2024-09-11T22:56:41.243 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-11T22:56:41.272 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-11T22:56:41.378 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901455 branch: squid description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/no} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/no 5-quiesce/no 6-workunit/postgres}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7901455' kernel: client: branch: testing kdb: 1 sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 5 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_export_ephemeral_random_max: 0.1 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc subvols: create: 2 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mntopts: - context=system_u:object_r:postgresql_db_t:s0 mount_subvol_num: 0 mountpoint: /tmp/cephfs check-counter: counters: mds: - mds.exported - mds.imported install: ceph: flavor: default sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc kclient: client.0: mntopts: - context=system_u:object_r:postgresql_db_t:s0 mount_subvol_num: 1 mountpoint: /tmp/cephfs mntopts: - ms_mode=legacy - nowsync syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 481 sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc sleep_before_teardown: 0 subset: 57/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi037.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDtIjzWC2c1YNj3nPraj9fEEzIB6Ttbih1b3VL6GPIvo48A/l93sDqZdIRJiFVyGRI/C74epaRFrOFVztj+0ErA= smithi123.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFGCnOKF8L04No9+t+S/HAMApFI3IuF+70EHVU5uARWRNDDiYiW4lRAFcnoFAy/+bIJniQEBtmM22vD/mR3mxDs= smithi160.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBF4vTIGC4Sl8xIkX22uNohlWp++Qiz/i6o3aLIkMOX54h0JcwR23uEque+09vz88Ed0z/U+9AdniWvAPqWgE5EA= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate false - ceph fs subvolumegroup pin cephfs qa random 0.10 - check-counter: {} - exec: client.0: - sudo ls -l /tmp/cephfs/ && sudo df -h /tmp/cephfs/ - sudo mkdir -m 755 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres && sudo chown postgres:postgres /tmp/cephfs/postgres - sudo -u postgres -- mkdir -m 700 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres/data - sudo semanage fcontext -a -t postgresql_db_t "/tmp/cephfs/postgres(/.*)?" - sudo grep -i postgresql /etc/selinux/targeted/contexts/files/file_contexts.local - sudo restorecon -R -v /tmp/cephfs/postgres - sudo ls -lZaR /tmp/cephfs/postgres/ - sudo mkdir -p /etc/systemd/system/postgresql.service.d/ && printf '[Service]\nEnvironment=PGDATA=/tmp/cephfs/postgres/data\nEnvironment=PGLOG=/tmp/cephfs/postgres/pgstartup.log\n' | sudo tee /etc/systemd/system/postgresql.service.d/env.conf - sudo -u postgres -- postgresql-setup --initdb - sudo ls -lZaR /tmp/cephfs/postgres/ - sudo systemctl start postgresql - sudo -u postgres -- pgbench -s 32 -i - sudo -u postgres -- pgbench -c 100 -j 4 --progress=5 --time=900 - sudo systemctl stop postgresql - sudo ls -lZaR /tmp/cephfs/postgres/ teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-11_21:24:17 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-11T22:56:41.378 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa; will attempt to use it 2024-09-11T22:56:41.379 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks 2024-09-11T22:56:41.379 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-11T22:56:41.381 INFO:teuthology.task.internal:Checking packages... 2024-09-11T22:56:41.403 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc' 2024-09-11T22:56:41.403 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-11T22:56:41.403 INFO:teuthology.packaging:ref: None 2024-09-11T22:56:41.403 INFO:teuthology.packaging:tag: None 2024-09-11T22:56:41.404 INFO:teuthology.packaging:branch: squid 2024-09-11T22:56:41.404 INFO:teuthology.packaging:sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T22:56:41.404 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-11T22:56:41.655 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-314.g086c737f 2024-09-11T22:56:41.656 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-11T22:56:41.663 INFO:teuthology.task.internal:no buildpackages task found 2024-09-11T22:56:41.663 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-11T22:56:41.810 INFO:teuthology.task.internal:Saving configuration 2024-09-11T22:56:41.831 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-11T22:56:42.271 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-11T22:56:42.299 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi037.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901455', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-11 22:51:41.287399', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDtIjzWC2c1YNj3nPraj9fEEzIB6Ttbih1b3VL6GPIvo48A/l93sDqZdIRJiFVyGRI/C74epaRFrOFVztj+0ErA='} 2024-09-11T22:56:42.332 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi123.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901455', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-11 22:51:41.289401', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFGCnOKF8L04No9+t+S/HAMApFI3IuF+70EHVU5uARWRNDDiYiW4lRAFcnoFAy/+bIJniQEBtmM22vD/mR3mxDs='} 2024-09-11T22:56:42.367 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi160.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901455', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-11 22:51:41.291119', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBF4vTIGC4Sl8xIkX22uNohlWp++Qiz/i6o3aLIkMOX54h0JcwR23uEque+09vz88Ed0z/U+9AdniWvAPqWgE5EA='} 2024-09-11T22:56:42.367 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-11T22:56:42.373 INFO:teuthology.task.internal:roles: ubuntu@smithi037.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-09-11T22:56:42.373 INFO:teuthology.task.internal:roles: ubuntu@smithi123.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-09-11T22:56:42.373 INFO:teuthology.task.internal:roles: ubuntu@smithi160.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-09-11T22:56:42.373 INFO:teuthology.run_tasks:Running task console_log... 2024-09-11T22:56:42.594 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f4ec926bbe0>, signals=[15]) 2024-09-11T22:56:42.594 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-11T22:56:42.884 INFO:teuthology.task.internal:Opening connections... 2024-09-11T22:56:42.884 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi037.front.sepia.ceph.com 2024-09-11T22:56:42.885 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T22:56:42.975 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi123.front.sepia.ceph.com 2024-09-11T22:56:42.976 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T22:56:43.058 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi160.front.sepia.ceph.com 2024-09-11T22:56:43.059 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T22:56:43.143 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-11T22:56:43.401 DEBUG:teuthology.orchestra.run.smithi037:> uname -m 2024-09-11T22:56:43.419 INFO:teuthology.orchestra.run.smithi037.stdout:x86_64 2024-09-11T22:56:43.420 DEBUG:teuthology.orchestra.run.smithi037:> cat /etc/os-release 2024-09-11T22:56:43.477 INFO:teuthology.orchestra.run.smithi037.stdout:NAME="CentOS Stream" 2024-09-11T22:56:43.477 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION="9" 2024-09-11T22:56:43.477 INFO:teuthology.orchestra.run.smithi037.stdout:ID="centos" 2024-09-11T22:56:43.477 INFO:teuthology.orchestra.run.smithi037.stdout:ID_LIKE="rhel fedora" 2024-09-11T22:56:43.477 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION_ID="9" 2024-09-11T22:56:43.477 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM_ID="platform:el9" 2024-09-11T22:56:43.477 INFO:teuthology.orchestra.run.smithi037.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-11T22:56:43.478 INFO:teuthology.orchestra.run.smithi037.stdout:ANSI_COLOR="0;31" 2024-09-11T22:56:43.478 INFO:teuthology.orchestra.run.smithi037.stdout:LOGO="fedora-logo-icon" 2024-09-11T22:56:43.478 INFO:teuthology.orchestra.run.smithi037.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-11T22:56:43.478 INFO:teuthology.orchestra.run.smithi037.stdout:HOME_URL="https://centos.org/" 2024-09-11T22:56:43.478 INFO:teuthology.orchestra.run.smithi037.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-11T22:56:43.478 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-11T22:56:43.478 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-11T22:56:43.479 INFO:teuthology.lock.ops:Updating smithi037.front.sepia.ceph.com on lock server 2024-09-11T22:56:43.511 DEBUG:teuthology.orchestra.run.smithi123:> uname -m 2024-09-11T22:56:43.530 INFO:teuthology.orchestra.run.smithi123.stdout:x86_64 2024-09-11T22:56:43.530 DEBUG:teuthology.orchestra.run.smithi123:> cat /etc/os-release 2024-09-11T22:56:43.588 INFO:teuthology.orchestra.run.smithi123.stdout:NAME="CentOS Stream" 2024-09-11T22:56:43.588 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION="9" 2024-09-11T22:56:43.589 INFO:teuthology.orchestra.run.smithi123.stdout:ID="centos" 2024-09-11T22:56:43.589 INFO:teuthology.orchestra.run.smithi123.stdout:ID_LIKE="rhel fedora" 2024-09-11T22:56:43.589 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION_ID="9" 2024-09-11T22:56:43.589 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM_ID="platform:el9" 2024-09-11T22:56:43.589 INFO:teuthology.orchestra.run.smithi123.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-11T22:56:43.589 INFO:teuthology.orchestra.run.smithi123.stdout:ANSI_COLOR="0;31" 2024-09-11T22:56:43.589 INFO:teuthology.orchestra.run.smithi123.stdout:LOGO="fedora-logo-icon" 2024-09-11T22:56:43.589 INFO:teuthology.orchestra.run.smithi123.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-11T22:56:43.589 INFO:teuthology.orchestra.run.smithi123.stdout:HOME_URL="https://centos.org/" 2024-09-11T22:56:43.589 INFO:teuthology.orchestra.run.smithi123.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-11T22:56:43.589 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-11T22:56:43.589 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-11T22:56:43.590 INFO:teuthology.lock.ops:Updating smithi123.front.sepia.ceph.com on lock server 2024-09-11T22:56:43.620 DEBUG:teuthology.orchestra.run.smithi160:> uname -m 2024-09-11T22:56:43.638 INFO:teuthology.orchestra.run.smithi160.stdout:x86_64 2024-09-11T22:56:43.638 DEBUG:teuthology.orchestra.run.smithi160:> cat /etc/os-release 2024-09-11T22:56:43.698 INFO:teuthology.orchestra.run.smithi160.stdout:NAME="CentOS Stream" 2024-09-11T22:56:43.698 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION="9" 2024-09-11T22:56:43.698 INFO:teuthology.orchestra.run.smithi160.stdout:ID="centos" 2024-09-11T22:56:43.698 INFO:teuthology.orchestra.run.smithi160.stdout:ID_LIKE="rhel fedora" 2024-09-11T22:56:43.698 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION_ID="9" 2024-09-11T22:56:43.698 INFO:teuthology.orchestra.run.smithi160.stdout:PLATFORM_ID="platform:el9" 2024-09-11T22:56:43.698 INFO:teuthology.orchestra.run.smithi160.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-11T22:56:43.698 INFO:teuthology.orchestra.run.smithi160.stdout:ANSI_COLOR="0;31" 2024-09-11T22:56:43.699 INFO:teuthology.orchestra.run.smithi160.stdout:LOGO="fedora-logo-icon" 2024-09-11T22:56:43.699 INFO:teuthology.orchestra.run.smithi160.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-11T22:56:43.699 INFO:teuthology.orchestra.run.smithi160.stdout:HOME_URL="https://centos.org/" 2024-09-11T22:56:43.699 INFO:teuthology.orchestra.run.smithi160.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-11T22:56:43.699 INFO:teuthology.orchestra.run.smithi160.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-11T22:56:43.699 INFO:teuthology.orchestra.run.smithi160.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-11T22:56:43.699 INFO:teuthology.lock.ops:Updating smithi160.front.sepia.ceph.com on lock server 2024-09-11T22:56:43.728 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-11T22:56:43.856 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-11T22:56:44.380 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-11T22:56:44.381 DEBUG:teuthology.orchestra.run.smithi037:> test '!' -e /home/ubuntu/cephtest 2024-09-11T22:56:44.383 DEBUG:teuthology.orchestra.run.smithi123:> test '!' -e /home/ubuntu/cephtest 2024-09-11T22:56:44.385 DEBUG:teuthology.orchestra.run.smithi160:> test '!' -e /home/ubuntu/cephtest 2024-09-11T22:56:44.403 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-11T22:56:44.969 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-11T22:56:44.969 DEBUG:teuthology.orchestra.run.smithi037:> test -z $(ls -A /var/lib/ceph) 2024-09-11T22:56:44.971 DEBUG:teuthology.orchestra.run.smithi123:> test -z $(ls -A /var/lib/ceph) 2024-09-11T22:56:44.974 DEBUG:teuthology.orchestra.run.smithi160:> test -z $(ls -A /var/lib/ceph) 2024-09-11T22:56:45.073 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-11T22:56:45.488 INFO:teuthology.run_tasks:Running task kernel... 2024-09-11T22:56:45.861 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-11T22:56:45.861 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2024-09-11T22:56:45.861 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2024-09-11T22:56:45.862 DEBUG:teuthology.orchestra.run.smithi037:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-11T22:56:45.879 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T22:56:45.880 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-09-11T22:56:46.060 DEBUG:teuthology.task.kernel:sha1 for client.0 is 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-11T22:56:46.061 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "2ca44a2f35ca8f36983aaaa46d49312239ef519a"... 2024-09-11T22:56:46.061 DEBUG:teuthology.orchestra.run.smithi037:> uname -r 2024-09-11T22:56:46.078 INFO:teuthology.orchestra.run.smithi037.stdout:5.14.0-503.el9.x86_64 2024-09-11T22:56:46.078 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-503.el9.x86_64 vs 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-11T22:56:46.079 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-09-11T22:56:46.079 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum upgrade -y linux-firmware 2024-09-11T22:56:48.438 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.2 MB 00:00 2024-09-11T22:56:50.197 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - AppStream 34 MB/s | 20 MB 00:00 2024-09-11T22:56:54.765 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.5 MB 00:00 2024-09-11T22:56:56.307 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - Extras packages 68 kB/s | 19 kB 00:00 2024-09-11T22:56:57.161 INFO:teuthology.orchestra.run.smithi037.stdout:Extra Packages for Enterprise Linux 31 MB/s | 23 MB 00:00 2024-09-11T22:57:02.809 INFO:teuthology.orchestra.run.smithi037.stdout:lab-extras 23 kB/s | 1.7 kB 00:00 2024-09-11T22:57:04.976 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-09-11T22:57:04.977 INFO:teuthology.orchestra.run.smithi037.stdout:Nothing to do. 2024-09-11T22:57:04.977 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-09-11T22:57:05.084 INFO:teuthology.task.kernel:Downloading kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.0... 2024-09-11T22:57:05.084 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-11T22:57:05.271 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ 2024-09-11T22:57:05.271 DEBUG:teuthology.orchestra.run.smithi037:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ --input-file=- 2024-09-11T22:57:05.275 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi037.front.sepia.ceph.com to complete... 2024-09-11T22:57:11.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11 22:57:11 URL:https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm [359633503/359633503] -> "/tmp/kernel.x86_64.rpm" [1] 2024-09-11T22:57:11.850 INFO:teuthology.orchestra.run.smithi037.stderr:FINISHED --2024-09-11 22:57:11-- 2024-09-11T22:57:11.850 INFO:teuthology.orchestra.run.smithi037.stderr:Total wall clock time: 6.5s 2024-09-11T22:57:11.850 INFO:teuthology.orchestra.run.smithi037.stderr:Downloaded: 1 files, 343M in 6.2s (55.3 MB/s) 2024-09-11T22:57:11.854 INFO:teuthology.task.kernel:Installing kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.0... 2024-09-11T22:57:11.855 DEBUG:teuthology.orchestra.run.smithi037:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-09-11T22:57:14.052 INFO:teuthology.orchestra.run.smithi037.stdout:Verifying... ######################################## 2024-09-11T22:57:14.193 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing... ######################################## 2024-09-11T22:57:14.311 INFO:teuthology.orchestra.run.smithi037.stdout:Updating / installing... 2024-09-11T22:57:22.628 INFO:teuthology.orchestra.run.smithi037.stdout:kernel-6.11.0_rc5_g2ca44a2f35ca-1 ######################################## 2024-09-11T22:58:02.533 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi037.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-09-11T22:58:02.533 DEBUG:teuthology.orchestra.run.smithi037:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-09-11T22:58:02.623 INFO:teuthology.orchestra.run.smithi037.stdout:/boot/System.map-6.11.0-rc5-g2ca44a2f35ca 2024-09-11T22:58:02.623 INFO:teuthology.orchestra.run.smithi037.stdout:/boot/config-6.11.0-rc5-g2ca44a2f35ca 2024-09-11T22:58:02.623 INFO:teuthology.orchestra.run.smithi037.stdout:/boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-11T22:58:02.624 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca 2024-09-11T22:58:02.624 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/System.map 2024-09-11T22:58:02.624 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/config 2024-09-11T22:58:02.624 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel 2024-09-11T22:58:02.624 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch 2024-09-11T22:58:02.624 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86 2024-09-11T22:58:02.624 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto 2024-09-11T22:58:02.624 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-09-11T22:58:02.624 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-09-11T22:58:02.624 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-09-11T22:58:02.624 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-09-11T22:58:02.625 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-09-11T22:58:02.625 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-09-11T22:58:02.625 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-09-11T22:58:02.625 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32c-intel.ko 2024-09-11T22:58:02.625 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-09-11T22:58:02.625 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-09-11T22:58:02.625 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-09-11T22:58:02.625 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-09-11T22:58:02.625 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx2.ko 2024-09-11T22:58:02.625 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-09-11T22:58:02.625 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-09-11T22:58:02.625 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-09-11T22:58:02.625 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-09-11T22:58:02.626 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-09-11T22:58:02.626 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-09-11T22:58:02.626 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-09-11T22:58:02.626 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel 2024-09-11T22:58:02.626 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu 2024-09-11T22:58:02.626 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce 2024-09-11T22:58:02.626 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-09-11T22:58:02.626 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm 2024-09-11T22:58:02.626 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-amd.ko 2024-09-11T22:58:02.626 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-intel.ko 2024-09-11T22:58:02.626 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm.ko 2024-09-11T22:58:02.626 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto 2024-09-11T22:58:02.627 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ansi_cprng.ko 2024-09-11T22:58:02.627 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/anubis.ko 2024-09-11T22:58:02.627 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/arc4.ko 2024-09-11T22:58:02.627 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx 2024-09-11T22:58:02.627 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_memcpy.ko 2024-09-11T22:58:02.627 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_pq.ko 2024-09-11T22:58:02.627 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_raid6_recov.ko 2024-09-11T22:58:02.627 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_tx.ko 2024-09-11T22:58:02.627 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_xor.ko 2024-09-11T22:58:02.627 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/raid6test.ko 2024-09-11T22:58:02.627 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authenc.ko 2024-09-11T22:58:02.627 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authencesn.ko 2024-09-11T22:58:02.627 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blake2b_generic.ko 2024-09-11T22:58:02.628 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_common.ko 2024-09-11T22:58:02.628 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_generic.ko 2024-09-11T22:58:02.628 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/camellia_generic.ko 2024-09-11T22:58:02.628 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast5_generic.ko 2024-09-11T22:58:02.628 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast6_generic.ko 2024-09-11T22:58:02.628 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast_common.ko 2024-09-11T22:58:02.628 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ccm.ko 2024-09-11T22:58:02.628 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cmac.ko 2024-09-11T22:58:02.628 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crc32_generic.ko 2024-09-11T22:58:02.628 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_engine.ko 2024-09-11T22:58:02.628 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_user.ko 2024-09-11T22:58:02.628 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cts.ko 2024-09-11T22:58:02.628 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/des_generic.ko 2024-09-11T22:58:02.629 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/dh_generic.ko 2024-09-11T22:58:02.629 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecc.ko 2024-09-11T22:58:02.629 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecdh_generic.ko 2024-09-11T22:58:02.629 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/echainiv.ko 2024-09-11T22:58:02.629 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/essiv.ko 2024-09-11T22:58:02.629 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/fcrypt.ko 2024-09-11T22:58:02.629 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/khazad.ko 2024-09-11T22:58:02.629 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4.ko 2024-09-11T22:58:02.629 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4hc.ko 2024-09-11T22:58:02.629 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/md4.ko 2024-09-11T22:58:02.629 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/michael_mic.ko 2024-09-11T22:58:02.629 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcbc.ko 2024-09-11T22:58:02.629 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcrypt.ko 2024-09-11T22:58:02.629 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/rmd160.ko 2024-09-11T22:58:02.630 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/seed.ko 2024-09-11T22:58:02.630 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/serpent_generic.ko 2024-09-11T22:58:02.630 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tcrypt.ko 2024-09-11T22:58:02.630 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tea.ko 2024-09-11T22:58:02.630 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_common.ko 2024-09-11T22:58:02.630 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_generic.ko 2024-09-11T22:58:02.630 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/vmac.ko 2024-09-11T22:58:02.630 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/wp512.ko 2024-09-11T22:58:02.630 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xcbc.ko 2024-09-11T22:58:02.630 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xor.ko 2024-09-11T22:58:02.630 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xxhash_generic.ko 2024-09-11T22:58:02.630 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers 2024-09-11T22:58:02.630 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi 2024-09-11T22:58:02.631 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_ipmi.ko 2024-09-11T22:58:02.631 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_pad.ko 2024-09-11T22:58:02.631 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ec_sys.ko 2024-09-11T22:58:02.631 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/platform_profile.ko 2024-09-11T22:58:02.631 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbs.ko 2024-09-11T22:58:02.631 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbshc.ko 2024-09-11T22:58:02.631 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/video.ko 2024-09-11T22:58:02.631 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata 2024-09-11T22:58:02.631 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/acard-ahci.ko 2024-09-11T22:58:02.631 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci_platform.ko 2024-09-11T22:58:02.631 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ata_generic.ko 2024-09-11T22:58:02.631 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci_platform.ko 2024-09-11T22:58:02.631 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_acpi.ko 2024-09-11T22:58:02.631 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ali.ko 2024-09-11T22:58:02.632 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_amd.ko 2024-09-11T22:58:02.632 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_artop.ko 2024-09-11T22:58:02.632 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atiixp.ko 2024-09-11T22:58:02.632 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atp867x.ko 2024-09-11T22:58:02.632 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd640.ko 2024-09-11T22:58:02.632 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd64x.ko 2024-09-11T22:58:02.632 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cypress.ko 2024-09-11T22:58:02.632 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_efar.ko 2024-09-11T22:58:02.632 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt366.ko 2024-09-11T22:58:02.632 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt37x.ko 2024-09-11T22:58:02.632 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x2n.ko 2024-09-11T22:58:02.632 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x3.ko 2024-09-11T22:58:02.632 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it8213.ko 2024-09-11T22:58:02.632 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it821x.ko 2024-09-11T22:58:02.633 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_jmicron.ko 2024-09-11T22:58:02.633 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_marvell.ko 2024-09-11T22:58:02.633 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_mpiix.ko 2024-09-11T22:58:02.633 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_netcell.ko 2024-09-11T22:58:02.633 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ninja32.ko 2024-09-11T22:58:02.633 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87410.ko 2024-09-11T22:58:02.633 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87415.ko 2024-09-11T22:58:02.633 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_oldpiix.ko 2024-09-11T22:58:02.633 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_opti.ko 2024-09-11T22:58:02.633 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_optidma.ko 2024-09-11T22:58:02.633 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pcmcia.ko 2024-09-11T22:58:02.633 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc2027x.ko 2024-09-11T22:58:02.633 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-09-11T22:58:02.634 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_piccolo.ko 2024-09-11T22:58:02.634 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rdc.ko 2024-09-11T22:58:02.634 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sch.ko 2024-09-11T22:58:02.634 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_serverworks.ko 2024-09-11T22:58:02.634 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sil680.ko 2024-09-11T22:58:02.634 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sis.ko 2024-09-11T22:58:02.634 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sl82c105.ko 2024-09-11T22:58:02.634 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_triflex.ko 2024-09-11T22:58:02.634 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_via.ko 2024-09-11T22:58:02.634 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pdc_adma.ko 2024-09-11T22:58:02.634 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_inic162x.ko 2024-09-11T22:58:02.634 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_mv.ko 2024-09-11T22:58:02.634 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_nv.ko 2024-09-11T22:58:02.635 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_promise.ko 2024-09-11T22:58:02.635 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_qstor.ko 2024-09-11T22:58:02.635 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil.ko 2024-09-11T22:58:02.635 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil24.ko 2024-09-11T22:58:02.635 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sis.ko 2024-09-11T22:58:02.635 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_svw.ko 2024-09-11T22:58:02.635 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sx4.ko 2024-09-11T22:58:02.635 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_uli.ko 2024-09-11T22:58:02.635 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_via.ko 2024-09-11T22:58:02.635 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_vsc.ko 2024-09-11T22:58:02.635 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay 2024-09-11T22:58:02.635 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ks0108.ko 2024-09-11T22:58:02.635 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base 2024-09-11T22:58:02.636 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap 2024-09-11T22:58:02.636 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-i2c.ko 2024-09-11T22:58:02.636 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-mmio.ko 2024-09-11T22:58:02.636 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma 2024-09-11T22:58:02.636 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/bcma.ko 2024-09-11T22:58:02.636 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block 2024-09-11T22:58:02.636 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe 2024-09-11T22:58:02.636 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/aoe.ko 2024-09-11T22:58:02.636 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/brd.ko 2024-09-11T22:58:02.636 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd 2024-09-11T22:58:02.637 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/drbd.ko 2024-09-11T22:58:02.637 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/floppy.ko 2024-09-11T22:58:02.637 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/loop.ko 2024-09-11T22:58:02.637 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx 2024-09-11T22:58:02.637 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-09-11T22:58:02.637 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/nbd.ko 2024-09-11T22:58:02.637 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk 2024-09-11T22:58:02.637 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/null_blk.ko 2024-09-11T22:58:02.637 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/pktcdvd.ko 2024-09-11T22:58:02.637 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/rbd.ko 2024-09-11T22:58:02.637 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/virtio_blk.ko 2024-09-11T22:58:02.637 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback 2024-09-11T22:58:02.638 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-09-11T22:58:02.638 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkfront.ko 2024-09-11T22:58:02.638 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram 2024-09-11T22:58:02.638 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/zram.ko 2024-09-11T22:58:02.638 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char 2024-09-11T22:58:02.638 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hangcheck-timer.ko 2024-09-11T22:58:02.638 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random 2024-09-11T22:58:02.638 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/amd-rng.ko 2024-09-11T22:58:02.638 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/intel-rng.ko 2024-09-11T22:58:02.639 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-09-11T22:58:02.639 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/via-rng.ko 2024-09-11T22:58:02.639 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/virtio-rng.ko 2024-09-11T22:58:02.639 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi 2024-09-11T22:58:02.639 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-09-11T22:58:02.639 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-09-11T22:58:02.639 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-09-11T22:58:02.639 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_si.ko 2024-09-11T22:58:02.639 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-09-11T22:58:02.639 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-09-11T22:58:02.639 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/lp.ko 2024-09-11T22:58:02.639 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave 2024-09-11T22:58:02.639 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/mwave.ko 2024-09-11T22:58:02.640 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ppdev.ko 2024-09-11T22:58:02.640 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tlclk.ko 2024-09-11T22:58:02.640 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm 2024-09-11T22:58:02.640 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm.ko 2024-09-11T22:58:02.640 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_atmel.ko 2024-09-11T22:58:02.640 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_infineon.ko 2024-09-11T22:58:02.640 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_nsc.ko 2024-09-11T22:58:02.640 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis.ko 2024-09-11T22:58:02.640 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-09-11T22:58:02.640 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/uv_mmtimer.ko 2024-09-11T22:58:02.640 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/virtio_console.ko 2024-09-11T22:58:02.640 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq 2024-09-11T22:58:02.640 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-09-11T22:58:02.641 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-09-11T22:58:02.641 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/p4-clockmod.ko 2024-09-11T22:58:02.641 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-09-11T22:58:02.641 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/powernow-k8.ko 2024-09-11T22:58:02.641 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/speedstep-lib.ko 2024-09-11T22:58:02.641 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto 2024-09-11T22:58:02.641 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp 2024-09-11T22:58:02.641 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-09-11T22:58:02.641 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp.ko 2024-09-11T22:58:02.641 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel 2024-09-11T22:58:02.641 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat 2024-09-11T22:58:02.641 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common 2024-09-11T22:58:02.641 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-09-11T22:58:02.642 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-09-11T22:58:02.642 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-09-11T22:58:02.642 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-aes.ko 2024-09-11T22:58:02.642 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-sha.ko 2024-09-11T22:58:02.642 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio 2024-09-11T22:58:02.642 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-09-11T22:58:02.642 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca 2024-09-11T22:58:02.642 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/dca.ko 2024-09-11T22:58:02.642 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq 2024-09-11T22:58:02.642 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-09-11T22:58:02.642 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma 2024-09-11T22:58:02.642 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw 2024-09-11T22:58:02.642 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/dw_dmac.ko 2024-09-11T22:58:02.643 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat 2024-09-11T22:58:02.643 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ioatdma.ko 2024-09-11T22:58:02.643 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac 2024-09-11T22:58:02.643 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/amd64_edac.ko 2024-09-11T22:58:02.643 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/e752x_edac.ko 2024-09-11T22:58:02.643 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/edac_mce_amd.ko 2024-09-11T22:58:02.643 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3000_edac.ko 2024-09-11T22:58:02.643 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3200_edac.ko 2024-09-11T22:58:02.643 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5100_edac.ko 2024-09-11T22:58:02.643 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5400_edac.ko 2024-09-11T22:58:02.643 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7300_edac.ko 2024-09-11T22:58:02.643 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7core_edac.ko 2024-09-11T22:58:02.643 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i82975x_edac.ko 2024-09-11T22:58:02.644 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ie31200_edac.ko 2024-09-11T22:58:02.644 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/sb_edac.ko 2024-09-11T22:58:02.644 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/x38_edac.ko 2024-09-11T22:58:02.644 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware 2024-09-11T22:58:02.644 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/edd.ko 2024-09-11T22:58:02.644 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/iscsi_ibft.ko 2024-09-11T22:58:02.644 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio 2024-09-11T22:58:02.644 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ich.ko 2024-09-11T22:58:02.644 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-viperboard.ko 2024-09-11T22:58:02.644 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid 2024-09-11T22:58:02.644 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-appleir.ko 2024-09-11T22:58:02.644 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-aureal.ko 2024-09-11T22:58:02.644 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-axff.ko 2024-09-11T22:58:02.645 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-dr.ko 2024-09-11T22:58:02.645 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elecom.ko 2024-09-11T22:58:02.645 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elo.ko 2024-09-11T22:58:02.645 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-emsff.ko 2024-09-11T22:58:02.645 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gaff.ko 2024-09-11T22:58:02.645 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gt683r.ko 2024-09-11T22:58:02.645 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gyration.ko 2024-09-11T22:58:02.645 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-kbd.ko 2024-09-11T22:58:02.645 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-mouse.ko 2024-09-11T22:58:02.645 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtekff.ko 2024-09-11T22:58:02.645 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-hyperv.ko 2024-09-11T22:58:02.645 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-icade.ko 2024-09-11T22:58:02.645 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-keytouch.ko 2024-09-11T22:58:02.646 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kye.ko 2024-09-11T22:58:02.646 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lcpower.ko 2024-09-11T22:58:02.646 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-led.ko 2024-09-11T22:58:02.646 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lenovo.ko 2024-09-11T22:58:02.646 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-dj.ko 2024-09-11T22:58:02.646 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-09-11T22:58:02.646 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-multitouch.ko 2024-09-11T22:58:02.646 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ortek.ko 2024-09-11T22:58:02.646 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-penmount.ko 2024-09-11T22:58:02.646 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-petalynx.ko 2024-09-11T22:58:02.646 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-picolcd.ko 2024-09-11T22:58:02.646 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-pl.ko 2024-09-11T22:58:02.646 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-plantronics.ko 2024-09-11T22:58:02.647 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-primax.ko 2024-09-11T22:58:02.647 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-rmi.ko 2024-09-11T22:58:02.647 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-arvo.ko 2024-09-11T22:58:02.647 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-common.ko 2024-09-11T22:58:02.647 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-isku.ko 2024-09-11T22:58:02.647 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kone.ko 2024-09-11T22:58:02.647 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-09-11T22:58:02.647 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-konepure.ko 2024-09-11T22:58:02.647 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-09-11T22:58:02.647 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-lua.ko 2024-09-11T22:58:02.647 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-pyra.ko 2024-09-11T22:58:02.647 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-ryos.ko 2024-09-11T22:58:02.648 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-savu.ko 2024-09-11T22:58:02.648 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat.ko 2024-09-11T22:58:02.648 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-saitek.ko 2024-09-11T22:58:02.648 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-samsung.ko 2024-09-11T22:58:02.648 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sensor-hub.ko 2024-09-11T22:58:02.648 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sjoy.ko 2024-09-11T22:58:02.648 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sony.ko 2024-09-11T22:58:02.648 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-speedlink.ko 2024-09-11T22:58:02.648 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-steelseries.ko 2024-09-11T22:58:02.648 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sunplus.ko 2024-09-11T22:58:02.648 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-thrustmaster.ko 2024-09-11T22:58:02.648 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tivo.ko 2024-09-11T22:58:02.648 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tmff.ko 2024-09-11T22:58:02.649 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-topseed.ko 2024-09-11T22:58:02.649 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-twinhan.ko 2024-09-11T22:58:02.649 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-uclogic.ko 2024-09-11T22:58:02.649 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-waltop.ko 2024-09-11T22:58:02.649 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-wiimote.ko 2024-09-11T22:58:02.649 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-xinmo.ko 2024-09-11T22:58:02.649 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zpff.ko 2024-09-11T22:58:02.649 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zydacron.ko 2024-09-11T22:58:02.649 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/uhid.ko 2024-09-11T22:58:02.649 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/wacom.ko 2024-09-11T22:58:02.649 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv 2024-09-11T22:58:02.649 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_balloon.ko 2024-09-11T22:58:02.649 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_utils.ko 2024-09-11T22:58:02.650 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_vmbus.ko 2024-09-11T22:58:02.650 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon 2024-09-11T22:58:02.650 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru.ko 2024-09-11T22:58:02.650 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru3.ko 2024-09-11T22:58:02.650 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/acpi_power_meter.ko 2024-09-11T22:58:02.650 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7414.ko 2024-09-11T22:58:02.650 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7418.ko 2024-09-11T22:58:02.650 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adc128d818.ko 2024-09-11T22:58:02.650 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1025.ko 2024-09-11T22:58:02.650 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1026.ko 2024-09-11T22:58:02.650 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1029.ko 2024-09-11T22:58:02.650 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1031.ko 2024-09-11T22:58:02.650 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm9240.ko 2024-09-11T22:58:02.650 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ads7828.ko 2024-09-11T22:58:02.651 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7410.ko 2024-09-11T22:58:02.651 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7411.ko 2024-09-11T22:58:02.651 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7462.ko 2024-09-11T22:58:02.651 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7470.ko 2024-09-11T22:58:02.651 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7475.ko 2024-09-11T22:58:02.651 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7x10.ko 2024-09-11T22:58:02.651 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/amc6821.ko 2024-09-11T22:58:02.651 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/applesmc.ko 2024-09-11T22:58:02.651 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asb100.ko 2024-09-11T22:58:02.651 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asc7621.ko 2024-09-11T22:58:02.651 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asus_atk0110.ko 2024-09-11T22:58:02.651 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/atxp1.ko 2024-09-11T22:58:02.651 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/coretemp.ko 2024-09-11T22:58:02.652 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-09-11T22:58:02.652 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dme1737.ko 2024-09-11T22:58:02.652 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds1621.ko 2024-09-11T22:58:02.652 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds620.ko 2024-09-11T22:58:02.652 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc1403.ko 2024-09-11T22:58:02.652 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc6w201.ko 2024-09-11T22:58:02.652 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71805f.ko 2024-09-11T22:58:02.652 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71882fg.ko 2024-09-11T22:58:02.652 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f75375s.ko 2024-09-11T22:58:02.652 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fam15h_power.ko 2024-09-11T22:58:02.652 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fschmd.ko 2024-09-11T22:58:02.652 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g760a.ko 2024-09-11T22:58:02.652 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g762.ko 2024-09-11T22:58:02.653 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl518sm.ko 2024-09-11T22:58:02.653 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl520sm.ko 2024-09-11T22:58:02.653 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hwmon-vid.ko 2024-09-11T22:58:02.653 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5500_temp.ko 2024-09-11T22:58:02.653 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5k_amb.ko 2024-09-11T22:58:02.653 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmaem.ko 2024-09-11T22:58:02.653 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmpex.ko 2024-09-11T22:58:02.653 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina209.ko 2024-09-11T22:58:02.653 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina2xx.ko 2024-09-11T22:58:02.653 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/it87.ko 2024-09-11T22:58:02.653 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k10temp.ko 2024-09-11T22:58:02.653 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k8temp.ko 2024-09-11T22:58:02.654 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lineage-pem.ko 2024-09-11T22:58:02.654 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm63.ko 2024-09-11T22:58:02.654 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm73.ko 2024-09-11T22:58:02.654 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm75.ko 2024-09-11T22:58:02.654 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm77.ko 2024-09-11T22:58:02.654 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm78.ko 2024-09-11T22:58:02.654 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm80.ko 2024-09-11T22:58:02.654 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm83.ko 2024-09-11T22:58:02.654 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm85.ko 2024-09-11T22:58:02.654 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm87.ko 2024-09-11T22:58:02.654 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm90.ko 2024-09-11T22:58:02.654 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm92.ko 2024-09-11T22:58:02.654 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm93.ko 2024-09-11T22:58:02.654 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95234.ko 2024-09-11T22:58:02.655 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95241.ko 2024-09-11T22:58:02.655 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95245.ko 2024-09-11T22:58:02.655 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc2945.ko 2024-09-11T22:58:02.655 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4151.ko 2024-09-11T22:58:02.655 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4215.ko 2024-09-11T22:58:02.655 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4222.ko 2024-09-11T22:58:02.655 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4245.ko 2024-09-11T22:58:02.655 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4260.ko 2024-09-11T22:58:02.655 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4261.ko 2024-09-11T22:58:02.655 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max16065.ko 2024-09-11T22:58:02.655 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1619.ko 2024-09-11T22:58:02.655 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1668.ko 2024-09-11T22:58:02.655 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max197.ko 2024-09-11T22:58:02.656 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6639.ko 2024-09-11T22:58:02.656 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6650.ko 2024-09-11T22:58:02.656 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6697.ko 2024-09-11T22:58:02.656 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mcp3021.ko 2024-09-11T22:58:02.656 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6683.ko 2024-09-11T22:58:02.656 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775-core.ko 2024-09-11T22:58:02.656 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775.ko 2024-09-11T22:58:02.656 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct7802.ko 2024-09-11T22:58:02.656 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87360.ko 2024-09-11T22:58:02.656 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87427.ko 2024-09-11T22:58:02.656 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pcf8591.ko 2024-09-11T22:58:02.656 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus 2024-09-11T22:58:02.656 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-09-11T22:58:02.657 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-09-11T22:58:02.657 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-09-11T22:58:02.657 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max16064.ko 2024-09-11T22:58:02.657 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max34440.ko 2024-09-11T22:58:02.657 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max8688.ko 2024-09-11T22:58:02.657 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-09-11T22:58:02.657 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-09-11T22:58:02.657 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-09-11T22:58:02.657 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-09-11T22:58:02.657 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-09-11T22:58:02.657 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-09-11T22:58:02.657 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/powr1220.ko 2024-09-11T22:58:02.657 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5627.ko 2024-09-11T22:58:02.658 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5636.ko 2024-09-11T22:58:02.658 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch56xx-common.ko 2024-09-11T22:58:02.658 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht15.ko 2024-09-11T22:58:02.658 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht21.ko 2024-09-11T22:58:02.658 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/shtc1.ko 2024-09-11T22:58:02.658 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sis5595.ko 2024-09-11T22:58:02.658 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47b397.ko 2024-09-11T22:58:02.658 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m1.ko 2024-09-11T22:58:02.658 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m192.ko 2024-09-11T22:58:02.658 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/thmc50.ko 2024-09-11T22:58:02.658 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp102.ko 2024-09-11T22:58:02.658 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp103.ko 2024-09-11T22:58:02.658 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp401.ko 2024-09-11T22:58:02.658 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp421.ko 2024-09-11T22:58:02.659 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via-cputemp.ko 2024-09-11T22:58:02.659 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via686a.ko 2024-09-11T22:58:02.659 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt1211.ko 2024-09-11T22:58:02.659 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt8231.ko 2024-09-11T22:58:02.659 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627ehf.ko 2024-09-11T22:58:02.659 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627hf.ko 2024-09-11T22:58:02.659 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83781d.ko 2024-09-11T22:58:02.659 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83791d.ko 2024-09-11T22:58:02.659 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83792d.ko 2024-09-11T22:58:02.659 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83793.ko 2024-09-11T22:58:02.659 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83795.ko 2024-09-11T22:58:02.659 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l785ts.ko 2024-09-11T22:58:02.659 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l786ng.ko 2024-09-11T22:58:02.660 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c 2024-09-11T22:58:02.660 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos 2024-09-11T22:58:02.660 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-09-11T22:58:02.660 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-09-11T22:58:02.660 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses 2024-09-11T22:58:02.660 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-09-11T22:58:02.660 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-09-11T22:58:02.660 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-09-11T22:58:02.660 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-09-11T22:58:02.660 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-09-11T22:58:02.660 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-09-11T22:58:02.660 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-09-11T22:58:02.660 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-09-11T22:58:02.661 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-i801.ko 2024-09-11T22:58:02.661 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-isch.ko 2024-09-11T22:58:02.661 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-09-11T22:58:02.661 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-09-11T22:58:02.661 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-09-11T22:58:02.661 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-parport.ko 2024-09-11T22:58:02.661 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-09-11T22:58:02.661 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-09-11T22:58:02.661 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-09-11T22:58:02.661 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-09-11T22:58:02.661 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-09-11T22:58:02.661 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-09-11T22:58:02.661 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-via.ko 2024-09-11T22:58:02.662 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-09-11T22:58:02.662 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-09-11T22:58:02.662 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-dev.ko 2024-09-11T22:58:02.662 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-mux.ko 2024-09-11T22:58:02.662 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-09-11T22:58:02.662 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-smbus.ko 2024-09-11T22:58:02.662 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-stub.ko 2024-09-11T22:58:02.662 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband 2024-09-11T22:58:02.662 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core 2024-09-11T22:58:02.662 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_cm.ko 2024-09-11T22:58:02.662 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_core.ko 2024-09-11T22:58:02.662 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_umad.ko 2024-09-11T22:58:02.662 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-09-11T22:58:02.663 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/iw_cm.ko 2024-09-11T22:58:02.663 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_cm.ko 2024-09-11T22:58:02.663 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-09-11T22:58:02.663 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw 2024-09-11T22:58:02.663 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4 2024-09-11T22:58:02.663 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-09-11T22:58:02.663 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4 2024-09-11T22:58:02.663 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-09-11T22:58:02.663 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5 2024-09-11T22:58:02.663 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-09-11T22:58:02.663 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca 2024-09-11T22:58:02.663 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-09-11T22:58:02.663 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp 2024-09-11T22:58:02.663 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib 2024-09-11T22:58:02.664 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-09-11T22:58:02.664 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser 2024-09-11T22:58:02.664 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-09-11T22:58:02.664 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert 2024-09-11T22:58:02.664 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-09-11T22:58:02.664 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp 2024-09-11T22:58:02.664 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-09-11T22:58:02.664 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt 2024-09-11T22:58:02.664 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-09-11T22:58:02.664 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input 2024-09-11T22:58:02.664 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport 2024-09-11T22:58:02.664 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-09-11T22:58:02.664 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/fm801-gp.ko 2024-09-11T22:58:02.665 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/gameport.ko 2024-09-11T22:58:02.665 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/joydev.ko 2024-09-11T22:58:02.665 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard 2024-09-11T22:58:02.665 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys.ko 2024-09-11T22:58:02.665 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse 2024-09-11T22:58:02.665 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/appletouch.ko 2024-09-11T22:58:02.665 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/bcm5974.ko 2024-09-11T22:58:02.665 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/cyapatp.ko 2024-09-11T22:58:02.665 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/elan_i2c.ko 2024-09-11T22:58:02.665 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/sermouse.ko 2024-09-11T22:58:02.665 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-09-11T22:58:02.665 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_usb.ko 2024-09-11T22:58:02.665 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/vsxxxaa.ko 2024-09-11T22:58:02.665 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4 2024-09-11T22:58:02.666 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/rmi_core.ko 2024-09-11T22:58:02.666 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio 2024-09-11T22:58:02.666 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/altera_ps2.ko 2024-09-11T22:58:02.666 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/arc_ps2.ko 2024-09-11T22:58:02.666 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-09-11T22:58:02.666 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serio_raw.ko 2024-09-11T22:58:02.666 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/sparse-keymap.ko 2024-09-11T22:58:02.666 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds 2024-09-11T22:58:02.666 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-blinkm.ko 2024-09-11T22:58:02.666 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3530.ko 2024-09-11T22:58:02.666 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp3944.ko 2024-09-11T22:58:02.666 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-ss4200.ko 2024-09-11T22:58:02.666 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger 2024-09-11T22:58:02.666 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-09-11T22:58:02.667 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-09-11T22:58:02.667 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-09-11T22:58:02.667 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-09-11T22:58:02.667 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-09-11T22:58:02.667 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-09-11T22:58:02.667 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-09-11T22:58:02.667 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-09-11T22:58:02.667 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md 2024-09-11T22:58:02.667 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache 2024-09-11T22:58:02.667 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/bcache.ko 2024-09-11T22:58:02.667 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bio-prison.ko 2024-09-11T22:58:02.667 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache-smq.ko 2024-09-11T22:58:02.667 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache.ko 2024-09-11T22:58:02.667 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-crypt.ko 2024-09-11T22:58:02.668 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-delay.ko 2024-09-11T22:58:02.668 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-flakey.ko 2024-09-11T22:58:02.668 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log-userspace.ko 2024-09-11T22:58:02.668 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-multipath.ko 2024-09-11T22:58:02.668 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-queue-length.ko 2024-09-11T22:58:02.668 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-raid.ko 2024-09-11T22:58:02.668 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-round-robin.ko 2024-09-11T22:58:02.668 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-service-time.ko 2024-09-11T22:58:02.668 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-switch.ko 2024-09-11T22:58:02.668 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-thin-pool.ko 2024-09-11T22:58:02.668 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-verity.ko 2024-09-11T22:58:02.669 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data 2024-09-11T22:58:02.669 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-09-11T22:58:02.669 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid0.ko 2024-09-11T22:58:02.669 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid1.ko 2024-09-11T22:58:02.669 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid10.ko 2024-09-11T22:58:02.669 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid456.ko 2024-09-11T22:58:02.669 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message 2024-09-11T22:58:02.669 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion 2024-09-11T22:58:02.669 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptbase.ko 2024-09-11T22:58:02.669 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptctl.ko 2024-09-11T22:58:02.669 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptfc.ko 2024-09-11T22:58:02.669 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptlan.ko 2024-09-11T22:58:02.669 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptsas.ko 2024-09-11T22:58:02.670 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptscsih.ko 2024-09-11T22:58:02.670 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptspi.ko 2024-09-11T22:58:02.670 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd 2024-09-11T22:58:02.670 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_ich.ko 2024-09-11T22:58:02.670 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_sch.ko 2024-09-11T22:58:02.670 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mfd-core.ko 2024-09-11T22:58:02.670 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/sm501.ko 2024-09-11T22:58:02.670 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/viperboard.ko 2024-09-11T22:58:02.670 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/vx855.ko 2024-09-11T22:58:02.670 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wl1273-core.ko 2024-09-11T22:58:02.670 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc 2024-09-11T22:58:02.670 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl 2024-09-11T22:58:02.670 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-09-11T22:58:02.671 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds9802als.ko 2024-09-11T22:58:02.671 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds990x.ko 2024-09-11T22:58:02.671 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/bh1770glc.ko 2024-09-11T22:58:02.671 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710 2024-09-11T22:58:02.671 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/cb710.ko 2024-09-11T22:58:02.671 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom 2024-09-11T22:58:02.671 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/at24.ko 2024-09-11T22:58:02.671 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-09-11T22:58:02.671 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/max6875.ko 2024-09-11T22:58:02.671 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/enclosure.ko 2024-09-11T22:58:02.671 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hpilo.ko 2024-09-11T22:58:02.671 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29003.ko 2024-09-11T22:58:02.672 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29020.ko 2024-09-11T22:58:02.672 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d 2024-09-11T22:58:02.672 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-09-11T22:58:02.672 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-09-11T22:58:02.672 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei 2024-09-11T22:58:02.672 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-me.ko 2024-09-11T22:58:02.672 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-txe.ko 2024-09-11T22:58:02.672 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei.ko 2024-09-11T22:58:02.672 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru 2024-09-11T22:58:02.672 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru/gru.ko 2024-09-11T22:58:02.673 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp 2024-09-11T22:58:02.673 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xp.ko 2024-09-11T22:58:02.673 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpc.ko 2024-09-11T22:58:02.673 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-09-11T22:58:02.673 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_7xx1.ko 2024-09-11T22:58:02.673 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_core.ko 2024-09-11T22:58:02.673 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tsl2550.ko 2024-09-11T22:58:02.673 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_balloon.ko 2024-09-11T22:58:02.673 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci 2024-09-11T22:58:02.673 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-09-11T22:58:02.674 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net 2024-09-11T22:58:02.674 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding 2024-09-11T22:58:02.674 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/bonding.ko 2024-09-11T22:58:02.674 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa 2024-09-11T22:58:02.674 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53 2024-09-11T22:58:02.674 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/b53_common.ko 2024-09-11T22:58:02.674 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/bcm-sf2.ko 2024-09-11T22:58:02.674 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6060.ko 2024-09-11T22:58:02.674 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx 2024-09-11T22:58:02.674 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-09-11T22:58:02.674 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dummy.ko 2024-09-11T22:58:02.674 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/eql.ko 2024-09-11T22:58:02.674 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet 2024-09-11T22:58:02.675 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com 2024-09-11T22:58:02.675 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-09-11T22:58:02.675 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-09-11T22:58:02.675 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-09-11T22:58:02.675 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-09-11T22:58:02.675 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390 2024-09-11T22:58:02.675 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/8390.ko 2024-09-11T22:58:02.675 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-09-11T22:58:02.675 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-09-11T22:58:02.675 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-09-11T22:58:02.675 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec 2024-09-11T22:58:02.675 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-09-11T22:58:02.675 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere 2024-09-11T22:58:02.675 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/et131x.ko 2024-09-11T22:58:02.676 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon 2024-09-11T22:58:02.676 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-09-11T22:58:02.676 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera 2024-09-11T22:58:02.676 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-09-11T22:58:02.676 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd 2024-09-11T22:58:02.676 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-09-11T22:58:02.676 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-09-11T22:58:02.676 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-09-11T22:58:02.676 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros 2024-09-11T22:58:02.676 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx 2024-09-11T22:58:02.676 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-09-11T22:58:02.676 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c 2024-09-11T22:58:02.676 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-09-11T22:58:02.677 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e 2024-09-11T22:58:02.677 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-09-11T22:58:02.677 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx 2024-09-11T22:58:02.677 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-09-11T22:58:02.677 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-09-11T22:58:02.677 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom 2024-09-11T22:58:02.677 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-09-11T22:58:02.677 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-09-11T22:58:02.677 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-09-11T22:58:02.677 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-09-11T22:58:02.677 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-09-11T22:58:02.677 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet 2024-09-11T22:58:02.678 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-09-11T22:58:02.678 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-09-11T22:58:02.678 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade 2024-09-11T22:58:02.678 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna 2024-09-11T22:58:02.678 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-09-11T22:58:02.678 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio 2024-09-11T22:58:02.678 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb 2024-09-11T22:58:02.678 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-09-11T22:58:02.678 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-09-11T22:58:02.678 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-09-11T22:58:02.678 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-09-11T22:58:02.678 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-09-11T22:58:02.678 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-09-11T22:58:02.679 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-09-11T22:58:02.679 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-09-11T22:58:02.679 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-09-11T22:58:02.679 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco 2024-09-11T22:58:02.679 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic 2024-09-11T22:58:02.679 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-09-11T22:58:02.679 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec 2024-09-11T22:58:02.679 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip 2024-09-11T22:58:02.679 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-09-11T22:58:02.679 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-09-11T22:58:02.679 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-09-11T22:58:02.679 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-09-11T22:58:02.679 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-09-11T22:58:02.680 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-09-11T22:58:02.680 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink 2024-09-11T22:58:02.680 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-09-11T22:58:02.680 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-09-11T22:58:02.680 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dnet.ko 2024-09-11T22:58:02.680 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex 2024-09-11T22:58:02.680 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet 2024-09-11T22:58:02.680 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-09-11T22:58:02.680 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ethoc.ko 2024-09-11T22:58:02.680 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fealnx.ko 2024-09-11T22:58:02.680 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel 2024-09-11T22:58:02.680 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e100.ko 2024-09-11T22:58:02.680 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000 2024-09-11T22:58:02.681 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-09-11T22:58:02.681 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e 2024-09-11T22:58:02.681 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-09-11T22:58:02.681 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k 2024-09-11T22:58:02.681 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-09-11T22:58:02.681 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e 2024-09-11T22:58:02.681 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-09-11T22:58:02.681 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf 2024-09-11T22:58:02.681 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-09-11T22:58:02.681 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb 2024-09-11T22:58:02.681 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-09-11T22:58:02.681 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf 2024-09-11T22:58:02.681 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-09-11T22:58:02.681 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe 2024-09-11T22:58:02.682 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-09-11T22:58:02.682 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf 2024-09-11T22:58:02.682 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-09-11T22:58:02.682 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth 2024-09-11T22:58:02.682 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-09-11T22:58:02.682 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie 2024-09-11T22:58:02.682 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-09-11T22:58:02.682 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/jme.ko 2024-09-11T22:58:02.682 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell 2024-09-11T22:58:02.682 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-09-11T22:58:02.682 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/skge.ko 2024-09-11T22:58:02.682 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-09-11T22:58:02.683 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox 2024-09-11T22:58:02.683 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4 2024-09-11T22:58:02.683 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-09-11T22:58:02.683 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-09-11T22:58:02.683 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5 2024-09-11T22:58:02.683 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-09-11T22:58:02.683 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-09-11T22:58:02.683 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel 2024-09-11T22:58:02.683 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-09-11T22:58:02.683 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom 2024-09-11T22:58:02.683 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge 2024-09-11T22:58:02.683 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-09-11T22:58:02.683 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi 2024-09-11T22:58:02.683 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-09-11T22:58:02.684 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-09-11T22:58:02.684 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion 2024-09-11T22:58:02.684 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-09-11T22:58:02.684 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia 2024-09-11T22:58:02.684 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-09-11T22:58:02.684 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines 2024-09-11T22:58:02.684 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-09-11T22:58:02.684 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-09-11T22:58:02.684 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic 2024-09-11T22:58:02.684 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen 2024-09-11T22:58:02.684 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-09-11T22:58:02.684 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-09-11T22:58:02.684 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-09-11T22:58:02.685 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-09-11T22:58:02.685 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc 2024-09-11T22:58:02.685 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-09-11T22:58:02.685 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek 2024-09-11T22:58:02.685 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-09-11T22:58:02.685 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-09-11T22:58:02.685 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/atp.ko 2024-09-11T22:58:02.685 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-09-11T22:58:02.685 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker 2024-09-11T22:58:02.685 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-09-11T22:58:02.685 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc 2024-09-11T22:58:02.685 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-09-11T22:58:02.685 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan 2024-09-11T22:58:02.686 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-09-11T22:58:02.686 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis 2024-09-11T22:58:02.686 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis190.ko 2024-09-11T22:58:02.686 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis900.ko 2024-09-11T22:58:02.686 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc 2024-09-11T22:58:02.686 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-09-11T22:58:02.686 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-09-11T22:58:02.686 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-09-11T22:58:02.686 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-09-11T22:58:02.686 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro 2024-09-11T22:58:02.686 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac 2024-09-11T22:58:02.686 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-09-11T22:58:02.686 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-09-11T22:58:02.687 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun 2024-09-11T22:58:02.687 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/cassini.ko 2024-09-11T22:58:02.687 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/niu.ko 2024-09-11T22:58:02.687 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sungem.ko 2024-09-11T22:58:02.687 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-09-11T22:58:02.687 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti 2024-09-11T22:58:02.687 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-09-11T22:58:02.687 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti 2024-09-11T22:58:02.687 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/tlan.ko 2024-09-11T22:58:02.687 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via 2024-09-11T22:58:02.687 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-09-11T22:58:02.687 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-09-11T22:58:02.687 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet 2024-09-11T22:58:02.688 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-09-11T22:58:02.688 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-09-11T22:58:02.688 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom 2024-09-11T22:58:02.688 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-09-11T22:58:02.688 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/geneve.ko 2024-09-11T22:58:02.688 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv 2024-09-11T22:58:02.688 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-09-11T22:58:02.688 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154 2024-09-11T22:58:02.688 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/fakelb.ko 2024-09-11T22:58:02.688 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ifb.ko 2024-09-11T22:58:02.688 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan 2024-09-11T22:58:02.688 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ipvlan.ko 2024-09-11T22:58:02.688 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvlan.ko 2024-09-11T22:58:02.689 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvtap.ko 2024-09-11T22:58:02.689 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio 2024-09-11T22:58:02.689 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio.ko 2024-09-11T22:58:02.689 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-09-11T22:58:02.689 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-09-11T22:58:02.689 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-regmap.ko 2024-09-11T22:58:02.689 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mii.ko 2024-09-11T22:58:02.689 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/net_failover.ko 2024-09-11T22:58:02.689 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/netconsole.ko 2024-09-11T22:58:02.689 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/nlmon.ko 2024-09-11T22:58:02.689 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs 2024-09-11T22:58:02.689 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs-lynx.ko 2024-09-11T22:58:02.689 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-09-11T22:58:02.689 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy 2024-09-11T22:58:02.690 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/amd.ko 2024-09-11T22:58:02.690 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-09-11T22:58:02.690 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-09-11T22:58:02.690 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm7xxx.ko 2024-09-11T22:58:02.690 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm87xx.ko 2024-09-11T22:58:02.690 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/broadcom.ko 2024-09-11T22:58:02.690 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/cicada.ko 2024-09-11T22:58:02.690 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/davicom.ko 2024-09-11T22:58:02.690 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/dp83640.ko 2024-09-11T22:58:02.690 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/et1011c.ko 2024-09-11T22:58:02.690 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/icplus.ko 2024-09-11T22:58:02.690 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/lxt.ko 2024-09-11T22:58:02.690 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/marvell.ko 2024-09-11T22:58:02.691 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/micrel.ko 2024-09-11T22:58:02.691 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/national.ko 2024-09-11T22:58:02.691 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/phylink.ko 2024-09-11T22:58:02.691 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/qsemi.ko 2024-09-11T22:58:02.691 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/realtek.ko 2024-09-11T22:58:02.691 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/smsc.ko 2024-09-11T22:58:02.691 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ste10Xp.ko 2024-09-11T22:58:02.691 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/vitesse.ko 2024-09-11T22:58:02.691 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp 2024-09-11T22:58:02.691 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/bsd_comp.ko 2024-09-11T22:58:02.691 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_async.ko 2024-09-11T22:58:02.691 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_deflate.ko 2024-09-11T22:58:02.691 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_generic.ko 2024-09-11T22:58:02.691 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_mppe.ko 2024-09-11T22:58:02.692 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_synctty.ko 2024-09-11T22:58:02.692 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppoe.ko 2024-09-11T22:58:02.692 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppox.ko 2024-09-11T22:58:02.692 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pptp.ko 2024-09-11T22:58:02.692 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip 2024-09-11T22:58:02.692 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slhc.ko 2024-09-11T22:58:02.692 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slip.ko 2024-09-11T22:58:02.692 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/sungem_phy.ko 2024-09-11T22:58:02.692 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tap.ko 2024-09-11T22:58:02.692 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team 2024-09-11T22:58:02.692 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team.ko 2024-09-11T22:58:02.692 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_activebackup.ko 2024-09-11T22:58:02.692 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_broadcast.ko 2024-09-11T22:58:02.693 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-09-11T22:58:02.693 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_random.ko 2024-09-11T22:58:02.693 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-09-11T22:58:02.693 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tun.ko 2024-09-11T22:58:02.693 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/veth.ko 2024-09-11T22:58:02.693 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/virtio_net.ko 2024-09-11T22:58:02.693 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3 2024-09-11T22:58:02.693 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-09-11T22:58:02.693 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan 2024-09-11T22:58:02.693 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/vxlan.ko 2024-09-11T22:58:02.693 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback 2024-09-11T22:58:02.693 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/xen-netback.ko 2024-09-11T22:58:02.693 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netfront.ko 2024-09-11T22:58:02.694 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb 2024-09-11T22:58:02.694 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ntb.ko 2024-09-11T22:58:02.694 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme 2024-09-11T22:58:02.694 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host 2024-09-11T22:58:02.694 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme-core.ko 2024-09-11T22:58:02.694 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme.ko 2024-09-11T22:58:02.694 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport 2024-09-11T22:58:02.694 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport.ko 2024-09-11T22:58:02.694 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_cs.ko 2024-09-11T22:58:02.694 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_pc.ko 2024-09-11T22:58:02.694 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_serial.ko 2024-09-11T22:58:02.694 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci 2024-09-11T22:58:02.694 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug 2024-09-11T22:58:02.694 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-09-11T22:58:02.695 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie 2024-09-11T22:58:02.695 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie/aer_inject.ko 2024-09-11T22:58:02.695 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/xen-pcifront.ko 2024-09-11T22:58:02.695 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia 2024-09-11T22:58:02.695 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/i82092.ko 2024-09-11T22:58:02.695 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pd6729.ko 2024-09-11T22:58:02.695 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/yenta_socket.ko 2024-09-11T22:58:02.695 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl 2024-09-11T22:58:02.695 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel 2024-09-11T22:58:02.695 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-09-11T22:58:02.695 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform 2024-09-11T22:58:02.695 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86 2024-09-11T22:58:02.695 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acer-wmi.ko 2024-09-11T22:58:02.696 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acerhdf.ko 2024-09-11T22:58:02.696 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/apple-gmux.ko 2024-09-11T22:58:02.696 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-laptop.ko 2024-09-11T22:58:02.696 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-09-11T22:58:02.696 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-wmi.ko 2024-09-11T22:58:02.696 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/classmate-laptop.ko 2024-09-11T22:58:02.696 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-09-11T22:58:02.696 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-09-11T22:58:02.696 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-09-11T22:58:02.696 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-09-11T22:58:02.696 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/hdaps.ko 2024-09-11T22:58:02.696 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel 2024-09-11T22:58:02.696 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-09-11T22:58:02.696 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel_ips.ko 2024-09-11T22:58:02.697 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/msi-wmi.ko 2024-09-11T22:58:02.697 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/mxm-wmi.ko 2024-09-11T22:58:02.697 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-09-11T22:58:02.697 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-laptop.ko 2024-09-11T22:58:02.697 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-q10.ko 2024-09-11T22:58:02.697 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/topstar-laptop.ko 2024-09-11T22:58:02.697 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-09-11T22:58:02.697 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_haps.ko 2024-09-11T22:58:02.697 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi-bmof.ko 2024-09-11T22:58:02.697 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi.ko 2024-09-11T22:58:02.697 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap 2024-09-11T22:58:02.697 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_common.ko 2024-09-11T22:58:02.697 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_msr.ko 2024-09-11T22:58:02.698 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps 2024-09-11T22:58:02.698 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients 2024-09-11T22:58:02.698 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-gpio.ko 2024-09-11T22:58:02.698 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-ldisc.ko 2024-09-11T22:58:02.698 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps_parport.ko 2024-09-11T22:58:02.698 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/pps_core.ko 2024-09-11T22:58:02.698 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp 2024-09-11T22:58:02.698 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp.ko 2024-09-11T22:58:02.698 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp_kvm.ko 2024-09-11T22:58:02.698 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras 2024-09-11T22:58:02.698 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd 2024-09-11T22:58:02.698 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl 2024-09-11T22:58:02.698 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-09-11T22:58:02.698 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/fmpm.ko 2024-09-11T22:58:02.699 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc 2024-09-11T22:58:02.699 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-bq32k.ko 2024-09-11T22:58:02.699 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1286.ko 2024-09-11T22:58:02.699 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1307.ko 2024-09-11T22:58:02.699 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1374.ko 2024-09-11T22:58:02.699 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1511.ko 2024-09-11T22:58:02.699 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1553.ko 2024-09-11T22:58:02.699 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1672.ko 2024-09-11T22:58:02.699 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1742.ko 2024-09-11T22:58:02.699 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds2404.ko 2024-09-11T22:58:02.699 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds3232.ko 2024-09-11T22:58:02.699 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-em3027.ko 2024-09-11T22:58:02.699 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-fm3130.ko 2024-09-11T22:58:02.699 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl12022.ko 2024-09-11T22:58:02.700 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl1208.ko 2024-09-11T22:58:02.700 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m41t80.ko 2024-09-11T22:58:02.700 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t35.ko 2024-09-11T22:58:02.700 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t59.ko 2024-09-11T22:58:02.700 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max6900.ko 2024-09-11T22:58:02.700 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-msm6242.ko 2024-09-11T22:58:02.700 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf2127.ko 2024-09-11T22:58:02.700 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf85063.ko 2024-09-11T22:58:02.700 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8523.ko 2024-09-11T22:58:02.700 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8563.ko 2024-09-11T22:58:02.700 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8583.ko 2024-09-11T22:58:02.700 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rp5c01.ko 2024-09-11T22:58:02.700 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rs5c372.ko 2024-09-11T22:58:02.700 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-09-11T22:58:02.701 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8025.ko 2024-09-11T22:58:02.701 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8581.ko 2024-09-11T22:58:02.701 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-09-11T22:58:02.701 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-x1205.ko 2024-09-11T22:58:02.701 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi 2024-09-11T22:58:02.701 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-9xxx.ko 2024-09-11T22:58:02.701 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-sas.ko 2024-09-11T22:58:02.701 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-xxxx.ko 2024-09-11T22:58:02.701 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/BusLogic.ko 2024-09-11T22:58:02.701 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/a100u2w.ko 2024-09-11T22:58:02.701 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid 2024-09-11T22:58:02.701 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/aacraid.ko 2024-09-11T22:58:02.701 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/advansys.ko 2024-09-11T22:58:02.701 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx 2024-09-11T22:58:02.702 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-09-11T22:58:02.702 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-09-11T22:58:02.702 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/am53c974.ko 2024-09-11T22:58:02.702 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr 2024-09-11T22:58:02.702 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-09-11T22:58:02.702 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/atp870u.ko 2024-09-11T22:58:02.702 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi 2024-09-11T22:58:02.702 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-09-11T22:58:02.702 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa 2024-09-11T22:58:02.702 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/bfa.ko 2024-09-11T22:58:02.702 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc 2024-09-11T22:58:02.702 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-09-11T22:58:02.702 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i 2024-09-11T22:58:02.703 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-09-11T22:58:02.703 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ch.ko 2024-09-11T22:58:02.703 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor 2024-09-11T22:58:02.703 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/csiostor.ko 2024-09-11T22:58:02.703 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi 2024-09-11T22:58:02.703 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i 2024-09-11T22:58:02.703 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-09-11T22:58:02.703 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i 2024-09-11T22:58:02.703 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-09-11T22:58:02.703 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-09-11T22:58:02.703 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dc395x.ko 2024-09-11T22:58:02.703 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler 2024-09-11T22:58:02.703 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-09-11T22:58:02.703 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-09-11T22:58:02.704 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-09-11T22:58:02.704 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-09-11T22:58:02.704 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dmx3191d.ko 2024-09-11T22:58:02.704 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r 2024-09-11T22:58:02.704 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/esas2r.ko 2024-09-11T22:58:02.704 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esp_scsi.ko 2024-09-11T22:58:02.704 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe 2024-09-11T22:58:02.704 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/fcoe.ko 2024-09-11T22:58:02.704 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-09-11T22:58:02.704 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic 2024-09-11T22:58:02.704 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/fnic.ko 2024-09-11T22:58:02.704 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hpsa.ko 2024-09-11T22:58:02.704 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hptiop.ko 2024-09-11T22:58:02.704 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hv_storvsc.ko 2024-09-11T22:58:02.705 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/initio.ko 2024-09-11T22:58:02.705 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ipr.ko 2024-09-11T22:58:02.705 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ips.ko 2024-09-11T22:58:02.705 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci 2024-09-11T22:58:02.705 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/isci.ko 2024-09-11T22:58:02.705 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-09-11T22:58:02.705 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_tcp.ko 2024-09-11T22:58:02.705 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc 2024-09-11T22:58:02.705 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/libfc.ko 2024-09-11T22:58:02.705 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi.ko 2024-09-11T22:58:02.705 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi_tcp.ko 2024-09-11T22:58:02.706 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas 2024-09-11T22:58:02.706 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/libsas.ko 2024-09-11T22:58:02.706 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc 2024-09-11T22:58:02.706 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/lpfc.ko 2024-09-11T22:58:02.706 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid 2024-09-11T22:58:02.706 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid.ko 2024-09-11T22:58:02.706 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-09-11T22:58:02.706 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-09-11T22:58:02.706 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-09-11T22:58:02.706 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas 2024-09-11T22:58:02.706 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-09-11T22:58:02.706 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas 2024-09-11T22:58:02.706 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/mvsas.ko 2024-09-11T22:58:02.707 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvumi.ko 2024-09-11T22:58:02.707 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001 2024-09-11T22:58:02.707 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-09-11T22:58:02.707 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pmcraid.ko 2024-09-11T22:58:02.707 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla1280.ko 2024-09-11T22:58:02.707 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx 2024-09-11T22:58:02.707 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-09-11T22:58:02.707 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-09-11T22:58:02.707 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx 2024-09-11T22:58:02.707 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-09-11T22:58:02.707 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/raid_class.ko 2024-09-11T22:58:02.708 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_debug.ko 2024-09-11T22:58:02.708 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_fc.ko 2024-09-11T22:58:02.708 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-09-11T22:58:02.708 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_sas.ko 2024-09-11T22:58:02.708 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_spi.ko 2024-09-11T22:58:02.708 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_srp.ko 2024-09-11T22:58:02.708 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ses.ko 2024-09-11T22:58:02.708 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/st.ko 2024-09-11T22:58:02.708 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/stex.ko 2024-09-11T22:58:02.708 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2 2024-09-11T22:58:02.708 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-09-11T22:58:02.708 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/virtio_scsi.ko 2024-09-11T22:58:02.708 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/vmw_pvscsi.ko 2024-09-11T22:58:02.709 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/wd719x.ko 2024-09-11T22:58:02.709 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb 2024-09-11T22:58:02.709 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ssb.ko 2024-09-11T22:58:02.709 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target 2024-09-11T22:58:02.709 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi 2024-09-11T22:58:02.709 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-09-11T22:58:02.709 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback 2024-09-11T22:58:02.709 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/tcm_loop.ko 2024-09-11T22:58:02.709 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_file.ko 2024-09-11T22:58:02.709 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_iblock.ko 2024-09-11T22:58:02.709 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_mod.ko 2024-09-11T22:58:02.709 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_pscsi.ko 2024-09-11T22:58:02.709 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_user.ko 2024-09-11T22:58:02.709 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc 2024-09-11T22:58:02.710 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-09-11T22:58:02.710 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal 2024-09-11T22:58:02.710 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel 2024-09-11T22:58:02.710 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal 2024-09-11T22:58:02.710 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-09-11T22:58:02.710 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-09-11T22:58:02.710 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-09-11T22:58:02.710 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-09-11T22:58:02.710 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-09-11T22:58:02.710 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-09-11T22:58:02.710 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-09-11T22:58:02.710 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-09-11T22:58:02.710 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-09-11T22:58:02.711 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-09-11T22:58:02.711 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-09-11T22:58:02.711 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-09-11T22:58:02.711 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-09-11T22:58:02.711 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-09-11T22:58:02.711 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-09-11T22:58:02.711 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-09-11T22:58:02.711 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-09-11T22:58:02.711 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-09-11T22:58:02.711 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty 2024-09-11T22:58:02.711 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless 2024-09-11T22:58:02.711 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-09-11T22:58:02.711 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_gsm.ko 2024-09-11T22:58:02.712 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_hdlc.ko 2024-09-11T22:58:02.712 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/nozomi.ko 2024-09-11T22:58:02.712 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial 2024-09-11T22:58:02.712 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250 2024-09-11T22:58:02.712 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-09-11T22:58:02.712 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/arc_uart.ko 2024-09-11T22:58:02.712 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm 2024-09-11T22:58:02.712 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/jsm.ko 2024-09-11T22:58:02.712 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs 2024-09-11T22:58:02.712 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core 2024-09-11T22:58:02.712 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ufshcd-core.ko 2024-09-11T22:58:02.712 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host 2024-09-11T22:58:02.712 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-09-11T22:58:02.712 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio 2024-09-11T22:58:02.713 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio.ko 2024-09-11T22:58:02.713 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_aec.ko 2024-09-11T22:58:02.713 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_cif.ko 2024-09-11T22:58:02.713 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pci_generic.ko 2024-09-11T22:58:02.713 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_sercos3.ko 2024-09-11T22:58:02.713 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb 2024-09-11T22:58:02.713 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class 2024-09-11T22:58:02.713 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-acm.ko 2024-09-11T22:58:02.713 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-wdm.ko 2024-09-11T22:58:02.713 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usblp.ko 2024-09-11T22:58:02.713 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usbtmc.ko 2024-09-11T22:58:02.713 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host 2024-09-11T22:58:02.713 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811-hcd.ko 2024-09-11T22:58:02.714 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image 2024-09-11T22:58:02.714 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/mdc800.ko 2024-09-11T22:58:02.714 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/microtek.ko 2024-09-11T22:58:02.714 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc 2024-09-11T22:58:02.714 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/adutux.ko 2024-09-11T22:58:02.714 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/appledisplay.ko 2024-09-11T22:58:02.714 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi26.ko 2024-09-11T22:58:02.714 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi62.ko 2024-09-11T22:58:02.714 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ezusb.ko 2024-09-11T22:58:02.714 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/idmouse.ko 2024-09-11T22:58:02.714 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/iowarrior.ko 2024-09-11T22:58:02.714 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/isight_firmware.ko 2024-09-11T22:58:02.714 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ldusb.ko 2024-09-11T22:58:02.714 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/legousbtower.ko 2024-09-11T22:58:02.715 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga 2024-09-11T22:58:02.715 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-09-11T22:58:02.715 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/trancevibrator.ko 2024-09-11T22:58:02.715 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usb3503.ko 2024-09-11T22:58:02.715 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usblcd.ko 2024-09-11T22:58:02.715 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbsevseg.ko 2024-09-11T22:58:02.715 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/uss720.ko 2024-09-11T22:58:02.715 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/yurex.ko 2024-09-11T22:58:02.715 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy 2024-09-11T22:58:02.715 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-generic.ko 2024-09-11T22:58:02.715 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial 2024-09-11T22:58:02.715 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/aircable.ko 2024-09-11T22:58:02.715 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ark3116.ko 2024-09-11T22:58:02.716 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/belkin_sa.ko 2024-09-11T22:58:02.716 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ch341.ko 2024-09-11T22:58:02.716 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cp210x.ko 2024-09-11T22:58:02.716 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cyberjack.ko 2024-09-11T22:58:02.716 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cypress_m8.ko 2024-09-11T22:58:02.716 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/digi_acceleport.ko 2024-09-11T22:58:02.716 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/empeg.ko 2024-09-11T22:58:02.716 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ftdi_sio.ko 2024-09-11T22:58:02.716 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/garmin_gps.ko 2024-09-11T22:58:02.716 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_edgeport.ko 2024-09-11T22:58:02.716 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_ti.ko 2024-09-11T22:58:02.716 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipaq.ko 2024-09-11T22:58:02.716 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipw.ko 2024-09-11T22:58:02.716 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ir-usb.ko 2024-09-11T22:58:02.717 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-09-11T22:58:02.717 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan.ko 2024-09-11T22:58:02.717 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan_pda.ko 2024-09-11T22:58:02.717 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kl5kusb105.ko 2024-09-11T22:58:02.717 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kobil_sct.ko 2024-09-11T22:58:02.717 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mct_u232.ko 2024-09-11T22:58:02.717 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7720.ko 2024-09-11T22:58:02.717 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7840.ko 2024-09-11T22:58:02.717 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/navman.ko 2024-09-11T22:58:02.717 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/omninet.ko 2024-09-11T22:58:02.717 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/opticon.ko 2024-09-11T22:58:02.717 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/option.ko 2024-09-11T22:58:02.717 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/oti6858.ko 2024-09-11T22:58:02.718 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/pl2303.ko 2024-09-11T22:58:02.718 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcaux.ko 2024-09-11T22:58:02.718 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcserial.ko 2024-09-11T22:58:02.718 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/quatech2.ko 2024-09-11T22:58:02.718 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/safe_serial.ko 2024-09-11T22:58:02.718 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/sierra.ko 2024-09-11T22:58:02.718 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/spcp8x5.ko 2024-09-11T22:58:02.718 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ssu100.ko 2024-09-11T22:58:02.718 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/symbolserial.ko 2024-09-11T22:58:02.718 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-09-11T22:58:02.718 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-09-11T22:58:02.718 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_debug.ko 2024-09-11T22:58:02.718 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_wwan.ko 2024-09-11T22:58:02.718 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/visor.ko 2024-09-11T22:58:02.719 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/whiteheat.ko 2024-09-11T22:58:02.719 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/xsens_mt.ko 2024-09-11T22:58:02.719 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage 2024-09-11T22:58:02.719 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/uas.ko 2024-09-11T22:58:02.719 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-alauda.ko 2024-09-11T22:58:02.719 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-cypress.ko 2024-09-11T22:58:02.719 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-datafab.ko 2024-09-11T22:58:02.719 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-09-11T22:58:02.719 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-freecom.ko 2024-09-11T22:58:02.719 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-isd200.ko 2024-09-11T22:58:02.719 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-09-11T22:58:02.719 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-karma.ko 2024-09-11T22:58:02.719 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-onetouch.ko 2024-09-11T22:58:02.720 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-realtek.ko 2024-09-11T22:58:02.720 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr09.ko 2024-09-11T22:58:02.720 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr55.ko 2024-09-11T22:58:02.720 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-usbat.ko 2024-09-11T22:58:02.720 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/usb-storage.ko 2024-09-11T22:58:02.720 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip 2024-09-11T22:58:02.720 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-core.ko 2024-09-11T22:58:02.720 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-host.ko 2024-09-11T22:58:02.720 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-09-11T22:58:02.720 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio 2024-09-11T22:58:02.720 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci 2024-09-11T22:58:02.720 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-09-11T22:58:02.720 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci.ko 2024-09-11T22:58:02.721 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio.ko 2024-09-11T22:58:02.721 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-09-11T22:58:02.721 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost 2024-09-11T22:58:02.721 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost.ko 2024-09-11T22:58:02.721 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_iotlb.ko 2024-09-11T22:58:02.721 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_net.ko 2024-09-11T22:58:02.721 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_scsi.ko 2024-09-11T22:58:02.721 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video 2024-09-11T22:58:02.721 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight 2024-09-11T22:58:02.721 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/apple_bl.ko 2024-09-11T22:58:02.721 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lcd.ko 2024-09-11T22:58:02.721 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/platform_lcd.ko 2024-09-11T22:58:02.722 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio 2024-09-11T22:58:02.722 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio.ko 2024-09-11T22:58:02.722 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_balloon.ko 2024-09-11T22:58:02.722 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_mmio.ko 2024-09-11T22:58:02.722 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci.ko 2024-09-11T22:58:02.722 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-09-11T22:58:02.722 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-09-11T22:58:02.722 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_ring.ko 2024-09-11T22:58:02.722 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1 2024-09-11T22:58:02.722 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters 2024-09-11T22:58:02.722 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2482.ko 2024-09-11T22:58:02.722 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2490.ko 2024-09-11T22:58:02.722 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves 2024-09-11T22:58:02.723 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-09-11T22:58:02.723 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-09-11T22:58:02.723 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-09-11T22:58:02.723 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-09-11T22:58:02.723 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-09-11T22:58:02.723 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-09-11T22:58:02.723 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-09-11T22:58:02.723 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-09-11T22:58:02.723 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-09-11T22:58:02.723 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_smem.ko 2024-09-11T22:58:02.723 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_therm.ko 2024-09-11T22:58:02.723 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/wire.ko 2024-09-11T22:58:02.723 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog 2024-09-11T22:58:02.723 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim1535_wdt.ko 2024-09-11T22:58:02.724 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim7101_wdt.ko 2024-09-11T22:58:02.724 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/f71808e_wdt.ko 2024-09-11T22:58:02.724 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/hpwdt.ko 2024-09-11T22:58:02.724 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/i6300esb.ko 2024-09-11T22:58:02.724 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-09-11T22:58:02.724 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_wdt.ko 2024-09-11T22:58:02.724 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ib700wdt.ko 2024-09-11T22:58:02.724 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ibmasr.ko 2024-09-11T22:58:02.724 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-09-11T22:58:02.724 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it8712f_wdt.ko 2024-09-11T22:58:02.724 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it87_wdt.ko 2024-09-11T22:58:02.724 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/machzwd.ko 2024-09-11T22:58:02.725 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/nv_tco.ko 2024-09-11T22:58:02.725 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_pci.ko 2024-09-11T22:58:02.725 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_usb.ko 2024-09-11T22:58:02.725 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-09-11T22:58:02.725 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sch311x_wdt.ko 2024-09-11T22:58:02.725 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/softdog.ko 2024-09-11T22:58:02.725 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sp5100_tco.ko 2024-09-11T22:58:02.725 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/via_wdt.ko 2024-09-11T22:58:02.725 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-09-11T22:58:02.725 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83877f_wdt.ko 2024-09-11T22:58:02.725 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83977f_wdt.ko 2024-09-11T22:58:02.725 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wdt_pci.ko 2024-09-11T22:58:02.725 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/xen_wdt.ko 2024-09-11T22:58:02.725 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen 2024-09-11T22:58:02.726 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-acpi-processor.ko 2024-09-11T22:58:02.726 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-evtchn.ko 2024-09-11T22:58:02.726 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntalloc.ko 2024-09-11T22:58:02.726 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntdev.ko 2024-09-11T22:58:02.726 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback 2024-09-11T22:58:02.726 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-09-11T22:58:02.726 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-privcmd.ko 2024-09-11T22:58:02.726 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs 2024-09-11T22:58:02.726 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/xenfs.ko 2024-09-11T22:58:02.726 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs 2024-09-11T22:58:02.726 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p 2024-09-11T22:58:02.726 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/9p.ko 2024-09-11T22:58:02.726 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs 2024-09-11T22:58:02.726 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/affs.ko 2024-09-11T22:58:02.727 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs 2024-09-11T22:58:02.727 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/befs.ko 2024-09-11T22:58:02.727 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/binfmt_misc.ko 2024-09-11T22:58:02.727 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs 2024-09-11T22:58:02.727 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/btrfs.ko 2024-09-11T22:58:02.727 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles 2024-09-11T22:58:02.727 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/cachefiles.ko 2024-09-11T22:58:02.727 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph 2024-09-11T22:58:02.727 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ceph.ko 2024-09-11T22:58:02.727 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda 2024-09-11T22:58:02.727 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/coda.ko 2024-09-11T22:58:02.727 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs 2024-09-11T22:58:02.727 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/cramfs.ko 2024-09-11T22:58:02.727 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm 2024-09-11T22:58:02.728 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/dlm.ko 2024-09-11T22:58:02.728 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs 2024-09-11T22:58:02.728 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs/ecryptfs.ko 2024-09-11T22:58:02.728 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs 2024-09-11T22:58:02.728 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/f2fs.ko 2024-09-11T22:58:02.728 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat 2024-09-11T22:58:02.728 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/fat.ko 2024-09-11T22:58:02.728 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/msdos.ko 2024-09-11T22:58:02.728 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/vfat.ko 2024-09-11T22:58:02.728 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse 2024-09-11T22:58:02.728 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/cuse.ko 2024-09-11T22:58:02.728 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/fuse.ko 2024-09-11T22:58:02.728 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2 2024-09-11T22:58:02.729 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/gfs2.ko 2024-09-11T22:58:02.729 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs 2024-09-11T22:58:02.729 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/hfs.ko 2024-09-11T22:58:02.729 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus 2024-09-11T22:58:02.729 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/hfsplus.ko 2024-09-11T22:58:02.729 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs 2024-09-11T22:58:02.729 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/isofs.ko 2024-09-11T22:58:02.729 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs 2024-09-11T22:58:02.729 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/jfs.ko 2024-09-11T22:58:02.729 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd 2024-09-11T22:58:02.729 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/lockd.ko 2024-09-11T22:58:02.729 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix 2024-09-11T22:58:02.729 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/minix.ko 2024-09-11T22:58:02.729 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs 2024-09-11T22:58:02.730 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/netfs.ko 2024-09-11T22:58:02.730 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs 2024-09-11T22:58:02.730 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout 2024-09-11T22:58:02.730 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-09-11T22:58:02.730 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout 2024-09-11T22:58:02.730 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-09-11T22:58:02.730 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout 2024-09-11T22:58:02.730 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-09-11T22:58:02.730 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfs.ko 2024-09-11T22:58:02.730 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv3.ko 2024-09-11T22:58:02.730 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv4.ko 2024-09-11T22:58:02.730 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common 2024-09-11T22:58:02.730 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/grace.ko 2024-09-11T22:58:02.731 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/nfs_acl.ko 2024-09-11T22:58:02.731 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd 2024-09-11T22:58:02.731 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/nfsd.ko 2024-09-11T22:58:02.731 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2 2024-09-11T22:58:02.731 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/nilfs2.ko 2024-09-11T22:58:02.731 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls 2024-09-11T22:58:02.731 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-celtic.ko 2024-09-11T22:58:02.731 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-centeuro.ko 2024-09-11T22:58:02.731 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-croatian.ko 2024-09-11T22:58:02.731 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-cyrillic.ko 2024-09-11T22:58:02.731 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-gaelic.ko 2024-09-11T22:58:02.731 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-greek.ko 2024-09-11T22:58:02.731 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-iceland.ko 2024-09-11T22:58:02.731 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-inuit.ko 2024-09-11T22:58:02.732 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-roman.ko 2024-09-11T22:58:02.732 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-romanian.ko 2024-09-11T22:58:02.732 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-turkish.ko 2024-09-11T22:58:02.732 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1250.ko 2024-09-11T22:58:02.732 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1251.ko 2024-09-11T22:58:02.732 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1255.ko 2024-09-11T22:58:02.732 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp737.ko 2024-09-11T22:58:02.732 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp775.ko 2024-09-11T22:58:02.732 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp850.ko 2024-09-11T22:58:02.732 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp852.ko 2024-09-11T22:58:02.732 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp855.ko 2024-09-11T22:58:02.732 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp857.ko 2024-09-11T22:58:02.732 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp860.ko 2024-09-11T22:58:02.733 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp861.ko 2024-09-11T22:58:02.733 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp862.ko 2024-09-11T22:58:02.733 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp863.ko 2024-09-11T22:58:02.733 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp864.ko 2024-09-11T22:58:02.733 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp865.ko 2024-09-11T22:58:02.733 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp866.ko 2024-09-11T22:58:02.733 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp869.ko 2024-09-11T22:58:02.733 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp874.ko 2024-09-11T22:58:02.733 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp932.ko 2024-09-11T22:58:02.733 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp936.ko 2024-09-11T22:58:02.733 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp949.ko 2024-09-11T22:58:02.733 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp950.ko 2024-09-11T22:58:02.733 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_euc-jp.ko 2024-09-11T22:58:02.733 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-1.ko 2024-09-11T22:58:02.734 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-13.ko 2024-09-11T22:58:02.734 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-14.ko 2024-09-11T22:58:02.734 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-15.ko 2024-09-11T22:58:02.734 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-2.ko 2024-09-11T22:58:02.734 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-3.ko 2024-09-11T22:58:02.734 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-4.ko 2024-09-11T22:58:02.734 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-5.ko 2024-09-11T22:58:02.734 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-6.ko 2024-09-11T22:58:02.734 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-7.ko 2024-09-11T22:58:02.734 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-9.ko 2024-09-11T22:58:02.734 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-r.ko 2024-09-11T22:58:02.734 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-ru.ko 2024-09-11T22:58:02.734 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-u.ko 2024-09-11T22:58:02.734 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ucs2_utils.ko 2024-09-11T22:58:02.735 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_utf8.ko 2024-09-11T22:58:02.735 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2 2024-09-11T22:58:02.735 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster 2024-09-11T22:58:02.735 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-09-11T22:58:02.735 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm 2024-09-11T22:58:02.735 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-09-11T22:58:02.735 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs 2024-09-11T22:58:02.735 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-09-11T22:58:02.735 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2.ko 2024-09-11T22:58:02.735 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-09-11T22:58:02.735 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-09-11T22:58:02.735 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-09-11T22:58:02.735 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs 2024-09-11T22:58:02.735 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/overlay.ko 2024-09-11T22:58:02.736 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore 2024-09-11T22:58:02.736 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ramoops.ko 2024-09-11T22:58:02.736 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs 2024-09-11T22:58:02.736 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/reiserfs.ko 2024-09-11T22:58:02.736 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs 2024-09-11T22:58:02.736 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/romfs.ko 2024-09-11T22:58:02.736 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb 2024-09-11T22:58:02.736 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client 2024-09-11T22:58:02.736 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/cifs.ko 2024-09-11T22:58:02.736 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common 2024-09-11T22:58:02.736 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_arc4.ko 2024-09-11T22:58:02.736 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_md4.ko 2024-09-11T22:58:02.736 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs 2024-09-11T22:58:02.737 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/squashfs.ko 2024-09-11T22:58:02.737 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv 2024-09-11T22:58:02.737 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/sysv.ko 2024-09-11T22:58:02.737 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf 2024-09-11T22:58:02.737 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/udf.ko 2024-09-11T22:58:02.737 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs 2024-09-11T22:58:02.737 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ufs.ko 2024-09-11T22:58:02.737 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs 2024-09-11T22:58:02.737 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/xfs.ko 2024-09-11T22:58:02.738 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel 2024-09-11T22:58:02.738 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu 2024-09-11T22:58:02.738 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu/rcutorture.ko 2024-09-11T22:58:02.738 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/torture.ko 2024-09-11T22:58:02.738 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace 2024-09-11T22:58:02.738 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-09-11T22:58:02.738 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib 2024-09-11T22:58:02.738 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/asn1_encoder.ko 2024-09-11T22:58:02.738 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc-itu-t.ko 2024-09-11T22:58:02.739 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc8.ko 2024-09-11T22:58:02.739 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto 2024-09-11T22:58:02.739 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libaescfb.ko 2024-09-11T22:58:02.739 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libarc4.ko 2024-09-11T22:58:02.739 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libdes.ko 2024-09-11T22:58:02.739 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/libcrc32c.ko 2024-09-11T22:58:02.739 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lru_cache.ko 2024-09-11T22:58:02.739 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4 2024-09-11T22:58:02.739 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4_compress.ko 2024-09-11T22:58:02.739 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4hc_compress.ko 2024-09-11T22:58:02.739 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math 2024-09-11T22:58:02.739 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/cordic.ko 2024-09-11T22:58:02.739 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6 2024-09-11T22:58:02.740 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/raid6_pq.ko 2024-09-11T22:58:02.740 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon 2024-09-11T22:58:02.740 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/reed_solomon.ko 2024-09-11T22:58:02.740 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_bm.ko 2024-09-11T22:58:02.740 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_fsm.ko 2024-09-11T22:58:02.740 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_kmp.ko 2024-09-11T22:58:02.740 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd 2024-09-11T22:58:02.740 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd/zstd_compress.ko 2024-09-11T22:58:02.740 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm 2024-09-11T22:58:02.740 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/hwpoison-inject.ko 2024-09-11T22:58:02.740 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net 2024-09-11T22:58:02.740 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan 2024-09-11T22:58:02.740 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/6lowpan.ko 2024-09-11T22:58:02.741 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_dest.ko 2024-09-11T22:58:02.741 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_fragment.ko 2024-09-11T22:58:02.741 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_hop.ko 2024-09-11T22:58:02.741 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_ipv6.ko 2024-09-11T22:58:02.741 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_mobility.ko 2024-09-11T22:58:02.741 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_routing.ko 2024-09-11T22:58:02.741 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_udp.ko 2024-09-11T22:58:02.741 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802 2024-09-11T22:58:02.741 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/garp.ko 2024-09-11T22:58:02.741 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/mrp.ko 2024-09-11T22:58:02.741 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/p8022.ko 2024-09-11T22:58:02.741 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/psnap.ko 2024-09-11T22:58:02.741 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/stp.ko 2024-09-11T22:58:02.742 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q 2024-09-11T22:58:02.742 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/8021q.ko 2024-09-11T22:58:02.742 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p 2024-09-11T22:58:02.742 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet.ko 2024-09-11T22:58:02.742 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_fd.ko 2024-09-11T22:58:02.742 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_rdma.ko 2024-09-11T22:58:02.742 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_virtio.ko 2024-09-11T22:58:02.742 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv 2024-09-11T22:58:02.742 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/batman-adv.ko 2024-09-11T22:58:02.742 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge 2024-09-11T22:58:02.742 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/br_netfilter.ko 2024-09-11T22:58:02.742 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/bridge.ko 2024-09-11T22:58:02.742 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter 2024-09-11T22:58:02.743 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-09-11T22:58:02.743 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_among.ko 2024-09-11T22:58:02.743 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arp.ko 2024-09-11T22:58:02.743 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-09-11T22:58:02.743 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-09-11T22:58:02.743 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip.ko 2024-09-11T22:58:02.743 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-09-11T22:58:02.743 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_limit.ko 2024-09-11T22:58:02.743 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_log.ko 2024-09-11T22:58:02.743 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark.ko 2024-09-11T22:58:02.743 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-09-11T22:58:02.743 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-09-11T22:58:02.743 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-09-11T22:58:02.744 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-09-11T22:58:02.744 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_snat.ko 2024-09-11T22:58:02.744 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_stp.ko 2024-09-11T22:58:02.744 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-09-11T22:58:02.744 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-09-11T22:58:02.744 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-09-11T22:58:02.744 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-09-11T22:58:02.744 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtables.ko 2024-09-11T22:58:02.744 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-09-11T22:58:02.744 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-09-11T22:58:02.744 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-09-11T22:58:02.744 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph 2024-09-11T22:58:02.744 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/libceph.ko 2024-09-11T22:58:02.744 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core 2024-09-11T22:58:02.745 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/failover.ko 2024-09-11T22:58:02.745 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/pktgen.ko 2024-09-11T22:58:02.745 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp 2024-09-11T22:58:02.745 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp.ko 2024-09-11T22:58:02.745 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_diag.ko 2024-09-11T22:58:02.745 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv4.ko 2024-09-11T22:58:02.745 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv6.ko 2024-09-11T22:58:02.745 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver 2024-09-11T22:58:02.745 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver/dns_resolver.ko 2024-09-11T22:58:02.745 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa 2024-09-11T22:58:02.745 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/dsa_core.ko 2024-09-11T22:58:02.745 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_brcm.ko 2024-09-11T22:58:02.746 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_dsa.ko 2024-09-11T22:58:02.746 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_none.ko 2024-09-11T22:58:02.746 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_trailer.ko 2024-09-11T22:58:02.746 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154 2024-09-11T22:58:02.746 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan 2024-09-11T22:58:02.746 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-09-11T22:58:02.746 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154.ko 2024-09-11T22:58:02.746 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154_socket.ko 2024-09-11T22:58:02.746 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4 2024-09-11T22:58:02.746 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ah4.ko 2024-09-11T22:58:02.746 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/esp4.ko 2024-09-11T22:58:02.746 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/fou.ko 2024-09-11T22:58:02.746 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/gre.ko 2024-09-11T22:58:02.747 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/inet_diag.ko 2024-09-11T22:58:02.747 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_gre.ko 2024-09-11T22:58:02.747 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_tunnel.ko 2024-09-11T22:58:02.747 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_vti.ko 2024-09-11T22:58:02.747 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipcomp.ko 2024-09-11T22:58:02.747 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipip.ko 2024-09-11T22:58:02.747 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter 2024-09-11T22:58:02.747 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arp_tables.ko 2024-09-11T22:58:02.747 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-09-11T22:58:02.747 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-09-11T22:58:02.747 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-09-11T22:58:02.747 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-09-11T22:58:02.747 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-09-11T22:58:02.748 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-09-11T22:58:02.748 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-09-11T22:58:02.748 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-09-11T22:58:02.748 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-09-11T22:58:02.748 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_security.ko 2024-09-11T22:58:02.748 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-09-11T22:58:02.748 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-09-11T22:58:02.748 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-09-11T22:58:02.748 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-09-11T22:58:02.748 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-09-11T22:58:02.748 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-09-11T22:58:02.748 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-09-11T22:58:02.748 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-09-11T22:58:02.749 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-09-11T22:58:02.749 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-09-11T22:58:02.749 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_bic.ko 2024-09-11T22:58:02.749 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_dctcp.ko 2024-09-11T22:58:02.749 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_diag.ko 2024-09-11T22:58:02.749 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_highspeed.ko 2024-09-11T22:58:02.749 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_htcp.ko 2024-09-11T22:58:02.749 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_hybla.ko 2024-09-11T22:58:02.749 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_illinois.ko 2024-09-11T22:58:02.749 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_lp.ko 2024-09-11T22:58:02.749 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_scalable.ko 2024-09-11T22:58:02.749 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_vegas.ko 2024-09-11T22:58:02.749 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_veno.ko 2024-09-11T22:58:02.750 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_westwood.ko 2024-09-11T22:58:02.750 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_yeah.ko 2024-09-11T22:58:02.750 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tunnel4.ko 2024-09-11T22:58:02.750 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_diag.ko 2024-09-11T22:58:02.750 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_tunnel.ko 2024-09-11T22:58:02.750 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/xfrm4_tunnel.ko 2024-09-11T22:58:02.750 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6 2024-09-11T22:58:02.750 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ah6.ko 2024-09-11T22:58:02.750 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/esp6.ko 2024-09-11T22:58:02.750 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/fou6.ko 2024-09-11T22:58:02.750 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_tunnel.ko 2024-09-11T22:58:02.750 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-09-11T22:58:02.750 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_vti.ko 2024-09-11T22:58:02.750 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ipcomp6.ko 2024-09-11T22:58:02.751 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter 2024-09-11T22:58:02.751 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-09-11T22:58:02.751 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-09-11T22:58:02.751 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-09-11T22:58:02.751 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-09-11T22:58:02.751 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-09-11T22:58:02.751 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-09-11T22:58:02.751 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-09-11T22:58:02.751 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-09-11T22:58:02.751 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-09-11T22:58:02.751 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-09-11T22:58:02.751 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-09-11T22:58:02.751 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-09-11T22:58:02.752 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-09-11T22:58:02.752 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-09-11T22:58:02.752 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-09-11T22:58:02.752 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-09-11T22:58:02.752 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-09-11T22:58:02.752 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-09-11T22:58:02.752 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-09-11T22:58:02.752 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-09-11T22:58:02.752 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-09-11T22:58:02.752 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-09-11T22:58:02.752 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-09-11T22:58:02.752 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-09-11T22:58:02.752 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/sit.ko 2024-09-11T22:58:02.753 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/tunnel6.ko 2024-09-11T22:58:02.753 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/xfrm6_tunnel.ko 2024-09-11T22:58:02.753 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key 2024-09-11T22:58:02.753 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/af_key.ko 2024-09-11T22:58:02.753 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp 2024-09-11T22:58:02.753 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_core.ko 2024-09-11T22:58:02.753 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_debugfs.ko 2024-09-11T22:58:02.753 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_eth.ko 2024-09-11T22:58:02.753 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip.ko 2024-09-11T22:58:02.753 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip6.ko 2024-09-11T22:58:02.753 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_netlink.ko 2024-09-11T22:58:02.753 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ppp.ko 2024-09-11T22:58:02.753 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc 2024-09-11T22:58:02.753 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc.ko 2024-09-11T22:58:02.754 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154 2024-09-11T22:58:02.754 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/mac802154.ko 2024-09-11T22:58:02.754 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls 2024-09-11T22:58:02.754 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/mpls_gso.ko 2024-09-11T22:58:02.754 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter 2024-09-11T22:58:02.754 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset 2024-09-11T22:58:02.754 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set.ko 2024-09-11T22:58:02.754 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-09-11T22:58:02.754 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-09-11T22:58:02.754 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-09-11T22:58:02.754 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-09-11T22:58:02.754 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-09-11T22:58:02.754 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-09-11T22:58:02.754 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-09-11T22:58:02.755 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-09-11T22:58:02.755 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-09-11T22:58:02.755 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-09-11T22:58:02.755 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-09-11T22:58:02.755 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-09-11T22:58:02.755 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-09-11T22:58:02.755 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-09-11T22:58:02.755 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-09-11T22:58:02.755 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs 2024-09-11T22:58:02.755 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs.ko 2024-09-11T22:58:02.755 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-09-11T22:58:02.755 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-09-11T22:58:02.755 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-09-11T22:58:02.756 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-09-11T22:58:02.756 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-09-11T22:58:02.756 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-09-11T22:58:02.756 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-09-11T22:58:02.756 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-09-11T22:58:02.756 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-09-11T22:58:02.756 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-09-11T22:58:02.756 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-09-11T22:58:02.756 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-09-11T22:58:02.756 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-09-11T22:58:02.756 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conncount.ko 2024-09-11T22:58:02.756 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack.ko 2024-09-11T22:58:02.756 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-09-11T22:58:02.756 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-09-11T22:58:02.757 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-09-11T22:58:02.757 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_h323.ko 2024-09-11T22:58:02.757 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_irc.ko 2024-09-11T22:58:02.757 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-09-11T22:58:02.757 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-09-11T22:58:02.757 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-09-11T22:58:02.757 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sane.ko 2024-09-11T22:58:02.757 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sip.ko 2024-09-11T22:58:02.757 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-09-11T22:58:02.757 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-09-11T22:58:02.757 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_dup_netdev.ko 2024-09-11T22:58:02.757 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table.ko 2024-09-11T22:58:02.757 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table_inet.ko 2024-09-11T22:58:02.758 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_log_syslog.ko 2024-09-11T22:58:02.758 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat.ko 2024-09-11T22:58:02.758 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_amanda.ko 2024-09-11T22:58:02.758 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_ftp.ko 2024-09-11T22:58:02.758 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_irc.ko 2024-09-11T22:58:02.758 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_sip.ko 2024-09-11T22:58:02.758 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_tftp.ko 2024-09-11T22:58:02.758 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_synproxy_core.ko 2024-09-11T22:58:02.758 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_tables.ko 2024-09-11T22:58:02.758 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink.ko 2024-09-11T22:58:02.758 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_acct.ko 2024-09-11T22:58:02.758 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_log.ko 2024-09-11T22:58:02.758 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_osf.ko 2024-09-11T22:58:02.758 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_queue.ko 2024-09-11T22:58:02.759 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_chain_nat.ko 2024-09-11T22:58:02.759 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_compat.ko 2024-09-11T22:58:02.759 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_ct.ko 2024-09-11T22:58:02.759 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_dup_netdev.ko 2024-09-11T22:58:02.759 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fib.ko 2024-09-11T22:58:02.759 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fwd_netdev.ko 2024-09-11T22:58:02.759 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_hash.ko 2024-09-11T22:58:02.759 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_limit.ko 2024-09-11T22:58:02.759 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_log.ko 2024-09-11T22:58:02.759 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_masq.ko 2024-09-11T22:58:02.759 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_nat.ko 2024-09-11T22:58:02.759 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_numgen.ko 2024-09-11T22:58:02.759 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_queue.ko 2024-09-11T22:58:02.759 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_quota.ko 2024-09-11T22:58:02.760 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_redir.ko 2024-09-11T22:58:02.760 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject.ko 2024-09-11T22:58:02.760 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject_inet.ko 2024-09-11T22:58:02.760 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_socket.ko 2024-09-11T22:58:02.760 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_tunnel.ko 2024-09-11T22:58:02.760 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_AUDIT.ko 2024-09-11T22:58:02.760 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CHECKSUM.ko 2024-09-11T22:58:02.760 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CLASSIFY.ko 2024-09-11T22:58:02.760 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-09-11T22:58:02.760 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CT.ko 2024-09-11T22:58:02.760 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_DSCP.ko 2024-09-11T22:58:02.760 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HL.ko 2024-09-11T22:58:02.760 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HMARK.ko 2024-09-11T22:58:02.761 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_IDLETIMER.ko 2024-09-11T22:58:02.761 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LED.ko 2024-09-11T22:58:02.761 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LOG.ko 2024-09-11T22:58:02.761 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_MASQUERADE.ko 2024-09-11T22:58:02.761 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NETMAP.ko 2024-09-11T22:58:02.761 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFLOG.ko 2024-09-11T22:58:02.761 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFQUEUE.ko 2024-09-11T22:58:02.761 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_RATEEST.ko 2024-09-11T22:58:02.761 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_REDIRECT.ko 2024-09-11T22:58:02.761 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_SECMARK.ko 2024-09-11T22:58:02.761 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPMSS.ko 2024-09-11T22:58:02.761 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-09-11T22:58:02.761 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TEE.ko 2024-09-11T22:58:02.761 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TPROXY.ko 2024-09-11T22:58:02.762 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TRACE.ko 2024-09-11T22:58:02.762 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_addrtype.ko 2024-09-11T22:58:02.762 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_bpf.ko 2024-09-11T22:58:02.762 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cgroup.ko 2024-09-11T22:58:02.762 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cluster.ko 2024-09-11T22:58:02.762 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_comment.ko 2024-09-11T22:58:02.762 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connbytes.ko 2024-09-11T22:58:02.762 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlabel.ko 2024-09-11T22:58:02.762 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlimit.ko 2024-09-11T22:58:02.762 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connmark.ko 2024-09-11T22:58:02.762 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_conntrack.ko 2024-09-11T22:58:02.762 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cpu.ko 2024-09-11T22:58:02.762 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dccp.ko 2024-09-11T22:58:02.762 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_devgroup.ko 2024-09-11T22:58:02.763 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dscp.ko 2024-09-11T22:58:02.763 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ecn.ko 2024-09-11T22:58:02.763 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_esp.ko 2024-09-11T22:58:02.763 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hashlimit.ko 2024-09-11T22:58:02.763 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_helper.ko 2024-09-11T22:58:02.763 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hl.ko 2024-09-11T22:58:02.763 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipcomp.ko 2024-09-11T22:58:02.763 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_iprange.ko 2024-09-11T22:58:02.763 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipvs.ko 2024-09-11T22:58:02.763 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_l2tp.ko 2024-09-11T22:58:02.763 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_length.ko 2024-09-11T22:58:02.763 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_limit.ko 2024-09-11T22:58:02.763 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mac.ko 2024-09-11T22:58:02.763 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mark.ko 2024-09-11T22:58:02.764 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_multiport.ko 2024-09-11T22:58:02.764 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nat.ko 2024-09-11T22:58:02.764 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nfacct.ko 2024-09-11T22:58:02.764 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_osf.ko 2024-09-11T22:58:02.764 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_owner.ko 2024-09-11T22:58:02.764 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_physdev.ko 2024-09-11T22:58:02.764 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_pkttype.ko 2024-09-11T22:58:02.764 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_policy.ko 2024-09-11T22:58:02.764 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_quota.ko 2024-09-11T22:58:02.764 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_rateest.ko 2024-09-11T22:58:02.764 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_realm.ko 2024-09-11T22:58:02.764 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_recent.ko 2024-09-11T22:58:02.764 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_sctp.ko 2024-09-11T22:58:02.765 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_set.ko 2024-09-11T22:58:02.765 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_socket.ko 2024-09-11T22:58:02.765 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_state.ko 2024-09-11T22:58:02.765 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_statistic.ko 2024-09-11T22:58:02.765 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_string.ko 2024-09-11T22:58:02.765 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpmss.ko 2024-09-11T22:58:02.765 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_time.ko 2024-09-11T22:58:02.765 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_u32.ko 2024-09-11T22:58:02.765 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink 2024-09-11T22:58:02.765 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/netlink_diag.ko 2024-09-11T22:58:02.765 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh 2024-09-11T22:58:02.765 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/nsh.ko 2024-09-11T22:58:02.765 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch 2024-09-11T22:58:02.765 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/openvswitch.ko 2024-09-11T22:58:02.766 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-geneve.ko 2024-09-11T22:58:02.766 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-gre.ko 2024-09-11T22:58:02.766 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-vxlan.ko 2024-09-11T22:58:02.766 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet 2024-09-11T22:58:02.766 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/af_packet_diag.ko 2024-09-11T22:58:02.766 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds 2024-09-11T22:58:02.766 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds.ko 2024-09-11T22:58:02.766 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_rdma.ko 2024-09-11T22:58:02.766 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_tcp.ko 2024-09-11T22:58:02.766 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched 2024-09-11T22:58:02.766 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_csum.ko 2024-09-11T22:58:02.766 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_gact.ko 2024-09-11T22:58:02.766 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_mirred.ko 2024-09-11T22:58:02.767 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_nat.ko 2024-09-11T22:58:02.767 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_pedit.ko 2024-09-11T22:58:02.767 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_police.ko 2024-09-11T22:58:02.767 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_simple.ko 2024-09-11T22:58:02.767 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_skbedit.ko 2024-09-11T22:58:02.767 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_vlan.ko 2024-09-11T22:58:02.767 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_basic.ko 2024-09-11T22:58:02.767 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_bpf.ko 2024-09-11T22:58:02.767 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_flow.ko 2024-09-11T22:58:02.767 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_fw.ko 2024-09-11T22:58:02.767 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_route.ko 2024-09-11T22:58:02.767 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_u32.ko 2024-09-11T22:58:02.767 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_cmp.ko 2024-09-11T22:58:02.768 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_ipset.ko 2024-09-11T22:58:02.768 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_meta.ko 2024-09-11T22:58:02.768 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_nbyte.ko 2024-09-11T22:58:02.768 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_text.ko 2024-09-11T22:58:02.768 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_u32.ko 2024-09-11T22:58:02.768 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_choke.ko 2024-09-11T22:58:02.768 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_codel.ko 2024-09-11T22:58:02.768 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_drr.ko 2024-09-11T22:58:02.768 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq.ko 2024-09-11T22:58:02.768 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_gred.ko 2024-09-11T22:58:02.768 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hfsc.ko 2024-09-11T22:58:02.768 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hhf.ko 2024-09-11T22:58:02.769 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_htb.ko 2024-09-11T22:58:02.769 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_ingress.ko 2024-09-11T22:58:02.769 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio.ko 2024-09-11T22:58:02.769 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio_lib.ko 2024-09-11T22:58:02.769 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_multiq.ko 2024-09-11T22:58:02.769 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_netem.ko 2024-09-11T22:58:02.769 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_pie.ko 2024-09-11T22:58:02.769 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_plug.ko 2024-09-11T22:58:02.769 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_prio.ko 2024-09-11T22:58:02.769 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_qfq.ko 2024-09-11T22:58:02.769 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_red.ko 2024-09-11T22:58:02.769 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfb.ko 2024-09-11T22:58:02.769 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfq.ko 2024-09-11T22:58:02.769 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_tbf.ko 2024-09-11T22:58:02.770 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_teql.ko 2024-09-11T22:58:02.770 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp 2024-09-11T22:58:02.770 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp.ko 2024-09-11T22:58:02.770 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp_diag.ko 2024-09-11T22:58:02.770 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc 2024-09-11T22:58:02.770 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss 2024-09-11T22:58:02.770 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-09-11T22:58:02.770 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-09-11T22:58:02.770 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/sunrpc.ko 2024-09-11T22:58:02.770 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma 2024-09-11T22:58:02.770 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-09-11T22:58:02.770 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc 2024-09-11T22:58:02.770 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc.ko 2024-09-11T22:58:02.771 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc_diag.ko 2024-09-11T22:58:02.771 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix 2024-09-11T22:58:02.771 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/unix_diag.ko 2024-09-11T22:58:02.771 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock 2024-09-11T22:58:02.771 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-09-11T22:58:02.771 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-09-11T22:58:02.771 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock.ko 2024-09-11T22:58:02.771 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_diag.ko 2024-09-11T22:58:02.771 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_loopback.ko 2024-09-11T22:58:02.771 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm 2024-09-11T22:58:02.771 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_ipcomp.ko 2024-09-11T22:58:02.771 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security 2024-09-11T22:58:02.771 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys 2024-09-11T22:58:02.771 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys 2024-09-11T22:58:02.772 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-09-11T22:58:02.772 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys 2024-09-11T22:58:02.772 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys/trusted.ko 2024-09-11T22:58:02.772 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias 2024-09-11T22:58:02.772 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias.bin 2024-09-11T22:58:02.772 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin 2024-09-11T22:58:02.772 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.alias.bin 2024-09-11T22:58:02.772 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.bin 2024-09-11T22:58:02.772 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.modinfo 2024-09-11T22:58:02.772 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep 2024-09-11T22:58:02.772 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep.bin 2024-09-11T22:58:02.772 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.devname 2024-09-11T22:58:02.772 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.order 2024-09-11T22:58:02.773 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.softdep 2024-09-11T22:58:02.773 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols 2024-09-11T22:58:02.773 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols.bin 2024-09-11T22:58:02.773 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.weakdep 2024-09-11T22:58:02.773 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-11T22:58:02.777 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc5-g2ca44a2f35ca 2024-09-11T22:58:02.777 DEBUG:teuthology.orchestra.run.smithi037:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-09-11T22:58:02.803 INFO:teuthology.orchestra.run.smithi037.stdout:postinstall scriptlet (using /bin/sh): 2024-09-11T22:58:02.803 INFO:teuthology.orchestra.run.smithi037.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-11T22:58:02.803 INFO:teuthology.orchestra.run.smithi037.stdout: /usr/bin/kernel-install add 6.11.0-rc5-g2ca44a2f35ca /lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-11T22:58:02.803 INFO:teuthology.orchestra.run.smithi037.stdout:fi 2024-09-11T22:58:02.803 INFO:teuthology.orchestra.run.smithi037.stdout:for file in vmlinuz System.map config; do 2024-09-11T22:58:02.803 INFO:teuthology.orchestra.run.smithi037.stdout: if ! cmp --silent "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca"; then 2024-09-11T22:58:02.803 INFO:teuthology.orchestra.run.smithi037.stdout: cp "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca" 2024-09-11T22:58:02.803 INFO:teuthology.orchestra.run.smithi037.stdout: fi 2024-09-11T22:58:02.804 INFO:teuthology.orchestra.run.smithi037.stdout:done 2024-09-11T22:58:02.804 INFO:teuthology.orchestra.run.smithi037.stdout:if [ -d "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" ] && \ 2024-09-11T22:58:02.804 INFO:teuthology.orchestra.run.smithi037.stdout: ! diff -rq "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" >/dev/null 2>&1; then 2024-09-11T22:58:02.804 INFO:teuthology.orchestra.run.smithi037.stdout: rm -rf "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-11T22:58:02.804 INFO:teuthology.orchestra.run.smithi037.stdout: cp -r "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-11T22:58:02.804 INFO:teuthology.orchestra.run.smithi037.stdout:fi 2024-09-11T22:58:02.804 INFO:teuthology.orchestra.run.smithi037.stdout:if [ ! -e "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep" ]; then 2024-09-11T22:58:02.804 INFO:teuthology.orchestra.run.smithi037.stdout: /usr/sbin/depmod 6.11.0-rc5-g2ca44a2f35ca 2024-09-11T22:58:02.804 INFO:teuthology.orchestra.run.smithi037.stdout:fi 2024-09-11T22:58:02.804 INFO:teuthology.orchestra.run.smithi037.stdout:preuninstall scriptlet (using /bin/sh): 2024-09-11T22:58:02.805 INFO:teuthology.orchestra.run.smithi037.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-11T22:58:02.805 INFO:teuthology.orchestra.run.smithi037.stdout:kernel-install remove 6.11.0-rc5-g2ca44a2f35ca 2024-09-11T22:58:02.805 INFO:teuthology.orchestra.run.smithi037.stdout:fi 2024-09-11T22:58:02.806 DEBUG:teuthology.orchestra.run.smithi037:> sudo rpm -qi grub2-tools 2024-09-11T22:58:02.882 INFO:teuthology.orchestra.run.smithi037.stdout:Name : grub2-tools 2024-09-11T22:58:02.882 INFO:teuthology.orchestra.run.smithi037.stdout:Epoch : 1 2024-09-11T22:58:02.883 INFO:teuthology.orchestra.run.smithi037.stdout:Version : 2.06 2024-09-11T22:58:02.883 INFO:teuthology.orchestra.run.smithi037.stdout:Release : 82.el9 2024-09-11T22:58:02.883 INFO:teuthology.orchestra.run.smithi037.stdout:Architecture: x86_64 2024-09-11T22:58:02.883 INFO:teuthology.orchestra.run.smithi037.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-11T22:58:02.883 INFO:teuthology.orchestra.run.smithi037.stdout:Group : Unspecified 2024-09-11T22:58:02.883 INFO:teuthology.orchestra.run.smithi037.stdout:Size : 8274670 2024-09-11T22:58:02.883 INFO:teuthology.orchestra.run.smithi037.stdout:License : GPLv3+ 2024-09-11T22:58:02.883 INFO:teuthology.orchestra.run.smithi037.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-11T22:58:02.883 INFO:teuthology.orchestra.run.smithi037.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-11T22:58:02.883 INFO:teuthology.orchestra.run.smithi037.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-11T22:58:02.883 INFO:teuthology.orchestra.run.smithi037.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-11T22:58:02.883 INFO:teuthology.orchestra.run.smithi037.stdout:Packager : builder@centos.org 2024-09-11T22:58:02.883 INFO:teuthology.orchestra.run.smithi037.stdout:Vendor : CentOS 2024-09-11T22:58:02.884 INFO:teuthology.orchestra.run.smithi037.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-11T22:58:02.884 INFO:teuthology.orchestra.run.smithi037.stdout:Summary : Support tools for GRUB. 2024-09-11T22:58:02.884 INFO:teuthology.orchestra.run.smithi037.stdout:Description : 2024-09-11T22:58:02.884 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T22:58:02.884 INFO:teuthology.orchestra.run.smithi037.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-11T22:58:02.884 INFO:teuthology.orchestra.run.smithi037.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-11T22:58:02.884 INFO:teuthology.orchestra.run.smithi037.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-11T22:58:02.884 INFO:teuthology.orchestra.run.smithi037.stdout:hardware devices. 2024-09-11T22:58:02.884 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T22:58:02.884 INFO:teuthology.orchestra.run.smithi037.stdout:This subpackage provides tools for support of all platforms. 2024-09-11T22:58:02.885 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-11T22:58:02.885 INFO:teuthology.task.kernel:Updating grub on smithi037 to boot 6.11.0-rc5-g2ca44a2f35ca 2024-09-11T22:58:02.885 DEBUG:teuthology.orchestra.run.smithi037:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-11T22:58:03.483 INFO:teuthology.orchestra.run.smithi037.stderr:Generating grub configuration file ... 2024-09-11T22:58:04.826 INFO:teuthology.orchestra.run.smithi037.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-11T22:58:04.855 INFO:teuthology.orchestra.run.smithi037.stderr:done 2024-09-11T22:58:04.857 DEBUG:teuthology.orchestra.run.smithi037:> mktemp 2024-09-11T22:58:04.872 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/tmp.qPAOwqZu57 2024-09-11T22:58:04.872 DEBUG:teuthology.orchestra.run.smithi037:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.qPAOwqZu57 2024-09-11T22:58:04.939 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 0666 /tmp/tmp.qPAOwqZu57 2024-09-11T22:58:05.073 DEBUG:teuthology.orchestra.remote:smithi037:/tmp/tmp.qPAOwqZu57 is 6KB 2024-09-11T22:58:05.122 DEBUG:teuthology.orchestra.run.smithi037:> rm -fr /tmp/tmp.qPAOwqZu57 2024-09-11T22:58:05.137 DEBUG:teuthology.orchestra.run.smithi037:> sudo /bin/ls /boot/loader/entries || true 2024-09-11T22:58:05.207 INFO:teuthology.orchestra.run.smithi037.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-11T22:58:05.207 INFO:teuthology.orchestra.run.smithi037.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-11T22:58:05.207 INFO:teuthology.orchestra.run.smithi037.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-11T22:58:05.207 INFO:teuthology.orchestra.run.smithi037.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca.conf 2024-09-11T22:58:05.208 DEBUG:teuthology.orchestra.run.smithi037:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca 2024-09-11T22:58:05.374 DEBUG:teuthology.orchestra.run.smithi037:> sudo shutdown -r now 2024-09-11T22:58:35.377 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-11T22:58:35.378 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2024-09-11T22:58:35.379 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T22:58:53.885 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.37 2024-09-11T22:59:02.886 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2024-09-11T22:59:02.887 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T23:00:02.898 DEBUG:teuthology.orchestra.remote:timed out 2024-09-11T23:00:14.899 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2024-09-11T23:00:14.900 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T23:00:15.299 DEBUG:teuthology.orchestra.run.smithi037:> true 2024-09-11T23:00:15.800 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi037.front.sepia.ceph.com' 2024-09-11T23:00:15.801 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.11.0-rc5-g2ca44a2f35ca"... 2024-09-11T23:00:15.801 DEBUG:teuthology.orchestra.run.smithi037:> uname -r 2024-09-11T23:00:15.835 INFO:teuthology.orchestra.run.smithi037.stdout:6.11.0-rc5-g2ca44a2f35ca 2024-09-11T23:00:15.835 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc5-g2ca44a2f35ca vs 6.11.0-rc5-g2ca44a2f35ca 2024-09-11T23:00:15.835 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-11T23:00:15.836 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-11T23:00:16.836 DEBUG:teuthology.parallel:result is None 2024-09-11T23:00:16.837 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-11T23:00:16.843 INFO:teuthology.task.internal:Creating test directory... 2024-09-11T23:00:16.843 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-11T23:00:16.848 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-11T23:00:16.851 DEBUG:teuthology.orchestra.run.smithi160:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-11T23:00:16.882 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-11T23:00:17.101 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-11T23:00:17.523 INFO:teuthology.task.internal:Creating archive directory... 2024-09-11T23:00:17.524 DEBUG:teuthology.orchestra.run.smithi037:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-11T23:00:17.528 DEBUG:teuthology.orchestra.run.smithi123:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-11T23:00:17.530 DEBUG:teuthology.orchestra.run.smithi160:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-11T23:00:17.672 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-11T23:00:17.810 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-11T23:00:17.811 DEBUG:teuthology.orchestra.run.smithi123:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-11T23:00:17.828 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T23:00:17.828 DEBUG:teuthology.orchestra.run.smithi160:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-11T23:00:17.845 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T23:00:17.846 DEBUG:teuthology.orchestra.run.smithi037:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-11T23:00:17.850 DEBUG:teuthology.orchestra.run.smithi123:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-11T23:00:17.870 DEBUG:teuthology.orchestra.run.smithi160:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-11T23:00:17.924 INFO:teuthology.orchestra.run.smithi123.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T23:00:17.941 INFO:teuthology.orchestra.run.smithi123.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T23:00:17.954 INFO:teuthology.orchestra.run.smithi037.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T23:00:17.956 INFO:teuthology.orchestra.run.smithi160.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T23:00:17.971 INFO:teuthology.orchestra.run.smithi160.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T23:00:17.982 INFO:teuthology.orchestra.run.smithi037.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T23:00:17.985 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-11T23:00:18.005 INFO:teuthology.task.internal:Configuring sudo... 2024-09-11T23:00:18.006 DEBUG:teuthology.orchestra.run.smithi037:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-11T23:00:18.011 DEBUG:teuthology.orchestra.run.smithi123:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-11T23:00:18.014 DEBUG:teuthology.orchestra.run.smithi160:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-11T23:00:18.066 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-11T23:00:18.091 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-11T23:00:18.091 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-11T23:00:18.095 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-11T23:00:18.098 DEBUG:teuthology.orchestra.run.smithi160:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-11T23:00:18.127 DEBUG:teuthology.orchestra.run.smithi037:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T23:00:18.239 DEBUG:teuthology.orchestra.run.smithi037:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T23:00:18.309 DEBUG:teuthology.orchestra.run.smithi037:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T23:00:18.380 DEBUG:teuthology.orchestra.run.smithi037:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T23:00:18.443 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-11T23:00:18.443 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-11T23:00:18.497 DEBUG:teuthology.orchestra.run.smithi123:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T23:00:18.550 DEBUG:teuthology.orchestra.run.smithi123:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T23:00:18.601 DEBUG:teuthology.orchestra.run.smithi123:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T23:00:18.695 DEBUG:teuthology.orchestra.run.smithi123:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T23:00:18.728 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-11T23:00:18.729 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-11T23:00:18.798 DEBUG:teuthology.orchestra.run.smithi160:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T23:00:18.853 DEBUG:teuthology.orchestra.run.smithi160:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T23:00:18.899 DEBUG:teuthology.orchestra.run.smithi160:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T23:00:18.992 DEBUG:teuthology.orchestra.run.smithi160:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T23:00:19.027 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-11T23:00:19.027 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-11T23:00:19.094 DEBUG:teuthology.orchestra.run.smithi037:> sudo service rsyslog restart 2024-09-11T23:00:19.098 DEBUG:teuthology.orchestra.run.smithi123:> sudo service rsyslog restart 2024-09-11T23:00:19.101 DEBUG:teuthology.orchestra.run.smithi160:> sudo service rsyslog restart 2024-09-11T23:00:19.140 INFO:teuthology.orchestra.run.smithi123.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T23:00:19.178 INFO:teuthology.orchestra.run.smithi037.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T23:00:19.191 INFO:teuthology.orchestra.run.smithi160.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T23:00:19.627 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-11T23:00:19.635 INFO:teuthology.task.internal:Starting timer... 2024-09-11T23:00:19.635 INFO:teuthology.run_tasks:Running task pcp... 2024-09-11T23:00:19.731 INFO:teuthology.run_tasks:Running task selinux... 2024-09-11T23:00:19.827 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-09-11T23:00:19.827 DEBUG:teuthology.orchestra.run.smithi037:> sudo service auditd rotate 2024-09-11T23:00:19.909 INFO:teuthology.orchestra.run.smithi037.stdout:Rotating logs: 2024-09-11T23:00:19.912 DEBUG:teuthology.orchestra.run.smithi123:> sudo service auditd rotate 2024-09-11T23:00:19.984 INFO:teuthology.orchestra.run.smithi123.stdout:Rotating logs: 2024-09-11T23:00:19.986 DEBUG:teuthology.orchestra.run.smithi160:> sudo service auditd rotate 2024-09-11T23:00:20.032 INFO:teuthology.orchestra.run.smithi160.stdout:Rotating logs: 2024-09-11T23:00:20.034 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-11T23:00:20.034 DEBUG:teuthology.orchestra.run.smithi037:> /usr/sbin/getenforce 2024-09-11T23:00:20.079 INFO:teuthology.orchestra.run.smithi037.stdout:Permissive 2024-09-11T23:00:20.079 DEBUG:teuthology.orchestra.run.smithi123:> /usr/sbin/getenforce 2024-09-11T23:00:20.105 INFO:teuthology.orchestra.run.smithi123.stdout:Permissive 2024-09-11T23:00:20.105 DEBUG:teuthology.orchestra.run.smithi160:> /usr/sbin/getenforce 2024-09-11T23:00:20.125 INFO:teuthology.orchestra.run.smithi160.stdout:Permissive 2024-09-11T23:00:20.125 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi037.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi123.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi160.front.sepia.ceph.com': 'permissive'} 2024-09-11T23:00:20.126 DEBUG:teuthology.orchestra.run.smithi037:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-11T23:00:20.183 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T23:00:20.184 DEBUG:teuthology.orchestra.run.smithi123:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-11T23:00:20.212 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T23:00:20.212 DEBUG:teuthology.orchestra.run.smithi160:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-11T23:00:20.239 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T23:00:20.240 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-11T23:00:20.240 DEBUG:teuthology.orchestra.run.smithi037:> sudo /usr/sbin/setenforce permissive 2024-09-11T23:00:20.301 DEBUG:teuthology.orchestra.run.smithi123:> sudo /usr/sbin/setenforce permissive 2024-09-11T23:00:20.333 DEBUG:teuthology.orchestra.run.smithi160:> sudo /usr/sbin/setenforce permissive 2024-09-11T23:00:20.373 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-11T23:00:20.385 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-11T23:00:20.400 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-11T23:00:20.402 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi037.front.sepia.ceph.com,smithi123.front.sepia.ceph.com,smithi160.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-11T23:05:03.881 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi037.front.sepia.ceph.com'), Remote(name='ubuntu@smithi123.front.sepia.ceph.com'), Remote(name='ubuntu@smithi160.front.sepia.ceph.com')] 2024-09-11T23:05:03.883 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2024-09-11T23:05:03.885 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T23:05:03.980 DEBUG:teuthology.orchestra.run.smithi037:> true 2024-09-11T23:05:04.102 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi037.front.sepia.ceph.com' 2024-09-11T23:05:04.103 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com' 2024-09-11T23:05:04.103 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T23:05:04.203 DEBUG:teuthology.orchestra.run.smithi123:> true 2024-09-11T23:05:04.281 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi123.front.sepia.ceph.com' 2024-09-11T23:05:04.281 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi160.front.sepia.ceph.com' 2024-09-11T23:05:04.282 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T23:05:04.366 DEBUG:teuthology.orchestra.run.smithi160:> true 2024-09-11T23:05:04.445 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi160.front.sepia.ceph.com' 2024-09-11T23:05:04.445 INFO:teuthology.run_tasks:Running task clock... 2024-09-11T23:05:04.457 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-11T23:05:04.457 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-11T23:05:04.458 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T23:05:04.461 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-11T23:05:04.462 DEBUG:teuthology.orchestra.run.smithi123:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T23:05:04.464 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-11T23:05:04.464 DEBUG:teuthology.orchestra.run.smithi160:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T23:05:04.494 INFO:teuthology.orchestra.run.smithi123.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-11T23:05:04.509 INFO:teuthology.orchestra.run.smithi123.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-11T23:05:04.515 INFO:teuthology.orchestra.run.smithi160.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-11T23:05:04.520 INFO:teuthology.orchestra.run.smithi037.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-11T23:05:04.530 INFO:teuthology.orchestra.run.smithi160.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-11T23:05:04.535 INFO:teuthology.orchestra.run.smithi123.stderr:sudo: ntpd: command not found 2024-09-11T23:05:04.546 INFO:teuthology.orchestra.run.smithi123.stdout:506 Cannot talk to daemon 2024-09-11T23:05:04.550 INFO:teuthology.orchestra.run.smithi037.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-11T23:05:04.555 INFO:teuthology.orchestra.run.smithi160.stderr:sudo: ntpd: command not found 2024-09-11T23:05:04.561 INFO:teuthology.orchestra.run.smithi123.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-11T23:05:04.566 INFO:teuthology.orchestra.run.smithi160.stdout:506 Cannot talk to daemon 2024-09-11T23:05:04.575 INFO:teuthology.orchestra.run.smithi123.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-11T23:05:04.580 INFO:teuthology.orchestra.run.smithi160.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-11T23:05:04.594 INFO:teuthology.orchestra.run.smithi160.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-11T23:05:04.602 INFO:teuthology.orchestra.run.smithi037.stderr:sudo: ntpd: command not found 2024-09-11T23:05:04.626 INFO:teuthology.orchestra.run.smithi037.stdout:506 Cannot talk to daemon 2024-09-11T23:05:04.627 INFO:teuthology.orchestra.run.smithi123.stderr:bash: line 1: ntpq: command not found 2024-09-11T23:05:04.631 INFO:teuthology.orchestra.run.smithi123.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T23:05:04.632 INFO:teuthology.orchestra.run.smithi123.stdout:=============================================================================== 2024-09-11T23:05:04.632 INFO:teuthology.orchestra.run.smithi123.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T23:05:04.632 INFO:teuthology.orchestra.run.smithi123.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T23:05:04.632 INFO:teuthology.orchestra.run.smithi123.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T23:05:04.632 INFO:teuthology.orchestra.run.smithi123.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T23:05:04.647 INFO:teuthology.orchestra.run.smithi160.stderr:bash: line 1: ntpq: command not found 2024-09-11T23:05:04.650 INFO:teuthology.orchestra.run.smithi160.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T23:05:04.652 INFO:teuthology.orchestra.run.smithi160.stdout:=============================================================================== 2024-09-11T23:05:04.652 INFO:teuthology.orchestra.run.smithi160.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T23:05:04.652 INFO:teuthology.orchestra.run.smithi160.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T23:05:04.652 INFO:teuthology.orchestra.run.smithi160.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T23:05:04.652 INFO:teuthology.orchestra.run.smithi160.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T23:05:04.656 INFO:teuthology.orchestra.run.smithi037.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-11T23:05:04.686 INFO:teuthology.orchestra.run.smithi037.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-11T23:05:04.787 INFO:teuthology.orchestra.run.smithi037.stderr:bash: line 1: ntpq: command not found 2024-09-11T23:05:04.793 INFO:teuthology.orchestra.run.smithi037.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T23:05:04.793 INFO:teuthology.orchestra.run.smithi037.stdout:=============================================================================== 2024-09-11T23:05:04.793 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T23:05:04.793 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T23:05:04.794 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T23:05:04.794 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T23:05:04.794 INFO:teuthology.run_tasks:Running task install... 2024-09-11T23:05:04.818 DEBUG:teuthology.task.install:project ceph 2024-09-11T23:05:04.818 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'}} 2024-09-11T23:05:04.818 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'} 2024-09-11T23:05:04.819 INFO:teuthology.task.install:Using flavor: default 2024-09-11T23:05:04.825 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-11T23:05:04.825 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-11T23:05:04.826 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'tag': None, 'wait_for_package': False} 2024-09-11T23:05:04.826 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T23:05:04.828 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'tag': None, 'wait_for_package': False} 2024-09-11T23:05:04.828 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T23:05:04.829 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'tag': None, 'wait_for_package': False} 2024-09-11T23:05:04.830 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T23:05:04.998 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/ 2024-09-11T23:05:04.998 INFO:teuthology.task.install.rpm:Package version is 19.1.1-298.gb53b6d3e 2024-09-11T23:05:05.011 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/ 2024-09-11T23:05:05.011 INFO:teuthology.task.install.rpm:Package version is 19.1.1-298.gb53b6d3e 2024-09-11T23:05:05.022 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/ 2024-09-11T23:05:05.022 INFO:teuthology.task.install.rpm:Package version is 19.1.1-298.gb53b6d3e 2024-09-11T23:05:05.308 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-11T23:05:05.308 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-11T23:05:05.308 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-11T23:05:05.310 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-11T23:05:05.311 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-11T23:05:05.311 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-11T23:05:05.330 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-11T23:05:05.330 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-11T23:05:05.330 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-11T23:05:05.338 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-11T23:05:05.338 DEBUG:teuthology.orchestra.run.smithi123:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-11T23:05:05.357 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-11T23:05:05.357 DEBUG:teuthology.orchestra.run.smithi160:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-11T23:05:05.368 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-11T23:05:05.369 DEBUG:teuthology.orchestra.run.smithi037:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-11T23:05:05.404 DEBUG:teuthology.orchestra.run.smithi123:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-11T23:05:05.423 DEBUG:teuthology.orchestra.run.smithi160:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-11T23:05:05.466 DEBUG:teuthology.orchestra.run.smithi037:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-11T23:05:05.479 DEBUG:teuthology.orchestra.run.smithi123:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-11T23:05:05.498 DEBUG:teuthology.orchestra.run.smithi160:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-11T23:05:05.543 INFO:teuthology.orchestra.run.smithi123.stdout:check_obsoletes = 1 2024-09-11T23:05:05.544 DEBUG:teuthology.orchestra.run.smithi123:> sudo yum clean all 2024-09-11T23:05:05.545 DEBUG:teuthology.orchestra.run.smithi037:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-11T23:05:05.562 INFO:teuthology.orchestra.run.smithi160.stdout:check_obsoletes = 1 2024-09-11T23:05:05.564 DEBUG:teuthology.orchestra.run.smithi160:> sudo yum clean all 2024-09-11T23:05:05.600 INFO:teuthology.orchestra.run.smithi037.stdout:check_obsoletes = 1 2024-09-11T23:05:05.604 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum clean all 2024-09-11T23:05:05.771 INFO:teuthology.orchestra.run.smithi123.stdout:45 files removed 2024-09-11T23:05:05.793 INFO:teuthology.orchestra.run.smithi160.stdout:45 files removed 2024-09-11T23:05:05.798 DEBUG:teuthology.orchestra.run.smithi123:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-11T23:05:05.821 DEBUG:teuthology.orchestra.run.smithi160:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-11T23:05:05.891 INFO:teuthology.orchestra.run.smithi037.stdout:45 files removed 2024-09-11T23:05:05.924 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-11T23:05:06.489 INFO:teuthology.orchestra.run.smithi123.stdout:ceph packages for x86_64 201 kB/s | 84 kB 00:00 2024-09-11T23:05:06.555 INFO:teuthology.orchestra.run.smithi160.stdout:ceph packages for x86_64 183 kB/s | 84 kB 00:00 2024-09-11T23:05:06.782 INFO:teuthology.orchestra.run.smithi037.stdout:ceph packages for x86_64 186 kB/s | 84 kB 00:00 2024-09-11T23:05:06.998 INFO:teuthology.orchestra.run.smithi123.stdout:ceph noarch packages 25 kB/s | 12 kB 00:00 2024-09-11T23:05:07.098 INFO:teuthology.orchestra.run.smithi160.stdout:ceph noarch packages 23 kB/s | 12 kB 00:00 2024-09-11T23:05:07.274 INFO:teuthology.orchestra.run.smithi037.stdout:ceph noarch packages 26 kB/s | 12 kB 00:00 2024-09-11T23:05:07.398 INFO:teuthology.orchestra.run.smithi123.stdout:ceph source packages 5.2 kB/s | 1.9 kB 00:00 2024-09-11T23:05:07.473 INFO:teuthology.orchestra.run.smithi160.stdout:ceph source packages 5.6 kB/s | 1.9 kB 00:00 2024-09-11T23:05:07.625 INFO:teuthology.orchestra.run.smithi037.stdout:ceph source packages 6.1 kB/s | 1.9 kB 00:00 2024-09-11T23:05:07.923 INFO:teuthology.orchestra.run.smithi123.stdout:CentOS Stream 9 - BaseOS 17 MB/s | 8.2 MB 00:00 2024-09-11T23:05:09.173 INFO:teuthology.orchestra.run.smithi160.stdout:CentOS Stream 9 - BaseOS 5.0 MB/s | 8.2 MB 00:01 2024-09-11T23:05:10.182 INFO:teuthology.orchestra.run.smithi123.stdout:CentOS Stream 9 - AppStream 18 MB/s | 20 MB 00:01 2024-09-11T23:05:10.600 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - BaseOS 2.8 MB/s | 8.2 MB 00:02 2024-09-11T23:05:12.349 INFO:teuthology.orchestra.run.smithi160.stdout:CentOS Stream 9 - AppStream 9.8 MB/s | 20 MB 00:02 2024-09-11T23:05:12.859 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - AppStream 19 MB/s | 20 MB 00:01 2024-09-11T23:05:15.858 INFO:teuthology.orchestra.run.smithi123.stdout:CentOS Stream 9 - CRB 3.6 MB/s | 6.5 MB 00:01 2024-09-11T23:05:16.908 INFO:teuthology.orchestra.run.smithi160.stdout:CentOS Stream 9 - CRB 9.6 MB/s | 6.5 MB 00:00 2024-09-11T23:05:17.467 INFO:teuthology.orchestra.run.smithi123.stdout:CentOS Stream 9 - Extras packages 52 kB/s | 19 kB 00:00 2024-09-11T23:05:18.542 INFO:teuthology.orchestra.run.smithi160.stdout:CentOS Stream 9 - Extras packages 44 kB/s | 19 kB 00:00 2024-09-11T23:05:18.655 INFO:teuthology.orchestra.run.smithi123.stdout:Extra Packages for Enterprise Linux 21 MB/s | 23 MB 00:01 2024-09-11T23:05:18.860 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - CRB 3.6 MB/s | 6.5 MB 00:01 2024-09-11T23:05:19.438 INFO:teuthology.orchestra.run.smithi160.stdout:Extra Packages for Enterprise Linux 29 MB/s | 23 MB 00:00 2024-09-11T23:05:20.694 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - Extras packages 39 kB/s | 19 kB 00:00 2024-09-11T23:05:21.565 INFO:teuthology.orchestra.run.smithi037.stdout:Extra Packages for Enterprise Linux 31 MB/s | 23 MB 00:00 2024-09-11T23:05:24.111 INFO:teuthology.orchestra.run.smithi123.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-11T23:05:24.885 INFO:teuthology.orchestra.run.smithi160.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-11T23:05:26.396 INFO:teuthology.orchestra.run.smithi123.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-11T23:05:26.397 INFO:teuthology.orchestra.run.smithi123.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-11T23:05:26.409 INFO:teuthology.orchestra.run.smithi123.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-11T23:05:26.409 INFO:teuthology.orchestra.run.smithi123.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-11T23:05:26.410 INFO:teuthology.orchestra.run.smithi123.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-11T23:05:26.411 INFO:teuthology.orchestra.run.smithi123.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-11T23:05:26.413 INFO:teuthology.orchestra.run.smithi123.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-11T23:05:26.415 INFO:teuthology.orchestra.run.smithi123.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-11T23:05:26.416 INFO:teuthology.orchestra.run.smithi123.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-11T23:05:26.478 INFO:teuthology.orchestra.run.smithi123.stdout:Dependencies resolved. 2024-09-11T23:05:26.495 INFO:teuthology.orchestra.run.smithi123.stdout:====================================================================================== 2024-09-11T23:05:26.496 INFO:teuthology.orchestra.run.smithi123.stdout: Package Arch Version Repository Size 2024-09-11T23:05:26.496 INFO:teuthology.orchestra.run.smithi123.stdout:====================================================================================== 2024-09-11T23:05:26.496 INFO:teuthology.orchestra.run.smithi123.stdout:Installing: 2024-09-11T23:05:26.496 INFO:teuthology.orchestra.run.smithi123.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-11T23:05:26.496 INFO:teuthology.orchestra.run.smithi123.stdout: ceph x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 6.5 k 2024-09-11T23:05:26.496 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-base x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.4 M 2024-09-11T23:05:26.496 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 897 k 2024-09-11T23:05:26.496 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 145 k 2024-09-11T23:05:26.496 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 1.5 M 2024-09-11T23:05:26.497 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 146 k 2024-09-11T23:05:26.497 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-dashboard noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 3.6 M 2024-09-11T23:05:26.497 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 7.4 M 2024-09-11T23:05:26.497 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-rook noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 49 k 2024-09-11T23:05:26.497 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-radosgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 11 M 2024-09-11T23:05:26.497 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-test x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 49 M 2024-09-11T23:05:26.497 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-volume noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 285 k 2024-09-11T23:05:26.497 INFO:teuthology.orchestra.run.smithi123.stdout: cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 765 k 2024-09-11T23:05:26.497 INFO:teuthology.orchestra.run.smithi123.stdout: cephfs-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 228 k 2024-09-11T23:05:26.497 INFO:teuthology.orchestra.run.smithi123.stdout: cephfs-shell x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 27 k 2024-09-11T23:05:26.497 INFO:teuthology.orchestra.run.smithi123.stdout: cephfs-top noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 18 k 2024-09-11T23:05:26.497 INFO:teuthology.orchestra.run.smithi123.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-11T23:05:26.498 INFO:teuthology.orchestra.run.smithi123.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-11T23:05:26.498 INFO:teuthology.orchestra.run.smithi123.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-11T23:05:26.498 INFO:teuthology.orchestra.run.smithi123.stdout: libcephfs-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 32 k 2024-09-11T23:05:26.498 INFO:teuthology.orchestra.run.smithi123.stdout: libcephfs2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 752 k 2024-09-11T23:05:26.498 INFO:teuthology.orchestra.run.smithi123.stdout: librados-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 127 k 2024-09-11T23:05:26.498 INFO:teuthology.orchestra.run.smithi123.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-11T23:05:26.498 INFO:teuthology.orchestra.run.smithi123.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-11T23:05:26.498 INFO:teuthology.orchestra.run.smithi123.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-11T23:05:26.498 INFO:teuthology.orchestra.run.smithi123.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-11T23:05:26.498 INFO:teuthology.orchestra.run.smithi123.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-11T23:05:26.498 INFO:teuthology.orchestra.run.smithi123.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-11T23:05:26.498 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cephfs x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 162 k 2024-09-11T23:05:26.499 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rados x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 321 k 2024-09-11T23:05:26.499 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 301 k 2024-09-11T23:05:26.499 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 100 k 2024-09-11T23:05:26.499 INFO:teuthology.orchestra.run.smithi123.stdout: rbd-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 85 k 2024-09-11T23:05:26.499 INFO:teuthology.orchestra.run.smithi123.stdout: rbd-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.1 M 2024-09-11T23:05:26.499 INFO:teuthology.orchestra.run.smithi123.stdout: rbd-nbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 171 k 2024-09-11T23:05:26.499 INFO:teuthology.orchestra.run.smithi123.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-11T23:05:26.499 INFO:teuthology.orchestra.run.smithi123.stdout:Upgrading: 2024-09-11T23:05:26.499 INFO:teuthology.orchestra.run.smithi123.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-11T23:05:26.499 INFO:teuthology.orchestra.run.smithi123.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-11T23:05:26.499 INFO:teuthology.orchestra.run.smithi123.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-11T23:05:26.499 INFO:teuthology.orchestra.run.smithi123.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-11T23:05:26.500 INFO:teuthology.orchestra.run.smithi123.stdout: librados2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.4 M 2024-09-11T23:05:26.500 INFO:teuthology.orchestra.run.smithi123.stdout: librbd1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.2 M 2024-09-11T23:05:26.500 INFO:teuthology.orchestra.run.smithi123.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-11T23:05:26.500 INFO:teuthology.orchestra.run.smithi123.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-11T23:05:26.500 INFO:teuthology.orchestra.run.smithi123.stdout:Installing dependencies: 2024-09-11T23:05:26.500 INFO:teuthology.orchestra.run.smithi123.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-11T23:05:26.500 INFO:teuthology.orchestra.run.smithi123.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-11T23:05:26.500 INFO:teuthology.orchestra.run.smithi123.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-11T23:05:26.500 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 21 M 2024-09-11T23:05:26.500 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-grafana-dashboards noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 32 k 2024-09-11T23:05:26.500 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mds x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 2.4 M 2024-09-11T23:05:26.500 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-modules-core noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 249 k 2024-09-11T23:05:26.501 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mon x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 4.7 M 2024-09-11T23:05:26.501 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-osd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 17 M 2024-09-11T23:05:26.501 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-prometheus-alerts noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 16 k 2024-09-11T23:05:26.501 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-selinux x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 25 k 2024-09-11T23:05:26.501 INFO:teuthology.orchestra.run.smithi123.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-11T23:05:26.501 INFO:teuthology.orchestra.run.smithi123.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-11T23:05:26.501 INFO:teuthology.orchestra.run.smithi123.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-11T23:05:26.501 INFO:teuthology.orchestra.run.smithi123.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-11T23:05:26.501 INFO:teuthology.orchestra.run.smithi123.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-11T23:05:26.501 INFO:teuthology.orchestra.run.smithi123.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-11T23:05:26.501 INFO:teuthology.orchestra.run.smithi123.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-11T23:05:26.501 INFO:teuthology.orchestra.run.smithi123.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-11T23:05:26.501 INFO:teuthology.orchestra.run.smithi123.stdout: libcephsqlite x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 163 k 2024-09-11T23:05:26.502 INFO:teuthology.orchestra.run.smithi123.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-11T23:05:26.502 INFO:teuthology.orchestra.run.smithi123.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-11T23:05:26.502 INFO:teuthology.orchestra.run.smithi123.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-11T23:05:26.502 INFO:teuthology.orchestra.run.smithi123.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-11T23:05:26.502 INFO:teuthology.orchestra.run.smithi123.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-11T23:05:26.502 INFO:teuthology.orchestra.run.smithi123.stdout: libradosstriper1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 506 k 2024-09-11T23:05:26.502 INFO:teuthology.orchestra.run.smithi123.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-11T23:05:26.502 INFO:teuthology.orchestra.run.smithi123.stdout: librgw2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.3 M 2024-09-11T23:05:26.502 INFO:teuthology.orchestra.run.smithi123.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-11T23:05:26.502 INFO:teuthology.orchestra.run.smithi123.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-11T23:05:26.502 INFO:teuthology.orchestra.run.smithi123.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-11T23:05:26.502 INFO:teuthology.orchestra.run.smithi123.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-11T23:05:26.502 INFO:teuthology.orchestra.run.smithi123.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-11T23:05:26.502 INFO:teuthology.orchestra.run.smithi123.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-11T23:05:26.503 INFO:teuthology.orchestra.run.smithi123.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-11T23:05:26.503 INFO:teuthology.orchestra.run.smithi123.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-11T23:05:26.503 INFO:teuthology.orchestra.run.smithi123.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-11T23:05:26.503 INFO:teuthology.orchestra.run.smithi123.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-11T23:05:26.503 INFO:teuthology.orchestra.run.smithi123.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-11T23:05:26.503 INFO:teuthology.orchestra.run.smithi123.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-11T23:05:26.503 INFO:teuthology.orchestra.run.smithi123.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-11T23:05:26.503 INFO:teuthology.orchestra.run.smithi123.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-11T23:05:26.503 INFO:teuthology.orchestra.run.smithi123.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-11T23:05:26.503 INFO:teuthology.orchestra.run.smithi123.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-11T23:05:26.503 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-11T23:05:26.503 INFO:teuthology.orchestra.run.smithi123.stdout: python3-ceph-argparse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 45 k 2024-09-11T23:05:26.503 INFO:teuthology.orchestra.run.smithi123.stdout: python3-ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 136 k 2024-09-11T23:05:26.504 INFO:teuthology.orchestra.run.smithi123.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-11T23:05:26.504 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-11T23:05:26.504 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-11T23:05:26.504 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-11T23:05:26.504 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-11T23:05:26.504 INFO:teuthology.orchestra.run.smithi123.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-11T23:05:26.504 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-11T23:05:26.504 INFO:teuthology.orchestra.run.smithi123.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-11T23:05:26.504 INFO:teuthology.orchestra.run.smithi123.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-11T23:05:26.504 INFO:teuthology.orchestra.run.smithi123.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-11T23:05:26.504 INFO:teuthology.orchestra.run.smithi123.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-11T23:05:26.504 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-11T23:05:26.504 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-11T23:05:26.505 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-11T23:05:26.505 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-11T23:05:26.505 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-11T23:05:26.505 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-11T23:05:26.505 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-11T23:05:26.505 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-11T23:05:26.505 INFO:teuthology.orchestra.run.smithi123.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-11T23:05:26.505 INFO:teuthology.orchestra.run.smithi123.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-11T23:05:26.505 INFO:teuthology.orchestra.run.smithi123.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-11T23:05:26.505 INFO:teuthology.orchestra.run.smithi123.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-11T23:05:26.505 INFO:teuthology.orchestra.run.smithi123.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-11T23:05:26.505 INFO:teuthology.orchestra.run.smithi123.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-11T23:05:26.505 INFO:teuthology.orchestra.run.smithi123.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-11T23:05:26.506 INFO:teuthology.orchestra.run.smithi123.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-11T23:05:26.506 INFO:teuthology.orchestra.run.smithi123.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-11T23:05:26.506 INFO:teuthology.orchestra.run.smithi123.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-11T23:05:26.506 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-11T23:05:26.506 INFO:teuthology.orchestra.run.smithi123.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-11T23:05:26.506 INFO:teuthology.orchestra.run.smithi123.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-11T23:05:26.506 INFO:teuthology.orchestra.run.smithi123.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-11T23:05:26.506 INFO:teuthology.orchestra.run.smithi123.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-11T23:05:26.506 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-11T23:05:26.506 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-11T23:05:26.506 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-11T23:05:26.506 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-11T23:05:26.507 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-11T23:05:26.507 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-11T23:05:26.507 INFO:teuthology.orchestra.run.smithi123.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-11T23:05:26.507 INFO:teuthology.orchestra.run.smithi123.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-11T23:05:26.507 INFO:teuthology.orchestra.run.smithi123.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-11T23:05:26.507 INFO:teuthology.orchestra.run.smithi123.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-11T23:05:26.507 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-11T23:05:26.507 INFO:teuthology.orchestra.run.smithi123.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-11T23:05:26.507 INFO:teuthology.orchestra.run.smithi123.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-11T23:05:26.507 INFO:teuthology.orchestra.run.smithi123.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-11T23:05:26.507 INFO:teuthology.orchestra.run.smithi123.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-11T23:05:26.507 INFO:teuthology.orchestra.run.smithi123.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-11T23:05:26.507 INFO:teuthology.orchestra.run.smithi123.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-11T23:05:26.507 INFO:teuthology.orchestra.run.smithi123.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-11T23:05:26.508 INFO:teuthology.orchestra.run.smithi123.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-11T23:05:26.508 INFO:teuthology.orchestra.run.smithi123.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-11T23:05:26.508 INFO:teuthology.orchestra.run.smithi123.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-11T23:05:26.508 INFO:teuthology.orchestra.run.smithi123.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-11T23:05:26.508 INFO:teuthology.orchestra.run.smithi123.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-11T23:05:26.508 INFO:teuthology.orchestra.run.smithi123.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-11T23:05:26.508 INFO:teuthology.orchestra.run.smithi123.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-11T23:05:26.508 INFO:teuthology.orchestra.run.smithi123.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-11T23:05:26.508 INFO:teuthology.orchestra.run.smithi123.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-11T23:05:26.508 INFO:teuthology.orchestra.run.smithi123.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-11T23:05:26.508 INFO:teuthology.orchestra.run.smithi123.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-11T23:05:26.508 INFO:teuthology.orchestra.run.smithi123.stdout:Installing weak dependencies: 2024-09-11T23:05:26.509 INFO:teuthology.orchestra.run.smithi123.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-11T23:05:26.509 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-11T23:05:26.509 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction Summary 2024-09-11T23:05:26.509 INFO:teuthology.orchestra.run.smithi123.stdout:====================================================================================== 2024-09-11T23:05:26.509 INFO:teuthology.orchestra.run.smithi123.stdout:Install 148 Packages 2024-09-11T23:05:26.509 INFO:teuthology.orchestra.run.smithi123.stdout:Upgrade 8 Packages 2024-09-11T23:05:26.509 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-11T23:05:26.510 INFO:teuthology.orchestra.run.smithi123.stdout:Total download size: 226 M 2024-09-11T23:05:26.510 INFO:teuthology.orchestra.run.smithi123.stdout:Downloading Packages: 2024-09-11T23:05:27.153 INFO:teuthology.orchestra.run.smithi123.stdout:(1/156): ceph-19.1.1-298.gb53b6d3e.el9.x86_64.r 51 kB/s | 6.5 kB 00:00 2024-09-11T23:05:27.165 INFO:teuthology.orchestra.run.smithi160.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-11T23:05:27.166 INFO:teuthology.orchestra.run.smithi160.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-11T23:05:27.179 INFO:teuthology.orchestra.run.smithi160.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-11T23:05:27.180 INFO:teuthology.orchestra.run.smithi160.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-11T23:05:27.181 INFO:teuthology.orchestra.run.smithi160.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-11T23:05:27.182 INFO:teuthology.orchestra.run.smithi160.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-11T23:05:27.184 INFO:teuthology.orchestra.run.smithi160.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-11T23:05:27.187 INFO:teuthology.orchestra.run.smithi160.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-11T23:05:27.188 INFO:teuthology.orchestra.run.smithi160.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-11T23:05:27.251 INFO:teuthology.orchestra.run.smithi160.stdout:Dependencies resolved. 2024-09-11T23:05:27.267 INFO:teuthology.orchestra.run.smithi160.stdout:====================================================================================== 2024-09-11T23:05:27.267 INFO:teuthology.orchestra.run.smithi160.stdout: Package Arch Version Repository Size 2024-09-11T23:05:27.267 INFO:teuthology.orchestra.run.smithi160.stdout:====================================================================================== 2024-09-11T23:05:27.267 INFO:teuthology.orchestra.run.smithi160.stdout:Installing: 2024-09-11T23:05:27.267 INFO:teuthology.orchestra.run.smithi160.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-11T23:05:27.267 INFO:teuthology.orchestra.run.smithi160.stdout: ceph x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 6.5 k 2024-09-11T23:05:27.267 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-base x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.4 M 2024-09-11T23:05:27.267 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 897 k 2024-09-11T23:05:27.268 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 145 k 2024-09-11T23:05:27.268 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 1.5 M 2024-09-11T23:05:27.268 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 146 k 2024-09-11T23:05:27.268 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-dashboard noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 3.6 M 2024-09-11T23:05:27.268 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 7.4 M 2024-09-11T23:05:27.268 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-rook noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 49 k 2024-09-11T23:05:27.268 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-radosgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 11 M 2024-09-11T23:05:27.268 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-test x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 49 M 2024-09-11T23:05:27.268 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-volume noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 285 k 2024-09-11T23:05:27.268 INFO:teuthology.orchestra.run.smithi160.stdout: cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 765 k 2024-09-11T23:05:27.268 INFO:teuthology.orchestra.run.smithi160.stdout: cephfs-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 228 k 2024-09-11T23:05:27.268 INFO:teuthology.orchestra.run.smithi160.stdout: cephfs-shell x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 27 k 2024-09-11T23:05:27.268 INFO:teuthology.orchestra.run.smithi160.stdout: cephfs-top noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 18 k 2024-09-11T23:05:27.269 INFO:teuthology.orchestra.run.smithi160.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-11T23:05:27.269 INFO:teuthology.orchestra.run.smithi160.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-11T23:05:27.269 INFO:teuthology.orchestra.run.smithi160.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-11T23:05:27.269 INFO:teuthology.orchestra.run.smithi160.stdout: libcephfs-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 32 k 2024-09-11T23:05:27.269 INFO:teuthology.orchestra.run.smithi160.stdout: libcephfs2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 752 k 2024-09-11T23:05:27.269 INFO:teuthology.orchestra.run.smithi160.stdout: librados-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 127 k 2024-09-11T23:05:27.269 INFO:teuthology.orchestra.run.smithi160.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-11T23:05:27.269 INFO:teuthology.orchestra.run.smithi160.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-11T23:05:27.269 INFO:teuthology.orchestra.run.smithi160.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-11T23:05:27.269 INFO:teuthology.orchestra.run.smithi160.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-11T23:05:27.269 INFO:teuthology.orchestra.run.smithi160.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-11T23:05:27.269 INFO:teuthology.orchestra.run.smithi160.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-11T23:05:27.270 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cephfs x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 162 k 2024-09-11T23:05:27.270 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rados x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 321 k 2024-09-11T23:05:27.270 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 301 k 2024-09-11T23:05:27.270 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 100 k 2024-09-11T23:05:27.270 INFO:teuthology.orchestra.run.smithi160.stdout: rbd-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 85 k 2024-09-11T23:05:27.270 INFO:teuthology.orchestra.run.smithi160.stdout: rbd-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.1 M 2024-09-11T23:05:27.270 INFO:teuthology.orchestra.run.smithi160.stdout: rbd-nbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 171 k 2024-09-11T23:05:27.270 INFO:teuthology.orchestra.run.smithi160.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-11T23:05:27.270 INFO:teuthology.orchestra.run.smithi160.stdout:Upgrading: 2024-09-11T23:05:27.270 INFO:teuthology.orchestra.run.smithi160.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-11T23:05:27.270 INFO:teuthology.orchestra.run.smithi160.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-11T23:05:27.270 INFO:teuthology.orchestra.run.smithi160.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-11T23:05:27.270 INFO:teuthology.orchestra.run.smithi160.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-11T23:05:27.271 INFO:teuthology.orchestra.run.smithi160.stdout: librados2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.4 M 2024-09-11T23:05:27.271 INFO:teuthology.orchestra.run.smithi160.stdout: librbd1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.2 M 2024-09-11T23:05:27.271 INFO:teuthology.orchestra.run.smithi160.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-11T23:05:27.271 INFO:teuthology.orchestra.run.smithi160.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-11T23:05:27.271 INFO:teuthology.orchestra.run.smithi160.stdout:Installing dependencies: 2024-09-11T23:05:27.271 INFO:teuthology.orchestra.run.smithi160.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-11T23:05:27.271 INFO:teuthology.orchestra.run.smithi160.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-11T23:05:27.271 INFO:teuthology.orchestra.run.smithi160.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-11T23:05:27.271 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 21 M 2024-09-11T23:05:27.271 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-grafana-dashboards noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 32 k 2024-09-11T23:05:27.271 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mds x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 2.4 M 2024-09-11T23:05:27.271 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-modules-core noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 249 k 2024-09-11T23:05:27.271 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mon x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 4.7 M 2024-09-11T23:05:27.272 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-osd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 17 M 2024-09-11T23:05:27.272 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-prometheus-alerts noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 16 k 2024-09-11T23:05:27.272 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-selinux x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 25 k 2024-09-11T23:05:27.272 INFO:teuthology.orchestra.run.smithi160.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-11T23:05:27.272 INFO:teuthology.orchestra.run.smithi160.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-11T23:05:27.272 INFO:teuthology.orchestra.run.smithi160.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-11T23:05:27.272 INFO:teuthology.orchestra.run.smithi160.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-11T23:05:27.272 INFO:teuthology.orchestra.run.smithi160.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-11T23:05:27.272 INFO:teuthology.orchestra.run.smithi160.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-11T23:05:27.272 INFO:teuthology.orchestra.run.smithi160.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-11T23:05:27.272 INFO:teuthology.orchestra.run.smithi160.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-11T23:05:27.272 INFO:teuthology.orchestra.run.smithi160.stdout: libcephsqlite x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 163 k 2024-09-11T23:05:27.273 INFO:teuthology.orchestra.run.smithi160.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-11T23:05:27.273 INFO:teuthology.orchestra.run.smithi160.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-11T23:05:27.273 INFO:teuthology.orchestra.run.smithi160.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-11T23:05:27.273 INFO:teuthology.orchestra.run.smithi160.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-11T23:05:27.273 INFO:teuthology.orchestra.run.smithi160.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-11T23:05:27.273 INFO:teuthology.orchestra.run.smithi160.stdout: libradosstriper1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 506 k 2024-09-11T23:05:27.273 INFO:teuthology.orchestra.run.smithi160.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-11T23:05:27.273 INFO:teuthology.orchestra.run.smithi160.stdout: librgw2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.3 M 2024-09-11T23:05:27.273 INFO:teuthology.orchestra.run.smithi160.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-11T23:05:27.273 INFO:teuthology.orchestra.run.smithi160.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-11T23:05:27.273 INFO:teuthology.orchestra.run.smithi160.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-11T23:05:27.273 INFO:teuthology.orchestra.run.smithi160.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-11T23:05:27.274 INFO:teuthology.orchestra.run.smithi160.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-11T23:05:27.274 INFO:teuthology.orchestra.run.smithi160.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-11T23:05:27.274 INFO:teuthology.orchestra.run.smithi160.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-11T23:05:27.274 INFO:teuthology.orchestra.run.smithi160.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-11T23:05:27.274 INFO:teuthology.orchestra.run.smithi160.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-11T23:05:27.274 INFO:teuthology.orchestra.run.smithi160.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-11T23:05:27.274 INFO:teuthology.orchestra.run.smithi160.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-11T23:05:27.274 INFO:teuthology.orchestra.run.smithi160.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-11T23:05:27.274 INFO:teuthology.orchestra.run.smithi160.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-11T23:05:27.274 INFO:teuthology.orchestra.run.smithi160.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-11T23:05:27.274 INFO:teuthology.orchestra.run.smithi160.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-11T23:05:27.274 INFO:teuthology.orchestra.run.smithi160.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-11T23:05:27.274 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-11T23:05:27.275 INFO:teuthology.orchestra.run.smithi160.stdout: python3-ceph-argparse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 45 k 2024-09-11T23:05:27.275 INFO:teuthology.orchestra.run.smithi160.stdout: python3-ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 136 k 2024-09-11T23:05:27.275 INFO:teuthology.orchestra.run.smithi160.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-11T23:05:27.275 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-11T23:05:27.275 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-11T23:05:27.275 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-11T23:05:27.275 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-11T23:05:27.275 INFO:teuthology.orchestra.run.smithi160.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-11T23:05:27.275 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-11T23:05:27.275 INFO:teuthology.orchestra.run.smithi160.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-11T23:05:27.275 INFO:teuthology.orchestra.run.smithi160.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-11T23:05:27.275 INFO:teuthology.orchestra.run.smithi160.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-11T23:05:27.275 INFO:teuthology.orchestra.run.smithi160.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-11T23:05:27.275 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-11T23:05:27.276 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-11T23:05:27.276 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-11T23:05:27.276 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-11T23:05:27.276 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-11T23:05:27.276 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-11T23:05:27.276 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-11T23:05:27.276 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-11T23:05:27.276 INFO:teuthology.orchestra.run.smithi160.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-11T23:05:27.276 INFO:teuthology.orchestra.run.smithi160.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-11T23:05:27.276 INFO:teuthology.orchestra.run.smithi160.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-11T23:05:27.276 INFO:teuthology.orchestra.run.smithi160.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-11T23:05:27.276 INFO:teuthology.orchestra.run.smithi160.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-11T23:05:27.276 INFO:teuthology.orchestra.run.smithi160.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-11T23:05:27.277 INFO:teuthology.orchestra.run.smithi160.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-11T23:05:27.277 INFO:teuthology.orchestra.run.smithi160.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-11T23:05:27.277 INFO:teuthology.orchestra.run.smithi160.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-11T23:05:27.277 INFO:teuthology.orchestra.run.smithi160.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-11T23:05:27.277 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-11T23:05:27.277 INFO:teuthology.orchestra.run.smithi160.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-11T23:05:27.277 INFO:teuthology.orchestra.run.smithi160.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-11T23:05:27.277 INFO:teuthology.orchestra.run.smithi160.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-11T23:05:27.277 INFO:teuthology.orchestra.run.smithi160.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-11T23:05:27.277 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-11T23:05:27.277 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-11T23:05:27.277 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-11T23:05:27.277 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-11T23:05:27.278 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-11T23:05:27.278 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-11T23:05:27.278 INFO:teuthology.orchestra.run.smithi160.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-11T23:05:27.278 INFO:teuthology.orchestra.run.smithi160.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-11T23:05:27.278 INFO:teuthology.orchestra.run.smithi160.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-11T23:05:27.278 INFO:teuthology.orchestra.run.smithi160.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-11T23:05:27.278 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-11T23:05:27.278 INFO:teuthology.orchestra.run.smithi160.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-11T23:05:27.278 INFO:teuthology.orchestra.run.smithi160.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-11T23:05:27.278 INFO:teuthology.orchestra.run.smithi160.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-11T23:05:27.278 INFO:teuthology.orchestra.run.smithi160.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-11T23:05:27.278 INFO:teuthology.orchestra.run.smithi160.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-11T23:05:27.278 INFO:teuthology.orchestra.run.smithi160.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-11T23:05:27.279 INFO:teuthology.orchestra.run.smithi160.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-11T23:05:27.279 INFO:teuthology.orchestra.run.smithi160.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-11T23:05:27.279 INFO:teuthology.orchestra.run.smithi160.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-11T23:05:27.279 INFO:teuthology.orchestra.run.smithi160.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-11T23:05:27.279 INFO:teuthology.orchestra.run.smithi160.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-11T23:05:27.279 INFO:teuthology.orchestra.run.smithi160.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-11T23:05:27.279 INFO:teuthology.orchestra.run.smithi160.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-11T23:05:27.279 INFO:teuthology.orchestra.run.smithi160.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-11T23:05:27.279 INFO:teuthology.orchestra.run.smithi160.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-11T23:05:27.279 INFO:teuthology.orchestra.run.smithi160.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-11T23:05:27.279 INFO:teuthology.orchestra.run.smithi160.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-11T23:05:27.279 INFO:teuthology.orchestra.run.smithi160.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-11T23:05:27.279 INFO:teuthology.orchestra.run.smithi160.stdout:Installing weak dependencies: 2024-09-11T23:05:27.279 INFO:teuthology.orchestra.run.smithi160.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-11T23:05:27.280 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-11T23:05:27.280 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction Summary 2024-09-11T23:05:27.280 INFO:teuthology.orchestra.run.smithi160.stdout:====================================================================================== 2024-09-11T23:05:27.280 INFO:teuthology.orchestra.run.smithi160.stdout:Install 148 Packages 2024-09-11T23:05:27.280 INFO:teuthology.orchestra.run.smithi160.stdout:Upgrade 8 Packages 2024-09-11T23:05:27.280 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-11T23:05:27.281 INFO:teuthology.orchestra.run.smithi160.stdout:Total download size: 226 M 2024-09-11T23:05:27.281 INFO:teuthology.orchestra.run.smithi160.stdout:Downloading Packages: 2024-09-11T23:05:27.362 INFO:teuthology.orchestra.run.smithi123.stdout:(2/156): ceph-fuse-19.1.1-298.gb53b6d3e.el9.x86 4.2 MB/s | 897 kB 00:00 2024-09-11T23:05:27.412 INFO:teuthology.orchestra.run.smithi123.stdout:(3/156): ceph-immutable-object-cache-19.1.1-298 2.8 MB/s | 145 kB 00:00 2024-09-11T23:05:27.588 INFO:teuthology.orchestra.run.smithi123.stdout:(4/156): ceph-base-19.1.1-298.gb53b6d3e.el9.x86 9.6 MB/s | 5.4 MB 00:00 2024-09-11T23:05:27.646 INFO:teuthology.orchestra.run.smithi123.stdout:(5/156): ceph-mds-19.1.1-298.gb53b6d3e.el9.x86_ 10 MB/s | 2.4 MB 00:00 2024-09-11T23:05:27.738 INFO:teuthology.orchestra.run.smithi123.stdout:(6/156): ceph-mgr-19.1.1-298.gb53b6d3e.el9.x86_ 10 MB/s | 1.5 MB 00:00 2024-09-11T23:05:27.853 INFO:teuthology.orchestra.run.smithi160.stdout:(1/156): ceph-19.1.1-298.gb53b6d3e.el9.x86_64.r 43 kB/s | 6.5 kB 00:00 2024-09-11T23:05:28.013 INFO:teuthology.orchestra.run.smithi123.stdout:(7/156): ceph-mon-19.1.1-298.gb53b6d3e.el9.x86_ 13 MB/s | 4.7 MB 00:00 2024-09-11T23:05:28.170 INFO:teuthology.orchestra.run.smithi037.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-11T23:05:28.453 INFO:teuthology.orchestra.run.smithi160.stdout:(2/156): ceph-fuse-19.1.1-298.gb53b6d3e.el9.x86 1.5 MB/s | 897 kB 00:00 2024-09-11T23:05:28.480 INFO:teuthology.orchestra.run.smithi123.stdout:(8/156): ceph-common-19.1.1-298.gb53b6d3e.el9.x 15 MB/s | 21 MB 00:01 2024-09-11T23:05:28.520 INFO:teuthology.orchestra.run.smithi160.stdout:(3/156): ceph-immutable-object-cache-19.1.1-298 2.1 MB/s | 145 kB 00:00 2024-09-11T23:05:28.522 INFO:teuthology.orchestra.run.smithi123.stdout:(9/156): ceph-selinux-19.1.1-298.gb53b6d3e.el9. 605 kB/s | 25 kB 00:00 2024-09-11T23:05:28.856 INFO:teuthology.orchestra.run.smithi123.stdout:(10/156): ceph-osd-19.1.1-298.gb53b6d3e.el9.x86 15 MB/s | 17 MB 00:01 2024-09-11T23:05:28.965 INFO:teuthology.orchestra.run.smithi123.stdout:(11/156): ceph-radosgw-19.1.1-298.gb53b6d3e.el9 11 MB/s | 11 MB 00:00 2024-09-11T23:05:28.990 INFO:teuthology.orchestra.run.smithi123.stdout:(12/156): cephfs-mirror-19.1.1-298.gb53b6d3e.el 1.7 MB/s | 228 kB 00:00 2024-09-11T23:05:29.015 INFO:teuthology.orchestra.run.smithi123.stdout:(13/156): cephfs-shell-19.1.1-298.gb53b6d3e.el9 541 kB/s | 27 kB 00:00 2024-09-11T23:05:29.040 INFO:teuthology.orchestra.run.smithi123.stdout:(14/156): libcephfs-devel-19.1.1-298.gb53b6d3e. 633 kB/s | 32 kB 00:00 2024-09-11T23:05:29.082 INFO:teuthology.orchestra.run.smithi123.stdout:(15/156): libcephsqlite-19.1.1-298.gb53b6d3e.el 3.8 MB/s | 163 kB 00:00 2024-09-11T23:05:29.164 INFO:teuthology.orchestra.run.smithi123.stdout:(16/156): librados-devel-19.1.1-298.gb53b6d3e.e 1.5 MB/s | 127 kB 00:00 2024-09-11T23:05:29.246 INFO:teuthology.orchestra.run.smithi160.stdout:(4/156): ceph-mds-19.1.1-298.gb53b6d3e.el9.x86_ 3.3 MB/s | 2.4 MB 00:00 2024-09-11T23:05:29.258 INFO:teuthology.orchestra.run.smithi123.stdout:(17/156): libradosstriper1-19.1.1-298.gb53b6d3e 5.3 MB/s | 506 kB 00:00 2024-09-11T23:05:29.299 INFO:teuthology.orchestra.run.smithi123.stdout:(18/156): libcephfs2-19.1.1-298.gb53b6d3e.el9.x 2.6 MB/s | 752 kB 00:00 2024-09-11T23:05:29.313 INFO:teuthology.orchestra.run.smithi160.stdout:(5/156): ceph-base-19.1.1-298.gb53b6d3e.el9.x86 3.4 MB/s | 5.4 MB 00:01 2024-09-11T23:05:29.366 INFO:teuthology.orchestra.run.smithi123.stdout:(19/156): python3-ceph-argparse-19.1.1-298.gb53 679 kB/s | 45 kB 00:00 2024-09-11T23:05:29.433 INFO:teuthology.orchestra.run.smithi123.stdout:(20/156): python3-ceph-common-19.1.1-298.gb53b6 2.0 MB/s | 136 kB 00:00 2024-09-11T23:05:29.500 INFO:teuthology.orchestra.run.smithi123.stdout:(21/156): python3-cephfs-19.1.1-298.gb53b6d3e.e 2.4 MB/s | 162 kB 00:00 2024-09-11T23:05:29.608 INFO:teuthology.orchestra.run.smithi123.stdout:(22/156): python3-rados-19.1.1-298.gb53b6d3e.el 2.9 MB/s | 321 kB 00:00 2024-09-11T23:05:29.759 INFO:teuthology.orchestra.run.smithi123.stdout:(23/156): librgw2-19.1.1-298.gb53b6d3e.el9.x86_ 11 MB/s | 5.3 MB 00:00 2024-09-11T23:05:29.784 INFO:teuthology.orchestra.run.smithi123.stdout:(24/156): python3-rbd-19.1.1-298.gb53b6d3e.el9. 1.7 MB/s | 301 kB 00:00 2024-09-11T23:05:29.796 INFO:teuthology.orchestra.run.smithi160.stdout:(6/156): ceph-mgr-19.1.1-298.gb53b6d3e.el9.x86_ 2.8 MB/s | 1.5 MB 00:00 2024-09-11T23:05:29.809 INFO:teuthology.orchestra.run.smithi123.stdout:(25/156): python3-rgw-19.1.1-298.gb53b6d3e.el9. 1.9 MB/s | 100 kB 00:00 2024-09-11T23:05:29.835 INFO:teuthology.orchestra.run.smithi123.stdout:(26/156): rbd-fuse-19.1.1-298.gb53b6d3e.el9.x86 1.7 MB/s | 85 kB 00:00 2024-09-11T23:05:29.902 INFO:teuthology.orchestra.run.smithi123.stdout:(27/156): rbd-nbd-19.1.1-298.gb53b6d3e.el9.x86_ 2.5 MB/s | 171 kB 00:00 2024-09-11T23:05:29.968 INFO:teuthology.orchestra.run.smithi123.stdout:(28/156): ceph-grafana-dashboards-19.1.1-298.gb 479 kB/s | 32 kB 00:00 2024-09-11T23:05:30.035 INFO:teuthology.orchestra.run.smithi123.stdout:(29/156): ceph-mgr-cephadm-19.1.1-298.gb53b6d3e 2.1 MB/s | 146 kB 00:00 2024-09-11T23:05:30.094 INFO:teuthology.orchestra.run.smithi123.stdout:(30/156): rbd-mirror-19.1.1-298.gb53b6d3e.el9.x 11 MB/s | 3.1 MB 00:00 2024-09-11T23:05:30.413 INFO:teuthology.orchestra.run.smithi160.stdout:(7/156): ceph-mon-19.1.1-298.gb53b6d3e.el9.x86_ 4.3 MB/s | 4.7 MB 00:01 2024-09-11T23:05:30.709 INFO:teuthology.orchestra.run.smithi037.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-11T23:05:30.709 INFO:teuthology.orchestra.run.smithi037.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-11T23:05:30.721 INFO:teuthology.orchestra.run.smithi037.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-11T23:05:30.722 INFO:teuthology.orchestra.run.smithi037.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-11T23:05:30.723 INFO:teuthology.orchestra.run.smithi037.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-11T23:05:30.724 INFO:teuthology.orchestra.run.smithi037.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-11T23:05:30.725 INFO:teuthology.orchestra.run.smithi037.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-11T23:05:30.728 INFO:teuthology.orchestra.run.smithi037.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-11T23:05:30.729 INFO:teuthology.orchestra.run.smithi037.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-11T23:05:30.798 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-09-11T23:05:30.819 INFO:teuthology.orchestra.run.smithi037.stdout:====================================================================================== 2024-09-11T23:05:30.819 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repository Size 2024-09-11T23:05:30.820 INFO:teuthology.orchestra.run.smithi037.stdout:====================================================================================== 2024-09-11T23:05:30.820 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2024-09-11T23:05:30.820 INFO:teuthology.orchestra.run.smithi037.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-11T23:05:30.820 INFO:teuthology.orchestra.run.smithi037.stdout: ceph x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 6.5 k 2024-09-11T23:05:30.820 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-base x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.4 M 2024-09-11T23:05:30.820 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 897 k 2024-09-11T23:05:30.820 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 145 k 2024-09-11T23:05:30.820 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 1.5 M 2024-09-11T23:05:30.820 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 146 k 2024-09-11T23:05:30.820 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-dashboard noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 3.6 M 2024-09-11T23:05:30.821 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 7.4 M 2024-09-11T23:05:30.821 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-rook noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 49 k 2024-09-11T23:05:30.821 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-radosgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 11 M 2024-09-11T23:05:30.821 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-test x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 49 M 2024-09-11T23:05:30.821 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-volume noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 285 k 2024-09-11T23:05:30.821 INFO:teuthology.orchestra.run.smithi037.stdout: cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 765 k 2024-09-11T23:05:30.821 INFO:teuthology.orchestra.run.smithi037.stdout: cephfs-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 228 k 2024-09-11T23:05:30.821 INFO:teuthology.orchestra.run.smithi037.stdout: cephfs-shell x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 27 k 2024-09-11T23:05:30.821 INFO:teuthology.orchestra.run.smithi037.stdout: cephfs-top noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 18 k 2024-09-11T23:05:30.821 INFO:teuthology.orchestra.run.smithi037.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-11T23:05:30.822 INFO:teuthology.orchestra.run.smithi037.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-11T23:05:30.822 INFO:teuthology.orchestra.run.smithi037.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-11T23:05:30.822 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 32 k 2024-09-11T23:05:30.822 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 752 k 2024-09-11T23:05:30.822 INFO:teuthology.orchestra.run.smithi037.stdout: librados-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 127 k 2024-09-11T23:05:30.822 INFO:teuthology.orchestra.run.smithi037.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-11T23:05:30.822 INFO:teuthology.orchestra.run.smithi037.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-11T23:05:30.822 INFO:teuthology.orchestra.run.smithi037.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-11T23:05:30.822 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-11T23:05:30.822 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-11T23:05:30.823 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-11T23:05:30.823 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cephfs x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 162 k 2024-09-11T23:05:30.823 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rados x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 321 k 2024-09-11T23:05:30.823 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 301 k 2024-09-11T23:05:30.823 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 100 k 2024-09-11T23:05:30.823 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 85 k 2024-09-11T23:05:30.823 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.1 M 2024-09-11T23:05:30.823 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-nbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 171 k 2024-09-11T23:05:30.823 INFO:teuthology.orchestra.run.smithi037.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-11T23:05:30.823 INFO:teuthology.orchestra.run.smithi037.stdout:Upgrading: 2024-09-11T23:05:30.824 INFO:teuthology.orchestra.run.smithi037.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-11T23:05:30.824 INFO:teuthology.orchestra.run.smithi037.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-11T23:05:30.824 INFO:teuthology.orchestra.run.smithi037.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-11T23:05:30.824 INFO:teuthology.orchestra.run.smithi037.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-11T23:05:30.824 INFO:teuthology.orchestra.run.smithi037.stdout: librados2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.4 M 2024-09-11T23:05:30.824 INFO:teuthology.orchestra.run.smithi037.stdout: librbd1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.2 M 2024-09-11T23:05:30.824 INFO:teuthology.orchestra.run.smithi037.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-11T23:05:30.824 INFO:teuthology.orchestra.run.smithi037.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-11T23:05:30.824 INFO:teuthology.orchestra.run.smithi037.stdout:Installing dependencies: 2024-09-11T23:05:30.824 INFO:teuthology.orchestra.run.smithi037.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-11T23:05:30.825 INFO:teuthology.orchestra.run.smithi037.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-11T23:05:30.825 INFO:teuthology.orchestra.run.smithi037.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-11T23:05:30.825 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 21 M 2024-09-11T23:05:30.825 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-grafana-dashboards noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 32 k 2024-09-11T23:05:30.825 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mds x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 2.4 M 2024-09-11T23:05:30.825 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-modules-core noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 249 k 2024-09-11T23:05:30.825 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mon x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 4.7 M 2024-09-11T23:05:30.825 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-osd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 17 M 2024-09-11T23:05:30.825 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-prometheus-alerts noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 16 k 2024-09-11T23:05:30.826 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-selinux x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 25 k 2024-09-11T23:05:30.826 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-11T23:05:30.826 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-11T23:05:30.826 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-11T23:05:30.826 INFO:teuthology.orchestra.run.smithi037.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-11T23:05:30.826 INFO:teuthology.orchestra.run.smithi037.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-11T23:05:30.826 INFO:teuthology.orchestra.run.smithi037.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-11T23:05:30.826 INFO:teuthology.orchestra.run.smithi037.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-11T23:05:30.826 INFO:teuthology.orchestra.run.smithi037.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-11T23:05:30.826 INFO:teuthology.orchestra.run.smithi037.stdout: libcephsqlite x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 163 k 2024-09-11T23:05:30.827 INFO:teuthology.orchestra.run.smithi037.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-11T23:05:30.827 INFO:teuthology.orchestra.run.smithi037.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-11T23:05:30.827 INFO:teuthology.orchestra.run.smithi037.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-11T23:05:30.827 INFO:teuthology.orchestra.run.smithi037.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-11T23:05:30.827 INFO:teuthology.orchestra.run.smithi037.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-11T23:05:30.827 INFO:teuthology.orchestra.run.smithi037.stdout: libradosstriper1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 506 k 2024-09-11T23:05:30.827 INFO:teuthology.orchestra.run.smithi037.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-11T23:05:30.827 INFO:teuthology.orchestra.run.smithi037.stdout: librgw2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.3 M 2024-09-11T23:05:30.827 INFO:teuthology.orchestra.run.smithi037.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-11T23:05:30.828 INFO:teuthology.orchestra.run.smithi037.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-11T23:05:30.828 INFO:teuthology.orchestra.run.smithi037.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-11T23:05:30.828 INFO:teuthology.orchestra.run.smithi037.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-11T23:05:30.828 INFO:teuthology.orchestra.run.smithi037.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-11T23:05:30.828 INFO:teuthology.orchestra.run.smithi037.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-11T23:05:30.828 INFO:teuthology.orchestra.run.smithi037.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-11T23:05:30.828 INFO:teuthology.orchestra.run.smithi037.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-11T23:05:30.828 INFO:teuthology.orchestra.run.smithi037.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-11T23:05:30.828 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-11T23:05:30.828 INFO:teuthology.orchestra.run.smithi037.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-11T23:05:30.829 INFO:teuthology.orchestra.run.smithi037.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-11T23:05:30.829 INFO:teuthology.orchestra.run.smithi037.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-11T23:05:30.829 INFO:teuthology.orchestra.run.smithi037.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-11T23:05:30.829 INFO:teuthology.orchestra.run.smithi037.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-11T23:05:30.829 INFO:teuthology.orchestra.run.smithi037.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-11T23:05:30.829 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-11T23:05:30.829 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-argparse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 45 k 2024-09-11T23:05:30.829 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 136 k 2024-09-11T23:05:30.829 INFO:teuthology.orchestra.run.smithi037.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-11T23:05:30.829 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-11T23:05:30.829 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-11T23:05:30.830 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-11T23:05:30.830 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-11T23:05:30.830 INFO:teuthology.orchestra.run.smithi037.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-11T23:05:30.830 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-11T23:05:30.830 INFO:teuthology.orchestra.run.smithi037.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-11T23:05:30.830 INFO:teuthology.orchestra.run.smithi037.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-11T23:05:30.830 INFO:teuthology.orchestra.run.smithi037.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-11T23:05:30.830 INFO:teuthology.orchestra.run.smithi037.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-11T23:05:30.830 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-11T23:05:30.830 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-11T23:05:30.831 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-11T23:05:30.831 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-11T23:05:30.831 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-11T23:05:30.831 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-11T23:05:30.831 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-11T23:05:30.831 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-11T23:05:30.831 INFO:teuthology.orchestra.run.smithi037.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-11T23:05:30.831 INFO:teuthology.orchestra.run.smithi037.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-11T23:05:30.831 INFO:teuthology.orchestra.run.smithi037.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-11T23:05:30.831 INFO:teuthology.orchestra.run.smithi037.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-11T23:05:30.831 INFO:teuthology.orchestra.run.smithi037.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-11T23:05:30.831 INFO:teuthology.orchestra.run.smithi037.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-11T23:05:30.831 INFO:teuthology.orchestra.run.smithi037.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-11T23:05:30.832 INFO:teuthology.orchestra.run.smithi037.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-11T23:05:30.832 INFO:teuthology.orchestra.run.smithi037.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-11T23:05:30.832 INFO:teuthology.orchestra.run.smithi037.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-11T23:05:30.832 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-11T23:05:30.832 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-11T23:05:30.832 INFO:teuthology.orchestra.run.smithi037.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-11T23:05:30.832 INFO:teuthology.orchestra.run.smithi037.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-11T23:05:30.832 INFO:teuthology.orchestra.run.smithi037.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-11T23:05:30.832 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-11T23:05:30.832 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-11T23:05:30.832 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-11T23:05:30.833 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-11T23:05:30.833 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-11T23:05:30.833 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-11T23:05:30.833 INFO:teuthology.orchestra.run.smithi037.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-11T23:05:30.833 INFO:teuthology.orchestra.run.smithi037.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-11T23:05:30.833 INFO:teuthology.orchestra.run.smithi037.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-11T23:05:30.833 INFO:teuthology.orchestra.run.smithi037.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-11T23:05:30.833 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-11T23:05:30.833 INFO:teuthology.orchestra.run.smithi037.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-11T23:05:30.833 INFO:teuthology.orchestra.run.smithi037.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-11T23:05:30.833 INFO:teuthology.orchestra.run.smithi037.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-11T23:05:30.834 INFO:teuthology.orchestra.run.smithi037.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-11T23:05:30.834 INFO:teuthology.orchestra.run.smithi037.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-11T23:05:30.834 INFO:teuthology.orchestra.run.smithi037.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-11T23:05:30.834 INFO:teuthology.orchestra.run.smithi037.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-11T23:05:30.834 INFO:teuthology.orchestra.run.smithi037.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-11T23:05:30.834 INFO:teuthology.orchestra.run.smithi037.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-11T23:05:30.834 INFO:teuthology.orchestra.run.smithi037.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-11T23:05:30.834 INFO:teuthology.orchestra.run.smithi037.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-11T23:05:30.834 INFO:teuthology.orchestra.run.smithi037.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-11T23:05:30.834 INFO:teuthology.orchestra.run.smithi037.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-11T23:05:30.834 INFO:teuthology.orchestra.run.smithi037.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-11T23:05:30.835 INFO:teuthology.orchestra.run.smithi037.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-11T23:05:30.835 INFO:teuthology.orchestra.run.smithi037.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-11T23:05:30.835 INFO:teuthology.orchestra.run.smithi037.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-11T23:05:30.835 INFO:teuthology.orchestra.run.smithi037.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-11T23:05:30.835 INFO:teuthology.orchestra.run.smithi037.stdout:Installing weak dependencies: 2024-09-11T23:05:30.835 INFO:teuthology.orchestra.run.smithi037.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-11T23:05:30.835 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:05:30.835 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2024-09-11T23:05:30.835 INFO:teuthology.orchestra.run.smithi037.stdout:====================================================================================== 2024-09-11T23:05:30.835 INFO:teuthology.orchestra.run.smithi037.stdout:Install 148 Packages 2024-09-11T23:05:30.836 INFO:teuthology.orchestra.run.smithi037.stdout:Upgrade 8 Packages 2024-09-11T23:05:30.836 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:05:30.836 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 226 M 2024-09-11T23:05:30.836 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2024-09-11T23:05:30.894 INFO:teuthology.orchestra.run.smithi123.stdout:(31/156): ceph-test-19.1.1-298.gb53b6d3e.el9.x8 21 MB/s | 49 MB 00:02 2024-09-11T23:05:30.953 INFO:teuthology.orchestra.run.smithi123.stdout:(32/156): ceph-mgr-dashboard-19.1.1-298.gb53b6d 3.9 MB/s | 3.6 MB 00:00 2024-09-11T23:05:31.053 INFO:teuthology.orchestra.run.smithi123.stdout:(33/156): ceph-mgr-diskprediction-local-19.1.1- 7.7 MB/s | 7.4 MB 00:00 2024-09-11T23:05:31.078 INFO:teuthology.orchestra.run.smithi123.stdout:(34/156): ceph-mgr-rook-19.1.1-298.gb53b6d3e.el 394 kB/s | 49 kB 00:00 2024-09-11T23:05:31.104 INFO:teuthology.orchestra.run.smithi123.stdout:(35/156): ceph-prometheus-alerts-19.1.1-298.gb5 328 kB/s | 16 kB 00:00 2024-09-11T23:05:31.129 INFO:teuthology.orchestra.run.smithi123.stdout:(36/156): ceph-mgr-modules-core-19.1.1-298.gb53 1.0 MB/s | 249 kB 00:00 2024-09-11T23:05:31.154 INFO:teuthology.orchestra.run.smithi123.stdout:(37/156): ceph-volume-19.1.1-298.gb53b6d3e.el9. 3.7 MB/s | 285 kB 00:00 2024-09-11T23:05:31.179 INFO:teuthology.orchestra.run.smithi123.stdout:(38/156): cephfs-top-19.1.1-298.gb53b6d3e.el9.n 364 kB/s | 18 kB 00:00 2024-09-11T23:05:31.213 INFO:teuthology.orchestra.run.smithi123.stdout:(39/156): cephadm-19.1.1-298.gb53b6d3e.el9.noar 6.9 MB/s | 765 kB 00:00 2024-09-11T23:05:31.614 INFO:teuthology.orchestra.run.smithi037.stdout:(1/156): ceph-19.1.1-298.gb53b6d3e.el9.x86_64.r 46 kB/s | 6.5 kB 00:00 2024-09-11T23:05:31.630 INFO:teuthology.orchestra.run.smithi123.stdout:(40/156): fuse-2.9.9-16.el9.x86_64.rpm 168 kB/s | 80 kB 00:00 2024-09-11T23:05:31.764 INFO:teuthology.orchestra.run.smithi123.stdout:(41/156): libquadmath-11.5.0-2.el9.x86_64.rpm 347 kB/s | 191 kB 00:00 2024-09-11T23:05:31.821 INFO:teuthology.orchestra.run.smithi160.stdout:(8/156): ceph-radosgw-19.1.1-298.gb53b6d3e.el9. 7.5 MB/s | 11 MB 00:01 2024-09-11T23:05:31.863 INFO:teuthology.orchestra.run.smithi160.stdout:(9/156): ceph-selinux-19.1.1-298.gb53b6d3e.el9. 608 kB/s | 25 kB 00:00 2024-09-11T23:05:31.898 INFO:teuthology.orchestra.run.smithi037.stdout:(2/156): ceph-fuse-19.1.1-298.gb53b6d3e.el9.x86 3.1 MB/s | 897 kB 00:00 2024-09-11T23:05:31.964 INFO:teuthology.orchestra.run.smithi037.stdout:(3/156): ceph-immutable-object-cache-19.1.1-298 2.1 MB/s | 145 kB 00:00 2024-09-11T23:05:31.997 INFO:teuthology.orchestra.run.smithi123.stdout:(42/156): libgfortran-11.5.0-2.el9.x86_64.rpm 981 kB/s | 801 kB 00:00 2024-09-11T23:05:32.022 INFO:teuthology.orchestra.run.smithi123.stdout:(43/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 646 kB/s | 253 kB 00:00 2024-09-11T23:05:32.106 INFO:teuthology.orchestra.run.smithi123.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 982 kB/s | 106 kB 00:00 2024-09-11T23:05:32.140 INFO:teuthology.orchestra.run.smithi123.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 1.1 MB/s | 135 kB 00:00 2024-09-11T23:05:32.215 INFO:teuthology.orchestra.run.smithi123.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 1.1 MB/s | 125 kB 00:00 2024-09-11T23:05:32.257 INFO:teuthology.orchestra.run.smithi123.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 1.8 MB/s | 215 kB 00:00 2024-09-11T23:05:32.290 INFO:teuthology.orchestra.run.smithi123.stdout:(48/156): python3-cryptography-36.0.1-4.el9.x86 2.3 MB/s | 1.2 MB 00:00 2024-09-11T23:05:32.331 INFO:teuthology.orchestra.run.smithi037.stdout:(4/156): ceph-mds-19.1.1-298.gb53b6d3e.el9.x86_ 6.5 MB/s | 2.4 MB 00:00 2024-09-11T23:05:32.397 INFO:teuthology.orchestra.run.smithi160.stdout:(10/156): ceph-common-19.1.1-298.gb53b6d3e.el9. 4.5 MB/s | 21 MB 00:04 2024-09-11T23:05:32.464 INFO:teuthology.orchestra.run.smithi160.stdout:(11/156): cephfs-mirror-19.1.1-298.gb53b6d3e.el 3.4 MB/s | 228 kB 00:00 2024-09-11T23:05:32.474 INFO:teuthology.orchestra.run.smithi123.stdout:(49/156): automake-1.16.2-8.el9.noarch.rpm 2.6 MB/s | 689 kB 00:00 2024-09-11T23:05:32.490 INFO:teuthology.orchestra.run.smithi037.stdout:(5/156): ceph-base-19.1.1-298.gb53b6d3e.el9.x86 5.3 MB/s | 5.4 MB 00:01 2024-09-11T23:05:32.497 INFO:teuthology.orchestra.run.smithi160.stdout:(12/156): cephfs-shell-19.1.1-298.gb53b6d3e.el9 820 kB/s | 27 kB 00:00 2024-09-11T23:05:32.499 INFO:teuthology.orchestra.run.smithi123.stdout:(50/156): boost-program-options-1.75.0-8.el9.x8 513 kB/s | 107 kB 00:00 2024-09-11T23:05:32.531 INFO:teuthology.orchestra.run.smithi160.stdout:(13/156): libcephfs-devel-19.1.1-298.gb53b6d3e. 954 kB/s | 32 kB 00:00 2024-09-11T23:05:32.533 INFO:teuthology.orchestra.run.smithi123.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 371 kB/s | 22 kB 00:00 2024-09-11T23:05:32.548 INFO:teuthology.orchestra.run.smithi037.stdout:(6/156): ceph-mgr-19.1.1-298.gb53b6d3e.el9.x86_ 7.0 MB/s | 1.5 MB 00:00 2024-09-11T23:05:32.600 INFO:teuthology.orchestra.run.smithi123.stdout:(52/156): bison-3.7.4-5.el9.x86_64.rpm 2.7 MB/s | 943 kB 00:00 2024-09-11T23:05:32.625 INFO:teuthology.orchestra.run.smithi123.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 356 kB/s | 33 kB 00:00 2024-09-11T23:05:32.650 INFO:teuthology.orchestra.run.smithi123.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 2.0 MB/s | 313 kB 00:00 2024-09-11T23:05:32.676 INFO:teuthology.orchestra.run.smithi123.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 363 kB/s | 18 kB 00:00 2024-09-11T23:05:32.689 INFO:teuthology.orchestra.run.smithi160.stdout:(14/156): libcephfs2-19.1.1-298.gb53b6d3e.el9.x 4.6 MB/s | 752 kB 00:00 2024-09-11T23:05:32.709 INFO:teuthology.orchestra.run.smithi123.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 191 kB/s | 11 kB 00:00 2024-09-11T23:05:32.734 INFO:teuthology.orchestra.run.smithi123.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-09-11T23:05:32.748 INFO:teuthology.orchestra.run.smithi160.stdout:(15/156): libcephsqlite-19.1.1-298.gb53b6d3e.el 2.7 MB/s | 163 kB 00:00 2024-09-11T23:05:32.785 INFO:teuthology.orchestra.run.smithi123.stdout:(58/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 16 MB/s | 3.0 MB 00:00 2024-09-11T23:05:32.806 INFO:teuthology.orchestra.run.smithi160.stdout:(16/156): librados-devel-19.1.1-298.gb53b6d3e.e 2.1 MB/s | 127 kB 00:00 2024-09-11T23:05:32.810 INFO:teuthology.orchestra.run.smithi123.stdout:(59/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 451 kB/s | 45 kB 00:00 2024-09-11T23:05:32.844 INFO:teuthology.orchestra.run.smithi123.stdout:(60/156): librdkafka-1.6.1-102.el9.x86_64.rpm 6.0 MB/s | 662 kB 00:00 2024-09-11T23:05:32.869 INFO:teuthology.orchestra.run.smithi123.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 417 kB/s | 24 kB 00:00 2024-09-11T23:05:32.894 INFO:teuthology.orchestra.run.smithi123.stdout:(62/156): libtool-2.4.6-46.el9.x86_64.rpm 5.2 MB/s | 581 kB 00:00 2024-09-11T23:05:32.919 INFO:teuthology.orchestra.run.smithi123.stdout:(63/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 628 kB/s | 47 kB 00:00 2024-09-11T23:05:32.924 INFO:teuthology.orchestra.run.smithi037.stdout:(7/156): ceph-mon-19.1.1-298.gb53b6d3e.el9.x86_ 11 MB/s | 4.7 MB 00:00 2024-09-11T23:05:32.944 INFO:teuthology.orchestra.run.smithi123.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.8 MB/s | 292 kB 00:00 2024-09-11T23:05:32.965 INFO:teuthology.orchestra.run.smithi160.stdout:(17/156): ceph-osd-19.1.1-298.gb53b6d3e.el9.x86 5.3 MB/s | 17 MB 00:03 2024-09-11T23:05:32.970 INFO:teuthology.orchestra.run.smithi123.stdout:(65/156): lua-5.4.4-4.el9.x86_64.rpm 2.4 MB/s | 188 kB 00:00 2024-09-11T23:05:32.999 INFO:teuthology.orchestra.run.smithi160.stdout:(18/156): libradosstriper1-19.1.1-298.gb53b6d3e 2.6 MB/s | 506 kB 00:00 2024-09-11T23:05:33.011 INFO:teuthology.orchestra.run.smithi123.stdout:(66/156): openblas-0.3.26-2.el9.x86_64.rpm 418 kB/s | 38 kB 00:00 2024-09-11T23:05:33.066 INFO:teuthology.orchestra.run.smithi160.stdout:(19/156): python3-ceph-argparse-19.1.1-298.gb53 677 kB/s | 45 kB 00:00 2024-09-11T23:05:33.129 INFO:teuthology.orchestra.run.smithi123.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-09-11T23:05:33.141 INFO:teuthology.orchestra.run.smithi160.stdout:(20/156): python3-ceph-common-19.1.1-298.gb53b6 1.8 MB/s | 136 kB 00:00 2024-09-11T23:05:33.196 INFO:teuthology.orchestra.run.smithi123.stdout:(68/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 20 MB/s | 4.4 MB 00:00 2024-09-11T23:05:33.225 INFO:teuthology.orchestra.run.smithi160.stdout:(21/156): python3-cephfs-19.1.1-298.gb53b6d3e.e 1.9 MB/s | 162 kB 00:00 2024-09-11T23:05:33.262 INFO:teuthology.orchestra.run.smithi123.stdout:(69/156): openblas-openmp-0.3.26-2.el9.x86_64.r 16 MB/s | 4.9 MB 00:00 2024-09-11T23:05:33.288 INFO:teuthology.orchestra.run.smithi123.stdout:(70/156): postgresql-contrib-13.16-1.el9.x86_64 5.6 MB/s | 910 kB 00:00 2024-09-11T23:05:33.313 INFO:teuthology.orchestra.run.smithi123.stdout:(71/156): postgresql-private-libs-13.16-1.el9.x 1.1 MB/s | 137 kB 00:00 2024-09-11T23:05:33.363 INFO:teuthology.orchestra.run.smithi123.stdout:(72/156): protobuf-3.14.0-13.el9.x86_64.rpm 13 MB/s | 1.0 MB 00:00 2024-09-11T23:05:33.367 INFO:teuthology.orchestra.run.smithi160.stdout:(22/156): python3-rados-19.1.1-298.gb53b6d3e.el 2.2 MB/s | 321 kB 00:00 2024-09-11T23:05:33.388 INFO:teuthology.orchestra.run.smithi123.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.1 MB/s | 87 kB 00:00 2024-09-11T23:05:33.433 INFO:teuthology.orchestra.run.smithi160.stdout:(23/156): python3-rbd-19.1.1-298.gb53b6d3e.el9. 4.4 MB/s | 301 kB 00:00 2024-09-11T23:05:33.455 INFO:teuthology.orchestra.run.smithi123.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 917 kB/s | 61 kB 00:00 2024-09-11T23:05:33.483 INFO:teuthology.orchestra.run.smithi160.stdout:(24/156): python3-rgw-19.1.1-298.gb53b6d3e.el9. 2.0 MB/s | 100 kB 00:00 2024-09-11T23:05:33.522 INFO:teuthology.orchestra.run.smithi123.stdout:(75/156): python3-devel-3.9.19-8.el9.x86_64.rpm 3.6 MB/s | 245 kB 00:00 2024-09-11T23:05:33.525 INFO:teuthology.orchestra.run.smithi160.stdout:(25/156): rbd-fuse-19.1.1-298.gb53b6d3e.el9.x86 2.0 MB/s | 85 kB 00:00 2024-09-11T23:05:33.565 INFO:teuthology.orchestra.run.smithi037.stdout:(8/156): ceph-common-19.1.1-298.gb53b6d3e.el9.x 10 MB/s | 21 MB 00:02 2024-09-11T23:05:33.598 INFO:teuthology.orchestra.run.smithi123.stdout:(76/156): postgresql-server-13.16-1.el9.x86_64. 17 MB/s | 5.8 MB 00:00 2024-09-11T23:05:33.616 INFO:teuthology.orchestra.run.smithi037.stdout:(9/156): ceph-selinux-19.1.1-298.gb53b6d3e.el9. 506 kB/s | 25 kB 00:00 2024-09-11T23:05:33.623 INFO:teuthology.orchestra.run.smithi123.stdout:(77/156): python3-jinja2-2.11.3-6.el9.noarch.rp 2.4 MB/s | 248 kB 00:00 2024-09-11T23:05:33.648 INFO:teuthology.orchestra.run.smithi123.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 511 kB/s | 26 kB 00:00 2024-09-11T23:05:33.724 INFO:teuthology.orchestra.run.smithi123.stdout:(79/156): python3-babel-2.9.1-2.el9.noarch.rpm 17 MB/s | 6.0 MB 00:00 2024-09-11T23:05:33.749 INFO:teuthology.orchestra.run.smithi123.stdout:(80/156): python3-jsonpointer-2.0-4.el9.noarch. 152 kB/s | 19 kB 00:00 2024-09-11T23:05:33.749 INFO:teuthology.orchestra.run.smithi037.stdout:(10/156): ceph-radosgw-19.1.1-298.gb53b6d3e.el9 13 MB/s | 11 MB 00:00 2024-09-11T23:05:33.774 INFO:teuthology.orchestra.run.smithi123.stdout:(81/156): python3-mako-1.1.4-6.el9.noarch.rpm 1.3 MB/s | 172 kB 00:00 2024-09-11T23:05:33.800 INFO:teuthology.orchestra.run.smithi123.stdout:(82/156): python3-markupsafe-1.1.1-12.el9.x86_6 461 kB/s | 35 kB 00:00 2024-09-11T23:05:33.833 INFO:teuthology.orchestra.run.smithi123.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.2 MB/s | 250 kB 00:00 2024-09-11T23:05:33.858 INFO:teuthology.orchestra.run.smithi123.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 3.7 MB/s | 222 kB 00:00 2024-09-11T23:05:33.892 INFO:teuthology.orchestra.run.smithi123.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-09-11T23:05:33.917 INFO:teuthology.orchestra.run.smithi123.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 721 kB/s | 42 kB 00:00 2024-09-11T23:05:33.926 INFO:teuthology.orchestra.run.smithi160.stdout:(26/156): librgw2-19.1.1-298.gb53b6d3e.el9.x86_ 5.6 MB/s | 5.3 MB 00:00 2024-09-11T23:05:33.942 INFO:teuthology.orchestra.run.smithi037.stdout:(11/156): ceph-osd-19.1.1-298.gb53b6d3e.el9.x86 12 MB/s | 17 MB 00:01 2024-09-11T23:05:33.950 INFO:teuthology.orchestra.run.smithi123.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 4.5 MB/s | 269 kB 00:00 2024-09-11T23:05:33.976 INFO:teuthology.orchestra.run.smithi123.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.6 MB/s | 159 kB 00:00 2024-09-11T23:05:33.991 INFO:teuthology.orchestra.run.smithi037.stdout:(12/156): cephfs-mirror-19.1.1-298.gb53b6d3e.el 945 kB/s | 228 kB 00:00 2024-09-11T23:05:34.009 INFO:teuthology.orchestra.run.smithi160.stdout:(27/156): rbd-mirror-19.1.1-298.gb53b6d3e.el9.x 6.4 MB/s | 3.1 MB 00:00 2024-09-11T23:05:34.017 INFO:teuthology.orchestra.run.smithi037.stdout:(13/156): cephfs-shell-19.1.1-298.gb53b6d3e.el9 362 kB/s | 27 kB 00:00 2024-09-11T23:05:34.034 INFO:teuthology.orchestra.run.smithi123.stdout:(89/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 18 MB/s | 5.1 MB 00:00 2024-09-11T23:05:34.035 INFO:teuthology.orchestra.run.smithi160.stdout:(28/156): rbd-nbd-19.1.1-298.gb53b6d3e.el9.x86_ 1.5 MB/s | 171 kB 00:00 2024-09-11T23:05:34.044 INFO:teuthology.orchestra.run.smithi037.stdout:(14/156): libcephfs-devel-19.1.1-298.gb53b6d3e. 633 kB/s | 32 kB 00:00 2024-09-11T23:05:34.059 INFO:teuthology.orchestra.run.smithi123.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 611 kB/s | 51 kB 00:00 2024-09-11T23:05:34.060 INFO:teuthology.orchestra.run.smithi160.stdout:(29/156): ceph-grafana-dashboards-19.1.1-298.gb 634 kB/s | 32 kB 00:00 2024-09-11T23:05:34.085 INFO:teuthology.orchestra.run.smithi123.stdout:(91/156): python3-pyasn1-modules-0.4.8-6.el9.no 2.0 MB/s | 279 kB 00:00 2024-09-11T23:05:34.085 INFO:teuthology.orchestra.run.smithi160.stdout:(30/156): ceph-mgr-cephadm-19.1.1-298.gb53b6d3e 2.9 MB/s | 146 kB 00:00 2024-09-11T23:05:34.101 INFO:teuthology.orchestra.run.smithi037.stdout:(15/156): libcephfs2-19.1.1-298.gb53b6d3e.el9.x 8.8 MB/s | 752 kB 00:00 2024-09-11T23:05:34.110 INFO:teuthology.orchestra.run.smithi123.stdout:(92/156): python3-requests-oauthlib-1.3.0-12.el 711 kB/s | 54 kB 00:00 2024-09-11T23:05:34.135 INFO:teuthology.orchestra.run.smithi123.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 829 kB/s | 42 kB 00:00 2024-09-11T23:05:34.160 INFO:teuthology.orchestra.run.smithi037.stdout:(16/156): libcephsqlite-19.1.1-298.gb53b6d3e.el 1.4 MB/s | 163 kB 00:00 2024-09-11T23:05:34.169 INFO:teuthology.orchestra.run.smithi123.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 754 kB/s | 44 kB 00:00 2024-09-11T23:05:34.185 INFO:teuthology.orchestra.run.smithi037.stdout:(17/156): librados-devel-19.1.1-298.gb53b6d3e.e 1.5 MB/s | 127 kB 00:00 2024-09-11T23:05:34.194 INFO:teuthology.orchestra.run.smithi123.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-09-11T23:05:34.219 INFO:teuthology.orchestra.run.smithi123.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 717 kB/s | 36 kB 00:00 2024-09-11T23:05:34.235 INFO:teuthology.orchestra.run.smithi037.stdout:(18/156): libradosstriper1-19.1.1-298.gb53b6d3e 6.6 MB/s | 506 kB 00:00 2024-09-11T23:05:34.245 INFO:teuthology.orchestra.run.smithi123.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 942 kB/s | 47 kB 00:00 2024-09-11T23:05:34.279 INFO:teuthology.orchestra.run.smithi123.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 5.1 MB/s | 304 kB 00:00 2024-09-11T23:05:34.295 INFO:teuthology.orchestra.run.smithi123.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-11T23:05:34.302 INFO:teuthology.orchestra.run.smithi037.stdout:(19/156): python3-ceph-argparse-19.1.1-298.gb53 678 kB/s | 45 kB 00:00 2024-09-11T23:05:34.329 INFO:teuthology.orchestra.run.smithi123.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-11T23:05:34.346 INFO:teuthology.orchestra.run.smithi123.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-11T23:05:34.379 INFO:teuthology.orchestra.run.smithi123.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 896 kB/s | 45 kB 00:00 2024-09-11T23:05:34.396 INFO:teuthology.orchestra.run.smithi123.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 445 kB/s | 22 kB 00:00 2024-09-11T23:05:34.402 INFO:teuthology.orchestra.run.smithi037.stdout:(20/156): python3-ceph-common-19.1.1-298.gb53b6 1.3 MB/s | 136 kB 00:00 2024-09-11T23:05:34.447 INFO:teuthology.orchestra.run.smithi123.stdout:(104/156): protobuf-compiler-3.14.0-13.el9.x86_ 13 MB/s | 863 kB 00:00 2024-09-11T23:05:34.472 INFO:teuthology.orchestra.run.smithi123.stdout:(105/156): abseil-cpp-20211102.0-3.el9.x86_64.r 7.1 MB/s | 548 kB 00:00 2024-09-11T23:05:34.486 INFO:teuthology.orchestra.run.smithi037.stdout:(21/156): python3-cephfs-19.1.1-298.gb53b6d3e.e 1.9 MB/s | 162 kB 00:00 2024-09-11T23:05:34.506 INFO:teuthology.orchestra.run.smithi123.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 747 kB/s | 19 kB 00:00 2024-09-11T23:05:34.595 INFO:teuthology.orchestra.run.smithi037.stdout:(22/156): librgw2-19.1.1-298.gb53b6d3e.el9.x86_ 13 MB/s | 5.3 MB 00:00 2024-09-11T23:05:34.620 INFO:teuthology.orchestra.run.smithi037.stdout:(23/156): python3-rados-19.1.1-298.gb53b6d3e.el 2.4 MB/s | 321 kB 00:00 2024-09-11T23:05:34.653 INFO:teuthology.orchestra.run.smithi037.stdout:(24/156): python3-rbd-19.1.1-298.gb53b6d3e.el9. 5.0 MB/s | 301 kB 00:00 2024-09-11T23:05:34.681 INFO:teuthology.orchestra.run.smithi123.stdout:(107/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 26 MB/s | 16 MB 00:00 2024-09-11T23:05:34.687 INFO:teuthology.orchestra.run.smithi037.stdout:(25/156): python3-rgw-19.1.1-298.gb53b6d3e.el9. 1.4 MB/s | 100 kB 00:00 2024-09-11T23:05:34.706 INFO:teuthology.orchestra.run.smithi123.stdout:(108/156): gperftools-libs-2.9.1-2.el9.x86_64.r 1.2 MB/s | 309 kB 00:00 2024-09-11T23:05:34.712 INFO:teuthology.orchestra.run.smithi037.stdout:(26/156): rbd-fuse-19.1.1-298.gb53b6d3e.el9.x86 1.4 MB/s | 85 kB 00:00 2024-09-11T23:05:34.728 INFO:teuthology.orchestra.run.smithi160.stdout:(31/156): ceph-mgr-dashboard-19.1.1-298.gb53b6d 5.3 MB/s | 3.6 MB 00:00 2024-09-11T23:05:34.740 INFO:teuthology.orchestra.run.smithi123.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.8 MB/s | 49 kB 00:00 2024-09-11T23:05:34.765 INFO:teuthology.orchestra.run.smithi123.stdout:(110/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 310 kB/s | 26 kB 00:00 2024-09-11T23:05:34.780 INFO:teuthology.orchestra.run.smithi037.stdout:(27/156): rbd-nbd-19.1.1-298.gb53b6d3e.el9.x86_ 2.5 MB/s | 171 kB 00:00 2024-09-11T23:05:34.782 INFO:teuthology.orchestra.run.smithi123.stdout:(111/156): libunwind-1.6.2-1.el9.x86_64.rpm 1.6 MB/s | 67 kB 00:00 2024-09-11T23:05:34.808 INFO:teuthology.orchestra.run.smithi123.stdout:(112/156): luarocks-3.9.2-5.el9.noarch.rpm 3.5 MB/s | 151 kB 00:00 2024-09-11T23:05:34.858 INFO:teuthology.orchestra.run.smithi123.stdout:(113/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 11 MB/s | 839 kB 00:00 2024-09-11T23:05:34.869 INFO:teuthology.orchestra.run.smithi160.stdout:(32/156): ceph-mgr-modules-core-19.1.1-298.gb53 1.7 MB/s | 249 kB 00:00 2024-09-11T23:05:34.883 INFO:teuthology.orchestra.run.smithi123.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-11T23:05:34.896 INFO:teuthology.orchestra.run.smithi037.stdout:(28/156): rbd-mirror-19.1.1-298.gb53b6d3e.el9.x 15 MB/s | 3.1 MB 00:00 2024-09-11T23:05:34.908 INFO:teuthology.orchestra.run.smithi123.stdout:(115/156): python3-asyncssh-2.13.2-5.el9.noarch 5.3 MB/s | 548 kB 00:00 2024-09-11T23:05:34.921 INFO:teuthology.orchestra.run.smithi037.stdout:(29/156): ceph-grafana-dashboards-19.1.1-298.gb 225 kB/s | 32 kB 00:00 2024-09-11T23:05:34.933 INFO:teuthology.orchestra.run.smithi123.stdout:(116/156): python3-cachetools-4.2.4-1.el9.noarc 642 kB/s | 32 kB 00:00 2024-09-11T23:05:34.936 INFO:teuthology.orchestra.run.smithi160.stdout:(33/156): ceph-mgr-rook-19.1.1-298.gb53b6d3e.el 742 kB/s | 49 kB 00:00 2024-09-11T23:05:34.955 INFO:teuthology.orchestra.run.smithi037.stdout:(30/156): ceph-mgr-cephadm-19.1.1-298.gb53b6d3e 2.5 MB/s | 146 kB 00:00 2024-09-11T23:05:34.958 INFO:teuthology.orchestra.run.smithi123.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 281 kB/s | 14 kB 00:00 2024-09-11T23:05:34.984 INFO:teuthology.orchestra.run.smithi123.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-11T23:05:35.003 INFO:teuthology.orchestra.run.smithi160.stdout:(34/156): ceph-prometheus-alerts-19.1.1-298.gb5 246 kB/s | 16 kB 00:00 2024-09-11T23:05:35.009 INFO:teuthology.orchestra.run.smithi123.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 7.0 MB/s | 358 kB 00:00 2024-09-11T23:05:35.076 INFO:teuthology.orchestra.run.smithi123.stdout:(120/156): libarrow-9.0.0-11.el9.x86_64.rpm 7.8 MB/s | 4.4 MB 00:00 2024-09-11T23:05:35.101 INFO:teuthology.orchestra.run.smithi123.stdout:(121/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.5 MB/s | 303 kB 00:00 2024-09-11T23:05:35.127 INFO:teuthology.orchestra.run.smithi123.stdout:(122/156): python3-google-auth-2.34.0-1.el9.noa 1.8 MB/s | 220 kB 00:00 2024-09-11T23:05:35.152 INFO:teuthology.orchestra.run.smithi123.stdout:(123/156): python3-grpcio-tools-1.46.7-10.el9.x 2.8 MB/s | 144 kB 00:00 2024-09-11T23:05:35.177 INFO:teuthology.orchestra.run.smithi123.stdout:(124/156): python3-jaraco-8.2.1-3.el9.noarch.rp 214 kB/s | 11 kB 00:00 2024-09-11T23:05:35.202 INFO:teuthology.orchestra.run.smithi123.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 711 kB/s | 18 kB 00:00 2024-09-11T23:05:35.227 INFO:teuthology.orchestra.run.smithi123.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 464 kB/s | 23 kB 00:00 2024-09-11T23:05:35.230 INFO:teuthology.orchestra.run.smithi037.stdout:(31/156): ceph-mgr-dashboard-19.1.1-298.gb53b6d 12 MB/s | 3.6 MB 00:00 2024-09-11T23:05:35.245 INFO:teuthology.orchestra.run.smithi160.stdout:(35/156): ceph-volume-19.1.1-298.gb53b6d3e.el9. 1.2 MB/s | 285 kB 00:00 2024-09-11T23:05:35.253 INFO:teuthology.orchestra.run.smithi123.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 389 kB/s | 19 kB 00:00 2024-09-11T23:05:35.278 INFO:teuthology.orchestra.run.smithi123.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 391 kB/s | 20 kB 00:00 2024-09-11T23:05:35.303 INFO:teuthology.orchestra.run.smithi123.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-11T23:05:35.306 INFO:teuthology.orchestra.run.smithi037.stdout:(32/156): ceph-mgr-modules-core-19.1.1-298.gb53 3.3 MB/s | 249 kB 00:00 2024-09-11T23:05:35.320 INFO:teuthology.orchestra.run.smithi123.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 4.7 MB/s | 79 kB 00:00 2024-09-11T23:05:35.346 INFO:teuthology.orchestra.run.smithi123.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-11T23:05:35.379 INFO:teuthology.orchestra.run.smithi123.stdout:(132/156): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-09-11T23:05:35.389 INFO:teuthology.orchestra.run.smithi037.stdout:(33/156): ceph-mgr-rook-19.1.1-298.gb53b6d3e.el 594 kB/s | 49 kB 00:00 2024-09-11T23:05:35.413 INFO:teuthology.orchestra.run.smithi123.stdout:(133/156): python3-kubernetes-26.1.0-2.el9.noar 6.4 MB/s | 1.0 MB 00:00 2024-09-11T23:05:35.438 INFO:teuthology.orchestra.run.smithi123.stdout:(134/156): python3-portend-3.1.0-2.el9.noarch.r 280 kB/s | 16 kB 00:00 2024-09-11T23:05:35.463 INFO:teuthology.orchestra.run.smithi123.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.7 MB/s | 90 kB 00:00 2024-09-11T23:05:35.487 INFO:teuthology.orchestra.run.smithi160.stdout:(36/156): cephadm-19.1.1-298.gb53b6d3e.el9.noar 3.1 MB/s | 765 kB 00:00 2024-09-11T23:05:35.488 INFO:teuthology.orchestra.run.smithi123.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 563 kB/s | 28 kB 00:00 2024-09-11T23:05:35.514 INFO:teuthology.orchestra.run.smithi123.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 613 kB/s | 31 kB 00:00 2024-09-11T23:05:35.531 INFO:teuthology.orchestra.run.smithi037.stdout:(34/156): ceph-mgr-diskprediction-local-19.1.1- 13 MB/s | 7.4 MB 00:00 2024-09-11T23:05:35.537 INFO:teuthology.orchestra.run.smithi160.stdout:(37/156): cephfs-top-19.1.1-298.gb53b6d3e.el9.n 366 kB/s | 18 kB 00:00 2024-09-11T23:05:35.539 INFO:teuthology.orchestra.run.smithi123.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-11T23:05:35.556 INFO:teuthology.orchestra.run.smithi037.stdout:(35/156): ceph-prometheus-alerts-19.1.1-298.gb5 99 kB/s | 16 kB 00:00 2024-09-11T23:05:35.582 INFO:teuthology.orchestra.run.smithi037.stdout:(36/156): ceph-volume-19.1.1-298.gb53b6d3e.el9. 5.6 MB/s | 285 kB 00:00 2024-09-11T23:05:35.589 INFO:teuthology.orchestra.run.smithi123.stdout:(139/156): python3-grpcio-1.46.7-10.el9.x86_64. 4.0 MB/s | 2.0 MB 00:00 2024-09-11T23:05:35.621 INFO:teuthology.orchestra.run.smithi160.stdout:(38/156): ceph-mgr-diskprediction-local-19.1.1- 4.8 MB/s | 7.4 MB 00:01 2024-09-11T23:05:35.623 INFO:teuthology.orchestra.run.smithi123.stdout:(140/156): python3-routes-2.5.1-5.el9.noarch.rp 1.4 MB/s | 188 kB 00:00 2024-09-11T23:05:35.623 INFO:teuthology.orchestra.run.smithi037.stdout:(37/156): cephfs-top-19.1.1-298.gb53b6d3e.el9.n 442 kB/s | 18 kB 00:00 2024-09-11T23:05:35.649 INFO:teuthology.orchestra.run.smithi123.stdout:(141/156): python3-tempora-5.0.0-2.el9.noarch.r 328 kB/s | 36 kB 00:00 2024-09-11T23:05:35.657 INFO:teuthology.orchestra.run.smithi037.stdout:(38/156): cephadm-19.1.1-298.gb53b6d3e.el9.noar 7.4 MB/s | 765 kB 00:00 2024-09-11T23:05:35.674 INFO:teuthology.orchestra.run.smithi123.stdout:(142/156): python3-typing-extensions-4.12.2-2.e 887 kB/s | 74 kB 00:00 2024-09-11T23:05:35.699 INFO:teuthology.orchestra.run.smithi123.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-11T23:05:35.724 INFO:teuthology.orchestra.run.smithi123.stdout:(144/156): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-11T23:05:35.729 INFO:teuthology.orchestra.run.smithi160.stdout:(39/156): fuse-2.9.9-16.el9.x86_64.rpm 416 kB/s | 80 kB 00:00 2024-09-11T23:05:35.741 INFO:teuthology.orchestra.run.smithi123.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 479 kB/s | 20 kB 00:00 2024-09-11T23:05:35.775 INFO:teuthology.orchestra.run.smithi123.stdout:(146/156): python3-werkzeug-2.0.3-3.el9.1.noarc 4.1 MB/s | 427 kB 00:00 2024-09-11T23:05:35.800 INFO:teuthology.orchestra.run.smithi123.stdout:(147/156): re2-20211101-20.el9.x86_64.rpm 3.2 MB/s | 191 kB 00:00 2024-09-11T23:05:35.821 INFO:teuthology.orchestra.run.smithi160.stdout:(40/156): libgfortran-11.5.0-2.el9.x86_64.rpm 3.9 MB/s | 801 kB 00:00 2024-09-11T23:05:35.847 INFO:teuthology.orchestra.run.smithi160.stdout:(41/156): libquadmath-11.5.0-2.el9.x86_64.rpm 1.6 MB/s | 191 kB 00:00 2024-09-11T23:05:35.850 INFO:teuthology.orchestra.run.smithi123.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-11T23:05:35.905 INFO:teuthology.orchestra.run.smithi160.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.0 MB/s | 253 kB 00:00 2024-09-11T23:05:35.972 INFO:teuthology.orchestra.run.smithi160.stdout:(43/156): python3-cryptography-36.0.1-4.el9.x86 9.8 MB/s | 1.2 MB 00:00 2024-09-11T23:05:35.997 INFO:teuthology.orchestra.run.smithi160.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 1.1 MB/s | 106 kB 00:00 2024-09-11T23:05:36.073 INFO:teuthology.orchestra.run.smithi160.stdout:(45/156): python3-requests-2.25.1-8.el9.noarch. 1.6 MB/s | 125 kB 00:00 2024-09-11T23:05:36.092 INFO:teuthology.orchestra.run.smithi123.stdout:(149/156): librbd1-19.1.1-298.gb53b6d3e.el9.x86 11 MB/s | 3.2 MB 00:00 2024-09-11T23:05:36.114 INFO:teuthology.orchestra.run.smithi160.stdout:(46/156): python3-pycparser-2.20-6.el9.noarch.r 952 kB/s | 135 kB 00:00 2024-09-11T23:05:36.125 INFO:teuthology.orchestra.run.smithi037.stdout:(39/156): ceph-test-19.1.1-298.gb53b6d3e.el9.x8 19 MB/s | 49 MB 00:02 2024-09-11T23:05:36.150 INFO:teuthology.orchestra.run.smithi037.stdout:(40/156): fuse-2.9.9-16.el9.x86_64.rpm 152 kB/s | 80 kB 00:00 2024-09-11T23:05:36.184 INFO:teuthology.orchestra.run.smithi123.stdout:(150/156): librados2-19.1.1-298.gb53b6d3e.el9.x 8.4 MB/s | 3.4 MB 00:00 2024-09-11T23:05:36.190 INFO:teuthology.orchestra.run.smithi160.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 1.8 MB/s | 215 kB 00:00 2024-09-11T23:05:36.384 INFO:teuthology.orchestra.run.smithi123.stdout:(151/156): NetworkManager-team-1.49.90-1.el9.x8 204 kB/s | 41 kB 00:00 2024-09-11T23:05:36.458 INFO:teuthology.orchestra.run.smithi037.stdout:(41/156): libquadmath-11.5.0-2.el9.x86_64.rpm 574 kB/s | 191 kB 00:00 2024-09-11T23:05:36.492 INFO:teuthology.orchestra.run.smithi037.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 740 kB/s | 253 kB 00:00 2024-09-11T23:05:36.576 INFO:teuthology.orchestra.run.smithi037.stdout:(43/156): python3-ply-3.11-14.el9.noarch.rpm 1.2 MB/s | 106 kB 00:00 2024-09-11T23:05:36.676 INFO:teuthology.orchestra.run.smithi123.stdout:(152/156): NetworkManager-tui-1.49.90-1.el9.x86 853 kB/s | 249 kB 00:00 2024-09-11T23:05:36.701 INFO:teuthology.orchestra.run.smithi037.stdout:(44/156): python3-pycparser-2.20-6.el9.noarch.r 1.1 MB/s | 135 kB 00:00 2024-09-11T23:05:36.734 INFO:teuthology.orchestra.run.smithi037.stdout:(45/156): libgfortran-11.5.0-2.el9.x86_64.rpm 744 kB/s | 801 kB 00:01 2024-09-11T23:05:36.826 INFO:teuthology.orchestra.run.smithi037.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 1.0 MB/s | 125 kB 00:00 2024-09-11T23:05:36.851 INFO:teuthology.orchestra.run.smithi123.stdout:(153/156): NetworkManager-1.49.90-1.el9.x86_64. 2.3 MB/s | 2.3 MB 00:01 2024-09-11T23:05:36.860 INFO:teuthology.orchestra.run.smithi037.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 1.7 MB/s | 215 kB 00:00 2024-09-11T23:05:37.010 INFO:teuthology.orchestra.run.smithi123.stdout:(154/156): NetworkManager-libnm-1.49.90-1.el9.x 2.0 MB/s | 1.8 MB 00:00 2024-09-11T23:05:37.010 INFO:teuthology.orchestra.run.smithi037.stdout:(48/156): bison-3.7.4-5.el9.x86_64.rpm 6.2 MB/s | 943 kB 00:00 2024-09-11T23:05:37.094 INFO:teuthology.orchestra.run.smithi037.stdout:(49/156): python3-cryptography-36.0.1-4.el9.x86 1.9 MB/s | 1.2 MB 00:00 2024-09-11T23:05:37.098 INFO:teuthology.orchestra.run.smithi160.stdout:(48/156): automake-1.16.2-8.el9.noarch.rpm 700 kB/s | 689 kB 00:00 2024-09-11T23:05:37.119 INFO:teuthology.orchestra.run.smithi037.stdout:(50/156): boost-program-options-1.75.0-8.el9.x8 988 kB/s | 107 kB 00:00 2024-09-11T23:05:37.153 INFO:teuthology.orchestra.run.smithi037.stdout:(51/156): automake-1.16.2-8.el9.noarch.rpm 2.1 MB/s | 689 kB 00:00 2024-09-11T23:05:37.168 INFO:teuthology.orchestra.run.smithi123.stdout:(155/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 7.6 MB/s | 2.4 MB 00:00 2024-09-11T23:05:37.182 INFO:teuthology.orchestra.run.smithi160.stdout:(49/156): bison-3.7.4-5.el9.x86_64.rpm 951 kB/s | 943 kB 00:00 2024-09-11T23:05:37.194 INFO:teuthology.orchestra.run.smithi037.stdout:(52/156): elfutils-libelf-devel-0.191-4.el9.x86 217 kB/s | 22 kB 00:00 2024-09-11T23:05:37.202 INFO:teuthology.orchestra.run.smithi123.stdout:(156/156): openssl-3.2.2-6.el9.x86_64.rpm 2.6 MB/s | 1.4 MB 00:00 2024-09-11T23:05:37.208 INFO:teuthology.orchestra.run.smithi123.stdout:-------------------------------------------------------------------------------- 2024-09-11T23:05:37.208 INFO:teuthology.orchestra.run.smithi123.stdout:Total 21 MB/s | 226 MB 00:10 2024-09-11T23:05:37.287 INFO:teuthology.orchestra.run.smithi037.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 245 kB/s | 33 kB 00:00 2024-09-11T23:05:37.362 INFO:teuthology.orchestra.run.smithi037.stdout:(54/156): flexiblas-openblas-openmp-3.0.4-8.el9 243 kB/s | 18 kB 00:00 2024-09-11T23:05:37.429 INFO:teuthology.orchestra.run.smithi037.stdout:(55/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 13 MB/s | 3.0 MB 00:00 2024-09-11T23:05:37.454 INFO:teuthology.orchestra.run.smithi037.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 121 kB/s | 11 kB 00:00 2024-09-11T23:05:37.521 INFO:teuthology.orchestra.run.smithi037.stdout:(57/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 683 kB/s | 45 kB 00:00 2024-09-11T23:05:37.563 INFO:teuthology.orchestra.run.smithi037.stdout:(58/156): flex-2.6.4-9.el9.x86_64.rpm 707 kB/s | 313 kB 00:00 2024-09-11T23:05:37.766 INFO:teuthology.orchestra.run.smithi160.stdout:(50/156): elfutils-libelf-devel-0.191-4.el9.x86 37 kB/s | 22 kB 00:00 2024-09-11T23:05:37.807 INFO:teuthology.orchestra.run.smithi160.stdout:(51/156): boost-program-options-1.75.0-8.el9.x8 151 kB/s | 107 kB 00:00 2024-09-11T23:05:37.813 INFO:teuthology.orchestra.run.smithi037.stdout:(59/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 417 kB/s | 160 kB 00:00 2024-09-11T23:05:37.864 INFO:teuthology.orchestra.run.smithi037.stdout:(60/156): librdkafka-1.6.1-102.el9.x86_64.rpm 1.9 MB/s | 662 kB 00:00 2024-09-11T23:05:37.889 INFO:teuthology.orchestra.run.smithi037.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 326 kB/s | 24 kB 00:00 2024-09-11T23:05:37.947 INFO:teuthology.orchestra.run.smithi037.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 570 kB/s | 47 kB 00:00 2024-09-11T23:05:37.981 INFO:teuthology.orchestra.run.smithi037.stdout:(63/156): libtool-2.4.6-46.el9.x86_64.rpm 1.4 MB/s | 581 kB 00:00 2024-09-11T23:05:38.006 INFO:teuthology.orchestra.run.smithi037.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.4 MB/s | 292 kB 00:00 2024-09-11T23:05:38.057 INFO:teuthology.orchestra.run.smithi037.stdout:(65/156): lua-5.4.4-4.el9.x86_64.rpm 1.7 MB/s | 188 kB 00:00 2024-09-11T23:05:38.082 INFO:teuthology.orchestra.run.smithi037.stdout:(66/156): openblas-0.3.26-2.el9.x86_64.rpm 384 kB/s | 38 kB 00:00 2024-09-11T23:05:38.308 INFO:teuthology.orchestra.run.smithi160.stdout:(52/156): ceph-test-19.1.1-298.gb53b6d3e.el9.x8 7.6 MB/s | 49 MB 00:06 2024-09-11T23:05:38.437 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction check 2024-09-11T23:05:38.565 INFO:teuthology.orchestra.run.smithi037.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 3.3 MB/s | 1.6 MB 00:00 2024-09-11T23:05:38.587 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction check succeeded. 2024-09-11T23:05:38.588 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction test 2024-09-11T23:05:38.691 INFO:teuthology.orchestra.run.smithi037.stdout:(68/156): postgresql-contrib-13.16-1.el9.x86_64 7.6 MB/s | 910 kB 00:00 2024-09-11T23:05:38.750 INFO:teuthology.orchestra.run.smithi037.stdout:(69/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 6.4 MB/s | 4.4 MB 00:00 2024-09-11T23:05:38.855 INFO:teuthology.orchestra.run.smithi160.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 32 kB/s | 33 kB 00:01 2024-09-11T23:05:39.033 INFO:teuthology.orchestra.run.smithi037.stdout:(70/156): postgresql-server-13.16-1.el9.x86_64. 20 MB/s | 5.8 MB 00:00 2024-09-11T23:05:39.123 INFO:teuthology.orchestra.run.smithi160.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 232 kB/s | 313 kB 00:01 2024-09-11T23:05:39.127 INFO:teuthology.orchestra.run.smithi037.stdout:(71/156): postgresql-private-libs-13.16-1.el9.x 311 kB/s | 137 kB 00:00 2024-09-11T23:05:39.342 INFO:teuthology.orchestra.run.smithi037.stdout:(72/156): openblas-openmp-0.3.26-2.el9.x86_64.r 3.7 MB/s | 4.9 MB 00:01 2024-09-11T23:05:39.375 INFO:teuthology.orchestra.run.smithi160.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 34 kB/s | 18 kB 00:00 2024-09-11T23:05:39.442 INFO:teuthology.orchestra.run.smithi037.stdout:(73/156): protobuf-3.14.0-13.el9.x86_64.rpm 2.5 MB/s | 1.0 MB 00:00 2024-09-11T23:05:39.459 INFO:teuthology.orchestra.run.smithi037.stdout:(74/156): python3-attrs-20.3.0-7.el9.noarch.rpm 262 kB/s | 87 kB 00:00 2024-09-11T23:05:39.576 INFO:teuthology.orchestra.run.smithi037.stdout:(75/156): python3-babel-2.9.1-2.el9.noarch.rpm 26 MB/s | 6.0 MB 00:00 2024-09-11T23:05:39.601 INFO:teuthology.orchestra.run.smithi037.stdout:(76/156): python3-colorama-0.4.6-3.el9.noarch.r 386 kB/s | 61 kB 00:00 2024-09-11T23:05:39.627 INFO:teuthology.orchestra.run.smithi037.stdout:(77/156): python3-devel-3.9.19-8.el9.x86_64.rpm 1.4 MB/s | 245 kB 00:00 2024-09-11T23:05:39.675 INFO:teuthology.orchestra.run.smithi160.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 20 kB/s | 11 kB 00:00 2024-09-11T23:05:39.685 INFO:teuthology.orchestra.run.smithi037.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 308 kB/s | 26 kB 00:00 2024-09-11T23:05:39.710 INFO:teuthology.orchestra.run.smithi037.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 230 kB/s | 19 kB 00:00 2024-09-11T23:05:39.735 INFO:teuthology.orchestra.run.smithi037.stdout:(80/156): python3-jinja2-2.11.3-6.el9.noarch.rp 1.5 MB/s | 248 kB 00:00 2024-09-11T23:05:39.786 INFO:teuthology.orchestra.run.smithi037.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 463 kB/s | 35 kB 00:00 2024-09-11T23:05:39.811 INFO:teuthology.orchestra.run.smithi037.stdout:(82/156): python3-mako-1.1.4-6.el9.noarch.rpm 1.3 MB/s | 172 kB 00:00 2024-09-11T23:05:39.886 INFO:teuthology.orchestra.run.smithi037.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.4 MB/s | 250 kB 00:00 2024-09-11T23:05:39.911 INFO:teuthology.orchestra.run.smithi037.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 2.2 MB/s | 222 kB 00:00 2024-09-11T23:05:40.012 INFO:teuthology.orchestra.run.smithi037.stdout:(85/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 18 MB/s | 5.1 MB 00:00 2024-09-11T23:05:40.037 INFO:teuthology.orchestra.run.smithi037.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 337 kB/s | 42 kB 00:00 2024-09-11T23:05:40.062 INFO:teuthology.orchestra.run.smithi037.stdout:(87/156): python3-packaging-20.9-5.el9.noarch.r 439 kB/s | 77 kB 00:00 2024-09-11T23:05:40.122 INFO:teuthology.orchestra.run.smithi037.stdout:(88/156): python3-protobuf-3.14.0-13.el9.noarch 2.4 MB/s | 269 kB 00:00 2024-09-11T23:05:40.171 INFO:teuthology.orchestra.run.smithi037.stdout:(89/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.2 MB/s | 159 kB 00:00 2024-09-11T23:05:40.184 INFO:teuthology.orchestra.run.smithi160.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 200 kB/s | 160 kB 00:00 2024-09-11T23:05:40.197 INFO:teuthology.orchestra.run.smithi037.stdout:(90/156): python3-pyasn1-modules-0.4.8-6.el9.no 2.0 MB/s | 279 kB 00:00 2024-09-11T23:05:40.239 INFO:teuthology.orchestra.run.smithi037.stdout:(91/156): python3-pytz-2021.1-5.el9.noarch.rpm 436 kB/s | 51 kB 00:00 2024-09-11T23:05:40.264 INFO:teuthology.orchestra.run.smithi037.stdout:(92/156): python3-requests-oauthlib-1.3.0-12.el 584 kB/s | 54 kB 00:00 2024-09-11T23:05:40.267 INFO:teuthology.orchestra.run.smithi160.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 76 kB/s | 45 kB 00:00 2024-09-11T23:05:40.314 INFO:teuthology.orchestra.run.smithi037.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 555 kB/s | 42 kB 00:00 2024-09-11T23:05:40.339 INFO:teuthology.orchestra.run.smithi037.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 589 kB/s | 44 kB 00:00 2024-09-11T23:05:40.398 INFO:teuthology.orchestra.run.smithi037.stdout:(95/156): qatlib-service-24.02.0-1.el9.x86_64.r 618 kB/s | 36 kB 00:00 2024-09-11T23:05:40.406 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction test succeeded. 2024-09-11T23:05:40.406 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction 2024-09-11T23:05:40.473 INFO:teuthology.orchestra.run.smithi037.stdout:(96/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 632 kB/s | 47 kB 00:00 2024-09-11T23:05:40.507 INFO:teuthology.orchestra.run.smithi037.stdout:(97/156): qatlib-24.02.0-1.el9.x86_64.rpm 1.1 MB/s | 221 kB 00:00 2024-09-11T23:05:40.582 INFO:teuthology.orchestra.run.smithi037.stdout:(98/156): uuid-1.6.2-55.el9.x86_64.rpm 774 kB/s | 58 kB 00:00 2024-09-11T23:05:40.615 INFO:teuthology.orchestra.run.smithi037.stdout:(99/156): socat-1.7.4.1-6.el9.x86_64.rpm 2.1 MB/s | 304 kB 00:00 2024-09-11T23:05:40.666 INFO:teuthology.orchestra.run.smithi037.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.1 MB/s | 96 kB 00:00 2024-09-11T23:05:40.699 INFO:teuthology.orchestra.run.smithi037.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 769 kB/s | 64 kB 00:00 2024-09-11T23:05:40.766 INFO:teuthology.orchestra.run.smithi037.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 452 kB/s | 45 kB 00:00 2024-09-11T23:05:40.808 INFO:teuthology.orchestra.run.smithi037.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 205 kB/s | 22 kB 00:00 2024-09-11T23:05:40.875 INFO:teuthology.orchestra.run.smithi037.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 8.1 MB/s | 548 kB 00:00 2024-09-11T23:05:40.908 INFO:teuthology.orchestra.run.smithi037.stdout:(105/156): gperftools-libs-2.9.1-2.el9.x86_64.r 9.1 MB/s | 309 kB 00:00 2024-09-11T23:05:40.934 INFO:teuthology.orchestra.run.smithi037.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 774 kB/s | 19 kB 00:00 2024-09-11T23:05:41.042 INFO:teuthology.orchestra.run.smithi037.stdout:(107/156): libarrow-9.0.0-11.el9.x86_64.rpm 41 MB/s | 4.4 MB 00:00 2024-09-11T23:05:41.067 INFO:teuthology.orchestra.run.smithi037.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-11T23:05:41.110 INFO:teuthology.orchestra.run.smithi037.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.1 MB/s | 49 kB 00:00 2024-09-11T23:05:41.143 INFO:teuthology.orchestra.run.smithi037.stdout:(110/156): protobuf-compiler-3.14.0-13.el9.x86_ 2.2 MB/s | 863 kB 00:00 2024-09-11T23:05:41.168 INFO:teuthology.orchestra.run.smithi037.stdout:(111/156): libunwind-1.6.2-1.el9.x86_64.rpm 1.1 MB/s | 67 kB 00:00 2024-09-11T23:05:41.184 INFO:teuthology.orchestra.run.smithi160.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 663 kB/s | 662 kB 00:00 2024-09-11T23:05:41.209 INFO:teuthology.orchestra.run.smithi160.stdout:(60/156): libtool-2.4.6-46.el9.x86_64.rpm 617 kB/s | 581 kB 00:00 2024-09-11T23:05:41.235 INFO:teuthology.orchestra.run.smithi037.stdout:(112/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 15 MB/s | 839 kB 00:00 2024-09-11T23:05:41.260 INFO:teuthology.orchestra.run.smithi037.stdout:(113/156): luarocks-3.9.2-5.el9.noarch.rpm 1.3 MB/s | 151 kB 00:00 2024-09-11T23:05:41.285 INFO:teuthology.orchestra.run.smithi037.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-11T23:05:41.311 INFO:teuthology.orchestra.run.smithi037.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-11T23:05:41.336 INFO:teuthology.orchestra.run.smithi037.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 566 kB/s | 14 kB 00:00 2024-09-11T23:05:41.370 INFO:teuthology.orchestra.run.smithi037.stdout:(117/156): python3-asyncssh-2.13.2-5.el9.noarch 4.0 MB/s | 548 kB 00:00 2024-09-11T23:05:41.395 INFO:teuthology.orchestra.run.smithi037.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-09-11T23:05:41.428 INFO:teuthology.orchestra.run.smithi037.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-11T23:05:41.454 INFO:teuthology.orchestra.run.smithi037.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-09-11T23:05:41.487 INFO:teuthology.orchestra.run.smithi037.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-09-11T23:05:41.521 INFO:teuthology.orchestra.run.smithi037.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 4.3 MB/s | 144 kB 00:00 2024-09-11T23:05:41.546 INFO:teuthology.orchestra.run.smithi037.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 426 kB/s | 11 kB 00:00 2024-09-11T23:05:41.572 INFO:teuthology.orchestra.run.smithi037.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 713 kB/s | 18 kB 00:00 2024-09-11T23:05:41.597 INFO:teuthology.orchestra.run.smithi037.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 929 kB/s | 23 kB 00:00 2024-09-11T23:05:41.622 INFO:teuthology.orchestra.run.smithi037.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 778 kB/s | 19 kB 00:00 2024-09-11T23:05:41.648 INFO:teuthology.orchestra.run.smithi037.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 795 kB/s | 20 kB 00:00 2024-09-11T23:05:41.715 INFO:teuthology.orchestra.run.smithi037.stdout:(128/156): python3-grpcio-1.46.7-10.el9.x86_64. 7.8 MB/s | 2.0 MB 00:00 2024-09-11T23:05:41.726 INFO:teuthology.orchestra.run.smithi160.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 45 kB/s | 24 kB 00:00 2024-09-11T23:05:41.740 INFO:teuthology.orchestra.run.smithi037.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-11T23:05:41.782 INFO:teuthology.orchestra.run.smithi037.stdout:(130/156): python3-kubernetes-26.1.0-2.el9.noar 7.6 MB/s | 1.0 MB 00:00 2024-09-11T23:05:41.807 INFO:teuthology.orchestra.run.smithi037.stdout:(131/156): python3-more-itertools-8.12.0-2.el9. 1.2 MB/s | 79 kB 00:00 2024-09-11T23:05:41.810 INFO:teuthology.orchestra.run.smithi160.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 79 kB/s | 47 kB 00:00 2024-09-11T23:05:41.832 INFO:teuthology.orchestra.run.smithi037.stdout:(132/156): python3-natsort-7.1.1-5.el9.noarch.r 1.1 MB/s | 58 kB 00:00 2024-09-11T23:05:41.858 INFO:teuthology.orchestra.run.smithi037.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 659 kB/s | 16 kB 00:00 2024-09-11T23:05:41.860 INFO:teuthology.orchestra.run.smithi160.stdout:(63/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 862 kB/s | 3.0 MB 00:03 2024-09-11T23:05:41.883 INFO:teuthology.orchestra.run.smithi037.stdout:(134/156): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-09-11T23:05:41.908 INFO:teuthology.orchestra.run.smithi037.stdout:(135/156): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-09-11T23:05:41.925 INFO:teuthology.orchestra.run.smithi037.stdout:(136/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.3 MB/s | 90 kB 00:00 2024-09-11T23:05:41.950 INFO:teuthology.orchestra.run.smithi037.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 737 kB/s | 31 kB 00:00 2024-09-11T23:05:41.976 INFO:teuthology.orchestra.run.smithi037.stdout:(138/156): python3-routes-2.5.1-5.el9.noarch.rp 3.7 MB/s | 188 kB 00:00 2024-09-11T23:05:42.001 INFO:teuthology.orchestra.run.smithi037.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-09-11T23:05:42.026 INFO:teuthology.orchestra.run.smithi037.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 715 kB/s | 36 kB 00:00 2024-09-11T23:05:42.070 INFO:teuthology.orchestra.run.smithi037.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.1 MB/s | 74 kB 00:00 2024-09-11T23:05:42.102 INFO:teuthology.orchestra.run.smithi037.stdout:(142/156): python3-websocket-client-1.2.3-2.el9 2.8 MB/s | 90 kB 00:00 2024-09-11T23:05:42.135 INFO:teuthology.orchestra.run.smithi037.stdout:(143/156): python3-webob-1.8.8-2.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-09-11T23:05:42.161 INFO:teuthology.orchestra.run.smithi037.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 800 kB/s | 20 kB 00:00 2024-09-11T23:05:42.194 INFO:teuthology.orchestra.run.smithi037.stdout:(145/156): re2-20211101-20.el9.x86_64.rpm 5.6 MB/s | 191 kB 00:00 2024-09-11T23:05:42.228 INFO:teuthology.orchestra.run.smithi037.stdout:(146/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-11T23:05:42.295 INFO:teuthology.orchestra.run.smithi037.stdout:(147/156): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-11T23:05:42.435 INFO:teuthology.orchestra.run.smithi160.stdout:(64/156): openblas-0.3.26-2.el9.x86_64.rpm 67 kB/s | 38 kB 00:00 2024-09-11T23:05:42.462 INFO:teuthology.orchestra.run.smithi037.stdout:(148/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 7.2 MB/s | 16 MB 00:02 2024-09-11T23:05:42.519 INFO:teuthology.orchestra.run.smithi160.stdout:(65/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 369 kB/s | 292 kB 00:00 2024-09-11T23:05:42.603 INFO:teuthology.orchestra.run.smithi160.stdout:(66/156): lua-5.4.4-4.el9.x86_64.rpm 238 kB/s | 188 kB 00:00 2024-09-11T23:05:42.620 INFO:teuthology.orchestra.run.smithi037.stdout:(149/156): librbd1-19.1.1-298.gb53b6d3e.el9.x86 9.7 MB/s | 3.2 MB 00:00 2024-09-11T23:05:42.687 INFO:teuthology.orchestra.run.smithi037.stdout:(150/156): librados2-19.1.1-298.gb53b6d3e.el9.x 7.5 MB/s | 3.4 MB 00:00 2024-09-11T23:05:42.846 INFO:teuthology.orchestra.run.smithi037.stdout:(151/156): NetworkManager-team-1.49.90-1.el9.x8 257 kB/s | 41 kB 00:00 2024-09-11T23:05:43.155 INFO:teuthology.orchestra.run.smithi037.stdout:(152/156): NetworkManager-tui-1.49.90-1.el9.x86 806 kB/s | 249 kB 00:00 2024-09-11T23:05:43.505 INFO:teuthology.orchestra.run.smithi037.stdout:(153/156): NetworkManager-1.49.90-1.el9.x86_64. 2.2 MB/s | 2.3 MB 00:01 2024-09-11T23:05:43.547 INFO:teuthology.orchestra.run.smithi037.stdout:(154/156): NetworkManager-libnm-1.49.90-1.el9.x 1.9 MB/s | 1.8 MB 00:00 2024-09-11T23:05:43.578 INFO:teuthology.orchestra.run.smithi160.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 1.6 MB/s | 1.6 MB 00:00 2024-09-11T23:05:43.653 INFO:teuthology.orchestra.run.smithi160.stdout:(68/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 3.9 MB/s | 4.4 MB 00:01 2024-09-11T23:05:43.729 INFO:teuthology.orchestra.run.smithi160.stdout:(69/156): openblas-openmp-0.3.26-2.el9.x86_64.r 3.8 MB/s | 4.9 MB 00:01 2024-09-11T23:05:43.764 INFO:teuthology.orchestra.run.smithi037.stdout:(155/156): openssl-3.2.2-6.el9.x86_64.rpm 2.2 MB/s | 1.4 MB 00:00 2024-09-11T23:05:44.322 INFO:teuthology.orchestra.run.smithi037.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 2.9 MB/s | 2.4 MB 00:00 2024-09-11T23:05:44.327 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2024-09-11T23:05:44.328 INFO:teuthology.orchestra.run.smithi037.stdout:Total 17 MB/s | 226 MB 00:13 2024-09-11T23:05:44.462 INFO:teuthology.orchestra.run.smithi160.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 170 kB/s | 137 kB 00:00 2024-09-11T23:05:44.662 INFO:teuthology.orchestra.run.smithi160.stdout:(71/156): postgresql-contrib-13.16-1.el9.x86_64 840 kB/s | 910 kB 00:01 2024-09-11T23:05:45.312 INFO:teuthology.orchestra.run.smithi160.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 135 kB/s | 87 kB 00:00 2024-09-11T23:05:45.471 INFO:teuthology.orchestra.run.smithi160.stdout:(73/156): protobuf-3.14.0-13.el9.x86_64.rpm 1.0 MB/s | 1.0 MB 00:01 2024-09-11T23:05:45.629 INFO:teuthology.orchestra.run.smithi160.stdout:(74/156): postgresql-server-13.16-1.el9.x86_64. 3.0 MB/s | 5.8 MB 00:01 2024-09-11T23:05:46.155 INFO:teuthology.orchestra.run.smithi160.stdout:(75/156): python3-colorama-0.4.6-3.el9.noarch.r 90 kB/s | 61 kB 00:00 2024-09-11T23:05:46.426 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2024-09-11T23:05:46.530 INFO:teuthology.orchestra.run.smithi160.stdout:(76/156): python3-babel-2.9.1-2.el9.noarch.rpm 4.9 MB/s | 6.0 MB 00:01 2024-09-11T23:05:46.555 INFO:teuthology.orchestra.run.smithi160.stdout:(77/156): python3-devel-3.9.19-8.el9.x86_64.rpm 265 kB/s | 245 kB 00:00 2024-09-11T23:05:46.624 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2024-09-11T23:05:46.624 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2024-09-11T23:05:46.705 INFO:teuthology.orchestra.run.smithi123.stdout: Preparing : 1/1 2024-09-11T23:05:46.822 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-11T23:05:46.860 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-11T23:05:46.921 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-11T23:05:46.956 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-11T23:05:46.982 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-11T23:05:46.997 INFO:teuthology.orchestra.run.smithi160.stdout:(78/156): python3-jinja2-2.11.3-6.el9.noarch.rp 295 kB/s | 248 kB 00:00 2024-09-11T23:05:47.033 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-11T23:05:47.089 INFO:teuthology.orchestra.run.smithi160.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 36 kB/s | 19 kB 00:00 2024-09-11T23:05:47.131 INFO:teuthology.orchestra.run.smithi160.stdout:(80/156): python3-jsonpatch-1.21-16.el9.noarch. 43 kB/s | 26 kB 00:00 2024-09-11T23:05:47.355 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-11T23:05:47.457 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-11T23:05:47.578 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-11T23:05:47.608 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-11T23:05:47.664 INFO:teuthology.orchestra.run.smithi160.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 60 kB/s | 35 kB 00:00 2024-09-11T23:05:47.699 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-11T23:05:47.729 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-11T23:05:47.806 INFO:teuthology.orchestra.run.smithi160.stdout:(82/156): python3-mako-1.1.4-6.el9.noarch.rpm 213 kB/s | 172 kB 00:00 2024-09-11T23:05:47.878 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-11T23:05:47.926 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-11T23:05:47.954 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-11T23:05:48.057 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-11T23:05:48.080 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-11T23:05:48.142 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-11T23:05:48.164 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-11T23:05:48.189 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-11T23:05:48.273 INFO:teuthology.orchestra.run.smithi160.stdout:(83/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.5 MB/s | 5.1 MB 00:01 2024-09-11T23:05:48.381 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-11T23:05:48.440 INFO:teuthology.orchestra.run.smithi160.stdout:(84/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 323 kB/s | 250 kB 00:00 2024-09-11T23:05:48.527 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-11T23:05:48.574 INFO:teuthology.orchestra.run.smithi160.stdout:(85/156): python3-oauthlib-3.1.1-5.el9.noarch.r 290 kB/s | 222 kB 00:00 2024-09-11T23:05:48.646 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-11T23:05:48.747 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-11T23:05:48.822 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-11T23:05:48.924 INFO:teuthology.orchestra.run.smithi160.stdout:(86/156): python3-packaging-20.9-5.el9.noarch.r 119 kB/s | 77 kB 00:00 2024-09-11T23:05:49.052 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-11T23:05:49.074 INFO:teuthology.orchestra.run.smithi160.stdout:(87/156): python3-prettytable-0.7.2-27.el9.noar 67 kB/s | 42 kB 00:00 2024-09-11T23:05:49.131 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2024-09-11T23:05:49.132 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2024-09-11T23:05:49.159 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-11T23:05:49.250 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-11T23:05:49.289 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-11T23:05:49.323 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-11T23:05:49.332 INFO:teuthology.orchestra.run.smithi160.stdout:(88/156): python3-protobuf-3.14.0-13.el9.noarch 355 kB/s | 269 kB 00:00 2024-09-11T23:05:49.387 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-11T23:05:49.432 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-11T23:05:49.464 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-11T23:05:49.516 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-11T23:05:49.548 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-11T23:05:49.577 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-11T23:05:49.645 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-11T23:05:49.699 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-11T23:05:49.716 INFO:teuthology.orchestra.run.smithi160.stdout:(89/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 200 kB/s | 159 kB 00:00 2024-09-11T23:05:49.729 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-11T23:05:49.764 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-11T23:05:49.841 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-11T23:05:49.875 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 34/164 2024-09-11T23:05:49.910 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 35/164 2024-09-11T23:05:49.916 INFO:teuthology.orchestra.run.smithi160.stdout:(90/156): python3-pyasn1-modules-0.4.8-6.el9.no 331 kB/s | 279 kB 00:00 2024-09-11T23:05:49.939 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 36/164 2024-09-11T23:05:49.958 INFO:teuthology.orchestra.run.smithi160.stdout:(91/156): python3-pytz-2021.1-5.el9.noarch.rpm 82 kB/s | 51 kB 00:00 2024-09-11T23:05:50.008 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-11T23:05:50.054 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-11T23:05:50.127 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-11T23:05:50.261 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-11T23:05:50.314 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-11T23:05:50.392 INFO:teuthology.orchestra.run.smithi160.stdout:(92/156): python3-requests-oauthlib-1.3.0-12.el 79 kB/s | 54 kB 00:00 2024-09-11T23:05:50.617 INFO:teuthology.orchestra.run.smithi160.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 64 kB/s | 42 kB 00:00 2024-09-11T23:05:50.836 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-11T23:05:50.917 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-11T23:05:50.947 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-11T23:05:50.984 INFO:teuthology.orchestra.run.smithi160.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 75 kB/s | 44 kB 00:00 2024-09-11T23:05:50.990 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-11T23:05:51.027 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 46/164 2024-09-11T23:05:51.077 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-11T23:05:51.239 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-11T23:05:51.297 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-11T23:05:51.352 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-11T23:05:51.367 INFO:teuthology.orchestra.run.smithi160.stdout:(95/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 11 MB/s | 16 MB 00:01 2024-09-11T23:05:51.401 INFO:teuthology.orchestra.run.smithi160.stdout:(96/156): qatlib-24.02.0-1.el9.x86_64.rpm 282 kB/s | 221 kB 00:00 2024-09-11T23:05:51.424 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-11T23:05:51.456 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-11T23:05:51.492 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-11T23:05:51.539 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-11T23:05:51.575 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-11T23:05:51.618 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-11T23:05:51.660 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-11T23:05:51.751 INFO:teuthology.orchestra.run.smithi160.stdout:(97/156): qatlib-service-24.02.0-1.el9.x86_64.r 47 kB/s | 36 kB 00:00 2024-09-11T23:05:51.795 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-11T23:05:51.837 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-11T23:05:51.878 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-11T23:05:51.979 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-11T23:05:52.020 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-11T23:05:52.027 INFO:teuthology.orchestra.run.smithi160.stdout:(98/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 73 kB/s | 47 kB 00:00 2024-09-11T23:05:52.059 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-11T23:05:52.085 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-09-11T23:05:52.118 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-11T23:05:52.193 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-11T23:05:52.244 INFO:teuthology.orchestra.run.smithi160.stdout:(99/156): socat-1.7.4.1-6.el9.x86_64.rpm 361 kB/s | 304 kB 00:00 2024-09-11T23:05:52.377 INFO:teuthology.orchestra.run.smithi160.stdout:(100/156): uuid-1.6.2-55.el9.x86_64.rpm 92 kB/s | 58 kB 00:00 2024-09-11T23:05:52.530 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-11T23:05:52.592 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-11T23:05:52.620 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-11T23:05:52.654 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-11T23:05:52.693 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-11T23:05:52.727 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-11T23:05:52.757 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-11T23:05:52.786 INFO:teuthology.orchestra.run.smithi160.stdout:(101/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 126 kB/s | 96 kB 00:00 2024-09-11T23:05:52.791 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-11T23:05:52.825 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-11T23:05:52.866 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-11T23:05:52.869 INFO:teuthology.orchestra.run.smithi160.stdout:(102/156): lua-devel-5.4.4-4.el9.x86_64.rpm 269 kB/s | 22 kB 00:00 2024-09-11T23:05:52.900 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-11T23:05:52.911 INFO:teuthology.orchestra.run.smithi160.stdout:(103/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 95 kB/s | 64 kB 00:00 2024-09-11T23:05:52.945 INFO:teuthology.orchestra.run.smithi160.stdout:(104/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 79 kB/s | 45 kB 00:00 2024-09-11T23:05:52.986 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-11T23:05:52.995 INFO:teuthology.orchestra.run.smithi160.stdout:(105/156): abseil-cpp-20211102.0-3.el9.x86_64.r 6.4 MB/s | 548 kB 00:00 2024-09-11T23:05:53.029 INFO:teuthology.orchestra.run.smithi160.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 586 kB/s | 19 kB 00:00 2024-09-11T23:05:53.038 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-11T23:05:53.054 INFO:teuthology.orchestra.run.smithi160.stdout:(107/156): gperftools-libs-2.9.1-2.el9.x86_64.r 2.8 MB/s | 309 kB 00:00 2024-09-11T23:05:53.070 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-11T23:05:53.079 INFO:teuthology.orchestra.run.smithi160.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-11T23:05:53.104 INFO:teuthology.orchestra.run.smithi160.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-11T23:05:53.130 INFO:teuthology.orchestra.run.smithi160.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-11T23:05:53.155 INFO:teuthology.orchestra.run.smithi160.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 6.0 MB/s | 151 kB 00:00 2024-09-11T23:05:53.173 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-11T23:05:53.197 INFO:teuthology.orchestra.run.smithi160.stdout:(112/156): protobuf-compiler-3.14.0-13.el9.x86_ 2.6 MB/s | 863 kB 00:00 2024-09-11T23:05:53.229 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-11T23:05:53.239 INFO:teuthology.orchestra.run.smithi160.stdout:(113/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 9.8 MB/s | 839 kB 00:00 2024-09-11T23:05:53.255 INFO:teuthology.orchestra.run.smithi160.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 2.9 MB/s | 43 kB 00:00 2024-09-11T23:05:53.272 INFO:teuthology.orchestra.run.smithi160.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.9 MB/s | 32 kB 00:00 2024-09-11T23:05:53.289 INFO:teuthology.orchestra.run.smithi160.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 851 kB/s | 14 kB 00:00 2024-09-11T23:05:53.315 INFO:teuthology.orchestra.run.smithi160.stdout:(117/156): python3-cheroot-8.6.0-4.el9.noarch.r 6.7 MB/s | 172 kB 00:00 2024-09-11T23:05:53.340 INFO:teuthology.orchestra.run.smithi160.stdout:(118/156): python3-asyncssh-2.13.2-5.el9.noarch 3.7 MB/s | 548 kB 00:00 2024-09-11T23:05:53.374 INFO:teuthology.orchestra.run.smithi160.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-11T23:05:53.399 INFO:teuthology.orchestra.run.smithi160.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-09-11T23:05:53.424 INFO:teuthology.orchestra.run.smithi160.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-11T23:05:53.441 INFO:teuthology.orchestra.run.smithi160.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 8.5 MB/s | 144 kB 00:00 2024-09-11T23:05:53.466 INFO:teuthology.orchestra.run.smithi160.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 428 kB/s | 11 kB 00:00 2024-09-11T23:05:53.492 INFO:teuthology.orchestra.run.smithi160.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 712 kB/s | 18 kB 00:00 2024-09-11T23:05:53.517 INFO:teuthology.orchestra.run.smithi160.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 927 kB/s | 23 kB 00:00 2024-09-11T23:05:53.584 INFO:teuthology.orchestra.run.smithi160.stdout:(126/156): libarrow-9.0.0-11.el9.x86_64.rpm 8.0 MB/s | 4.4 MB 00:00 2024-09-11T23:05:53.609 INFO:teuthology.orchestra.run.smithi160.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 212 kB/s | 19 kB 00:00 2024-09-11T23:05:53.634 INFO:teuthology.orchestra.run.smithi160.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 394 kB/s | 20 kB 00:00 2024-09-11T23:05:53.660 INFO:teuthology.orchestra.run.smithi160.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-11T23:05:53.685 INFO:teuthology.orchestra.run.smithi160.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-11T23:05:53.710 INFO:teuthology.orchestra.run.smithi160.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-11T23:05:53.744 INFO:teuthology.orchestra.run.smithi160.stdout:(132/156): python3-kubernetes-26.1.0-2.el9.noar 7.6 MB/s | 1.0 MB 00:00 2024-09-11T23:05:53.769 INFO:teuthology.orchestra.run.smithi160.stdout:(133/156): python3-pecan-1.4.2-3.el9.noarch.rpm 4.5 MB/s | 272 kB 00:00 2024-09-11T23:05:53.811 INFO:teuthology.orchestra.run.smithi160.stdout:(134/156): python3-grpcio-1.46.7-10.el9.x86_64. 4.9 MB/s | 2.0 MB 00:00 2024-09-11T23:05:53.836 INFO:teuthology.orchestra.run.smithi160.stdout:(135/156): python3-portend-3.1.0-2.el9.noarch.r 178 kB/s | 16 kB 00:00 2024-09-11T23:05:53.862 INFO:teuthology.orchestra.run.smithi160.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 563 kB/s | 28 kB 00:00 2024-09-11T23:05:53.887 INFO:teuthology.orchestra.run.smithi160.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 613 kB/s | 31 kB 00:00 2024-09-11T23:05:53.912 INFO:teuthology.orchestra.run.smithi160.stdout:(138/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 631 kB/s | 90 kB 00:00 2024-09-11T23:05:53.937 INFO:teuthology.orchestra.run.smithi160.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-09-11T23:05:53.949 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-11T23:05:53.963 INFO:teuthology.orchestra.run.smithi160.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 712 kB/s | 36 kB 00:00 2024-09-11T23:05:53.988 INFO:teuthology.orchestra.run.smithi160.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-11T23:05:53.993 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-11T23:05:54.013 INFO:teuthology.orchestra.run.smithi160.stdout:(142/156): python3-routes-2.5.1-5.el9.noarch.rp 1.2 MB/s | 188 kB 00:00 2024-09-11T23:05:54.026 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-11T23:05:54.038 INFO:teuthology.orchestra.run.smithi160.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.8 MB/s | 90 kB 00:00 2024-09-11T23:05:54.064 INFO:teuthology.orchestra.run.smithi160.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 801 kB/s | 20 kB 00:00 2024-09-11T23:05:54.089 INFO:teuthology.orchestra.run.smithi160.stdout:(145/156): python3-webob-1.8.8-2.el9.noarch.rpm 1.8 MB/s | 230 kB 00:00 2024-09-11T23:05:54.114 INFO:teuthology.orchestra.run.smithi160.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-11T23:05:54.125 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-11T23:05:54.139 INFO:teuthology.orchestra.run.smithi160.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-11T23:05:54.182 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-11T23:05:54.190 INFO:teuthology.orchestra.run.smithi160.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-11T23:05:54.234 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-11T23:05:54.298 INFO:teuthology.orchestra.run.smithi160.stdout:(149/156): NetworkManager-1.49.90-1.el9.x86_64. 21 MB/s | 2.3 MB 00:00 2024-09-11T23:05:54.315 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-11T23:05:54.346 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-11T23:05:54.390 INFO:teuthology.orchestra.run.smithi160.stdout:(150/156): NetworkManager-libnm-1.49.90-1.el9.x 20 MB/s | 1.8 MB 00:00 2024-09-11T23:05:54.461 INFO:teuthology.orchestra.run.smithi160.stdout:(151/156): NetworkManager-team-1.49.90-1.el9.x8 612 kB/s | 41 kB 00:00 2024-09-11T23:05:54.522 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-11T23:05:54.533 INFO:teuthology.orchestra.run.smithi160.stdout:(152/156): NetworkManager-tui-1.49.90-1.el9.x86 3.3 MB/s | 249 kB 00:00 2024-09-11T23:05:54.545 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-11T23:05:54.583 INFO:teuthology.orchestra.run.smithi160.stdout:(153/156): librbd1-19.1.1-298.gb53b6d3e.el9.x86 7.1 MB/s | 3.2 MB 00:00 2024-09-11T23:05:54.621 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-11T23:05:54.642 INFO:teuthology.orchestra.run.smithi160.stdout:(154/156): librados2-19.1.1-298.gb53b6d3e.el9.x 6.5 MB/s | 3.4 MB 00:00 2024-09-11T23:05:54.684 INFO:teuthology.orchestra.run.smithi160.stdout:(155/156): openssl-3.2.2-6.el9.x86_64.rpm 9.0 MB/s | 1.4 MB 00:00 2024-09-11T23:05:54.750 INFO:teuthology.orchestra.run.smithi160.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 14 MB/s | 2.4 MB 00:00 2024-09-11T23:05:54.757 INFO:teuthology.orchestra.run.smithi160.stdout:-------------------------------------------------------------------------------- 2024-09-11T23:05:54.757 INFO:teuthology.orchestra.run.smithi160.stdout:Total 8.2 MB/s | 226 MB 00:27 2024-09-11T23:05:55.263 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-11T23:05:55.383 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-11T23:05:55.974 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction check 2024-09-11T23:05:56.095 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2024-09-11T23:05:56.127 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction check succeeded. 2024-09-11T23:05:56.127 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction test 2024-09-11T23:05:56.269 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-11T23:05:56.320 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-11T23:05:56.394 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-11T23:05:56.438 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-11T23:05:56.486 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-11T23:05:56.549 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-11T23:05:56.578 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-11T23:05:56.663 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-11T23:05:56.691 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-11T23:05:56.724 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-11T23:05:56.944 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-11T23:05:57.033 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-11T23:05:57.061 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-11T23:05:57.070 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-11T23:05:57.169 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-11T23:05:57.200 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 102/164 2024-09-11T23:05:57.236 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-11T23:05:57.369 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-11T23:05:57.404 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-11T23:05:57.510 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-11T23:05:57.543 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-11T23:05:57.713 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-11T23:05:57.756 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-11T23:05:57.769 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-11T23:05:57.832 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-11T23:05:57.858 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-11T23:05:57.894 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-11T23:05:57.924 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction test succeeded. 2024-09-11T23:05:57.924 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction 2024-09-11T23:05:57.958 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 106/164 2024-09-11T23:05:58.012 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-11T23:05:58.042 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-11T23:05:58.165 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-11T23:05:58.193 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-11T23:05:58.236 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-11T23:05:58.604 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-11T23:05:58.789 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-11T23:05:58.968 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-11T23:05:59.109 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-11T23:05:59.218 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-11T23:05:59.512 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-11T23:05:59.657 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-11T23:05:59.783 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-11T23:05:59.833 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-11T23:05:59.878 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-11T23:05:59.973 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-11T23:06:00.040 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-11T23:06:00.078 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-11T23:06:00.132 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-11T23:06:00.179 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-11T23:06:00.212 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-11T23:06:00.227 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-11T23:06:00.265 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-11T23:06:00.306 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-11T23:06:00.374 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-11T23:06:00.408 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-11T23:06:00.455 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-11T23:06:00.546 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-11T23:06:00.578 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 34/164 2024-09-11T23:06:00.622 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 35/164 2024-09-11T23:06:00.650 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 36/164 2024-09-11T23:06:00.745 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-11T23:06:00.803 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-11T23:06:00.809 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-11T23:06:00.849 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-11T23:06:00.898 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-11T23:06:00.932 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-11T23:06:00.933 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-11T23:06:00.933 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-11T23:06:00.933 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-11T23:06:00.967 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-11T23:06:01.071 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-11T23:06:01.140 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-11T23:06:01.813 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-11T23:06:02.076 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-11T23:06:02.117 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-11T23:06:02.160 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-11T23:06:02.199 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 46/164 2024-09-11T23:06:02.269 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-11T23:06:02.468 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-11T23:06:02.530 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-11T23:06:02.600 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-11T23:06:02.687 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-11T23:06:02.725 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-11T23:06:02.759 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-11T23:06:02.819 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-11T23:06:02.857 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-11T23:06:02.905 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-11T23:06:02.954 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-11T23:06:03.134 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-11T23:06:03.202 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-11T23:06:03.247 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-11T23:06:03.371 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-11T23:06:03.411 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-11T23:06:03.461 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-11T23:06:03.500 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-09-11T23:06:03.524 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-11T23:06:03.639 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-11T23:06:03.799 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-11T23:06:03.882 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-11T23:06:03.919 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-11T23:06:03.968 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-11T23:06:04.011 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-11T23:06:04.050 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-11T23:06:04.087 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-11T23:06:04.121 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-11T23:06:04.171 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-11T23:06:04.189 INFO:teuthology.orchestra.run.smithi160.stdout: Preparing : 1/1 2024-09-11T23:06:04.223 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-11T23:06:04.255 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-11T23:06:04.293 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-11T23:06:04.334 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-11T23:06:04.358 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-11T23:06:04.388 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-11T23:06:04.414 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-11T23:06:04.421 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-11T23:06:04.447 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-11T23:06:04.459 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-11T23:06:04.489 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-11T23:06:04.586 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-11T23:06:04.657 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-11T23:06:04.818 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-11T23:06:04.931 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-11T23:06:05.052 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-11T23:06:05.082 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-11T23:06:05.173 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-11T23:06:05.203 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-11T23:06:05.350 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-11T23:06:05.407 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-11T23:06:05.436 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-11T23:06:05.539 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-11T23:06:05.562 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-11T23:06:05.590 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-11T23:06:05.624 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-11T23:06:05.646 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-11T23:06:05.648 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-11T23:06:05.667 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-11T23:06:05.682 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-11T23:06:05.802 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-11T23:06:05.813 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-11T23:06:05.866 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-11T23:06:05.919 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-11T23:06:05.943 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-11T23:06:06.027 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-11T23:06:06.061 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-11T23:06:06.104 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-11T23:06:06.152 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-11T23:06:06.220 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-11T23:06:06.356 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-11T23:06:06.401 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-11T23:06:06.444 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-11T23:06:06.503 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-11T23:06:06.551 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-11T23:06:06.644 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-11T23:06:06.675 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-11T23:06:06.718 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-11T23:06:06.783 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-11T23:06:06.826 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-11T23:06:06.859 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-11T23:06:06.903 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-11T23:06:06.935 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-11T23:06:06.963 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-11T23:06:07.031 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-11T23:06:07.085 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-11T23:06:07.116 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-11T23:06:07.154 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-11T23:06:07.230 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-11T23:06:07.265 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 34/164 2024-09-11T23:06:07.300 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 35/164 2024-09-11T23:06:07.329 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 36/164 2024-09-11T23:06:07.358 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-11T23:06:07.397 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-11T23:06:07.443 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-11T23:06:07.500 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-11T23:06:07.517 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-11T23:06:07.648 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-11T23:06:07.695 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-11T23:06:08.223 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-11T23:06:08.307 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-11T23:06:08.337 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-11T23:06:08.371 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-11T23:06:08.409 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 46/164 2024-09-11T23:06:08.454 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-11T23:06:08.611 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-11T23:06:08.662 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-11T23:06:08.716 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-11T23:06:08.789 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-11T23:06:08.821 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-11T23:06:08.857 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-11T23:06:08.930 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-11T23:06:08.965 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-11T23:06:09.007 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-11T23:06:09.050 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-11T23:06:09.155 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-11T23:06:09.194 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-11T23:06:09.235 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-11T23:06:09.244 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-11T23:06:09.273 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-11T23:06:09.276 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-11T23:06:09.305 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-11T23:06:09.379 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-11T23:06:09.410 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-11T23:06:09.450 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-11T23:06:09.475 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-09-11T23:06:09.508 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-11T23:06:09.583 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-11T23:06:09.668 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-11T23:06:09.710 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-11T23:06:09.716 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-11T23:06:09.749 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-11T23:06:09.776 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-11T23:06:09.810 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-11T23:06:09.830 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-11T23:06:09.849 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-11T23:06:09.864 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 102/164 2024-09-11T23:06:09.881 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-11T23:06:09.911 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-11T23:06:09.935 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-11T23:06:09.951 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-11T23:06:09.979 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-11T23:06:10.013 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-11T23:06:10.046 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-11T23:06:10.133 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-11T23:06:10.176 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-11T23:06:10.208 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-11T23:06:10.319 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-11T23:06:10.367 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-11T23:06:10.481 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-11T23:06:10.519 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-11T23:06:10.602 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-11T23:06:10.630 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 106/164 2024-09-11T23:06:11.096 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-11T23:06:11.139 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-11T23:06:11.173 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-11T23:06:11.271 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-11T23:06:11.319 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-11T23:06:11.364 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-11T23:06:11.451 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-11T23:06:11.485 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-11T23:06:11.665 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-11T23:06:11.691 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-11T23:06:11.770 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-11T23:06:12.413 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-11T23:06:12.539 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-11T23:06:12.821 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-11T23:06:12.821 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /sys 2024-09-11T23:06:12.821 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /proc 2024-09-11T23:06:12.821 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /mnt 2024-09-11T23:06:12.821 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /var/tmp 2024-09-11T23:06:12.821 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /home 2024-09-11T23:06:12.821 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /root 2024-09-11T23:06:12.822 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /tmp 2024-09-11T23:06:12.822 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-11T23:06:12.994 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-11T23:06:13.010 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-11T23:06:13.011 INFO:teuthology.orchestra.run.smithi123.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:06:13.011 INFO:teuthology.orchestra.run.smithi123.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-11T23:06:13.011 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-11T23:06:13.456 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-11T23:06:13.493 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-11T23:06:13.770 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-11T23:06:13.861 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-11T23:06:13.888 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-11T23:06:13.922 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-11T23:06:14.160 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-11T23:06:14.204 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-11T23:06:14.232 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-11T23:06:14.276 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-11T23:06:14.367 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-11T23:06:14.382 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-11T23:06:14.382 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-11T23:06:14.382 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-11T23:06:14.382 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:06:14.398 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 102/164 2024-09-11T23:06:14.422 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-11T23:06:14.443 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-11T23:06:14.496 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-11T23:06:14.524 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-11T23:06:14.524 INFO:teuthology.orchestra.run.smithi123.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:06:14.524 INFO:teuthology.orchestra.run.smithi123.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-11T23:06:14.524 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T23:06:14.524 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T23:06:14.524 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-11T23:06:14.747 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-11T23:06:14.770 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-11T23:06:14.771 INFO:teuthology.orchestra.run.smithi123.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:06:14.771 INFO:teuthology.orchestra.run.smithi123.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-11T23:06:14.771 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T23:06:14.771 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T23:06:14.771 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-11T23:06:14.922 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-11T23:06:14.954 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-11T23:06:15.042 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-11T23:06:15.072 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 106/164 2024-09-11T23:06:15.206 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-11T23:06:15.229 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-11T23:06:15.230 INFO:teuthology.orchestra.run.smithi123.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:06:15.230 INFO:teuthology.orchestra.run.smithi123.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-11T23:06:15.230 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T23:06:15.230 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T23:06:15.230 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-11T23:06:15.327 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-11T23:06:15.376 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-11T23:06:15.430 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-11T23:06:15.625 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-11T23:06:15.673 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-11T23:06:15.743 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-11T23:06:15.832 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-11T23:06:15.970 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-11T23:06:16.015 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-11T23:06:16.047 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-11T23:06:16.074 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-11T23:06:16.542 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-11T23:06:16.573 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-11T23:06:16.604 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 126/164 2024-09-11T23:06:16.666 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 127/164 2024-09-11T23:06:16.696 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-11T23:06:17.320 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-11T23:06:17.352 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-11T23:06:17.737 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-11T23:06:17.772 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-11T23:06:17.928 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-11T23:06:17.964 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-11T23:06:18.062 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-11T23:06:18.062 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-11T23:06:18.062 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-11T23:06:18.062 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-11T23:06:18.121 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-11T23:06:18.738 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-11T23:06:18.764 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-11T23:06:18.867 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-11T23:06:19.035 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 131/164 2024-09-11T23:06:19.067 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-11T23:06:19.091 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-11T23:06:19.091 INFO:teuthology.orchestra.run.smithi123.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:06:19.091 INFO:teuthology.orchestra.run.smithi123.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-11T23:06:19.091 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T23:06:19.091 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T23:06:19.091 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-11T23:06:19.134 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-11T23:06:19.145 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-11T23:06:19.250 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 134/164 2024-09-11T23:06:19.298 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 135/164 2024-09-11T23:06:20.219 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-11T23:06:20.253 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-11T23:06:20.277 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-11T23:06:20.277 INFO:teuthology.orchestra.run.smithi123.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:06:20.277 INFO:teuthology.orchestra.run.smithi123.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-11T23:06:20.277 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T23:06:20.277 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T23:06:20.277 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-11T23:06:20.320 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-11T23:06:20.343 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-11T23:06:20.344 INFO:teuthology.orchestra.run.smithi123.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:06:20.344 INFO:teuthology.orchestra.run.smithi123.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-11T23:06:20.344 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-11T23:06:20.388 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-11T23:06:20.411 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-11T23:06:20.411 INFO:teuthology.orchestra.run.smithi123.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:06:20.411 INFO:teuthology.orchestra.run.smithi123.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-11T23:06:20.411 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-11T23:06:20.412 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-11T23:06:20.412 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-11T23:06:20.722 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-11T23:06:20.745 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-11T23:06:20.746 INFO:teuthology.orchestra.run.smithi123.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:06:20.746 INFO:teuthology.orchestra.run.smithi123.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-11T23:06:20.746 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T23:06:20.746 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T23:06:20.746 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-11T23:06:25.267 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 141/164 2024-09-11T23:06:25.308 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 142/164 2024-09-11T23:06:25.348 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 143/164 2024-09-11T23:06:25.381 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-11T23:06:25.408 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-11T23:06:25.587 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 146/164 2024-09-11T23:06:25.638 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-11T23:06:25.668 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 148/164 2024-09-11T23:06:25.698 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-11T23:06:25.744 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-11T23:06:26.304 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-11T23:06:26.350 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-11T23:06:26.371 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-11T23:06:27.198 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 152/164 2024-09-11T23:06:27.288 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-11T23:06:27.328 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-11T23:06:27.409 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-11T23:06:27.441 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-11T23:06:27.466 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-11T23:06:27.500 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-11T23:06:27.501 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-11T23:06:27.585 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-11T23:06:27.585 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-11T23:06:27.611 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-11T23:06:27.611 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /sys 2024-09-11T23:06:27.611 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /proc 2024-09-11T23:06:27.611 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /mnt 2024-09-11T23:06:27.611 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /var/tmp 2024-09-11T23:06:27.611 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /home 2024-09-11T23:06:27.611 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /root 2024-09-11T23:06:27.611 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /tmp 2024-09-11T23:06:27.611 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:06:27.652 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-11T23:06:27.677 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-11T23:06:27.682 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-11T23:06:27.682 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-11T23:06:27.823 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-11T23:06:27.860 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-11T23:06:27.861 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:06:27.861 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-11T23:06:27.861 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:06:27.862 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-11T23:06:27.862 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-11T23:06:27.938 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-11T23:06:28.009 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-11T23:06:29.527 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-11T23:06:29.587 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-11T23:06:29.587 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:06:29.587 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-11T23:06:29.587 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T23:06:29.587 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T23:06:29.587 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:06:29.845 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-11T23:06:29.896 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-11T23:06:29.896 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:06:29.896 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-11T23:06:29.896 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T23:06:29.896 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T23:06:29.896 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:06:29.902 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-11T23:06:29.902 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /sys 2024-09-11T23:06:29.902 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /proc 2024-09-11T23:06:29.902 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /mnt 2024-09-11T23:06:29.902 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /var/tmp 2024-09-11T23:06:29.902 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /home 2024-09-11T23:06:29.902 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /root 2024-09-11T23:06:29.903 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /tmp 2024-09-11T23:06:29.903 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-11T23:06:30.067 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-11T23:06:30.084 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-11T23:06:30.084 INFO:teuthology.orchestra.run.smithi160.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:06:30.084 INFO:teuthology.orchestra.run.smithi160.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-11T23:06:30.084 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-11T23:06:30.404 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-11T23:06:30.455 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-11T23:06:30.455 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:06:30.456 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-11T23:06:30.456 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T23:06:30.456 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T23:06:30.456 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:06:30.597 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-11T23:06:30.658 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-11T23:06:30.731 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-11T23:06:30.978 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-11T23:06:31.058 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-11T23:06:31.149 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-11T23:06:31.260 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-11T23:06:31.438 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-11T23:06:31.498 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-11T23:06:31.539 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-11T23:06:31.564 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-11T23:06:31.570 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-11T23:06:31.598 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-11T23:06:31.598 INFO:teuthology.orchestra.run.smithi160.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:06:31.598 INFO:teuthology.orchestra.run.smithi160.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-11T23:06:31.598 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T23:06:31.598 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T23:06:31.598 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-11T23:06:31.829 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-11T23:06:31.853 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-11T23:06:31.853 INFO:teuthology.orchestra.run.smithi160.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:06:31.853 INFO:teuthology.orchestra.run.smithi160.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-11T23:06:31.853 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T23:06:31.853 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T23:06:31.853 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-11T23:06:32.177 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-11T23:06:32.205 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-11T23:06:32.247 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 126/164 2024-09-11T23:06:32.288 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-11T23:06:32.312 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-11T23:06:32.312 INFO:teuthology.orchestra.run.smithi160.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:06:32.312 INFO:teuthology.orchestra.run.smithi160.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-11T23:06:32.312 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T23:06:32.312 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T23:06:32.312 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-11T23:06:32.327 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 127/164 2024-09-11T23:06:32.361 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-11T23:06:32.421 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-11T23:06:32.475 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-11T23:06:32.530 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-11T23:06:32.714 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-11T23:06:32.763 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-11T23:06:32.840 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-11T23:06:32.928 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-11T23:06:33.060 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-11T23:06:33.105 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-11T23:06:33.137 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-11T23:06:33.165 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-11T23:06:33.548 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-11T23:06:33.580 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-11T23:06:33.612 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 126/164 2024-09-11T23:06:33.631 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-11T23:06:33.631 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/164 2024-09-11T23:06:33.631 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2/164 2024-09-11T23:06:33.631 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 3/164 2024-09-11T23:06:33.631 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 4/164 2024-09-11T23:06:33.631 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 5/164 2024-09-11T23:06:33.631 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 6/164 2024-09-11T23:06:33.631 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 7/164 2024-09-11T23:06:33.631 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-11T23:06:33.631 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-11T23:06:33.632 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-11T23:06:33.632 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 11/164 2024-09-11T23:06:33.632 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 12/164 2024-09-11T23:06:33.632 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-11T23:06:33.632 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 14/164 2024-09-11T23:06:33.632 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 15/164 2024-09-11T23:06:33.632 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 16/164 2024-09-11T23:06:33.632 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 17/164 2024-09-11T23:06:33.632 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 18/164 2024-09-11T23:06:33.632 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 19/164 2024-09-11T23:06:33.632 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 20/164 2024-09-11T23:06:33.632 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 21/164 2024-09-11T23:06:33.633 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 22/164 2024-09-11T23:06:33.633 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 23/164 2024-09-11T23:06:33.633 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 24/164 2024-09-11T23:06:33.633 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 25/164 2024-09-11T23:06:33.633 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 26/164 2024-09-11T23:06:33.633 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 27/164 2024-09-11T23:06:33.649 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 28/164 2024-09-11T23:06:33.649 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 29/164 2024-09-11T23:06:33.649 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 30/164 2024-09-11T23:06:33.650 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 31/164 2024-09-11T23:06:33.650 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 32/164 2024-09-11T23:06:33.650 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 33/164 2024-09-11T23:06:33.650 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 34/164 2024-09-11T23:06:33.650 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 35/164 2024-09-11T23:06:33.650 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 36/164 2024-09-11T23:06:33.650 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 37/164 2024-09-11T23:06:33.650 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 38/164 2024-09-11T23:06:33.650 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 39/164 2024-09-11T23:06:33.650 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-11T23:06:33.650 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-11T23:06:33.650 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-11T23:06:33.651 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-11T23:06:33.651 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-11T23:06:33.651 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-11T23:06:33.651 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-11T23:06:33.651 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-11T23:06:33.651 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-11T23:06:33.651 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-11T23:06:33.651 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-11T23:06:33.651 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-11T23:06:33.651 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-11T23:06:33.651 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-11T23:06:33.651 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-11T23:06:33.652 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-11T23:06:33.652 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-11T23:06:33.652 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-11T23:06:33.652 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-11T23:06:33.652 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-11T23:06:33.652 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-11T23:06:33.652 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-11T23:06:33.652 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-11T23:06:33.652 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-11T23:06:33.652 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-11T23:06:33.652 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-11T23:06:33.652 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-11T23:06:33.653 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-11T23:06:33.653 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-11T23:06:33.653 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-11T23:06:33.653 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-11T23:06:33.653 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-11T23:06:33.653 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-11T23:06:33.653 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-11T23:06:33.653 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-11T23:06:33.653 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-11T23:06:33.653 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-11T23:06:33.653 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-11T23:06:33.653 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-11T23:06:33.653 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-11T23:06:33.654 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-11T23:06:33.654 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-11T23:06:33.654 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-11T23:06:33.654 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-11T23:06:33.654 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-11T23:06:33.654 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-11T23:06:33.654 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-11T23:06:33.654 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-11T23:06:33.654 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-11T23:06:33.654 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-11T23:06:33.654 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-11T23:06:33.654 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-11T23:06:33.654 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-11T23:06:33.655 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-11T23:06:33.655 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-11T23:06:33.655 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-11T23:06:33.655 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-11T23:06:33.655 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-11T23:06:33.655 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-11T23:06:33.655 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-11T23:06:33.655 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-11T23:06:33.655 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-11T23:06:33.655 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-11T23:06:33.655 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-11T23:06:33.655 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-11T23:06:33.655 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-11T23:06:33.656 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-11T23:06:33.656 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/164 2024-09-11T23:06:33.656 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-11T23:06:33.656 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-11T23:06:33.656 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-11T23:06:33.656 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-11T23:06:33.656 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-11T23:06:33.656 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-11T23:06:33.656 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-11T23:06:33.656 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-11T23:06:33.656 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-11T23:06:33.656 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-11T23:06:33.656 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-11T23:06:33.657 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-11T23:06:33.657 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-11T23:06:33.657 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-11T23:06:33.657 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-11T23:06:33.657 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-11T23:06:33.657 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-11T23:06:33.657 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-11T23:06:33.657 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-11T23:06:33.657 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-11T23:06:33.657 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-11T23:06:33.657 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-11T23:06:33.657 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-11T23:06:33.657 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-11T23:06:33.658 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-11T23:06:33.658 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-11T23:06:33.658 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-11T23:06:33.658 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-11T23:06:33.658 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-11T23:06:33.658 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-11T23:06:33.658 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-11T23:06:33.658 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-11T23:06:33.658 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-11T23:06:33.658 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-11T23:06:33.658 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-11T23:06:33.658 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-11T23:06:33.658 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-11T23:06:33.658 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-11T23:06:33.658 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-11T23:06:33.659 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-11T23:06:33.659 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-11T23:06:33.659 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 149/164 2024-09-11T23:06:33.659 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-11T23:06:33.659 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 151/164 2024-09-11T23:06:33.659 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-11T23:06:33.659 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-11T23:06:33.659 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-11T23:06:33.659 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-11T23:06:33.659 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-11T23:06:33.659 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-11T23:06:33.659 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-11T23:06:33.659 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-11T23:06:33.660 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-11T23:06:33.660 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-11T23:06:33.660 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-11T23:06:33.660 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-11T23:06:33.660 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-11T23:06:33.674 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 127/164 2024-09-11T23:06:33.703 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-11T23:06:33.713 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-11T23:06:34.750 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-11T23:06:34.788 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-11T23:06:34.867 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-11T23:06:34.896 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-11T23:06:35.042 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-11T23:06:35.227 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 131/164 2024-09-11T23:06:35.256 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-11T23:06:35.308 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-11T23:06:35.309 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:06:35.309 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-11T23:06:35.309 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T23:06:35.309 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T23:06:35.309 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:06:35.366 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-11T23:06:35.392 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-11T23:06:35.503 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 134/164 2024-09-11T23:06:35.588 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 135/164 2024-09-11T23:06:35.757 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-11T23:06:35.780 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-11T23:06:35.882 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-11T23:06:36.035 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 131/164 2024-09-11T23:06:36.066 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-11T23:06:36.091 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-11T23:06:36.091 INFO:teuthology.orchestra.run.smithi160.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:06:36.091 INFO:teuthology.orchestra.run.smithi160.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-11T23:06:36.091 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T23:06:36.091 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T23:06:36.091 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-11T23:06:36.141 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-11T23:06:36.153 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-11T23:06:36.250 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 134/164 2024-09-11T23:06:36.306 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 135/164 2024-09-11T23:06:36.444 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-11T23:06:36.444 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-11T23:06:36.444 INFO:teuthology.orchestra.run.smithi123.stdout:Upgraded: 2024-09-11T23:06:36.444 INFO:teuthology.orchestra.run.smithi123.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-11T23:06:36.445 INFO:teuthology.orchestra.run.smithi123.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-11T23:06:36.445 INFO:teuthology.orchestra.run.smithi123.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-11T23:06:36.445 INFO:teuthology.orchestra.run.smithi123.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-11T23:06:36.445 INFO:teuthology.orchestra.run.smithi123.stdout: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:06:36.445 INFO:teuthology.orchestra.run.smithi123.stdout: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:06:36.445 INFO:teuthology.orchestra.run.smithi123.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-11T23:06:36.445 INFO:teuthology.orchestra.run.smithi123.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-11T23:06:36.445 INFO:teuthology.orchestra.run.smithi123.stdout:Installed: 2024-09-11T23:06:36.445 INFO:teuthology.orchestra.run.smithi123.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-11T23:06:36.445 INFO:teuthology.orchestra.run.smithi123.stdout: automake-1.16.2-8.el9.noarch 2024-09-11T23:06:36.445 INFO:teuthology.orchestra.run.smithi123.stdout: bison-3.7.4-5.el9.x86_64 2024-09-11T23:06:36.445 INFO:teuthology.orchestra.run.smithi123.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-11T23:06:36.445 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:06:36.446 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:06:36.446 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:06:36.446 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:06:36.446 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:06:36.446 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:06:36.446 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:06:36.446 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:06:36.446 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:06:36.446 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:06:36.446 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:06:36.446 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:06:36.446 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:06:36.446 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:06:36.447 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:06:36.447 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:06:36.447 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:06:36.447 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:06:36.447 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:06:36.447 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:06:36.447 INFO:teuthology.orchestra.run.smithi123.stdout: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:06:36.447 INFO:teuthology.orchestra.run.smithi123.stdout: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:06:36.447 INFO:teuthology.orchestra.run.smithi123.stdout: cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:06:36.447 INFO:teuthology.orchestra.run.smithi123.stdout: cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:06:36.447 INFO:teuthology.orchestra.run.smithi123.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-11T23:06:36.447 INFO:teuthology.orchestra.run.smithi123.stdout: flex-2.6.4-9.el9.x86_64 2024-09-11T23:06:36.447 INFO:teuthology.orchestra.run.smithi123.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-11T23:06:36.447 INFO:teuthology.orchestra.run.smithi123.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-11T23:06:36.448 INFO:teuthology.orchestra.run.smithi123.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-11T23:06:36.448 INFO:teuthology.orchestra.run.smithi123.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-11T23:06:36.448 INFO:teuthology.orchestra.run.smithi123.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-11T23:06:36.448 INFO:teuthology.orchestra.run.smithi123.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-11T23:06:36.448 INFO:teuthology.orchestra.run.smithi123.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-11T23:06:36.448 INFO:teuthology.orchestra.run.smithi123.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-11T23:06:36.448 INFO:teuthology.orchestra.run.smithi123.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-11T23:06:36.448 INFO:teuthology.orchestra.run.smithi123.stdout: libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:06:36.448 INFO:teuthology.orchestra.run.smithi123.stdout: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:06:36.448 INFO:teuthology.orchestra.run.smithi123.stdout: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:06:36.448 INFO:teuthology.orchestra.run.smithi123.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-11T23:06:36.448 INFO:teuthology.orchestra.run.smithi123.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-11T23:06:36.449 INFO:teuthology.orchestra.run.smithi123.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-11T23:06:36.449 INFO:teuthology.orchestra.run.smithi123.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-11T23:06:36.449 INFO:teuthology.orchestra.run.smithi123.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-11T23:06:36.449 INFO:teuthology.orchestra.run.smithi123.stdout: librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:06:36.449 INFO:teuthology.orchestra.run.smithi123.stdout: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:06:36.449 INFO:teuthology.orchestra.run.smithi123.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-11T23:06:36.449 INFO:teuthology.orchestra.run.smithi123.stdout: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:06:36.449 INFO:teuthology.orchestra.run.smithi123.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-11T23:06:36.449 INFO:teuthology.orchestra.run.smithi123.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-11T23:06:36.449 INFO:teuthology.orchestra.run.smithi123.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-11T23:06:36.449 INFO:teuthology.orchestra.run.smithi123.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-11T23:06:36.449 INFO:teuthology.orchestra.run.smithi123.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-11T23:06:36.449 INFO:teuthology.orchestra.run.smithi123.stdout: lua-5.4.4-4.el9.x86_64 2024-09-11T23:06:36.449 INFO:teuthology.orchestra.run.smithi123.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-11T23:06:36.450 INFO:teuthology.orchestra.run.smithi123.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-11T23:06:36.450 INFO:teuthology.orchestra.run.smithi123.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-11T23:06:36.450 INFO:teuthology.orchestra.run.smithi123.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-11T23:06:36.450 INFO:teuthology.orchestra.run.smithi123.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-11T23:06:36.450 INFO:teuthology.orchestra.run.smithi123.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-11T23:06:36.450 INFO:teuthology.orchestra.run.smithi123.stdout: postgresql-13.16-1.el9.x86_64 2024-09-11T23:06:36.450 INFO:teuthology.orchestra.run.smithi123.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-11T23:06:36.450 INFO:teuthology.orchestra.run.smithi123.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-11T23:06:36.450 INFO:teuthology.orchestra.run.smithi123.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-11T23:06:36.450 INFO:teuthology.orchestra.run.smithi123.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-11T23:06:36.450 INFO:teuthology.orchestra.run.smithi123.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-11T23:06:36.450 INFO:teuthology.orchestra.run.smithi123.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-11T23:06:36.450 INFO:teuthology.orchestra.run.smithi123.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-11T23:06:36.450 INFO:teuthology.orchestra.run.smithi123.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-11T23:06:36.450 INFO:teuthology.orchestra.run.smithi123.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-11T23:06:36.451 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-11T23:06:36.451 INFO:teuthology.orchestra.run.smithi123.stdout: python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:06:36.451 INFO:teuthology.orchestra.run.smithi123.stdout: python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:06:36.451 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:06:36.451 INFO:teuthology.orchestra.run.smithi123.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-11T23:06:36.451 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-11T23:06:36.451 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-11T23:06:36.451 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-11T23:06:36.451 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-11T23:06:36.451 INFO:teuthology.orchestra.run.smithi123.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-11T23:06:36.451 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-11T23:06:36.451 INFO:teuthology.orchestra.run.smithi123.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-11T23:06:36.451 INFO:teuthology.orchestra.run.smithi123.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-11T23:06:36.452 INFO:teuthology.orchestra.run.smithi123.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-11T23:06:36.452 INFO:teuthology.orchestra.run.smithi123.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-11T23:06:36.452 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-11T23:06:36.452 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-11T23:06:36.452 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-11T23:06:36.452 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-11T23:06:36.452 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-11T23:06:36.452 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-11T23:06:36.452 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-11T23:06:36.452 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-11T23:06:36.452 INFO:teuthology.orchestra.run.smithi123.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-11T23:06:36.452 INFO:teuthology.orchestra.run.smithi123.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-11T23:06:36.452 INFO:teuthology.orchestra.run.smithi123.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-11T23:06:36.453 INFO:teuthology.orchestra.run.smithi123.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-11T23:06:36.453 INFO:teuthology.orchestra.run.smithi123.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-11T23:06:36.453 INFO:teuthology.orchestra.run.smithi123.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-11T23:06:36.453 INFO:teuthology.orchestra.run.smithi123.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-11T23:06:36.453 INFO:teuthology.orchestra.run.smithi123.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-11T23:06:36.453 INFO:teuthology.orchestra.run.smithi123.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-11T23:06:36.453 INFO:teuthology.orchestra.run.smithi123.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-11T23:06:36.453 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-11T23:06:36.453 INFO:teuthology.orchestra.run.smithi123.stdout: python3-ply-3.11-14.el9.noarch 2024-09-11T23:06:36.453 INFO:teuthology.orchestra.run.smithi123.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-11T23:06:36.453 INFO:teuthology.orchestra.run.smithi123.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-11T23:06:36.453 INFO:teuthology.orchestra.run.smithi123.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-11T23:06:36.453 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-11T23:06:36.454 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-11T23:06:36.454 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-11T23:06:36.454 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-11T23:06:36.454 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-11T23:06:36.454 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-11T23:06:36.454 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:06:36.454 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:06:36.454 INFO:teuthology.orchestra.run.smithi123.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-11T23:06:36.454 INFO:teuthology.orchestra.run.smithi123.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-11T23:06:36.454 INFO:teuthology.orchestra.run.smithi123.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-11T23:06:36.454 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:06:36.454 INFO:teuthology.orchestra.run.smithi123.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-11T23:06:36.454 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-11T23:06:36.455 INFO:teuthology.orchestra.run.smithi123.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-11T23:06:36.455 INFO:teuthology.orchestra.run.smithi123.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-11T23:06:36.455 INFO:teuthology.orchestra.run.smithi123.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-11T23:06:36.455 INFO:teuthology.orchestra.run.smithi123.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-11T23:06:36.455 INFO:teuthology.orchestra.run.smithi123.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-11T23:06:36.455 INFO:teuthology.orchestra.run.smithi123.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-11T23:06:36.455 INFO:teuthology.orchestra.run.smithi123.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-11T23:06:36.455 INFO:teuthology.orchestra.run.smithi123.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-11T23:06:36.455 INFO:teuthology.orchestra.run.smithi123.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-11T23:06:36.455 INFO:teuthology.orchestra.run.smithi123.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-11T23:06:36.455 INFO:teuthology.orchestra.run.smithi123.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-11T23:06:36.455 INFO:teuthology.orchestra.run.smithi123.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-11T23:06:36.455 INFO:teuthology.orchestra.run.smithi123.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-11T23:06:36.456 INFO:teuthology.orchestra.run.smithi123.stdout: rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:06:36.456 INFO:teuthology.orchestra.run.smithi123.stdout: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:06:36.456 INFO:teuthology.orchestra.run.smithi123.stdout: rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:06:36.456 INFO:teuthology.orchestra.run.smithi123.stdout: re2-1:20211101-20.el9.x86_64 2024-09-11T23:06:36.456 INFO:teuthology.orchestra.run.smithi123.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-11T23:06:36.456 INFO:teuthology.orchestra.run.smithi123.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-11T23:06:36.456 INFO:teuthology.orchestra.run.smithi123.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-11T23:06:36.456 INFO:teuthology.orchestra.run.smithi123.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-11T23:06:36.456 INFO:teuthology.orchestra.run.smithi123.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-11T23:06:36.456 INFO:teuthology.orchestra.run.smithi123.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-11T23:06:36.457 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-11T23:06:36.457 INFO:teuthology.orchestra.run.smithi123.stdout:Complete! 2024-09-11T23:06:36.643 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-11T23:06:36.676 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-11T23:06:36.729 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-11T23:06:36.729 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:06:36.729 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-11T23:06:36.729 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T23:06:36.729 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T23:06:36.729 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:06:36.802 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-11T23:06:36.852 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-11T23:06:36.852 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:06:36.852 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-11T23:06:36.852 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:06:36.879 DEBUG:teuthology.parallel:result is None 2024-09-11T23:06:36.911 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-11T23:06:36.962 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-11T23:06:36.962 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:06:36.963 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-11T23:06:36.963 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-11T23:06:36.963 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-11T23:06:36.963 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:06:37.233 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-11T23:06:37.260 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-11T23:06:37.284 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-11T23:06:37.284 INFO:teuthology.orchestra.run.smithi160.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:06:37.284 INFO:teuthology.orchestra.run.smithi160.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-11T23:06:37.284 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T23:06:37.284 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T23:06:37.284 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-11T23:06:37.320 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-11T23:06:37.329 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-11T23:06:37.351 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-11T23:06:37.351 INFO:teuthology.orchestra.run.smithi160.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:06:37.351 INFO:teuthology.orchestra.run.smithi160.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-11T23:06:37.351 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-11T23:06:37.371 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-11T23:06:37.372 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:06:37.372 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-11T23:06:37.372 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T23:06:37.372 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T23:06:37.372 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:06:37.403 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-11T23:06:37.426 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-11T23:06:37.427 INFO:teuthology.orchestra.run.smithi160.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:06:37.427 INFO:teuthology.orchestra.run.smithi160.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-11T23:06:37.427 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-11T23:06:37.427 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-11T23:06:37.427 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-11T23:06:37.729 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-11T23:06:37.752 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-11T23:06:37.752 INFO:teuthology.orchestra.run.smithi160.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:06:37.752 INFO:teuthology.orchestra.run.smithi160.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-11T23:06:37.752 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T23:06:37.752 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T23:06:37.753 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-11T23:06:42.307 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 141/164 2024-09-11T23:06:42.348 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 142/164 2024-09-11T23:06:42.389 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 143/164 2024-09-11T23:06:42.421 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-11T23:06:42.448 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-11T23:06:42.629 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 146/164 2024-09-11T23:06:42.634 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 141/164 2024-09-11T23:06:42.670 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-11T23:06:42.676 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 142/164 2024-09-11T23:06:42.700 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 148/164 2024-09-11T23:06:42.720 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 143/164 2024-09-11T23:06:42.730 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-11T23:06:42.756 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-11T23:06:42.768 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-11T23:06:42.783 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-11T23:06:43.029 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 146/164 2024-09-11T23:06:43.080 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-11T23:06:43.109 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 148/164 2024-09-11T23:06:43.141 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-11T23:06:43.201 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-11T23:06:43.375 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-11T23:06:43.415 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-11T23:06:43.436 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-11T23:06:44.000 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-11T23:06:44.057 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-11T23:06:44.100 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-11T23:06:44.312 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 152/164 2024-09-11T23:06:44.395 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-11T23:06:44.435 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-11T23:06:44.516 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-11T23:06:44.548 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-11T23:06:44.573 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-11T23:06:44.599 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-11T23:06:44.599 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-11T23:06:44.700 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-11T23:06:44.700 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-11T23:06:44.784 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-11T23:06:44.808 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-11T23:06:44.814 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-11T23:06:44.814 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-11T23:06:44.994 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-11T23:06:44.994 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-11T23:06:45.078 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-11T23:06:45.141 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-11T23:06:45.481 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 152/164 2024-09-11T23:06:45.596 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-11T23:06:45.653 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-11T23:06:45.763 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-11T23:06:45.798 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-11T23:06:45.823 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-11T23:06:45.868 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-11T23:06:45.868 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-11T23:06:45.967 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-11T23:06:45.967 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-11T23:06:46.076 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-11T23:06:46.109 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-11T23:06:46.126 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-11T23:06:46.126 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-11T23:06:46.370 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-11T23:06:46.370 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-11T23:06:46.488 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-11T23:06:46.564 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-11T23:06:46.776 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-11T23:06:46.776 INFO:teuthology.orchestra.run.smithi037.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-09-11T23:06:46.776 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:06:50.561 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-11T23:06:50.562 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/164 2024-09-11T23:06:50.562 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2/164 2024-09-11T23:06:50.562 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 3/164 2024-09-11T23:06:50.562 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 4/164 2024-09-11T23:06:50.562 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 5/164 2024-09-11T23:06:50.562 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 6/164 2024-09-11T23:06:50.562 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 7/164 2024-09-11T23:06:50.563 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-11T23:06:50.563 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-11T23:06:50.563 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-11T23:06:50.563 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 11/164 2024-09-11T23:06:50.563 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 12/164 2024-09-11T23:06:50.563 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-11T23:06:50.564 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 14/164 2024-09-11T23:06:50.564 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 15/164 2024-09-11T23:06:50.564 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 16/164 2024-09-11T23:06:50.564 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 17/164 2024-09-11T23:06:50.564 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 18/164 2024-09-11T23:06:50.564 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 19/164 2024-09-11T23:06:50.564 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 20/164 2024-09-11T23:06:50.564 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 21/164 2024-09-11T23:06:50.564 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 22/164 2024-09-11T23:06:50.564 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 23/164 2024-09-11T23:06:50.564 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 24/164 2024-09-11T23:06:50.564 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 25/164 2024-09-11T23:06:50.564 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 26/164 2024-09-11T23:06:50.565 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 27/164 2024-09-11T23:06:50.565 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 28/164 2024-09-11T23:06:50.565 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 29/164 2024-09-11T23:06:50.565 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 30/164 2024-09-11T23:06:50.565 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 31/164 2024-09-11T23:06:50.565 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 32/164 2024-09-11T23:06:50.565 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 33/164 2024-09-11T23:06:50.565 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 34/164 2024-09-11T23:06:50.565 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 35/164 2024-09-11T23:06:50.565 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 36/164 2024-09-11T23:06:50.565 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 37/164 2024-09-11T23:06:50.565 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 38/164 2024-09-11T23:06:50.565 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 39/164 2024-09-11T23:06:50.566 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-11T23:06:50.566 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-11T23:06:50.566 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-11T23:06:50.566 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-11T23:06:50.566 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-11T23:06:50.566 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-11T23:06:50.566 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-11T23:06:50.566 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-11T23:06:50.566 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-11T23:06:50.566 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-11T23:06:50.566 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-11T23:06:50.566 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-11T23:06:50.566 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-11T23:06:50.566 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-11T23:06:50.566 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-11T23:06:50.567 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-11T23:06:50.567 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-11T23:06:50.567 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-11T23:06:50.567 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-11T23:06:50.567 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-11T23:06:50.567 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-11T23:06:50.567 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-11T23:06:50.567 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-11T23:06:50.567 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-11T23:06:50.567 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-11T23:06:50.567 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-11T23:06:50.567 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-11T23:06:50.567 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-11T23:06:50.567 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-11T23:06:50.568 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-11T23:06:50.568 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-11T23:06:50.568 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-11T23:06:50.568 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-11T23:06:50.568 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-11T23:06:50.568 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-11T23:06:50.568 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-11T23:06:50.568 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-11T23:06:50.568 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-11T23:06:50.568 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-11T23:06:50.568 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-11T23:06:50.568 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-11T23:06:50.569 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-11T23:06:50.569 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-11T23:06:50.569 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-11T23:06:50.569 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-11T23:06:50.569 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-11T23:06:50.569 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-11T23:06:50.569 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-11T23:06:50.569 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-11T23:06:50.569 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-11T23:06:50.569 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-11T23:06:50.569 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-11T23:06:50.569 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-11T23:06:50.570 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-11T23:06:50.570 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-11T23:06:50.570 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-11T23:06:50.570 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-11T23:06:50.570 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-11T23:06:50.570 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-11T23:06:50.570 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-11T23:06:50.570 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-11T23:06:50.570 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-11T23:06:50.570 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-11T23:06:50.570 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-11T23:06:50.570 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-11T23:06:50.570 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-11T23:06:50.570 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-11T23:06:50.571 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/164 2024-09-11T23:06:50.571 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-11T23:06:50.571 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-11T23:06:50.571 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-11T23:06:50.571 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-11T23:06:50.571 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-11T23:06:50.571 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-11T23:06:50.571 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-11T23:06:50.571 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-11T23:06:50.571 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-11T23:06:50.571 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-11T23:06:50.571 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-11T23:06:50.571 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-11T23:06:50.571 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-11T23:06:50.572 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-11T23:06:50.572 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-11T23:06:50.572 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-11T23:06:50.572 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-11T23:06:50.572 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-11T23:06:50.572 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-11T23:06:50.572 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-11T23:06:50.572 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-11T23:06:50.572 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-11T23:06:50.572 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-11T23:06:50.572 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-11T23:06:50.572 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-11T23:06:50.572 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-11T23:06:50.572 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-11T23:06:50.573 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-11T23:06:50.573 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-11T23:06:50.573 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-11T23:06:50.573 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-11T23:06:50.573 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-11T23:06:50.573 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-11T23:06:50.573 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-11T23:06:50.573 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-11T23:06:50.573 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-11T23:06:50.573 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-11T23:06:50.573 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-11T23:06:50.573 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-11T23:06:50.573 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-11T23:06:50.573 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-11T23:06:50.574 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 149/164 2024-09-11T23:06:50.574 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-11T23:06:50.574 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 151/164 2024-09-11T23:06:50.574 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-11T23:06:50.574 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-11T23:06:50.574 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-11T23:06:50.574 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-11T23:06:50.574 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-11T23:06:50.574 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-11T23:06:50.574 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-11T23:06:50.574 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-11T23:06:50.574 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-11T23:06:50.574 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-11T23:06:50.574 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-11T23:06:50.575 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-11T23:06:52.464 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/164 2024-09-11T23:06:52.464 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2/164 2024-09-11T23:06:52.464 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 3/164 2024-09-11T23:06:52.464 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 4/164 2024-09-11T23:06:52.464 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 5/164 2024-09-11T23:06:52.464 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 6/164 2024-09-11T23:06:52.464 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 7/164 2024-09-11T23:06:52.464 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-11T23:06:52.465 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-11T23:06:52.465 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-11T23:06:52.465 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 11/164 2024-09-11T23:06:52.465 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 12/164 2024-09-11T23:06:52.465 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-11T23:06:52.465 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 14/164 2024-09-11T23:06:52.465 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 15/164 2024-09-11T23:06:52.465 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 16/164 2024-09-11T23:06:52.465 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 17/164 2024-09-11T23:06:52.465 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 18/164 2024-09-11T23:06:52.465 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 19/164 2024-09-11T23:06:52.465 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 20/164 2024-09-11T23:06:52.466 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 21/164 2024-09-11T23:06:52.466 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 22/164 2024-09-11T23:06:52.466 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 23/164 2024-09-11T23:06:52.466 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 24/164 2024-09-11T23:06:52.466 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 25/164 2024-09-11T23:06:52.466 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 26/164 2024-09-11T23:06:52.466 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 27/164 2024-09-11T23:06:52.466 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 28/164 2024-09-11T23:06:52.466 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 29/164 2024-09-11T23:06:52.480 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 30/164 2024-09-11T23:06:52.480 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 31/164 2024-09-11T23:06:52.480 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 32/164 2024-09-11T23:06:52.481 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 33/164 2024-09-11T23:06:52.481 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 34/164 2024-09-11T23:06:52.481 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 35/164 2024-09-11T23:06:52.481 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 36/164 2024-09-11T23:06:52.481 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 37/164 2024-09-11T23:06:52.481 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 38/164 2024-09-11T23:06:52.481 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 39/164 2024-09-11T23:06:52.481 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-11T23:06:52.481 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-11T23:06:52.481 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-11T23:06:52.481 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-11T23:06:52.481 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-11T23:06:52.481 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-11T23:06:52.482 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-11T23:06:52.482 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-11T23:06:52.482 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-11T23:06:52.482 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-11T23:06:52.482 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-11T23:06:52.482 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-11T23:06:52.482 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-11T23:06:52.482 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-11T23:06:52.482 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-11T23:06:52.482 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-11T23:06:52.482 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-11T23:06:52.482 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-11T23:06:52.482 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-11T23:06:52.483 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-11T23:06:52.483 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-11T23:06:52.483 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-11T23:06:52.483 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-11T23:06:52.483 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-11T23:06:52.483 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-11T23:06:52.483 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-11T23:06:52.483 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-11T23:06:52.483 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-11T23:06:52.483 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-11T23:06:52.483 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-11T23:06:52.483 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-11T23:06:52.483 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-11T23:06:52.484 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-11T23:06:52.484 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-11T23:06:52.484 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-11T23:06:52.484 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-11T23:06:52.484 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-11T23:06:52.484 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-11T23:06:52.484 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-11T23:06:52.484 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-11T23:06:52.484 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-11T23:06:52.484 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-11T23:06:52.484 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-11T23:06:52.485 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-11T23:06:52.485 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-11T23:06:52.485 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-11T23:06:52.485 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-11T23:06:52.485 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-11T23:06:52.485 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-11T23:06:52.485 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-11T23:06:52.485 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-11T23:06:52.485 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-11T23:06:52.485 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-11T23:06:52.485 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-11T23:06:52.485 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-11T23:06:52.485 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-11T23:06:52.486 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-11T23:06:52.486 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-11T23:06:52.486 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-11T23:06:52.486 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-11T23:06:52.486 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-11T23:06:52.486 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-11T23:06:52.486 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-11T23:06:52.486 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-11T23:06:52.486 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-11T23:06:52.486 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-11T23:06:52.486 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-11T23:06:52.486 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/164 2024-09-11T23:06:52.486 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-11T23:06:52.486 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-11T23:06:52.487 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-11T23:06:52.487 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-11T23:06:52.487 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-11T23:06:52.487 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-11T23:06:52.487 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-11T23:06:52.487 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-11T23:06:52.487 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-11T23:06:52.487 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-11T23:06:52.487 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-11T23:06:52.487 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-11T23:06:52.487 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-11T23:06:52.487 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-11T23:06:52.487 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-11T23:06:52.488 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-11T23:06:52.488 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-11T23:06:52.488 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-11T23:06:52.488 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-11T23:06:52.488 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-11T23:06:52.488 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-11T23:06:52.488 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-11T23:06:52.488 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-11T23:06:52.488 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-11T23:06:52.488 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-11T23:06:52.488 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-11T23:06:52.489 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-11T23:06:52.489 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-11T23:06:52.489 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-11T23:06:52.489 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-11T23:06:52.489 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-11T23:06:52.489 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-11T23:06:52.489 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-11T23:06:52.489 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-11T23:06:52.489 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-11T23:06:52.490 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-11T23:06:52.490 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-11T23:06:52.490 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-11T23:06:52.490 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-11T23:06:52.490 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-11T23:06:52.490 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-11T23:06:52.490 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 149/164 2024-09-11T23:06:52.490 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-11T23:06:52.490 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 151/164 2024-09-11T23:06:52.490 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-11T23:06:52.490 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-11T23:06:52.491 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-11T23:06:52.491 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-11T23:06:52.491 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-11T23:06:52.491 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-11T23:06:52.491 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-11T23:06:52.491 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-11T23:06:52.491 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-11T23:06:52.491 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-11T23:06:52.491 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-11T23:06:52.491 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-11T23:06:53.215 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-11T23:06:53.215 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-11T23:06:53.215 INFO:teuthology.orchestra.run.smithi160.stdout:Upgraded: 2024-09-11T23:06:53.215 INFO:teuthology.orchestra.run.smithi160.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-11T23:06:53.215 INFO:teuthology.orchestra.run.smithi160.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-11T23:06:53.216 INFO:teuthology.orchestra.run.smithi160.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-11T23:06:53.216 INFO:teuthology.orchestra.run.smithi160.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-11T23:06:53.216 INFO:teuthology.orchestra.run.smithi160.stdout: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:06:53.216 INFO:teuthology.orchestra.run.smithi160.stdout: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:06:53.216 INFO:teuthology.orchestra.run.smithi160.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-11T23:06:53.216 INFO:teuthology.orchestra.run.smithi160.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-11T23:06:53.216 INFO:teuthology.orchestra.run.smithi160.stdout:Installed: 2024-09-11T23:06:53.216 INFO:teuthology.orchestra.run.smithi160.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-11T23:06:53.216 INFO:teuthology.orchestra.run.smithi160.stdout: automake-1.16.2-8.el9.noarch 2024-09-11T23:06:53.216 INFO:teuthology.orchestra.run.smithi160.stdout: bison-3.7.4-5.el9.x86_64 2024-09-11T23:06:53.216 INFO:teuthology.orchestra.run.smithi160.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-11T23:06:53.216 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:06:53.217 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:06:53.217 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:06:53.217 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:06:53.217 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:06:53.217 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:06:53.217 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:06:53.217 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:06:53.217 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:06:53.217 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:06:53.217 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:06:53.217 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:06:53.217 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:06:53.217 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:06:53.218 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:06:53.218 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:06:53.218 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:06:53.218 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:06:53.218 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:06:53.218 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:06:53.218 INFO:teuthology.orchestra.run.smithi160.stdout: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:06:53.218 INFO:teuthology.orchestra.run.smithi160.stdout: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:06:53.218 INFO:teuthology.orchestra.run.smithi160.stdout: cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:06:53.218 INFO:teuthology.orchestra.run.smithi160.stdout: cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:06:53.218 INFO:teuthology.orchestra.run.smithi160.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-11T23:06:53.218 INFO:teuthology.orchestra.run.smithi160.stdout: flex-2.6.4-9.el9.x86_64 2024-09-11T23:06:53.219 INFO:teuthology.orchestra.run.smithi160.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-11T23:06:53.219 INFO:teuthology.orchestra.run.smithi160.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-11T23:06:53.219 INFO:teuthology.orchestra.run.smithi160.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-11T23:06:53.219 INFO:teuthology.orchestra.run.smithi160.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-11T23:06:53.219 INFO:teuthology.orchestra.run.smithi160.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-11T23:06:53.219 INFO:teuthology.orchestra.run.smithi160.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-11T23:06:53.219 INFO:teuthology.orchestra.run.smithi160.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-11T23:06:53.219 INFO:teuthology.orchestra.run.smithi160.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-11T23:06:53.219 INFO:teuthology.orchestra.run.smithi160.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-11T23:06:53.219 INFO:teuthology.orchestra.run.smithi160.stdout: libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:06:53.219 INFO:teuthology.orchestra.run.smithi160.stdout: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:06:53.219 INFO:teuthology.orchestra.run.smithi160.stdout: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:06:53.220 INFO:teuthology.orchestra.run.smithi160.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-11T23:06:53.220 INFO:teuthology.orchestra.run.smithi160.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-11T23:06:53.220 INFO:teuthology.orchestra.run.smithi160.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-11T23:06:53.220 INFO:teuthology.orchestra.run.smithi160.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-11T23:06:53.220 INFO:teuthology.orchestra.run.smithi160.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-11T23:06:53.220 INFO:teuthology.orchestra.run.smithi160.stdout: librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:06:53.220 INFO:teuthology.orchestra.run.smithi160.stdout: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:06:53.220 INFO:teuthology.orchestra.run.smithi160.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-11T23:06:53.220 INFO:teuthology.orchestra.run.smithi160.stdout: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:06:53.220 INFO:teuthology.orchestra.run.smithi160.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-11T23:06:53.220 INFO:teuthology.orchestra.run.smithi160.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-11T23:06:53.220 INFO:teuthology.orchestra.run.smithi160.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-11T23:06:53.221 INFO:teuthology.orchestra.run.smithi160.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-11T23:06:53.221 INFO:teuthology.orchestra.run.smithi160.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-11T23:06:53.221 INFO:teuthology.orchestra.run.smithi160.stdout: lua-5.4.4-4.el9.x86_64 2024-09-11T23:06:53.221 INFO:teuthology.orchestra.run.smithi160.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-11T23:06:53.221 INFO:teuthology.orchestra.run.smithi160.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-11T23:06:53.221 INFO:teuthology.orchestra.run.smithi160.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-11T23:06:53.221 INFO:teuthology.orchestra.run.smithi160.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-11T23:06:53.221 INFO:teuthology.orchestra.run.smithi160.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-11T23:06:53.221 INFO:teuthology.orchestra.run.smithi160.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-11T23:06:53.221 INFO:teuthology.orchestra.run.smithi160.stdout: postgresql-13.16-1.el9.x86_64 2024-09-11T23:06:53.221 INFO:teuthology.orchestra.run.smithi160.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-11T23:06:53.222 INFO:teuthology.orchestra.run.smithi160.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-11T23:06:53.222 INFO:teuthology.orchestra.run.smithi160.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-11T23:06:53.222 INFO:teuthology.orchestra.run.smithi160.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-11T23:06:53.222 INFO:teuthology.orchestra.run.smithi160.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-11T23:06:53.222 INFO:teuthology.orchestra.run.smithi160.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-11T23:06:53.222 INFO:teuthology.orchestra.run.smithi160.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-11T23:06:53.222 INFO:teuthology.orchestra.run.smithi160.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-11T23:06:53.222 INFO:teuthology.orchestra.run.smithi160.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-11T23:06:53.222 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-11T23:06:53.222 INFO:teuthology.orchestra.run.smithi160.stdout: python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:06:53.222 INFO:teuthology.orchestra.run.smithi160.stdout: python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:06:53.222 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:06:53.223 INFO:teuthology.orchestra.run.smithi160.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-11T23:06:53.223 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-11T23:06:53.223 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-11T23:06:53.223 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-11T23:06:53.223 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-11T23:06:53.223 INFO:teuthology.orchestra.run.smithi160.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-11T23:06:53.223 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-11T23:06:53.224 INFO:teuthology.orchestra.run.smithi160.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-11T23:06:53.224 INFO:teuthology.orchestra.run.smithi160.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-11T23:06:53.224 INFO:teuthology.orchestra.run.smithi160.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-11T23:06:53.224 INFO:teuthology.orchestra.run.smithi160.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-11T23:06:53.224 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-11T23:06:53.224 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-11T23:06:53.224 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-11T23:06:53.224 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-11T23:06:53.224 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-11T23:06:53.224 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-11T23:06:53.224 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-11T23:06:53.225 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-11T23:06:53.225 INFO:teuthology.orchestra.run.smithi160.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-11T23:06:53.225 INFO:teuthology.orchestra.run.smithi160.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-11T23:06:53.225 INFO:teuthology.orchestra.run.smithi160.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-11T23:06:53.225 INFO:teuthology.orchestra.run.smithi160.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-11T23:06:53.225 INFO:teuthology.orchestra.run.smithi160.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-11T23:06:53.225 INFO:teuthology.orchestra.run.smithi160.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-11T23:06:53.225 INFO:teuthology.orchestra.run.smithi160.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-11T23:06:53.226 INFO:teuthology.orchestra.run.smithi160.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-11T23:06:53.226 INFO:teuthology.orchestra.run.smithi160.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-11T23:06:53.226 INFO:teuthology.orchestra.run.smithi160.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-11T23:06:53.226 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-11T23:06:53.226 INFO:teuthology.orchestra.run.smithi160.stdout: python3-ply-3.11-14.el9.noarch 2024-09-11T23:06:53.226 INFO:teuthology.orchestra.run.smithi160.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-11T23:06:53.226 INFO:teuthology.orchestra.run.smithi160.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-11T23:06:53.226 INFO:teuthology.orchestra.run.smithi160.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-11T23:06:53.226 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-11T23:06:53.226 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-11T23:06:53.226 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-11T23:06:53.226 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-11T23:06:53.227 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-11T23:06:53.227 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-11T23:06:53.227 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:06:53.227 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:06:53.227 INFO:teuthology.orchestra.run.smithi160.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-11T23:06:53.227 INFO:teuthology.orchestra.run.smithi160.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-11T23:06:53.227 INFO:teuthology.orchestra.run.smithi160.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-11T23:06:53.227 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:06:53.227 INFO:teuthology.orchestra.run.smithi160.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-11T23:06:53.227 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-11T23:06:53.227 INFO:teuthology.orchestra.run.smithi160.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-11T23:06:53.227 INFO:teuthology.orchestra.run.smithi160.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-11T23:06:53.228 INFO:teuthology.orchestra.run.smithi160.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-11T23:06:53.228 INFO:teuthology.orchestra.run.smithi160.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-11T23:06:53.228 INFO:teuthology.orchestra.run.smithi160.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-11T23:06:53.228 INFO:teuthology.orchestra.run.smithi160.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-11T23:06:53.228 INFO:teuthology.orchestra.run.smithi160.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-11T23:06:53.228 INFO:teuthology.orchestra.run.smithi160.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-11T23:06:53.228 INFO:teuthology.orchestra.run.smithi160.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-11T23:06:53.228 INFO:teuthology.orchestra.run.smithi160.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-11T23:06:53.228 INFO:teuthology.orchestra.run.smithi160.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-11T23:06:53.228 INFO:teuthology.orchestra.run.smithi160.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-11T23:06:53.228 INFO:teuthology.orchestra.run.smithi160.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-11T23:06:53.229 INFO:teuthology.orchestra.run.smithi160.stdout: rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:06:53.229 INFO:teuthology.orchestra.run.smithi160.stdout: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:06:53.229 INFO:teuthology.orchestra.run.smithi160.stdout: rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:06:53.229 INFO:teuthology.orchestra.run.smithi160.stdout: re2-1:20211101-20.el9.x86_64 2024-09-11T23:06:53.229 INFO:teuthology.orchestra.run.smithi160.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-11T23:06:53.229 INFO:teuthology.orchestra.run.smithi160.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-11T23:06:53.229 INFO:teuthology.orchestra.run.smithi160.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-11T23:06:53.229 INFO:teuthology.orchestra.run.smithi160.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-11T23:06:53.229 INFO:teuthology.orchestra.run.smithi160.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-11T23:06:53.230 INFO:teuthology.orchestra.run.smithi160.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-11T23:06:53.230 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-11T23:06:53.230 INFO:teuthology.orchestra.run.smithi160.stdout:Complete! 2024-09-11T23:06:53.627 DEBUG:teuthology.parallel:result is None 2024-09-11T23:06:54.679 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-11T23:06:54.679 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:06:54.679 INFO:teuthology.orchestra.run.smithi037.stdout:Upgraded: 2024-09-11T23:06:54.679 INFO:teuthology.orchestra.run.smithi037.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-11T23:06:54.679 INFO:teuthology.orchestra.run.smithi037.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-11T23:06:54.680 INFO:teuthology.orchestra.run.smithi037.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-11T23:06:54.680 INFO:teuthology.orchestra.run.smithi037.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-11T23:06:54.680 INFO:teuthology.orchestra.run.smithi037.stdout: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:06:54.680 INFO:teuthology.orchestra.run.smithi037.stdout: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:06:54.680 INFO:teuthology.orchestra.run.smithi037.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-11T23:06:54.680 INFO:teuthology.orchestra.run.smithi037.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-11T23:06:54.680 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2024-09-11T23:06:54.680 INFO:teuthology.orchestra.run.smithi037.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-11T23:06:54.680 INFO:teuthology.orchestra.run.smithi037.stdout: automake-1.16.2-8.el9.noarch 2024-09-11T23:06:54.680 INFO:teuthology.orchestra.run.smithi037.stdout: bison-3.7.4-5.el9.x86_64 2024-09-11T23:06:54.680 INFO:teuthology.orchestra.run.smithi037.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-11T23:06:54.681 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:06:54.681 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:06:54.681 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:06:54.681 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:06:54.681 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:06:54.681 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:06:54.681 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:06:54.681 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:06:54.681 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:06:54.681 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:06:54.681 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:06:54.681 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:06:54.681 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:06:54.682 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:06:54.682 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:06:54.682 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:06:54.682 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:06:54.682 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:06:54.682 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:06:54.682 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:06:54.682 INFO:teuthology.orchestra.run.smithi037.stdout: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:06:54.682 INFO:teuthology.orchestra.run.smithi037.stdout: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:06:54.682 INFO:teuthology.orchestra.run.smithi037.stdout: cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:06:54.682 INFO:teuthology.orchestra.run.smithi037.stdout: cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:06:54.682 INFO:teuthology.orchestra.run.smithi037.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-11T23:06:54.683 INFO:teuthology.orchestra.run.smithi037.stdout: flex-2.6.4-9.el9.x86_64 2024-09-11T23:06:54.683 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-11T23:06:54.683 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-11T23:06:54.683 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-11T23:06:54.683 INFO:teuthology.orchestra.run.smithi037.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-11T23:06:54.683 INFO:teuthology.orchestra.run.smithi037.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-11T23:06:54.683 INFO:teuthology.orchestra.run.smithi037.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-11T23:06:54.683 INFO:teuthology.orchestra.run.smithi037.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-11T23:06:54.683 INFO:teuthology.orchestra.run.smithi037.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-11T23:06:54.683 INFO:teuthology.orchestra.run.smithi037.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-11T23:06:54.683 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:06:54.683 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:06:54.683 INFO:teuthology.orchestra.run.smithi037.stdout: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:06:54.684 INFO:teuthology.orchestra.run.smithi037.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-11T23:06:54.684 INFO:teuthology.orchestra.run.smithi037.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-11T23:06:54.684 INFO:teuthology.orchestra.run.smithi037.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-11T23:06:54.684 INFO:teuthology.orchestra.run.smithi037.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-11T23:06:54.684 INFO:teuthology.orchestra.run.smithi037.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-11T23:06:54.684 INFO:teuthology.orchestra.run.smithi037.stdout: librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:06:54.684 INFO:teuthology.orchestra.run.smithi037.stdout: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:06:54.684 INFO:teuthology.orchestra.run.smithi037.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-11T23:06:54.684 INFO:teuthology.orchestra.run.smithi037.stdout: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:06:54.684 INFO:teuthology.orchestra.run.smithi037.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-11T23:06:54.684 INFO:teuthology.orchestra.run.smithi037.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-11T23:06:54.684 INFO:teuthology.orchestra.run.smithi037.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-11T23:06:54.684 INFO:teuthology.orchestra.run.smithi037.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-11T23:06:54.685 INFO:teuthology.orchestra.run.smithi037.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-11T23:06:54.685 INFO:teuthology.orchestra.run.smithi037.stdout: lua-5.4.4-4.el9.x86_64 2024-09-11T23:06:54.685 INFO:teuthology.orchestra.run.smithi037.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-11T23:06:54.685 INFO:teuthology.orchestra.run.smithi037.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-11T23:06:54.685 INFO:teuthology.orchestra.run.smithi037.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-11T23:06:54.685 INFO:teuthology.orchestra.run.smithi037.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-11T23:06:54.685 INFO:teuthology.orchestra.run.smithi037.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-11T23:06:54.685 INFO:teuthology.orchestra.run.smithi037.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-11T23:06:54.685 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-13.16-1.el9.x86_64 2024-09-11T23:06:54.685 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-11T23:06:54.685 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-11T23:06:54.685 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-11T23:06:54.685 INFO:teuthology.orchestra.run.smithi037.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-11T23:06:54.686 INFO:teuthology.orchestra.run.smithi037.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-11T23:06:54.686 INFO:teuthology.orchestra.run.smithi037.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-11T23:06:54.686 INFO:teuthology.orchestra.run.smithi037.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-11T23:06:54.686 INFO:teuthology.orchestra.run.smithi037.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-11T23:06:54.686 INFO:teuthology.orchestra.run.smithi037.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-11T23:06:54.686 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-11T23:06:54.686 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:06:54.686 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:06:54.686 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:06:54.686 INFO:teuthology.orchestra.run.smithi037.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-11T23:06:54.686 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-11T23:06:54.686 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-11T23:06:54.686 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-11T23:06:54.686 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-11T23:06:54.687 INFO:teuthology.orchestra.run.smithi037.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-11T23:06:54.687 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-11T23:06:54.687 INFO:teuthology.orchestra.run.smithi037.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-11T23:06:54.687 INFO:teuthology.orchestra.run.smithi037.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-11T23:06:54.687 INFO:teuthology.orchestra.run.smithi037.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-11T23:06:54.687 INFO:teuthology.orchestra.run.smithi037.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-11T23:06:54.687 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-11T23:06:54.687 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-11T23:06:54.687 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-11T23:06:54.687 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-11T23:06:54.687 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-11T23:06:54.687 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-11T23:06:54.687 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-11T23:06:54.688 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-11T23:06:54.688 INFO:teuthology.orchestra.run.smithi037.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-11T23:06:54.688 INFO:teuthology.orchestra.run.smithi037.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-11T23:06:54.688 INFO:teuthology.orchestra.run.smithi037.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-11T23:06:54.688 INFO:teuthology.orchestra.run.smithi037.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-11T23:06:54.688 INFO:teuthology.orchestra.run.smithi037.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-11T23:06:54.688 INFO:teuthology.orchestra.run.smithi037.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-11T23:06:54.688 INFO:teuthology.orchestra.run.smithi037.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-11T23:06:54.688 INFO:teuthology.orchestra.run.smithi037.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-11T23:06:54.688 INFO:teuthology.orchestra.run.smithi037.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-11T23:06:54.688 INFO:teuthology.orchestra.run.smithi037.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-11T23:06:54.688 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-11T23:06:54.689 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ply-3.11-14.el9.noarch 2024-09-11T23:06:54.689 INFO:teuthology.orchestra.run.smithi037.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-11T23:06:54.689 INFO:teuthology.orchestra.run.smithi037.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-11T23:06:54.689 INFO:teuthology.orchestra.run.smithi037.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-11T23:06:54.689 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-11T23:06:54.689 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-11T23:06:54.689 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-11T23:06:54.689 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-11T23:06:54.689 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-11T23:06:54.689 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-11T23:06:54.689 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:06:54.689 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:06:54.689 INFO:teuthology.orchestra.run.smithi037.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-11T23:06:54.690 INFO:teuthology.orchestra.run.smithi037.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-11T23:06:54.690 INFO:teuthology.orchestra.run.smithi037.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-11T23:06:54.690 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:06:54.690 INFO:teuthology.orchestra.run.smithi037.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-11T23:06:54.690 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-11T23:06:54.690 INFO:teuthology.orchestra.run.smithi037.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-11T23:06:54.690 INFO:teuthology.orchestra.run.smithi037.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-11T23:06:54.690 INFO:teuthology.orchestra.run.smithi037.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-11T23:06:54.690 INFO:teuthology.orchestra.run.smithi037.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-11T23:06:54.690 INFO:teuthology.orchestra.run.smithi037.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-11T23:06:54.690 INFO:teuthology.orchestra.run.smithi037.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-11T23:06:54.690 INFO:teuthology.orchestra.run.smithi037.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-11T23:06:54.690 INFO:teuthology.orchestra.run.smithi037.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-11T23:06:54.690 INFO:teuthology.orchestra.run.smithi037.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-11T23:06:54.691 INFO:teuthology.orchestra.run.smithi037.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-11T23:06:54.691 INFO:teuthology.orchestra.run.smithi037.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-11T23:06:54.691 INFO:teuthology.orchestra.run.smithi037.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-11T23:06:54.691 INFO:teuthology.orchestra.run.smithi037.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-11T23:06:54.691 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:06:54.691 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:06:54.691 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:06:54.691 INFO:teuthology.orchestra.run.smithi037.stdout: re2-1:20211101-20.el9.x86_64 2024-09-11T23:06:54.691 INFO:teuthology.orchestra.run.smithi037.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-11T23:06:54.691 INFO:teuthology.orchestra.run.smithi037.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-11T23:06:54.691 INFO:teuthology.orchestra.run.smithi037.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-11T23:06:54.691 INFO:teuthology.orchestra.run.smithi037.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-11T23:06:54.691 INFO:teuthology.orchestra.run.smithi037.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-11T23:06:54.692 INFO:teuthology.orchestra.run.smithi037.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-11T23:06:54.692 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:06:54.692 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-09-11T23:06:55.317 DEBUG:teuthology.parallel:result is None 2024-09-11T23:06:55.318 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T23:06:55.477 DEBUG:teuthology.orchestra.run.smithi037:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-11T23:06:55.522 INFO:teuthology.orchestra.run.smithi037.stdout:19.1.1-298.gb53b6d3e.el9 2024-09-11T23:06:55.523 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-298.gb53b6d3e.el9 2024-09-11T23:06:55.523 INFO:teuthology.task.install:The correct ceph version 19.1.1-298.gb53b6d3e is installed. 2024-09-11T23:06:55.525 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T23:06:55.682 DEBUG:teuthology.orchestra.run.smithi123:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-11T23:06:55.709 INFO:teuthology.orchestra.run.smithi123.stdout:19.1.1-298.gb53b6d3e.el9 2024-09-11T23:06:55.709 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-298.gb53b6d3e.el9 2024-09-11T23:06:55.709 INFO:teuthology.task.install:The correct ceph version 19.1.1-298.gb53b6d3e is installed. 2024-09-11T23:06:55.711 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T23:06:55.866 DEBUG:teuthology.orchestra.run.smithi160:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-11T23:06:55.893 INFO:teuthology.orchestra.run.smithi160.stdout:19.1.1-298.gb53b6d3e.el9 2024-09-11T23:06:55.894 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-298.gb53b6d3e.el9 2024-09-11T23:06:55.894 INFO:teuthology.task.install:The correct ceph version 19.1.1-298.gb53b6d3e is installed. 2024-09-11T23:06:55.897 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-11T23:06:55.897 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-11T23:06:55.897 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-11T23:06:55.957 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-11T23:06:55.957 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-11T23:06:55.990 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-11T23:06:55.990 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-11T23:06:56.023 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-11T23:06:56.024 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-11T23:06:56.024 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/usr/bin/daemon-helper 2024-09-11T23:06:56.079 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-11T23:06:56.174 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-11T23:06:56.174 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/usr/bin/daemon-helper 2024-09-11T23:06:56.206 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-11T23:06:56.274 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-11T23:06:56.274 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/usr/bin/daemon-helper 2024-09-11T23:06:56.304 DEBUG:teuthology.orchestra.run.smithi160:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-11T23:06:56.373 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-11T23:06:56.373 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-11T23:06:56.373 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-11T23:06:56.429 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-11T23:06:56.525 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-11T23:06:56.525 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-11T23:06:56.550 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-11T23:06:56.615 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-11T23:06:56.615 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-11T23:06:56.645 DEBUG:teuthology.orchestra.run.smithi160:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-11T23:06:56.714 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-11T23:06:56.714 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-11T23:06:56.714 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/usr/bin/stdin-killer 2024-09-11T23:06:56.771 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-11T23:06:56.872 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-11T23:06:56.872 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/usr/bin/stdin-killer 2024-09-11T23:06:56.896 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-11T23:06:56.961 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-11T23:06:56.961 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/usr/bin/stdin-killer 2024-09-11T23:06:56.991 DEBUG:teuthology.orchestra.run.smithi160:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-11T23:06:57.060 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-11T23:06:57.159 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_export_ephemeral_random_max': 0.1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'subvols': {'create': 2}} 2024-09-11T23:06:57.159 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T23:06:57.160 INFO:tasks.cephadm:Cluster fsid is 8b03efce-7092-11ef-bcea-c7b262605968 2024-09-11T23:06:57.160 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-11T23:06:57.160 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.37', 'mon.b': '172.21.15.123', 'mon.c': '172.21.15.160'} 2024-09-11T23:06:57.160 INFO:tasks.cephadm:First mon is mon.a on smithi037 2024-09-11T23:06:57.160 INFO:tasks.cephadm:First mgr is x 2024-09-11T23:06:57.160 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-11T23:06:57.161 DEBUG:teuthology.orchestra.run.smithi037:> sudo hostname $(hostname -s) 2024-09-11T23:06:57.221 DEBUG:teuthology.orchestra.run.smithi123:> sudo hostname $(hostname -s) 2024-09-11T23:06:57.246 DEBUG:teuthology.orchestra.run.smithi160:> sudo hostname $(hostname -s) 2024-09-11T23:06:57.277 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-11T23:06:57.278 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T23:06:57.433 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/56038/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.1.1-298-gb53b6d3e', 'node_name': '172.21.5.36+adami06', 'job_name': 'ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.1.1-298.gb53b6d3e'}, 'url': 'https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-09 17:24:58.599585', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'squid', 'chacra_url': 'https://2.chacra.ceph.com/repos/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2024-09-11T23:06:57.586 INFO:tasks.util.chacra:got chacra host 2.chacra.ceph.com, ref squid, sha1 b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T23:06:57.588 INFO:tasks.cephadm:Discovered cachra url: https://2.chacra.ceph.com/binaries/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/x86_64/flavors/default/cephadm 2024-09-11T23:06:57.589 INFO:tasks.cephadm:Downloading cephadm from url: https://2.chacra.ceph.com/binaries/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/x86_64/flavors/default/cephadm 2024-09-11T23:06:57.589 DEBUG:teuthology.orchestra.run.smithi037:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-11T23:06:57.962 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r--. 1 ubuntu ubuntu 784498 Sep 11 23:06 /home/ubuntu/cephtest/cephadm 2024-09-11T23:06:57.963 DEBUG:teuthology.orchestra.run.smithi123:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-11T23:06:58.335 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r--. 1 ubuntu ubuntu 784498 Sep 11 23:06 /home/ubuntu/cephtest/cephadm 2024-09-11T23:06:58.335 DEBUG:teuthology.orchestra.run.smithi160:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-11T23:06:58.742 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r--. 1 ubuntu ubuntu 784498 Sep 11 23:06 /home/ubuntu/cephtest/cephadm 2024-09-11T23:06:58.742 DEBUG:teuthology.orchestra.run.smithi037:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-11T23:06:58.781 DEBUG:teuthology.orchestra.run.smithi123:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-11T23:06:58.801 DEBUG:teuthology.orchestra.run.smithi160:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-11T23:06:58.839 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc on all hosts... 2024-09-11T23:06:58.839 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc pull 2024-09-11T23:06:58.843 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc pull 2024-09-11T23:06:58.845 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc pull 2024-09-11T23:07:00.321 INFO:teuthology.orchestra.run.smithi160.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc... 2024-09-11T23:07:00.391 INFO:teuthology.orchestra.run.smithi123.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc... 2024-09-11T23:07:00.689 INFO:teuthology.orchestra.run.smithi037.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc... 2024-09-11T23:07:27.235 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-11T23:07:27.235 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-11T23:07:27.235 INFO:teuthology.orchestra.run.smithi123.stdout: "image_id": "54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594", 2024-09-11T23:07:27.236 INFO:teuthology.orchestra.run.smithi123.stdout: "repo_digests": [ 2024-09-11T23:07:27.236 INFO:teuthology.orchestra.run.smithi123.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66" 2024-09-11T23:07:27.236 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-11T23:07:27.236 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-11T23:07:31.907 INFO:teuthology.orchestra.run.smithi160.stdout:{ 2024-09-11T23:07:31.907 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-11T23:07:31.907 INFO:teuthology.orchestra.run.smithi160.stdout: "image_id": "54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594", 2024-09-11T23:07:31.907 INFO:teuthology.orchestra.run.smithi160.stdout: "repo_digests": [ 2024-09-11T23:07:31.907 INFO:teuthology.orchestra.run.smithi160.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66" 2024-09-11T23:07:31.907 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-11T23:07:31.907 INFO:teuthology.orchestra.run.smithi160.stdout:} 2024-09-11T23:07:37.663 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-11T23:07:37.663 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-11T23:07:37.664 INFO:teuthology.orchestra.run.smithi037.stdout: "image_id": "54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594", 2024-09-11T23:07:37.664 INFO:teuthology.orchestra.run.smithi037.stdout: "repo_digests": [ 2024-09-11T23:07:37.664 INFO:teuthology.orchestra.run.smithi037.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66" 2024-09-11T23:07:37.664 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2024-09-11T23:07:37.664 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-11T23:07:37.696 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /etc/ceph 2024-09-11T23:07:37.770 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /etc/ceph 2024-09-11T23:07:37.803 DEBUG:teuthology.orchestra.run.smithi160:> sudo mkdir -p /etc/ceph 2024-09-11T23:07:37.838 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 777 /etc/ceph 2024-09-11T23:07:37.893 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 777 /etc/ceph 2024-09-11T23:07:37.922 DEBUG:teuthology.orchestra.run.smithi160:> sudo chmod 777 /etc/ceph 2024-09-11T23:07:37.952 INFO:tasks.cephadm:Writing seed config... 2024-09-11T23:07:37.954 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-09-11T23:07:37.954 INFO:tasks.cephadm: override: [client] debug client = 20 2024-09-11T23:07:37.954 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-09-11T23:07:37.954 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-09-11T23:07:37.954 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-09-11T23:07:37.954 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-09-11T23:07:37.954 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-09-11T23:07:37.954 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-09-11T23:07:37.955 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-09-11T23:07:37.955 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-09-11T23:07:37.955 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-09-11T23:07:37.955 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-09-11T23:07:37.955 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-09-11T23:07:37.955 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-09-11T23:07:37.955 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-09-11T23:07:37.955 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-09-11T23:07:37.955 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-09-11T23:07:37.955 INFO:tasks.cephadm: override: [mds] mds_export_ephemeral_random_max = 0.1 2024-09-11T23:07:37.955 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-09-11T23:07:37.955 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-09-11T23:07:37.955 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-09-11T23:07:37.955 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-09-11T23:07:37.956 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-11T23:07:37.956 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-11T23:07:37.956 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-11T23:07:37.956 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-11T23:07:37.956 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-11T23:07:37.956 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-11T23:07:37.956 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-11T23:07:37.956 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-09-11T23:07:37.956 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-09-11T23:07:37.956 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-11T23:07:37.956 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-11T23:07:37.956 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-09-11T23:07:37.957 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-09-11T23:07:37.957 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-11T23:07:37.957 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-11T23:07:37.957 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-09-11T23:07:37.957 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-11T23:07:37.957 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-11T23:07:37.957 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-11T23:07:37.957 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-11T23:07:37.957 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-11T23:07:37.957 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-09-11T23:07:37.957 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-11T23:07:37.957 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10 2024-09-11T23:07:37.958 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-11T23:07:37.958 DEBUG:teuthology.orchestra.run.smithi037:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-11T23:07:37.993 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 8b03efce-7092-11ef-bcea-c7b262605968 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True mds_export_ephemeral_random_max = 0.1 osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-09-11T23:07:37.993 DEBUG:teuthology.orchestra.run.smithi037:mon.a> sudo journalctl -f -n 0 -u ceph-8b03efce-7092-11ef-bcea-c7b262605968@mon.a.service 2024-09-11T23:07:38.038 DEBUG:teuthology.orchestra.run.smithi037:mgr.x> sudo journalctl -f -n 0 -u ceph-8b03efce-7092-11ef-bcea-c7b262605968@mgr.x.service 2024-09-11T23:07:38.083 INFO:tasks.cephadm:Bootstrapping... 2024-09-11T23:07:38.083 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc -v bootstrap --fsid 8b03efce-7092-11ef-bcea-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.37 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-11T23:07:38.347 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2024-09-11T23:07:38.347 INFO:teuthology.orchestra.run.smithi037.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', '-v', 'bootstrap', '--fsid', '8b03efce-7092-11ef-bcea-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.37', '--skip-admin-label'] 2024-09-11T23:07:38.347 INFO:teuthology.orchestra.run.smithi037.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-11T23:07:38.347 INFO:teuthology.orchestra.run.smithi037.stdout:Verifying podman|docker is present... 2024-09-11T23:07:38.393 INFO:teuthology.orchestra.run.smithi037.stdout:/bin/podman: stdout 5.2.2 2024-09-11T23:07:38.393 INFO:teuthology.orchestra.run.smithi037.stdout:Verifying lvm2 is present... 2024-09-11T23:07:38.393 INFO:teuthology.orchestra.run.smithi037.stdout:Verifying time synchronization is in place... 2024-09-11T23:07:38.407 INFO:teuthology.orchestra.run.smithi037.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-11T23:07:38.407 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-11T23:07:38.419 INFO:teuthology.orchestra.run.smithi037.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-11T23:07:38.419 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stdout inactive 2024-09-11T23:07:38.433 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stdout enabled 2024-09-11T23:07:38.445 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stdout active 2024-09-11T23:07:38.446 INFO:teuthology.orchestra.run.smithi037.stdout:Unit chronyd.service is enabled and running 2024-09-11T23:07:38.446 INFO:teuthology.orchestra.run.smithi037.stdout:Repeating the final host check... 2024-09-11T23:07:38.489 INFO:teuthology.orchestra.run.smithi037.stdout:/bin/podman: stdout 5.2.2 2024-09-11T23:07:38.489 INFO:teuthology.orchestra.run.smithi037.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-11T23:07:38.489 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl is present 2024-09-11T23:07:38.489 INFO:teuthology.orchestra.run.smithi037.stdout:lvcreate is present 2024-09-11T23:07:38.502 INFO:teuthology.orchestra.run.smithi037.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-11T23:07:38.502 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-11T23:07:38.514 INFO:teuthology.orchestra.run.smithi037.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-11T23:07:38.514 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stdout inactive 2024-09-11T23:07:38.528 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stdout enabled 2024-09-11T23:07:38.542 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stdout active 2024-09-11T23:07:38.542 INFO:teuthology.orchestra.run.smithi037.stdout:Unit chronyd.service is enabled and running 2024-09-11T23:07:38.542 INFO:teuthology.orchestra.run.smithi037.stdout:Host looks OK 2024-09-11T23:07:38.542 INFO:teuthology.orchestra.run.smithi037.stdout:Cluster fsid: 8b03efce-7092-11ef-bcea-c7b262605968 2024-09-11T23:07:38.542 INFO:teuthology.orchestra.run.smithi037.stdout:Acquiring lock 140177146643312 on /run/cephadm/8b03efce-7092-11ef-bcea-c7b262605968.lock 2024-09-11T23:07:38.542 INFO:teuthology.orchestra.run.smithi037.stdout:Lock 140177146643312 acquired on /run/cephadm/8b03efce-7092-11ef-bcea-c7b262605968.lock 2024-09-11T23:07:38.542 INFO:teuthology.orchestra.run.smithi037.stdout:Verifying IP 172.21.15.37 port 3300 ... 2024-09-11T23:07:38.542 INFO:teuthology.orchestra.run.smithi037.stdout:Verifying IP 172.21.15.37 port 6789 ... 2024-09-11T23:07:38.542 INFO:teuthology.orchestra.run.smithi037.stdout:Base mon IP(s) is [172.21.15.37:3300, 172.21.15.37:6789], mon addrv is [v2:172.21.15.37:3300,v1:172.21.15.37:6789] 2024-09-11T23:07:38.548 INFO:teuthology.orchestra.run.smithi037.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.37 metric 100 2024-09-11T23:07:38.548 INFO:teuthology.orchestra.run.smithi037.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.37 metric 100 2024-09-11T23:07:38.554 INFO:teuthology.orchestra.run.smithi037.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-11T23:07:38.554 INFO:teuthology.orchestra.run.smithi037.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2024-09-11T23:07:38.554 INFO:teuthology.orchestra.run.smithi037.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1789sec hoplimit 64 pref medium 2024-09-11T23:07:38.560 INFO:teuthology.orchestra.run.smithi037.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-11T23:07:38.560 INFO:teuthology.orchestra.run.smithi037.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-11T23:07:38.560 INFO:teuthology.orchestra.run.smithi037.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-11T23:07:38.560 INFO:teuthology.orchestra.run.smithi037.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-09-11T23:07:38.560 INFO:teuthology.orchestra.run.smithi037.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe88:7794/64 scope link 2024-09-11T23:07:38.561 INFO:teuthology.orchestra.run.smithi037.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-11T23:07:38.561 INFO:teuthology.orchestra.run.smithi037.stdout:Mon IP `172.21.15.37` is in CIDR network `172.21.0.0/20` 2024-09-11T23:07:38.561 INFO:teuthology.orchestra.run.smithi037.stdout:Mon IP `172.21.15.37` is in CIDR network `172.21.0.0/20` 2024-09-11T23:07:38.561 INFO:teuthology.orchestra.run.smithi037.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-11T23:07:38.562 INFO:teuthology.orchestra.run.smithi037.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-11T23:07:38.563 INFO:teuthology.orchestra.run.smithi037.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc... 2024-09-11T23:07:39.098 INFO:teuthology.orchestra.run.smithi037.stdout:/bin/podman: stdout 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 2024-09-11T23:07:39.099 INFO:teuthology.orchestra.run.smithi037.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc... 2024-09-11T23:07:39.099 INFO:teuthology.orchestra.run.smithi037.stdout:/bin/podman: stderr Getting image source signatures 2024-09-11T23:07:39.099 INFO:teuthology.orchestra.run.smithi037.stdout:/bin/podman: stderr Copying blob sha256:60180723200353b4e13b39fd162aecaf1bc097c859c7c6537324229e97c78567 2024-09-11T23:07:39.099 INFO:teuthology.orchestra.run.smithi037.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-11T23:07:39.099 INFO:teuthology.orchestra.run.smithi037.stdout:/bin/podman: stderr Copying config sha256:54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 2024-09-11T23:07:39.099 INFO:teuthology.orchestra.run.smithi037.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-11T23:07:40.077 INFO:teuthology.orchestra.run.smithi037.stdout:ceph: stdout ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable) 2024-09-11T23:07:40.077 INFO:teuthology.orchestra.run.smithi037.stdout:Ceph version: ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable) 2024-09-11T23:07:40.077 INFO:teuthology.orchestra.run.smithi037.stdout:Extracting ceph user uid/gid from container image... 2024-09-11T23:07:41.477 INFO:teuthology.orchestra.run.smithi037.stdout:stat: stdout 167 167 2024-09-11T23:07:41.478 INFO:teuthology.orchestra.run.smithi037.stdout:Creating initial keys... 2024-09-11T23:07:42.431 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph-authtool: stdout AQC9IuJmAJaVMhAAc+EUhvYjziNkPoV0xTmYug== 2024-09-11T23:07:43.497 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph-authtool: stdout AQC+IuJmxNLbNxAAsb4+ZZvkkBYJOtNIVekcZQ== 2024-09-11T23:07:44.499 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph-authtool: stdout AQC/IuJmA7UvNBAAXw3NeDjhPlGdn+r/jM9ixQ== 2024-09-11T23:07:44.500 INFO:teuthology.orchestra.run.smithi037.stdout:Creating initial monmap... 2024-09-11T23:07:45.579 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-11T23:07:45.580 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-11T23:07:45.580 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 8b03efce-7092-11ef-bcea-c7b262605968 2024-09-11T23:07:45.580 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-11T23:07:45.580 INFO:teuthology.orchestra.run.smithi037.stdout:monmaptool for a [v2:172.21.15.37:3300,v1:172.21.15.37:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-11T23:07:45.580 INFO:teuthology.orchestra.run.smithi037.stdout:setting min_mon_release = quincy 2024-09-11T23:07:45.580 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/monmaptool: set fsid to 8b03efce-7092-11ef-bcea-c7b262605968 2024-09-11T23:07:45.580 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-11T23:07:45.580 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:07:45.580 INFO:teuthology.orchestra.run.smithi037.stdout:Creating mon... 2024-09-11T23:07:57.314 INFO:teuthology.orchestra.run.smithi037.stdout:create mon.a on 2024-09-11T23:07:57.633 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-11T23:07:57.858 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-11T23:07:58.153 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-8b03efce-7092-11ef-bcea-c7b262605968.target → /etc/systemd/system/ceph-8b03efce-7092-11ef-bcea-c7b262605968.target. 2024-09-11T23:07:58.153 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-8b03efce-7092-11ef-bcea-c7b262605968.target → /etc/systemd/system/ceph-8b03efce-7092-11ef-bcea-c7b262605968.target. 2024-09-11T23:07:58.483 INFO:teuthology.orchestra.run.smithi037.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-8b03efce-7092-11ef-bcea-c7b262605968@mon.a 2024-09-11T23:07:58.483 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stderr Failed to reset failed state of unit ceph-8b03efce-7092-11ef-bcea-c7b262605968@mon.a.service: Unit ceph-8b03efce-7092-11ef-bcea-c7b262605968@mon.a.service not loaded. 2024-09-11T23:07:58.765 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-8b03efce-7092-11ef-bcea-c7b262605968.target.wants/ceph-8b03efce-7092-11ef-bcea-c7b262605968@mon.a.service → /etc/systemd/system/ceph-8b03efce-7092-11ef-bcea-c7b262605968@.service. 2024-09-11T23:07:59.390 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:07:59 smithi037 podman[30253]: 2024-09-11 23:07:59.326844297 +0000 UTC m=+0.341636771 container start 9425e65770c6b89e1f5c0ce53c0feb424e671ba0a4f8b6e04fa7f5385017df6e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-mon-a, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-11T23:07:59.390 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:07:59 smithi037 ceph-mon[30272]: mkfs 8b03efce-7092-11ef-bcea-c7b262605968 2024-09-11T23:07:59.440 INFO:teuthology.orchestra.run.smithi037.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-11T23:07:59.440 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stdout disabled 2024-09-11T23:07:59.454 INFO:teuthology.orchestra.run.smithi037.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-11T23:07:59.454 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stdout inactive 2024-09-11T23:07:59.454 INFO:teuthology.orchestra.run.smithi037.stdout:firewalld.service is not enabled 2024-09-11T23:07:59.454 INFO:teuthology.orchestra.run.smithi037.stdout:Not possible to enable service . firewalld.service is not available 2024-09-11T23:07:59.454 INFO:teuthology.orchestra.run.smithi037.stdout:Waiting for mon to start... 2024-09-11T23:07:59.455 INFO:teuthology.orchestra.run.smithi037.stdout:Waiting for mon... 2024-09-11T23:07:59.705 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:07:59 smithi037 ceph-mon[30272]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-11T23:07:59.705 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:07:59 smithi037 bash[30253]: 9425e65770c6b89e1f5c0ce53c0feb424e671ba0a4f8b6e04fa7f5385017df6e 2024-09-11T23:07:59.705 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:07:59 smithi037 systemd[1]: Started Ceph mon.a for 8b03efce-7092-11ef-bcea-c7b262605968. 2024-09-11T23:08:00.631 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:00 smithi037 ceph-mon[30272]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-11T23:08:00.631 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:00 smithi037 ceph-mon[30272]: monmap epoch 1 2024-09-11T23:08:00.631 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:00 smithi037 ceph-mon[30272]: fsid 8b03efce-7092-11ef-bcea-c7b262605968 2024-09-11T23:08:00.631 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:00 smithi037 ceph-mon[30272]: last_changed 2024-09-11T23:07:45.034404+0000 2024-09-11T23:08:00.631 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:00 smithi037 ceph-mon[30272]: created 2024-09-11T23:07:45.034404+0000 2024-09-11T23:08:00.631 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:00 smithi037 ceph-mon[30272]: min_mon_release 19 (squid) 2024-09-11T23:08:00.632 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:00 smithi037 ceph-mon[30272]: election_strategy: 1 2024-09-11T23:08:00.632 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:00 smithi037 ceph-mon[30272]: 0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-11T23:08:00.632 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:00 smithi037 ceph-mon[30272]: fsmap 2024-09-11T23:08:00.632 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:00 smithi037 ceph-mon[30272]: osdmap e1: 0 total, 0 up, 0 in 2024-09-11T23:08:00.632 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:00 smithi037 ceph-mon[30272]: mgrmap e1: no daemons active 2024-09-11T23:08:00.632 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:00 smithi037 ceph-mon[30272]: from='client.? 172.21.15.37:0/1265679218' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-11T23:08:00.638 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout cluster: 2024-09-11T23:08:00.638 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout id: 8b03efce-7092-11ef-bcea-c7b262605968 2024-09-11T23:08:00.638 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-11T23:08:00.638 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 2024-09-11T23:08:00.638 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout services: 2024-09-11T23:08:00.638 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.667588s) 2024-09-11T23:08:00.638 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-11T23:08:00.639 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-11T23:08:00.639 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 2024-09-11T23:08:00.639 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout data: 2024-09-11T23:08:00.639 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-11T23:08:00.639 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-11T23:08:00.639 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-11T23:08:00.639 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout pgs: 2024-09-11T23:08:00.639 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 2024-09-11T23:08:00.639 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:07:59.973+0000 7f990f200640 1 Processor -- start 2024-09-11T23:08:00.639 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:07:59.974+0000 7f990f200640 1 -- start start 2024-09-11T23:08:00.639 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:07:59.974+0000 7f990f200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9910109910 0x7f9910109d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:08:00.640 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:07:59.974+0000 7f990f200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f991010a2e0 con 0x7f9910109910 2024-09-11T23:08:00.640 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:07:59.975+0000 7f990de00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9910109910 0x7f9910109d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:08:00.640 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:07:59.975+0000 7f990de00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9910109910 0x7f9910109d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44822/0 (socket says 172.21.15.37:44822) 2024-09-11T23:08:00.640 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:07:59.975+0000 7f990de00640 1 -- 172.21.15.37:0/865903364 learned_addr learned my addr 172.21.15.37:0/865903364 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:08:00.640 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:07:59.975+0000 7f990de00640 1 -- 172.21.15.37:0/865903364 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f991010a770 con 0x7f9910109910 2024-09-11T23:08:00.640 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:07:59.978+0000 7f990de00640 1 --2- 172.21.15.37:0/865903364 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9910109910 0x7f9910109d10 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f9900009820 tx=0x7f990002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b414af6ea3dc6a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:08:00.640 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:07:59.978+0000 7f990d400640 1 -- 172.21.15.37:0/865903364 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9900037070 con 0x7f9910109910 2024-09-11T23:08:00.640 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:07:59.978+0000 7f990d400640 1 -- 172.21.15.37:0/865903364 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9900032440 con 0x7f9910109910 2024-09-11T23:08:00.640 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:07:59.978+0000 7f990d400640 1 -- 172.21.15.37:0/865903364 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9900032740 con 0x7f9910109910 2024-09-11T23:08:00.640 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:07:59.979+0000 7f990f200640 1 -- 172.21.15.37:0/865903364 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9910109910 msgr2=0x7f9910109d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:08:00.640 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:07:59.979+0000 7f990f200640 1 --2- 172.21.15.37:0/865903364 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9910109910 0x7f9910109d10 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f9900009820 tx=0x7f990002a270 comp rx=0 tx=0).stop 2024-09-11T23:08:00.641 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:07:59.979+0000 7f990f200640 1 -- 172.21.15.37:0/865903364 shutdown_connections 2024-09-11T23:08:00.641 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:07:59.979+0000 7f990f200640 1 --2- 172.21.15.37:0/865903364 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9910109910 0x7f9910109d10 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:08:00.641 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:07:59.979+0000 7f990f200640 1 -- 172.21.15.37:0/865903364 >> 172.21.15.37:0/865903364 conn(0x7f991007cc40 msgr2=0x7f991007d050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:08:00.641 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:07:59.979+0000 7f990f200640 1 -- 172.21.15.37:0/865903364 shutdown_connections 2024-09-11T23:08:00.641 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:07:59.979+0000 7f990f200640 1 -- 172.21.15.37:0/865903364 wait complete. 2024-09-11T23:08:00.641 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:07:59.980+0000 7f990f200640 1 Processor -- start 2024-09-11T23:08:00.641 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:07:59.980+0000 7f990f200640 1 -- start start 2024-09-11T23:08:00.641 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:07:59.981+0000 7f990f200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9910109910 0x7f991019cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:08:00.641 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:07:59.981+0000 7f990f200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f991010ad10 con 0x7f9910109910 2024-09-11T23:08:00.641 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:07:59.981+0000 7f990de00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9910109910 0x7f991019cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:08:00.641 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:07:59.981+0000 7f990de00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9910109910 0x7f991019cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44834/0 (socket says 172.21.15.37:44834) 2024-09-11T23:08:00.641 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:07:59.981+0000 7f990de00640 1 -- 172.21.15.37:0/1265679218 learned_addr learned my addr 172.21.15.37:0/1265679218 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:08:00.641 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:07:59.981+0000 7f990de00640 1 -- 172.21.15.37:0/1265679218 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f991019d2e0 con 0x7f9910109910 2024-09-11T23:08:00.642 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:07:59.982+0000 7f990de00640 1 --2- 172.21.15.37:0/1265679218 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9910109910 0x7f991019cda0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f99000090b0 tx=0x7f99000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:08:00.642 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:07:59.982+0000 7f9906a00640 1 -- 172.21.15.37:0/1265679218 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9900041070 con 0x7f9910109910 2024-09-11T23:08:00.642 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:07:59.982+0000 7f9906a00640 1 -- 172.21.15.37:0/1265679218 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f990003c7a0 con 0x7f9910109910 2024-09-11T23:08:00.642 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:07:59.982+0000 7f9906a00640 1 -- 172.21.15.37:0/1265679218 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9900037040 con 0x7f9910109910 2024-09-11T23:08:00.642 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:07:59.982+0000 7f990f200640 1 -- 172.21.15.37:0/1265679218 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f991019d570 con 0x7f9910109910 2024-09-11T23:08:00.642 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:07:59.982+0000 7f990f200640 1 -- 172.21.15.37:0/1265679218 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99101a0260 con 0x7f9910109910 2024-09-11T23:08:00.642 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:07:59.982+0000 7f9906a00640 1 -- 172.21.15.37:0/1265679218 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f9900044070 con 0x7f9910109910 2024-09-11T23:08:00.642 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:07:59.983+0000 7f9906a00640 1 -- 172.21.15.37:0/1265679218 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f990003d3f0 con 0x7f9910109910 2024-09-11T23:08:00.642 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:07:59.983+0000 7f990f200640 1 -- 172.21.15.37:0/1265679218 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f991010b3d0 con 0x7f9910109910 2024-09-11T23:08:00.642 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:07:59.986+0000 7f9906a00640 1 -- 172.21.15.37:0/1265679218 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f9900046450 con 0x7f9910109910 2024-09-11T23:08:00.642 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:00.052+0000 7f990f200640 1 -- 172.21.15.37:0/1265679218 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7f991002d910 con 0x7f9910109910 2024-09-11T23:08:00.642 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:00.052+0000 7f9906a00640 1 -- 172.21.15.37:0/1265679218 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+317 (secure 0 0 0) 0x7f9900046630 con 0x7f9910109910 2024-09-11T23:08:00.642 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:00.053+0000 7f990f200640 1 -- 172.21.15.37:0/1265679218 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9910109910 msgr2=0x7f991019cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:08:00.643 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:00.053+0000 7f990f200640 1 --2- 172.21.15.37:0/1265679218 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9910109910 0x7f991019cda0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f99000090b0 tx=0x7f99000046c0 comp rx=0 tx=0).stop 2024-09-11T23:08:00.643 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:00.053+0000 7f990f200640 1 -- 172.21.15.37:0/1265679218 shutdown_connections 2024-09-11T23:08:00.643 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:00.053+0000 7f990f200640 1 --2- 172.21.15.37:0/1265679218 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9910109910 0x7f991019cda0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:08:00.643 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:00.053+0000 7f990f200640 1 -- 172.21.15.37:0/1265679218 >> 172.21.15.37:0/1265679218 conn(0x7f991007cc40 msgr2=0x7f9910193ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:08:00.643 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:00.053+0000 7f990f200640 1 -- 172.21.15.37:0/1265679218 shutdown_connections 2024-09-11T23:08:00.643 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:00.053+0000 7f990f200640 1 -- 172.21.15.37:0/1265679218 wait complete. 2024-09-11T23:08:00.643 INFO:teuthology.orchestra.run.smithi037.stdout:mon is available 2024-09-11T23:08:00.643 INFO:teuthology.orchestra.run.smithi037.stdout:Assimilating anything we can from ceph.conf... 2024-09-11T23:08:01.459 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:01 smithi037 ceph-mon[30272]: from='client.? 172.21.15.37:0/2834314563' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-11T23:08:01.460 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:01 smithi037 ceph-mon[30272]: from='client.? 172.21.15.37:0/2834314563' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-11T23:08:02.166 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 2024-09-11T23:08:02.166 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout [global] 2024-09-11T23:08:02.166 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout fsid = 8b03efce-7092-11ef-bcea-c7b262605968 2024-09-11T23:08:02.167 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.37:3300,v1:172.21.15.37:6789] 2024-09-11T23:08:02.167 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-11T23:08:02.167 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-11T23:08:02.167 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-11T23:08:02.167 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-11T23:08:02.167 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 2024-09-11T23:08:02.167 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-11T23:08:02.167 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-11T23:08:02.167 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 2024-09-11T23:08:02.167 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout [osd] 2024-09-11T23:08:02.167 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-11T23:08:02.167 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-11T23:08:02.167 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-11T23:08:02.168 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-11T23:08:02.168 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-11T23:08:02.168 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:01.127+0000 7f2f9ac00640 1 Processor -- start 2024-09-11T23:08:02.168 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:01.127+0000 7f2f9ac00640 1 -- start start 2024-09-11T23:08:02.168 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:01.127+0000 7f2f9ac00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f941098c0 0x7f2f94109cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:08:02.168 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:01.127+0000 7f2f9ac00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2f9410a290 con 0x7f2f941098c0 2024-09-11T23:08:02.168 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:01.128+0000 7f2f93e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f941098c0 0x7f2f94109cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:08:02.168 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:01.128+0000 7f2f93e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f941098c0 0x7f2f94109cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44838/0 (socket says 172.21.15.37:44838) 2024-09-11T23:08:02.168 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:01.128+0000 7f2f93e00640 1 -- 172.21.15.37:0/125027714 learned_addr learned my addr 172.21.15.37:0/125027714 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:08:02.168 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:01.128+0000 7f2f93e00640 1 -- 172.21.15.37:0/125027714 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f9410a9b0 con 0x7f2f941098c0 2024-09-11T23:08:02.168 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:01.129+0000 7f2f93e00640 1 --2- 172.21.15.37:0/125027714 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f941098c0 0x7f2f94109cc0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f2f84009820 tx=0x7f2f8402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cdb7f12097b4d3b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:08:02.168 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:01.130+0000 7f2f92a00640 1 -- 172.21.15.37:0/125027714 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f84037070 con 0x7f2f941098c0 2024-09-11T23:08:02.168 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:01.130+0000 7f2f92a00640 1 -- 172.21.15.37:0/125027714 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f84032440 con 0x7f2f941098c0 2024-09-11T23:08:02.169 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:01.130+0000 7f2f92a00640 1 -- 172.21.15.37:0/125027714 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f84032740 con 0x7f2f941098c0 2024-09-11T23:08:02.169 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:01.130+0000 7f2f9ac00640 1 -- 172.21.15.37:0/125027714 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f941098c0 msgr2=0x7f2f94109cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:08:02.169 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:01.130+0000 7f2f9ac00640 1 --2- 172.21.15.37:0/125027714 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f941098c0 0x7f2f94109cc0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f2f84009820 tx=0x7f2f8402a270 comp rx=0 tx=0).stop 2024-09-11T23:08:02.169 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:01.130+0000 7f2f9ac00640 1 -- 172.21.15.37:0/125027714 shutdown_connections 2024-09-11T23:08:02.169 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:01.130+0000 7f2f9ac00640 1 --2- 172.21.15.37:0/125027714 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f941098c0 0x7f2f94109cc0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:08:02.169 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:01.130+0000 7f2f9ac00640 1 -- 172.21.15.37:0/125027714 >> 172.21.15.37:0/125027714 conn(0x7f2f9407ce20 msgr2=0x7f2f9407d230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:08:02.169 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:01.130+0000 7f2f9ac00640 1 -- 172.21.15.37:0/125027714 shutdown_connections 2024-09-11T23:08:02.169 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:01.131+0000 7f2f9ac00640 1 -- 172.21.15.37:0/125027714 wait complete. 2024-09-11T23:08:02.169 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:01.131+0000 7f2f9ac00640 1 Processor -- start 2024-09-11T23:08:02.169 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:01.132+0000 7f2f9ac00640 1 -- start start 2024-09-11T23:08:02.169 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:01.132+0000 7f2f9ac00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f941098c0 0x7f2f941a1680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:08:02.169 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:01.132+0000 7f2f9ac00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2f9410aee0 con 0x7f2f941098c0 2024-09-11T23:08:02.170 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:01.132+0000 7f2f93e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f941098c0 0x7f2f941a1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:08:02.170 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:01.132+0000 7f2f93e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f941098c0 0x7f2f941a1680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44840/0 (socket says 172.21.15.37:44840) 2024-09-11T23:08:02.170 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:01.132+0000 7f2f93e00640 1 -- 172.21.15.37:0/2834314563 learned_addr learned my addr 172.21.15.37:0/2834314563 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:08:02.170 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:01.132+0000 7f2f93e00640 1 -- 172.21.15.37:0/2834314563 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f941a1bc0 con 0x7f2f941098c0 2024-09-11T23:08:02.170 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:01.133+0000 7f2f93e00640 1 --2- 172.21.15.37:0/2834314563 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f941098c0 0x7f2f941a1680 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f2f840090b0 tx=0x7f2f840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:08:02.170 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:01.133+0000 7f2f90c00640 1 -- 172.21.15.37:0/2834314563 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f84041070 con 0x7f2f941098c0 2024-09-11T23:08:02.170 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:01.133+0000 7f2f90c00640 1 -- 172.21.15.37:0/2834314563 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f8403c7a0 con 0x7f2f941098c0 2024-09-11T23:08:02.170 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:01.133+0000 7f2f90c00640 1 -- 172.21.15.37:0/2834314563 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f84037040 con 0x7f2f941098c0 2024-09-11T23:08:02.170 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:01.133+0000 7f2f9ac00640 1 -- 172.21.15.37:0/2834314563 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f941a1e50 con 0x7f2f941098c0 2024-09-11T23:08:02.170 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:01.133+0000 7f2f9ac00640 1 -- 172.21.15.37:0/2834314563 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f941a4b40 con 0x7f2f941098c0 2024-09-11T23:08:02.170 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:01.134+0000 7f2f90c00640 1 -- 172.21.15.37:0/2834314563 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f2f84044070 con 0x7f2f941098c0 2024-09-11T23:08:02.170 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:01.134+0000 7f2f90c00640 1 -- 172.21.15.37:0/2834314563 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f2f8403d3f0 con 0x7f2f941098c0 2024-09-11T23:08:02.170 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:01.134+0000 7f2f9ac00640 1 -- 172.21.15.37:0/2834314563 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f9410b530 con 0x7f2f941098c0 2024-09-11T23:08:02.171 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:01.137+0000 7f2f90c00640 1 -- 172.21.15.37:0/2834314563 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f2f84046450 con 0x7f2f941098c0 2024-09-11T23:08:02.171 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:01.200+0000 7f2f9ac00640 1 -- 172.21.15.37:0/2834314563 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f2f941a5e90 con 0x7f2f941098c0 2024-09-11T23:08:02.171 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:01.204+0000 7f2f90c00640 1 -- 172.21.15.37:0/2834314563 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+429 (secure 0 0 0) 0x7f2f84046630 con 0x7f2f941098c0 2024-09-11T23:08:02.171 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:01.205+0000 7f2f90c00640 1 -- 172.21.15.37:0/2834314563 <== mon.0 v2:172.21.15.37:3300/0 8 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2f84056070 con 0x7f2f941098c0 2024-09-11T23:08:02.171 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:01.206+0000 7f2f9ac00640 1 -- 172.21.15.37:0/2834314563 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f941098c0 msgr2=0x7f2f941a1680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:08:02.171 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:01.206+0000 7f2f9ac00640 1 --2- 172.21.15.37:0/2834314563 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f941098c0 0x7f2f941a1680 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f2f840090b0 tx=0x7f2f840046c0 comp rx=0 tx=0).stop 2024-09-11T23:08:02.171 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:01.206+0000 7f2f9ac00640 1 -- 172.21.15.37:0/2834314563 shutdown_connections 2024-09-11T23:08:02.171 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:01.206+0000 7f2f9ac00640 1 --2- 172.21.15.37:0/2834314563 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f941098c0 0x7f2f941a1680 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:08:02.171 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:01.206+0000 7f2f9ac00640 1 -- 172.21.15.37:0/2834314563 >> 172.21.15.37:0/2834314563 conn(0x7f2f9407ce20 msgr2=0x7f2f940802a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:08:02.171 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:01.206+0000 7f2f9ac00640 1 -- 172.21.15.37:0/2834314563 shutdown_connections 2024-09-11T23:08:02.171 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:01.206+0000 7f2f9ac00640 1 -- 172.21.15.37:0/2834314563 wait complete. 2024-09-11T23:08:02.171 INFO:teuthology.orchestra.run.smithi037.stdout:Generating new minimal ceph.conf... 2024-09-11T23:08:03.017 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:02 smithi037 ceph-mon[30272]: from='client.? 172.21.15.37:0/2881902458' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:08:03.284 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:02.643+0000 7f3fd5000640 1 Processor -- start 2024-09-11T23:08:03.285 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:02.643+0000 7f3fd5000640 1 -- start start 2024-09-11T23:08:03.285 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:02.643+0000 7f3fd5000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3fd007cd20 0x7f3fd007b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:08:03.285 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:02.643+0000 7f3fd5000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3fd007b7a0 con 0x7f3fd007cd20 2024-09-11T23:08:03.285 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:02.644+0000 7f3fcf400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3fd007cd20 0x7f3fd007b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:08:03.285 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:02.644+0000 7f3fcf400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3fd007cd20 0x7f3fd007b1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44846/0 (socket says 172.21.15.37:44846) 2024-09-11T23:08:03.285 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:02.644+0000 7f3fcf400640 1 -- 172.21.15.37:0/627310759 learned_addr learned my addr 172.21.15.37:0/627310759 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:08:03.285 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:02.644+0000 7f3fcf400640 1 -- 172.21.15.37:0/627310759 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fd007b920 con 0x7f3fd007cd20 2024-09-11T23:08:03.285 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:02.645+0000 7f3fcf400640 1 --2- 172.21.15.37:0/627310759 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3fd007cd20 0x7f3fd007b1d0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f3fc0009820 tx=0x7f3fc002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f3e31245b214a58 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:08:03.285 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:02.645+0000 7f3fce000640 1 -- 172.21.15.37:0/627310759 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fc0037070 con 0x7f3fd007cd20 2024-09-11T23:08:03.285 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:02.646+0000 7f3fce000640 1 -- 172.21.15.37:0/627310759 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3fc0032900 con 0x7f3fd007cd20 2024-09-11T23:08:03.285 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:02.646+0000 7f3fce000640 1 -- 172.21.15.37:0/627310759 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fc0030850 con 0x7f3fd007cd20 2024-09-11T23:08:03.286 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:02.646+0000 7f3fd5000640 1 -- 172.21.15.37:0/627310759 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3fd007cd20 msgr2=0x7f3fd007b1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:08:03.286 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:02.646+0000 7f3fd5000640 1 --2- 172.21.15.37:0/627310759 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3fd007cd20 0x7f3fd007b1d0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f3fc0009820 tx=0x7f3fc002a270 comp rx=0 tx=0).stop 2024-09-11T23:08:03.286 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:02.646+0000 7f3fd5000640 1 -- 172.21.15.37:0/627310759 shutdown_connections 2024-09-11T23:08:03.286 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:02.646+0000 7f3fd5000640 1 --2- 172.21.15.37:0/627310759 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3fd007cd20 0x7f3fd007b1d0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:08:03.286 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:02.646+0000 7f3fd5000640 1 -- 172.21.15.37:0/627310759 >> 172.21.15.37:0/627310759 conn(0x7f3fd0102c10 msgr2=0x7f3fd0105030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:08:03.286 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:02.646+0000 7f3fd5000640 1 -- 172.21.15.37:0/627310759 shutdown_connections 2024-09-11T23:08:03.286 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:02.646+0000 7f3fd5000640 1 -- 172.21.15.37:0/627310759 wait complete. 2024-09-11T23:08:03.286 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:02.647+0000 7f3fd5000640 1 Processor -- start 2024-09-11T23:08:03.286 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:02.648+0000 7f3fd5000640 1 -- start start 2024-09-11T23:08:03.286 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:02.648+0000 7f3fd5000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3fd007cd20 0x7f3fd01a19c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:08:03.286 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:02.648+0000 7f3fd5000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3fd01095e0 con 0x7f3fd007cd20 2024-09-11T23:08:03.286 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:02.648+0000 7f3fcf400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3fd007cd20 0x7f3fd01a19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:08:03.286 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:02.648+0000 7f3fcf400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3fd007cd20 0x7f3fd01a19c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44860/0 (socket says 172.21.15.37:44860) 2024-09-11T23:08:03.287 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:02.648+0000 7f3fcf400640 1 -- 172.21.15.37:0/2881902458 learned_addr learned my addr 172.21.15.37:0/2881902458 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:08:03.287 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:02.648+0000 7f3fcf400640 1 -- 172.21.15.37:0/2881902458 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fd01a1f00 con 0x7f3fd007cd20 2024-09-11T23:08:03.287 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:02.649+0000 7f3fcf400640 1 --2- 172.21.15.37:0/2881902458 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3fd007cd20 0x7f3fd01a19c0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f3fc00097f0 tx=0x7f3fc0030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:08:03.287 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:02.649+0000 7f3fc7e00640 1 -- 172.21.15.37:0/2881902458 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fc0037040 con 0x7f3fd007cd20 2024-09-11T23:08:03.287 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:02.649+0000 7f3fc7e00640 1 -- 172.21.15.37:0/2881902458 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3fc0040070 con 0x7f3fd007cd20 2024-09-11T23:08:03.287 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:02.649+0000 7f3fc7e00640 1 -- 172.21.15.37:0/2881902458 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fc003a390 con 0x7f3fd007cd20 2024-09-11T23:08:03.287 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:02.649+0000 7f3fd5000640 1 -- 172.21.15.37:0/2881902458 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fd01a2190 con 0x7f3fd007cd20 2024-09-11T23:08:03.287 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:02.649+0000 7f3fd5000640 1 -- 172.21.15.37:0/2881902458 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fd01a4e80 con 0x7f3fd007cd20 2024-09-11T23:08:03.287 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:02.649+0000 7f3fc7e00640 1 -- 172.21.15.37:0/2881902458 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3fc003a5e0 con 0x7f3fd007cd20 2024-09-11T23:08:03.287 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:02.650+0000 7f3fc7e00640 1 -- 172.21.15.37:0/2881902458 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f3fc00459a0 con 0x7f3fd007cd20 2024-09-11T23:08:03.287 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:02.651+0000 7f3fd5000640 1 -- 172.21.15.37:0/2881902458 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fd007b250 con 0x7f3fd007cd20 2024-09-11T23:08:03.287 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:02.653+0000 7f3fc7e00640 1 -- 172.21.15.37:0/2881902458 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f3fc0045460 con 0x7f3fd007cd20 2024-09-11T23:08:03.287 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:02.716+0000 7f3fd5000640 1 -- 172.21.15.37:0/2881902458 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f3fd019ae30 con 0x7f3fd007cd20 2024-09-11T23:08:03.288 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:02.716+0000 7f3fc7e00640 1 -- 172.21.15.37:0/2881902458 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+175 (secure 0 0 0) 0x7f3fc003b430 con 0x7f3fd007cd20 2024-09-11T23:08:03.288 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:02.717+0000 7f3fd5000640 1 -- 172.21.15.37:0/2881902458 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3fd007cd20 msgr2=0x7f3fd01a19c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:08:03.288 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:02.717+0000 7f3fd5000640 1 --2- 172.21.15.37:0/2881902458 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3fd007cd20 0x7f3fd01a19c0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f3fc00097f0 tx=0x7f3fc0030d80 comp rx=0 tx=0).stop 2024-09-11T23:08:03.288 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:02.717+0000 7f3fd5000640 1 -- 172.21.15.37:0/2881902458 shutdown_connections 2024-09-11T23:08:03.288 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:02.717+0000 7f3fd5000640 1 --2- 172.21.15.37:0/2881902458 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3fd007cd20 0x7f3fd01a19c0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:08:03.288 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:02.717+0000 7f3fd5000640 1 -- 172.21.15.37:0/2881902458 >> 172.21.15.37:0/2881902458 conn(0x7f3fd0102c10 msgr2=0x7f3fd0105000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:08:03.288 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:02.717+0000 7f3fd5000640 1 -- 172.21.15.37:0/2881902458 shutdown_connections 2024-09-11T23:08:03.288 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:02.718+0000 7f3fd5000640 1 -- 172.21.15.37:0/2881902458 wait complete. 2024-09-11T23:08:03.288 INFO:teuthology.orchestra.run.smithi037.stdout:Restarting the monitor... 2024-09-11T23:08:03.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:03 smithi037 systemd[1]: Stopping Ceph mon.a for 8b03efce-7092-11ef-bcea-c7b262605968... 2024-09-11T23:08:03.970 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:03 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mon-a[30268]: 2024-09-11T23:08:03.648+0000 7f6ef0c00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T23:08:03.971 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:03 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mon-a[30268]: 2024-09-11T23:08:03.648+0000 7f6ef0c00640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-11T23:08:03.971 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:03 smithi037 podman[30509]: 2024-09-11 23:08:03.679964837 +0000 UTC m=+0.162381031 container died 9425e65770c6b89e1f5c0ce53c0feb424e671ba0a4f8b6e04fa7f5385017df6e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-mon-a, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-11T23:08:04.254 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:04 smithi037 podman[30509]: 2024-09-11 23:08:04.078055686 +0000 UTC m=+0.560471885 container cleanup 9425e65770c6b89e1f5c0ce53c0feb424e671ba0a4f8b6e04fa7f5385017df6e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-mon-a, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True) 2024-09-11T23:08:04.254 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:04 smithi037 bash[30509]: ceph-8b03efce-7092-11ef-bcea-c7b262605968-mon-a 2024-09-11T23:08:04.528 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:04 smithi037 podman[30520]: 2024-09-11 23:08:04.254031038 +0000 UTC m=+0.567216904 container remove 9425e65770c6b89e1f5c0ce53c0feb424e671ba0a4f8b6e04fa7f5385017df6e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-mon-a, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-11T23:08:04.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:04 smithi037 systemd[1]: ceph-8b03efce-7092-11ef-bcea-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-11T23:08:04.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:04 smithi037 systemd[1]: Stopped Ceph mon.a for 8b03efce-7092-11ef-bcea-c7b262605968. 2024-09-11T23:08:04.815 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:04 smithi037 systemd[1]: ceph-8b03efce-7092-11ef-bcea-c7b262605968@mon.a.service: Consumed 1.225s CPU time. 2024-09-11T23:08:04.815 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:04 smithi037 systemd[1]: Starting Ceph mon.a for 8b03efce-7092-11ef-bcea-c7b262605968... 2024-09-11T23:08:05.131 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:04 smithi037 podman[30611]: 2024-09-11 23:08:04.7607186 +0000 UTC m=+0.026931627 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T23:08:05.131 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:04 smithi037 podman[30611]: 2024-09-11 23:08:04.875577696 +0000 UTC m=+0.141790728 container create c2d2d08e1b75c98bcc194d52eaa4ad5e491a2913ce1e4e900814b8a081690385 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-mon-a, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-11T23:08:05.131 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 podman[30611]: 2024-09-11 23:08:05.090659856 +0000 UTC m=+0.356872883 container init c2d2d08e1b75c98bcc194d52eaa4ad5e491a2913ce1e4e900814b8a081690385 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-mon-a, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True) 2024-09-11T23:08:05.131 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 podman[30611]: 2024-09-11 23:08:05.097365947 +0000 UTC m=+0.363578973 container start c2d2d08e1b75c98bcc194d52eaa4ad5e491a2913ce1e4e900814b8a081690385 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-mon-a, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3) 2024-09-11T23:08:05.160 INFO:teuthology.orchestra.run.smithi037.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-11T23:08:05.409 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: set uid:gid to 167:167 (ceph:ceph) 2024-09-11T23:08:05.409 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable), process ceph-mon, pid 2 2024-09-11T23:08:05.409 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: pidfile_write: ignore empty --pid-file 2024-09-11T23:08:05.409 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: load: jerasure load: lrc 2024-09-11T23:08:05.409 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: RocksDB version: 7.9.2 2024-09-11T23:08:05.410 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Git sha 0 2024-09-11T23:08:05.410 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Compile date 2024-09-09 16:23:28 2024-09-11T23:08:05.410 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: DB SUMMARY 2024-09-11T23:08:05.410 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: DB Session ID: J3X1QTQLRX2JR6A7Z3AZ 2024-09-11T23:08:05.410 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: CURRENT file: CURRENT 2024-09-11T23:08:05.410 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: IDENTITY file: IDENTITY 2024-09-11T23:08:05.410 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-11T23:08:05.410 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-11T23:08:05.410 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 104832 ; 2024-09-11T23:08:05.410 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.error_if_exists: 0 2024-09-11T23:08:05.410 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.create_if_missing: 0 2024-09-11T23:08:05.410 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.paranoid_checks: 1 2024-09-11T23:08:05.411 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-11T23:08:05.411 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-11T23:08:05.411 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-11T23:08:05.411 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.env: 0x559186a45940 2024-09-11T23:08:05.411 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.fs: PosixFileSystem 2024-09-11T23:08:05.411 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.info_log: 0x55918eeeb6a0 2024-09-11T23:08:05.411 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.max_file_opening_threads: 16 2024-09-11T23:08:05.411 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.statistics: (nil) 2024-09-11T23:08:05.411 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.use_fsync: 0 2024-09-11T23:08:05.411 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.max_log_file_size: 0 2024-09-11T23:08:05.411 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-11T23:08:05.411 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-11T23:08:05.411 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.keep_log_file_num: 1000 2024-09-11T23:08:05.412 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.recycle_log_file_num: 0 2024-09-11T23:08:05.412 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.allow_fallocate: 1 2024-09-11T23:08:05.412 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.allow_mmap_reads: 0 2024-09-11T23:08:05.412 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.allow_mmap_writes: 0 2024-09-11T23:08:05.412 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.use_direct_reads: 0 2024-09-11T23:08:05.412 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-11T23:08:05.412 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.create_missing_column_families: 0 2024-09-11T23:08:05.412 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.db_log_dir: 2024-09-11T23:08:05.412 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.wal_dir: 2024-09-11T23:08:05.412 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-11T23:08:05.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-11T23:08:05.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-11T23:08:05.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-11T23:08:05.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-11T23:08:05.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-11T23:08:05.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.advise_random_on_open: 1 2024-09-11T23:08:05.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.db_write_buffer_size: 0 2024-09-11T23:08:05.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.write_buffer_manager: 0x55918eefadc0 2024-09-11T23:08:05.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-11T23:08:05.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-11T23:08:05.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-11T23:08:05.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.rate_limiter: (nil) 2024-09-11T23:08:05.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-11T23:08:05.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.wal_recovery_mode: 2 2024-09-11T23:08:05.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.enable_thread_tracking: 0 2024-09-11T23:08:05.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.enable_pipelined_write: 0 2024-09-11T23:08:05.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.unordered_write: 0 2024-09-11T23:08:05.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-11T23:08:05.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-11T23:08:05.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-11T23:08:05.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-11T23:08:05.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.row_cache: None 2024-09-11T23:08:05.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.wal_filter: None 2024-09-11T23:08:05.416 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-11T23:08:05.416 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.allow_ingest_behind: 0 2024-09-11T23:08:05.416 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.two_write_queues: 0 2024-09-11T23:08:05.416 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.manual_wal_flush: 0 2024-09-11T23:08:05.416 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.wal_compression: 0 2024-09-11T23:08:05.416 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.atomic_flush: 0 2024-09-11T23:08:05.416 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-11T23:08:05.416 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-11T23:08:05.416 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-11T23:08:05.416 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.log_readahead_size: 0 2024-09-11T23:08:05.416 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-11T23:08:05.416 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.best_efforts_recovery: 0 2024-09-11T23:08:05.416 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-11T23:08:05.417 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-11T23:08:05.417 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.allow_data_in_errors: 0 2024-09-11T23:08:05.417 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.db_host_id: __hostname__ 2024-09-11T23:08:05.417 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-11T23:08:05.417 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.max_background_jobs: 2 2024-09-11T23:08:05.417 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.max_background_compactions: -1 2024-09-11T23:08:05.417 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.max_subcompactions: 1 2024-09-11T23:08:05.417 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-11T23:08:05.417 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-11T23:08:05.417 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-11T23:08:05.417 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.max_total_wal_size: 0 2024-09-11T23:08:05.417 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-11T23:08:05.417 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-11T23:08:05.418 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-11T23:08:05.418 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-11T23:08:05.418 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.max_open_files: -1 2024-09-11T23:08:05.418 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.bytes_per_sync: 0 2024-09-11T23:08:05.418 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-11T23:08:05.418 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-11T23:08:05.418 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.compaction_readahead_size: 0 2024-09-11T23:08:05.418 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.max_background_flushes: -1 2024-09-11T23:08:05.418 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Compression algorithms supported: 2024-09-11T23:08:05.418 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: kZSTD supported: 0 2024-09-11T23:08:05.418 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: kXpressCompression supported: 0 2024-09-11T23:08:05.418 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: kBZip2Compression supported: 0 2024-09-11T23:08:05.418 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-11T23:08:05.418 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: kLZ4Compression supported: 1 2024-09-11T23:08:05.419 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: kZlibCompression supported: 1 2024-09-11T23:08:05.419 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: kLZ4HCCompression supported: 1 2024-09-11T23:08:05.419 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: kSnappyCompression supported: 1 2024-09-11T23:08:05.419 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-11T23:08:05.419 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-11T23:08:05.419 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-11T23:08:05.419 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-11T23:08:05.419 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-11T23:08:05.419 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.merge_operator: 2024-09-11T23:08:05.419 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.compaction_filter: None 2024-09-11T23:08:05.419 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.compaction_filter_factory: None 2024-09-11T23:08:05.419 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.sst_partitioner_factory: None 2024-09-11T23:08:05.419 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-11T23:08:05.419 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-11T23:08:05.420 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55918eeeb300) 2024-09-11T23:08:05.420 INFO:journalctl@ceph.mon.a.smithi037.stdout: cache_index_and_filter_blocks: 1 2024-09-11T23:08:05.420 INFO:journalctl@ceph.mon.a.smithi037.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-11T23:08:05.420 INFO:journalctl@ceph.mon.a.smithi037.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-11T23:08:05.420 INFO:journalctl@ceph.mon.a.smithi037.stdout: pin_top_level_index_and_filter: 1 2024-09-11T23:08:05.420 INFO:journalctl@ceph.mon.a.smithi037.stdout: index_type: 0 2024-09-11T23:08:05.420 INFO:journalctl@ceph.mon.a.smithi037.stdout: data_block_index_type: 0 2024-09-11T23:08:05.420 INFO:journalctl@ceph.mon.a.smithi037.stdout: index_shortening: 1 2024-09-11T23:08:05.420 INFO:journalctl@ceph.mon.a.smithi037.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-11T23:08:05.420 INFO:journalctl@ceph.mon.a.smithi037.stdout: checksum: 4 2024-09-11T23:08:05.420 INFO:journalctl@ceph.mon.a.smithi037.stdout: no_block_cache: 0 2024-09-11T23:08:05.420 INFO:journalctl@ceph.mon.a.smithi037.stdout: block_cache: 0x55918eedf1f0 2024-09-11T23:08:05.420 INFO:journalctl@ceph.mon.a.smithi037.stdout: block_cache_name: BinnedLRUCache 2024-09-11T23:08:05.421 INFO:journalctl@ceph.mon.a.smithi037.stdout: block_cache_options: 2024-09-11T23:08:05.421 INFO:journalctl@ceph.mon.a.smithi037.stdout: capacity : 536870912 2024-09-11T23:08:05.421 INFO:journalctl@ceph.mon.a.smithi037.stdout: num_shard_bits : 4 2024-09-11T23:08:05.421 INFO:journalctl@ceph.mon.a.smithi037.stdout: strict_capacity_limit : 0 2024-09-11T23:08:05.421 INFO:journalctl@ceph.mon.a.smithi037.stdout: high_pri_pool_ratio: 0.000 2024-09-11T23:08:05.421 INFO:journalctl@ceph.mon.a.smithi037.stdout: block_cache_compressed: (nil) 2024-09-11T23:08:05.421 INFO:journalctl@ceph.mon.a.smithi037.stdout: persistent_cache: (nil) 2024-09-11T23:08:05.421 INFO:journalctl@ceph.mon.a.smithi037.stdout: block_size: 4096 2024-09-11T23:08:05.421 INFO:journalctl@ceph.mon.a.smithi037.stdout: block_size_deviation: 10 2024-09-11T23:08:05.421 INFO:journalctl@ceph.mon.a.smithi037.stdout: block_restart_interval: 16 2024-09-11T23:08:05.421 INFO:journalctl@ceph.mon.a.smithi037.stdout: index_block_restart_interval: 1 2024-09-11T23:08:05.421 INFO:journalctl@ceph.mon.a.smithi037.stdout: metadata_block_size: 4096 2024-09-11T23:08:05.421 INFO:journalctl@ceph.mon.a.smithi037.stdout: partition_filters: 0 2024-09-11T23:08:05.422 INFO:journalctl@ceph.mon.a.smithi037.stdout: use_delta_encoding: 1 2024-09-11T23:08:05.422 INFO:journalctl@ceph.mon.a.smithi037.stdout: filter_policy: bloomfilter 2024-09-11T23:08:05.422 INFO:journalctl@ceph.mon.a.smithi037.stdout: whole_key_filtering: 1 2024-09-11T23:08:05.422 INFO:journalctl@ceph.mon.a.smithi037.stdout: verify_compression: 0 2024-09-11T23:08:05.422 INFO:journalctl@ceph.mon.a.smithi037.stdout: read_amp_bytes_per_bit: 0 2024-09-11T23:08:05.422 INFO:journalctl@ceph.mon.a.smithi037.stdout: format_version: 5 2024-09-11T23:08:05.422 INFO:journalctl@ceph.mon.a.smithi037.stdout: enable_index_compression: 1 2024-09-11T23:08:05.422 INFO:journalctl@ceph.mon.a.smithi037.stdout: block_align: 0 2024-09-11T23:08:05.422 INFO:journalctl@ceph.mon.a.smithi037.stdout: max_auto_readahead_size: 262144 2024-09-11T23:08:05.422 INFO:journalctl@ceph.mon.a.smithi037.stdout: prepopulate_block_cache: 0 2024-09-11T23:08:05.422 INFO:journalctl@ceph.mon.a.smithi037.stdout: initial_auto_readahead_size: 8192 2024-09-11T23:08:05.422 INFO:journalctl@ceph.mon.a.smithi037.stdout: num_file_reads_for_auto_readahead: 2 2024-09-11T23:08:05.422 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.write_buffer_size: 33554432 2024-09-11T23:08:05.423 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.max_write_buffer_number: 2 2024-09-11T23:08:05.423 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.compression: NoCompression 2024-09-11T23:08:05.423 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.bottommost_compression: Disabled 2024-09-11T23:08:05.423 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.prefix_extractor: nullptr 2024-09-11T23:08:05.423 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-11T23:08:05.423 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.num_levels: 7 2024-09-11T23:08:05.423 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-11T23:08:05.423 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-11T23:08:05.423 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-11T23:08:05.423 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-11T23:08:05.423 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-11T23:08:05.423 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-11T23:08:05.423 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-11T23:08:05.423 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-11T23:08:05.424 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-11T23:08:05.424 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-11T23:08:05.424 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-11T23:08:05.424 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-11T23:08:05.424 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-11T23:08:05.424 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.compression_opts.level: 32767 2024-09-11T23:08:05.424 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.compression_opts.strategy: 0 2024-09-11T23:08:05.424 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-11T23:08:05.424 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-11T23:08:05.424 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-11T23:08:05.424 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-11T23:08:05.424 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.compression_opts.enabled: false 2024-09-11T23:08:05.424 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-11T23:08:05.425 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-11T23:08:05.425 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-11T23:08:05.425 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-11T23:08:05.425 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.target_file_size_base: 67108864 2024-09-11T23:08:05.425 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-11T23:08:05.425 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-11T23:08:05.425 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-11T23:08:05.425 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-11T23:08:05.425 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-11T23:08:05.425 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-11T23:08:05.425 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-11T23:08:05.425 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-11T23:08:05.425 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-11T23:08:05.426 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-11T23:08:05.426 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-11T23:08:05.426 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-11T23:08:05.426 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-11T23:08:05.426 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-11T23:08:05.426 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.arena_block_size: 1048576 2024-09-11T23:08:05.426 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-11T23:08:05.426 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-11T23:08:05.426 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.disable_auto_compactions: 0 2024-09-11T23:08:05.426 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-11T23:08:05.426 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-11T23:08:05.426 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-11T23:08:05.426 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-11T23:08:05.426 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-11T23:08:05.427 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-11T23:08:05.427 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-11T23:08:05.427 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-11T23:08:05.427 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-11T23:08:05.427 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-11T23:08:05.427 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-11T23:08:05.427 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.inplace_update_support: 0 2024-09-11T23:08:05.427 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-11T23:08:05.427 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-11T23:08:05.427 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-11T23:08:05.427 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-11T23:08:05.427 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.bloom_locality: 0 2024-09-11T23:08:05.427 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.max_successive_merges: 0 2024-09-11T23:08:05.428 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-11T23:08:05.428 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.paranoid_file_checks: 0 2024-09-11T23:08:05.428 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.force_consistency_checks: 1 2024-09-11T23:08:05.428 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.report_bg_io_stats: 0 2024-09-11T23:08:05.428 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.ttl: 2592000 2024-09-11T23:08:05.428 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-11T23:08:05.428 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-11T23:08:05.428 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-11T23:08:05.428 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.enable_blob_files: false 2024-09-11T23:08:05.428 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.min_blob_size: 0 2024-09-11T23:08:05.428 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.blob_file_size: 268435456 2024-09-11T23:08:05.428 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-11T23:08:05.428 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-11T23:08:05.428 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 bash[30611]: c2d2d08e1b75c98bcc194d52eaa4ad5e491a2913ce1e4e900814b8a081690385 2024-09-11T23:08:05.429 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-11T23:08:05.429 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-11T23:08:05.429 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-11T23:08:05.429 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.blob_file_starting_level: 0 2024-09-11T23:08:05.429 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-11T23:08:05.429 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-11T23:08:05.429 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-11T23:08:05.429 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: e58c3295-5e4b-42a7-aa08-bd8958ac3d03 2024-09-11T23:08:05.429 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726096085141299, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-11T23:08:05.429 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-11T23:08:05.429 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726096085144380, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 99968, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 326, "table_properties": {"data_size": 97852, "index_size": 308, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 773, "raw_key_size": 14189, "raw_average_key_size": 49, "raw_value_size": 90148, "raw_average_value_size": 316, "num_data_blocks": 12, "num_entries": 285, "num_filter_entries": 285, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726096085, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "e58c3295-5e4b-42a7-aa08-bd8958ac3d03", "db_session_id": "J3X1QTQLRX2JR6A7Z3AZ", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-11T23:08:05.429 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726096085144773, "job": 1, "event": "recovery_finished"} 2024-09-11T23:08:05.429 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-11T23:08:05.430 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-11T23:08:05.430 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55918ef0ee00 2024-09-11T23:08:05.430 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: DB pointer 0x55918f00a000 2024-09-11T23:08:05.430 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-11T23:08:05.430 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-11T23:08:05.430 INFO:journalctl@ceph.mon.a.smithi037.stdout: ** DB Stats ** 2024-09-11T23:08:05.430 INFO:journalctl@ceph.mon.a.smithi037.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-11T23:08:05.430 INFO:journalctl@ceph.mon.a.smithi037.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-11T23:08:05.430 INFO:journalctl@ceph.mon.a.smithi037.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-11T23:08:05.430 INFO:journalctl@ceph.mon.a.smithi037.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-11T23:08:05.430 INFO:journalctl@ceph.mon.a.smithi037.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-11T23:08:05.430 INFO:journalctl@ceph.mon.a.smithi037.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-11T23:08:05.430 INFO:journalctl@ceph.mon.a.smithi037.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-11T23:08:05.430 INFO:journalctl@ceph.mon.a.smithi037.stdout: 2024-09-11T23:08:05.431 INFO:journalctl@ceph.mon.a.smithi037.stdout: ** Compaction Stats [default] ** 2024-09-11T23:08:05.431 INFO:journalctl@ceph.mon.a.smithi037.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-11T23:08:05.431 INFO:journalctl@ceph.mon.a.smithi037.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-11T23:08:05.431 INFO:journalctl@ceph.mon.a.smithi037.stdout: L0 2/0 99.49 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 49.2 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-09-11T23:08:05.431 INFO:journalctl@ceph.mon.a.smithi037.stdout: Sum 2/0 99.49 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 49.2 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-09-11T23:08:05.431 INFO:journalctl@ceph.mon.a.smithi037.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 49.2 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-09-11T23:08:05.431 INFO:journalctl@ceph.mon.a.smithi037.stdout: 2024-09-11T23:08:05.431 INFO:journalctl@ceph.mon.a.smithi037.stdout: ** Compaction Stats [default] ** 2024-09-11T23:08:05.431 INFO:journalctl@ceph.mon.a.smithi037.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-11T23:08:05.431 INFO:journalctl@ceph.mon.a.smithi037.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-11T23:08:05.431 INFO:journalctl@ceph.mon.a.smithi037.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 49.2 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-09-11T23:08:05.431 INFO:journalctl@ceph.mon.a.smithi037.stdout: 2024-09-11T23:08:05.431 INFO:journalctl@ceph.mon.a.smithi037.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-11T23:08:05.432 INFO:journalctl@ceph.mon.a.smithi037.stdout: 2024-09-11T23:08:05.432 INFO:journalctl@ceph.mon.a.smithi037.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-11T23:08:05.432 INFO:journalctl@ceph.mon.a.smithi037.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-11T23:08:05.432 INFO:journalctl@ceph.mon.a.smithi037.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-11T23:08:05.432 INFO:journalctl@ceph.mon.a.smithi037.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-11T23:08:05.432 INFO:journalctl@ceph.mon.a.smithi037.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-11T23:08:05.432 INFO:journalctl@ceph.mon.a.smithi037.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-11T23:08:05.432 INFO:journalctl@ceph.mon.a.smithi037.stdout: Cumulative compaction: 0.00 GB write, 9.97 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-11T23:08:05.432 INFO:journalctl@ceph.mon.a.smithi037.stdout: Interval compaction: 0.00 GB write, 9.97 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-11T23:08:05.432 INFO:journalctl@ceph.mon.a.smithi037.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-11T23:08:05.432 INFO:journalctl@ceph.mon.a.smithi037.stdout: Block cache BinnedLRUCache@0x55918eedf1f0#2 capacity: 512.00 MB usage: 1.52 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-11T23:08:05.432 INFO:journalctl@ceph.mon.a.smithi037.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,1.02 KB,0.000193715%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-09-11T23:08:05.432 INFO:journalctl@ceph.mon.a.smithi037.stdout: 2024-09-11T23:08:05.433 INFO:journalctl@ceph.mon.a.smithi037.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-11T23:08:05.433 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: starting mon.a rank 0 at public addrs [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] at bind addrs [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 8b03efce-7092-11ef-bcea-c7b262605968 2024-09-11T23:08:05.433 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: mon.a@-1(???) e1 preinit fsid 8b03efce-7092-11ef-bcea-c7b262605968 2024-09-11T23:08:05.433 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: mon.a@-1(???).mds e1 new map 2024-09-11T23:08:05.433 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: mon.a@-1(???).mds e1 print_map 2024-09-11T23:08:05.433 INFO:journalctl@ceph.mon.a.smithi037.stdout: e1 2024-09-11T23:08:05.433 INFO:journalctl@ceph.mon.a.smithi037.stdout: btime 2024-09-11T23:07:59:386558+0000 2024-09-11T23:08:05.433 INFO:journalctl@ceph.mon.a.smithi037.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-11T23:08:05.433 INFO:journalctl@ceph.mon.a.smithi037.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-11T23:08:05.433 INFO:journalctl@ceph.mon.a.smithi037.stdout: legacy client fscid: -1 2024-09-11T23:08:05.433 INFO:journalctl@ceph.mon.a.smithi037.stdout: 2024-09-11T23:08:05.433 INFO:journalctl@ceph.mon.a.smithi037.stdout: No filesystems configured 2024-09-11T23:08:05.433 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-11T23:08:05.434 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-11T23:08:05.434 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-11T23:08:05.434 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-11T23:08:05.434 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-11T23:08:05.434 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 systemd[1]: Started Ceph mon.a for 8b03efce-7092-11ef-bcea-c7b262605968. 2024-09-11T23:08:05.434 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-11T23:08:05.434 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: monmap epoch 1 2024-09-11T23:08:05.434 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: fsid 8b03efce-7092-11ef-bcea-c7b262605968 2024-09-11T23:08:05.434 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: last_changed 2024-09-11T23:07:45.034404+0000 2024-09-11T23:08:05.434 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: created 2024-09-11T23:07:45.034404+0000 2024-09-11T23:08:05.434 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: min_mon_release 19 (squid) 2024-09-11T23:08:05.434 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: election_strategy: 1 2024-09-11T23:08:05.434 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: 0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-11T23:08:05.434 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: fsmap 2024-09-11T23:08:05.434 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: osdmap e1: 0 total, 0 up, 0 in 2024-09-11T23:08:05.435 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:05 smithi037 ceph-mon[30630]: mgrmap e1: no daemons active 2024-09-11T23:08:06.323 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:05.639+0000 7fafdbe00640 1 Processor -- start 2024-09-11T23:08:06.323 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:05.640+0000 7fafdbe00640 1 -- start start 2024-09-11T23:08:06.323 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:05.640+0000 7fafdbe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafdc109910 0x7fafdc109d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:08:06.323 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:05.640+0000 7fafdbe00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fafdc10a2e0 con 0x7fafdc109910 2024-09-11T23:08:06.323 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:05.641+0000 7fafdaa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafdc109910 0x7fafdc109d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:08:06.324 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:05.641+0000 7fafdaa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafdc109910 0x7fafdc109d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44866/0 (socket says 172.21.15.37:44866) 2024-09-11T23:08:06.324 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:05.641+0000 7fafdaa00640 1 -- 172.21.15.37:0/1287961762 learned_addr learned my addr 172.21.15.37:0/1287961762 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:08:06.324 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:05.641+0000 7fafdaa00640 1 -- 172.21.15.37:0/1287961762 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafdc10a770 con 0x7fafdc109910 2024-09-11T23:08:06.324 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:05.644+0000 7fafdaa00640 1 --2- 172.21.15.37:0/1287961762 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafdc109910 0x7fafdc109d10 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fafcc009e80 tx=0x7fafcc02a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9576ad4aeefddd89 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:08:06.324 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:05.644+0000 7fafda000640 1 -- 172.21.15.37:0/1287961762 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafcc036070 con 0x7fafdc109910 2024-09-11T23:08:06.324 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:05.644+0000 7fafda000640 1 -- 172.21.15.37:0/1287961762 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fafcc0318c0 con 0x7fafdc109910 2024-09-11T23:08:06.324 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:05.644+0000 7fafda000640 1 -- 172.21.15.37:0/1287961762 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafcc007ab0 con 0x7fafdc109910 2024-09-11T23:08:06.324 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:05.644+0000 7fafdbe00640 1 -- 172.21.15.37:0/1287961762 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafdc109910 msgr2=0x7fafdc109d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:08:06.324 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:05.644+0000 7fafdbe00640 1 --2- 172.21.15.37:0/1287961762 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafdc109910 0x7fafdc109d10 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fafcc009e80 tx=0x7fafcc02a7a0 comp rx=0 tx=0).stop 2024-09-11T23:08:06.324 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:05.645+0000 7fafdbe00640 1 -- 172.21.15.37:0/1287961762 shutdown_connections 2024-09-11T23:08:06.324 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:05.645+0000 7fafdbe00640 1 --2- 172.21.15.37:0/1287961762 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafdc109910 0x7fafdc109d10 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:08:06.325 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:05.645+0000 7fafdbe00640 1 -- 172.21.15.37:0/1287961762 >> 172.21.15.37:0/1287961762 conn(0x7fafdc07cc40 msgr2=0x7fafdc07d050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:08:06.325 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:05.645+0000 7fafdbe00640 1 -- 172.21.15.37:0/1287961762 shutdown_connections 2024-09-11T23:08:06.325 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:05.645+0000 7fafdbe00640 1 -- 172.21.15.37:0/1287961762 wait complete. 2024-09-11T23:08:06.325 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:05.646+0000 7fafdbe00640 1 Processor -- start 2024-09-11T23:08:06.325 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:05.646+0000 7fafdbe00640 1 -- start start 2024-09-11T23:08:06.325 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:05.646+0000 7fafdbe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafdc109910 0x7fafdc19d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:08:06.325 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:05.646+0000 7fafdbe00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fafdc10db20 con 0x7fafdc109910 2024-09-11T23:08:06.325 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:05.646+0000 7fafdaa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafdc109910 0x7fafdc19d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:08:06.325 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:05.646+0000 7fafdaa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafdc109910 0x7fafdc19d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44874/0 (socket says 172.21.15.37:44874) 2024-09-11T23:08:06.325 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:05.647+0000 7fafdaa00640 1 -- 172.21.15.37:0/1229258710 learned_addr learned my addr 172.21.15.37:0/1229258710 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:08:06.325 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:05.647+0000 7fafdaa00640 1 -- 172.21.15.37:0/1229258710 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafdc19db10 con 0x7fafdc109910 2024-09-11T23:08:06.325 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:05.647+0000 7fafdaa00640 1 --2- 172.21.15.37:0/1229258710 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafdc109910 0x7fafdc19d5d0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fafcc02acc0 tx=0x7fafcc031ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:08:06.326 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:05.648+0000 7fafd3e00640 1 -- 172.21.15.37:0/1229258710 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafcc036050 con 0x7fafdc109910 2024-09-11T23:08:06.326 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:05.648+0000 7fafdbe00640 1 -- 172.21.15.37:0/1229258710 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafdc19dda0 con 0x7fafdc109910 2024-09-11T23:08:06.326 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:05.648+0000 7fafd3e00640 1 -- 172.21.15.37:0/1229258710 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fafcc037040 con 0x7fafdc109910 2024-09-11T23:08:06.326 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:05.648+0000 7fafd3e00640 1 -- 172.21.15.37:0/1229258710 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafcc03d8c0 con 0x7fafdc109910 2024-09-11T23:08:06.326 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:05.648+0000 7fafdbe00640 1 -- 172.21.15.37:0/1229258710 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafdc1a0a90 con 0x7fafdc109910 2024-09-11T23:08:06.326 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:05.648+0000 7fafd3e00640 1 -- 172.21.15.37:0/1229258710 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fafcc044020 con 0x7fafdc109910 2024-09-11T23:08:06.326 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:05.648+0000 7fafd3e00640 1 -- 172.21.15.37:0/1229258710 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fafcc042020 con 0x7fafdc109910 2024-09-11T23:08:06.326 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:05.649+0000 7fafdbe00640 1 -- 172.21.15.37:0/1229258710 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafdc109d90 con 0x7fafdc109910 2024-09-11T23:08:06.326 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:05.652+0000 7fafd3e00640 1 -- 172.21.15.37:0/1229258710 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fafcc0073b0 con 0x7fafdc109910 2024-09-11T23:08:06.326 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:05.714+0000 7fafdbe00640 1 -- 172.21.15.37:0/1229258710 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7fafdc1a1070 con 0x7fafdc109910 2024-09-11T23:08:06.326 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:05.717+0000 7fafd3e00640 1 -- 172.21.15.37:0/1229258710 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7fafcc046410 con 0x7fafdc109910 2024-09-11T23:08:06.326 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:05.718+0000 7fafdbe00640 1 -- 172.21.15.37:0/1229258710 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafdc109910 msgr2=0x7fafdc19d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:08:06.327 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:05.718+0000 7fafdbe00640 1 --2- 172.21.15.37:0/1229258710 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafdc109910 0x7fafdc19d5d0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fafcc02acc0 tx=0x7fafcc031ca0 comp rx=0 tx=0).stop 2024-09-11T23:08:06.327 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:05.718+0000 7fafdbe00640 1 -- 172.21.15.37:0/1229258710 shutdown_connections 2024-09-11T23:08:06.327 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:05.718+0000 7fafdbe00640 1 --2- 172.21.15.37:0/1229258710 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafdc109910 0x7fafdc19d5d0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:08:06.327 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:05.718+0000 7fafdbe00640 1 -- 172.21.15.37:0/1229258710 >> 172.21.15.37:0/1229258710 conn(0x7fafdc07cc40 msgr2=0x7fafdc107560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:08:06.327 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:05.718+0000 7fafdbe00640 1 -- 172.21.15.37:0/1229258710 shutdown_connections 2024-09-11T23:08:06.327 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:05.718+0000 7fafdbe00640 1 -- 172.21.15.37:0/1229258710 wait complete. 2024-09-11T23:08:06.327 INFO:teuthology.orchestra.run.smithi037.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-11T23:08:06.346 INFO:teuthology.orchestra.run.smithi037.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-11T23:08:06.346 INFO:teuthology.orchestra.run.smithi037.stdout:Creating mgr... 2024-09-11T23:08:06.346 INFO:teuthology.orchestra.run.smithi037.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-11T23:08:06.347 INFO:teuthology.orchestra.run.smithi037.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-11T23:08:06.691 INFO:teuthology.orchestra.run.smithi037.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-8b03efce-7092-11ef-bcea-c7b262605968@mgr.x 2024-09-11T23:08:06.692 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stderr Failed to reset failed state of unit ceph-8b03efce-7092-11ef-bcea-c7b262605968@mgr.x.service: Unit ceph-8b03efce-7092-11ef-bcea-c7b262605968@mgr.x.service not loaded. 2024-09-11T23:08:06.930 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-8b03efce-7092-11ef-bcea-c7b262605968.target.wants/ceph-8b03efce-7092-11ef-bcea-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-8b03efce-7092-11ef-bcea-c7b262605968@.service. 2024-09-11T23:08:06.958 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:06 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/1229258710' entity='client.admin' 2024-09-11T23:08:06.958 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:06 smithi037 systemd[1]: Starting Ceph mgr.x for 8b03efce-7092-11ef-bcea-c7b262605968... 2024-09-11T23:08:07.551 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:07 smithi037 podman[30838]: 2024-09-11 23:08:07.265523717 +0000 UTC m=+0.121382027 container create a37b4620cc88c47b2c546ce6ac224a718710048cff345d7039896967d9cd1857 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=) 2024-09-11T23:08:07.551 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:07 smithi037 podman[30838]: 2024-09-11 23:08:07.17218798 +0000 UTC m=+0.028046292 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T23:08:07.551 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:07 smithi037 podman[30838]: 2024-09-11 23:08:07.468471711 +0000 UTC m=+0.324330037 container init a37b4620cc88c47b2c546ce6ac224a718710048cff345d7039896967d9cd1857 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3) 2024-09-11T23:08:07.551 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:07 smithi037 podman[30838]: 2024-09-11 23:08:07.474889509 +0000 UTC m=+0.330747830 container start a37b4620cc88c47b2c546ce6ac224a718710048cff345d7039896967d9cd1857 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T23:08:07.552 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:07 smithi037 bash[30838]: a37b4620cc88c47b2c546ce6ac224a718710048cff345d7039896967d9cd1857 2024-09-11T23:08:07.581 INFO:teuthology.orchestra.run.smithi037.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-11T23:08:07.581 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stdout disabled 2024-09-11T23:08:07.596 INFO:teuthology.orchestra.run.smithi037.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-11T23:08:07.596 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stdout inactive 2024-09-11T23:08:07.596 INFO:teuthology.orchestra.run.smithi037.stdout:firewalld.service is not enabled 2024-09-11T23:08:07.596 INFO:teuthology.orchestra.run.smithi037.stdout:Not possible to enable service . firewalld.service is not available 2024-09-11T23:08:07.614 INFO:teuthology.orchestra.run.smithi037.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-11T23:08:07.614 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stdout disabled 2024-09-11T23:08:07.629 INFO:teuthology.orchestra.run.smithi037.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-11T23:08:07.629 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stdout inactive 2024-09-11T23:08:07.629 INFO:teuthology.orchestra.run.smithi037.stdout:firewalld.service is not enabled 2024-09-11T23:08:07.629 INFO:teuthology.orchestra.run.smithi037.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-11T23:08:07.629 INFO:teuthology.orchestra.run.smithi037.stdout:Waiting for mgr to start... 2024-09-11T23:08:07.629 INFO:teuthology.orchestra.run.smithi037.stdout:Waiting for mgr... 2024-09-11T23:08:07.814 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:07 smithi037 systemd[1]: Started Ceph mgr.x for 8b03efce-7092-11ef-bcea-c7b262605968. 2024-09-11T23:08:07.814 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:07 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: 2024-09-11T23:08:07.648+0000 7f2b8c5d8040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-11T23:08:07.815 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:07 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: 2024-09-11T23:08:07.724+0000 7f2b8c5d8040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-11T23:08:08.188 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:07 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: 2024-09-11T23:08:07.923+0000 7f2b8c5d8040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-11T23:08:08.188 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:08 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: 2024-09-11T23:08:08.010+0000 7f2b8c5d8040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-11T23:08:08.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:08 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/4247266339' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-11T23:08:08.565 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:08 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: 2024-09-11T23:08:08.196+0000 7f2b8c5d8040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-11T23:08:08.565 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:08 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: 2024-09-11T23:08:08.379+0000 7f2b8c5d8040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-11T23:08:08.890 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 2024-09-11T23:08:08.893 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout { 2024-09-11T23:08:08.893 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "fsid": "8b03efce-7092-11ef-bcea-c7b262605968", 2024-09-11T23:08:08.893 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "health": { 2024-09-11T23:08:08.893 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-11T23:08:08.893 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-11T23:08:08.893 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-11T23:08:08.893 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-09-11T23:08:08.893 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-11T23:08:08.894 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-11T23:08:08.894 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 0 2024-09-11T23:08:08.894 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout ], 2024-09-11T23:08:08.894 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-11T23:08:08.894 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "a" 2024-09-11T23:08:08.894 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout ], 2024-09-11T23:08:08.894 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2024-09-11T23:08:08.894 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-11T23:08:08.894 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-11T23:08:08.894 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-11T23:08:08.894 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-11T23:08:08.894 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-09-11T23:08:08.894 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-11T23:08:08.895 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-11T23:08:08.895 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-11T23:08:08.895 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-11T23:08:08.895 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-11T23:08:08.903 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-11T23:08:08.903 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-11T23:08:08.903 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-11T23:08:08.903 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-09-11T23:08:08.903 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-11T23:08:08.903 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-11T23:08:08.904 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-11T23:08:08.904 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-11T23:08:08.904 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-11T23:08:08.904 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-11T23:08:08.904 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-11T23:08:08.904 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-11T23:08:08.904 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-11T23:08:08.904 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-09-11T23:08:08.904 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-11T23:08:08.904 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-11T23:08:08.904 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "btime": "2024-09-11T23:07:59:386558+0000", 2024-09-11T23:08:08.904 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-11T23:08:08.904 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-11T23:08:08.905 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-09-11T23:08:08.905 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-11T23:08:08.905 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-11T23:08:08.905 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-11T23:08:08.905 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-11T23:08:08.905 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-11T23:08:08.905 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-11T23:08:08.905 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "restful" 2024-09-11T23:08:08.905 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout ], 2024-09-11T23:08:08.905 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-11T23:08:08.905 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-09-11T23:08:08.905 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-11T23:08:08.906 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-11T23:08:08.906 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "modified": "2024-09-11T23:07:59.387374+0000", 2024-09-11T23:08:08.906 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-11T23:08:08.906 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-09-11T23:08:08.906 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-11T23:08:08.906 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout } 2024-09-11T23:08:08.906 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:08.208+0000 7fb001e00640 1 Processor -- start 2024-09-11T23:08:08.906 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:08.208+0000 7fb001e00640 1 -- start start 2024-09-11T23:08:08.906 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:08.209+0000 7fb001e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faffc1098c0 0x7faffc109cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:08:08.906 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:08.209+0000 7fb001e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7faffc10a290 con 0x7faffc1098c0 2024-09-11T23:08:08.906 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:08.210+0000 7faffaa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faffc1098c0 0x7faffc109cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:08:08.906 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:08.210+0000 7faffaa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faffc1098c0 0x7faffc109cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44888/0 (socket says 172.21.15.37:44888) 2024-09-11T23:08:08.906 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:08.210+0000 7faffaa00640 1 -- 172.21.15.37:0/2191898129 learned_addr learned my addr 172.21.15.37:0/2191898129 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:08:08.907 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:08.210+0000 7faffaa00640 1 -- 172.21.15.37:0/2191898129 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faffc10a9b0 con 0x7faffc1098c0 2024-09-11T23:08:08.907 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:08.211+0000 7faffaa00640 1 --2- 172.21.15.37:0/2191898129 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faffc1098c0 0x7faffc109cc0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fafec009820 tx=0x7fafec02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f2a07a324105863 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:08:08.907 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:08.211+0000 7faff9600640 1 -- 172.21.15.37:0/2191898129 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafec037070 con 0x7faffc1098c0 2024-09-11T23:08:08.907 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:08.212+0000 7faff9600640 1 -- 172.21.15.37:0/2191898129 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fafec032900 con 0x7faffc1098c0 2024-09-11T23:08:08.907 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:08.212+0000 7faff9600640 1 -- 172.21.15.37:0/2191898129 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafec030850 con 0x7faffc1098c0 2024-09-11T23:08:08.907 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:08.212+0000 7fb001e00640 1 -- 172.21.15.37:0/2191898129 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faffc1098c0 msgr2=0x7faffc109cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:08:08.907 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:08.212+0000 7fb001e00640 1 --2- 172.21.15.37:0/2191898129 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faffc1098c0 0x7faffc109cc0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fafec009820 tx=0x7fafec02a270 comp rx=0 tx=0).stop 2024-09-11T23:08:08.907 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:08.213+0000 7fb001e00640 1 -- 172.21.15.37:0/2191898129 shutdown_connections 2024-09-11T23:08:08.907 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:08.213+0000 7fb001e00640 1 --2- 172.21.15.37:0/2191898129 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faffc1098c0 0x7faffc109cc0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:08:08.907 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:08.213+0000 7fb001e00640 1 -- 172.21.15.37:0/2191898129 >> 172.21.15.37:0/2191898129 conn(0x7faffc07ce20 msgr2=0x7faffc07d230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:08:08.907 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:08.213+0000 7fb001e00640 1 -- 172.21.15.37:0/2191898129 shutdown_connections 2024-09-11T23:08:08.908 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:08.213+0000 7fb001e00640 1 -- 172.21.15.37:0/2191898129 wait complete. 2024-09-11T23:08:08.908 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:08.214+0000 7fb001e00640 1 Processor -- start 2024-09-11T23:08:08.908 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:08.214+0000 7fb001e00640 1 -- start start 2024-09-11T23:08:08.908 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:08.215+0000 7fb001e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faffc1098c0 0x7faffc19db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:08:08.908 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:08.215+0000 7fb001e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7faffc10dd60 con 0x7faffc1098c0 2024-09-11T23:08:08.908 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:08.215+0000 7faffaa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faffc1098c0 0x7faffc19db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:08:08.908 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:08.215+0000 7faffaa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faffc1098c0 0x7faffc19db00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44894/0 (socket says 172.21.15.37:44894) 2024-09-11T23:08:08.908 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:08.215+0000 7faffaa00640 1 -- 172.21.15.37:0/4247266339 learned_addr learned my addr 172.21.15.37:0/4247266339 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:08:08.908 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:08.215+0000 7faffaa00640 1 -- 172.21.15.37:0/4247266339 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faffc19e040 con 0x7faffc1098c0 2024-09-11T23:08:08.908 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:08.216+0000 7faffaa00640 1 --2- 172.21.15.37:0/4247266339 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faffc1098c0 0x7faffc19db00 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fafec009940 tx=0x7fafec0326e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:08:08.908 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:08.216+0000 7fb000a00640 1 -- 172.21.15.37:0/4247266339 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafec042070 con 0x7faffc1098c0 2024-09-11T23:08:08.908 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:08.216+0000 7fb000a00640 1 -- 172.21.15.37:0/4247266339 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fafec032be0 con 0x7faffc1098c0 2024-09-11T23:08:08.909 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:08.216+0000 7fb000a00640 1 -- 172.21.15.37:0/4247266339 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafec037040 con 0x7faffc1098c0 2024-09-11T23:08:08.909 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:08.216+0000 7fb001e00640 1 -- 172.21.15.37:0/4247266339 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faffc19e2d0 con 0x7faffc1098c0 2024-09-11T23:08:08.909 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:08.216+0000 7fb001e00640 1 -- 172.21.15.37:0/4247266339 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faffc1a0fc0 con 0x7faffc1098c0 2024-09-11T23:08:08.909 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:08.216+0000 7fb000a00640 1 -- 172.21.15.37:0/4247266339 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fafec045070 con 0x7faffc1098c0 2024-09-11T23:08:08.909 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:08.217+0000 7fb000a00640 1 -- 172.21.15.37:0/4247266339 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fafec0463b0 con 0x7faffc1098c0 2024-09-11T23:08:08.909 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:08.217+0000 7fb001e00640 1 -- 172.21.15.37:0/4247266339 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faffc10dee0 con 0x7faffc1098c0 2024-09-11T23:08:08.909 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:08.222+0000 7fb000a00640 1 -- 172.21.15.37:0/4247266339 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fafec032d90 con 0x7faffc1098c0 2024-09-11T23:08:08.909 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:08.290+0000 7fb001e00640 1 -- 172.21.15.37:0/4247266339 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7faffc197650 con 0x7faffc1098c0 2024-09-11T23:08:08.909 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:08.291+0000 7fb000a00640 1 -- 172.21.15.37:0/4247266339 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7fafec047440 con 0x7faffc1098c0 2024-09-11T23:08:08.909 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:08.292+0000 7fb001e00640 1 -- 172.21.15.37:0/4247266339 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faffc1098c0 msgr2=0x7faffc19db00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:08:08.909 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:08.292+0000 7fb001e00640 1 --2- 172.21.15.37:0/4247266339 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faffc1098c0 0x7faffc19db00 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fafec009940 tx=0x7fafec0326e0 comp rx=0 tx=0).stop 2024-09-11T23:08:08.909 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:08.292+0000 7fb001e00640 1 -- 172.21.15.37:0/4247266339 shutdown_connections 2024-09-11T23:08:08.909 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:08.292+0000 7fb001e00640 1 --2- 172.21.15.37:0/4247266339 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faffc1098c0 0x7faffc19db00 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:08:08.910 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:08.292+0000 7fb001e00640 1 -- 172.21.15.37:0/4247266339 >> 172.21.15.37:0/4247266339 conn(0x7faffc07ce20 msgr2=0x7faffc1077d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:08:08.910 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:08.292+0000 7fb001e00640 1 -- 172.21.15.37:0/4247266339 shutdown_connections 2024-09-11T23:08:08.910 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:08.293+0000 7fb001e00640 1 -- 172.21.15.37:0/4247266339 wait complete. 2024-09-11T23:08:08.910 INFO:teuthology.orchestra.run.smithi037.stdout:mgr not available, waiting (1/15)... 2024-09-11T23:08:08.937 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:08 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: 2024-09-11T23:08:08.781+0000 7f2b8c5d8040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-11T23:08:08.937 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:08 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: 2024-09-11T23:08:08.856+0000 7f2b8c5d8040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-11T23:08:09.314 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:09 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: 2024-09-11T23:08:09.082+0000 7f2b8c5d8040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-11T23:08:10.564 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:10 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: 2024-09-11T23:08:10.229+0000 7f2b8c5d8040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-11T23:08:10.565 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:10 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: 2024-09-11T23:08:10.312+0000 7f2b8c5d8040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-11T23:08:11.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:11 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/3437117797' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-11T23:08:11.565 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:11 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: 2024-09-11T23:08:11.300+0000 7f2b8c5d8040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-11T23:08:11.565 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:11 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: 2024-09-11T23:08:11.445+0000 7f2b8c5d8040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-11T23:08:11.875 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:11 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: 2024-09-11T23:08:11.620+0000 7f2b8c5d8040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-11T23:08:11.875 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:11 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: 2024-09-11T23:08:11.695+0000 7f2b8c5d8040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-11T23:08:11.876 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:11 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: 2024-09-11T23:08:11.875+0000 7f2b8c5d8040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-11T23:08:12.148 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:11 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: 2024-09-11T23:08:11.959+0000 7f2b8c5d8040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-11T23:08:12.148 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:12 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: 2024-09-11T23:08:12.033+0000 7f2b8c5d8040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-11T23:08:12.155 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 2024-09-11T23:08:12.155 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout { 2024-09-11T23:08:12.155 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "fsid": "8b03efce-7092-11ef-bcea-c7b262605968", 2024-09-11T23:08:12.155 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "health": { 2024-09-11T23:08:12.155 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-11T23:08:12.155 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-11T23:08:12.155 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-11T23:08:12.155 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-09-11T23:08:12.156 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-11T23:08:12.156 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-11T23:08:12.156 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 0 2024-09-11T23:08:12.156 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout ], 2024-09-11T23:08:12.156 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-11T23:08:12.156 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "a" 2024-09-11T23:08:12.156 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout ], 2024-09-11T23:08:12.156 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "quorum_age": 6, 2024-09-11T23:08:12.156 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-11T23:08:12.156 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-11T23:08:12.156 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-11T23:08:12.156 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-11T23:08:12.156 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-09-11T23:08:12.157 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-11T23:08:12.157 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-11T23:08:12.157 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-11T23:08:12.157 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-11T23:08:12.165 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-11T23:08:12.165 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-11T23:08:12.165 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-11T23:08:12.165 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-11T23:08:12.165 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-09-11T23:08:12.165 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-11T23:08:12.165 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-11T23:08:12.165 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-11T23:08:12.165 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-11T23:08:12.165 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-11T23:08:12.166 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-11T23:08:12.166 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-11T23:08:12.166 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-11T23:08:12.166 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-11T23:08:12.166 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-09-11T23:08:12.166 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-11T23:08:12.166 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-11T23:08:12.166 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "btime": "2024-09-11T23:07:59:386558+0000", 2024-09-11T23:08:12.166 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-11T23:08:12.166 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-11T23:08:12.166 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-09-11T23:08:12.166 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-11T23:08:12.167 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-11T23:08:12.167 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-11T23:08:12.167 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-11T23:08:12.167 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-11T23:08:12.167 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-11T23:08:12.167 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "restful" 2024-09-11T23:08:12.167 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout ], 2024-09-11T23:08:12.167 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-11T23:08:12.167 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-09-11T23:08:12.167 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-11T23:08:12.167 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-11T23:08:12.167 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "modified": "2024-09-11T23:07:59.387374+0000", 2024-09-11T23:08:12.167 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-11T23:08:12.168 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-09-11T23:08:12.168 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-11T23:08:12.168 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout } 2024-09-11T23:08:12.168 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:11.388+0000 7f095e800640 1 Processor -- start 2024-09-11T23:08:12.168 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:11.388+0000 7f095e800640 1 -- start start 2024-09-11T23:08:12.168 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:11.388+0000 7f095e800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0958107420 0x7f0958107820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:08:12.168 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:11.388+0000 7f095e800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0958107df0 con 0x7f0958107420 2024-09-11T23:08:12.168 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:11.389+0000 7f095d400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0958107420 0x7f0958107820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:08:12.168 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:11.389+0000 7f095d400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0958107420 0x7f0958107820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60118/0 (socket says 172.21.15.37:60118) 2024-09-11T23:08:12.168 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:11.389+0000 7f095d400640 1 -- 172.21.15.37:0/4094639008 learned_addr learned my addr 172.21.15.37:0/4094639008 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:08:12.168 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:11.389+0000 7f095d400640 1 -- 172.21.15.37:0/4094639008 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09581085d0 con 0x7f0958107420 2024-09-11T23:08:12.168 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:11.390+0000 7f095d400640 1 --2- 172.21.15.37:0/4094639008 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0958107420 0x7f0958107820 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f094c009820 tx=0x7f094c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd55aa34b0df73c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:08:12.168 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:11.391+0000 7f0957e00640 1 -- 172.21.15.37:0/4094639008 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f094c037070 con 0x7f0958107420 2024-09-11T23:08:12.169 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:11.391+0000 7f0957e00640 1 -- 172.21.15.37:0/4094639008 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f094c032900 con 0x7f0958107420 2024-09-11T23:08:12.169 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:11.391+0000 7f0957e00640 1 -- 172.21.15.37:0/4094639008 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f094c030850 con 0x7f0958107420 2024-09-11T23:08:12.169 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:11.391+0000 7f095e800640 1 -- 172.21.15.37:0/4094639008 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0958107420 msgr2=0x7f0958107820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:08:12.169 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:11.391+0000 7f095e800640 1 --2- 172.21.15.37:0/4094639008 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0958107420 0x7f0958107820 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f094c009820 tx=0x7f094c02a270 comp rx=0 tx=0).stop 2024-09-11T23:08:12.169 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:11.391+0000 7f095e800640 1 -- 172.21.15.37:0/4094639008 shutdown_connections 2024-09-11T23:08:12.169 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:11.391+0000 7f095e800640 1 --2- 172.21.15.37:0/4094639008 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0958107420 0x7f0958107820 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:08:12.169 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:11.391+0000 7f095e800640 1 -- 172.21.15.37:0/4094639008 >> 172.21.15.37:0/4094639008 conn(0x7f0958102c10 msgr2=0x7f0958105030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:08:12.169 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:11.392+0000 7f095e800640 1 -- 172.21.15.37:0/4094639008 shutdown_connections 2024-09-11T23:08:12.169 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:11.392+0000 7f095e800640 1 -- 172.21.15.37:0/4094639008 wait complete. 2024-09-11T23:08:12.169 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:11.393+0000 7f095e800640 1 Processor -- start 2024-09-11T23:08:12.169 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:11.393+0000 7f095e800640 1 -- start start 2024-09-11T23:08:12.169 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:11.393+0000 7f095e800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0958107420 0x7f095807ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:08:12.170 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:11.393+0000 7f095e800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f095810b980 con 0x7f0958107420 2024-09-11T23:08:12.170 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:11.393+0000 7f095d400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0958107420 0x7f095807ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:08:12.170 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:11.393+0000 7f095d400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0958107420 0x7f095807ca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60120/0 (socket says 172.21.15.37:60120) 2024-09-11T23:08:12.170 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:11.393+0000 7f095d400640 1 -- 172.21.15.37:0/3437117797 learned_addr learned my addr 172.21.15.37:0/3437117797 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:08:12.170 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:11.394+0000 7f095d400640 1 -- 172.21.15.37:0/3437117797 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f095807cf40 con 0x7f0958107420 2024-09-11T23:08:12.170 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:11.394+0000 7f095d400640 1 --2- 172.21.15.37:0/3437117797 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0958107420 0x7f095807ca00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f094c0097f0 tx=0x7f094c030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:08:12.170 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:11.394+0000 7f0956000640 1 -- 172.21.15.37:0/3437117797 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f094c037040 con 0x7f0958107420 2024-09-11T23:08:12.170 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:11.395+0000 7f0956000640 1 -- 172.21.15.37:0/3437117797 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f094c040070 con 0x7f0958107420 2024-09-11T23:08:12.170 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:11.395+0000 7f095e800640 1 -- 172.21.15.37:0/3437117797 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f095807b130 con 0x7f0958107420 2024-09-11T23:08:12.170 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:11.395+0000 7f0956000640 1 -- 172.21.15.37:0/3437117797 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f094c03a390 con 0x7f0958107420 2024-09-11T23:08:12.171 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:11.395+0000 7f095e800640 1 -- 172.21.15.37:0/3437117797 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f095807b610 con 0x7f0958107420 2024-09-11T23:08:12.171 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:11.395+0000 7f0956000640 1 -- 172.21.15.37:0/3437117797 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f094c03a630 con 0x7f0958107420 2024-09-11T23:08:12.171 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:11.395+0000 7f0956000640 1 -- 172.21.15.37:0/3437117797 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f094c0459a0 con 0x7f0958107420 2024-09-11T23:08:12.171 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:11.396+0000 7f095e800640 1 -- 172.21.15.37:0/3437117797 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09581078a0 con 0x7f0958107420 2024-09-11T23:08:12.171 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:11.398+0000 7f0956000640 1 -- 172.21.15.37:0/3437117797 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f094c045460 con 0x7f0958107420 2024-09-11T23:08:12.171 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:11.464+0000 7f095e800640 1 -- 172.21.15.37:0/3437117797 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f095807bb40 con 0x7f0958107420 2024-09-11T23:08:12.171 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:11.465+0000 7f0956000640 1 -- 172.21.15.37:0/3437117797 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7f094c03b430 con 0x7f0958107420 2024-09-11T23:08:12.171 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:11.466+0000 7f095e800640 1 -- 172.21.15.37:0/3437117797 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0958107420 msgr2=0x7f095807ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:08:12.171 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:11.466+0000 7f095e800640 1 --2- 172.21.15.37:0/3437117797 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0958107420 0x7f095807ca00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f094c0097f0 tx=0x7f094c030d80 comp rx=0 tx=0).stop 2024-09-11T23:08:12.171 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:11.466+0000 7f095e800640 1 -- 172.21.15.37:0/3437117797 shutdown_connections 2024-09-11T23:08:12.171 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:11.466+0000 7f095e800640 1 --2- 172.21.15.37:0/3437117797 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0958107420 0x7f095807ca00 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:08:12.171 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:11.466+0000 7f095e800640 1 -- 172.21.15.37:0/3437117797 >> 172.21.15.37:0/3437117797 conn(0x7f0958102c10 msgr2=0x7f09581037d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:08:12.171 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:11.466+0000 7f095e800640 1 -- 172.21.15.37:0/3437117797 shutdown_connections 2024-09-11T23:08:12.172 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:11.466+0000 7f095e800640 1 -- 172.21.15.37:0/3437117797 wait complete. 2024-09-11T23:08:12.172 INFO:teuthology.orchestra.run.smithi037.stdout:mgr not available, waiting (2/15)... 2024-09-11T23:08:12.486 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:12 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: 2024-09-11T23:08:12.224+0000 7f2b8c5d8040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-11T23:08:12.486 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:12 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: 2024-09-11T23:08:12.304+0000 7f2b8c5d8040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-11T23:08:12.487 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:12 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: 2024-09-11T23:08:12.386+0000 7f2b8c5d8040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-11T23:08:12.487 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:12 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: 2024-09-11T23:08:12.486+0000 7f2b8c5d8040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-11T23:08:12.814 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:12 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: 2024-09-11T23:08:12.559+0000 7f2b8c5d8040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-11T23:08:12.814 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:12 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: 2024-09-11T23:08:12.631+0000 7f2b8c5d8040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-11T23:08:14.065 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:13 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: 2024-09-11T23:08:13.581+0000 7f2b8c5d8040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-11T23:08:14.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:13 smithi037 ceph-mon[30630]: Activating manager daemon x 2024-09-11T23:08:14.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:13 smithi037 ceph-mon[30630]: mgrmap e2: x(active, starting, since 0.00401498s) 2024-09-11T23:08:14.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:13 smithi037 ceph-mon[30630]: from='mgr.14100 172.21.15.37:0/503655252' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-11T23:08:14.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:13 smithi037 ceph-mon[30630]: from='mgr.14100 172.21.15.37:0/503655252' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-11T23:08:14.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:13 smithi037 ceph-mon[30630]: from='mgr.14100 172.21.15.37:0/503655252' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-11T23:08:14.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:13 smithi037 ceph-mon[30630]: from='mgr.14100 172.21.15.37:0/503655252' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T23:08:14.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:13 smithi037 ceph-mon[30630]: from='mgr.14100 172.21.15.37:0/503655252' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-11T23:08:14.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:13 smithi037 ceph-mon[30630]: Manager daemon x is now available 2024-09-11T23:08:14.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:13 smithi037 ceph-mon[30630]: from='mgr.14100 172.21.15.37:0/503655252' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-11T23:08:14.066 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:13 smithi037 ceph-mon[30630]: from='mgr.14100 172.21.15.37:0/503655252' entity='mgr.x' 2024-09-11T23:08:14.066 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:13 smithi037 ceph-mon[30630]: from='mgr.14100 172.21.15.37:0/503655252' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-11T23:08:14.066 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:13 smithi037 ceph-mon[30630]: from='mgr.14100 172.21.15.37:0/503655252' entity='mgr.x' 2024-09-11T23:08:14.066 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:13 smithi037 ceph-mon[30630]: from='mgr.14100 172.21.15.37:0/503655252' entity='mgr.x' 2024-09-11T23:08:15.593 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 2024-09-11T23:08:15.596 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout { 2024-09-11T23:08:15.596 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "fsid": "8b03efce-7092-11ef-bcea-c7b262605968", 2024-09-11T23:08:15.596 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "health": { 2024-09-11T23:08:15.596 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-11T23:08:15.596 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-11T23:08:15.596 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-11T23:08:15.596 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-09-11T23:08:15.596 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-11T23:08:15.597 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-11T23:08:15.597 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 0 2024-09-11T23:08:15.597 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout ], 2024-09-11T23:08:15.597 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-11T23:08:15.597 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "a" 2024-09-11T23:08:15.597 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout ], 2024-09-11T23:08:15.597 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "quorum_age": 9, 2024-09-11T23:08:15.597 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-11T23:08:15.597 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-11T23:08:15.597 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-11T23:08:15.597 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-11T23:08:15.597 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-09-11T23:08:15.597 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-11T23:08:15.597 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-11T23:08:15.598 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-11T23:08:15.598 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-11T23:08:15.598 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-11T23:08:15.598 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-11T23:08:15.598 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-11T23:08:15.598 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-11T23:08:15.598 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-09-11T23:08:15.606 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-11T23:08:15.606 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-11T23:08:15.606 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-11T23:08:15.606 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-11T23:08:15.606 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-11T23:08:15.606 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-11T23:08:15.606 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-11T23:08:15.606 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-11T23:08:15.606 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-11T23:08:15.606 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-09-11T23:08:15.606 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-11T23:08:15.607 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-11T23:08:15.607 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "btime": "2024-09-11T23:07:59:386558+0000", 2024-09-11T23:08:15.607 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-11T23:08:15.607 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-11T23:08:15.607 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-09-11T23:08:15.607 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-11T23:08:15.607 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-11T23:08:15.607 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-11T23:08:15.607 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-11T23:08:15.607 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-11T23:08:15.607 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-11T23:08:15.607 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "restful" 2024-09-11T23:08:15.608 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout ], 2024-09-11T23:08:15.608 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-11T23:08:15.608 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-09-11T23:08:15.608 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-11T23:08:15.608 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-11T23:08:15.608 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "modified": "2024-09-11T23:07:59.387374+0000", 2024-09-11T23:08:15.608 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-11T23:08:15.608 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-09-11T23:08:15.608 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-11T23:08:15.608 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout } 2024-09-11T23:08:15.608 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:14.644+0000 7f8377e00640 1 Processor -- start 2024-09-11T23:08:15.608 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:14.644+0000 7f8377e00640 1 -- start start 2024-09-11T23:08:15.608 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:14.644+0000 7f8377e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8378107420 0x7f8378107820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:08:15.609 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:14.644+0000 7f8377e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8378107df0 con 0x7f8378107420 2024-09-11T23:08:15.609 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:14.644+0000 7f8376a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8378107420 0x7f8378107820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:08:15.609 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:14.644+0000 7f8376a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8378107420 0x7f8378107820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60212/0 (socket says 172.21.15.37:60212) 2024-09-11T23:08:15.609 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:14.644+0000 7f8376a00640 1 -- 172.21.15.37:0/502003699 learned_addr learned my addr 172.21.15.37:0/502003699 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:08:15.609 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:14.645+0000 7f8376a00640 1 -- 172.21.15.37:0/502003699 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83781085d0 con 0x7f8378107420 2024-09-11T23:08:15.609 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:14.646+0000 7f8376a00640 1 --2- 172.21.15.37:0/502003699 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8378107420 0x7f8378107820 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f8368009820 tx=0x7f836802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd0e6e61c8ab8191 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:08:15.609 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:14.646+0000 7f8376000640 1 -- 172.21.15.37:0/502003699 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8368037070 con 0x7f8378107420 2024-09-11T23:08:15.609 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:14.646+0000 7f8376000640 1 -- 172.21.15.37:0/502003699 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8368032900 con 0x7f8378107420 2024-09-11T23:08:15.609 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:14.646+0000 7f8376000640 1 -- 172.21.15.37:0/502003699 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8368030850 con 0x7f8378107420 2024-09-11T23:08:15.609 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:14.647+0000 7f8377e00640 1 -- 172.21.15.37:0/502003699 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8378107420 msgr2=0x7f8378107820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:08:15.609 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:14.647+0000 7f8377e00640 1 --2- 172.21.15.37:0/502003699 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8378107420 0x7f8378107820 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f8368009820 tx=0x7f836802a270 comp rx=0 tx=0).stop 2024-09-11T23:08:15.610 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:14.647+0000 7f8377e00640 1 -- 172.21.15.37:0/502003699 shutdown_connections 2024-09-11T23:08:15.610 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:14.647+0000 7f8377e00640 1 --2- 172.21.15.37:0/502003699 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8378107420 0x7f8378107820 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:08:15.610 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:14.647+0000 7f8377e00640 1 -- 172.21.15.37:0/502003699 >> 172.21.15.37:0/502003699 conn(0x7f8378102c10 msgr2=0x7f8378105030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:08:15.610 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:14.647+0000 7f8377e00640 1 -- 172.21.15.37:0/502003699 shutdown_connections 2024-09-11T23:08:15.610 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:14.647+0000 7f8377e00640 1 -- 172.21.15.37:0/502003699 wait complete. 2024-09-11T23:08:15.610 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:14.648+0000 7f8377e00640 1 Processor -- start 2024-09-11T23:08:15.610 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:14.648+0000 7f8377e00640 1 -- start start 2024-09-11T23:08:15.610 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:14.648+0000 7f8377e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8378107420 0x7f837819b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:08:15.610 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:14.648+0000 7f8377e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f837810b980 con 0x7f8378107420 2024-09-11T23:08:15.610 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:14.648+0000 7f8376a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8378107420 0x7f837819b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:08:15.610 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:14.648+0000 7f8376a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8378107420 0x7f837819b3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60214/0 (socket says 172.21.15.37:60214) 2024-09-11T23:08:15.610 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:14.649+0000 7f8376a00640 1 -- 172.21.15.37:0/1939444660 learned_addr learned my addr 172.21.15.37:0/1939444660 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:08:15.611 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:14.649+0000 7f8376a00640 1 -- 172.21.15.37:0/1939444660 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f837819b930 con 0x7f8378107420 2024-09-11T23:08:15.611 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:14.649+0000 7f8376a00640 1 --2- 172.21.15.37:0/1939444660 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8378107420 0x7f837819b3f0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f83680097f0 tx=0x7f8368030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:08:15.611 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:14.649+0000 7f837ca00640 1 -- 172.21.15.37:0/1939444660 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8368037040 con 0x7f8378107420 2024-09-11T23:08:15.611 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:14.649+0000 7f837ca00640 1 -- 172.21.15.37:0/1939444660 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8368040070 con 0x7f8378107420 2024-09-11T23:08:15.611 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:14.649+0000 7f837ca00640 1 -- 172.21.15.37:0/1939444660 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f836803a390 con 0x7f8378107420 2024-09-11T23:08:15.611 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:14.649+0000 7f8377e00640 1 -- 172.21.15.37:0/1939444660 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f837819bbc0 con 0x7f8378107420 2024-09-11T23:08:15.611 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:14.650+0000 7f8377e00640 1 -- 172.21.15.37:0/1939444660 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f837819e8b0 con 0x7f8378107420 2024-09-11T23:08:15.611 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:14.651+0000 7f837ca00640 1 -- 172.21.15.37:0/1939444660 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 3) ==== 46170+0+0 (secure 0 0 0) 0x7f836803b430 con 0x7f8378107420 2024-09-11T23:08:15.611 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:14.651+0000 7f8377e00640 1 -- 172.21.15.37:0/1939444660 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f837810bb00 con 0x7f8378107420 2024-09-11T23:08:15.611 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:14.651+0000 7f837ca00640 1 --2- 172.21.15.37:0/1939444660 >> [v2:172.21.15.37:6800/3447426643,v1:172.21.15.37:6801/3447426643] conn(0x7f835c038e60 0x7f835c03b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:08:15.611 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:14.651+0000 7f837ca00640 1 -- 172.21.15.37:0/1939444660 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f836806be70 con 0x7f8378107420 2024-09-11T23:08:15.611 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:14.651+0000 7f836e000640 1 --2- 172.21.15.37:0/1939444660 >> [v2:172.21.15.37:6800/3447426643,v1:172.21.15.37:6801/3447426643] conn(0x7f835c038e60 0x7f835c03b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:08:15.612 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:14.652+0000 7f836e000640 1 --2- 172.21.15.37:0/1939444660 >> [v2:172.21.15.37:6800/3447426643,v1:172.21.15.37:6801/3447426643] conn(0x7f835c038e60 0x7f835c03b320 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f83600098c0 tx=0x7f8360006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:08:15.612 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:14.657+0000 7f837ca00640 1 -- 172.21.15.37:0/1939444660 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8368032900 con 0x7f8378107420 2024-09-11T23:08:15.612 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:14.909+0000 7f8377e00640 1 -- 172.21.15.37:0/1939444660 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f837819ea80 con 0x7f8378107420 2024-09-11T23:08:15.612 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:14.910+0000 7f837ca00640 1 -- 172.21.15.37:0/1939444660 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1290 (secure 0 0 0) 0x7f8368043c30 con 0x7f8378107420 2024-09-11T23:08:15.612 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:14.912+0000 7f8377e00640 1 -- 172.21.15.37:0/1939444660 >> [v2:172.21.15.37:6800/3447426643,v1:172.21.15.37:6801/3447426643] conn(0x7f835c038e60 msgr2=0x7f835c03b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:08:15.612 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:14.912+0000 7f8377e00640 1 --2- 172.21.15.37:0/1939444660 >> [v2:172.21.15.37:6800/3447426643,v1:172.21.15.37:6801/3447426643] conn(0x7f835c038e60 0x7f835c03b320 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f83600098c0 tx=0x7f8360006db0 comp rx=0 tx=0).stop 2024-09-11T23:08:15.612 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:14.912+0000 7f8377e00640 1 -- 172.21.15.37:0/1939444660 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8378107420 msgr2=0x7f837819b3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:08:15.612 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:14.912+0000 7f8377e00640 1 --2- 172.21.15.37:0/1939444660 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8378107420 0x7f837819b3f0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f83680097f0 tx=0x7f8368030d80 comp rx=0 tx=0).stop 2024-09-11T23:08:15.612 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:14.912+0000 7f8377e00640 1 -- 172.21.15.37:0/1939444660 shutdown_connections 2024-09-11T23:08:15.612 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:14.912+0000 7f8377e00640 1 --2- 172.21.15.37:0/1939444660 >> [v2:172.21.15.37:6800/3447426643,v1:172.21.15.37:6801/3447426643] conn(0x7f835c038e60 0x7f835c03b320 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:08:15.612 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:14.912+0000 7f8377e00640 1 --2- 172.21.15.37:0/1939444660 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8378107420 0x7f837819b3f0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:08:15.612 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:14.912+0000 7f8377e00640 1 -- 172.21.15.37:0/1939444660 >> 172.21.15.37:0/1939444660 conn(0x7f8378102c10 msgr2=0x7f83781037d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:08:15.613 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:14.912+0000 7f8377e00640 1 -- 172.21.15.37:0/1939444660 shutdown_connections 2024-09-11T23:08:15.613 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:14.912+0000 7f8377e00640 1 -- 172.21.15.37:0/1939444660 wait complete. 2024-09-11T23:08:15.613 INFO:teuthology.orchestra.run.smithi037.stdout:mgr is available 2024-09-11T23:08:15.837 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:15 smithi037 ceph-mon[30630]: mgrmap e3: x(active, since 1.0087s) 2024-09-11T23:08:15.837 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:15 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/1939444660' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-11T23:08:16.946 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:16 smithi037 ceph-mon[30630]: mgrmap e4: x(active, since 2s) 2024-09-11T23:08:16.946 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:16 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/3228149484' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-11T23:08:16.951 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 2024-09-11T23:08:16.957 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout [global] 2024-09-11T23:08:16.958 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout fsid = 8b03efce-7092-11ef-bcea-c7b262605968 2024-09-11T23:08:16.958 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.37:3300,v1:172.21.15.37:6789] 2024-09-11T23:08:16.958 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-11T23:08:16.958 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-11T23:08:16.958 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-11T23:08:16.958 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-11T23:08:16.958 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 2024-09-11T23:08:16.958 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-11T23:08:16.958 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-11T23:08:16.958 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 2024-09-11T23:08:16.958 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout [osd] 2024-09-11T23:08:16.958 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-11T23:08:16.959 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-11T23:08:16.959 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-11T23:08:16.959 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-11T23:08:16.959 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-11T23:08:16.959 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:16.096+0000 7faa42c00640 1 Processor -- start 2024-09-11T23:08:16.959 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:16.096+0000 7faa42c00640 1 -- start start 2024-09-11T23:08:16.959 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:16.097+0000 7faa42c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa3c07dd30 0x7faa3c07c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:08:16.959 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:16.097+0000 7faa42c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7faa3c07c7e0 con 0x7faa3c07dd30 2024-09-11T23:08:16.959 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:16.097+0000 7faa3be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa3c07dd30 0x7faa3c07c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:08:16.959 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:16.097+0000 7faa3be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa3c07dd30 0x7faa3c07c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60224/0 (socket says 172.21.15.37:60224) 2024-09-11T23:08:16.959 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:16.097+0000 7faa3be00640 1 -- 172.21.15.37:0/331491397 learned_addr learned my addr 172.21.15.37:0/331491397 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:08:16.959 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:16.098+0000 7faa3be00640 1 -- 172.21.15.37:0/331491397 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa3c07c960 con 0x7faa3c07dd30 2024-09-11T23:08:16.960 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:16.098+0000 7faa3be00640 1 --2- 172.21.15.37:0/331491397 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa3c07dd30 0x7faa3c07c2a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7faa2c009820 tx=0x7faa2c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcb91dbc87bd80e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:08:16.960 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:16.099+0000 7faa3b400640 1 -- 172.21.15.37:0/331491397 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa2c037070 con 0x7faa3c07dd30 2024-09-11T23:08:16.960 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:16.099+0000 7faa3b400640 1 -- 172.21.15.37:0/331491397 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7faa2c032900 con 0x7faa3c07dd30 2024-09-11T23:08:16.960 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:16.099+0000 7faa3b400640 1 -- 172.21.15.37:0/331491397 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa2c030850 con 0x7faa3c07dd30 2024-09-11T23:08:16.960 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:16.099+0000 7faa42c00640 1 -- 172.21.15.37:0/331491397 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa3c07dd30 msgr2=0x7faa3c07c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:08:16.960 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:16.099+0000 7faa42c00640 1 --2- 172.21.15.37:0/331491397 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa3c07dd30 0x7faa3c07c2a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7faa2c009820 tx=0x7faa2c02a270 comp rx=0 tx=0).stop 2024-09-11T23:08:16.960 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:16.099+0000 7faa42c00640 1 -- 172.21.15.37:0/331491397 shutdown_connections 2024-09-11T23:08:16.960 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:16.099+0000 7faa42c00640 1 --2- 172.21.15.37:0/331491397 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa3c07dd30 0x7faa3c07c2a0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:08:16.960 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:16.099+0000 7faa42c00640 1 -- 172.21.15.37:0/331491397 >> 172.21.15.37:0/331491397 conn(0x7faa3c102e50 msgr2=0x7faa3c105270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:08:16.960 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:16.100+0000 7faa42c00640 1 -- 172.21.15.37:0/331491397 shutdown_connections 2024-09-11T23:08:16.960 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:16.100+0000 7faa42c00640 1 -- 172.21.15.37:0/331491397 wait complete. 2024-09-11T23:08:16.960 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:16.101+0000 7faa42c00640 1 Processor -- start 2024-09-11T23:08:16.960 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:16.101+0000 7faa42c00640 1 -- start start 2024-09-11T23:08:16.961 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:16.101+0000 7faa42c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa3c07dd30 0x7faa3c19d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:08:16.961 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:16.101+0000 7faa42c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7faa3c10db80 con 0x7faa3c07dd30 2024-09-11T23:08:16.961 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:16.101+0000 7faa3be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa3c07dd30 0x7faa3c19d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:08:16.961 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:16.101+0000 7faa3be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa3c07dd30 0x7faa3c19d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60236/0 (socket says 172.21.15.37:60236) 2024-09-11T23:08:16.961 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:16.101+0000 7faa3be00640 1 -- 172.21.15.37:0/3228149484 learned_addr learned my addr 172.21.15.37:0/3228149484 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:08:16.961 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:16.102+0000 7faa3be00640 1 -- 172.21.15.37:0/3228149484 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa3c19dd00 con 0x7faa3c07dd30 2024-09-11T23:08:16.961 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:16.102+0000 7faa3be00640 1 --2- 172.21.15.37:0/3228149484 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa3c07dd30 0x7faa3c19d7c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7faa2c0097f0 tx=0x7faa2c030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:08:16.961 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:16.102+0000 7faa39600640 1 -- 172.21.15.37:0/3228149484 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa2c037040 con 0x7faa3c07dd30 2024-09-11T23:08:16.961 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:16.102+0000 7faa39600640 1 -- 172.21.15.37:0/3228149484 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7faa2c040070 con 0x7faa3c07dd30 2024-09-11T23:08:16.961 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:16.102+0000 7faa42c00640 1 -- 172.21.15.37:0/3228149484 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa3c19df90 con 0x7faa3c07dd30 2024-09-11T23:08:16.961 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:16.102+0000 7faa39600640 1 -- 172.21.15.37:0/3228149484 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa2c03a390 con 0x7faa3c07dd30 2024-09-11T23:08:16.962 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:16.102+0000 7faa42c00640 1 -- 172.21.15.37:0/3228149484 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa3c1a0c80 con 0x7faa3c07dd30 2024-09-11T23:08:16.962 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:16.103+0000 7faa39600640 1 -- 172.21.15.37:0/3228149484 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 4) ==== 46276+0+0 (secure 0 0 0) 0x7faa2c03b430 con 0x7faa3c07dd30 2024-09-11T23:08:16.962 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:16.103+0000 7faa42c00640 1 -- 172.21.15.37:0/3228149484 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa3c07c320 con 0x7faa3c07dd30 2024-09-11T23:08:16.962 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:16.104+0000 7faa39600640 1 --2- 172.21.15.37:0/3228149484 >> [v2:172.21.15.37:6800/3447426643,v1:172.21.15.37:6801/3447426643] conn(0x7faa20038f20 0x7faa2003b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:08:16.962 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:16.104+0000 7faa39600640 1 -- 172.21.15.37:0/3228149484 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7faa2c06c0c0 con 0x7faa3c07dd30 2024-09-11T23:08:16.962 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:16.104+0000 7faa33e00640 1 --2- 172.21.15.37:0/3228149484 >> [v2:172.21.15.37:6800/3447426643,v1:172.21.15.37:6801/3447426643] conn(0x7faa20038f20 0x7faa2003b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:08:16.962 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:16.105+0000 7faa33e00640 1 --2- 172.21.15.37:0/3228149484 >> [v2:172.21.15.37:6800/3447426643,v1:172.21.15.37:6801/3447426643] conn(0x7faa20038f20 0x7faa2003b3e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7faa240098c0 tx=0x7faa24006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:08:16.962 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:16.109+0000 7faa39600640 1 -- 172.21.15.37:0/3228149484 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7faa2c06be20 con 0x7faa3c07dd30 2024-09-11T23:08:16.962 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:16.294+0000 7faa42c00640 1 -- 172.21.15.37:0/3228149484 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7faa3c19e410 con 0x7faa3c07dd30 2024-09-11T23:08:16.962 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:16.295+0000 7faa39600640 1 -- 172.21.15.37:0/3228149484 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+429 (secure 0 0 0) 0x7faa2c032900 con 0x7faa3c07dd30 2024-09-11T23:08:16.962 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:16.298+0000 7faa42c00640 1 -- 172.21.15.37:0/3228149484 >> [v2:172.21.15.37:6800/3447426643,v1:172.21.15.37:6801/3447426643] conn(0x7faa20038f20 msgr2=0x7faa2003b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:08:16.962 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:16.298+0000 7faa42c00640 1 --2- 172.21.15.37:0/3228149484 >> [v2:172.21.15.37:6800/3447426643,v1:172.21.15.37:6801/3447426643] conn(0x7faa20038f20 0x7faa2003b3e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7faa240098c0 tx=0x7faa24006db0 comp rx=0 tx=0).stop 2024-09-11T23:08:16.962 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:16.298+0000 7faa42c00640 1 -- 172.21.15.37:0/3228149484 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa3c07dd30 msgr2=0x7faa3c19d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:08:16.963 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:16.298+0000 7faa42c00640 1 --2- 172.21.15.37:0/3228149484 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa3c07dd30 0x7faa3c19d7c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7faa2c0097f0 tx=0x7faa2c030d80 comp rx=0 tx=0).stop 2024-09-11T23:08:16.963 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:16.298+0000 7faa42c00640 1 -- 172.21.15.37:0/3228149484 shutdown_connections 2024-09-11T23:08:16.963 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:16.298+0000 7faa42c00640 1 --2- 172.21.15.37:0/3228149484 >> [v2:172.21.15.37:6800/3447426643,v1:172.21.15.37:6801/3447426643] conn(0x7faa20038f20 0x7faa2003b3e0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:08:16.963 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:16.298+0000 7faa42c00640 1 --2- 172.21.15.37:0/3228149484 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa3c07dd30 0x7faa3c19d7c0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:08:16.963 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:16.298+0000 7faa42c00640 1 -- 172.21.15.37:0/3228149484 >> 172.21.15.37:0/3228149484 conn(0x7faa3c102e50 msgr2=0x7faa3c103980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:08:16.963 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:16.298+0000 7faa42c00640 1 -- 172.21.15.37:0/3228149484 shutdown_connections 2024-09-11T23:08:16.963 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:16.298+0000 7faa42c00640 1 -- 172.21.15.37:0/3228149484 wait complete. 2024-09-11T23:08:16.963 INFO:teuthology.orchestra.run.smithi037.stdout:Enabling cephadm module... 2024-09-11T23:08:17.947 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:17 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/1082999849' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-11T23:08:17.947 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:17 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: ignoring --setuser ceph since I am not root 2024-09-11T23:08:17.947 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:17 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: ignoring --setgroup ceph since I am not root 2024-09-11T23:08:17.947 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:17 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: 2024-09-11T23:08:17.946+0000 7f2d1762d040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-11T23:08:18.212 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:18 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: 2024-09-11T23:08:18.021+0000 7f2d1762d040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-11T23:08:18.212 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:18 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: 2024-09-11T23:08:18.212+0000 7f2d1762d040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-11T23:08:18.477 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:18 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: 2024-09-11T23:08:18.295+0000 7f2d1762d040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-11T23:08:18.511 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:17.424+0000 7fea68e00640 1 Processor -- start 2024-09-11T23:08:18.511 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:17.424+0000 7fea68e00640 1 -- start start 2024-09-11T23:08:18.511 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:17.424+0000 7fea68e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea64109620 0x7fea64109a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:08:18.511 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:17.424+0000 7fea68e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fea64109ff0 con 0x7fea64109620 2024-09-11T23:08:18.511 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:17.424+0000 7fea63400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea64109620 0x7fea64109a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:08:18.511 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:17.425+0000 7fea63400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea64109620 0x7fea64109a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60242/0 (socket says 172.21.15.37:60242) 2024-09-11T23:08:18.511 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:17.425+0000 7fea63400640 1 -- 172.21.15.37:0/3480172787 learned_addr learned my addr 172.21.15.37:0/3480172787 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:08:18.511 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:17.425+0000 7fea63400640 1 -- 172.21.15.37:0/3480172787 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea6410a7d0 con 0x7fea64109620 2024-09-11T23:08:18.512 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:17.426+0000 7fea63400640 1 --2- 172.21.15.37:0/3480172787 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea64109620 0x7fea64109a20 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fea54009820 tx=0x7fea5402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94bb210ec0049f71 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:08:18.512 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:17.426+0000 7fea62000640 1 -- 172.21.15.37:0/3480172787 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea54037070 con 0x7fea64109620 2024-09-11T23:08:18.512 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:17.426+0000 7fea62000640 1 -- 172.21.15.37:0/3480172787 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fea54032900 con 0x7fea64109620 2024-09-11T23:08:18.512 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:17.426+0000 7fea62000640 1 -- 172.21.15.37:0/3480172787 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea54030850 con 0x7fea64109620 2024-09-11T23:08:18.512 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:17.427+0000 7fea68e00640 1 -- 172.21.15.37:0/3480172787 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea64109620 msgr2=0x7fea64109a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:08:18.512 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:17.427+0000 7fea68e00640 1 --2- 172.21.15.37:0/3480172787 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea64109620 0x7fea64109a20 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fea54009820 tx=0x7fea5402a270 comp rx=0 tx=0).stop 2024-09-11T23:08:18.512 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:17.427+0000 7fea68e00640 1 -- 172.21.15.37:0/3480172787 shutdown_connections 2024-09-11T23:08:18.512 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:17.427+0000 7fea68e00640 1 --2- 172.21.15.37:0/3480172787 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea64109620 0x7fea64109a20 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:08:18.512 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:17.427+0000 7fea68e00640 1 -- 172.21.15.37:0/3480172787 >> 172.21.15.37:0/3480172787 conn(0x7fea6407cc70 msgr2=0x7fea64107360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:08:18.512 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:17.427+0000 7fea68e00640 1 -- 172.21.15.37:0/3480172787 shutdown_connections 2024-09-11T23:08:18.512 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:17.427+0000 7fea68e00640 1 -- 172.21.15.37:0/3480172787 wait complete. 2024-09-11T23:08:18.512 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:17.428+0000 7fea68e00640 1 Processor -- start 2024-09-11T23:08:18.512 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:17.428+0000 7fea68e00640 1 -- start start 2024-09-11T23:08:18.513 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:17.428+0000 7fea68e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea64109620 0x7fea6419d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:08:18.513 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:17.428+0000 7fea68e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fea6410db80 con 0x7fea64109620 2024-09-11T23:08:18.513 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:17.429+0000 7fea63400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea64109620 0x7fea6419d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:08:18.513 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:17.429+0000 7fea63400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea64109620 0x7fea6419d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60244/0 (socket says 172.21.15.37:60244) 2024-09-11T23:08:18.513 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:17.429+0000 7fea63400640 1 -- 172.21.15.37:0/1082999849 learned_addr learned my addr 172.21.15.37:0/1082999849 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:08:18.513 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:17.429+0000 7fea63400640 1 -- 172.21.15.37:0/1082999849 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea6419db30 con 0x7fea64109620 2024-09-11T23:08:18.513 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:17.429+0000 7fea63400640 1 --2- 172.21.15.37:0/1082999849 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea64109620 0x7fea6419d5f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fea540097f0 tx=0x7fea54030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:08:18.513 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:17.430+0000 7fea5be00640 1 -- 172.21.15.37:0/1082999849 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea54037040 con 0x7fea64109620 2024-09-11T23:08:18.513 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:17.430+0000 7fea5be00640 1 -- 172.21.15.37:0/1082999849 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fea54040070 con 0x7fea64109620 2024-09-11T23:08:18.513 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:17.430+0000 7fea5be00640 1 -- 172.21.15.37:0/1082999849 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea5403a390 con 0x7fea64109620 2024-09-11T23:08:18.513 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:17.430+0000 7fea68e00640 1 -- 172.21.15.37:0/1082999849 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea6419ddc0 con 0x7fea64109620 2024-09-11T23:08:18.513 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:17.430+0000 7fea68e00640 1 -- 172.21.15.37:0/1082999849 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea641a0ab0 con 0x7fea64109620 2024-09-11T23:08:18.513 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:17.431+0000 7fea5be00640 1 -- 172.21.15.37:0/1082999849 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 4) ==== 46276+0+0 (secure 0 0 0) 0x7fea5403b430 con 0x7fea64109620 2024-09-11T23:08:18.514 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:17.431+0000 7fea68e00640 1 -- 172.21.15.37:0/1082999849 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea64109aa0 con 0x7fea64109620 2024-09-11T23:08:18.514 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:17.431+0000 7fea5be00640 1 --2- 172.21.15.37:0/1082999849 >> [v2:172.21.15.37:6800/3447426643,v1:172.21.15.37:6801/3447426643] conn(0x7fea48038f70 0x7fea4803b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:08:18.514 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:17.431+0000 7fea5be00640 1 -- 172.21.15.37:0/1082999849 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fea5406c0d0 con 0x7fea64109620 2024-09-11T23:08:18.514 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:17.432+0000 7fea62a00640 1 --2- 172.21.15.37:0/1082999849 >> [v2:172.21.15.37:6800/3447426643,v1:172.21.15.37:6801/3447426643] conn(0x7fea48038f70 0x7fea4803b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:08:18.514 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:17.433+0000 7fea62a00640 1 --2- 172.21.15.37:0/1082999849 >> [v2:172.21.15.37:6800/3447426643,v1:172.21.15.37:6801/3447426643] conn(0x7fea48038f70 0x7fea4803b430 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fea500098c0 tx=0x7fea50006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:08:18.514 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:17.437+0000 7fea5be00640 1 -- 172.21.15.37:0/1082999849 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fea540371e0 con 0x7fea64109620 2024-09-11T23:08:18.514 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:17.669+0000 7fea68e00640 1 -- 172.21.15.37:0/1082999849 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7fea6419e240 con 0x7fea64109620 2024-09-11T23:08:18.514 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:17.721+0000 7fea5be00640 1 -- 172.21.15.37:0/1082999849 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7fea54032dd0 con 0x7fea64109620 2024-09-11T23:08:18.514 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:17.723+0000 7fea5be00640 1 -- 172.21.15.37:0/1082999849 <== mon.0 v2:172.21.15.37:3300/0 8 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7fea54032900 con 0x7fea64109620 2024-09-11T23:08:18.514 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:17.724+0000 7fea68e00640 1 -- 172.21.15.37:0/1082999849 >> [v2:172.21.15.37:6800/3447426643,v1:172.21.15.37:6801/3447426643] conn(0x7fea48038f70 msgr2=0x7fea4803b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:08:18.514 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:17.724+0000 7fea68e00640 1 --2- 172.21.15.37:0/1082999849 >> [v2:172.21.15.37:6800/3447426643,v1:172.21.15.37:6801/3447426643] conn(0x7fea48038f70 0x7fea4803b430 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fea500098c0 tx=0x7fea50006db0 comp rx=0 tx=0).stop 2024-09-11T23:08:18.514 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:17.724+0000 7fea68e00640 1 -- 172.21.15.37:0/1082999849 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea64109620 msgr2=0x7fea6419d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:08:18.514 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:17.724+0000 7fea68e00640 1 --2- 172.21.15.37:0/1082999849 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea64109620 0x7fea6419d5f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fea540097f0 tx=0x7fea54030d80 comp rx=0 tx=0).stop 2024-09-11T23:08:18.515 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:17.725+0000 7fea68e00640 1 -- 172.21.15.37:0/1082999849 shutdown_connections 2024-09-11T23:08:18.515 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:17.725+0000 7fea68e00640 1 --2- 172.21.15.37:0/1082999849 >> [v2:172.21.15.37:6800/3447426643,v1:172.21.15.37:6801/3447426643] conn(0x7fea48038f70 0x7fea4803b430 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:08:18.515 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:17.725+0000 7fea68e00640 1 --2- 172.21.15.37:0/1082999849 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea64109620 0x7fea6419d5f0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:08:18.515 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:17.725+0000 7fea68e00640 1 -- 172.21.15.37:0/1082999849 >> 172.21.15.37:0/1082999849 conn(0x7fea6407cc70 msgr2=0x7fea64106b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:08:18.515 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:17.725+0000 7fea68e00640 1 -- 172.21.15.37:0/1082999849 shutdown_connections 2024-09-11T23:08:18.515 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:17.725+0000 7fea68e00640 1 -- 172.21.15.37:0/1082999849 wait complete. 2024-09-11T23:08:18.785 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:18 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/1082999849' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-11T23:08:18.785 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:18 smithi037 ceph-mon[30630]: mgrmap e5: x(active, since 4s) 2024-09-11T23:08:18.786 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:18 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: 2024-09-11T23:08:18.477+0000 7f2d1762d040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-11T23:08:18.786 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:18 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: 2024-09-11T23:08:18.652+0000 7f2d1762d040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-11T23:08:19.314 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:19 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: 2024-09-11T23:08:19.045+0000 7f2d1762d040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-11T23:08:19.315 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:19 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: 2024-09-11T23:08:19.120+0000 7f2d1762d040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-11T23:08:19.606 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:19 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: 2024-09-11T23:08:19.342+0000 7f2d1762d040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-11T23:08:19.925 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:19 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/713412762' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-11T23:08:19.936 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout { 2024-09-11T23:08:19.936 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-11T23:08:19.936 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-11T23:08:19.936 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-11T23:08:19.936 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-11T23:08:19.936 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout } 2024-09-11T23:08:19.936 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:19.007+0000 7fcb79a00640 1 Processor -- start 2024-09-11T23:08:19.936 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:19.007+0000 7fcb79a00640 1 -- start start 2024-09-11T23:08:19.936 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:19.007+0000 7fcb79a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb741075b0 0x7fcb741079b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:08:19.936 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:19.007+0000 7fcb79a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fcb74107f80 con 0x7fcb741075b0 2024-09-11T23:08:19.936 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:19.008+0000 7fcb72a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb741075b0 0x7fcb741079b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:08:19.936 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:19.008+0000 7fcb72a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb741075b0 0x7fcb741079b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48314/0 (socket says 172.21.15.37:48314) 2024-09-11T23:08:19.937 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:19.008+0000 7fcb72a00640 1 -- 172.21.15.37:0/2050865132 learned_addr learned my addr 172.21.15.37:0/2050865132 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:08:19.937 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:19.008+0000 7fcb72a00640 1 -- 172.21.15.37:0/2050865132 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb74108760 con 0x7fcb741075b0 2024-09-11T23:08:19.937 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:19.009+0000 7fcb72a00640 1 --2- 172.21.15.37:0/2050865132 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb741075b0 0x7fcb741079b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fcb64009820 tx=0x7fcb6402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=344f7b044aed95c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:08:19.937 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:19.009+0000 7fcb71600640 1 -- 172.21.15.37:0/2050865132 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb64037070 con 0x7fcb741075b0 2024-09-11T23:08:19.937 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:19.009+0000 7fcb71600640 1 -- 172.21.15.37:0/2050865132 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fcb64032900 con 0x7fcb741075b0 2024-09-11T23:08:19.937 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:19.009+0000 7fcb71600640 1 -- 172.21.15.37:0/2050865132 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb64030850 con 0x7fcb741075b0 2024-09-11T23:08:19.937 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:19.010+0000 7fcb79a00640 1 -- 172.21.15.37:0/2050865132 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb741075b0 msgr2=0x7fcb741079b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:08:19.937 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:19.010+0000 7fcb79a00640 1 --2- 172.21.15.37:0/2050865132 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb741075b0 0x7fcb741079b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fcb64009820 tx=0x7fcb6402a270 comp rx=0 tx=0).stop 2024-09-11T23:08:19.937 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:19.010+0000 7fcb79a00640 1 -- 172.21.15.37:0/2050865132 shutdown_connections 2024-09-11T23:08:19.937 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:19.010+0000 7fcb79a00640 1 --2- 172.21.15.37:0/2050865132 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb741075b0 0x7fcb741079b0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:08:19.937 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:19.010+0000 7fcb79a00640 1 -- 172.21.15.37:0/2050865132 >> 172.21.15.37:0/2050865132 conn(0x7fcb74102d20 msgr2=0x7fcb74105180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:08:19.937 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:19.011+0000 7fcb79a00640 1 -- 172.21.15.37:0/2050865132 shutdown_connections 2024-09-11T23:08:19.937 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:19.011+0000 7fcb79a00640 1 -- 172.21.15.37:0/2050865132 wait complete. 2024-09-11T23:08:19.938 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:19.012+0000 7fcb79a00640 1 Processor -- start 2024-09-11T23:08:19.938 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:19.012+0000 7fcb79a00640 1 -- start start 2024-09-11T23:08:19.938 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:19.012+0000 7fcb79a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb741075b0 0x7fcb7419b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:08:19.938 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:19.012+0000 7fcb79a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fcb7410bb10 con 0x7fcb741075b0 2024-09-11T23:08:19.938 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:19.012+0000 7fcb72a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb741075b0 0x7fcb7419b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:08:19.938 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:19.012+0000 7fcb72a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb741075b0 0x7fcb7419b580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48324/0 (socket says 172.21.15.37:48324) 2024-09-11T23:08:19.938 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:19.012+0000 7fcb72a00640 1 -- 172.21.15.37:0/713412762 learned_addr learned my addr 172.21.15.37:0/713412762 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:08:19.938 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:19.013+0000 7fcb72a00640 1 -- 172.21.15.37:0/713412762 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb7419bac0 con 0x7fcb741075b0 2024-09-11T23:08:19.938 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:19.013+0000 7fcb72a00640 1 --2- 172.21.15.37:0/713412762 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb741075b0 0x7fcb7419b580 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fcb640097f0 tx=0x7fcb64030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:08:19.938 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:19.013+0000 7fcb6b400640 1 -- 172.21.15.37:0/713412762 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb64037040 con 0x7fcb741075b0 2024-09-11T23:08:19.938 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:19.014+0000 7fcb6b400640 1 -- 172.21.15.37:0/713412762 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fcb64040070 con 0x7fcb741075b0 2024-09-11T23:08:19.938 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:19.014+0000 7fcb79a00640 1 -- 172.21.15.37:0/713412762 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb7419bd50 con 0x7fcb741075b0 2024-09-11T23:08:19.938 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:19.014+0000 7fcb6b400640 1 -- 172.21.15.37:0/713412762 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb6403a390 con 0x7fcb741075b0 2024-09-11T23:08:19.939 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:19.014+0000 7fcb79a00640 1 -- 172.21.15.37:0/713412762 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb7419ea40 con 0x7fcb741075b0 2024-09-11T23:08:19.939 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:19.015+0000 7fcb6b400640 1 -- 172.21.15.37:0/713412762 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7fcb6403a630 con 0x7fcb741075b0 2024-09-11T23:08:19.939 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:19.015+0000 7fcb79a00640 1 -- 172.21.15.37:0/713412762 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb7410bc90 con 0x7fcb741075b0 2024-09-11T23:08:19.939 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:19.016+0000 7fcb6b400640 1 --2- 172.21.15.37:0/713412762 >> [v2:172.21.15.37:6800/3447426643,v1:172.21.15.37:6801/3447426643] conn(0x7fcb58038f70 0x7fcb5803b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:08:19.939 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:19.016+0000 7fcb6b400640 1 -- 172.21.15.37:0/713412762 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fcb6406c140 con 0x7fcb741075b0 2024-09-11T23:08:19.939 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:19.016+0000 7fcb72000640 1 -- 172.21.15.37:0/713412762 >> [v2:172.21.15.37:6800/3447426643,v1:172.21.15.37:6801/3447426643] conn(0x7fcb58038f70 msgr2=0x7fcb5803b430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.37:6800/3447426643 2024-09-11T23:08:19.939 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:19.016+0000 7fcb72000640 1 --2- 172.21.15.37:0/713412762 >> [v2:172.21.15.37:6800/3447426643,v1:172.21.15.37:6801/3447426643] conn(0x7fcb58038f70 0x7fcb5803b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T23:08:19.939 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:19.025+0000 7fcb6b400640 1 -- 172.21.15.37:0/713412762 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fcb6404a200 con 0x7fcb741075b0 2024-09-11T23:08:19.939 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:19.217+0000 7fcb72000640 1 -- 172.21.15.37:0/713412762 >> [v2:172.21.15.37:6800/3447426643,v1:172.21.15.37:6801/3447426643] conn(0x7fcb58038f70 msgr2=0x7fcb5803b430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.37:6800/3447426643 2024-09-11T23:08:19.939 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:19.217+0000 7fcb72000640 1 --2- 172.21.15.37:0/713412762 >> [v2:172.21.15.37:6800/3447426643,v1:172.21.15.37:6801/3447426643] conn(0x7fcb58038f70 0x7fcb5803b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T23:08:19.939 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:19.261+0000 7fcb79a00640 1 -- 172.21.15.37:0/713412762 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7fcb7419ec10 con 0x7fcb741075b0 2024-09-11T23:08:19.939 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:19.261+0000 7fcb6b400640 1 -- 172.21.15.37:0/713412762 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7fcb6402ee80 con 0x7fcb741075b0 2024-09-11T23:08:19.939 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:19.263+0000 7fcb79a00640 1 -- 172.21.15.37:0/713412762 >> [v2:172.21.15.37:6800/3447426643,v1:172.21.15.37:6801/3447426643] conn(0x7fcb58038f70 msgr2=0x7fcb5803b430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T23:08:19.940 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:19.263+0000 7fcb79a00640 1 --2- 172.21.15.37:0/713412762 >> [v2:172.21.15.37:6800/3447426643,v1:172.21.15.37:6801/3447426643] conn(0x7fcb58038f70 0x7fcb5803b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:08:19.940 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:19.263+0000 7fcb79a00640 1 -- 172.21.15.37:0/713412762 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb741075b0 msgr2=0x7fcb7419b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:08:19.940 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:19.263+0000 7fcb79a00640 1 --2- 172.21.15.37:0/713412762 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb741075b0 0x7fcb7419b580 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fcb640097f0 tx=0x7fcb64030d80 comp rx=0 tx=0).stop 2024-09-11T23:08:19.940 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:19.264+0000 7fcb79a00640 1 -- 172.21.15.37:0/713412762 shutdown_connections 2024-09-11T23:08:19.940 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:19.264+0000 7fcb79a00640 1 --2- 172.21.15.37:0/713412762 >> [v2:172.21.15.37:6800/3447426643,v1:172.21.15.37:6801/3447426643] conn(0x7fcb58038f70 0x7fcb5803b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:08:19.940 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:19.264+0000 7fcb79a00640 1 --2- 172.21.15.37:0/713412762 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb741075b0 0x7fcb7419b580 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:08:19.940 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:19.264+0000 7fcb79a00640 1 -- 172.21.15.37:0/713412762 >> 172.21.15.37:0/713412762 conn(0x7fcb74102d20 msgr2=0x7fcb74103960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:08:19.940 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:19.264+0000 7fcb79a00640 1 -- 172.21.15.37:0/713412762 shutdown_connections 2024-09-11T23:08:19.940 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:19.264+0000 7fcb79a00640 1 -- 172.21.15.37:0/713412762 wait complete. 2024-09-11T23:08:19.940 INFO:teuthology.orchestra.run.smithi037.stdout:Waiting for the mgr to restart... 2024-09-11T23:08:19.940 INFO:teuthology.orchestra.run.smithi037.stdout:Waiting for mgr epoch 5... 2024-09-11T23:08:20.814 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:20 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: 2024-09-11T23:08:20.498+0000 7f2d1762d040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-11T23:08:20.814 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:20 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: 2024-09-11T23:08:20.584+0000 7f2d1762d040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-11T23:08:21.814 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:21 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: 2024-09-11T23:08:21.525+0000 7f2d1762d040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-11T23:08:21.814 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:21 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: 2024-09-11T23:08:21.667+0000 7f2d1762d040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-11T23:08:22.090 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:21 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: 2024-09-11T23:08:21.837+0000 7f2d1762d040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-11T23:08:22.091 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:21 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: 2024-09-11T23:08:21.912+0000 7f2d1762d040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-11T23:08:22.091 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:22 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: 2024-09-11T23:08:22.089+0000 7f2d1762d040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-11T23:08:22.436 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:22 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: 2024-09-11T23:08:22.173+0000 7f2d1762d040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-11T23:08:22.436 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:22 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: 2024-09-11T23:08:22.247+0000 7f2d1762d040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-11T23:08:22.436 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:22 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: 2024-09-11T23:08:22.434+0000 7f2d1762d040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-11T23:08:22.698 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:22 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: 2024-09-11T23:08:22.514+0000 7f2d1762d040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-11T23:08:22.699 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:22 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: 2024-09-11T23:08:22.597+0000 7f2d1762d040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-11T23:08:22.699 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:22 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: 2024-09-11T23:08:22.697+0000 7f2d1762d040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-11T23:08:23.064 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:22 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: 2024-09-11T23:08:22.770+0000 7f2d1762d040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-11T23:08:23.065 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:22 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: 2024-09-11T23:08:22.842+0000 7f2d1762d040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-11T23:08:24.064 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:23 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: 2024-09-11T23:08:23.790+0000 7f2d1762d040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-11T23:08:24.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:23 smithi037 ceph-mon[30630]: Active manager daemon x restarted 2024-09-11T23:08:24.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:23 smithi037 ceph-mon[30630]: Activating manager daemon x 2024-09-11T23:08:24.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:23 smithi037 ceph-mon[30630]: osdmap e2: 0 total, 0 up, 0 in 2024-09-11T23:08:24.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:23 smithi037 ceph-mon[30630]: mgrmap e6: x(active, starting, since 0.00416298s) 2024-09-11T23:08:24.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:23 smithi037 ceph-mon[30630]: from='mgr.14118 172.21.15.37:0/4176675630' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T23:08:24.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:23 smithi037 ceph-mon[30630]: from='mgr.14118 172.21.15.37:0/4176675630' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-11T23:08:24.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:23 smithi037 ceph-mon[30630]: from='mgr.14118 172.21.15.37:0/4176675630' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-11T23:08:24.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:23 smithi037 ceph-mon[30630]: from='mgr.14118 172.21.15.37:0/4176675630' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-11T23:08:24.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:23 smithi037 ceph-mon[30630]: from='mgr.14118 172.21.15.37:0/4176675630' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-11T23:08:24.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:23 smithi037 ceph-mon[30630]: Manager daemon x is now available 2024-09-11T23:08:24.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:23 smithi037 ceph-mon[30630]: Found migration_current of "None". Setting to last migration. 2024-09-11T23:08:24.066 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:23 smithi037 ceph-mon[30630]: from='mgr.14118 172.21.15.37:0/4176675630' entity='mgr.x' 2024-09-11T23:08:24.066 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:23 smithi037 ceph-mon[30630]: from='mgr.14118 172.21.15.37:0/4176675630' entity='mgr.x' 2024-09-11T23:08:24.066 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:23 smithi037 ceph-mon[30630]: from='mgr.14118 172.21.15.37:0/4176675630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:08:24.066 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:23 smithi037 ceph-mon[30630]: from='mgr.14118 172.21.15.37:0/4176675630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:08:25.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:24 smithi037 ceph-mon[30630]: from='mgr.14118 172.21.15.37:0/4176675630' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-11T23:08:25.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:24 smithi037 ceph-mon[30630]: from='mgr.14118 172.21.15.37:0/4176675630' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-11T23:08:25.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:24 smithi037 ceph-mon[30630]: mgrmap e7: x(active, since 1.0063s) 2024-09-11T23:08:25.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:24 smithi037 ceph-mon[30630]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-11T23:08:25.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:24 smithi037 ceph-mon[30630]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-11T23:08:25.477 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout { 2024-09-11T23:08:25.477 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-11T23:08:25.477 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-11T23:08:25.477 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout } 2024-09-11T23:08:25.477 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:20.438+0000 7f459bc00640 1 Processor -- start 2024-09-11T23:08:25.477 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:20.438+0000 7f459bc00640 1 -- start start 2024-09-11T23:08:25.477 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:20.438+0000 7f459bc00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4594107600 0x7f4594107a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:08:25.477 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:20.438+0000 7f459bc00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4594107f40 con 0x7f4594107600 2024-09-11T23:08:25.478 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:20.438+0000 7f4599200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4594107600 0x7f4594107a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:08:25.478 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:20.439+0000 7f4599200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4594107600 0x7f4594107a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48330/0 (socket says 172.21.15.37:48330) 2024-09-11T23:08:25.478 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:20.439+0000 7f4599200640 1 -- 172.21.15.37:0/1302216331 learned_addr learned my addr 172.21.15.37:0/1302216331 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:08:25.478 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:20.439+0000 7f4599200640 1 -- 172.21.15.37:0/1302216331 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45941080c0 con 0x7f4594107600 2024-09-11T23:08:25.478 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:20.440+0000 7f4599200640 1 --2- 172.21.15.37:0/1302216331 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4594107600 0x7f4594107a00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4588009820 tx=0x7f458802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59c83fa46c74f5be server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:08:25.478 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:20.440+0000 7f4593400640 1 -- 172.21.15.37:0/1302216331 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4588037070 con 0x7f4594107600 2024-09-11T23:08:25.478 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:20.440+0000 7f4593400640 1 -- 172.21.15.37:0/1302216331 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4588032900 con 0x7f4594107600 2024-09-11T23:08:25.478 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:20.440+0000 7f4593400640 1 -- 172.21.15.37:0/1302216331 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4588030850 con 0x7f4594107600 2024-09-11T23:08:25.478 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:20.441+0000 7f459bc00640 1 -- 172.21.15.37:0/1302216331 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4594107600 msgr2=0x7f4594107a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:08:25.478 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:20.441+0000 7f459bc00640 1 --2- 172.21.15.37:0/1302216331 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4594107600 0x7f4594107a00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4588009820 tx=0x7f458802a270 comp rx=0 tx=0).stop 2024-09-11T23:08:25.478 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:20.441+0000 7f459bc00640 1 -- 172.21.15.37:0/1302216331 shutdown_connections 2024-09-11T23:08:25.478 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:20.441+0000 7f459bc00640 1 --2- 172.21.15.37:0/1302216331 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4594107600 0x7f4594107a00 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:08:25.479 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:20.441+0000 7f459bc00640 1 -- 172.21.15.37:0/1302216331 >> 172.21.15.37:0/1302216331 conn(0x7f4594102e50 msgr2=0x7f4594105270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:08:25.479 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:20.441+0000 7f459bc00640 1 -- 172.21.15.37:0/1302216331 shutdown_connections 2024-09-11T23:08:25.479 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:20.441+0000 7f459bc00640 1 -- 172.21.15.37:0/1302216331 wait complete. 2024-09-11T23:08:25.479 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:20.442+0000 7f459bc00640 1 Processor -- start 2024-09-11T23:08:25.479 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:20.442+0000 7f459bc00640 1 -- start start 2024-09-11T23:08:25.479 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:20.442+0000 7f459bc00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4594107600 0x7f459419d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:08:25.479 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:20.442+0000 7f459bc00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f459410ba70 con 0x7f4594107600 2024-09-11T23:08:25.479 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:20.443+0000 7f4599200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4594107600 0x7f459419d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:08:25.479 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:20.443+0000 7f4599200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4594107600 0x7f459419d790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48338/0 (socket says 172.21.15.37:48338) 2024-09-11T23:08:25.479 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:20.443+0000 7f4599200640 1 -- 172.21.15.37:0/1138208956 learned_addr learned my addr 172.21.15.37:0/1138208956 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:08:25.479 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:20.443+0000 7f4599200640 1 -- 172.21.15.37:0/1138208956 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f459419dcd0 con 0x7f4594107600 2024-09-11T23:08:25.479 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:20.444+0000 7f4599200640 1 --2- 172.21.15.37:0/1138208956 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4594107600 0x7f459419d790 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f45880097f0 tx=0x7f4588030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:08:25.479 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:20.444+0000 7f4591600640 1 -- 172.21.15.37:0/1138208956 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4588037040 con 0x7f4594107600 2024-09-11T23:08:25.480 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:20.444+0000 7f4591600640 1 -- 172.21.15.37:0/1138208956 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4588040070 con 0x7f4594107600 2024-09-11T23:08:25.480 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:20.444+0000 7f459bc00640 1 -- 172.21.15.37:0/1138208956 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f459419df60 con 0x7f4594107600 2024-09-11T23:08:25.480 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:20.444+0000 7f4591600640 1 -- 172.21.15.37:0/1138208956 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f458803a390 con 0x7f4594107600 2024-09-11T23:08:25.480 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:20.444+0000 7f459bc00640 1 -- 172.21.15.37:0/1138208956 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45941a0c50 con 0x7f4594107600 2024-09-11T23:08:25.480 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:20.445+0000 7f4591600640 1 -- 172.21.15.37:0/1138208956 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7f4588032900 con 0x7f4594107600 2024-09-11T23:08:25.480 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:20.446+0000 7f4591600640 1 --2- 172.21.15.37:0/1138208956 >> [v2:172.21.15.37:6800/3447426643,v1:172.21.15.37:6801/3447426643] conn(0x7f457c038f70 0x7f457c03b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:08:25.480 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:20.446+0000 7f4591600640 1 -- 172.21.15.37:0/1138208956 --> [v2:172.21.15.37:6800/3447426643,v1:172.21.15.37:6801/3447426643] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f457c03bb40 con 0x7f457c038f70 2024-09-11T23:08:25.480 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:20.446+0000 7f4591600640 1 -- 172.21.15.37:0/1138208956 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f458806c160 con 0x7f4594107600 2024-09-11T23:08:25.480 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:20.446+0000 7f4593e00640 1 -- 172.21.15.37:0/1138208956 >> [v2:172.21.15.37:6800/3447426643,v1:172.21.15.37:6801/3447426643] conn(0x7f457c038f70 msgr2=0x7f457c03b430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.37:6800/3447426643 2024-09-11T23:08:25.480 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:20.446+0000 7f4593e00640 1 --2- 172.21.15.37:0/1138208956 >> [v2:172.21.15.37:6800/3447426643,v1:172.21.15.37:6801/3447426643] conn(0x7f457c038f70 0x7f457c03b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T23:08:25.480 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:20.647+0000 7f4593e00640 1 -- 172.21.15.37:0/1138208956 >> [v2:172.21.15.37:6800/3447426643,v1:172.21.15.37:6801/3447426643] conn(0x7f457c038f70 msgr2=0x7f457c03b430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.37:6800/3447426643 2024-09-11T23:08:25.480 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:20.647+0000 7f4593e00640 1 --2- 172.21.15.37:0/1138208956 >> [v2:172.21.15.37:6800/3447426643,v1:172.21.15.37:6801/3447426643] conn(0x7f457c038f70 0x7f457c03b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T23:08:25.481 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:21.048+0000 7f4593e00640 1 -- 172.21.15.37:0/1138208956 >> [v2:172.21.15.37:6800/3447426643,v1:172.21.15.37:6801/3447426643] conn(0x7f457c038f70 msgr2=0x7f457c03b430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.37:6800/3447426643 2024-09-11T23:08:25.481 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:21.048+0000 7f4593e00640 1 --2- 172.21.15.37:0/1138208956 >> [v2:172.21.15.37:6800/3447426643,v1:172.21.15.37:6801/3447426643] conn(0x7f457c038f70 0x7f457c03b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-11T23:08:25.481 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:21.849+0000 7f4593e00640 1 -- 172.21.15.37:0/1138208956 >> [v2:172.21.15.37:6800/3447426643,v1:172.21.15.37:6801/3447426643] conn(0x7f457c038f70 msgr2=0x7f457c03b430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.37:6800/3447426643 2024-09-11T23:08:25.481 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:21.849+0000 7f4593e00640 1 --2- 172.21.15.37:0/1138208956 >> [v2:172.21.15.37:6800/3447426643,v1:172.21.15.37:6801/3447426643] conn(0x7f457c038f70 0x7f457c03b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-11T23:08:25.481 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:23.450+0000 7f4593e00640 1 -- 172.21.15.37:0/1138208956 >> [v2:172.21.15.37:6800/3447426643,v1:172.21.15.37:6801/3447426643] conn(0x7f457c038f70 msgr2=0x7f457c03b430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.37:6800/3447426643 2024-09-11T23:08:25.481 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:23.450+0000 7f4593e00640 1 --2- 172.21.15.37:0/1138208956 >> [v2:172.21.15.37:6800/3447426643,v1:172.21.15.37:6801/3447426643] conn(0x7f457c038f70 0x7f457c03b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-09-11T23:08:25.481 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:23.795+0000 7f4591600640 1 -- 172.21.15.37:0/1138208956 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mgrmap(e 6) ==== 46054+0+0 (secure 0 0 0) 0x7f4588040ce0 con 0x7f4594107600 2024-09-11T23:08:25.481 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:23.795+0000 7f4591600640 1 -- 172.21.15.37:0/1138208956 >> [v2:172.21.15.37:6800/3447426643,v1:172.21.15.37:6801/3447426643] conn(0x7f457c038f70 msgr2=0x7f457c03b430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T23:08:25.481 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:23.795+0000 7f4591600640 1 --2- 172.21.15.37:0/1138208956 >> [v2:172.21.15.37:6800/3447426643,v1:172.21.15.37:6801/3447426643] conn(0x7f457c038f70 0x7f457c03b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:08:25.481 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:24.796+0000 7f4591600640 1 -- 172.21.15.37:0/1138208956 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mgrmap(e 7) ==== 46181+0+0 (secure 0 0 0) 0x7f458806d660 con 0x7f4594107600 2024-09-11T23:08:25.481 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:24.796+0000 7f4591600640 1 --2- 172.21.15.37:0/1138208956 >> [v2:172.21.15.37:6800/2886800769,v1:172.21.15.37:6801/2886800769] conn(0x7f457c03c8a0 0x7f457c03ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:08:25.482 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:24.796+0000 7f4591600640 1 -- 172.21.15.37:0/1138208956 --> [v2:172.21.15.37:6800/2886800769,v1:172.21.15.37:6801/2886800769] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f457c03bb40 con 0x7f457c03c8a0 2024-09-11T23:08:25.482 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:24.797+0000 7f4593e00640 1 --2- 172.21.15.37:0/1138208956 >> [v2:172.21.15.37:6800/2886800769,v1:172.21.15.37:6801/2886800769] conn(0x7f457c03c8a0 0x7f457c03ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:08:25.482 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:24.799+0000 7f4593e00640 1 --2- 172.21.15.37:0/1138208956 >> [v2:172.21.15.37:6800/2886800769,v1:172.21.15.37:6801/2886800769] conn(0x7f457c03c8a0 0x7f457c03ec90 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f4580003980 tx=0x7f4580009290 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:08:25.482 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:24.799+0000 7f4591600640 1 -- 172.21.15.37:0/1138208956 <== mgr.14118 v2:172.21.15.37:6800/2886800769 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f457c03bb40 con 0x7f457c03c8a0 2024-09-11T23:08:25.482 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:24.807+0000 7f459bc00640 1 -- 172.21.15.37:0/1138208956 --> [v2:172.21.15.37:6800/2886800769,v1:172.21.15.37:6801/2886800769] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f4594107a80 con 0x7f457c03c8a0 2024-09-11T23:08:25.482 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:24.807+0000 7f4591600640 1 -- 172.21.15.37:0/1138208956 <== mgr.14118 v2:172.21.15.37:6800/2886800769 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7f4594107a80 con 0x7f457c03c8a0 2024-09-11T23:08:25.482 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:24.808+0000 7f459bc00640 1 -- 172.21.15.37:0/1138208956 >> [v2:172.21.15.37:6800/2886800769,v1:172.21.15.37:6801/2886800769] conn(0x7f457c03c8a0 msgr2=0x7f457c03ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:08:25.482 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:24.808+0000 7f459bc00640 1 --2- 172.21.15.37:0/1138208956 >> [v2:172.21.15.37:6800/2886800769,v1:172.21.15.37:6801/2886800769] conn(0x7f457c03c8a0 0x7f457c03ec90 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f4580003980 tx=0x7f4580009290 comp rx=0 tx=0).stop 2024-09-11T23:08:25.482 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:24.808+0000 7f459bc00640 1 -- 172.21.15.37:0/1138208956 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4594107600 msgr2=0x7f459419d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:08:25.482 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:24.808+0000 7f459bc00640 1 --2- 172.21.15.37:0/1138208956 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4594107600 0x7f459419d790 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f45880097f0 tx=0x7f4588030d80 comp rx=0 tx=0).stop 2024-09-11T23:08:25.482 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:24.808+0000 7f459bc00640 1 -- 172.21.15.37:0/1138208956 shutdown_connections 2024-09-11T23:08:25.482 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:24.808+0000 7f459bc00640 1 --2- 172.21.15.37:0/1138208956 >> [v2:172.21.15.37:6800/2886800769,v1:172.21.15.37:6801/2886800769] conn(0x7f457c03c8a0 0x7f457c03ec90 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:08:25.482 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:24.808+0000 7f459bc00640 1 --2- 172.21.15.37:0/1138208956 >> [v2:172.21.15.37:6800/3447426643,v1:172.21.15.37:6801/3447426643] conn(0x7f457c038f70 0x7f457c03b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:08:25.483 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:24.808+0000 7f459bc00640 1 --2- 172.21.15.37:0/1138208956 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4594107600 0x7f459419d790 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:08:25.483 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:24.808+0000 7f459bc00640 1 -- 172.21.15.37:0/1138208956 >> 172.21.15.37:0/1138208956 conn(0x7f4594102e50 msgr2=0x7f45941038c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:08:25.483 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:24.808+0000 7f459bc00640 1 -- 172.21.15.37:0/1138208956 shutdown_connections 2024-09-11T23:08:25.483 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:24.808+0000 7f459bc00640 1 -- 172.21.15.37:0/1138208956 wait complete. 2024-09-11T23:08:25.483 INFO:teuthology.orchestra.run.smithi037.stdout:mgr epoch 5 is available 2024-09-11T23:08:25.483 INFO:teuthology.orchestra.run.smithi037.stdout:Setting orchestrator backend to cephadm... 2024-09-11T23:08:26.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:25 smithi037 ceph-mon[30630]: from='mgr.14118 172.21.15.37:0/4176675630' entity='mgr.x' 2024-09-11T23:08:26.066 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:25 smithi037 ceph-mon[30630]: from='mgr.14118 172.21.15.37:0/4176675630' entity='mgr.x' 2024-09-11T23:08:26.813 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:25.961+0000 7fa73fe00640 1 Processor -- start 2024-09-11T23:08:26.813 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:25.961+0000 7fa73fe00640 1 -- start start 2024-09-11T23:08:26.814 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:25.961+0000 7fa73fe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa738109860 0x7fa738109c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:08:26.814 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:25.961+0000 7fa73fe00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa73810a230 con 0x7fa738109860 2024-09-11T23:08:26.814 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:25.962+0000 7fa73d400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa738109860 0x7fa738109c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:08:26.814 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:25.962+0000 7fa73d400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa738109860 0x7fa738109c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48402/0 (socket says 172.21.15.37:48402) 2024-09-11T23:08:26.814 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:25.962+0000 7fa73d400640 1 -- 172.21.15.37:0/433416570 learned_addr learned my addr 172.21.15.37:0/433416570 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:08:26.814 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:25.962+0000 7fa73d400640 1 -- 172.21.15.37:0/433416570 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa73810a9e0 con 0x7fa738109860 2024-09-11T23:08:26.814 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:25.963+0000 7fa73d400640 1 --2- 172.21.15.37:0/433416570 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa738109860 0x7fa738109c60 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fa72c009820 tx=0x7fa72c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66317768da7375 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:08:26.814 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:25.964+0000 7fa737e00640 1 -- 172.21.15.37:0/433416570 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa72c037070 con 0x7fa738109860 2024-09-11T23:08:26.814 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:25.964+0000 7fa737e00640 1 -- 172.21.15.37:0/433416570 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa72c032900 con 0x7fa738109860 2024-09-11T23:08:26.814 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:25.964+0000 7fa737e00640 1 -- 172.21.15.37:0/433416570 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa72c030850 con 0x7fa738109860 2024-09-11T23:08:26.814 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:25.964+0000 7fa73fe00640 1 -- 172.21.15.37:0/433416570 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa738109860 msgr2=0x7fa738109c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:08:26.814 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:25.964+0000 7fa73fe00640 1 --2- 172.21.15.37:0/433416570 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa738109860 0x7fa738109c60 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fa72c009820 tx=0x7fa72c02a270 comp rx=0 tx=0).stop 2024-09-11T23:08:26.815 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:25.965+0000 7fa73fe00640 1 -- 172.21.15.37:0/433416570 shutdown_connections 2024-09-11T23:08:26.815 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:25.965+0000 7fa73fe00640 1 --2- 172.21.15.37:0/433416570 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa738109860 0x7fa738109c60 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:08:26.815 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:25.965+0000 7fa73fe00640 1 -- 172.21.15.37:0/433416570 >> 172.21.15.37:0/433416570 conn(0x7fa73807cee0 msgr2=0x7fa73807d2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:08:26.815 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:25.965+0000 7fa73fe00640 1 -- 172.21.15.37:0/433416570 shutdown_connections 2024-09-11T23:08:26.815 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:25.965+0000 7fa73fe00640 1 -- 172.21.15.37:0/433416570 wait complete. 2024-09-11T23:08:26.815 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:25.966+0000 7fa73fe00640 1 Processor -- start 2024-09-11T23:08:26.815 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:25.966+0000 7fa73fe00640 1 -- start start 2024-09-11T23:08:26.815 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:25.966+0000 7fa73fe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa738109860 0x7fa73819dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:08:26.815 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:25.966+0000 7fa73fe00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa73810dd90 con 0x7fa738109860 2024-09-11T23:08:26.815 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:25.966+0000 7fa73d400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa738109860 0x7fa73819dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:08:26.815 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:25.966+0000 7fa73d400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa738109860 0x7fa73819dae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48416/0 (socket says 172.21.15.37:48416) 2024-09-11T23:08:26.815 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:25.966+0000 7fa73d400640 1 -- 172.21.15.37:0/995279110 learned_addr learned my addr 172.21.15.37:0/995279110 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:08:26.815 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:25.967+0000 7fa73d400640 1 -- 172.21.15.37:0/995279110 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa73819e020 con 0x7fa738109860 2024-09-11T23:08:26.815 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:25.967+0000 7fa73d400640 1 --2- 172.21.15.37:0/995279110 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa738109860 0x7fa73819dae0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fa72c0097f0 tx=0x7fa72c030ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:08:26.816 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:25.967+0000 7fa736000640 1 -- 172.21.15.37:0/995279110 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa72c042070 con 0x7fa738109860 2024-09-11T23:08:26.816 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:25.967+0000 7fa736000640 1 -- 172.21.15.37:0/995279110 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa72c032ca0 con 0x7fa738109860 2024-09-11T23:08:26.816 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:25.967+0000 7fa736000640 1 -- 172.21.15.37:0/995279110 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa72c037040 con 0x7fa738109860 2024-09-11T23:08:26.816 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:25.967+0000 7fa73fe00640 1 -- 172.21.15.37:0/995279110 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa73819e2b0 con 0x7fa738109860 2024-09-11T23:08:26.816 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:25.968+0000 7fa73fe00640 1 -- 172.21.15.37:0/995279110 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7381a0fa0 con 0x7fa738109860 2024-09-11T23:08:26.816 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:25.969+0000 7fa73fe00640 1 -- 172.21.15.37:0/995279110 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa73810df10 con 0x7fa738109860 2024-09-11T23:08:26.816 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:25.969+0000 7fa736000640 1 -- 172.21.15.37:0/995279110 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fa72c045070 con 0x7fa738109860 2024-09-11T23:08:26.816 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:25.970+0000 7fa736000640 1 --2- 172.21.15.37:0/995279110 >> [v2:172.21.15.37:6800/2886800769,v1:172.21.15.37:6801/2886800769] conn(0x7fa720038f70 0x7fa72003b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:08:26.816 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:25.970+0000 7fa736000640 1 -- 172.21.15.37:0/995279110 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fa72c06c830 con 0x7fa738109860 2024-09-11T23:08:26.816 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:25.970+0000 7fa73ca00640 1 --2- 172.21.15.37:0/995279110 >> [v2:172.21.15.37:6800/2886800769,v1:172.21.15.37:6801/2886800769] conn(0x7fa720038f70 0x7fa72003b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:08:26.816 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:25.971+0000 7fa73ca00640 1 --2- 172.21.15.37:0/995279110 >> [v2:172.21.15.37:6800/2886800769,v1:172.21.15.37:6801/2886800769] conn(0x7fa720038f70 0x7fa72003b430 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa7240098c0 tx=0x7fa724006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:08:26.816 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:25.975+0000 7fa736000640 1 -- 172.21.15.37:0/995279110 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa72c02f2a0 con 0x7fa738109860 2024-09-11T23:08:26.816 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:26.176+0000 7fa73fe00640 1 -- 172.21.15.37:0/995279110 --> [v2:172.21.15.37:6800/2886800769,v1:172.21.15.37:6801/2886800769] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7fa738062630 con 0x7fa720038f70 2024-09-11T23:08:26.817 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:26.185+0000 7fa736000640 1 -- 172.21.15.37:0/995279110 <== mgr.14118 v2:172.21.15.37:6800/2886800769 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fa738062630 con 0x7fa720038f70 2024-09-11T23:08:26.817 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:26.187+0000 7fa73fe00640 1 -- 172.21.15.37:0/995279110 >> [v2:172.21.15.37:6800/2886800769,v1:172.21.15.37:6801/2886800769] conn(0x7fa720038f70 msgr2=0x7fa72003b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:08:26.817 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:26.187+0000 7fa73fe00640 1 --2- 172.21.15.37:0/995279110 >> [v2:172.21.15.37:6800/2886800769,v1:172.21.15.37:6801/2886800769] conn(0x7fa720038f70 0x7fa72003b430 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa7240098c0 tx=0x7fa724006db0 comp rx=0 tx=0).stop 2024-09-11T23:08:26.817 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:26.187+0000 7fa73fe00640 1 -- 172.21.15.37:0/995279110 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa738109860 msgr2=0x7fa73819dae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:08:26.817 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:26.187+0000 7fa73fe00640 1 --2- 172.21.15.37:0/995279110 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa738109860 0x7fa73819dae0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fa72c0097f0 tx=0x7fa72c030ec0 comp rx=0 tx=0).stop 2024-09-11T23:08:26.817 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:26.187+0000 7fa73fe00640 1 -- 172.21.15.37:0/995279110 shutdown_connections 2024-09-11T23:08:26.817 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:26.187+0000 7fa73fe00640 1 --2- 172.21.15.37:0/995279110 >> [v2:172.21.15.37:6800/2886800769,v1:172.21.15.37:6801/2886800769] conn(0x7fa720038f70 0x7fa72003b430 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:08:26.817 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:26.187+0000 7fa73fe00640 1 --2- 172.21.15.37:0/995279110 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa738109860 0x7fa73819dae0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:08:26.817 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:26.187+0000 7fa73fe00640 1 -- 172.21.15.37:0/995279110 >> 172.21.15.37:0/995279110 conn(0x7fa73807cee0 msgr2=0x7fa738107650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:08:26.817 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:26.188+0000 7fa73fe00640 1 -- 172.21.15.37:0/995279110 shutdown_connections 2024-09-11T23:08:26.817 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:26.188+0000 7fa73fe00640 1 -- 172.21.15.37:0/995279110 wait complete. 2024-09-11T23:08:27.062 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:26 smithi037 ceph-mon[30630]: mgrmap e8: x(active, since 2s) 2024-09-11T23:08:27.062 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:26 smithi037 ceph-mon[30630]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:08:27.062 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:26 smithi037 ceph-mon[30630]: from='mgr.14118 172.21.15.37:0/4176675630' entity='mgr.x' 2024-09-11T23:08:27.062 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:26 smithi037 ceph-mon[30630]: from='mgr.14118 172.21.15.37:0/4176675630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:08:27.315 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:27 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: 2024-09-11T23:08:27.061+0000 7f2c76800640 -1 log_channel(cephadm) log [ERR] : [11/Sep/2024:23:08:27] ENGINE Error in HTTPServer.serve 2024-09-11T23:08:27.315 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:27 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: Traceback (most recent call last): 2024-09-11T23:08:27.315 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:27 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-11T23:08:27.315 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:27 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: self._connections.run(self.expiration_interval) 2024-09-11T23:08:27.315 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:27 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-11T23:08:27.315 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:27 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: self._run(expiration_interval) 2024-09-11T23:08:27.315 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:27 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-11T23:08:27.315 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:27 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: new_conn = self._from_server_socket(self.server.socket) 2024-09-11T23:08:27.315 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:27 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-11T23:08:27.316 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:27 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-11T23:08:27.316 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:27 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-11T23:08:27.316 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:27 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: s = self.context.wrap_socket( 2024-09-11T23:08:27.316 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:27 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-11T23:08:27.316 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:27 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: return self.sslsocket_class._create( 2024-09-11T23:08:27.316 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:27 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-11T23:08:27.316 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:27 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: self.do_handshake() 2024-09-11T23:08:27.316 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:27 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-11T23:08:27.316 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:27 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: self._sslobj.do_handshake() 2024-09-11T23:08:27.316 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:27 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-11T23:08:27.316 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:27 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: 2024-09-11T23:08:28.160 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:27 smithi037 ceph-mon[30630]: [11/Sep/2024:23:08:26] ENGINE Bus STARTING 2024-09-11T23:08:28.160 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:27 smithi037 ceph-mon[30630]: [11/Sep/2024:23:08:27] ENGINE Serving on https://172.21.15.37:7150 2024-09-11T23:08:28.160 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:27 smithi037 ceph-mon[30630]: [11/Sep/2024:23:08:27] ENGINE Error in HTTPServer.serve 2024-09-11T23:08:28.160 INFO:journalctl@ceph.mon.a.smithi037.stdout: Traceback (most recent call last): 2024-09-11T23:08:28.161 INFO:journalctl@ceph.mon.a.smithi037.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-11T23:08:28.161 INFO:journalctl@ceph.mon.a.smithi037.stdout: self._connections.run(self.expiration_interval) 2024-09-11T23:08:28.161 INFO:journalctl@ceph.mon.a.smithi037.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-11T23:08:28.161 INFO:journalctl@ceph.mon.a.smithi037.stdout: self._run(expiration_interval) 2024-09-11T23:08:28.161 INFO:journalctl@ceph.mon.a.smithi037.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-11T23:08:28.161 INFO:journalctl@ceph.mon.a.smithi037.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-11T23:08:28.161 INFO:journalctl@ceph.mon.a.smithi037.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-11T23:08:28.161 INFO:journalctl@ceph.mon.a.smithi037.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-11T23:08:28.161 INFO:journalctl@ceph.mon.a.smithi037.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-11T23:08:28.161 INFO:journalctl@ceph.mon.a.smithi037.stdout: s = self.context.wrap_socket( 2024-09-11T23:08:28.161 INFO:journalctl@ceph.mon.a.smithi037.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-11T23:08:28.161 INFO:journalctl@ceph.mon.a.smithi037.stdout: return self.sslsocket_class._create( 2024-09-11T23:08:28.162 INFO:journalctl@ceph.mon.a.smithi037.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-11T23:08:28.162 INFO:journalctl@ceph.mon.a.smithi037.stdout: self.do_handshake() 2024-09-11T23:08:28.162 INFO:journalctl@ceph.mon.a.smithi037.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-11T23:08:28.162 INFO:journalctl@ceph.mon.a.smithi037.stdout: self._sslobj.do_handshake() 2024-09-11T23:08:28.162 INFO:journalctl@ceph.mon.a.smithi037.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-11T23:08:28.162 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:27 smithi037 ceph-mon[30630]: [11/Sep/2024:23:08:27] ENGINE Serving on http://172.21.15.37:8765 2024-09-11T23:08:28.162 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:27 smithi037 ceph-mon[30630]: [11/Sep/2024:23:08:27] ENGINE Bus STARTED 2024-09-11T23:08:28.162 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:27 smithi037 ceph-mon[30630]: from='mgr.14118 172.21.15.37:0/4176675630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:08:28.162 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:27 smithi037 ceph-mon[30630]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:08:28.170 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-11T23:08:28.170 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:27.322+0000 7f3e14600640 1 Processor -- start 2024-09-11T23:08:28.171 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:27.322+0000 7f3e14600640 1 -- start start 2024-09-11T23:08:28.171 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:27.322+0000 7f3e14600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e0c109810 0x7f3e0c109c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:08:28.171 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:27.322+0000 7f3e14600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3e0c10a1e0 con 0x7f3e0c109810 2024-09-11T23:08:28.171 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:27.323+0000 7f3e11c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e0c109810 0x7f3e0c109c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:08:28.171 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:27.323+0000 7f3e11c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e0c109810 0x7f3e0c109c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48422/0 (socket says 172.21.15.37:48422) 2024-09-11T23:08:28.171 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:27.323+0000 7f3e11c00640 1 -- 172.21.15.37:0/175916786 learned_addr learned my addr 172.21.15.37:0/175916786 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:08:28.171 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:27.323+0000 7f3e11c00640 1 -- 172.21.15.37:0/175916786 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e0c10a9c0 con 0x7f3e0c109810 2024-09-11T23:08:28.171 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:27.324+0000 7f3e11c00640 1 --2- 172.21.15.37:0/175916786 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e0c109810 0x7f3e0c109c10 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3e00009820 tx=0x7f3e0002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=139d05ca855aa1ce server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:08:28.171 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:27.324+0000 7f3e0be00640 1 -- 172.21.15.37:0/175916786 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e00037070 con 0x7f3e0c109810 2024-09-11T23:08:28.171 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:27.324+0000 7f3e0be00640 1 -- 172.21.15.37:0/175916786 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3e00032900 con 0x7f3e0c109810 2024-09-11T23:08:28.171 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:27.324+0000 7f3e0be00640 1 -- 172.21.15.37:0/175916786 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e00030850 con 0x7f3e0c109810 2024-09-11T23:08:28.171 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:27.325+0000 7f3e14600640 1 -- 172.21.15.37:0/175916786 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e0c109810 msgr2=0x7f3e0c109c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:08:28.172 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:27.325+0000 7f3e14600640 1 --2- 172.21.15.37:0/175916786 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e0c109810 0x7f3e0c109c10 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3e00009820 tx=0x7f3e0002a270 comp rx=0 tx=0).stop 2024-09-11T23:08:28.172 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:27.325+0000 7f3e14600640 1 -- 172.21.15.37:0/175916786 shutdown_connections 2024-09-11T23:08:28.172 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:27.325+0000 7f3e14600640 1 --2- 172.21.15.37:0/175916786 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e0c109810 0x7f3e0c109c10 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:08:28.172 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:27.325+0000 7f3e14600640 1 -- 172.21.15.37:0/175916786 >> 172.21.15.37:0/175916786 conn(0x7f3e0c07ce80 msgr2=0x7f3e0c07d290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:08:28.172 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:27.325+0000 7f3e14600640 1 -- 172.21.15.37:0/175916786 shutdown_connections 2024-09-11T23:08:28.172 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:27.325+0000 7f3e14600640 1 -- 172.21.15.37:0/175916786 wait complete. 2024-09-11T23:08:28.172 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:27.326+0000 7f3e14600640 1 Processor -- start 2024-09-11T23:08:28.172 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:27.326+0000 7f3e14600640 1 -- start start 2024-09-11T23:08:28.172 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:27.327+0000 7f3e14600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e0c109810 0x7f3e0c19d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:08:28.172 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:27.327+0000 7f3e14600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3e0c10dd70 con 0x7f3e0c109810 2024-09-11T23:08:28.172 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:27.327+0000 7f3e11c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e0c109810 0x7f3e0c19d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:08:28.172 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:27.327+0000 7f3e11c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e0c109810 0x7f3e0c19d790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48430/0 (socket says 172.21.15.37:48430) 2024-09-11T23:08:28.173 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:27.327+0000 7f3e11c00640 1 -- 172.21.15.37:0/20270945 learned_addr learned my addr 172.21.15.37:0/20270945 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:08:28.173 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:27.327+0000 7f3e11c00640 1 -- 172.21.15.37:0/20270945 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e0c19dcd0 con 0x7f3e0c109810 2024-09-11T23:08:28.173 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:27.327+0000 7f3e11c00640 1 --2- 172.21.15.37:0/20270945 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e0c109810 0x7f3e0c19d790 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3e00032ce0 tx=0x7f3e00032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:08:28.173 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:27.328+0000 7f3e0a000640 1 -- 172.21.15.37:0/20270945 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e00042070 con 0x7f3e0c109810 2024-09-11T23:08:28.173 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:27.328+0000 7f3e0a000640 1 -- 172.21.15.37:0/20270945 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3e000308c0 con 0x7f3e0c109810 2024-09-11T23:08:28.173 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:27.328+0000 7f3e14600640 1 -- 172.21.15.37:0/20270945 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e0c19df60 con 0x7f3e0c109810 2024-09-11T23:08:28.173 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:27.328+0000 7f3e0a000640 1 -- 172.21.15.37:0/20270945 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e00037040 con 0x7f3e0c109810 2024-09-11T23:08:28.173 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:27.328+0000 7f3e14600640 1 -- 172.21.15.37:0/20270945 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e0c1a0c50 con 0x7f3e0c109810 2024-09-11T23:08:28.173 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:27.329+0000 7f3e14600640 1 -- 172.21.15.37:0/20270945 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e0c109c10 con 0x7f3e0c109810 2024-09-11T23:08:28.173 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:27.329+0000 7f3e0a000640 1 -- 172.21.15.37:0/20270945 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f3e00045070 con 0x7f3e0c109810 2024-09-11T23:08:28.173 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:27.330+0000 7f3e0a000640 1 --2- 172.21.15.37:0/20270945 >> [v2:172.21.15.37:6800/2886800769,v1:172.21.15.37:6801/2886800769] conn(0x7f3df4038fc0 0x7f3df403b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:08:28.174 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:27.330+0000 7f3e0a000640 1 -- 172.21.15.37:0/20270945 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f3e0006c010 con 0x7f3e0c109810 2024-09-11T23:08:28.174 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:27.330+0000 7f3e11200640 1 --2- 172.21.15.37:0/20270945 >> [v2:172.21.15.37:6800/2886800769,v1:172.21.15.37:6801/2886800769] conn(0x7f3df4038fc0 0x7f3df403b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:08:28.174 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:27.331+0000 7f3e11200640 1 --2- 172.21.15.37:0/20270945 >> [v2:172.21.15.37:6800/2886800769,v1:172.21.15.37:6801/2886800769] conn(0x7f3df4038fc0 0x7f3df403b480 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3df80098c0 tx=0x7f3df8006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:08:28.174 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:27.335+0000 7f3e0a000640 1 -- 172.21.15.37:0/20270945 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3e00045360 con 0x7f3e0c109810 2024-09-11T23:08:28.174 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:27.519+0000 7f3e14600640 1 -- 172.21.15.37:0/20270945 --> [v2:172.21.15.37:6800/2886800769,v1:172.21.15.37:6801/2886800769] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7f3e0c107ae0 con 0x7f3df4038fc0 2024-09-11T23:08:28.174 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:27.520+0000 7f3e0a000640 1 -- 172.21.15.37:0/20270945 <== mgr.14118 v2:172.21.15.37:6800/2886800769 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7f3e0c107ae0 con 0x7f3df4038fc0 2024-09-11T23:08:28.174 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:27.522+0000 7f3e14600640 1 -- 172.21.15.37:0/20270945 >> [v2:172.21.15.37:6800/2886800769,v1:172.21.15.37:6801/2886800769] conn(0x7f3df4038fc0 msgr2=0x7f3df403b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:08:28.174 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:27.522+0000 7f3e14600640 1 --2- 172.21.15.37:0/20270945 >> [v2:172.21.15.37:6800/2886800769,v1:172.21.15.37:6801/2886800769] conn(0x7f3df4038fc0 0x7f3df403b480 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3df80098c0 tx=0x7f3df8006db0 comp rx=0 tx=0).stop 2024-09-11T23:08:28.174 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:27.522+0000 7f3e14600640 1 -- 172.21.15.37:0/20270945 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e0c109810 msgr2=0x7f3e0c19d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:08:28.174 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:27.522+0000 7f3e14600640 1 --2- 172.21.15.37:0/20270945 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e0c109810 0x7f3e0c19d790 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3e00032ce0 tx=0x7f3e00032d10 comp rx=0 tx=0).stop 2024-09-11T23:08:28.174 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:27.522+0000 7f3e14600640 1 -- 172.21.15.37:0/20270945 shutdown_connections 2024-09-11T23:08:28.174 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:27.522+0000 7f3e14600640 1 --2- 172.21.15.37:0/20270945 >> [v2:172.21.15.37:6800/2886800769,v1:172.21.15.37:6801/2886800769] conn(0x7f3df4038fc0 0x7f3df403b480 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:08:28.174 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:27.522+0000 7f3e14600640 1 --2- 172.21.15.37:0/20270945 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e0c109810 0x7f3e0c19d790 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:08:28.175 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:27.522+0000 7f3e14600640 1 -- 172.21.15.37:0/20270945 >> 172.21.15.37:0/20270945 conn(0x7f3e0c07ce80 msgr2=0x7f3e0c1073d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:08:28.175 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:27.522+0000 7f3e14600640 1 -- 172.21.15.37:0/20270945 shutdown_connections 2024-09-11T23:08:28.175 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:27.522+0000 7f3e14600640 1 -- 172.21.15.37:0/20270945 wait complete. 2024-09-11T23:08:28.175 INFO:teuthology.orchestra.run.smithi037.stdout:Generating ssh key... 2024-09-11T23:08:29.726 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:29 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: Generating public/private rsa key pair. 2024-09-11T23:08:29.726 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:29 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: Your identification has been saved in /tmp/tmp51gjchyi/key 2024-09-11T23:08:29.726 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:29 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: Your public key has been saved in /tmp/tmp51gjchyi/key.pub 2024-09-11T23:08:29.726 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:29 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: The key fingerprint is: 2024-09-11T23:08:29.726 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:29 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: SHA256:J8Ix7DBfkn03OUGsd63D8vFp+Kjz6RRZ2pgh6wg1Wio ceph-8b03efce-7092-11ef-bcea-c7b262605968 2024-09-11T23:08:29.726 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:29 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: The key's randomart image is: 2024-09-11T23:08:29.726 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:29 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: +---[RSA 3072]----+ 2024-09-11T23:08:29.727 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:29 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: | oo | 2024-09-11T23:08:29.727 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:29 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: | . o .o | 2024-09-11T23:08:29.727 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:29 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: | o * o+.o=. o | 2024-09-11T23:08:29.727 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:29 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: | * ==.o.+oX .| 2024-09-11T23:08:29.727 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:29 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: | E=+S .o O o | 2024-09-11T23:08:29.727 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:29 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: | ...oo . * | 2024-09-11T23:08:29.727 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:29 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: | . . +.+.| 2024-09-11T23:08:29.727 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:29 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: | ...+o.| 2024-09-11T23:08:29.727 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:29 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: | .==o. | 2024-09-11T23:08:29.727 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:29 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: +----[SHA256]-----+ 2024-09-11T23:08:30.060 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:28.661+0000 7f496e400640 1 Processor -- start 2024-09-11T23:08:30.060 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:28.661+0000 7f496e400640 1 -- start start 2024-09-11T23:08:30.060 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:28.661+0000 7f496e400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f496807dd30 0x7f496807c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:08:30.060 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:28.661+0000 7f496e400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f496807c7e0 con 0x7f496807dd30 2024-09-11T23:08:30.060 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:28.662+0000 7f4967400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f496807dd30 0x7f496807c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:08:30.060 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:28.662+0000 7f4967400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f496807dd30 0x7f496807c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48446/0 (socket says 172.21.15.37:48446) 2024-09-11T23:08:30.060 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:28.662+0000 7f4967400640 1 -- 172.21.15.37:0/154216934 learned_addr learned my addr 172.21.15.37:0/154216934 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:08:30.060 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:28.662+0000 7f4967400640 1 -- 172.21.15.37:0/154216934 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f496807c960 con 0x7f496807dd30 2024-09-11T23:08:30.060 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:28.663+0000 7f4967400640 1 --2- 172.21.15.37:0/154216934 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f496807dd30 0x7f496807c2a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f4958009820 tx=0x7f495802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=766902b1f6bd9f28 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:08:30.060 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:28.664+0000 7f4966000640 1 -- 172.21.15.37:0/154216934 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4958037070 con 0x7f496807dd30 2024-09-11T23:08:30.061 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:28.664+0000 7f4966000640 1 -- 172.21.15.37:0/154216934 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4958032900 con 0x7f496807dd30 2024-09-11T23:08:30.061 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:28.664+0000 7f4966000640 1 -- 172.21.15.37:0/154216934 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4958030850 con 0x7f496807dd30 2024-09-11T23:08:30.061 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:28.664+0000 7f496e400640 1 -- 172.21.15.37:0/154216934 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f496807dd30 msgr2=0x7f496807c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:08:30.061 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:28.664+0000 7f496e400640 1 --2- 172.21.15.37:0/154216934 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f496807dd30 0x7f496807c2a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f4958009820 tx=0x7f495802a270 comp rx=0 tx=0).stop 2024-09-11T23:08:30.061 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:28.664+0000 7f496e400640 1 -- 172.21.15.37:0/154216934 shutdown_connections 2024-09-11T23:08:30.061 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:28.664+0000 7f496e400640 1 --2- 172.21.15.37:0/154216934 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f496807dd30 0x7f496807c2a0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:08:30.061 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:28.664+0000 7f496e400640 1 -- 172.21.15.37:0/154216934 >> 172.21.15.37:0/154216934 conn(0x7f4968102e50 msgr2=0x7f4968105270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:08:30.061 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:28.664+0000 7f496e400640 1 -- 172.21.15.37:0/154216934 shutdown_connections 2024-09-11T23:08:30.061 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:28.664+0000 7f496e400640 1 -- 172.21.15.37:0/154216934 wait complete. 2024-09-11T23:08:30.061 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:28.665+0000 7f496e400640 1 Processor -- start 2024-09-11T23:08:30.061 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:28.665+0000 7f496e400640 1 -- start start 2024-09-11T23:08:30.061 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:28.666+0000 7f496e400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f496807dd30 0x7f496819d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:08:30.061 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:28.666+0000 7f496e400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f496810db80 con 0x7f496807dd30 2024-09-11T23:08:30.062 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:28.666+0000 7f4967400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f496807dd30 0x7f496819d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:08:30.062 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:28.666+0000 7f4967400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f496807dd30 0x7f496819d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48452/0 (socket says 172.21.15.37:48452) 2024-09-11T23:08:30.062 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:28.666+0000 7f4967400640 1 -- 172.21.15.37:0/3370192646 learned_addr learned my addr 172.21.15.37:0/3370192646 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:08:30.062 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:28.666+0000 7f4967400640 1 -- 172.21.15.37:0/3370192646 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f496819dd00 con 0x7f496807dd30 2024-09-11T23:08:30.062 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:28.667+0000 7f4967400640 1 --2- 172.21.15.37:0/3370192646 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f496807dd30 0x7f496819d7c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f4958032ce0 tx=0x7f4958032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:08:30.062 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:28.667+0000 7f495fe00640 1 -- 172.21.15.37:0/3370192646 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4958042070 con 0x7f496807dd30 2024-09-11T23:08:30.062 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:28.667+0000 7f495fe00640 1 -- 172.21.15.37:0/3370192646 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f49580308c0 con 0x7f496807dd30 2024-09-11T23:08:30.062 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:28.667+0000 7f496e400640 1 -- 172.21.15.37:0/3370192646 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f496819df90 con 0x7f496807dd30 2024-09-11T23:08:30.062 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:28.667+0000 7f495fe00640 1 -- 172.21.15.37:0/3370192646 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4958037040 con 0x7f496807dd30 2024-09-11T23:08:30.062 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:28.667+0000 7f496e400640 1 -- 172.21.15.37:0/3370192646 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49681a0c80 con 0x7f496807dd30 2024-09-11T23:08:30.062 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:28.668+0000 7f495fe00640 1 -- 172.21.15.37:0/3370192646 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f4958045070 con 0x7f496807dd30 2024-09-11T23:08:30.062 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:28.668+0000 7f496e400640 1 -- 172.21.15.37:0/3370192646 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f496807c320 con 0x7f496807dd30 2024-09-11T23:08:30.062 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:28.668+0000 7f495fe00640 1 --2- 172.21.15.37:0/3370192646 >> [v2:172.21.15.37:6800/2886800769,v1:172.21.15.37:6801/2886800769] conn(0x7f494c038fc0 0x7f494c03b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:08:30.063 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:28.669+0000 7f495fe00640 1 -- 172.21.15.37:0/3370192646 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f495806c040 con 0x7f496807dd30 2024-09-11T23:08:30.063 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:28.669+0000 7f4966a00640 1 --2- 172.21.15.37:0/3370192646 >> [v2:172.21.15.37:6800/2886800769,v1:172.21.15.37:6801/2886800769] conn(0x7f494c038fc0 0x7f494c03b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:08:30.063 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:28.669+0000 7f4966a00640 1 --2- 172.21.15.37:0/3370192646 >> [v2:172.21.15.37:6800/2886800769,v1:172.21.15.37:6801/2886800769] conn(0x7f494c038fc0 0x7f494c03b480 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f49540098c0 tx=0x7f4954006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:08:30.063 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:28.673+0000 7f495fe00640 1 -- 172.21.15.37:0/3370192646 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f495806b990 con 0x7f496807dd30 2024-09-11T23:08:30.063 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:28.858+0000 7f496e400640 1 -- 172.21.15.37:0/3370192646 --> [v2:172.21.15.37:6800/2886800769,v1:172.21.15.37:6801/2886800769] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7f4968104090 con 0x7f494c038fc0 2024-09-11T23:08:30.063 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:29.398+0000 7f495fe00640 1 -- 172.21.15.37:0/3370192646 <== mgr.14118 v2:172.21.15.37:6800/2886800769 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f4968104090 con 0x7f494c038fc0 2024-09-11T23:08:30.063 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:29.400+0000 7f496e400640 1 -- 172.21.15.37:0/3370192646 >> [v2:172.21.15.37:6800/2886800769,v1:172.21.15.37:6801/2886800769] conn(0x7f494c038fc0 msgr2=0x7f494c03b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:08:30.063 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:29.400+0000 7f496e400640 1 --2- 172.21.15.37:0/3370192646 >> [v2:172.21.15.37:6800/2886800769,v1:172.21.15.37:6801/2886800769] conn(0x7f494c038fc0 0x7f494c03b480 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f49540098c0 tx=0x7f4954006db0 comp rx=0 tx=0).stop 2024-09-11T23:08:30.063 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:29.400+0000 7f496e400640 1 -- 172.21.15.37:0/3370192646 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f496807dd30 msgr2=0x7f496819d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:08:30.063 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:29.400+0000 7f496e400640 1 --2- 172.21.15.37:0/3370192646 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f496807dd30 0x7f496819d7c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f4958032ce0 tx=0x7f4958032d10 comp rx=0 tx=0).stop 2024-09-11T23:08:30.063 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:29.400+0000 7f496e400640 1 -- 172.21.15.37:0/3370192646 shutdown_connections 2024-09-11T23:08:30.063 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:29.400+0000 7f496e400640 1 --2- 172.21.15.37:0/3370192646 >> [v2:172.21.15.37:6800/2886800769,v1:172.21.15.37:6801/2886800769] conn(0x7f494c038fc0 0x7f494c03b480 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:08:30.064 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:29.400+0000 7f496e400640 1 --2- 172.21.15.37:0/3370192646 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f496807dd30 0x7f496819d7c0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:08:30.064 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:29.400+0000 7f496e400640 1 -- 172.21.15.37:0/3370192646 >> 172.21.15.37:0/3370192646 conn(0x7f4968102e50 msgr2=0x7f4968103980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:08:30.064 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:29.401+0000 7f496e400640 1 -- 172.21.15.37:0/3370192646 shutdown_connections 2024-09-11T23:08:30.064 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:29.401+0000 7f496e400640 1 -- 172.21.15.37:0/3370192646 wait complete. 2024-09-11T23:08:30.743 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:30 smithi037 ceph-mon[30630]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:08:30.743 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:30 smithi037 ceph-mon[30630]: Generating ssh key... 2024-09-11T23:08:30.744 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:30 smithi037 ceph-mon[30630]: from='mgr.14118 172.21.15.37:0/4176675630' entity='mgr.x' 2024-09-11T23:08:30.744 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:30 smithi037 ceph-mon[30630]: from='mgr.14118 172.21.15.37:0/4176675630' entity='mgr.x' 2024-09-11T23:08:31.358 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDStPpuii9GZizCCNYi68BUJ6HMC2QWej+2sss2Svn7TG6olh0/FFf7fD3hy2bo34J6c1Ty96lDTyJWuL4Xnly/9vJ6ZLh7GXx2sOpgjPymYpJSVtbyxM9o8RLBSKLXvZZjOOPAAD8LBCZS6EmynSb2tHV4GK7DBXgbN6sDwYM8R3GThAshIrkeiSfapjbZsffvSCnfRtLN41ga+rNO5fExcm9xK1jkMJwgRr5AZqphqxF5Mlt//VA0qrRPZDGQqV3f5/y8RSa+IlxQLd9Z9no0Hg9kDXq7/bXHCcYQqj9fVBExVxONEucgeUxPWlCf0cK1wwSMoULWUcNVYaubvmaEYn2xDH9fmLav0m69Rz5GlnMNx/4EX9mD2M+J+qOK3S3HgktHqRjcRg06GVauqgzH6kZIMvNbetVTssLFxK0954PQybALx5uBbtcAQstlYdOsgPYmtuON7LENjbX/3SAXaYhpCTvKkSzkEMc6xtssgu0Wc+cFXr7T3aa3cm7d3bc= ceph-8b03efce-7092-11ef-bcea-c7b262605968 2024-09-11T23:08:31.358 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:30.542+0000 7f1054200640 1 Processor -- start 2024-09-11T23:08:31.358 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:30.542+0000 7f1054200640 1 -- start start 2024-09-11T23:08:31.358 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:30.543+0000 7f1054200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f104c07dd30 0x7f104c07c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:08:31.358 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:30.543+0000 7f1054200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f104c07c7e0 con 0x7f104c07dd30 2024-09-11T23:08:31.358 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:30.543+0000 7f1051800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f104c07dd30 0x7f104c07c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:08:31.358 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:30.543+0000 7f1051800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f104c07dd30 0x7f104c07c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39702/0 (socket says 172.21.15.37:39702) 2024-09-11T23:08:31.358 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:30.543+0000 7f1051800640 1 -- 172.21.15.37:0/1009536622 learned_addr learned my addr 172.21.15.37:0/1009536622 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:08:31.358 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:30.543+0000 7f1051800640 1 -- 172.21.15.37:0/1009536622 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f104c07c960 con 0x7f104c07dd30 2024-09-11T23:08:31.359 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:30.544+0000 7f1051800640 1 --2- 172.21.15.37:0/1009536622 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f104c07dd30 0x7f104c07c2a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1040009820 tx=0x7f104002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ace9483d5b6918d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:08:31.359 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:30.545+0000 7f104be00640 1 -- 172.21.15.37:0/1009536622 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1040037070 con 0x7f104c07dd30 2024-09-11T23:08:31.359 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:30.545+0000 7f104be00640 1 -- 172.21.15.37:0/1009536622 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1040032900 con 0x7f104c07dd30 2024-09-11T23:08:31.359 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:30.545+0000 7f104be00640 1 -- 172.21.15.37:0/1009536622 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1040030850 con 0x7f104c07dd30 2024-09-11T23:08:31.359 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:30.545+0000 7f1054200640 1 -- 172.21.15.37:0/1009536622 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f104c07dd30 msgr2=0x7f104c07c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:08:31.359 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:30.545+0000 7f1054200640 1 --2- 172.21.15.37:0/1009536622 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f104c07dd30 0x7f104c07c2a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1040009820 tx=0x7f104002a270 comp rx=0 tx=0).stop 2024-09-11T23:08:31.359 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:30.546+0000 7f1054200640 1 -- 172.21.15.37:0/1009536622 shutdown_connections 2024-09-11T23:08:31.359 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:30.546+0000 7f1054200640 1 --2- 172.21.15.37:0/1009536622 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f104c07dd30 0x7f104c07c2a0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:08:31.359 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:30.546+0000 7f1054200640 1 -- 172.21.15.37:0/1009536622 >> 172.21.15.37:0/1009536622 conn(0x7f104c102e50 msgr2=0x7f104c105270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:08:31.359 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:30.546+0000 7f1054200640 1 -- 172.21.15.37:0/1009536622 shutdown_connections 2024-09-11T23:08:31.359 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:30.546+0000 7f1054200640 1 -- 172.21.15.37:0/1009536622 wait complete. 2024-09-11T23:08:31.359 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:30.547+0000 7f1054200640 1 Processor -- start 2024-09-11T23:08:31.359 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:30.547+0000 7f1054200640 1 -- start start 2024-09-11T23:08:31.360 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:30.547+0000 7f1054200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f104c07dd30 0x7f104c19d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:08:31.360 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:30.547+0000 7f1054200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f104c10db80 con 0x7f104c07dd30 2024-09-11T23:08:31.360 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:30.547+0000 7f1051800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f104c07dd30 0x7f104c19d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:08:31.360 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:30.547+0000 7f1051800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f104c07dd30 0x7f104c19d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39706/0 (socket says 172.21.15.37:39706) 2024-09-11T23:08:31.360 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:30.547+0000 7f1051800640 1 -- 172.21.15.37:0/4199449288 learned_addr learned my addr 172.21.15.37:0/4199449288 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:08:31.360 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:30.548+0000 7f1051800640 1 -- 172.21.15.37:0/4199449288 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f104c19dd00 con 0x7f104c07dd30 2024-09-11T23:08:31.360 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:30.548+0000 7f1051800640 1 --2- 172.21.15.37:0/4199449288 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f104c07dd30 0x7f104c19d7c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f10400097f0 tx=0x7f1040030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:08:31.360 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:30.548+0000 7f104a000640 1 -- 172.21.15.37:0/4199449288 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1040037040 con 0x7f104c07dd30 2024-09-11T23:08:31.360 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:30.548+0000 7f104a000640 1 -- 172.21.15.37:0/4199449288 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1040040070 con 0x7f104c07dd30 2024-09-11T23:08:31.360 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:30.548+0000 7f1054200640 1 -- 172.21.15.37:0/4199449288 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f104c19df90 con 0x7f104c07dd30 2024-09-11T23:08:31.360 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:30.548+0000 7f104a000640 1 -- 172.21.15.37:0/4199449288 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f104003a390 con 0x7f104c07dd30 2024-09-11T23:08:31.360 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:30.549+0000 7f1054200640 1 -- 172.21.15.37:0/4199449288 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f104c1a0c80 con 0x7f104c07dd30 2024-09-11T23:08:31.360 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:30.549+0000 7f104a000640 1 -- 172.21.15.37:0/4199449288 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f104003b430 con 0x7f104c07dd30 2024-09-11T23:08:31.361 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:30.550+0000 7f1054200640 1 -- 172.21.15.37:0/4199449288 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f104c07c320 con 0x7f104c07dd30 2024-09-11T23:08:31.361 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:30.550+0000 7f104a000640 1 --2- 172.21.15.37:0/4199449288 >> [v2:172.21.15.37:6800/2886800769,v1:172.21.15.37:6801/2886800769] conn(0x7f1034038f70 0x7f103403b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:08:31.361 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:30.550+0000 7f104a000640 1 -- 172.21.15.37:0/4199449288 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f104006c4f0 con 0x7f104c07dd30 2024-09-11T23:08:31.361 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:30.550+0000 7f1050e00640 1 --2- 172.21.15.37:0/4199449288 >> [v2:172.21.15.37:6800/2886800769,v1:172.21.15.37:6801/2886800769] conn(0x7f1034038f70 0x7f103403b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:08:31.361 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:30.551+0000 7f1050e00640 1 --2- 172.21.15.37:0/4199449288 >> [v2:172.21.15.37:6800/2886800769,v1:172.21.15.37:6801/2886800769] conn(0x7f1034038f70 0x7f103403b430 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f10380098c0 tx=0x7f1038006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:08:31.361 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:30.556+0000 7f104a000640 1 -- 172.21.15.37:0/4199449288 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f10400371e0 con 0x7f104c07dd30 2024-09-11T23:08:31.361 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:30.742+0000 7f1054200640 1 -- 172.21.15.37:0/4199449288 --> [v2:172.21.15.37:6800/2886800769,v1:172.21.15.37:6801/2886800769] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7f104c104090 con 0x7f1034038f70 2024-09-11T23:08:31.361 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:30.743+0000 7f104a000640 1 -- 172.21.15.37:0/4199449288 <== mgr.14118 v2:172.21.15.37:6800/2886800769 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7f104c104090 con 0x7f1034038f70 2024-09-11T23:08:31.361 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:30.745+0000 7f1054200640 1 -- 172.21.15.37:0/4199449288 >> [v2:172.21.15.37:6800/2886800769,v1:172.21.15.37:6801/2886800769] conn(0x7f1034038f70 msgr2=0x7f103403b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:08:31.361 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:30.745+0000 7f1054200640 1 --2- 172.21.15.37:0/4199449288 >> [v2:172.21.15.37:6800/2886800769,v1:172.21.15.37:6801/2886800769] conn(0x7f1034038f70 0x7f103403b430 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f10380098c0 tx=0x7f1038006db0 comp rx=0 tx=0).stop 2024-09-11T23:08:31.361 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:30.745+0000 7f1054200640 1 -- 172.21.15.37:0/4199449288 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f104c07dd30 msgr2=0x7f104c19d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:08:31.361 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:30.745+0000 7f1054200640 1 --2- 172.21.15.37:0/4199449288 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f104c07dd30 0x7f104c19d7c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f10400097f0 tx=0x7f1040030d80 comp rx=0 tx=0).stop 2024-09-11T23:08:31.361 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:30.745+0000 7f1054200640 1 -- 172.21.15.37:0/4199449288 shutdown_connections 2024-09-11T23:08:31.362 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:30.745+0000 7f1054200640 1 --2- 172.21.15.37:0/4199449288 >> [v2:172.21.15.37:6800/2886800769,v1:172.21.15.37:6801/2886800769] conn(0x7f1034038f70 0x7f103403b430 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:08:31.362 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:30.745+0000 7f1054200640 1 --2- 172.21.15.37:0/4199449288 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f104c07dd30 0x7f104c19d7c0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:08:31.362 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:30.745+0000 7f1054200640 1 -- 172.21.15.37:0/4199449288 >> 172.21.15.37:0/4199449288 conn(0x7f104c102e50 msgr2=0x7f104c103980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:08:31.362 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:30.745+0000 7f1054200640 1 -- 172.21.15.37:0/4199449288 shutdown_connections 2024-09-11T23:08:31.362 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:30.745+0000 7f1054200640 1 -- 172.21.15.37:0/4199449288 wait complete. 2024-09-11T23:08:31.362 INFO:teuthology.orchestra.run.smithi037.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-11T23:08:31.362 INFO:teuthology.orchestra.run.smithi037.stdout:Adding key to root@localhost authorized_keys... 2024-09-11T23:08:31.362 INFO:teuthology.orchestra.run.smithi037.stdout:Adding host smithi037... 2024-09-11T23:08:31.612 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:31 smithi037 ceph-mon[30630]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:08:33.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:32 smithi037 ceph-mon[30630]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi037", "addr": "172.21.15.37", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:08:34.301 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:33 smithi037 ceph-mon[30630]: Deploying cephadm binary to smithi037 2024-09-11T23:08:37.234 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout Added host 'smithi037' with addr '172.21.15.37' 2024-09-11T23:08:37.240 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:31.818+0000 7f0a50600640 1 Processor -- start 2024-09-11T23:08:37.240 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:31.818+0000 7f0a50600640 1 -- start start 2024-09-11T23:08:37.240 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:31.818+0000 7f0a50600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a481098c0 0x7f0a48109cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:08:37.240 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:31.818+0000 7f0a50600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0a4810a290 con 0x7f0a481098c0 2024-09-11T23:08:37.240 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:31.819+0000 7f0a4dc00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a481098c0 0x7f0a48109cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:08:37.240 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:31.819+0000 7f0a4dc00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a481098c0 0x7f0a48109cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39722/0 (socket says 172.21.15.37:39722) 2024-09-11T23:08:37.241 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:31.819+0000 7f0a4dc00640 1 -- 172.21.15.37:0/455459906 learned_addr learned my addr 172.21.15.37:0/455459906 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:08:37.241 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:31.819+0000 7f0a4dc00640 1 -- 172.21.15.37:0/455459906 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a4810a9b0 con 0x7f0a481098c0 2024-09-11T23:08:37.241 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:31.820+0000 7f0a4dc00640 1 --2- 172.21.15.37:0/455459906 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a481098c0 0x7f0a48109cc0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0a3c009820 tx=0x7f0a3c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4205a4dcf9000934 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:08:37.241 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:31.820+0000 7f0a47e00640 1 -- 172.21.15.37:0/455459906 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a3c037070 con 0x7f0a481098c0 2024-09-11T23:08:37.241 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:31.820+0000 7f0a47e00640 1 -- 172.21.15.37:0/455459906 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0a3c032900 con 0x7f0a481098c0 2024-09-11T23:08:37.241 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:31.820+0000 7f0a47e00640 1 -- 172.21.15.37:0/455459906 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a3c030850 con 0x7f0a481098c0 2024-09-11T23:08:37.241 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:31.821+0000 7f0a50600640 1 -- 172.21.15.37:0/455459906 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a481098c0 msgr2=0x7f0a48109cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:08:37.241 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:31.821+0000 7f0a50600640 1 --2- 172.21.15.37:0/455459906 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a481098c0 0x7f0a48109cc0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0a3c009820 tx=0x7f0a3c02a270 comp rx=0 tx=0).stop 2024-09-11T23:08:37.241 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:31.821+0000 7f0a50600640 1 -- 172.21.15.37:0/455459906 shutdown_connections 2024-09-11T23:08:37.241 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:31.821+0000 7f0a50600640 1 --2- 172.21.15.37:0/455459906 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a481098c0 0x7f0a48109cc0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:08:37.241 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:31.821+0000 7f0a50600640 1 -- 172.21.15.37:0/455459906 >> 172.21.15.37:0/455459906 conn(0x7f0a4807ce20 msgr2=0x7f0a4807d230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:08:37.242 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:31.821+0000 7f0a50600640 1 -- 172.21.15.37:0/455459906 shutdown_connections 2024-09-11T23:08:37.242 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:31.821+0000 7f0a50600640 1 -- 172.21.15.37:0/455459906 wait complete. 2024-09-11T23:08:37.242 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:31.822+0000 7f0a50600640 1 Processor -- start 2024-09-11T23:08:37.242 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:31.822+0000 7f0a50600640 1 -- start start 2024-09-11T23:08:37.242 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:31.823+0000 7f0a50600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a481098c0 0x7f0a4819db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:08:37.242 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:31.823+0000 7f0a50600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0a4810dd60 con 0x7f0a481098c0 2024-09-11T23:08:37.242 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:31.823+0000 7f0a4dc00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a481098c0 0x7f0a4819db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:08:37.242 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:31.823+0000 7f0a4dc00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a481098c0 0x7f0a4819db00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39726/0 (socket says 172.21.15.37:39726) 2024-09-11T23:08:37.242 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:31.823+0000 7f0a4dc00640 1 -- 172.21.15.37:0/519740309 learned_addr learned my addr 172.21.15.37:0/519740309 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:08:37.243 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:31.823+0000 7f0a4dc00640 1 -- 172.21.15.37:0/519740309 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a4819e040 con 0x7f0a481098c0 2024-09-11T23:08:37.243 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:31.824+0000 7f0a4dc00640 1 --2- 172.21.15.37:0/519740309 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a481098c0 0x7f0a4819db00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0a3c0097f0 tx=0x7f0a3c030ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:08:37.243 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:31.824+0000 7f0a46000640 1 -- 172.21.15.37:0/519740309 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a3c042070 con 0x7f0a481098c0 2024-09-11T23:08:37.243 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:31.824+0000 7f0a46000640 1 -- 172.21.15.37:0/519740309 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0a3c032ca0 con 0x7f0a481098c0 2024-09-11T23:08:37.243 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:31.824+0000 7f0a50600640 1 -- 172.21.15.37:0/519740309 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a4819e2d0 con 0x7f0a481098c0 2024-09-11T23:08:37.243 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:31.824+0000 7f0a46000640 1 -- 172.21.15.37:0/519740309 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a3c037040 con 0x7f0a481098c0 2024-09-11T23:08:37.243 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:31.824+0000 7f0a50600640 1 -- 172.21.15.37:0/519740309 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a481a0fc0 con 0x7f0a481098c0 2024-09-11T23:08:37.243 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:31.825+0000 7f0a46000640 1 -- 172.21.15.37:0/519740309 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f0a3c045070 con 0x7f0a481098c0 2024-09-11T23:08:37.243 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:31.825+0000 7f0a50600640 1 -- 172.21.15.37:0/519740309 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a4810dee0 con 0x7f0a481098c0 2024-09-11T23:08:37.243 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:31.825+0000 7f0a46000640 1 --2- 172.21.15.37:0/519740309 >> [v2:172.21.15.37:6800/2886800769,v1:172.21.15.37:6801/2886800769] conn(0x7f0a30038f70 0x7f0a3003b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:08:37.244 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:31.825+0000 7f0a46000640 1 -- 172.21.15.37:0/519740309 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f0a3c06bfd0 con 0x7f0a481098c0 2024-09-11T23:08:37.244 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:31.826+0000 7f0a4d200640 1 --2- 172.21.15.37:0/519740309 >> [v2:172.21.15.37:6800/2886800769,v1:172.21.15.37:6801/2886800769] conn(0x7f0a30038f70 0x7f0a3003b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:08:37.244 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:31.826+0000 7f0a4d200640 1 --2- 172.21.15.37:0/519740309 >> [v2:172.21.15.37:6800/2886800769,v1:172.21.15.37:6801/2886800769] conn(0x7f0a30038f70 0x7f0a3003b430 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0a340098c0 tx=0x7f0a34006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:08:37.244 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:31.831+0000 7f0a46000640 1 -- 172.21.15.37:0/519740309 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0a3c06b920 con 0x7f0a481098c0 2024-09-11T23:08:37.244 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:32.019+0000 7f0a50600640 1 -- 172.21.15.37:0/519740309 --> [v2:172.21.15.37:6800/2886800769,v1:172.21.15.37:6801/2886800769] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi037", "addr": "172.21.15.37", "target": ["mon-mgr", ""]}) -- 0x7f0a48062630 con 0x7f0a30038f70 2024-09-11T23:08:37.244 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:36.562+0000 7f0a46000640 1 -- 172.21.15.37:0/519740309 <== mgr.14118 v2:172.21.15.37:6800/2886800769 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7f0a48062630 con 0x7f0a30038f70 2024-09-11T23:08:37.244 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:36.566+0000 7f0a50600640 1 -- 172.21.15.37:0/519740309 >> [v2:172.21.15.37:6800/2886800769,v1:172.21.15.37:6801/2886800769] conn(0x7f0a30038f70 msgr2=0x7f0a3003b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:08:37.244 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:36.566+0000 7f0a50600640 1 --2- 172.21.15.37:0/519740309 >> [v2:172.21.15.37:6800/2886800769,v1:172.21.15.37:6801/2886800769] conn(0x7f0a30038f70 0x7f0a3003b430 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0a340098c0 tx=0x7f0a34006db0 comp rx=0 tx=0).stop 2024-09-11T23:08:37.244 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:36.566+0000 7f0a50600640 1 -- 172.21.15.37:0/519740309 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a481098c0 msgr2=0x7f0a4819db00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:08:37.244 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:36.566+0000 7f0a50600640 1 --2- 172.21.15.37:0/519740309 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a481098c0 0x7f0a4819db00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0a3c0097f0 tx=0x7f0a3c030ec0 comp rx=0 tx=0).stop 2024-09-11T23:08:37.244 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:36.566+0000 7f0a50600640 1 -- 172.21.15.37:0/519740309 shutdown_connections 2024-09-11T23:08:37.244 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:36.566+0000 7f0a50600640 1 --2- 172.21.15.37:0/519740309 >> [v2:172.21.15.37:6800/2886800769,v1:172.21.15.37:6801/2886800769] conn(0x7f0a30038f70 0x7f0a3003b430 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:08:37.245 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:36.566+0000 7f0a50600640 1 --2- 172.21.15.37:0/519740309 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a481098c0 0x7f0a4819db00 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:08:37.245 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:36.566+0000 7f0a50600640 1 -- 172.21.15.37:0/519740309 >> 172.21.15.37:0/519740309 conn(0x7f0a4807ce20 msgr2=0x7f0a481077d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:08:37.245 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:36.566+0000 7f0a50600640 1 -- 172.21.15.37:0/519740309 shutdown_connections 2024-09-11T23:08:37.245 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:36.566+0000 7f0a50600640 1 -- 172.21.15.37:0/519740309 wait complete. 2024-09-11T23:08:37.245 INFO:teuthology.orchestra.run.smithi037.stdout:Deploying unmanaged mon service... 2024-09-11T23:08:37.815 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:37 smithi037 ceph-mon[30630]: from='mgr.14118 172.21.15.37:0/4176675630' entity='mgr.x' 2024-09-11T23:08:37.815 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:37 smithi037 ceph-mon[30630]: Added host smithi037 2024-09-11T23:08:37.815 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:37 smithi037 ceph-mon[30630]: from='mgr.14118 172.21.15.37:0/4176675630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:08:38.813 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-11T23:08:38.813 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:37.786+0000 7ff6fa400640 1 Processor -- start 2024-09-11T23:08:38.813 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:37.786+0000 7ff6fa400640 1 -- start start 2024-09-11T23:08:38.813 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:37.786+0000 7ff6fa400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6f4107420 0x7ff6f4107820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:08:38.814 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:37.786+0000 7ff6fa400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff6f4107df0 con 0x7ff6f4107420 2024-09-11T23:08:38.814 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:37.787+0000 7ff6f9000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6f4107420 0x7ff6f4107820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:08:38.814 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:37.787+0000 7ff6f9000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6f4107420 0x7ff6f4107820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39734/0 (socket says 172.21.15.37:39734) 2024-09-11T23:08:38.814 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:37.787+0000 7ff6f9000640 1 -- 172.21.15.37:0/809792894 learned_addr learned my addr 172.21.15.37:0/809792894 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:08:38.814 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:37.787+0000 7ff6f9000640 1 -- 172.21.15.37:0/809792894 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6f41085d0 con 0x7ff6f4107420 2024-09-11T23:08:38.814 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:37.788+0000 7ff6f9000640 1 --2- 172.21.15.37:0/809792894 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6f4107420 0x7ff6f4107820 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff6e8009820 tx=0x7ff6e802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fc561dc10233604 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:08:38.814 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:37.788+0000 7ff6f3400640 1 -- 172.21.15.37:0/809792894 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6e8037070 con 0x7ff6f4107420 2024-09-11T23:08:38.814 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:37.788+0000 7ff6f3400640 1 -- 172.21.15.37:0/809792894 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff6e8032900 con 0x7ff6f4107420 2024-09-11T23:08:38.814 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:37.789+0000 7ff6f3400640 1 -- 172.21.15.37:0/809792894 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6e8030850 con 0x7ff6f4107420 2024-09-11T23:08:38.814 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:37.789+0000 7ff6fa400640 1 -- 172.21.15.37:0/809792894 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6f4107420 msgr2=0x7ff6f4107820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:08:38.814 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:37.789+0000 7ff6fa400640 1 --2- 172.21.15.37:0/809792894 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6f4107420 0x7ff6f4107820 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff6e8009820 tx=0x7ff6e802a270 comp rx=0 tx=0).stop 2024-09-11T23:08:38.814 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:37.789+0000 7ff6fa400640 1 -- 172.21.15.37:0/809792894 shutdown_connections 2024-09-11T23:08:38.815 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:37.789+0000 7ff6fa400640 1 --2- 172.21.15.37:0/809792894 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6f4107420 0x7ff6f4107820 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:08:38.815 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:37.789+0000 7ff6fa400640 1 -- 172.21.15.37:0/809792894 >> 172.21.15.37:0/809792894 conn(0x7ff6f4102c10 msgr2=0x7ff6f4105030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:08:38.815 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:37.789+0000 7ff6fa400640 1 -- 172.21.15.37:0/809792894 shutdown_connections 2024-09-11T23:08:38.815 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:37.789+0000 7ff6fa400640 1 -- 172.21.15.37:0/809792894 wait complete. 2024-09-11T23:08:38.815 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:37.790+0000 7ff6fa400640 1 Processor -- start 2024-09-11T23:08:38.815 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:37.790+0000 7ff6fa400640 1 -- start start 2024-09-11T23:08:38.815 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:37.791+0000 7ff6fa400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6f4107420 0x7ff6f407ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:08:38.815 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:37.791+0000 7ff6fa400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff6f410b980 con 0x7ff6f4107420 2024-09-11T23:08:38.815 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:37.791+0000 7ff6f9000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6f4107420 0x7ff6f407ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:08:38.815 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:37.791+0000 7ff6f9000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6f4107420 0x7ff6f407ca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39740/0 (socket says 172.21.15.37:39740) 2024-09-11T23:08:38.815 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:37.791+0000 7ff6f9000640 1 -- 172.21.15.37:0/55974522 learned_addr learned my addr 172.21.15.37:0/55974522 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:08:38.815 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:37.791+0000 7ff6f9000640 1 -- 172.21.15.37:0/55974522 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6f407cf40 con 0x7ff6f4107420 2024-09-11T23:08:38.815 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:37.792+0000 7ff6f9000640 1 --2- 172.21.15.37:0/55974522 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6f4107420 0x7ff6f407ca00 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff6e8009940 tx=0x7ff6e8032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:08:38.816 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:37.792+0000 7ff6f1600640 1 -- 172.21.15.37:0/55974522 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6e8042070 con 0x7ff6f4107420 2024-09-11T23:08:38.816 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:37.792+0000 7ff6f1600640 1 -- 172.21.15.37:0/55974522 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff6e80308c0 con 0x7ff6f4107420 2024-09-11T23:08:38.816 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:37.792+0000 7ff6f1600640 1 -- 172.21.15.37:0/55974522 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6e8037040 con 0x7ff6f4107420 2024-09-11T23:08:38.816 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:37.792+0000 7ff6fa400640 1 -- 172.21.15.37:0/55974522 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6f407b130 con 0x7ff6f4107420 2024-09-11T23:08:38.816 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:37.792+0000 7ff6fa400640 1 -- 172.21.15.37:0/55974522 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6f407b670 con 0x7ff6f4107420 2024-09-11T23:08:38.816 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:37.793+0000 7ff6f1600640 1 -- 172.21.15.37:0/55974522 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7ff6e8045070 con 0x7ff6f4107420 2024-09-11T23:08:38.816 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:37.793+0000 7ff6fa400640 1 -- 172.21.15.37:0/55974522 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6f410bb00 con 0x7ff6f4107420 2024-09-11T23:08:38.816 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:37.794+0000 7ff6f1600640 1 --2- 172.21.15.37:0/55974522 >> [v2:172.21.15.37:6800/2886800769,v1:172.21.15.37:6801/2886800769] conn(0x7ff6dc038f70 0x7ff6dc03b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:08:38.816 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:37.794+0000 7ff6f1600640 1 -- 172.21.15.37:0/55974522 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7ff6e806c0f0 con 0x7ff6f4107420 2024-09-11T23:08:38.816 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:37.794+0000 7ff6f3e00640 1 --2- 172.21.15.37:0/55974522 >> [v2:172.21.15.37:6800/2886800769,v1:172.21.15.37:6801/2886800769] conn(0x7ff6dc038f70 0x7ff6dc03b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:08:38.816 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:37.795+0000 7ff6f3e00640 1 --2- 172.21.15.37:0/55974522 >> [v2:172.21.15.37:6800/2886800769,v1:172.21.15.37:6801/2886800769] conn(0x7ff6dc038f70 0x7ff6dc03b430 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff6e00098c0 tx=0x7ff6e0006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:08:38.816 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:37.800+0000 7ff6f1600640 1 -- 172.21.15.37:0/55974522 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff6e806ba40 con 0x7ff6f4107420 2024-09-11T23:08:38.816 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:38.018+0000 7ff6fa400640 1 -- 172.21.15.37:0/55974522 --> [v2:172.21.15.37:6800/2886800769,v1:172.21.15.37:6801/2886800769] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7ff6f407bf00 con 0x7ff6dc038f70 2024-09-11T23:08:38.817 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:38.024+0000 7ff6f1600640 1 -- 172.21.15.37:0/55974522 <== mgr.14118 v2:172.21.15.37:6800/2886800769 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7ff6f407bf00 con 0x7ff6dc038f70 2024-09-11T23:08:38.817 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:38.026+0000 7ff6fa400640 1 -- 172.21.15.37:0/55974522 >> [v2:172.21.15.37:6800/2886800769,v1:172.21.15.37:6801/2886800769] conn(0x7ff6dc038f70 msgr2=0x7ff6dc03b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:08:38.817 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:38.026+0000 7ff6fa400640 1 --2- 172.21.15.37:0/55974522 >> [v2:172.21.15.37:6800/2886800769,v1:172.21.15.37:6801/2886800769] conn(0x7ff6dc038f70 0x7ff6dc03b430 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff6e00098c0 tx=0x7ff6e0006db0 comp rx=0 tx=0).stop 2024-09-11T23:08:38.817 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:38.026+0000 7ff6fa400640 1 -- 172.21.15.37:0/55974522 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6f4107420 msgr2=0x7ff6f407ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:08:38.817 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:38.026+0000 7ff6fa400640 1 --2- 172.21.15.37:0/55974522 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6f4107420 0x7ff6f407ca00 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff6e8009940 tx=0x7ff6e8032ce0 comp rx=0 tx=0).stop 2024-09-11T23:08:38.817 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:38.026+0000 7ff6fa400640 1 -- 172.21.15.37:0/55974522 shutdown_connections 2024-09-11T23:08:38.817 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:38.026+0000 7ff6fa400640 1 --2- 172.21.15.37:0/55974522 >> [v2:172.21.15.37:6800/2886800769,v1:172.21.15.37:6801/2886800769] conn(0x7ff6dc038f70 0x7ff6dc03b430 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:08:38.817 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:38.026+0000 7ff6fa400640 1 --2- 172.21.15.37:0/55974522 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6f4107420 0x7ff6f407ca00 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:08:38.817 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:38.026+0000 7ff6fa400640 1 -- 172.21.15.37:0/55974522 >> 172.21.15.37:0/55974522 conn(0x7ff6f4102c10 msgr2=0x7ff6f4103810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:08:38.817 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:38.026+0000 7ff6fa400640 1 -- 172.21.15.37:0/55974522 shutdown_connections 2024-09-11T23:08:38.817 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:38.027+0000 7ff6fa400640 1 -- 172.21.15.37:0/55974522 wait complete. 2024-09-11T23:08:38.817 INFO:teuthology.orchestra.run.smithi037.stdout:Deploying unmanaged mgr service... 2024-09-11T23:08:39.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:39 smithi037 ceph-mon[30630]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:08:39.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:39 smithi037 ceph-mon[30630]: Saving service mon spec with placement count:5 2024-09-11T23:08:39.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:39 smithi037 ceph-mon[30630]: from='mgr.14118 172.21.15.37:0/4176675630' entity='mgr.x' 2024-09-11T23:08:40.993 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:40 smithi037 ceph-mon[30630]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:08:40.993 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:40 smithi037 ceph-mon[30630]: Saving service mgr spec with placement count:2 2024-09-11T23:08:40.993 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:40 smithi037 ceph-mon[30630]: from='mgr.14118 172.21.15.37:0/4176675630' entity='mgr.x' 2024-09-11T23:08:41.002 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-11T23:08:41.002 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:39.368+0000 7f2d87e00640 1 Processor -- start 2024-09-11T23:08:41.002 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:39.368+0000 7f2d87e00640 1 -- start start 2024-09-11T23:08:41.002 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:39.368+0000 7f2d87e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d8807cca0 0x7f2d8807b150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:08:41.002 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:39.368+0000 7f2d87e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2d8807b690 con 0x7f2d8807cca0 2024-09-11T23:08:41.002 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:39.369+0000 7f2d86a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d8807cca0 0x7f2d8807b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:08:41.002 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:39.369+0000 7f2d86a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d8807cca0 0x7f2d8807b150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56142/0 (socket says 172.21.15.37:56142) 2024-09-11T23:08:41.002 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:39.369+0000 7f2d86a00640 1 -- 172.21.15.37:0/1829451722 learned_addr learned my addr 172.21.15.37:0/1829451722 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:08:41.002 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:39.369+0000 7f2d86a00640 1 -- 172.21.15.37:0/1829451722 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d8807b810 con 0x7f2d8807cca0 2024-09-11T23:08:41.003 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:39.370+0000 7f2d86a00640 1 --2- 172.21.15.37:0/1829451722 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d8807cca0 0x7f2d8807b150 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2d78009820 tx=0x7f2d7802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d388253fd08608f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:08:41.003 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:39.370+0000 7f2d86000640 1 -- 172.21.15.37:0/1829451722 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d78037070 con 0x7f2d8807cca0 2024-09-11T23:08:41.003 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:39.370+0000 7f2d86000640 1 -- 172.21.15.37:0/1829451722 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2d78032900 con 0x7f2d8807cca0 2024-09-11T23:08:41.003 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:39.370+0000 7f2d86000640 1 -- 172.21.15.37:0/1829451722 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d78030850 con 0x7f2d8807cca0 2024-09-11T23:08:41.003 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:39.371+0000 7f2d87e00640 1 -- 172.21.15.37:0/1829451722 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d8807cca0 msgr2=0x7f2d8807b150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:08:41.003 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:39.371+0000 7f2d87e00640 1 --2- 172.21.15.37:0/1829451722 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d8807cca0 0x7f2d8807b150 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2d78009820 tx=0x7f2d7802a270 comp rx=0 tx=0).stop 2024-09-11T23:08:41.003 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:39.371+0000 7f2d87e00640 1 -- 172.21.15.37:0/1829451722 shutdown_connections 2024-09-11T23:08:41.003 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:39.371+0000 7f2d87e00640 1 --2- 172.21.15.37:0/1829451722 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d8807cca0 0x7f2d8807b150 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:08:41.003 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:39.371+0000 7f2d87e00640 1 -- 172.21.15.37:0/1829451722 >> 172.21.15.37:0/1829451722 conn(0x7f2d88102b70 msgr2=0x7f2d88104fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:08:41.003 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:39.371+0000 7f2d87e00640 1 -- 172.21.15.37:0/1829451722 shutdown_connections 2024-09-11T23:08:41.003 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:39.371+0000 7f2d87e00640 1 -- 172.21.15.37:0/1829451722 wait complete. 2024-09-11T23:08:41.003 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:39.372+0000 7f2d87e00640 1 Processor -- start 2024-09-11T23:08:41.003 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:39.372+0000 7f2d87e00640 1 -- start start 2024-09-11T23:08:41.004 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:39.373+0000 7f2d87e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d8807cca0 0x7f2d8819d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:08:41.004 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:39.373+0000 7f2d87e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2d8810da50 con 0x7f2d8807cca0 2024-09-11T23:08:41.004 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:39.373+0000 7f2d86a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d8807cca0 0x7f2d8819d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:08:41.004 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:39.373+0000 7f2d86a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d8807cca0 0x7f2d8819d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56144/0 (socket says 172.21.15.37:56144) 2024-09-11T23:08:41.004 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:39.373+0000 7f2d86a00640 1 -- 172.21.15.37:0/1235345108 learned_addr learned my addr 172.21.15.37:0/1235345108 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:08:41.004 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:39.373+0000 7f2d86a00640 1 -- 172.21.15.37:0/1235345108 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d8819dae0 con 0x7f2d8807cca0 2024-09-11T23:08:41.004 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:39.374+0000 7f2d86a00640 1 --2- 172.21.15.37:0/1235345108 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d8807cca0 0x7f2d8819d5a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2d780097f0 tx=0x7f2d78030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:08:41.004 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:39.374+0000 7f2d7fe00640 1 -- 172.21.15.37:0/1235345108 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d78037040 con 0x7f2d8807cca0 2024-09-11T23:08:41.004 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:39.374+0000 7f2d7fe00640 1 -- 172.21.15.37:0/1235345108 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2d78040070 con 0x7f2d8807cca0 2024-09-11T23:08:41.004 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:39.374+0000 7f2d7fe00640 1 -- 172.21.15.37:0/1235345108 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d7803a390 con 0x7f2d8807cca0 2024-09-11T23:08:41.004 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:39.374+0000 7f2d87e00640 1 -- 172.21.15.37:0/1235345108 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d8819dd70 con 0x7f2d8807cca0 2024-09-11T23:08:41.004 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:39.374+0000 7f2d87e00640 1 -- 172.21.15.37:0/1235345108 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d881a0a60 con 0x7f2d8807cca0 2024-09-11T23:08:41.004 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:39.375+0000 7f2d7fe00640 1 -- 172.21.15.37:0/1235345108 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f2d7803b430 con 0x7f2d8807cca0 2024-09-11T23:08:41.005 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:39.375+0000 7f2d87e00640 1 -- 172.21.15.37:0/1235345108 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d8807b1d0 con 0x7f2d8807cca0 2024-09-11T23:08:41.005 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:39.376+0000 7f2d7fe00640 1 --2- 172.21.15.37:0/1235345108 >> [v2:172.21.15.37:6800/2886800769,v1:172.21.15.37:6801/2886800769] conn(0x7f2d6c038fc0 0x7f2d6c03b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:08:41.005 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:39.376+0000 7f2d7fe00640 1 -- 172.21.15.37:0/1235345108 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f2d7806c510 con 0x7f2d8807cca0 2024-09-11T23:08:41.005 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:39.376+0000 7f2d7e000640 1 --2- 172.21.15.37:0/1235345108 >> [v2:172.21.15.37:6800/2886800769,v1:172.21.15.37:6801/2886800769] conn(0x7f2d6c038fc0 0x7f2d6c03b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:08:41.005 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:39.377+0000 7f2d7e000640 1 --2- 172.21.15.37:0/1235345108 >> [v2:172.21.15.37:6800/2886800769,v1:172.21.15.37:6801/2886800769] conn(0x7f2d6c038fc0 0x7f2d6c03b480 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f2d700098c0 tx=0x7f2d70006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:08:41.005 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:39.381+0000 7f2d7fe00640 1 -- 172.21.15.37:0/1235345108 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2d7806be60 con 0x7f2d8807cca0 2024-09-11T23:08:41.005 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:39.580+0000 7f2d87e00640 1 -- 172.21.15.37:0/1235345108 --> [v2:172.21.15.37:6800/2886800769,v1:172.21.15.37:6801/2886800769] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f2d88103e80 con 0x7f2d6c038fc0 2024-09-11T23:08:41.005 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:39.585+0000 7f2d7fe00640 1 -- 172.21.15.37:0/1235345108 <== mgr.14118 v2:172.21.15.37:6800/2886800769 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f2d88103e80 con 0x7f2d6c038fc0 2024-09-11T23:08:41.005 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:39.587+0000 7f2d87e00640 1 -- 172.21.15.37:0/1235345108 >> [v2:172.21.15.37:6800/2886800769,v1:172.21.15.37:6801/2886800769] conn(0x7f2d6c038fc0 msgr2=0x7f2d6c03b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:08:41.005 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:39.587+0000 7f2d87e00640 1 --2- 172.21.15.37:0/1235345108 >> [v2:172.21.15.37:6800/2886800769,v1:172.21.15.37:6801/2886800769] conn(0x7f2d6c038fc0 0x7f2d6c03b480 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f2d700098c0 tx=0x7f2d70006db0 comp rx=0 tx=0).stop 2024-09-11T23:08:41.005 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:39.587+0000 7f2d87e00640 1 -- 172.21.15.37:0/1235345108 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d8807cca0 msgr2=0x7f2d8819d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:08:41.005 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:39.587+0000 7f2d87e00640 1 --2- 172.21.15.37:0/1235345108 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d8807cca0 0x7f2d8819d5a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2d780097f0 tx=0x7f2d78030d80 comp rx=0 tx=0).stop 2024-09-11T23:08:41.006 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:39.587+0000 7f2d87e00640 1 -- 172.21.15.37:0/1235345108 shutdown_connections 2024-09-11T23:08:41.006 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:39.587+0000 7f2d87e00640 1 --2- 172.21.15.37:0/1235345108 >> [v2:172.21.15.37:6800/2886800769,v1:172.21.15.37:6801/2886800769] conn(0x7f2d6c038fc0 0x7f2d6c03b480 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:08:41.006 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:39.587+0000 7f2d87e00640 1 --2- 172.21.15.37:0/1235345108 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d8807cca0 0x7f2d8819d5a0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:08:41.006 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:39.587+0000 7f2d87e00640 1 -- 172.21.15.37:0/1235345108 >> 172.21.15.37:0/1235345108 conn(0x7f2d88102b70 msgr2=0x7f2d88103770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:08:41.006 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:39.587+0000 7f2d87e00640 1 -- 172.21.15.37:0/1235345108 shutdown_connections 2024-09-11T23:08:41.006 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:39.587+0000 7f2d87e00640 1 -- 172.21.15.37:0/1235345108 wait complete. 2024-09-11T23:08:41.795 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:41 smithi037 ceph-mon[30630]: from='mgr.14118 172.21.15.37:0/4176675630' entity='mgr.x' 2024-09-11T23:08:41.795 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:41 smithi037 ceph-mon[30630]: from='mgr.14118 172.21.15.37:0/4176675630' entity='mgr.x' 2024-09-11T23:08:43.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:42 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/3703714095' entity='client.admin' 2024-09-11T23:08:43.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:42 smithi037 ceph-mon[30630]: from='mgr.14118 172.21.15.37:0/4176675630' entity='mgr.x' 2024-09-11T23:08:43.103 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:41.534+0000 7f1c5d000640 1 Processor -- start 2024-09-11T23:08:43.104 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:41.534+0000 7f1c5d000640 1 -- start start 2024-09-11T23:08:43.104 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:41.534+0000 7f1c5d000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c58107450 0x7f1c58107850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:08:43.104 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:41.534+0000 7f1c5d000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1c58107e20 con 0x7f1c58107450 2024-09-11T23:08:43.104 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:41.535+0000 7f1c57400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c58107450 0x7f1c58107850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:08:43.104 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:41.535+0000 7f1c57400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c58107450 0x7f1c58107850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56154/0 (socket says 172.21.15.37:56154) 2024-09-11T23:08:43.104 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:41.535+0000 7f1c57400640 1 -- 172.21.15.37:0/1432104217 learned_addr learned my addr 172.21.15.37:0/1432104217 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:08:43.104 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:41.535+0000 7f1c57400640 1 -- 172.21.15.37:0/1432104217 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c58108600 con 0x7f1c58107450 2024-09-11T23:08:43.104 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:41.537+0000 7f1c57400640 1 --2- 172.21.15.37:0/1432104217 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c58107450 0x7f1c58107850 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1c48009820 tx=0x7f1c4802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0a0ce3d38078696 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:08:43.104 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:41.537+0000 7f1c56000640 1 -- 172.21.15.37:0/1432104217 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c48037070 con 0x7f1c58107450 2024-09-11T23:08:43.104 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:41.537+0000 7f1c56000640 1 -- 172.21.15.37:0/1432104217 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1c48032920 con 0x7f1c58107450 2024-09-11T23:08:43.104 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:41.537+0000 7f1c56000640 1 -- 172.21.15.37:0/1432104217 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c48030810 con 0x7f1c58107450 2024-09-11T23:08:43.105 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:41.538+0000 7f1c5d000640 1 -- 172.21.15.37:0/1432104217 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c58107450 msgr2=0x7f1c58107850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:08:43.105 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:41.538+0000 7f1c5d000640 1 --2- 172.21.15.37:0/1432104217 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c58107450 0x7f1c58107850 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1c48009820 tx=0x7f1c4802a270 comp rx=0 tx=0).stop 2024-09-11T23:08:43.105 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:41.538+0000 7f1c5d000640 1 -- 172.21.15.37:0/1432104217 shutdown_connections 2024-09-11T23:08:43.105 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:41.538+0000 7f1c5d000640 1 --2- 172.21.15.37:0/1432104217 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c58107450 0x7f1c58107850 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:08:43.105 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:41.538+0000 7f1c5d000640 1 -- 172.21.15.37:0/1432104217 >> 172.21.15.37:0/1432104217 conn(0x7f1c58102be0 msgr2=0x7f1c58105020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:08:43.105 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:41.538+0000 7f1c5d000640 1 -- 172.21.15.37:0/1432104217 shutdown_connections 2024-09-11T23:08:43.105 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:41.538+0000 7f1c5d000640 1 -- 172.21.15.37:0/1432104217 wait complete. 2024-09-11T23:08:43.105 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:41.539+0000 7f1c5d000640 1 Processor -- start 2024-09-11T23:08:43.105 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:41.539+0000 7f1c5d000640 1 -- start start 2024-09-11T23:08:43.105 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:41.539+0000 7f1c5d000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c58107450 0x7f1c5807ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:08:43.105 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:41.539+0000 7f1c5d000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1c5810b9b0 con 0x7f1c58107450 2024-09-11T23:08:43.105 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:41.540+0000 7f1c57400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c58107450 0x7f1c5807ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:08:43.105 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:41.540+0000 7f1c57400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c58107450 0x7f1c5807ca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56158/0 (socket says 172.21.15.37:56158) 2024-09-11T23:08:43.106 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:41.540+0000 7f1c57400640 1 -- 172.21.15.37:0/3703714095 learned_addr learned my addr 172.21.15.37:0/3703714095 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:08:43.106 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:41.540+0000 7f1c57400640 1 -- 172.21.15.37:0/3703714095 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c5807cf40 con 0x7f1c58107450 2024-09-11T23:08:43.106 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:41.540+0000 7f1c57400640 1 --2- 172.21.15.37:0/3703714095 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c58107450 0x7f1c5807ca00 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1c480097f0 tx=0x7f1c480327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:08:43.106 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:41.541+0000 7f1c4fe00640 1 -- 172.21.15.37:0/3703714095 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c48037040 con 0x7f1c58107450 2024-09-11T23:08:43.106 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:41.541+0000 7f1c5d000640 1 -- 172.21.15.37:0/3703714095 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c5807b130 con 0x7f1c58107450 2024-09-11T23:08:43.106 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:41.541+0000 7f1c4fe00640 1 -- 172.21.15.37:0/3703714095 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1c48030c40 con 0x7f1c58107450 2024-09-11T23:08:43.106 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:41.541+0000 7f1c4fe00640 1 -- 172.21.15.37:0/3703714095 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c4803a5b0 con 0x7f1c58107450 2024-09-11T23:08:43.106 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:41.541+0000 7f1c5d000640 1 -- 172.21.15.37:0/3703714095 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c5807b670 con 0x7f1c58107450 2024-09-11T23:08:43.106 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:41.542+0000 7f1c4fe00640 1 -- 172.21.15.37:0/3703714095 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f1c4803a7a0 con 0x7f1c58107450 2024-09-11T23:08:43.106 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:41.542+0000 7f1c5d000640 1 -- 172.21.15.37:0/3703714095 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c5810bb30 con 0x7f1c58107450 2024-09-11T23:08:43.106 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:41.543+0000 7f1c4fe00640 1 --2- 172.21.15.37:0/3703714095 >> [v2:172.21.15.37:6800/2886800769,v1:172.21.15.37:6801/2886800769] conn(0x7f1c3c038fc0 0x7f1c3c03b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:08:43.106 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:41.543+0000 7f1c4fe00640 1 -- 172.21.15.37:0/3703714095 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f1c4806c440 con 0x7f1c58107450 2024-09-11T23:08:43.106 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:41.543+0000 7f1c56a00640 1 --2- 172.21.15.37:0/3703714095 >> [v2:172.21.15.37:6800/2886800769,v1:172.21.15.37:6801/2886800769] conn(0x7f1c3c038fc0 0x7f1c3c03b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:08:43.107 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:41.544+0000 7f1c56a00640 1 --2- 172.21.15.37:0/3703714095 >> [v2:172.21.15.37:6800/2886800769,v1:172.21.15.37:6801/2886800769] conn(0x7f1c3c038fc0 0x7f1c3c03b480 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f1c440098c0 tx=0x7f1c44006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:08:43.107 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:41.548+0000 7f1c4fe00640 1 -- 172.21.15.37:0/3703714095 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1c480371e0 con 0x7f1c58107450 2024-09-11T23:08:43.107 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:41.771+0000 7f1c5d000640 1 -- 172.21.15.37:0/3703714095 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7f1c581078d0 con 0x7f1c58107450 2024-09-11T23:08:43.107 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:41.775+0000 7f1c4fe00640 1 -- 172.21.15.37:0/3703714095 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) ==== 142+0+0 (secure 0 0 0) 0x7f1c48030df0 con 0x7f1c58107450 2024-09-11T23:08:43.107 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:41.778+0000 7f1c5d000640 1 -- 172.21.15.37:0/3703714095 >> [v2:172.21.15.37:6800/2886800769,v1:172.21.15.37:6801/2886800769] conn(0x7f1c3c038fc0 msgr2=0x7f1c3c03b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:08:43.107 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:41.778+0000 7f1c5d000640 1 --2- 172.21.15.37:0/3703714095 >> [v2:172.21.15.37:6800/2886800769,v1:172.21.15.37:6801/2886800769] conn(0x7f1c3c038fc0 0x7f1c3c03b480 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f1c440098c0 tx=0x7f1c44006db0 comp rx=0 tx=0).stop 2024-09-11T23:08:43.107 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:41.778+0000 7f1c5d000640 1 -- 172.21.15.37:0/3703714095 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c58107450 msgr2=0x7f1c5807ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:08:43.107 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:41.778+0000 7f1c5d000640 1 --2- 172.21.15.37:0/3703714095 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c58107450 0x7f1c5807ca00 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1c480097f0 tx=0x7f1c480327b0 comp rx=0 tx=0).stop 2024-09-11T23:08:43.107 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:41.779+0000 7f1c5d000640 1 -- 172.21.15.37:0/3703714095 shutdown_connections 2024-09-11T23:08:43.107 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:41.779+0000 7f1c5d000640 1 --2- 172.21.15.37:0/3703714095 >> [v2:172.21.15.37:6800/2886800769,v1:172.21.15.37:6801/2886800769] conn(0x7f1c3c038fc0 0x7f1c3c03b480 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:08:43.107 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:41.779+0000 7f1c5d000640 1 --2- 172.21.15.37:0/3703714095 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c58107450 0x7f1c5807ca00 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:08:43.107 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:41.779+0000 7f1c5d000640 1 -- 172.21.15.37:0/3703714095 >> 172.21.15.37:0/3703714095 conn(0x7f1c58102be0 msgr2=0x7f1c581037e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:08:43.107 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:41.779+0000 7f1c5d000640 1 -- 172.21.15.37:0/3703714095 shutdown_connections 2024-09-11T23:08:43.107 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:41.779+0000 7f1c5d000640 1 -- 172.21.15.37:0/3703714095 wait complete. 2024-09-11T23:08:44.517 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:43.584+0000 7f9b9e400640 1 Processor -- start 2024-09-11T23:08:44.517 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:43.585+0000 7f9b9e400640 1 -- start start 2024-09-11T23:08:44.517 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:43.585+0000 7f9b9e400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b9807dd30 0x7f9b9807c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:08:44.517 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:43.585+0000 7f9b9e400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9b9807c7e0 con 0x7f9b9807dd30 2024-09-11T23:08:44.517 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:43.585+0000 7f9b97400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b9807dd30 0x7f9b9807c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:08:44.517 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:43.585+0000 7f9b97400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b9807dd30 0x7f9b9807c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56162/0 (socket says 172.21.15.37:56162) 2024-09-11T23:08:44.517 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:43.585+0000 7f9b97400640 1 -- 172.21.15.37:0/2295467511 learned_addr learned my addr 172.21.15.37:0/2295467511 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:08:44.518 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:43.586+0000 7f9b97400640 1 -- 172.21.15.37:0/2295467511 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b9807c960 con 0x7f9b9807dd30 2024-09-11T23:08:44.518 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:43.587+0000 7f9b97400640 1 --2- 172.21.15.37:0/2295467511 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b9807dd30 0x7f9b9807c2a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9b88009820 tx=0x7f9b8802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec5adebc52429c91 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:08:44.518 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:43.587+0000 7f9b96a00640 1 -- 172.21.15.37:0/2295467511 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b88037070 con 0x7f9b9807dd30 2024-09-11T23:08:44.518 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:43.587+0000 7f9b96a00640 1 -- 172.21.15.37:0/2295467511 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9b88032920 con 0x7f9b9807dd30 2024-09-11T23:08:44.518 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:43.587+0000 7f9b96a00640 1 -- 172.21.15.37:0/2295467511 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b88030810 con 0x7f9b9807dd30 2024-09-11T23:08:44.523 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:43.588+0000 7f9b9e400640 1 -- 172.21.15.37:0/2295467511 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b9807dd30 msgr2=0x7f9b9807c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:08:44.523 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:43.588+0000 7f9b9e400640 1 --2- 172.21.15.37:0/2295467511 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b9807dd30 0x7f9b9807c2a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9b88009820 tx=0x7f9b8802a270 comp rx=0 tx=0).stop 2024-09-11T23:08:44.523 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:43.588+0000 7f9b9e400640 1 -- 172.21.15.37:0/2295467511 shutdown_connections 2024-09-11T23:08:44.523 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:43.588+0000 7f9b9e400640 1 --2- 172.21.15.37:0/2295467511 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b9807dd30 0x7f9b9807c2a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:08:44.523 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:43.588+0000 7f9b9e400640 1 -- 172.21.15.37:0/2295467511 >> 172.21.15.37:0/2295467511 conn(0x7f9b98102e50 msgr2=0x7f9b98105270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:08:44.524 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:43.588+0000 7f9b9e400640 1 -- 172.21.15.37:0/2295467511 shutdown_connections 2024-09-11T23:08:44.524 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:43.588+0000 7f9b9e400640 1 -- 172.21.15.37:0/2295467511 wait complete. 2024-09-11T23:08:44.524 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:43.589+0000 7f9b9e400640 1 Processor -- start 2024-09-11T23:08:44.524 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:43.589+0000 7f9b9e400640 1 -- start start 2024-09-11T23:08:44.524 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:43.590+0000 7f9b9e400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b9807dd30 0x7f9b9819d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:08:44.524 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:43.590+0000 7f9b9e400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9b9810db80 con 0x7f9b9807dd30 2024-09-11T23:08:44.524 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:43.590+0000 7f9b97400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b9807dd30 0x7f9b9819d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:08:44.524 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:43.590+0000 7f9b97400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b9807dd30 0x7f9b9819d7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56172/0 (socket says 172.21.15.37:56172) 2024-09-11T23:08:44.524 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:43.590+0000 7f9b97400640 1 -- 172.21.15.37:0/4087318826 learned_addr learned my addr 172.21.15.37:0/4087318826 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:08:44.524 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:43.590+0000 7f9b97400640 1 -- 172.21.15.37:0/4087318826 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b9819dce0 con 0x7f9b9807dd30 2024-09-11T23:08:44.524 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:43.591+0000 7f9b97400640 1 --2- 172.21.15.37:0/4087318826 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b9807dd30 0x7f9b9819d7a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9b880097f0 tx=0x7f9b880327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:08:44.524 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:43.591+0000 7f9b94c00640 1 -- 172.21.15.37:0/4087318826 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b88037040 con 0x7f9b9807dd30 2024-09-11T23:08:44.524 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:43.591+0000 7f9b94c00640 1 -- 172.21.15.37:0/4087318826 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9b88030cc0 con 0x7f9b9807dd30 2024-09-11T23:08:44.525 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:43.591+0000 7f9b94c00640 1 -- 172.21.15.37:0/4087318826 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b8803a6b0 con 0x7f9b9807dd30 2024-09-11T23:08:44.525 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:43.591+0000 7f9b9e400640 1 -- 172.21.15.37:0/4087318826 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b9819df70 con 0x7f9b9807dd30 2024-09-11T23:08:44.525 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:43.591+0000 7f9b9e400640 1 -- 172.21.15.37:0/4087318826 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b981a0c60 con 0x7f9b9807dd30 2024-09-11T23:08:44.525 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:43.592+0000 7f9b94c00640 1 -- 172.21.15.37:0/4087318826 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f9b8803b3f0 con 0x7f9b9807dd30 2024-09-11T23:08:44.525 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:43.593+0000 7f9b94c00640 1 --2- 172.21.15.37:0/4087318826 >> [v2:172.21.15.37:6800/2886800769,v1:172.21.15.37:6801/2886800769] conn(0x7f9b7c038fc0 0x7f9b7c03b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:08:44.525 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:43.593+0000 7f9b94c00640 1 -- 172.21.15.37:0/4087318826 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f9b8806c550 con 0x7f9b9807dd30 2024-09-11T23:08:44.525 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:43.593+0000 7f9b8fe00640 1 --2- 172.21.15.37:0/4087318826 >> [v2:172.21.15.37:6800/2886800769,v1:172.21.15.37:6801/2886800769] conn(0x7f9b7c038fc0 0x7f9b7c03b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:08:44.525 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:43.593+0000 7f9b9e400640 1 -- 172.21.15.37:0/4087318826 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b9807c320 con 0x7f9b9807dd30 2024-09-11T23:08:44.525 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:43.594+0000 7f9b8fe00640 1 --2- 172.21.15.37:0/4087318826 >> [v2:172.21.15.37:6800/2886800769,v1:172.21.15.37:6801/2886800769] conn(0x7f9b7c038fc0 0x7f9b7c03b480 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f9b800098c0 tx=0x7f9b80006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:08:44.525 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:43.599+0000 7f9b94c00640 1 -- 172.21.15.37:0/4087318826 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9b880371e0 con 0x7f9b9807dd30 2024-09-11T23:08:44.525 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:43.785+0000 7f9b9e400640 1 -- 172.21.15.37:0/4087318826 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7f9b981a12b0 con 0x7f9b9807dd30 2024-09-11T23:08:44.525 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:43.787+0000 7f9b94c00640 1 -- 172.21.15.37:0/4087318826 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7f9b8803b730 con 0x7f9b9807dd30 2024-09-11T23:08:44.525 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:43.790+0000 7f9b9e400640 1 -- 172.21.15.37:0/4087318826 >> [v2:172.21.15.37:6800/2886800769,v1:172.21.15.37:6801/2886800769] conn(0x7f9b7c038fc0 msgr2=0x7f9b7c03b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:08:44.526 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:43.790+0000 7f9b9e400640 1 --2- 172.21.15.37:0/4087318826 >> [v2:172.21.15.37:6800/2886800769,v1:172.21.15.37:6801/2886800769] conn(0x7f9b7c038fc0 0x7f9b7c03b480 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f9b800098c0 tx=0x7f9b80006db0 comp rx=0 tx=0).stop 2024-09-11T23:08:44.526 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:43.790+0000 7f9b9e400640 1 -- 172.21.15.37:0/4087318826 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b9807dd30 msgr2=0x7f9b9819d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:08:44.526 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:43.790+0000 7f9b9e400640 1 --2- 172.21.15.37:0/4087318826 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b9807dd30 0x7f9b9819d7a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9b880097f0 tx=0x7f9b880327b0 comp rx=0 tx=0).stop 2024-09-11T23:08:44.526 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:43.790+0000 7f9b9e400640 1 -- 172.21.15.37:0/4087318826 shutdown_connections 2024-09-11T23:08:44.526 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:43.790+0000 7f9b9e400640 1 --2- 172.21.15.37:0/4087318826 >> [v2:172.21.15.37:6800/2886800769,v1:172.21.15.37:6801/2886800769] conn(0x7f9b7c038fc0 0x7f9b7c03b480 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:08:44.526 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:43.790+0000 7f9b9e400640 1 --2- 172.21.15.37:0/4087318826 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b9807dd30 0x7f9b9819d7a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:08:44.526 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:43.790+0000 7f9b9e400640 1 -- 172.21.15.37:0/4087318826 >> 172.21.15.37:0/4087318826 conn(0x7f9b98102e50 msgr2=0x7f9b98103980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:08:44.526 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:43.791+0000 7f9b9e400640 1 -- 172.21.15.37:0/4087318826 shutdown_connections 2024-09-11T23:08:44.526 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:43.791+0000 7f9b9e400640 1 -- 172.21.15.37:0/4087318826 wait complete. 2024-09-11T23:08:44.526 INFO:teuthology.orchestra.run.smithi037.stdout:Enabling the dashboard module... 2024-09-11T23:08:45.013 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:44 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/4087318826' entity='client.admin' 2024-09-11T23:08:45.013 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:44 smithi037 ceph-mon[30630]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:08:45.013 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:44 smithi037 ceph-mon[30630]: from='mgr.14118 172.21.15.37:0/4176675630' entity='mgr.x' 2024-09-11T23:08:45.877 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:45 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/3626360101' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-11T23:08:46.164 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:45 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: ignoring --setuser ceph since I am not root 2024-09-11T23:08:46.164 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:45 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: ignoring --setgroup ceph since I am not root 2024-09-11T23:08:46.164 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:46 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: 2024-09-11T23:08:46.042+0000 7f56d8432040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-11T23:08:46.165 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:46 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: 2024-09-11T23:08:46.115+0000 7f56d8432040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-11T23:08:46.470 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:46 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: 2024-09-11T23:08:46.309+0000 7f56d8432040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-11T23:08:46.470 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:46 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: 2024-09-11T23:08:46.393+0000 7f56d8432040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-11T23:08:46.479 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:44.996+0000 7f3eeb200640 1 Processor -- start 2024-09-11T23:08:46.479 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:44.997+0000 7f3eeb200640 1 -- start start 2024-09-11T23:08:46.479 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:44.997+0000 7f3eeb200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3eec109910 0x7f3eec109d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:08:46.480 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:44.997+0000 7f3eeb200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3eec10a2e0 con 0x7f3eec109910 2024-09-11T23:08:46.480 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:44.997+0000 7f3ee9e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3eec109910 0x7f3eec109d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:08:46.480 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:44.998+0000 7f3ee9e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3eec109910 0x7f3eec109d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56178/0 (socket says 172.21.15.37:56178) 2024-09-11T23:08:46.480 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:44.998+0000 7f3ee9e00640 1 -- 172.21.15.37:0/961516491 learned_addr learned my addr 172.21.15.37:0/961516491 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:08:46.480 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:44.998+0000 7f3ee9e00640 1 -- 172.21.15.37:0/961516491 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3eec10a770 con 0x7f3eec109910 2024-09-11T23:08:46.480 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:44.999+0000 7f3ee9e00640 1 --2- 172.21.15.37:0/961516491 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3eec109910 0x7f3eec109d10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3edc009820 tx=0x7f3edc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9ca28890731948c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:08:46.480 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:44.999+0000 7f3ee9400640 1 -- 172.21.15.37:0/961516491 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3edc037070 con 0x7f3eec109910 2024-09-11T23:08:46.480 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:44.999+0000 7f3ee9400640 1 -- 172.21.15.37:0/961516491 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3edc032920 con 0x7f3eec109910 2024-09-11T23:08:46.480 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:44.999+0000 7f3ee9400640 1 -- 172.21.15.37:0/961516491 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3edc030810 con 0x7f3eec109910 2024-09-11T23:08:46.480 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:45.000+0000 7f3eeb200640 1 -- 172.21.15.37:0/961516491 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3eec109910 msgr2=0x7f3eec109d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:08:46.480 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:45.000+0000 7f3eeb200640 1 --2- 172.21.15.37:0/961516491 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3eec109910 0x7f3eec109d10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3edc009820 tx=0x7f3edc02a270 comp rx=0 tx=0).stop 2024-09-11T23:08:46.480 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:45.000+0000 7f3eeb200640 1 -- 172.21.15.37:0/961516491 shutdown_connections 2024-09-11T23:08:46.481 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:45.000+0000 7f3eeb200640 1 --2- 172.21.15.37:0/961516491 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3eec109910 0x7f3eec109d10 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:08:46.481 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:45.000+0000 7f3eeb200640 1 -- 172.21.15.37:0/961516491 >> 172.21.15.37:0/961516491 conn(0x7f3eec07cc40 msgr2=0x7f3eec07d050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:08:46.481 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:45.000+0000 7f3eeb200640 1 -- 172.21.15.37:0/961516491 shutdown_connections 2024-09-11T23:08:46.481 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:45.000+0000 7f3eeb200640 1 -- 172.21.15.37:0/961516491 wait complete. 2024-09-11T23:08:46.481 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:45.001+0000 7f3eeb200640 1 Processor -- start 2024-09-11T23:08:46.481 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:45.002+0000 7f3eeb200640 1 -- start start 2024-09-11T23:08:46.481 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:45.002+0000 7f3eeb200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3eec109910 0x7f3eec19d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:08:46.481 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:45.002+0000 7f3eeb200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3eec10db20 con 0x7f3eec109910 2024-09-11T23:08:46.481 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:45.002+0000 7f3ee9e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3eec109910 0x7f3eec19d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:08:46.481 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:45.002+0000 7f3ee9e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3eec109910 0x7f3eec19d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56194/0 (socket says 172.21.15.37:56194) 2024-09-11T23:08:46.481 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:45.002+0000 7f3ee9e00640 1 -- 172.21.15.37:0/3626360101 learned_addr learned my addr 172.21.15.37:0/3626360101 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:08:46.481 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:45.002+0000 7f3ee9e00640 1 -- 172.21.15.37:0/3626360101 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3eec19db30 con 0x7f3eec109910 2024-09-11T23:08:46.481 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:45.003+0000 7f3ee9e00640 1 --2- 172.21.15.37:0/3626360101 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3eec109910 0x7f3eec19d5f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3edc0097f0 tx=0x7f3edc0327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:08:46.482 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:45.003+0000 7f3ee2a00640 1 -- 172.21.15.37:0/3626360101 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3edc037040 con 0x7f3eec109910 2024-09-11T23:08:46.482 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:45.003+0000 7f3ee2a00640 1 -- 172.21.15.37:0/3626360101 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3edc030cc0 con 0x7f3eec109910 2024-09-11T23:08:46.482 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:45.003+0000 7f3eeb200640 1 -- 172.21.15.37:0/3626360101 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3eec19ddc0 con 0x7f3eec109910 2024-09-11T23:08:46.482 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:45.003+0000 7f3ee2a00640 1 -- 172.21.15.37:0/3626360101 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3edc03a640 con 0x7f3eec109910 2024-09-11T23:08:46.482 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:45.003+0000 7f3eeb200640 1 -- 172.21.15.37:0/3626360101 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3eec1a0ab0 con 0x7f3eec109910 2024-09-11T23:08:46.482 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:45.004+0000 7f3ee2a00640 1 -- 172.21.15.37:0/3626360101 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f3edc03b3f0 con 0x7f3eec109910 2024-09-11T23:08:46.482 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:45.004+0000 7f3eeb200640 1 -- 172.21.15.37:0/3626360101 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3eec109d90 con 0x7f3eec109910 2024-09-11T23:08:46.482 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:45.005+0000 7f3ee2a00640 1 --2- 172.21.15.37:0/3626360101 >> [v2:172.21.15.37:6800/2886800769,v1:172.21.15.37:6801/2886800769] conn(0x7f3ed0038fc0 0x7f3ed003b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:08:46.482 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:45.005+0000 7f3ee2a00640 1 -- 172.21.15.37:0/3626360101 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f3edc06c4a0 con 0x7f3eec109910 2024-09-11T23:08:46.482 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:45.005+0000 7f3ee3e00640 1 --2- 172.21.15.37:0/3626360101 >> [v2:172.21.15.37:6800/2886800769,v1:172.21.15.37:6801/2886800769] conn(0x7f3ed0038fc0 0x7f3ed003b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:08:46.482 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:45.006+0000 7f3ee3e00640 1 --2- 172.21.15.37:0/3626360101 >> [v2:172.21.15.37:6800/2886800769,v1:172.21.15.37:6801/2886800769] conn(0x7f3ed0038fc0 0x7f3ed003b480 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f3ed40098c0 tx=0x7f3ed4006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:08:46.482 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:45.012+0000 7f3ee2a00640 1 -- 172.21.15.37:0/3626360101 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3edc0328c0 con 0x7f3eec109910 2024-09-11T23:08:46.482 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:45.266+0000 7f3eeb200640 1 -- 172.21.15.37:0/3626360101 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7f3eec1a10a0 con 0x7f3eec109910 2024-09-11T23:08:46.482 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:45.792+0000 7f3ee2a00640 1 -- 172.21.15.37:0/3626360101 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7f3edc042dc0 con 0x7f3eec109910 2024-09-11T23:08:46.483 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:45.794+0000 7f3ee2a00640 1 -- 172.21.15.37:0/3626360101 <== mon.0 v2:172.21.15.37:3300/0 8 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7f3edc049ca0 con 0x7f3eec109910 2024-09-11T23:08:46.483 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:45.796+0000 7f3eeb200640 1 -- 172.21.15.37:0/3626360101 >> [v2:172.21.15.37:6800/2886800769,v1:172.21.15.37:6801/2886800769] conn(0x7f3ed0038fc0 msgr2=0x7f3ed003b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:08:46.483 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:45.796+0000 7f3eeb200640 1 --2- 172.21.15.37:0/3626360101 >> [v2:172.21.15.37:6800/2886800769,v1:172.21.15.37:6801/2886800769] conn(0x7f3ed0038fc0 0x7f3ed003b480 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f3ed40098c0 tx=0x7f3ed4006db0 comp rx=0 tx=0).stop 2024-09-11T23:08:46.483 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:45.796+0000 7f3eeb200640 1 -- 172.21.15.37:0/3626360101 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3eec109910 msgr2=0x7f3eec19d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:08:46.483 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:45.796+0000 7f3eeb200640 1 --2- 172.21.15.37:0/3626360101 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3eec109910 0x7f3eec19d5f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3edc0097f0 tx=0x7f3edc0327b0 comp rx=0 tx=0).stop 2024-09-11T23:08:46.483 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:45.796+0000 7f3eeb200640 1 -- 172.21.15.37:0/3626360101 shutdown_connections 2024-09-11T23:08:46.483 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:45.796+0000 7f3eeb200640 1 --2- 172.21.15.37:0/3626360101 >> [v2:172.21.15.37:6800/2886800769,v1:172.21.15.37:6801/2886800769] conn(0x7f3ed0038fc0 0x7f3ed003b480 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:08:46.483 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:45.796+0000 7f3eeb200640 1 --2- 172.21.15.37:0/3626360101 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3eec109910 0x7f3eec19d5f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:08:46.483 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:45.796+0000 7f3eeb200640 1 -- 172.21.15.37:0/3626360101 >> 172.21.15.37:0/3626360101 conn(0x7f3eec07cc40 msgr2=0x7f3eec107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:08:46.483 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:45.796+0000 7f3eeb200640 1 -- 172.21.15.37:0/3626360101 shutdown_connections 2024-09-11T23:08:46.483 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:45.796+0000 7f3eeb200640 1 -- 172.21.15.37:0/3626360101 wait complete. 2024-09-11T23:08:46.750 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:46 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: 2024-09-11T23:08:46.576+0000 7f56d8432040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-11T23:08:46.750 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:46 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: 2024-09-11T23:08:46.749+0000 7f56d8432040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-11T23:08:47.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:46 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/3626360101' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-11T23:08:47.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:46 smithi037 ceph-mon[30630]: mgrmap e9: x(active, since 22s) 2024-09-11T23:08:47.433 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:47 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: 2024-09-11T23:08:47.136+0000 7f56d8432040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-11T23:08:47.433 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:47 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: 2024-09-11T23:08:47.211+0000 7f56d8432040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-11T23:08:47.433 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:47 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: 2024-09-11T23:08:47.432+0000 7f56d8432040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-11T23:08:48.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:47 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/2592496943' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-11T23:08:48.553 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout { 2024-09-11T23:08:48.553 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-11T23:08:48.554 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-11T23:08:48.554 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-11T23:08:48.554 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-11T23:08:48.554 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout } 2024-09-11T23:08:48.554 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:47.578+0000 7fd22f200640 1 Processor -- start 2024-09-11T23:08:48.554 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:47.579+0000 7fd22f200640 1 -- start start 2024-09-11T23:08:48.554 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:47.579+0000 7fd22f200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd228107400 0x7fd228107800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:08:48.554 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:47.579+0000 7fd22f200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd228107dd0 con 0x7fd228107400 2024-09-11T23:08:48.554 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:47.579+0000 7fd22de00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd228107400 0x7fd228107800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:08:48.554 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:47.579+0000 7fd22de00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd228107400 0x7fd228107800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56216/0 (socket says 172.21.15.37:56216) 2024-09-11T23:08:48.555 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:47.579+0000 7fd22de00640 1 -- 172.21.15.37:0/2023327889 learned_addr learned my addr 172.21.15.37:0/2023327889 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:08:48.555 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:47.580+0000 7fd22de00640 1 -- 172.21.15.37:0/2023327889 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2281085b0 con 0x7fd228107400 2024-09-11T23:08:48.555 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:47.581+0000 7fd22de00640 1 --2- 172.21.15.37:0/2023327889 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd228107400 0x7fd228107800 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd21c009820 tx=0x7fd21c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e9f352a123ae152 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:08:48.555 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:47.581+0000 7fd22ca00640 1 -- 172.21.15.37:0/2023327889 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd21c037070 con 0x7fd228107400 2024-09-11T23:08:48.555 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:47.581+0000 7fd22ca00640 1 -- 172.21.15.37:0/2023327889 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd21c032920 con 0x7fd228107400 2024-09-11T23:08:48.555 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:47.581+0000 7fd22ca00640 1 -- 172.21.15.37:0/2023327889 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd21c030810 con 0x7fd228107400 2024-09-11T23:08:48.555 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:47.582+0000 7fd22f200640 1 -- 172.21.15.37:0/2023327889 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd228107400 msgr2=0x7fd228107800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:08:48.555 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:47.582+0000 7fd22f200640 1 --2- 172.21.15.37:0/2023327889 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd228107400 0x7fd228107800 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd21c009820 tx=0x7fd21c02a270 comp rx=0 tx=0).stop 2024-09-11T23:08:48.555 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:47.582+0000 7fd22f200640 1 -- 172.21.15.37:0/2023327889 shutdown_connections 2024-09-11T23:08:48.555 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:47.582+0000 7fd22f200640 1 --2- 172.21.15.37:0/2023327889 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd228107400 0x7fd228107800 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:08:48.559 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:47.582+0000 7fd22f200640 1 -- 172.21.15.37:0/2023327889 >> 172.21.15.37:0/2023327889 conn(0x7fd228102b70 msgr2=0x7fd228104fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:08:48.559 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:47.582+0000 7fd22f200640 1 -- 172.21.15.37:0/2023327889 shutdown_connections 2024-09-11T23:08:48.559 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:47.583+0000 7fd22f200640 1 -- 172.21.15.37:0/2023327889 wait complete. 2024-09-11T23:08:48.559 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:47.583+0000 7fd22f200640 1 Processor -- start 2024-09-11T23:08:48.560 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:47.584+0000 7fd22f200640 1 -- start start 2024-09-11T23:08:48.560 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:47.584+0000 7fd22f200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd228107400 0x7fd22807ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:08:48.560 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:47.584+0000 7fd22f200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd22810b960 con 0x7fd228107400 2024-09-11T23:08:48.560 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:47.584+0000 7fd22de00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd228107400 0x7fd22807ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:08:48.560 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:47.584+0000 7fd22de00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd228107400 0x7fd22807ca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56228/0 (socket says 172.21.15.37:56228) 2024-09-11T23:08:48.560 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:47.584+0000 7fd22de00640 1 -- 172.21.15.37:0/2592496943 learned_addr learned my addr 172.21.15.37:0/2592496943 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:08:48.560 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:47.585+0000 7fd22de00640 1 -- 172.21.15.37:0/2592496943 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd22807cf40 con 0x7fd228107400 2024-09-11T23:08:48.560 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:47.585+0000 7fd22de00640 1 --2- 172.21.15.37:0/2592496943 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd228107400 0x7fd22807ca00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd21c0097f0 tx=0x7fd21c0327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:08:48.560 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:47.585+0000 7fd222a00640 1 -- 172.21.15.37:0/2592496943 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd21c037040 con 0x7fd228107400 2024-09-11T23:08:48.560 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:47.585+0000 7fd222a00640 1 -- 172.21.15.37:0/2592496943 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd21c030cc0 con 0x7fd228107400 2024-09-11T23:08:48.560 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:47.585+0000 7fd222a00640 1 -- 172.21.15.37:0/2592496943 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd21c03a640 con 0x7fd228107400 2024-09-11T23:08:48.560 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:47.585+0000 7fd22f200640 1 -- 172.21.15.37:0/2592496943 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd22807b130 con 0x7fd228107400 2024-09-11T23:08:48.561 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:47.585+0000 7fd22f200640 1 -- 172.21.15.37:0/2592496943 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd22807b670 con 0x7fd228107400 2024-09-11T23:08:48.561 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:47.587+0000 7fd222a00640 1 -- 172.21.15.37:0/2592496943 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7fd21c03b3f0 con 0x7fd228107400 2024-09-11T23:08:48.561 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:47.587+0000 7fd22f200640 1 -- 172.21.15.37:0/2592496943 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd228107880 con 0x7fd228107400 2024-09-11T23:08:48.561 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:47.587+0000 7fd222a00640 1 --2- 172.21.15.37:0/2592496943 >> [v2:172.21.15.37:6800/2886800769,v1:172.21.15.37:6801/2886800769] conn(0x7fd210039020 0x7fd21003b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:08:48.561 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:47.587+0000 7fd222a00640 1 -- 172.21.15.37:0/2592496943 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fd21c06c5c0 con 0x7fd228107400 2024-09-11T23:08:48.561 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:47.587+0000 7fd22d400640 1 -- 172.21.15.37:0/2592496943 >> [v2:172.21.15.37:6800/2886800769,v1:172.21.15.37:6801/2886800769] conn(0x7fd210039020 msgr2=0x7fd21003b4e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.37:6800/2886800769 2024-09-11T23:08:48.561 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:47.587+0000 7fd22d400640 1 --2- 172.21.15.37:0/2592496943 >> [v2:172.21.15.37:6800/2886800769,v1:172.21.15.37:6801/2886800769] conn(0x7fd210039020 0x7fd21003b4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T23:08:48.561 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:47.592+0000 7fd222a00640 1 -- 172.21.15.37:0/2592496943 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd21c0371e0 con 0x7fd228107400 2024-09-11T23:08:48.561 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:47.788+0000 7fd22d400640 1 -- 172.21.15.37:0/2592496943 >> [v2:172.21.15.37:6800/2886800769,v1:172.21.15.37:6801/2886800769] conn(0x7fd210039020 msgr2=0x7fd21003b4e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.37:6800/2886800769 2024-09-11T23:08:48.561 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:47.788+0000 7fd22d400640 1 --2- 172.21.15.37:0/2592496943 >> [v2:172.21.15.37:6800/2886800769,v1:172.21.15.37:6801/2886800769] conn(0x7fd210039020 0x7fd21003b4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T23:08:48.561 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:47.825+0000 7fd22f200640 1 -- 172.21.15.37:0/2592496943 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7fd22807bf10 con 0x7fd228107400 2024-09-11T23:08:48.561 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:47.826+0000 7fd222a00640 1 -- 172.21.15.37:0/2592496943 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7fd21c0328c0 con 0x7fd228107400 2024-09-11T23:08:48.561 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:47.829+0000 7fd22f200640 1 -- 172.21.15.37:0/2592496943 >> [v2:172.21.15.37:6800/2886800769,v1:172.21.15.37:6801/2886800769] conn(0x7fd210039020 msgr2=0x7fd21003b4e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T23:08:48.561 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:47.829+0000 7fd22f200640 1 --2- 172.21.15.37:0/2592496943 >> [v2:172.21.15.37:6800/2886800769,v1:172.21.15.37:6801/2886800769] conn(0x7fd210039020 0x7fd21003b4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:08:48.562 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:47.829+0000 7fd22f200640 1 -- 172.21.15.37:0/2592496943 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd228107400 msgr2=0x7fd22807ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:08:48.562 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:47.829+0000 7fd22f200640 1 --2- 172.21.15.37:0/2592496943 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd228107400 0x7fd22807ca00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd21c0097f0 tx=0x7fd21c0327b0 comp rx=0 tx=0).stop 2024-09-11T23:08:48.562 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:47.829+0000 7fd22f200640 1 -- 172.21.15.37:0/2592496943 shutdown_connections 2024-09-11T23:08:48.562 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:47.829+0000 7fd22f200640 1 --2- 172.21.15.37:0/2592496943 >> [v2:172.21.15.37:6800/2886800769,v1:172.21.15.37:6801/2886800769] conn(0x7fd210039020 0x7fd21003b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:08:48.562 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:47.829+0000 7fd22f200640 1 --2- 172.21.15.37:0/2592496943 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd228107400 0x7fd22807ca00 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:08:48.562 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:47.829+0000 7fd22f200640 1 -- 172.21.15.37:0/2592496943 >> 172.21.15.37:0/2592496943 conn(0x7fd228102b70 msgr2=0x7fd228103750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:08:48.562 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:47.829+0000 7fd22f200640 1 -- 172.21.15.37:0/2592496943 shutdown_connections 2024-09-11T23:08:48.562 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:47.829+0000 7fd22f200640 1 -- 172.21.15.37:0/2592496943 wait complete. 2024-09-11T23:08:48.562 INFO:teuthology.orchestra.run.smithi037.stdout:Waiting for the mgr to restart... 2024-09-11T23:08:48.563 INFO:teuthology.orchestra.run.smithi037.stdout:Waiting for mgr epoch 9... 2024-09-11T23:08:48.808 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:48 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: 2024-09-11T23:08:48.606+0000 7f56d8432040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-11T23:08:48.809 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:48 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: 2024-09-11T23:08:48.690+0000 7f56d8432040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-11T23:08:49.967 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:49 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: 2024-09-11T23:08:49.654+0000 7f56d8432040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-11T23:08:49.967 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:49 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: 2024-09-11T23:08:49.796+0000 7f56d8432040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-11T23:08:49.967 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:49 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: 2024-09-11T23:08:49.966+0000 7f56d8432040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-11T23:08:50.221 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:50 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: 2024-09-11T23:08:50.042+0000 7f56d8432040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-11T23:08:50.221 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:50 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: 2024-09-11T23:08:50.220+0000 7f56d8432040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-11T23:08:50.564 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:50 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: 2024-09-11T23:08:50.305+0000 7f56d8432040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-11T23:08:50.565 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:50 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: 2024-09-11T23:08:50.379+0000 7f56d8432040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-11T23:08:50.831 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:50 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: 2024-09-11T23:08:50.568+0000 7f56d8432040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-11T23:08:50.831 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:50 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: 2024-09-11T23:08:50.648+0000 7f56d8432040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-11T23:08:50.831 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:50 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: 2024-09-11T23:08:50.730+0000 7f56d8432040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-11T23:08:50.831 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:50 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: 2024-09-11T23:08:50.831+0000 7f56d8432040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-11T23:08:51.314 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:50 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: 2024-09-11T23:08:50.904+0000 7f56d8432040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-11T23:08:51.314 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:50 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: 2024-09-11T23:08:50.977+0000 7f56d8432040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-11T23:08:52.203 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:51 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: 2024-09-11T23:08:51.932+0000 7f56d8432040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-11T23:08:52.204 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:51 smithi037 ceph-mon[30630]: Active manager daemon x restarted 2024-09-11T23:08:52.204 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:51 smithi037 ceph-mon[30630]: Activating manager daemon x 2024-09-11T23:08:52.204 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:51 smithi037 ceph-mon[30630]: osdmap e3: 0 total, 0 up, 0 in 2024-09-11T23:08:52.204 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:51 smithi037 ceph-mon[30630]: mgrmap e10: x(active, starting, since 0.0039745s) 2024-09-11T23:08:52.204 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:51 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T23:08:52.204 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:51 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-11T23:08:52.204 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:51 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-11T23:08:52.204 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:51 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-11T23:08:52.204 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:51 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-11T23:08:52.204 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:51 smithi037 ceph-mon[30630]: Manager daemon x is now available 2024-09-11T23:08:52.205 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:51 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:08:53.219 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:52 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-11T23:08:53.220 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:52 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-11T23:08:53.220 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:52 smithi037 ceph-mon[30630]: mgrmap e11: x(active, since 1.00753s) 2024-09-11T23:08:53.996 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:53 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: 2024-09-11T23:08:53.609+0000 7f5635800640 -1 log_channel(cephadm) log [ERR] : [11/Sep/2024:23:08:53] ENGINE Error in HTTPServer.serve 2024-09-11T23:08:53.996 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:53 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: Traceback (most recent call last): 2024-09-11T23:08:53.996 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:53 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-11T23:08:53.996 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:53 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: self._connections.run(self.expiration_interval) 2024-09-11T23:08:53.996 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:53 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-11T23:08:53.996 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:53 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: self._run(expiration_interval) 2024-09-11T23:08:53.996 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:53 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-11T23:08:53.996 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:53 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: new_conn = self._from_server_socket(self.server.socket) 2024-09-11T23:08:53.996 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:53 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-11T23:08:53.996 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:53 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-11T23:08:53.997 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:53 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-11T23:08:53.997 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:53 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: s = self.context.wrap_socket( 2024-09-11T23:08:53.997 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:53 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-11T23:08:53.997 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:53 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: return self.sslsocket_class._create( 2024-09-11T23:08:53.997 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:53 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-11T23:08:53.997 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:53 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: self.do_handshake() 2024-09-11T23:08:53.997 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:53 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-11T23:08:53.997 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:53 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: self._sslobj.do_handshake() 2024-09-11T23:08:53.997 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:53 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-11T23:08:53.997 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:08:53 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: 2024-09-11T23:08:54.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:53 smithi037 ceph-mon[30630]: [11/Sep/2024:23:08:53] ENGINE Bus STARTING 2024-09-11T23:08:54.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:53 smithi037 ceph-mon[30630]: [11/Sep/2024:23:08:53] ENGINE Serving on https://172.21.15.37:7150 2024-09-11T23:08:54.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:53 smithi037 ceph-mon[30630]: [11/Sep/2024:23:08:53] ENGINE Error in HTTPServer.serve 2024-09-11T23:08:54.315 INFO:journalctl@ceph.mon.a.smithi037.stdout: Traceback (most recent call last): 2024-09-11T23:08:54.315 INFO:journalctl@ceph.mon.a.smithi037.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-11T23:08:54.315 INFO:journalctl@ceph.mon.a.smithi037.stdout: self._connections.run(self.expiration_interval) 2024-09-11T23:08:54.315 INFO:journalctl@ceph.mon.a.smithi037.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-11T23:08:54.315 INFO:journalctl@ceph.mon.a.smithi037.stdout: self._run(expiration_interval) 2024-09-11T23:08:54.315 INFO:journalctl@ceph.mon.a.smithi037.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-11T23:08:54.315 INFO:journalctl@ceph.mon.a.smithi037.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-11T23:08:54.315 INFO:journalctl@ceph.mon.a.smithi037.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-11T23:08:54.315 INFO:journalctl@ceph.mon.a.smithi037.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-11T23:08:54.315 INFO:journalctl@ceph.mon.a.smithi037.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-11T23:08:54.316 INFO:journalctl@ceph.mon.a.smithi037.stdout: s = self.context.wrap_socket( 2024-09-11T23:08:54.316 INFO:journalctl@ceph.mon.a.smithi037.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-11T23:08:54.316 INFO:journalctl@ceph.mon.a.smithi037.stdout: return self.sslsocket_class._create( 2024-09-11T23:08:54.316 INFO:journalctl@ceph.mon.a.smithi037.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-11T23:08:54.316 INFO:journalctl@ceph.mon.a.smithi037.stdout: self.do_handshake() 2024-09-11T23:08:54.316 INFO:journalctl@ceph.mon.a.smithi037.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-11T23:08:54.316 INFO:journalctl@ceph.mon.a.smithi037.stdout: self._sslobj.do_handshake() 2024-09-11T23:08:54.316 INFO:journalctl@ceph.mon.a.smithi037.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-11T23:08:54.316 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:53 smithi037 ceph-mon[30630]: [11/Sep/2024:23:08:53] ENGINE Serving on http://172.21.15.37:8765 2024-09-11T23:08:54.316 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:53 smithi037 ceph-mon[30630]: [11/Sep/2024:23:08:53] ENGINE Bus STARTED 2024-09-11T23:08:54.403 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout { 2024-09-11T23:08:54.403 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-11T23:08:54.403 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-11T23:08:54.403 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout } 2024-09-11T23:08:54.404 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:49.042+0000 7f9f73200640 1 Processor -- start 2024-09-11T23:08:54.404 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:49.042+0000 7f9f73200640 1 -- start start 2024-09-11T23:08:54.404 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:49.042+0000 7f9f73200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f741062c0 0x7f9f741066c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:08:54.404 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:49.042+0000 7f9f73200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9f74106c90 con 0x7f9f741062c0 2024-09-11T23:08:54.404 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:49.042+0000 7f9f71e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f741062c0 0x7f9f741066c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:08:54.404 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:49.042+0000 7f9f71e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f741062c0 0x7f9f741066c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33576/0 (socket says 172.21.15.37:33576) 2024-09-11T23:08:54.404 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:49.042+0000 7f9f71e00640 1 -- 172.21.15.37:0/2658529340 learned_addr learned my addr 172.21.15.37:0/2658529340 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:08:54.404 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:49.043+0000 7f9f71e00640 1 -- 172.21.15.37:0/2658529340 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f741074c0 con 0x7f9f741062c0 2024-09-11T23:08:54.404 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:49.044+0000 7f9f71e00640 1 --2- 172.21.15.37:0/2658529340 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f741062c0 0x7f9f741066c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9f64009820 tx=0x7f9f6402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28acccc62ebd3041 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:08:54.405 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:49.044+0000 7f9f71400640 1 -- 172.21.15.37:0/2658529340 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f64037070 con 0x7f9f741062c0 2024-09-11T23:08:54.405 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:49.044+0000 7f9f71400640 1 -- 172.21.15.37:0/2658529340 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f64032920 con 0x7f9f741062c0 2024-09-11T23:08:54.405 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:49.044+0000 7f9f71400640 1 -- 172.21.15.37:0/2658529340 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f64030810 con 0x7f9f741062c0 2024-09-11T23:08:54.405 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:49.045+0000 7f9f73200640 1 -- 172.21.15.37:0/2658529340 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f741062c0 msgr2=0x7f9f741066c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:08:54.405 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:49.045+0000 7f9f73200640 1 --2- 172.21.15.37:0/2658529340 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f741062c0 0x7f9f741066c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9f64009820 tx=0x7f9f6402a270 comp rx=0 tx=0).stop 2024-09-11T23:08:54.405 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:49.045+0000 7f9f73200640 1 -- 172.21.15.37:0/2658529340 shutdown_connections 2024-09-11T23:08:54.405 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:49.045+0000 7f9f73200640 1 --2- 172.21.15.37:0/2658529340 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f741062c0 0x7f9f741066c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:08:54.405 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:49.045+0000 7f9f73200640 1 -- 172.21.15.37:0/2658529340 >> 172.21.15.37:0/2658529340 conn(0x7f9f74101a90 msgr2=0x7f9f74103eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:08:54.405 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:49.045+0000 7f9f73200640 1 -- 172.21.15.37:0/2658529340 shutdown_connections 2024-09-11T23:08:54.405 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:49.045+0000 7f9f73200640 1 -- 172.21.15.37:0/2658529340 wait complete. 2024-09-11T23:08:54.405 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:49.046+0000 7f9f73200640 1 Processor -- start 2024-09-11T23:08:54.406 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:49.046+0000 7f9f73200640 1 -- start start 2024-09-11T23:08:54.406 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:49.046+0000 7f9f73200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f741062c0 0x7f9f7419d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:08:54.406 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:49.046+0000 7f9f73200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9f7410a870 con 0x7f9f741062c0 2024-09-11T23:08:54.406 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:49.047+0000 7f9f71e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f741062c0 0x7f9f7419d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:08:54.406 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:49.047+0000 7f9f71e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f741062c0 0x7f9f7419d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33584/0 (socket says 172.21.15.37:33584) 2024-09-11T23:08:54.406 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:49.047+0000 7f9f71e00640 1 -- 172.21.15.37:0/534364959 learned_addr learned my addr 172.21.15.37:0/534364959 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:08:54.406 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:49.047+0000 7f9f71e00640 1 -- 172.21.15.37:0/534364959 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f7419dbd0 con 0x7f9f741062c0 2024-09-11T23:08:54.406 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:49.047+0000 7f9f71e00640 1 --2- 172.21.15.37:0/534364959 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f741062c0 0x7f9f7419d690 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9f64030560 tx=0x7f9f64032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:08:54.406 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:49.048+0000 7f9f6aa00640 1 -- 172.21.15.37:0/534364959 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f64037040 con 0x7f9f741062c0 2024-09-11T23:08:54.406 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:49.048+0000 7f9f73200640 1 -- 172.21.15.37:0/534364959 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f7419de60 con 0x7f9f741062c0 2024-09-11T23:08:54.406 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:49.048+0000 7f9f6aa00640 1 -- 172.21.15.37:0/534364959 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f64040070 con 0x7f9f741062c0 2024-09-11T23:08:54.406 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:49.048+0000 7f9f6aa00640 1 -- 172.21.15.37:0/534364959 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f6403a740 con 0x7f9f741062c0 2024-09-11T23:08:54.406 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:49.048+0000 7f9f73200640 1 -- 172.21.15.37:0/534364959 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f741a0b50 con 0x7f9f741062c0 2024-09-11T23:08:54.407 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:49.049+0000 7f9f6aa00640 1 -- 172.21.15.37:0/534364959 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7f9f6403bb90 con 0x7f9f741062c0 2024-09-11T23:08:54.407 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:49.050+0000 7f9f6aa00640 1 --2- 172.21.15.37:0/534364959 >> [v2:172.21.15.37:6800/2886800769,v1:172.21.15.37:6801/2886800769] conn(0x7f9f58039070 0x7f9f5803b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:08:54.407 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:49.050+0000 7f9f6aa00640 1 -- 172.21.15.37:0/534364959 --> [v2:172.21.15.37:6800/2886800769,v1:172.21.15.37:6801/2886800769] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f9f5803bc40 con 0x7f9f58039070 2024-09-11T23:08:54.407 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:49.050+0000 7f9f6aa00640 1 -- 172.21.15.37:0/534364959 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f9f6406c640 con 0x7f9f741062c0 2024-09-11T23:08:54.407 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:49.050+0000 7f9f6be00640 1 -- 172.21.15.37:0/534364959 >> [v2:172.21.15.37:6800/2886800769,v1:172.21.15.37:6801/2886800769] conn(0x7f9f58039070 msgr2=0x7f9f5803b530 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.37:6800/2886800769 2024-09-11T23:08:54.407 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:49.050+0000 7f9f6be00640 1 --2- 172.21.15.37:0/534364959 >> [v2:172.21.15.37:6800/2886800769,v1:172.21.15.37:6801/2886800769] conn(0x7f9f58039070 0x7f9f5803b530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T23:08:54.407 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:49.251+0000 7f9f6be00640 1 -- 172.21.15.37:0/534364959 >> [v2:172.21.15.37:6800/2886800769,v1:172.21.15.37:6801/2886800769] conn(0x7f9f58039070 msgr2=0x7f9f5803b530 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.37:6800/2886800769 2024-09-11T23:08:54.407 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:49.251+0000 7f9f6be00640 1 --2- 172.21.15.37:0/534364959 >> [v2:172.21.15.37:6800/2886800769,v1:172.21.15.37:6801/2886800769] conn(0x7f9f58039070 0x7f9f5803b530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T23:08:54.407 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:49.652+0000 7f9f6be00640 1 -- 172.21.15.37:0/534364959 >> [v2:172.21.15.37:6800/2886800769,v1:172.21.15.37:6801/2886800769] conn(0x7f9f58039070 msgr2=0x7f9f5803b530 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.37:6800/2886800769 2024-09-11T23:08:54.407 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:49.652+0000 7f9f6be00640 1 --2- 172.21.15.37:0/534364959 >> [v2:172.21.15.37:6800/2886800769,v1:172.21.15.37:6801/2886800769] conn(0x7f9f58039070 0x7f9f5803b530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-11T23:08:54.407 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:50.453+0000 7f9f6be00640 1 -- 172.21.15.37:0/534364959 >> [v2:172.21.15.37:6800/2886800769,v1:172.21.15.37:6801/2886800769] conn(0x7f9f58039070 msgr2=0x7f9f5803b530 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.37:6800/2886800769 2024-09-11T23:08:54.407 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:50.453+0000 7f9f6be00640 1 --2- 172.21.15.37:0/534364959 >> [v2:172.21.15.37:6800/2886800769,v1:172.21.15.37:6801/2886800769] conn(0x7f9f58039070 0x7f9f5803b530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-11T23:08:54.407 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:51.936+0000 7f9f6aa00640 1 -- 172.21.15.37:0/534364959 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mgrmap(e 10) ==== 46067+0+0 (secure 0 0 0) 0x7f9f6406b030 con 0x7f9f741062c0 2024-09-11T23:08:54.408 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:51.936+0000 7f9f6aa00640 1 -- 172.21.15.37:0/534364959 >> [v2:172.21.15.37:6800/2886800769,v1:172.21.15.37:6801/2886800769] conn(0x7f9f58039070 msgr2=0x7f9f5803b530 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T23:08:54.408 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:51.936+0000 7f9f6aa00640 1 --2- 172.21.15.37:0/534364959 >> [v2:172.21.15.37:6800/2886800769,v1:172.21.15.37:6801/2886800769] conn(0x7f9f58039070 0x7f9f5803b530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:08:54.408 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:52.938+0000 7f9f6aa00640 1 -- 172.21.15.37:0/534364959 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mgrmap(e 11) ==== 46194+0+0 (secure 0 0 0) 0x7f9f6403b420 con 0x7f9f741062c0 2024-09-11T23:08:54.408 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:52.938+0000 7f9f6aa00640 1 --2- 172.21.15.37:0/534364959 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f9f5803cb30 0x7f9f5803ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:08:54.408 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:52.939+0000 7f9f6aa00640 1 -- 172.21.15.37:0/534364959 --> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f9f6403de70 con 0x7f9f5803cb30 2024-09-11T23:08:54.408 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:52.940+0000 7f9f6be00640 1 --2- 172.21.15.37:0/534364959 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f9f5803cb30 0x7f9f5803ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:08:54.408 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:52.942+0000 7f9f6be00640 1 --2- 172.21.15.37:0/534364959 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f9f5803cb30 0x7f9f5803ef20 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c003980 tx=0x7f9f5c0092b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:08:54.408 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:52.942+0000 7f9f6aa00640 1 -- 172.21.15.37:0/534364959 <== mgr.14150 v2:172.21.15.37:6800/31543269 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f9f6403de70 con 0x7f9f5803cb30 2024-09-11T23:08:54.408 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:52.950+0000 7f9f73200640 1 -- 172.21.15.37:0/534364959 --> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f9f7410a9f0 con 0x7f9f5803cb30 2024-09-11T23:08:54.408 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:52.950+0000 7f9f6aa00640 1 -- 172.21.15.37:0/534364959 <== mgr.14150 v2:172.21.15.37:6800/31543269 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7f9f7410a9f0 con 0x7f9f5803cb30 2024-09-11T23:08:54.408 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:52.950+0000 7f9f73200640 1 -- 172.21.15.37:0/534364959 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f9f5803cb30 msgr2=0x7f9f5803ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:08:54.408 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:52.950+0000 7f9f73200640 1 --2- 172.21.15.37:0/534364959 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f9f5803cb30 0x7f9f5803ef20 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c003980 tx=0x7f9f5c0092b0 comp rx=0 tx=0).stop 2024-09-11T23:08:54.408 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:52.950+0000 7f9f73200640 1 -- 172.21.15.37:0/534364959 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f741062c0 msgr2=0x7f9f7419d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:08:54.409 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:52.950+0000 7f9f73200640 1 --2- 172.21.15.37:0/534364959 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f741062c0 0x7f9f7419d690 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9f64030560 tx=0x7f9f64032670 comp rx=0 tx=0).stop 2024-09-11T23:08:54.409 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:52.950+0000 7f9f73200640 1 -- 172.21.15.37:0/534364959 shutdown_connections 2024-09-11T23:08:54.409 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:52.950+0000 7f9f73200640 1 --2- 172.21.15.37:0/534364959 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f9f5803cb30 0x7f9f5803ef20 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:08:54.409 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:52.950+0000 7f9f73200640 1 --2- 172.21.15.37:0/534364959 >> [v2:172.21.15.37:6800/2886800769,v1:172.21.15.37:6801/2886800769] conn(0x7f9f58039070 0x7f9f5803b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:08:54.409 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:52.950+0000 7f9f73200640 1 --2- 172.21.15.37:0/534364959 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f741062c0 0x7f9f7419d690 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:08:54.409 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:52.950+0000 7f9f73200640 1 -- 172.21.15.37:0/534364959 >> 172.21.15.37:0/534364959 conn(0x7f9f74101a90 msgr2=0x7f9f74102640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:08:54.409 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:52.951+0000 7f9f73200640 1 -- 172.21.15.37:0/534364959 shutdown_connections 2024-09-11T23:08:54.409 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:52.951+0000 7f9f73200640 1 -- 172.21.15.37:0/534364959 wait complete. 2024-09-11T23:08:54.409 INFO:teuthology.orchestra.run.smithi037.stdout:mgr epoch 9 is available 2024-09-11T23:08:54.409 INFO:teuthology.orchestra.run.smithi037.stdout:Generating a dashboard self-signed certificate... 2024-09-11T23:08:55.203 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:54 smithi037 ceph-mon[30630]: mgrmap e12: x(active, since 2s) 2024-09-11T23:08:55.204 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:54 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:08:55.871 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-11T23:08:55.871 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:54.892+0000 7f9e23200640 1 Processor -- start 2024-09-11T23:08:55.871 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:54.892+0000 7f9e23200640 1 -- start start 2024-09-11T23:08:55.871 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:54.892+0000 7f9e23200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e2407cd20 0x7f9e2407b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:08:55.871 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:54.892+0000 7f9e23200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9e2407b7a0 con 0x7f9e2407cd20 2024-09-11T23:08:55.871 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:54.893+0000 7f9e21e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e2407cd20 0x7f9e2407b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:08:55.871 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:54.893+0000 7f9e21e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e2407cd20 0x7f9e2407b1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33666/0 (socket says 172.21.15.37:33666) 2024-09-11T23:08:55.871 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:54.893+0000 7f9e21e00640 1 -- 172.21.15.37:0/2370301529 learned_addr learned my addr 172.21.15.37:0/2370301529 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:08:55.871 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:54.893+0000 7f9e21e00640 1 -- 172.21.15.37:0/2370301529 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e2407b920 con 0x7f9e2407cd20 2024-09-11T23:08:55.871 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:54.894+0000 7f9e21e00640 1 --2- 172.21.15.37:0/2370301529 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e2407cd20 0x7f9e2407b1d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9e14009820 tx=0x7f9e1402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db753117e802ea89 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:08:55.871 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:54.894+0000 7f9e21400640 1 -- 172.21.15.37:0/2370301529 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e14037070 con 0x7f9e2407cd20 2024-09-11T23:08:55.872 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:54.894+0000 7f9e21400640 1 -- 172.21.15.37:0/2370301529 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9e14032920 con 0x7f9e2407cd20 2024-09-11T23:08:55.872 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:54.894+0000 7f9e21400640 1 -- 172.21.15.37:0/2370301529 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e14030810 con 0x7f9e2407cd20 2024-09-11T23:08:55.872 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:54.895+0000 7f9e23200640 1 -- 172.21.15.37:0/2370301529 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e2407cd20 msgr2=0x7f9e2407b1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:08:55.872 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:54.895+0000 7f9e23200640 1 --2- 172.21.15.37:0/2370301529 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e2407cd20 0x7f9e2407b1d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9e14009820 tx=0x7f9e1402a270 comp rx=0 tx=0).stop 2024-09-11T23:08:55.872 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:54.895+0000 7f9e23200640 1 -- 172.21.15.37:0/2370301529 shutdown_connections 2024-09-11T23:08:55.872 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:54.895+0000 7f9e23200640 1 --2- 172.21.15.37:0/2370301529 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e2407cd20 0x7f9e2407b1d0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:08:55.872 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:54.895+0000 7f9e23200640 1 -- 172.21.15.37:0/2370301529 >> 172.21.15.37:0/2370301529 conn(0x7f9e24102c10 msgr2=0x7f9e24105030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:08:55.872 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:54.895+0000 7f9e23200640 1 -- 172.21.15.37:0/2370301529 shutdown_connections 2024-09-11T23:08:55.872 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:54.895+0000 7f9e23200640 1 -- 172.21.15.37:0/2370301529 wait complete. 2024-09-11T23:08:55.872 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:54.896+0000 7f9e23200640 1 Processor -- start 2024-09-11T23:08:55.872 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:54.896+0000 7f9e23200640 1 -- start start 2024-09-11T23:08:55.872 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:54.896+0000 7f9e23200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e2407cd20 0x7f9e241a19c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:08:55.873 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:54.897+0000 7f9e23200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9e24109640 con 0x7f9e2407cd20 2024-09-11T23:08:55.873 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:54.897+0000 7f9e21e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e2407cd20 0x7f9e241a19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:08:55.873 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:54.897+0000 7f9e21e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e2407cd20 0x7f9e241a19c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33668/0 (socket says 172.21.15.37:33668) 2024-09-11T23:08:55.873 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:54.897+0000 7f9e21e00640 1 -- 172.21.15.37:0/446174854 learned_addr learned my addr 172.21.15.37:0/446174854 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:08:55.873 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:54.897+0000 7f9e21e00640 1 -- 172.21.15.37:0/446174854 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e241a1f00 con 0x7f9e2407cd20 2024-09-11T23:08:55.873 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:54.897+0000 7f9e21e00640 1 --2- 172.21.15.37:0/446174854 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e2407cd20 0x7f9e241a19c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9e140097f0 tx=0x7f9e140327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:08:55.873 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:54.898+0000 7f9e1aa00640 1 -- 172.21.15.37:0/446174854 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e14037040 con 0x7f9e2407cd20 2024-09-11T23:08:55.873 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:54.898+0000 7f9e23200640 1 -- 172.21.15.37:0/446174854 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e241a2190 con 0x7f9e2407cd20 2024-09-11T23:08:55.873 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:54.898+0000 7f9e1aa00640 1 -- 172.21.15.37:0/446174854 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9e14030cc0 con 0x7f9e2407cd20 2024-09-11T23:08:55.873 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:54.898+0000 7f9e1aa00640 1 -- 172.21.15.37:0/446174854 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e1403a6b0 con 0x7f9e2407cd20 2024-09-11T23:08:55.873 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:54.898+0000 7f9e23200640 1 -- 172.21.15.37:0/446174854 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e241a4e80 con 0x7f9e2407cd20 2024-09-11T23:08:55.873 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:54.899+0000 7f9e1aa00640 1 -- 172.21.15.37:0/446174854 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7f9e1403b3f0 con 0x7f9e2407cd20 2024-09-11T23:08:55.873 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:54.899+0000 7f9e23200640 1 -- 172.21.15.37:0/446174854 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e2407b250 con 0x7f9e2407cd20 2024-09-11T23:08:55.874 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:54.900+0000 7f9e1aa00640 1 --2- 172.21.15.37:0/446174854 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f9e08038fc0 0x7f9e0803b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:08:55.874 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:54.900+0000 7f9e1aa00640 1 -- 172.21.15.37:0/446174854 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f9e1406c6e0 con 0x7f9e2407cd20 2024-09-11T23:08:55.874 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:54.900+0000 7f9e1be00640 1 --2- 172.21.15.37:0/446174854 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f9e08038fc0 0x7f9e0803b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:08:55.874 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:54.901+0000 7f9e1be00640 1 --2- 172.21.15.37:0/446174854 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f9e08038fc0 0x7f9e0803b480 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f9e0c0098c0 tx=0x7f9e0c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:08:55.874 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:54.909+0000 7f9e1aa00640 1 -- 172.21.15.37:0/446174854 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9e1403baf0 con 0x7f9e2407cd20 2024-09-11T23:08:55.874 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:55.109+0000 7f9e23200640 1 -- 172.21.15.37:0/446174854 --> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7f9e24062630 con 0x7f9e08038fc0 2024-09-11T23:08:55.874 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:55.203+0000 7f9e1aa00640 1 -- 172.21.15.37:0/446174854 <== mgr.14150 v2:172.21.15.37:6800/31543269 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7f9e24062630 con 0x7f9e08038fc0 2024-09-11T23:08:55.874 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:55.205+0000 7f9e23200640 1 -- 172.21.15.37:0/446174854 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f9e08038fc0 msgr2=0x7f9e0803b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:08:55.874 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:55.205+0000 7f9e23200640 1 --2- 172.21.15.37:0/446174854 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f9e08038fc0 0x7f9e0803b480 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f9e0c0098c0 tx=0x7f9e0c006db0 comp rx=0 tx=0).stop 2024-09-11T23:08:55.874 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:55.205+0000 7f9e23200640 1 -- 172.21.15.37:0/446174854 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e2407cd20 msgr2=0x7f9e241a19c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:08:55.874 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:55.205+0000 7f9e23200640 1 --2- 172.21.15.37:0/446174854 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e2407cd20 0x7f9e241a19c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9e140097f0 tx=0x7f9e140327b0 comp rx=0 tx=0).stop 2024-09-11T23:08:55.874 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:55.205+0000 7f9e23200640 1 -- 172.21.15.37:0/446174854 shutdown_connections 2024-09-11T23:08:55.874 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:55.205+0000 7f9e23200640 1 --2- 172.21.15.37:0/446174854 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f9e08038fc0 0x7f9e0803b480 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:08:55.875 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:55.205+0000 7f9e23200640 1 --2- 172.21.15.37:0/446174854 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e2407cd20 0x7f9e241a19c0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:08:55.875 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:55.206+0000 7f9e23200640 1 -- 172.21.15.37:0/446174854 >> 172.21.15.37:0/446174854 conn(0x7f9e24102c10 msgr2=0x7f9e24105000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:08:55.875 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:55.206+0000 7f9e23200640 1 -- 172.21.15.37:0/446174854 shutdown_connections 2024-09-11T23:08:55.875 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:55.206+0000 7f9e23200640 1 -- 172.21.15.37:0/446174854 wait complete. 2024-09-11T23:08:55.875 INFO:teuthology.orchestra.run.smithi037.stdout:Creating initial admin user... 2024-09-11T23:08:56.395 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:56 smithi037 ceph-mon[30630]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:08:56.395 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:56 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:08:56.395 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:56 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:08:56.396 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:56 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:08:58.199 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:57 smithi037 ceph-mon[30630]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:08:58.199 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:57 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:08:58.211 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$eTEklQurkT11hhM80PzhmenFGKnqaeIf3TV/nYVatR1TOVSkqlQAq", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726096136, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-11T23:08:58.211 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:56.386+0000 7f7648000640 1 Processor -- start 2024-09-11T23:08:58.211 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:56.387+0000 7f7648000640 1 -- start start 2024-09-11T23:08:58.211 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:56.387+0000 7f7648000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76401098c0 0x7f7640109cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:08:58.211 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:56.387+0000 7f7648000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f764010a290 con 0x7f76401098c0 2024-09-11T23:08:58.211 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:56.388+0000 7f7645600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76401098c0 0x7f7640109cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:08:58.211 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:56.388+0000 7f7645600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76401098c0 0x7f7640109cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33680/0 (socket says 172.21.15.37:33680) 2024-09-11T23:08:58.211 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:56.388+0000 7f7645600640 1 -- 172.21.15.37:0/150144420 learned_addr learned my addr 172.21.15.37:0/150144420 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:08:58.211 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:56.388+0000 7f7645600640 1 -- 172.21.15.37:0/150144420 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f764010a9b0 con 0x7f76401098c0 2024-09-11T23:08:58.211 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:56.389+0000 7f7645600640 1 --2- 172.21.15.37:0/150144420 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76401098c0 0x7f7640109cc0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7634009820 tx=0x7f763402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abc88676c4c83f26 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:08:58.211 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:56.389+0000 7f763fe00640 1 -- 172.21.15.37:0/150144420 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7634037070 con 0x7f76401098c0 2024-09-11T23:08:58.212 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:56.390+0000 7f763fe00640 1 -- 172.21.15.37:0/150144420 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7634032920 con 0x7f76401098c0 2024-09-11T23:08:58.212 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:56.390+0000 7f763fe00640 1 -- 172.21.15.37:0/150144420 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7634030810 con 0x7f76401098c0 2024-09-11T23:08:58.212 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:56.390+0000 7f7648000640 1 -- 172.21.15.37:0/150144420 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76401098c0 msgr2=0x7f7640109cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:08:58.212 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:56.390+0000 7f7648000640 1 --2- 172.21.15.37:0/150144420 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76401098c0 0x7f7640109cc0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7634009820 tx=0x7f763402a270 comp rx=0 tx=0).stop 2024-09-11T23:08:58.212 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:56.390+0000 7f7648000640 1 -- 172.21.15.37:0/150144420 shutdown_connections 2024-09-11T23:08:58.212 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:56.390+0000 7f7648000640 1 --2- 172.21.15.37:0/150144420 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76401098c0 0x7f7640109cc0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:08:58.212 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:56.390+0000 7f7648000640 1 -- 172.21.15.37:0/150144420 >> 172.21.15.37:0/150144420 conn(0x7f764007ce20 msgr2=0x7f764007d230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:08:58.212 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:56.391+0000 7f7648000640 1 -- 172.21.15.37:0/150144420 shutdown_connections 2024-09-11T23:08:58.212 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:56.391+0000 7f7648000640 1 -- 172.21.15.37:0/150144420 wait complete. 2024-09-11T23:08:58.212 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:56.391+0000 7f7648000640 1 Processor -- start 2024-09-11T23:08:58.212 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:56.392+0000 7f7648000640 1 -- start start 2024-09-11T23:08:58.212 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:56.392+0000 7f7648000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76401098c0 0x7f764019db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:08:58.212 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:56.392+0000 7f7648000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f764010dd60 con 0x7f76401098c0 2024-09-11T23:08:58.213 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:56.392+0000 7f7645600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76401098c0 0x7f764019db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:08:58.213 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:56.392+0000 7f7645600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76401098c0 0x7f764019db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33690/0 (socket says 172.21.15.37:33690) 2024-09-11T23:08:58.213 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:56.392+0000 7f7645600640 1 -- 172.21.15.37:0/413210785 learned_addr learned my addr 172.21.15.37:0/413210785 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:08:58.213 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:56.393+0000 7f7645600640 1 -- 172.21.15.37:0/413210785 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f764019e0b0 con 0x7f76401098c0 2024-09-11T23:08:58.213 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:56.393+0000 7f7645600640 1 --2- 172.21.15.37:0/413210785 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76401098c0 0x7f764019db70 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f76340097f0 tx=0x7f7634030d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:08:58.213 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:56.393+0000 7f763e000640 1 -- 172.21.15.37:0/413210785 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7634037040 con 0x7f76401098c0 2024-09-11T23:08:58.213 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:56.393+0000 7f763e000640 1 -- 172.21.15.37:0/413210785 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7634040070 con 0x7f76401098c0 2024-09-11T23:08:58.213 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:56.393+0000 7f7648000640 1 -- 172.21.15.37:0/413210785 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f764019e340 con 0x7f76401098c0 2024-09-11T23:08:58.213 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:56.393+0000 7f763e000640 1 -- 172.21.15.37:0/413210785 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f763403a610 con 0x7f76401098c0 2024-09-11T23:08:58.213 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:56.394+0000 7f7648000640 1 -- 172.21.15.37:0/413210785 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76401a1030 con 0x7f76401098c0 2024-09-11T23:08:58.213 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:56.395+0000 7f763e000640 1 -- 172.21.15.37:0/413210785 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7f76340327b0 con 0x7f76401098c0 2024-09-11T23:08:58.213 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:56.395+0000 7f7648000640 1 -- 172.21.15.37:0/413210785 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f764010dee0 con 0x7f76401098c0 2024-09-11T23:08:58.213 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:56.395+0000 7f763e000640 1 --2- 172.21.15.37:0/413210785 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f7628038fc0 0x7f762803b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:08:58.214 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:56.395+0000 7f763e000640 1 -- 172.21.15.37:0/413210785 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f763406c6f0 con 0x7f76401098c0 2024-09-11T23:08:58.214 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:56.396+0000 7f7644c00640 1 --2- 172.21.15.37:0/413210785 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f7628038fc0 0x7f762803b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:08:58.214 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:56.396+0000 7f7644c00640 1 --2- 172.21.15.37:0/413210785 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f7628038fc0 0x7f762803b480 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f762c0098c0 tx=0x7f762c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:08:58.214 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:56.401+0000 7f763e000640 1 -- 172.21.15.37:0/413210785 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f763404a200 con 0x7f76401098c0 2024-09-11T23:08:58.214 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:56.615+0000 7f7648000640 1 -- 172.21.15.37:0/413210785 --> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7f7640109d40 con 0x7f7628038fc0 2024-09-11T23:08:58.214 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:56.865+0000 7f763e000640 1 -- 172.21.15.37:0/413210785 <== mgr.14150 v2:172.21.15.37:6800/31543269 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7f7640109d40 con 0x7f7628038fc0 2024-09-11T23:08:58.214 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:56.867+0000 7f7648000640 1 -- 172.21.15.37:0/413210785 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f7628038fc0 msgr2=0x7f762803b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:08:58.214 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:56.867+0000 7f7648000640 1 --2- 172.21.15.37:0/413210785 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f7628038fc0 0x7f762803b480 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f762c0098c0 tx=0x7f762c006db0 comp rx=0 tx=0).stop 2024-09-11T23:08:58.214 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:56.867+0000 7f7648000640 1 -- 172.21.15.37:0/413210785 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76401098c0 msgr2=0x7f764019db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:08:58.214 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:56.867+0000 7f7648000640 1 --2- 172.21.15.37:0/413210785 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76401098c0 0x7f764019db70 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f76340097f0 tx=0x7f7634030d40 comp rx=0 tx=0).stop 2024-09-11T23:08:58.214 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:56.867+0000 7f7648000640 1 -- 172.21.15.37:0/413210785 shutdown_connections 2024-09-11T23:08:58.214 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:56.867+0000 7f7648000640 1 --2- 172.21.15.37:0/413210785 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f7628038fc0 0x7f762803b480 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:08:58.214 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:56.867+0000 7f7648000640 1 --2- 172.21.15.37:0/413210785 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76401098c0 0x7f764019db70 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:08:58.215 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:56.867+0000 7f7648000640 1 -- 172.21.15.37:0/413210785 >> 172.21.15.37:0/413210785 conn(0x7f764007ce20 msgr2=0x7f7640107780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:08:58.215 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:56.867+0000 7f7648000640 1 -- 172.21.15.37:0/413210785 shutdown_connections 2024-09-11T23:08:58.215 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:56.867+0000 7f7648000640 1 -- 172.21.15.37:0/413210785 wait complete. 2024-09-11T23:08:58.215 INFO:teuthology.orchestra.run.smithi037.stdout:Fetching dashboard port number... 2024-09-11T23:08:59.499 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 8443 2024-09-11T23:08:59.499 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:58.671+0000 7fa42ec00640 1 Processor -- start 2024-09-11T23:08:59.499 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:58.671+0000 7fa42ec00640 1 -- start start 2024-09-11T23:08:59.499 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:58.671+0000 7fa42ec00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa428109620 0x7fa428109a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:08:59.500 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:58.671+0000 7fa42ec00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa428109ff0 con 0x7fa428109620 2024-09-11T23:08:59.500 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:58.671+0000 7fa42d800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa428109620 0x7fa428109a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:08:59.500 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:58.671+0000 7fa42d800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa428109620 0x7fa428109a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33692/0 (socket says 172.21.15.37:33692) 2024-09-11T23:08:59.500 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:58.671+0000 7fa42d800640 1 -- 172.21.15.37:0/1910018290 learned_addr learned my addr 172.21.15.37:0/1910018290 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:08:59.500 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:58.672+0000 7fa42d800640 1 -- 172.21.15.37:0/1910018290 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa42810a7d0 con 0x7fa428109620 2024-09-11T23:08:59.500 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:58.673+0000 7fa42d800640 1 --2- 172.21.15.37:0/1910018290 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa428109620 0x7fa428109a20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa41c009e80 tx=0x7fa41c02a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85c1386189b6856d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:08:59.500 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:58.673+0000 7fa427e00640 1 -- 172.21.15.37:0/1910018290 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa41c036070 con 0x7fa428109620 2024-09-11T23:08:59.500 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:58.673+0000 7fa427e00640 1 -- 172.21.15.37:0/1910018290 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa41c0318e0 con 0x7fa428109620 2024-09-11T23:08:59.501 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:58.673+0000 7fa427e00640 1 -- 172.21.15.37:0/1910018290 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa41c007a00 con 0x7fa428109620 2024-09-11T23:08:59.504 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:58.674+0000 7fa42ec00640 1 -- 172.21.15.37:0/1910018290 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa428109620 msgr2=0x7fa428109a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:08:59.504 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:58.674+0000 7fa42ec00640 1 --2- 172.21.15.37:0/1910018290 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa428109620 0x7fa428109a20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa41c009e80 tx=0x7fa41c02a7a0 comp rx=0 tx=0).stop 2024-09-11T23:08:59.504 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:58.674+0000 7fa42ec00640 1 -- 172.21.15.37:0/1910018290 shutdown_connections 2024-09-11T23:08:59.505 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:58.674+0000 7fa42ec00640 1 --2- 172.21.15.37:0/1910018290 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa428109620 0x7fa428109a20 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:08:59.505 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:58.674+0000 7fa42ec00640 1 -- 172.21.15.37:0/1910018290 >> 172.21.15.37:0/1910018290 conn(0x7fa42807cc70 msgr2=0x7fa428107360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:08:59.505 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:58.674+0000 7fa42ec00640 1 -- 172.21.15.37:0/1910018290 shutdown_connections 2024-09-11T23:08:59.505 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:58.674+0000 7fa42ec00640 1 -- 172.21.15.37:0/1910018290 wait complete. 2024-09-11T23:08:59.505 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:58.675+0000 7fa42ec00640 1 Processor -- start 2024-09-11T23:08:59.505 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:58.675+0000 7fa42ec00640 1 -- start start 2024-09-11T23:08:59.505 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:58.675+0000 7fa42ec00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa428109620 0x7fa42819d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:08:59.505 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:58.675+0000 7fa42ec00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa42810db80 con 0x7fa428109620 2024-09-11T23:08:59.505 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:58.675+0000 7fa42d800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa428109620 0x7fa42819d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:08:59.505 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:58.675+0000 7fa42d800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa428109620 0x7fa42819d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33696/0 (socket says 172.21.15.37:33696) 2024-09-11T23:08:59.505 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:58.675+0000 7fa42d800640 1 -- 172.21.15.37:0/267617613 learned_addr learned my addr 172.21.15.37:0/267617613 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:08:59.505 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:58.676+0000 7fa42d800640 1 -- 172.21.15.37:0/267617613 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa42819db40 con 0x7fa428109620 2024-09-11T23:08:59.505 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:58.676+0000 7fa42d800640 1 --2- 172.21.15.37:0/267617613 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa428109620 0x7fa42819d600 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa41c02acc0 tx=0x7fa41c031cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:08:59.506 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:58.676+0000 7fa426000640 1 -- 172.21.15.37:0/267617613 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa41c036050 con 0x7fa428109620 2024-09-11T23:08:59.506 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:58.676+0000 7fa426000640 1 -- 172.21.15.37:0/267617613 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa41c037040 con 0x7fa428109620 2024-09-11T23:08:59.506 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:58.676+0000 7fa426000640 1 -- 172.21.15.37:0/267617613 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa41c03b890 con 0x7fa428109620 2024-09-11T23:08:59.506 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:58.676+0000 7fa42ec00640 1 -- 172.21.15.37:0/267617613 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa42819ddd0 con 0x7fa428109620 2024-09-11T23:08:59.506 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:58.677+0000 7fa42ec00640 1 -- 172.21.15.37:0/267617613 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4281a0ac0 con 0x7fa428109620 2024-09-11T23:08:59.506 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:58.677+0000 7fa426000640 1 -- 172.21.15.37:0/267617613 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7fa41c044020 con 0x7fa428109620 2024-09-11T23:08:59.506 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:58.678+0000 7fa42ec00640 1 -- 172.21.15.37:0/267617613 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa42810dd00 con 0x7fa428109620 2024-09-11T23:08:59.506 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:58.678+0000 7fa426000640 1 --2- 172.21.15.37:0/267617613 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fa410039020 0x7fa41003b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:08:59.506 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:58.678+0000 7fa426000640 1 -- 172.21.15.37:0/267617613 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fa41c042020 con 0x7fa428109620 2024-09-11T23:08:59.506 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:58.678+0000 7fa42ce00640 1 --2- 172.21.15.37:0/267617613 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fa410039020 0x7fa41003b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:08:59.506 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:58.679+0000 7fa42ce00640 1 --2- 172.21.15.37:0/267617613 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fa410039020 0x7fa41003b4e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa4140098c0 tx=0x7fa414006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:08:59.506 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:58.683+0000 7fa426000640 1 -- 172.21.15.37:0/267617613 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa41c04b020 con 0x7fa428109620 2024-09-11T23:08:59.506 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:58.866+0000 7fa426000640 1 -- 172.21.15.37:0/267617613 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fa41c037ce0 con 0x7fa428109620 2024-09-11T23:08:59.507 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:58.872+0000 7fa42ec00640 1 -- 172.21.15.37:0/267617613 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7fa4281a0c90 con 0x7fa428109620 2024-09-11T23:08:59.507 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:58.873+0000 7fa426000640 1 -- 172.21.15.37:0/267617613 <== mon.0 v2:172.21.15.37:3300/0 8 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7fa41c02e260 con 0x7fa428109620 2024-09-11T23:08:59.507 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:58.875+0000 7fa42ec00640 1 -- 172.21.15.37:0/267617613 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fa410039020 msgr2=0x7fa41003b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:08:59.507 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:58.875+0000 7fa42ec00640 1 --2- 172.21.15.37:0/267617613 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fa410039020 0x7fa41003b4e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa4140098c0 tx=0x7fa414006db0 comp rx=0 tx=0).stop 2024-09-11T23:08:59.507 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:58.875+0000 7fa42ec00640 1 -- 172.21.15.37:0/267617613 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa428109620 msgr2=0x7fa42819d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:08:59.507 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:58.875+0000 7fa42ec00640 1 --2- 172.21.15.37:0/267617613 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa428109620 0x7fa42819d600 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa41c02acc0 tx=0x7fa41c031cc0 comp rx=0 tx=0).stop 2024-09-11T23:08:59.507 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:58.875+0000 7fa42ec00640 1 -- 172.21.15.37:0/267617613 shutdown_connections 2024-09-11T23:08:59.507 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:58.875+0000 7fa42ec00640 1 --2- 172.21.15.37:0/267617613 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fa410039020 0x7fa41003b4e0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:08:59.507 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:58.875+0000 7fa42ec00640 1 --2- 172.21.15.37:0/267617613 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa428109620 0x7fa42819d600 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:08:59.507 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:58.875+0000 7fa42ec00640 1 -- 172.21.15.37:0/267617613 >> 172.21.15.37:0/267617613 conn(0x7fa42807cc70 msgr2=0x7fa428106b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:08:59.507 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:58.875+0000 7fa42ec00640 1 -- 172.21.15.37:0/267617613 shutdown_connections 2024-09-11T23:08:59.507 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:08:58.875+0000 7fa42ec00640 1 -- 172.21.15.37:0/267617613 wait complete. 2024-09-11T23:08:59.515 INFO:teuthology.orchestra.run.smithi037.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-11T23:08:59.516 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stdout disabled 2024-09-11T23:08:59.529 INFO:teuthology.orchestra.run.smithi037.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-11T23:08:59.529 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stdout inactive 2024-09-11T23:08:59.529 INFO:teuthology.orchestra.run.smithi037.stdout:firewalld.service is not enabled 2024-09-11T23:08:59.530 INFO:teuthology.orchestra.run.smithi037.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-11T23:08:59.532 INFO:teuthology.orchestra.run.smithi037.stdout:Ceph Dashboard is now available at: 2024-09-11T23:08:59.532 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:08:59.532 INFO:teuthology.orchestra.run.smithi037.stdout: URL: https://smithi037.front.sepia.ceph.com:8443/ 2024-09-11T23:08:59.532 INFO:teuthology.orchestra.run.smithi037.stdout: User: admin 2024-09-11T23:08:59.532 INFO:teuthology.orchestra.run.smithi037.stdout: Password: htadhsl4a8 2024-09-11T23:08:59.532 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:08:59.533 INFO:teuthology.orchestra.run.smithi037.stdout:Saving cluster configuration to /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/config directory 2024-09-11T23:09:00.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:59 smithi037 ceph-mon[30630]: mgrmap e13: x(active, since 6s) 2024-09-11T23:09:00.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:08:59 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/267617613' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-11T23:09:01.033 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:09:00.110+0000 7f41de400640 1 Processor -- start 2024-09-11T23:09:01.033 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:09:00.110+0000 7f41de400640 1 -- start start 2024-09-11T23:09:01.033 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:09:00.111+0000 7f41de400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41d81098c0 0x7f41d8109cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:09:01.033 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:09:00.111+0000 7f41de400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f41d810a290 con 0x7f41d81098c0 2024-09-11T23:09:01.033 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:09:00.111+0000 7f41d7400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41d81098c0 0x7f41d8109cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:09:01.033 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:09:00.111+0000 7f41d7400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41d81098c0 0x7f41d8109cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43802/0 (socket says 172.21.15.37:43802) 2024-09-11T23:09:01.033 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:09:00.111+0000 7f41d7400640 1 -- 172.21.15.37:0/3663479891 learned_addr learned my addr 172.21.15.37:0/3663479891 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:09:01.033 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:09:00.112+0000 7f41d7400640 1 -- 172.21.15.37:0/3663479891 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41d810a9b0 con 0x7f41d81098c0 2024-09-11T23:09:01.033 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:09:00.113+0000 7f41d7400640 1 --2- 172.21.15.37:0/3663479891 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41d81098c0 0x7f41d8109cc0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f41c8009820 tx=0x7f41c802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c2c3e1868912d31 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:09:01.033 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:09:00.113+0000 7f41d6a00640 1 -- 172.21.15.37:0/3663479891 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41c8037070 con 0x7f41d81098c0 2024-09-11T23:09:01.034 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:09:00.113+0000 7f41d6a00640 1 -- 172.21.15.37:0/3663479891 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f41c8032920 con 0x7f41d81098c0 2024-09-11T23:09:01.034 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:09:00.113+0000 7f41d6a00640 1 -- 172.21.15.37:0/3663479891 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41c8030810 con 0x7f41d81098c0 2024-09-11T23:09:01.034 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:09:00.113+0000 7f41de400640 1 -- 172.21.15.37:0/3663479891 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41d81098c0 msgr2=0x7f41d8109cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:09:01.034 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:09:00.113+0000 7f41de400640 1 --2- 172.21.15.37:0/3663479891 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41d81098c0 0x7f41d8109cc0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f41c8009820 tx=0x7f41c802a270 comp rx=0 tx=0).stop 2024-09-11T23:09:01.034 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:09:00.114+0000 7f41de400640 1 -- 172.21.15.37:0/3663479891 shutdown_connections 2024-09-11T23:09:01.034 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:09:00.114+0000 7f41de400640 1 --2- 172.21.15.37:0/3663479891 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41d81098c0 0x7f41d8109cc0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:09:01.034 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:09:00.114+0000 7f41de400640 1 -- 172.21.15.37:0/3663479891 >> 172.21.15.37:0/3663479891 conn(0x7f41d807ce20 msgr2=0x7f41d807d230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:09:01.034 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:09:00.114+0000 7f41de400640 1 -- 172.21.15.37:0/3663479891 shutdown_connections 2024-09-11T23:09:01.034 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:09:00.114+0000 7f41de400640 1 -- 172.21.15.37:0/3663479891 wait complete. 2024-09-11T23:09:01.034 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:09:00.115+0000 7f41de400640 1 Processor -- start 2024-09-11T23:09:01.034 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:09:00.115+0000 7f41de400640 1 -- start start 2024-09-11T23:09:01.034 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:09:00.115+0000 7f41de400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41d81098c0 0x7f41d819db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:09:01.034 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:09:00.115+0000 7f41de400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f41d810dd60 con 0x7f41d81098c0 2024-09-11T23:09:01.035 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:09:00.115+0000 7f41d7400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41d81098c0 0x7f41d819db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:09:01.035 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:09:00.115+0000 7f41d7400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41d81098c0 0x7f41d819db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43810/0 (socket says 172.21.15.37:43810) 2024-09-11T23:09:01.035 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:09:00.115+0000 7f41d7400640 1 -- 172.21.15.37:0/749982103 learned_addr learned my addr 172.21.15.37:0/749982103 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:09:01.035 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:09:00.116+0000 7f41d7400640 1 -- 172.21.15.37:0/749982103 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41d819e090 con 0x7f41d81098c0 2024-09-11T23:09:01.035 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:09:00.116+0000 7f41d7400640 1 --2- 172.21.15.37:0/749982103 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41d81098c0 0x7f41d819db50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f41c80097f0 tx=0x7f41c8030d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:09:01.035 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:09:00.116+0000 7f41d4c00640 1 -- 172.21.15.37:0/749982103 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41c8037040 con 0x7f41d81098c0 2024-09-11T23:09:01.035 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:09:00.116+0000 7f41d4c00640 1 -- 172.21.15.37:0/749982103 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f41c8040070 con 0x7f41d81098c0 2024-09-11T23:09:01.035 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:09:00.116+0000 7f41d4c00640 1 -- 172.21.15.37:0/749982103 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41c803a610 con 0x7f41d81098c0 2024-09-11T23:09:01.035 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:09:00.116+0000 7f41de400640 1 -- 172.21.15.37:0/749982103 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41d819e320 con 0x7f41d81098c0 2024-09-11T23:09:01.035 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:09:00.116+0000 7f41de400640 1 -- 172.21.15.37:0/749982103 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41d81a1010 con 0x7f41d81098c0 2024-09-11T23:09:01.035 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:09:00.117+0000 7f41d4c00640 1 -- 172.21.15.37:0/749982103 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f41c80327b0 con 0x7f41d81098c0 2024-09-11T23:09:01.035 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:09:00.117+0000 7f41de400640 1 -- 172.21.15.37:0/749982103 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41d810dee0 con 0x7f41d81098c0 2024-09-11T23:09:01.035 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:09:00.118+0000 7f41d4c00640 1 --2- 172.21.15.37:0/749982103 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f41bc039060 0x7f41bc03b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:09:01.036 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:09:00.118+0000 7f41d4c00640 1 -- 172.21.15.37:0/749982103 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f41c806c7d0 con 0x7f41d81098c0 2024-09-11T23:09:01.036 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:09:00.118+0000 7f41cfe00640 1 --2- 172.21.15.37:0/749982103 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f41bc039060 0x7f41bc03b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:09:01.036 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:09:00.119+0000 7f41cfe00640 1 --2- 172.21.15.37:0/749982103 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f41bc039060 0x7f41bc03b520 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f41c00098c0 tx=0x7f41c0006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:09:01.036 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:09:00.123+0000 7f41d4c00640 1 -- 172.21.15.37:0/749982103 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f41c8042b20 con 0x7f41d81098c0 2024-09-11T23:09:01.036 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:09:00.398+0000 7f41de400640 1 -- 172.21.15.37:0/749982103 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7f41d8109d40 con 0x7f41d81098c0 2024-09-11T23:09:01.036 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:09:00.401+0000 7f41d4c00640 1 -- 172.21.15.37:0/749982103 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) ==== 153+0+0 (secure 0 0 0) 0x7f41c8043360 con 0x7f41d81098c0 2024-09-11T23:09:01.036 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-11T23:09:01.036 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:09:00.403+0000 7f41de400640 1 -- 172.21.15.37:0/749982103 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f41bc039060 msgr2=0x7f41bc03b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:09:01.036 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:09:00.403+0000 7f41de400640 1 --2- 172.21.15.37:0/749982103 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f41bc039060 0x7f41bc03b520 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f41c00098c0 tx=0x7f41c0006db0 comp rx=0 tx=0).stop 2024-09-11T23:09:01.036 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:09:00.404+0000 7f41de400640 1 -- 172.21.15.37:0/749982103 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41d81098c0 msgr2=0x7f41d819db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:09:01.036 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:09:00.404+0000 7f41de400640 1 --2- 172.21.15.37:0/749982103 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41d81098c0 0x7f41d819db50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f41c80097f0 tx=0x7f41c8030d40 comp rx=0 tx=0).stop 2024-09-11T23:09:01.036 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:09:00.404+0000 7f41de400640 1 -- 172.21.15.37:0/749982103 shutdown_connections 2024-09-11T23:09:01.037 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:09:00.404+0000 7f41de400640 1 --2- 172.21.15.37:0/749982103 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f41bc039060 0x7f41bc03b520 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:09:01.037 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:09:00.404+0000 7f41de400640 1 --2- 172.21.15.37:0/749982103 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41d81098c0 0x7f41d819db50 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:09:01.037 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:09:00.404+0000 7f41de400640 1 -- 172.21.15.37:0/749982103 >> 172.21.15.37:0/749982103 conn(0x7f41d807ce20 msgr2=0x7f41d81077d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:09:01.037 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:09:00.404+0000 7f41de400640 1 -- 172.21.15.37:0/749982103 shutdown_connections 2024-09-11T23:09:01.037 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-11T23:09:00.404+0000 7f41de400640 1 -- 172.21.15.37:0/749982103 wait complete. 2024-09-11T23:09:01.037 INFO:teuthology.orchestra.run.smithi037.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-11T23:09:01.037 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:09:01.037 INFO:teuthology.orchestra.run.smithi037.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-11T23:09:01.037 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:09:01.037 INFO:teuthology.orchestra.run.smithi037.stdout:Or, if you are only running a single cluster on this host: 2024-09-11T23:09:01.037 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:09:01.037 INFO:teuthology.orchestra.run.smithi037.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-11T23:09:01.037 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:09:01.037 INFO:teuthology.orchestra.run.smithi037.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-11T23:09:01.038 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:09:01.038 INFO:teuthology.orchestra.run.smithi037.stdout: ceph telemetry on 2024-09-11T23:09:01.038 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:09:01.038 INFO:teuthology.orchestra.run.smithi037.stdout:For more information see: 2024-09-11T23:09:01.038 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:09:01.038 INFO:teuthology.orchestra.run.smithi037.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-11T23:09:01.038 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:09:01.038 INFO:teuthology.orchestra.run.smithi037.stdout:Bootstrap complete. 2024-09-11T23:09:01.090 INFO:tasks.cephadm:Fetching config... 2024-09-11T23:09:01.090 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-11T23:09:01.090 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-11T23:09:01.130 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-11T23:09:01.130 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-11T23:09:01.131 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-11T23:09:01.209 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-11T23:09:01.209 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-11T23:09:01.209 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/keyring of=/dev/stdout 2024-09-11T23:09:01.305 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-11T23:09:01.305 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-11T23:09:01.305 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-11T23:09:01.380 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-11T23:09:01.380 DEBUG:teuthology.orchestra.run.smithi037:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDStPpuii9GZizCCNYi68BUJ6HMC2QWej+2sss2Svn7TG6olh0/FFf7fD3hy2bo34J6c1Ty96lDTyJWuL4Xnly/9vJ6ZLh7GXx2sOpgjPymYpJSVtbyxM9o8RLBSKLXvZZjOOPAAD8LBCZS6EmynSb2tHV4GK7DBXgbN6sDwYM8R3GThAshIrkeiSfapjbZsffvSCnfRtLN41ga+rNO5fExcm9xK1jkMJwgRr5AZqphqxF5Mlt//VA0qrRPZDGQqV3f5/y8RSa+IlxQLd9Z9no0Hg9kDXq7/bXHCcYQqj9fVBExVxONEucgeUxPWlCf0cK1wwSMoULWUcNVYaubvmaEYn2xDH9fmLav0m69Rz5GlnMNx/4EX9mD2M+J+qOK3S3HgktHqRjcRg06GVauqgzH6kZIMvNbetVTssLFxK0954PQybALx5uBbtcAQstlYdOsgPYmtuON7LENjbX/3SAXaYhpCTvKkSzkEMc6xtssgu0Wc+cFXr7T3aa3cm7d3bc= ceph-8b03efce-7092-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-11T23:09:01.500 INFO:teuthology.orchestra.run.smithi037.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDStPpuii9GZizCCNYi68BUJ6HMC2QWej+2sss2Svn7TG6olh0/FFf7fD3hy2bo34J6c1Ty96lDTyJWuL4Xnly/9vJ6ZLh7GXx2sOpgjPymYpJSVtbyxM9o8RLBSKLXvZZjOOPAAD8LBCZS6EmynSb2tHV4GK7DBXgbN6sDwYM8R3GThAshIrkeiSfapjbZsffvSCnfRtLN41ga+rNO5fExcm9xK1jkMJwgRr5AZqphqxF5Mlt//VA0qrRPZDGQqV3f5/y8RSa+IlxQLd9Z9no0Hg9kDXq7/bXHCcYQqj9fVBExVxONEucgeUxPWlCf0cK1wwSMoULWUcNVYaubvmaEYn2xDH9fmLav0m69Rz5GlnMNx/4EX9mD2M+J+qOK3S3HgktHqRjcRg06GVauqgzH6kZIMvNbetVTssLFxK0954PQybALx5uBbtcAQstlYdOsgPYmtuON7LENjbX/3SAXaYhpCTvKkSzkEMc6xtssgu0Wc+cFXr7T3aa3cm7d3bc= ceph-8b03efce-7092-11ef-bcea-c7b262605968 2024-09-11T23:09:01.525 DEBUG:teuthology.orchestra.run.smithi123:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDStPpuii9GZizCCNYi68BUJ6HMC2QWej+2sss2Svn7TG6olh0/FFf7fD3hy2bo34J6c1Ty96lDTyJWuL4Xnly/9vJ6ZLh7GXx2sOpgjPymYpJSVtbyxM9o8RLBSKLXvZZjOOPAAD8LBCZS6EmynSb2tHV4GK7DBXgbN6sDwYM8R3GThAshIrkeiSfapjbZsffvSCnfRtLN41ga+rNO5fExcm9xK1jkMJwgRr5AZqphqxF5Mlt//VA0qrRPZDGQqV3f5/y8RSa+IlxQLd9Z9no0Hg9kDXq7/bXHCcYQqj9fVBExVxONEucgeUxPWlCf0cK1wwSMoULWUcNVYaubvmaEYn2xDH9fmLav0m69Rz5GlnMNx/4EX9mD2M+J+qOK3S3HgktHqRjcRg06GVauqgzH6kZIMvNbetVTssLFxK0954PQybALx5uBbtcAQstlYdOsgPYmtuON7LENjbX/3SAXaYhpCTvKkSzkEMc6xtssgu0Wc+cFXr7T3aa3cm7d3bc= ceph-8b03efce-7092-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-11T23:09:01.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:01 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/749982103' entity='client.admin' 2024-09-11T23:09:01.566 INFO:teuthology.orchestra.run.smithi123.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDStPpuii9GZizCCNYi68BUJ6HMC2QWej+2sss2Svn7TG6olh0/FFf7fD3hy2bo34J6c1Ty96lDTyJWuL4Xnly/9vJ6ZLh7GXx2sOpgjPymYpJSVtbyxM9o8RLBSKLXvZZjOOPAAD8LBCZS6EmynSb2tHV4GK7DBXgbN6sDwYM8R3GThAshIrkeiSfapjbZsffvSCnfRtLN41ga+rNO5fExcm9xK1jkMJwgRr5AZqphqxF5Mlt//VA0qrRPZDGQqV3f5/y8RSa+IlxQLd9Z9no0Hg9kDXq7/bXHCcYQqj9fVBExVxONEucgeUxPWlCf0cK1wwSMoULWUcNVYaubvmaEYn2xDH9fmLav0m69Rz5GlnMNx/4EX9mD2M+J+qOK3S3HgktHqRjcRg06GVauqgzH6kZIMvNbetVTssLFxK0954PQybALx5uBbtcAQstlYdOsgPYmtuON7LENjbX/3SAXaYhpCTvKkSzkEMc6xtssgu0Wc+cFXr7T3aa3cm7d3bc= ceph-8b03efce-7092-11ef-bcea-c7b262605968 2024-09-11T23:09:01.579 DEBUG:teuthology.orchestra.run.smithi160:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDStPpuii9GZizCCNYi68BUJ6HMC2QWej+2sss2Svn7TG6olh0/FFf7fD3hy2bo34J6c1Ty96lDTyJWuL4Xnly/9vJ6ZLh7GXx2sOpgjPymYpJSVtbyxM9o8RLBSKLXvZZjOOPAAD8LBCZS6EmynSb2tHV4GK7DBXgbN6sDwYM8R3GThAshIrkeiSfapjbZsffvSCnfRtLN41ga+rNO5fExcm9xK1jkMJwgRr5AZqphqxF5Mlt//VA0qrRPZDGQqV3f5/y8RSa+IlxQLd9Z9no0Hg9kDXq7/bXHCcYQqj9fVBExVxONEucgeUxPWlCf0cK1wwSMoULWUcNVYaubvmaEYn2xDH9fmLav0m69Rz5GlnMNx/4EX9mD2M+J+qOK3S3HgktHqRjcRg06GVauqgzH6kZIMvNbetVTssLFxK0954PQybALx5uBbtcAQstlYdOsgPYmtuON7LENjbX/3SAXaYhpCTvKkSzkEMc6xtssgu0Wc+cFXr7T3aa3cm7d3bc= ceph-8b03efce-7092-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-11T23:09:01.621 INFO:teuthology.orchestra.run.smithi160.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDStPpuii9GZizCCNYi68BUJ6HMC2QWej+2sss2Svn7TG6olh0/FFf7fD3hy2bo34J6c1Ty96lDTyJWuL4Xnly/9vJ6ZLh7GXx2sOpgjPymYpJSVtbyxM9o8RLBSKLXvZZjOOPAAD8LBCZS6EmynSb2tHV4GK7DBXgbN6sDwYM8R3GThAshIrkeiSfapjbZsffvSCnfRtLN41ga+rNO5fExcm9xK1jkMJwgRr5AZqphqxF5Mlt//VA0qrRPZDGQqV3f5/y8RSa+IlxQLd9Z9no0Hg9kDXq7/bXHCcYQqj9fVBExVxONEucgeUxPWlCf0cK1wwSMoULWUcNVYaubvmaEYn2xDH9fmLav0m69Rz5GlnMNx/4EX9mD2M+J+qOK3S3HgktHqRjcRg06GVauqgzH6kZIMvNbetVTssLFxK0954PQybALx5uBbtcAQstlYdOsgPYmtuON7LENjbX/3SAXaYhpCTvKkSzkEMc6xtssgu0Wc+cFXr7T3aa3cm7d3bc= ceph-8b03efce-7092-11ef-bcea-c7b262605968 2024-09-11T23:09:01.634 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-11T23:09:02.003 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:09:02.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:02.580+0000 7f11f6c00640 1 -- 172.21.15.37:0/1561895971 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11f01015e0 msgr2=0x7f11f01019e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:09:02.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:02.580+0000 7f11f6c00640 1 --2- 172.21.15.37:0/1561895971 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11f01015e0 0x7f11f01019e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f11e0009880 tx=0x7f11e002a5d0 comp rx=0 tx=0).stop 2024-09-11T23:09:02.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:02.580+0000 7f11f6c00640 1 -- 172.21.15.37:0/1561895971 shutdown_connections 2024-09-11T23:09:02.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:02.580+0000 7f11f6c00640 1 --2- 172.21.15.37:0/1561895971 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11f01015e0 0x7f11f01019e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:09:02.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:02.580+0000 7f11f6c00640 1 -- 172.21.15.37:0/1561895971 >> 172.21.15.37:0/1561895971 conn(0x7f11f00fcd70 msgr2=0x7f11f00ff1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:09:02.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:02.580+0000 7f11f6c00640 1 -- 172.21.15.37:0/1561895971 shutdown_connections 2024-09-11T23:09:02.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:02.580+0000 7f11f6c00640 1 -- 172.21.15.37:0/1561895971 wait complete. 2024-09-11T23:09:02.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:02.581+0000 7f11f6c00640 1 Processor -- start 2024-09-11T23:09:02.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:02.581+0000 7f11f6c00640 1 -- start start 2024-09-11T23:09:02.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:02.582+0000 7f11f6c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11f01015e0 0x7f11f019d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:09:02.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:02.582+0000 7f11f6c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f11f01076f0 con 0x7f11f01015e0 2024-09-11T23:09:02.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:02.582+0000 7f11efe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11f01015e0 0x7f11f019d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:09:02.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:02.582+0000 7f11efe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11f01015e0 0x7f11f019d390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43828/0 (socket says 172.21.15.37:43828) 2024-09-11T23:09:02.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:02.582+0000 7f11efe00640 1 -- 172.21.15.37:0/1866050214 learned_addr learned my addr 172.21.15.37:0/1866050214 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:09:02.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:02.583+0000 7f11efe00640 1 -- 172.21.15.37:0/1866050214 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11f019d8d0 con 0x7f11f01015e0 2024-09-11T23:09:02.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:02.583+0000 7f11efe00640 1 --2- 172.21.15.37:0/1866050214 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11f01015e0 0x7f11f019d390 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f11e0004f60 tx=0x7f11e00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:09:02.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:02.583+0000 7f11ecc00640 1 -- 172.21.15.37:0/1866050214 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f11e003f070 con 0x7f11f01015e0 2024-09-11T23:09:02.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:02.583+0000 7f11ecc00640 1 -- 172.21.15.37:0/1866050214 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f11e0004cc0 con 0x7f11f01015e0 2024-09-11T23:09:02.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:02.583+0000 7f11ecc00640 1 -- 172.21.15.37:0/1866050214 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f11e0035030 con 0x7f11f01015e0 2024-09-11T23:09:02.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:02.583+0000 7f11f6c00640 1 -- 172.21.15.37:0/1866050214 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11f019db60 con 0x7f11f01015e0 2024-09-11T23:09:02.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:02.584+0000 7f11f6c00640 1 -- 172.21.15.37:0/1866050214 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11f01a0850 con 0x7f11f01015e0 2024-09-11T23:09:02.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:02.585+0000 7f11ecc00640 1 -- 172.21.15.37:0/1866050214 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f11e0042070 con 0x7f11f01015e0 2024-09-11T23:09:02.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:02.585+0000 7f11f6c00640 1 -- 172.21.15.37:0/1866050214 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11f0107e70 con 0x7f11f01015e0 2024-09-11T23:09:02.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:02.585+0000 7f11ecc00640 1 --2- 172.21.15.37:0/1866050214 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f11d4039060 0x7f11d403b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:09:02.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:02.585+0000 7f11ecc00640 1 -- 172.21.15.37:0/1866050214 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f11e006cfc0 con 0x7f11f01015e0 2024-09-11T23:09:02.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:02.586+0000 7f11ef400640 1 --2- 172.21.15.37:0/1866050214 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f11d4039060 0x7f11d403b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:09:02.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:02.586+0000 7f11ef400640 1 --2- 172.21.15.37:0/1866050214 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f11d4039060 0x7f11d403b520 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f11dc0098c0 tx=0x7f11dc006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:09:02.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:02.594+0000 7f11ecc00640 1 -- 172.21.15.37:0/1866050214 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f11e00433b0 con 0x7f11f01015e0 2024-09-11T23:09:02.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:02.784+0000 7f11f6c00640 1 -- 172.21.15.37:0/1866050214 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7f11f002d830 con 0x7f11f01015e0 2024-09-11T23:09:02.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:02.788+0000 7f11ecc00640 1 -- 172.21.15.37:0/1866050214 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7f11e0003dd0 con 0x7f11f01015e0 2024-09-11T23:09:02.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:02.790+0000 7f11f6c00640 1 -- 172.21.15.37:0/1866050214 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f11d4039060 msgr2=0x7f11d403b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:09:02.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:02.790+0000 7f11f6c00640 1 --2- 172.21.15.37:0/1866050214 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f11d4039060 0x7f11d403b520 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f11dc0098c0 tx=0x7f11dc006db0 comp rx=0 tx=0).stop 2024-09-11T23:09:02.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:02.790+0000 7f11f6c00640 1 -- 172.21.15.37:0/1866050214 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11f01015e0 msgr2=0x7f11f019d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:09:02.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:02.790+0000 7f11f6c00640 1 --2- 172.21.15.37:0/1866050214 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11f01015e0 0x7f11f019d390 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f11e0004f60 tx=0x7f11e00048f0 comp rx=0 tx=0).stop 2024-09-11T23:09:02.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:02.791+0000 7f11f6c00640 1 -- 172.21.15.37:0/1866050214 shutdown_connections 2024-09-11T23:09:02.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:02.791+0000 7f11f6c00640 1 --2- 172.21.15.37:0/1866050214 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f11d4039060 0x7f11d403b520 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:09:02.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:02.791+0000 7f11f6c00640 1 --2- 172.21.15.37:0/1866050214 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11f01015e0 0x7f11f019d390 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:09:02.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:02.791+0000 7f11f6c00640 1 -- 172.21.15.37:0/1866050214 >> 172.21.15.37:0/1866050214 conn(0x7f11f00fcd70 msgr2=0x7f11f00ff1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:09:02.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:02.791+0000 7f11f6c00640 1 -- 172.21.15.37:0/1866050214 shutdown_connections 2024-09-11T23:09:02.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:02.791+0000 7f11f6c00640 1 -- 172.21.15.37:0/1866050214 wait complete. 2024-09-11T23:09:03.822 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-11T23:09:03.822 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-11T23:09:03.870 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:03 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/1866050214' entity='client.admin' 2024-09-11T23:09:03.871 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:03 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:03.871 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:03 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:03.871 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:03 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi037", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:09:03.871 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:03 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:03.871 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:03 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:09:03.871 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:03 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:04.379 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:09:04.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:04.920+0000 7f775f200640 1 -- 172.21.15.37:0/3381212455 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7760103640 msgr2=0x7f7760103a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:09:04.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:04.920+0000 7f775f200640 1 --2- 172.21.15.37:0/3381212455 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7760103640 0x7f7760103a40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7750009880 tx=0x7f775002a5d0 comp rx=0 tx=0).stop 2024-09-11T23:09:04.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:04.920+0000 7f775f200640 1 -- 172.21.15.37:0/3381212455 shutdown_connections 2024-09-11T23:09:04.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:04.920+0000 7f775f200640 1 --2- 172.21.15.37:0/3381212455 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7760103640 0x7f7760103a40 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:09:04.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:04.920+0000 7f775f200640 1 -- 172.21.15.37:0/3381212455 >> 172.21.15.37:0/3381212455 conn(0x7f77600fedd0 msgr2=0x7f7760101210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:09:04.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:04.920+0000 7f775f200640 1 -- 172.21.15.37:0/3381212455 shutdown_connections 2024-09-11T23:09:04.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:04.920+0000 7f775f200640 1 -- 172.21.15.37:0/3381212455 wait complete. 2024-09-11T23:09:04.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:04.921+0000 7f775f200640 1 Processor -- start 2024-09-11T23:09:04.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:04.921+0000 7f775f200640 1 -- start start 2024-09-11T23:09:04.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:04.921+0000 7f775f200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7760103640 0x7f7760198e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:09:04.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:04.921+0000 7f775f200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7760109750 con 0x7f7760103640 2024-09-11T23:09:04.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:04.922+0000 7f775de00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7760103640 0x7f7760198e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:09:04.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:04.922+0000 7f775de00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7760103640 0x7f7760198e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43838/0 (socket says 172.21.15.37:43838) 2024-09-11T23:09:04.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:04.922+0000 7f775de00640 1 -- 172.21.15.37:0/3012641290 learned_addr learned my addr 172.21.15.37:0/3012641290 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:09:04.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:04.922+0000 7f775de00640 1 -- 172.21.15.37:0/3012641290 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7760199340 con 0x7f7760103640 2024-09-11T23:09:04.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:04.922+0000 7f775de00640 1 --2- 172.21.15.37:0/3012641290 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7760103640 0x7f7760198e00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7750004f60 tx=0x7f77500048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:09:04.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:04.923+0000 7f7756a00640 1 -- 172.21.15.37:0/3012641290 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f775003f070 con 0x7f7760103640 2024-09-11T23:09:04.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:04.923+0000 7f7756a00640 1 -- 172.21.15.37:0/3012641290 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7750004d40 con 0x7f7760103640 2024-09-11T23:09:04.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:04.923+0000 7f775f200640 1 -- 172.21.15.37:0/3012641290 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77601995d0 con 0x7f7760103640 2024-09-11T23:09:04.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:04.923+0000 7f7756a00640 1 -- 172.21.15.37:0/3012641290 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7750035030 con 0x7f7760103640 2024-09-11T23:09:04.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:04.923+0000 7f775f200640 1 -- 172.21.15.37:0/3012641290 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f776019c2c0 con 0x7f7760103640 2024-09-11T23:09:04.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:04.924+0000 7f7756a00640 1 -- 172.21.15.37:0/3012641290 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f7750042070 con 0x7f7760103640 2024-09-11T23:09:04.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:04.924+0000 7f775f200640 1 -- 172.21.15.37:0/3012641290 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7760109ed0 con 0x7f7760103640 2024-09-11T23:09:04.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:04.925+0000 7f7756a00640 1 --2- 172.21.15.37:0/3012641290 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f7744039060 0x7f774403b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:09:04.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:04.925+0000 7f7756a00640 1 -- 172.21.15.37:0/3012641290 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f775006cdc0 con 0x7f7760103640 2024-09-11T23:09:04.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:04.925+0000 7f775d400640 1 --2- 172.21.15.37:0/3012641290 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f7744039060 0x7f774403b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:09:04.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:04.926+0000 7f775d400640 1 --2- 172.21.15.37:0/3012641290 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f7744039060 0x7f774403b520 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f774c0098c0 tx=0x7f774c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:09:04.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:04.930+0000 7f7756a00640 1 -- 172.21.15.37:0/3012641290 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f775004a260 con 0x7f7760103640 2024-09-11T23:09:05.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:05.134+0000 7f775f200640 1 -- 172.21.15.37:0/3012641290 --> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7f776002d830 con 0x7f7744039060 2024-09-11T23:09:05.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:05.138+0000 7f7756a00640 1 -- 172.21.15.37:0/3012641290 <== mgr.14150 v2:172.21.15.37:6800/31543269 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f776002d830 con 0x7f7744039060 2024-09-11T23:09:05.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:05.140+0000 7f775f200640 1 -- 172.21.15.37:0/3012641290 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f7744039060 msgr2=0x7f774403b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:09:05.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:05.140+0000 7f775f200640 1 --2- 172.21.15.37:0/3012641290 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f7744039060 0x7f774403b520 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f774c0098c0 tx=0x7f774c006db0 comp rx=0 tx=0).stop 2024-09-11T23:09:05.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:05.140+0000 7f775f200640 1 -- 172.21.15.37:0/3012641290 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7760103640 msgr2=0x7f7760198e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:09:05.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:05.140+0000 7f775f200640 1 --2- 172.21.15.37:0/3012641290 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7760103640 0x7f7760198e00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7750004f60 tx=0x7f77500048f0 comp rx=0 tx=0).stop 2024-09-11T23:09:05.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:05.141+0000 7f775f200640 1 -- 172.21.15.37:0/3012641290 shutdown_connections 2024-09-11T23:09:05.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:05.141+0000 7f775f200640 1 --2- 172.21.15.37:0/3012641290 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f7744039060 0x7f774403b520 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:09:05.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:05.141+0000 7f775f200640 1 --2- 172.21.15.37:0/3012641290 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7760103640 0x7f7760198e00 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:09:05.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:05.141+0000 7f775f200640 1 -- 172.21.15.37:0/3012641290 >> 172.21.15.37:0/3012641290 conn(0x7f77600fedd0 msgr2=0x7f77600ff900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:09:05.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:05.141+0000 7f775f200640 1 -- 172.21.15.37:0/3012641290 shutdown_connections 2024-09-11T23:09:05.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:05.141+0000 7f775f200640 1 -- 172.21.15.37:0/3012641290 wait complete. 2024-09-11T23:09:06.158 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi123 2024-09-11T23:09:06.158 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-11T23:09:06.159 DEBUG:teuthology.orchestra.run.smithi123:> dd of=/etc/ceph/ceph.conf 2024-09-11T23:09:06.178 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-11T23:09:06.178 DEBUG:teuthology.orchestra.run.smithi123:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-11T23:09:06.236 INFO:tasks.cephadm:Adding host smithi123 to orchestrator... 2024-09-11T23:09:06.237 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph orch host add smithi123 2024-09-11T23:09:06.334 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:06 smithi037 ceph-mon[30630]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:09:06.334 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:06 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:06.334 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:06 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:09:06.334 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:06 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:09:06.335 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:06 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:09:06.335 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:06 smithi037 ceph-mon[30630]: Updating smithi037:/etc/ceph/ceph.conf 2024-09-11T23:09:06.335 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:06 smithi037 ceph-mon[30630]: Updating smithi037:/var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T23:09:06.799 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:09:07.305 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:07 smithi037 ceph-mon[30630]: Updating smithi037:/etc/ceph/ceph.client.admin.keyring 2024-09-11T23:09:07.305 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:07 smithi037 ceph-mon[30630]: Updating smithi037:/var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-11T23:09:07.305 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:07 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:07.305 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:07 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:07.305 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:07 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:07.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:07.421+0000 7f4039400640 1 -- 172.21.15.37:0/751444686 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4034074510 msgr2=0x7f40340748f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:09:07.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:07.421+0000 7f4039400640 1 --2- 172.21.15.37:0/751444686 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4034074510 0x7f40340748f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4024009880 tx=0x7f402402a670 comp rx=0 tx=0).stop 2024-09-11T23:09:07.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:07.421+0000 7f4039400640 1 -- 172.21.15.37:0/751444686 shutdown_connections 2024-09-11T23:09:07.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:07.421+0000 7f4039400640 1 --2- 172.21.15.37:0/751444686 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4034074510 0x7f40340748f0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:09:07.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:07.421+0000 7f4039400640 1 -- 172.21.15.37:0/751444686 >> 172.21.15.37:0/751444686 conn(0x7f40340fd290 msgr2=0x7f40340ff6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:09:07.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:07.421+0000 7f4039400640 1 -- 172.21.15.37:0/751444686 shutdown_connections 2024-09-11T23:09:07.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:07.421+0000 7f4039400640 1 -- 172.21.15.37:0/751444686 wait complete. 2024-09-11T23:09:07.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:07.422+0000 7f4039400640 1 Processor -- start 2024-09-11T23:09:07.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:07.423+0000 7f4039400640 1 -- start start 2024-09-11T23:09:07.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:07.423+0000 7f4039400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4034074510 0x7f4034199390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:09:07.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:07.423+0000 7f4039400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f403410dea0 con 0x7f4034074510 2024-09-11T23:09:07.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:07.423+0000 7f4032800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4034074510 0x7f4034199390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:09:07.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:07.423+0000 7f4032800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4034074510 0x7f4034199390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43858/0 (socket says 172.21.15.37:43858) 2024-09-11T23:09:07.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:07.423+0000 7f4032800640 1 -- 172.21.15.37:0/3313875737 learned_addr learned my addr 172.21.15.37:0/3313875737 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:09:07.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:07.424+0000 7f4032800640 1 -- 172.21.15.37:0/3313875737 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40341998d0 con 0x7f4034074510 2024-09-11T23:09:07.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:07.424+0000 7f4032800640 1 --2- 172.21.15.37:0/3313875737 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4034074510 0x7f4034199390 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4024009230 tx=0x7f4024003d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:09:07.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:07.424+0000 7f402b400640 1 -- 172.21.15.37:0/3313875737 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f402403f070 con 0x7f4034074510 2024-09-11T23:09:07.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:07.424+0000 7f402b400640 1 -- 172.21.15.37:0/3313875737 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f402403bd40 con 0x7f4034074510 2024-09-11T23:09:07.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:07.424+0000 7f402b400640 1 -- 172.21.15.37:0/3313875737 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4024035030 con 0x7f4034074510 2024-09-11T23:09:07.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:07.424+0000 7f4039400640 1 -- 172.21.15.37:0/3313875737 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4034199b60 con 0x7f4034074510 2024-09-11T23:09:07.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:07.425+0000 7f4039400640 1 -- 172.21.15.37:0/3313875737 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4034199fc0 con 0x7f4034074510 2024-09-11T23:09:07.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:07.426+0000 7f402b400640 1 -- 172.21.15.37:0/3313875737 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f4024042070 con 0x7f4034074510 2024-09-11T23:09:07.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:07.426+0000 7f4039400640 1 -- 172.21.15.37:0/3313875737 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4034075c50 con 0x7f4034074510 2024-09-11T23:09:07.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:07.426+0000 7f402b400640 1 --2- 172.21.15.37:0/3313875737 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f40180390c0 0x7f401803b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:09:07.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:07.426+0000 7f402b400640 1 -- 172.21.15.37:0/3313875737 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f402406c910 con 0x7f4034074510 2024-09-11T23:09:07.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:07.426+0000 7f4031e00640 1 --2- 172.21.15.37:0/3313875737 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f40180390c0 0x7f401803b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:09:07.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:07.427+0000 7f4031e00640 1 --2- 172.21.15.37:0/3313875737 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f40180390c0 0x7f401803b580 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f40200098c0 tx=0x7f4020006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:09:07.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:07.432+0000 7f402b400640 1 -- 172.21.15.37:0/3313875737 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4024044e10 con 0x7f4034074510 2024-09-11T23:09:07.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:07.636+0000 7f4039400640 1 -- 172.21.15.37:0/3313875737 --> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi123", "target": ["mon-mgr", ""]}) -- 0x7f403419a760 con 0x7f40180390c0 2024-09-11T23:09:08.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:08 smithi037 ceph-mon[30630]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi123", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:09:09.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:09 smithi037 ceph-mon[30630]: Deploying cephadm binary to smithi123 2024-09-11T23:09:11.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:11.531+0000 7f402b400640 1 -- 172.21.15.37:0/3313875737 <== mgr.14150 v2:172.21.15.37:6800/31543269 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f403419a760 con 0x7f40180390c0 2024-09-11T23:09:11.531 INFO:teuthology.orchestra.run.smithi037.stdout:Added host 'smithi123' with addr '172.21.15.123' 2024-09-11T23:09:11.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:11.533+0000 7f4039400640 1 -- 172.21.15.37:0/3313875737 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f40180390c0 msgr2=0x7f401803b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:09:11.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:11.533+0000 7f4039400640 1 --2- 172.21.15.37:0/3313875737 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f40180390c0 0x7f401803b580 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f40200098c0 tx=0x7f4020006db0 comp rx=0 tx=0).stop 2024-09-11T23:09:11.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:11.534+0000 7f4039400640 1 -- 172.21.15.37:0/3313875737 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4034074510 msgr2=0x7f4034199390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:09:11.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:11.534+0000 7f4039400640 1 --2- 172.21.15.37:0/3313875737 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4034074510 0x7f4034199390 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4024009230 tx=0x7f4024003d80 comp rx=0 tx=0).stop 2024-09-11T23:09:11.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:11.534+0000 7f4039400640 1 -- 172.21.15.37:0/3313875737 shutdown_connections 2024-09-11T23:09:11.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:11.534+0000 7f4039400640 1 --2- 172.21.15.37:0/3313875737 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f40180390c0 0x7f401803b580 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:09:11.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:11.534+0000 7f4039400640 1 --2- 172.21.15.37:0/3313875737 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4034074510 0x7f4034199390 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:09:11.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:11.534+0000 7f4039400640 1 -- 172.21.15.37:0/3313875737 >> 172.21.15.37:0/3313875737 conn(0x7f40340fd290 msgr2=0x7f40341078c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:09:11.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:11.534+0000 7f4039400640 1 -- 172.21.15.37:0/3313875737 shutdown_connections 2024-09-11T23:09:11.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:11.534+0000 7f4039400640 1 -- 172.21.15.37:0/3313875737 wait complete. 2024-09-11T23:09:12.248 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph orch host ls --format=json 2024-09-11T23:09:12.622 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:09:12.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:12 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:12.815 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:12 smithi037 ceph-mon[30630]: Added host smithi123 2024-09-11T23:09:12.815 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:12 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:09:12.815 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:12 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:12.815 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:12 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:13.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:13.319+0000 7ff8dbe00640 1 -- 172.21.15.37:0/1298243971 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8d4107660 msgr2=0x7ff8d4107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:09:13.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:13.319+0000 7ff8dbe00640 1 --2- 172.21.15.37:0/1298243971 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8d4107660 0x7ff8d4107a40 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff8c8009880 tx=0x7ff8c802a5d0 comp rx=0 tx=0).stop 2024-09-11T23:09:13.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:13.320+0000 7ff8dbe00640 1 -- 172.21.15.37:0/1298243971 shutdown_connections 2024-09-11T23:09:13.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:13.320+0000 7ff8dbe00640 1 --2- 172.21.15.37:0/1298243971 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8d4107660 0x7ff8d4107a40 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:09:13.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:13.320+0000 7ff8dbe00640 1 -- 172.21.15.37:0/1298243971 >> 172.21.15.37:0/1298243971 conn(0x7ff8d40fd290 msgr2=0x7ff8d40ff6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:09:13.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:13.320+0000 7ff8dbe00640 1 -- 172.21.15.37:0/1298243971 shutdown_connections 2024-09-11T23:09:13.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:13.320+0000 7ff8dbe00640 1 -- 172.21.15.37:0/1298243971 wait complete. 2024-09-11T23:09:13.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:13.321+0000 7ff8dbe00640 1 Processor -- start 2024-09-11T23:09:13.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:13.321+0000 7ff8dbe00640 1 -- start start 2024-09-11T23:09:13.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:13.321+0000 7ff8dbe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8d4107660 0x7ff8d4199340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:09:13.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:13.321+0000 7ff8dbe00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff8d410bc90 con 0x7ff8d4107660 2024-09-11T23:09:13.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:13.321+0000 7ff8d9400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8d4107660 0x7ff8d4199340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:09:13.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:13.321+0000 7ff8d9400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8d4107660 0x7ff8d4199340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48254/0 (socket says 172.21.15.37:48254) 2024-09-11T23:09:13.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:13.321+0000 7ff8d9400640 1 -- 172.21.15.37:0/1827808932 learned_addr learned my addr 172.21.15.37:0/1827808932 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:09:13.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:13.322+0000 7ff8d9400640 1 -- 172.21.15.37:0/1827808932 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8d4199880 con 0x7ff8d4107660 2024-09-11T23:09:13.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:13.322+0000 7ff8d9400640 1 --2- 172.21.15.37:0/1827808932 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8d4107660 0x7ff8d4199340 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff8c8009230 tx=0x7ff8c8003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:09:13.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:13.322+0000 7ff8d2000640 1 -- 172.21.15.37:0/1827808932 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff8c803f070 con 0x7ff8d4107660 2024-09-11T23:09:13.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:13.322+0000 7ff8d2000640 1 -- 172.21.15.37:0/1827808932 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff8c803bc80 con 0x7ff8d4107660 2024-09-11T23:09:13.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:13.322+0000 7ff8d2000640 1 -- 172.21.15.37:0/1827808932 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff8c8035030 con 0x7ff8d4107660 2024-09-11T23:09:13.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:13.323+0000 7ff8dbe00640 1 -- 172.21.15.37:0/1827808932 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8d4199b10 con 0x7ff8d4107660 2024-09-11T23:09:13.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:13.323+0000 7ff8dbe00640 1 -- 172.21.15.37:0/1827808932 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8d419dc10 con 0x7ff8d4107660 2024-09-11T23:09:13.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:13.324+0000 7ff8d2000640 1 -- 172.21.15.37:0/1827808932 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7ff8c8042070 con 0x7ff8d4107660 2024-09-11T23:09:13.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:13.324+0000 7ff8c7400640 1 -- 172.21.15.37:0/1827808932 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8d4102cd0 con 0x7ff8d4107660 2024-09-11T23:09:13.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:13.324+0000 7ff8d2000640 1 --2- 172.21.15.37:0/1827808932 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7ff8bc0390c0 0x7ff8bc03b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:09:13.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:13.324+0000 7ff8d2000640 1 -- 172.21.15.37:0/1827808932 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7ff8c806cd60 con 0x7ff8d4107660 2024-09-11T23:09:13.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:13.325+0000 7ff8d8a00640 1 --2- 172.21.15.37:0/1827808932 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7ff8bc0390c0 0x7ff8bc03b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:09:13.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:13.325+0000 7ff8d8a00640 1 --2- 172.21.15.37:0/1827808932 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7ff8bc0390c0 0x7ff8bc03b580 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff8c00098c0 tx=0x7ff8c0006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:09:13.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:13.329+0000 7ff8d2000640 1 -- 172.21.15.37:0/1827808932 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff8c80372d0 con 0x7ff8d4107660 2024-09-11T23:09:13.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:13.518+0000 7ff8c7400640 1 -- 172.21.15.37:0/1827808932 --> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff8d4107ac0 con 0x7ff8bc0390c0 2024-09-11T23:09:13.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:13.520+0000 7ff8d2000640 1 -- 172.21.15.37:0/1827808932 <== mgr.14150 v2:172.21.15.37:6800/31543269 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+160 (secure 0 0 0) 0x7ff8d4107ac0 con 0x7ff8bc0390c0 2024-09-11T23:09:13.520 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:09:13.520 INFO:teuthology.orchestra.run.smithi037.stdout:[{"addr": "172.21.15.37", "hostname": "smithi037", "labels": [], "status": ""}, {"addr": "172.21.15.123", "hostname": "smithi123", "labels": [], "status": ""}] 2024-09-11T23:09:13.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:13.522+0000 7ff8c7400640 1 -- 172.21.15.37:0/1827808932 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7ff8bc0390c0 msgr2=0x7ff8bc03b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:09:13.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:13.522+0000 7ff8c7400640 1 --2- 172.21.15.37:0/1827808932 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7ff8bc0390c0 0x7ff8bc03b580 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff8c00098c0 tx=0x7ff8c0006db0 comp rx=0 tx=0).stop 2024-09-11T23:09:13.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:13.522+0000 7ff8c7400640 1 -- 172.21.15.37:0/1827808932 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8d4107660 msgr2=0x7ff8d4199340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:09:13.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:13.522+0000 7ff8c7400640 1 --2- 172.21.15.37:0/1827808932 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8d4107660 0x7ff8d4199340 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff8c8009230 tx=0x7ff8c8003d40 comp rx=0 tx=0).stop 2024-09-11T23:09:13.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:13.522+0000 7ff8c7400640 1 -- 172.21.15.37:0/1827808932 shutdown_connections 2024-09-11T23:09:13.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:13.522+0000 7ff8c7400640 1 --2- 172.21.15.37:0/1827808932 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7ff8bc0390c0 0x7ff8bc03b580 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:09:13.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:13.522+0000 7ff8c7400640 1 --2- 172.21.15.37:0/1827808932 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8d4107660 0x7ff8d4199340 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:09:13.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:13.522+0000 7ff8c7400640 1 -- 172.21.15.37:0/1827808932 >> 172.21.15.37:0/1827808932 conn(0x7ff8d40fd290 msgr2=0x7ff8d4075e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:09:13.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:13.522+0000 7ff8c7400640 1 -- 172.21.15.37:0/1827808932 shutdown_connections 2024-09-11T23:09:13.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:13.522+0000 7ff8c7400640 1 -- 172.21.15.37:0/1827808932 wait complete. 2024-09-11T23:09:14.156 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:13 smithi037 ceph-mon[30630]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:09:14.156 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:13 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:14.196 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi160 2024-09-11T23:09:14.196 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-11T23:09:14.196 DEBUG:teuthology.orchestra.run.smithi160:> dd of=/etc/ceph/ceph.conf 2024-09-11T23:09:14.215 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-11T23:09:14.216 DEBUG:teuthology.orchestra.run.smithi160:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-11T23:09:14.274 INFO:tasks.cephadm:Adding host smithi160 to orchestrator... 2024-09-11T23:09:14.274 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph orch host add smithi160 2024-09-11T23:09:14.641 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:09:15.034 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:14 smithi037 ceph-mon[30630]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T23:09:15.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:15.149+0000 7fdf6f400640 1 -- 172.21.15.37:0/2460608861 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf68107660 msgr2=0x7fdf68107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:09:15.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:15.149+0000 7fdf6f400640 1 --2- 172.21.15.37:0/2460608861 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf68107660 0x7fdf68107a40 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fdf5c009880 tx=0x7fdf5c02a5d0 comp rx=0 tx=0).stop 2024-09-11T23:09:15.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:15.149+0000 7fdf6f400640 1 -- 172.21.15.37:0/2460608861 shutdown_connections 2024-09-11T23:09:15.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:15.149+0000 7fdf6f400640 1 --2- 172.21.15.37:0/2460608861 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf68107660 0x7fdf68107a40 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:09:15.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:15.149+0000 7fdf6f400640 1 -- 172.21.15.37:0/2460608861 >> 172.21.15.37:0/2460608861 conn(0x7fdf680fd290 msgr2=0x7fdf680ff6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:09:15.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:15.149+0000 7fdf6f400640 1 -- 172.21.15.37:0/2460608861 shutdown_connections 2024-09-11T23:09:15.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:15.149+0000 7fdf6f400640 1 -- 172.21.15.37:0/2460608861 wait complete. 2024-09-11T23:09:15.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:15.150+0000 7fdf6f400640 1 Processor -- start 2024-09-11T23:09:15.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:15.150+0000 7fdf6f400640 1 -- start start 2024-09-11T23:09:15.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:15.150+0000 7fdf6f400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf68107660 0x7fdf680744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:09:15.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:15.150+0000 7fdf6f400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fdf6810bc90 con 0x7fdf68107660 2024-09-11T23:09:15.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:15.151+0000 7fdf6ca00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf68107660 0x7fdf680744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:09:15.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:15.151+0000 7fdf6ca00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf68107660 0x7fdf680744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48270/0 (socket says 172.21.15.37:48270) 2024-09-11T23:09:15.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:15.151+0000 7fdf6ca00640 1 -- 172.21.15.37:0/1360182257 learned_addr learned my addr 172.21.15.37:0/1360182257 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:09:15.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:15.151+0000 7fdf6ca00640 1 -- 172.21.15.37:0/1360182257 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf680763e0 con 0x7fdf68107660 2024-09-11T23:09:15.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:15.151+0000 7fdf6ca00640 1 --2- 172.21.15.37:0/1360182257 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf68107660 0x7fdf680744f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fdf5c009230 tx=0x7fdf5c003d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:09:15.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:15.152+0000 7fdf65600640 1 -- 172.21.15.37:0/1360182257 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdf5c03f070 con 0x7fdf68107660 2024-09-11T23:09:15.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:15.152+0000 7fdf65600640 1 -- 172.21.15.37:0/1360182257 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdf5c03bd40 con 0x7fdf68107660 2024-09-11T23:09:15.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:15.152+0000 7fdf65600640 1 -- 172.21.15.37:0/1360182257 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdf5c035030 con 0x7fdf68107660 2024-09-11T23:09:15.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:15.152+0000 7fdf6f400640 1 -- 172.21.15.37:0/1360182257 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf68074a30 con 0x7fdf68107660 2024-09-11T23:09:15.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:15.152+0000 7fdf6f400640 1 -- 172.21.15.37:0/1360182257 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf68074ef0 con 0x7fdf68107660 2024-09-11T23:09:15.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:15.153+0000 7fdf65600640 1 -- 172.21.15.37:0/1360182257 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fdf5c042070 con 0x7fdf68107660 2024-09-11T23:09:15.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:15.153+0000 7fdf6f400640 1 -- 172.21.15.37:0/1360182257 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf68102cd0 con 0x7fdf68107660 2024-09-11T23:09:15.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:15.153+0000 7fdf65600640 1 --2- 172.21.15.37:0/1360182257 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fdf500390c0 0x7fdf5003b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:09:15.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:15.153+0000 7fdf65600640 1 -- 172.21.15.37:0/1360182257 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fdf5c06ccd0 con 0x7fdf68107660 2024-09-11T23:09:15.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:15.154+0000 7fdf67e00640 1 --2- 172.21.15.37:0/1360182257 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fdf500390c0 0x7fdf5003b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:09:15.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:15.154+0000 7fdf67e00640 1 --2- 172.21.15.37:0/1360182257 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fdf500390c0 0x7fdf5003b580 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fdf540098c0 tx=0x7fdf54006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:09:15.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:15.158+0000 7fdf65600640 1 -- 172.21.15.37:0/1360182257 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdf5c0412c0 con 0x7fdf68107660 2024-09-11T23:09:15.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:15.349+0000 7fdf6f400640 1 -- 172.21.15.37:0/1360182257 --> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi160", "target": ["mon-mgr", ""]}) -- 0x7fdf68075a90 con 0x7fdf500390c0 2024-09-11T23:09:16.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:15 smithi037 ceph-mon[30630]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:09:16.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:15 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:16.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:15 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:16.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:15 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:16.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:15 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:16.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:15 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi123", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:09:16.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:15 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:09:16.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:15 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:09:17.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:16 smithi037 ceph-mon[30630]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi160", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:09:17.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:16 smithi037 ceph-mon[30630]: Updating smithi123:/etc/ceph/ceph.conf 2024-09-11T23:09:17.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:16 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:17.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:16 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:17.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:16 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:18.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:17 smithi037 ceph-mon[30630]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:09:18.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:17 smithi037 ceph-mon[30630]: Updating smithi123:/var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T23:09:18.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:17 smithi037 ceph-mon[30630]: Updating smithi123:/etc/ceph/ceph.client.admin.keyring 2024-09-11T23:09:18.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:17 smithi037 ceph-mon[30630]: Updating smithi123:/var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-11T23:09:18.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:17 smithi037 ceph-mon[30630]: Deploying cephadm binary to smithi160 2024-09-11T23:09:19.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:19.225+0000 7fdf65600640 1 -- 172.21.15.37:0/1360182257 <== mgr.14150 v2:172.21.15.37:6800/31543269 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7fdf68075a90 con 0x7fdf500390c0 2024-09-11T23:09:19.226 INFO:teuthology.orchestra.run.smithi037.stdout:Added host 'smithi160' with addr '172.21.15.160' 2024-09-11T23:09:19.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:19.228+0000 7fdf6f400640 1 -- 172.21.15.37:0/1360182257 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fdf500390c0 msgr2=0x7fdf5003b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:09:19.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:19.228+0000 7fdf6f400640 1 --2- 172.21.15.37:0/1360182257 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fdf500390c0 0x7fdf5003b580 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fdf540098c0 tx=0x7fdf54006db0 comp rx=0 tx=0).stop 2024-09-11T23:09:19.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:19.228+0000 7fdf6f400640 1 -- 172.21.15.37:0/1360182257 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf68107660 msgr2=0x7fdf680744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:09:19.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:19.228+0000 7fdf6f400640 1 --2- 172.21.15.37:0/1360182257 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf68107660 0x7fdf680744f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fdf5c009230 tx=0x7fdf5c003d80 comp rx=0 tx=0).stop 2024-09-11T23:09:19.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:19.228+0000 7fdf6f400640 1 -- 172.21.15.37:0/1360182257 shutdown_connections 2024-09-11T23:09:19.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:19.228+0000 7fdf6f400640 1 --2- 172.21.15.37:0/1360182257 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fdf500390c0 0x7fdf5003b580 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:09:19.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:19.228+0000 7fdf6f400640 1 --2- 172.21.15.37:0/1360182257 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf68107660 0x7fdf680744f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:09:19.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:19.228+0000 7fdf6f400640 1 -- 172.21.15.37:0/1360182257 >> 172.21.15.37:0/1360182257 conn(0x7fdf680fd290 msgr2=0x7fdf680feb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:09:19.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:19.228+0000 7fdf6f400640 1 -- 172.21.15.37:0/1360182257 shutdown_connections 2024-09-11T23:09:19.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:19.228+0000 7fdf6f400640 1 -- 172.21.15.37:0/1360182257 wait complete. 2024-09-11T23:09:19.985 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph orch host ls --format=json 2024-09-11T23:09:20.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:19 smithi037 ceph-mon[30630]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:09:20.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:19 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:20.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:19 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:09:20.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:19 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:20.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:19 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:20.349 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:09:20.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:20.878+0000 7f56c1800640 1 -- 172.21.15.37:0/1817571064 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56bc107660 msgr2=0x7f56bc107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:09:20.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:20.878+0000 7f56c1800640 1 --2- 172.21.15.37:0/1817571064 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56bc107660 0x7f56bc107a40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f56ac009880 tx=0x7f56ac02a5d0 comp rx=0 tx=0).stop 2024-09-11T23:09:20.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:20.878+0000 7f56c1800640 1 -- 172.21.15.37:0/1817571064 shutdown_connections 2024-09-11T23:09:20.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:20.878+0000 7f56c1800640 1 --2- 172.21.15.37:0/1817571064 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56bc107660 0x7f56bc107a40 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:09:20.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:20.878+0000 7f56c1800640 1 -- 172.21.15.37:0/1817571064 >> 172.21.15.37:0/1817571064 conn(0x7f56bc0fd290 msgr2=0x7f56bc0ff6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:09:20.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:20.878+0000 7f56c1800640 1 -- 172.21.15.37:0/1817571064 shutdown_connections 2024-09-11T23:09:20.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:20.879+0000 7f56c1800640 1 -- 172.21.15.37:0/1817571064 wait complete. 2024-09-11T23:09:20.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:20.879+0000 7f56c1800640 1 Processor -- start 2024-09-11T23:09:20.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:20.880+0000 7f56c1800640 1 -- start start 2024-09-11T23:09:20.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:20.880+0000 7f56c1800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56bc107660 0x7f56bc199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:09:20.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:20.880+0000 7f56c1800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f56bc10bc90 con 0x7f56bc107660 2024-09-11T23:09:20.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:20.880+0000 7f56baa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56bc107660 0x7f56bc199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:09:20.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:20.880+0000 7f56baa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56bc107660 0x7f56bc199350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52100/0 (socket says 172.21.15.37:52100) 2024-09-11T23:09:20.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:20.880+0000 7f56baa00640 1 -- 172.21.15.37:0/2381206524 learned_addr learned my addr 172.21.15.37:0/2381206524 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:09:20.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:20.881+0000 7f56baa00640 1 -- 172.21.15.37:0/2381206524 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56bc199890 con 0x7f56bc107660 2024-09-11T23:09:20.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:20.881+0000 7f56baa00640 1 --2- 172.21.15.37:0/2381206524 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56bc107660 0x7f56bc199350 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f56ac009230 tx=0x7f56ac003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:09:20.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:20.881+0000 7f56b3400640 1 -- 172.21.15.37:0/2381206524 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56ac03f070 con 0x7f56bc107660 2024-09-11T23:09:20.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:20.881+0000 7f56b3400640 1 -- 172.21.15.37:0/2381206524 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f56ac03bc80 con 0x7f56bc107660 2024-09-11T23:09:20.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:20.881+0000 7f56b3400640 1 -- 172.21.15.37:0/2381206524 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56ac035030 con 0x7f56bc107660 2024-09-11T23:09:20.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:20.881+0000 7f56c1800640 1 -- 172.21.15.37:0/2381206524 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56bc199b20 con 0x7f56bc107660 2024-09-11T23:09:20.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:20.881+0000 7f56c1800640 1 -- 172.21.15.37:0/2381206524 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56bc19dc20 con 0x7f56bc107660 2024-09-11T23:09:20.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:20.883+0000 7f56b3400640 1 -- 172.21.15.37:0/2381206524 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f56ac042070 con 0x7f56bc107660 2024-09-11T23:09:20.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:20.883+0000 7f56c1800640 1 -- 172.21.15.37:0/2381206524 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56bc102cd0 con 0x7f56bc107660 2024-09-11T23:09:20.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:20.883+0000 7f56b3400640 1 --2- 172.21.15.37:0/2381206524 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f56a0039060 0x7f56a003b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:09:20.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:20.883+0000 7f56b3400640 1 -- 172.21.15.37:0/2381206524 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f56ac06cda0 con 0x7f56bc107660 2024-09-11T23:09:20.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:20.884+0000 7f56b3e00640 1 --2- 172.21.15.37:0/2381206524 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f56a0039060 0x7f56a003b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:09:20.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:20.884+0000 7f56b3e00640 1 --2- 172.21.15.37:0/2381206524 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f56a0039060 0x7f56a003b520 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f56a40098c0 tx=0x7f56a4006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:09:20.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:20.888+0000 7f56b3400640 1 -- 172.21.15.37:0/2381206524 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f56ac031e20 con 0x7f56bc107660 2024-09-11T23:09:21.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:20 smithi037 ceph-mon[30630]: Added host smithi160 2024-09-11T23:09:21.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:20 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:21.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:21.084+0000 7f56c1800640 1 -- 172.21.15.37:0/2381206524 --> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f56bc19a6b0 con 0x7f56a0039060 2024-09-11T23:09:21.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:21.085+0000 7f56b3400640 1 -- 172.21.15.37:0/2381206524 <== mgr.14150 v2:172.21.15.37:6800/31543269 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+240 (secure 0 0 0) 0x7f56bc19a6b0 con 0x7f56a0039060 2024-09-11T23:09:21.085 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:09:21.085 INFO:teuthology.orchestra.run.smithi037.stdout:[{"addr": "172.21.15.37", "hostname": "smithi037", "labels": [], "status": ""}, {"addr": "172.21.15.123", "hostname": "smithi123", "labels": [], "status": ""}, {"addr": "172.21.15.160", "hostname": "smithi160", "labels": [], "status": ""}] 2024-09-11T23:09:21.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:21.087+0000 7f56c1800640 1 -- 172.21.15.37:0/2381206524 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f56a0039060 msgr2=0x7f56a003b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:09:21.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:21.087+0000 7f56c1800640 1 --2- 172.21.15.37:0/2381206524 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f56a0039060 0x7f56a003b520 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f56a40098c0 tx=0x7f56a4006db0 comp rx=0 tx=0).stop 2024-09-11T23:09:21.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:21.087+0000 7f56c1800640 1 -- 172.21.15.37:0/2381206524 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56bc107660 msgr2=0x7f56bc199350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:09:21.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:21.087+0000 7f56c1800640 1 --2- 172.21.15.37:0/2381206524 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56bc107660 0x7f56bc199350 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f56ac009230 tx=0x7f56ac003d40 comp rx=0 tx=0).stop 2024-09-11T23:09:21.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:21.087+0000 7f56c1800640 1 -- 172.21.15.37:0/2381206524 shutdown_connections 2024-09-11T23:09:21.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:21.087+0000 7f56c1800640 1 --2- 172.21.15.37:0/2381206524 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f56a0039060 0x7f56a003b520 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:09:21.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:21.087+0000 7f56c1800640 1 --2- 172.21.15.37:0/2381206524 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56bc107660 0x7f56bc199350 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:09:21.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:21.087+0000 7f56c1800640 1 -- 172.21.15.37:0/2381206524 >> 172.21.15.37:0/2381206524 conn(0x7f56bc0fd290 msgr2=0x7f56bc075e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:09:21.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:21.088+0000 7f56c1800640 1 -- 172.21.15.37:0/2381206524 shutdown_connections 2024-09-11T23:09:21.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:21.088+0000 7f56c1800640 1 -- 172.21.15.37:0/2381206524 wait complete. 2024-09-11T23:09:21.748 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-11T23:09:21.748 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph osd crush tunables default 2024-09-11T23:09:22.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:21 smithi037 ceph-mon[30630]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:09:22.112 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:09:22.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:22.585+0000 7f296d400640 1 -- 172.21.15.37:0/846124755 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2968107660 msgr2=0x7f2968107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:09:22.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:22.585+0000 7f296d400640 1 --2- 172.21.15.37:0/846124755 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2968107660 0x7f2968107a40 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2958009880 tx=0x7f295802a5d0 comp rx=0 tx=0).stop 2024-09-11T23:09:22.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:22.586+0000 7f296d400640 1 -- 172.21.15.37:0/846124755 shutdown_connections 2024-09-11T23:09:22.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:22.586+0000 7f296d400640 1 --2- 172.21.15.37:0/846124755 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2968107660 0x7f2968107a40 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:09:22.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:22.586+0000 7f296d400640 1 -- 172.21.15.37:0/846124755 >> 172.21.15.37:0/846124755 conn(0x7f29680fd290 msgr2=0x7f29680ff6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:09:22.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:22.586+0000 7f296d400640 1 -- 172.21.15.37:0/846124755 shutdown_connections 2024-09-11T23:09:22.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:22.586+0000 7f296d400640 1 -- 172.21.15.37:0/846124755 wait complete. 2024-09-11T23:09:22.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:22.587+0000 7f296d400640 1 Processor -- start 2024-09-11T23:09:22.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:22.587+0000 7f296d400640 1 -- start start 2024-09-11T23:09:22.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:22.587+0000 7f296d400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2968107660 0x7f2968197130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:09:22.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:22.587+0000 7f296d400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f296810bc90 con 0x7f2968107660 2024-09-11T23:09:22.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:22.587+0000 7f2966800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2968107660 0x7f2968197130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:09:22.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:22.587+0000 7f2966800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2968107660 0x7f2968197130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52126/0 (socket says 172.21.15.37:52126) 2024-09-11T23:09:22.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:22.587+0000 7f2966800640 1 -- 172.21.15.37:0/928772461 learned_addr learned my addr 172.21.15.37:0/928772461 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:09:22.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:22.588+0000 7f2966800640 1 -- 172.21.15.37:0/928772461 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2968197670 con 0x7f2968107660 2024-09-11T23:09:22.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:22.588+0000 7f2966800640 1 --2- 172.21.15.37:0/928772461 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2968107660 0x7f2968197130 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2958009230 tx=0x7f2958003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:09:22.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:22.588+0000 7f295f400640 1 -- 172.21.15.37:0/928772461 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f295803f070 con 0x7f2968107660 2024-09-11T23:09:22.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:22.588+0000 7f295f400640 1 -- 172.21.15.37:0/928772461 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f295803bc80 con 0x7f2968107660 2024-09-11T23:09:22.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:22.588+0000 7f296d400640 1 -- 172.21.15.37:0/928772461 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2968197900 con 0x7f2968107660 2024-09-11T23:09:22.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:22.588+0000 7f295f400640 1 -- 172.21.15.37:0/928772461 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2958035030 con 0x7f2968107660 2024-09-11T23:09:22.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:22.589+0000 7f296d400640 1 -- 172.21.15.37:0/928772461 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f296819ba00 con 0x7f2968107660 2024-09-11T23:09:22.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:22.590+0000 7f296d400640 1 -- 172.21.15.37:0/928772461 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2968102cd0 con 0x7f2968107660 2024-09-11T23:09:22.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:22.590+0000 7f295f400640 1 -- 172.21.15.37:0/928772461 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f2958042070 con 0x7f2968107660 2024-09-11T23:09:22.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:22.590+0000 7f295f400640 1 --2- 172.21.15.37:0/928772461 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f294c039060 0x7f294c03b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:09:22.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:22.590+0000 7f295f400640 1 -- 172.21.15.37:0/928772461 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f295806cda0 con 0x7f2968107660 2024-09-11T23:09:22.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:22.590+0000 7f2965e00640 1 --2- 172.21.15.37:0/928772461 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f294c039060 0x7f294c03b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:09:22.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:22.591+0000 7f2965e00640 1 --2- 172.21.15.37:0/928772461 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f294c039060 0x7f294c03b520 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f29540098c0 tx=0x7f2954006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:09:22.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:22.595+0000 7f295f400640 1 -- 172.21.15.37:0/928772461 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2958031e20 con 0x7f2968107660 2024-09-11T23:09:22.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:22.783+0000 7f296d400640 1 -- 172.21.15.37:0/928772461 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f2968198490 con 0x7f2968107660 2024-09-11T23:09:22.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:22.904+0000 7f295f400640 1 -- 172.21.15.37:0/928772461 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7f29580372d0 con 0x7f2968107660 2024-09-11T23:09:22.905 INFO:teuthology.orchestra.run.smithi037.stderr:adjusted tunables profile to default 2024-09-11T23:09:22.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:22.907+0000 7f296d400640 1 -- 172.21.15.37:0/928772461 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f294c039060 msgr2=0x7f294c03b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:09:22.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:22.907+0000 7f296d400640 1 --2- 172.21.15.37:0/928772461 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f294c039060 0x7f294c03b520 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f29540098c0 tx=0x7f2954006db0 comp rx=0 tx=0).stop 2024-09-11T23:09:22.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:22.907+0000 7f296d400640 1 -- 172.21.15.37:0/928772461 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2968107660 msgr2=0x7f2968197130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:09:22.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:22.907+0000 7f296d400640 1 --2- 172.21.15.37:0/928772461 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2968107660 0x7f2968197130 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2958009230 tx=0x7f2958003d40 comp rx=0 tx=0).stop 2024-09-11T23:09:22.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:22.907+0000 7f296d400640 1 -- 172.21.15.37:0/928772461 shutdown_connections 2024-09-11T23:09:22.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:22.907+0000 7f296d400640 1 --2- 172.21.15.37:0/928772461 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f294c039060 0x7f294c03b520 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:09:22.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:22.907+0000 7f296d400640 1 --2- 172.21.15.37:0/928772461 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2968107660 0x7f2968197130 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:09:22.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:22.907+0000 7f296d400640 1 -- 172.21.15.37:0/928772461 >> 172.21.15.37:0/928772461 conn(0x7f29680fd290 msgr2=0x7f29680feb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:09:22.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:22.907+0000 7f296d400640 1 -- 172.21.15.37:0/928772461 shutdown_connections 2024-09-11T23:09:22.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:22.907+0000 7f296d400640 1 -- 172.21.15.37:0/928772461 wait complete. 2024-09-11T23:09:23.167 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:22 smithi037 ceph-mon[30630]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T23:09:23.167 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:22 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/928772461' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-11T23:09:23.908 INFO:tasks.cephadm:Adding mon.a on smithi037 2024-09-11T23:09:23.909 INFO:tasks.cephadm:Adding mon.b on smithi123 2024-09-11T23:09:23.909 INFO:tasks.cephadm:Adding mon.c on smithi160 2024-09-11T23:09:23.909 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph orch apply mon '3;smithi037:172.21.15.37=a;smithi123:172.21.15.123=b;smithi160:172.21.15.160=c' 2024-09-11T23:09:24.155 INFO:teuthology.orchestra.run.smithi160.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T23:09:24.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:23 smithi037 ceph-mon[30630]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:09:24.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:23 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/928772461' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-11T23:09:24.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:23 smithi037 ceph-mon[30630]: osdmap e4: 0 total, 0 up, 0 in 2024-09-11T23:09:24.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:23 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:24.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:23 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:24.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:23 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:24.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:23 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:24.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:23 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi160", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:09:24.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:23 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:09:24.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:23 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:09:24.559 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:24.557+0000 7f2995922640 1 -- 172.21.15.160:0/3432030376 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2990107660 msgr2=0x7f2990107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:09:24.559 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:24.557+0000 7f2995922640 1 --2- 172.21.15.160:0/3432030376 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2990107660 0x7f2990107a40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2980009880 tx=0x7f298002a5d0 comp rx=0 tx=0).stop 2024-09-11T23:09:24.559 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:24.557+0000 7f2995922640 1 -- 172.21.15.160:0/3432030376 shutdown_connections 2024-09-11T23:09:24.559 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:24.557+0000 7f2995922640 1 --2- 172.21.15.160:0/3432030376 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2990107660 0x7f2990107a40 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:09:24.559 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:24.557+0000 7f2995922640 1 -- 172.21.15.160:0/3432030376 >> 172.21.15.160:0/3432030376 conn(0x7f29900fd270 msgr2=0x7f29900ff690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:09:24.559 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:24.557+0000 7f2995922640 1 -- 172.21.15.160:0/3432030376 shutdown_connections 2024-09-11T23:09:24.559 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:24.557+0000 7f2995922640 1 -- 172.21.15.160:0/3432030376 wait complete. 2024-09-11T23:09:24.560 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:24.558+0000 7f2995922640 1 Processor -- start 2024-09-11T23:09:24.560 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:24.558+0000 7f2995922640 1 -- start start 2024-09-11T23:09:24.560 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:24.558+0000 7f2995922640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2990107660 0x7f2990197130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:09:24.560 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:24.559+0000 7f2995922640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f299010bc90 con 0x7f2990107660 2024-09-11T23:09:24.560 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:24.559+0000 7f298effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2990107660 0x7f2990197130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:09:24.561 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:24.559+0000 7f298effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2990107660 0x7f2990197130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.160:34782/0 (socket says 172.21.15.160:34782) 2024-09-11T23:09:24.561 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:24.559+0000 7f298effd640 1 -- 172.21.15.160:0/592123064 learned_addr learned my addr 172.21.15.160:0/592123064 (peer_addr_for_me v2:172.21.15.160:0/0) 2024-09-11T23:09:24.561 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:24.559+0000 7f298effd640 1 -- 172.21.15.160:0/592123064 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2990197670 con 0x7f2990107660 2024-09-11T23:09:24.561 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:24.559+0000 7f298effd640 1 --2- 172.21.15.160:0/592123064 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2990107660 0x7f2990197130 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2980009230 tx=0x7f2980003d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:09:24.562 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:24.560+0000 7f2994920640 1 -- 172.21.15.160:0/592123064 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f298003f070 con 0x7f2990107660 2024-09-11T23:09:24.562 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:24.560+0000 7f2995922640 1 -- 172.21.15.160:0/592123064 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2990197900 con 0x7f2990107660 2024-09-11T23:09:24.562 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:24.560+0000 7f2994920640 1 -- 172.21.15.160:0/592123064 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f298003bd40 con 0x7f2990107660 2024-09-11T23:09:24.562 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:24.560+0000 7f2994920640 1 -- 172.21.15.160:0/592123064 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2980035030 con 0x7f2990107660 2024-09-11T23:09:24.562 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:24.560+0000 7f2995922640 1 -- 172.21.15.160:0/592123064 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f299019ba00 con 0x7f2990107660 2024-09-11T23:09:24.563 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:24.561+0000 7f2994920640 1 -- 172.21.15.160:0/592123064 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f2980042070 con 0x7f2990107660 2024-09-11T23:09:24.563 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:24.561+0000 7f2995922640 1 -- 172.21.15.160:0/592123064 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2990102cd0 con 0x7f2990107660 2024-09-11T23:09:24.563 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:24.561+0000 7f2994920640 1 --2- 172.21.15.160:0/592123064 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f2978039060 0x7f297803b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:09:24.563 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:24.561+0000 7f2994920640 1 -- 172.21.15.160:0/592123064 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f298006cc40 con 0x7f2990107660 2024-09-11T23:09:24.563 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:24.561+0000 7f298e7fc640 1 --2- 172.21.15.160:0/592123064 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f2978039060 0x7f297803b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:09:24.563 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:24.562+0000 7f298e7fc640 1 --2- 172.21.15.160:0/592123064 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f2978039060 0x7f297803b520 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f29840098c0 tx=0x7f2984006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:09:24.567 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:24.566+0000 7f2994920640 1 -- 172.21.15.160:0/592123064 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2980036df0 con 0x7f2990107660 2024-09-11T23:09:24.749 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:24.748+0000 7f2995922640 1 -- 172.21.15.160:0/592123064 --> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi037:172.21.15.37=a;smithi123:172.21.15.123=b;smithi160:172.21.15.160=c", "target": ["mon-mgr", ""]}) -- 0x7f2990198490 con 0x7f2978039060 2024-09-11T23:09:24.755 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:24.754+0000 7f2994920640 1 -- 172.21.15.160:0/592123064 <== mgr.14150 v2:172.21.15.37:6800/31543269 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f2990198490 con 0x7f2978039060 2024-09-11T23:09:24.755 INFO:teuthology.orchestra.run.smithi160.stdout:Scheduled mon update... 2024-09-11T23:09:24.757 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:24.756+0000 7f2995922640 1 -- 172.21.15.160:0/592123064 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f2978039060 msgr2=0x7f297803b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:09:24.757 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:24.756+0000 7f2995922640 1 --2- 172.21.15.160:0/592123064 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f2978039060 0x7f297803b520 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f29840098c0 tx=0x7f2984006db0 comp rx=0 tx=0).stop 2024-09-11T23:09:24.757 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:24.756+0000 7f2995922640 1 -- 172.21.15.160:0/592123064 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2990107660 msgr2=0x7f2990197130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:09:24.758 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:24.756+0000 7f2995922640 1 --2- 172.21.15.160:0/592123064 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2990107660 0x7f2990197130 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2980009230 tx=0x7f2980003d80 comp rx=0 tx=0).stop 2024-09-11T23:09:24.758 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:24.756+0000 7f2995922640 1 -- 172.21.15.160:0/592123064 shutdown_connections 2024-09-11T23:09:24.758 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:24.756+0000 7f2995922640 1 --2- 172.21.15.160:0/592123064 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f2978039060 0x7f297803b520 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:09:24.758 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:24.756+0000 7f2995922640 1 --2- 172.21.15.160:0/592123064 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2990107660 0x7f2990197130 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:09:24.758 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:24.756+0000 7f2995922640 1 -- 172.21.15.160:0/592123064 >> 172.21.15.160:0/592123064 conn(0x7f29900fd270 msgr2=0x7f29900feb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:09:24.758 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:24.756+0000 7f2995922640 1 -- 172.21.15.160:0/592123064 shutdown_connections 2024-09-11T23:09:24.758 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:24.756+0000 7f2995922640 1 -- 172.21.15.160:0/592123064 wait complete. 2024-09-11T23:09:25.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:24 smithi037 ceph-mon[30630]: Updating smithi160:/etc/ceph/ceph.conf 2024-09-11T23:09:25.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:24 smithi037 ceph-mon[30630]: Updating smithi160:/var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T23:09:25.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:24 smithi037 ceph-mon[30630]: Updating smithi160:/etc/ceph/ceph.client.admin.keyring 2024-09-11T23:09:25.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:24 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:25.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:24 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:25.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:24 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:25.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:24 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:25.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:24 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:09:25.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:24 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:09:25.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:24 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:09:25.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:24 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:25.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:24 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-11T23:09:25.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:24 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:09:25.333 DEBUG:teuthology.orchestra.run.smithi123:mon.b> sudo journalctl -f -n 0 -u ceph-8b03efce-7092-11ef-bcea-c7b262605968@mon.b.service 2024-09-11T23:09:25.336 DEBUG:teuthology.orchestra.run.smithi160:mon.c> sudo journalctl -f -n 0 -u ceph-8b03efce-7092-11ef-bcea-c7b262605968@mon.c.service 2024-09-11T23:09:25.339 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-11T23:09:25.339 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-11T23:09:26.303 INFO:teuthology.orchestra.run.smithi160.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T23:09:26.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:25 smithi037 ceph-mon[30630]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:09:26.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:25 smithi037 ceph-mon[30630]: Updating smithi160:/var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-11T23:09:26.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:25 smithi037 ceph-mon[30630]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi037:172.21.15.37=a;smithi123:172.21.15.123=b;smithi160:172.21.15.160=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:09:26.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:25 smithi037 ceph-mon[30630]: Saving service mon spec with placement smithi037:172.21.15.37=a;smithi123:172.21.15.123=b;smithi160:172.21.15.160=c;count:3 2024-09-11T23:09:26.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:25 smithi037 ceph-mon[30630]: Deploying daemon mon.c on smithi160 2024-09-11T23:09:27.250 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:27.248+0000 7ffb1a600640 1 -- 172.21.15.160:0/3043301769 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb14106560 msgr2=0x7ffb14106940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:09:27.251 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:27.248+0000 7ffb1a600640 1 --2- 172.21.15.160:0/3043301769 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb14106560 0x7ffb14106940 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ffb04009880 tx=0x7ffb0402a5d0 comp rx=0 tx=0).stop 2024-09-11T23:09:27.251 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:27.248+0000 7ffb1a600640 1 -- 172.21.15.160:0/3043301769 shutdown_connections 2024-09-11T23:09:27.251 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:27.248+0000 7ffb1a600640 1 --2- 172.21.15.160:0/3043301769 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb14106560 0x7ffb14106940 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:09:27.251 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:27.248+0000 7ffb1a600640 1 -- 172.21.15.160:0/3043301769 >> 172.21.15.160:0/3043301769 conn(0x7ffb140fc1b0 msgr2=0x7ffb140fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:09:27.251 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:27.248+0000 7ffb1a600640 1 -- 172.21.15.160:0/3043301769 shutdown_connections 2024-09-11T23:09:27.251 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:27.248+0000 7ffb1a600640 1 -- 172.21.15.160:0/3043301769 wait complete. 2024-09-11T23:09:27.251 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:27.249+0000 7ffb1a600640 1 Processor -- start 2024-09-11T23:09:27.251 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:27.249+0000 7ffb1a600640 1 -- start start 2024-09-11T23:09:27.251 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:27.249+0000 7ffb1a600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb14106560 0x7ffb14197190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:09:27.251 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:27.249+0000 7ffb1a600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ffb1410ab90 con 0x7ffb14106560 2024-09-11T23:09:27.251 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:27.249+0000 7ffb13fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb14106560 0x7ffb14197190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:09:27.252 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:27.249+0000 7ffb13fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb14106560 0x7ffb14197190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.160:34808/0 (socket says 172.21.15.160:34808) 2024-09-11T23:09:27.252 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:27.249+0000 7ffb13fff640 1 -- 172.21.15.160:0/475147861 learned_addr learned my addr 172.21.15.160:0/475147861 (peer_addr_for_me v2:172.21.15.160:0/0) 2024-09-11T23:09:27.253 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:27.250+0000 7ffb13fff640 1 -- 172.21.15.160:0/475147861 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb141976d0 con 0x7ffb14106560 2024-09-11T23:09:27.253 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:27.250+0000 7ffb13fff640 1 --2- 172.21.15.160:0/475147861 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb14106560 0x7ffb14197190 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ffb04009230 tx=0x7ffb04003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:09:27.253 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:27.250+0000 7ffb117fa640 1 -- 172.21.15.160:0/475147861 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb0403f070 con 0x7ffb14106560 2024-09-11T23:09:27.253 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:27.250+0000 7ffb1a600640 1 -- 172.21.15.160:0/475147861 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb14197960 con 0x7ffb14106560 2024-09-11T23:09:27.253 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:27.250+0000 7ffb117fa640 1 -- 172.21.15.160:0/475147861 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffb0403bc80 con 0x7ffb14106560 2024-09-11T23:09:27.253 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:27.250+0000 7ffb117fa640 1 -- 172.21.15.160:0/475147861 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb04035030 con 0x7ffb14106560 2024-09-11T23:09:27.253 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:27.250+0000 7ffb1a600640 1 -- 172.21.15.160:0/475147861 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb14197dc0 con 0x7ffb14106560 2024-09-11T23:09:27.254 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:27.251+0000 7ffb1a600640 1 -- 172.21.15.160:0/475147861 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb14101bd0 con 0x7ffb14106560 2024-09-11T23:09:27.254 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:27.251+0000 7ffb117fa640 1 -- 172.21.15.160:0/475147861 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7ffb04042070 con 0x7ffb14106560 2024-09-11T23:09:27.254 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:27.252+0000 7ffb117fa640 1 --2- 172.21.15.160:0/475147861 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7ffafc039060 0x7ffafc03b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:09:27.254 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:27.252+0000 7ffb117fa640 1 -- 172.21.15.160:0/475147861 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7ffb0406cdf0 con 0x7ffb14106560 2024-09-11T23:09:27.254 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:27.252+0000 7ffb137fe640 1 --2- 172.21.15.160:0/475147861 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7ffafc039060 0x7ffafc03b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:09:27.254 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:27.252+0000 7ffb137fe640 1 --2- 172.21.15.160:0/475147861 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7ffafc039060 0x7ffafc03b520 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ffb080098c0 tx=0x7ffb08006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:09:27.258 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:27.257+0000 7ffb117fa640 1 -- 172.21.15.160:0/475147861 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ffb04031570 con 0x7ffb14106560 2024-09-11T23:09:27.494 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:27.493+0000 7ffb1a600640 1 -- 172.21.15.160:0/475147861 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7ffb141984f0 con 0x7ffb14106560 2024-09-11T23:09:27.495 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:27.494+0000 7ffb117fa640 1 -- 172.21.15.160:0/475147861 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+745 (secure 0 0 0) 0x7ffb040303a0 con 0x7ffb14106560 2024-09-11T23:09:27.495 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-11T23:09:27.495 INFO:teuthology.orchestra.run.smithi160.stdout:{"epoch":1,"fsid":"8b03efce-7092-11ef-bcea-c7b262605968","modified":"2024-09-11T23:07:45.034404Z","created":"2024-09-11T23:07:45.034404Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:3300","nonce":0},{"type":"v1","addr":"172.21.15.37:6789","nonce":0}]},"addr":"172.21.15.37:6789/0","public_addr":"172.21.15.37:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-11T23:09:27.495 INFO:teuthology.orchestra.run.smithi160.stderr:dumped monmap epoch 1 2024-09-11T23:09:27.497 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:27.496+0000 7ffb1a600640 1 -- 172.21.15.160:0/475147861 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7ffafc039060 msgr2=0x7ffafc03b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:09:27.497 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:27.496+0000 7ffb1a600640 1 --2- 172.21.15.160:0/475147861 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7ffafc039060 0x7ffafc03b520 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ffb080098c0 tx=0x7ffb08006db0 comp rx=0 tx=0).stop 2024-09-11T23:09:27.497 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:27.496+0000 7ffb1a600640 1 -- 172.21.15.160:0/475147861 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb14106560 msgr2=0x7ffb14197190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:09:27.497 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:27.496+0000 7ffb1a600640 1 --2- 172.21.15.160:0/475147861 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb14106560 0x7ffb14197190 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ffb04009230 tx=0x7ffb04003d40 comp rx=0 tx=0).stop 2024-09-11T23:09:27.497 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:27.496+0000 7ffb1a600640 1 -- 172.21.15.160:0/475147861 shutdown_connections 2024-09-11T23:09:27.497 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:27.496+0000 7ffb1a600640 1 --2- 172.21.15.160:0/475147861 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7ffafc039060 0x7ffafc03b520 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:09:27.497 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:27.496+0000 7ffb1a600640 1 --2- 172.21.15.160:0/475147861 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb14106560 0x7ffb14197190 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:09:27.497 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:27.496+0000 7ffb1a600640 1 -- 172.21.15.160:0/475147861 >> 172.21.15.160:0/475147861 conn(0x7ffb140fc1b0 msgr2=0x7ffb14069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:09:27.497 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:27.496+0000 7ffb1a600640 1 -- 172.21.15.160:0/475147861 shutdown_connections 2024-09-11T23:09:27.498 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:27.496+0000 7ffb1a600640 1 -- 172.21.15.160:0/475147861 wait complete. 2024-09-11T23:09:28.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:27 smithi037 ceph-mon[30630]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:09:28.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:27 smithi037 ceph-mon[30630]: from='client.? 172.21.15.160:0/475147861' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-11T23:09:29.278 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:29 smithi160 ceph-mon[35055]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-11T23:09:29.278 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:29 smithi160 bash[35036]: 4bff42e76a97bdd4362a4cd67d84cf01dfcaf503cbbc5c4c3b715750cb9f4b7c 2024-09-11T23:09:29.527 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-11T23:09:29.527 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-11T23:09:29.551 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:29 smithi160 systemd[1]: Started Ceph mon.c for 8b03efce-7092-11ef-bcea-c7b262605968. 2024-09-11T23:09:29.777 INFO:teuthology.orchestra.run.smithi160.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T23:09:34.593 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:34.591+0000 7f8a09f8f640 1 -- 172.21.15.160:0/1295737304 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89f0003530 msgr2=0x7f89f00059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:09:34.593 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:34.591+0000 7f8a09f8f640 1 --2- 172.21.15.160:0/1295737304 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89f0003530 0x7f89f00059c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8a04102af0 tx=0x7f89f402c490 comp rx=0 tx=0).stop 2024-09-11T23:09:34.593 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:34.591+0000 7f8a09f8f640 1 -- 172.21.15.160:0/1295737304 shutdown_connections 2024-09-11T23:09:34.593 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:34.591+0000 7f8a09f8f640 1 --2- 172.21.15.160:0/1295737304 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89f0003530 0x7f89f00059c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:09:34.593 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:34.591+0000 7f8a09f8f640 1 -- 172.21.15.160:0/1295737304 >> 172.21.15.160:0/1295737304 conn(0x7f8a040fd320 msgr2=0x7f8a040ff740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:09:34.594 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:34.591+0000 7f8a09f8f640 1 -- 172.21.15.160:0/1295737304 shutdown_connections 2024-09-11T23:09:34.594 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:34.591+0000 7f8a09f8f640 1 -- 172.21.15.160:0/1295737304 wait complete. 2024-09-11T23:09:34.594 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:34 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T23:09:34.594 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:34 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T23:09:34.594 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:34 smithi160 ceph-mon[35055]: mon.a calling monitor election 2024-09-11T23:09:34.594 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:34 smithi160 ceph-mon[35055]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:09:34.595 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:34 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T23:09:34.595 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:34 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T23:09:34.595 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:34 smithi160 ceph-mon[35055]: mon.c calling monitor election 2024-09-11T23:09:34.595 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:34 smithi160 ceph-mon[35055]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:09:34.595 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:34 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T23:09:34.595 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:34 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T23:09:34.595 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:34 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T23:09:34.595 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:34 smithi160 ceph-mon[35055]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-11T23:09:34.595 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:34 smithi160 ceph-mon[35055]: monmap epoch 2 2024-09-11T23:09:34.595 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:34 smithi160 ceph-mon[35055]: fsid 8b03efce-7092-11ef-bcea-c7b262605968 2024-09-11T23:09:34.595 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:34 smithi160 ceph-mon[35055]: last_changed 2024-09-11T23:09:29.261155+0000 2024-09-11T23:09:34.595 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:34 smithi160 ceph-mon[35055]: created 2024-09-11T23:07:45.034404+0000 2024-09-11T23:09:34.595 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:34 smithi160 ceph-mon[35055]: min_mon_release 19 (squid) 2024-09-11T23:09:34.596 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:34 smithi160 ceph-mon[35055]: election_strategy: 1 2024-09-11T23:09:34.596 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:34 smithi160 ceph-mon[35055]: 0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-11T23:09:34.596 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:34 smithi160 ceph-mon[35055]: 1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.c 2024-09-11T23:09:34.596 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:34 smithi160 ceph-mon[35055]: fsmap 2024-09-11T23:09:34.596 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:34 smithi160 ceph-mon[35055]: osdmap e4: 0 total, 0 up, 0 in 2024-09-11T23:09:34.596 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:34 smithi160 ceph-mon[35055]: mgrmap e13: x(active, since 42s) 2024-09-11T23:09:34.596 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:34 smithi160 ceph-mon[35055]: overall HEALTH_OK 2024-09-11T23:09:34.596 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:34 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:34.596 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:34 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:34.596 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:34 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:34.596 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:34 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-11T23:09:34.596 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:34 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:09:34.598 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:34.592+0000 7f8a09f8f640 1 Processor -- start 2024-09-11T23:09:34.599 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:34.592+0000 7f8a09f8f640 1 -- start start 2024-09-11T23:09:34.599 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:34.593+0000 7f8a09f8f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89f0003530 0x7f8a041972a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:09:34.599 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:34.593+0000 7f8a09f8f640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8a041977e0 0x7f8a0419bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:09:34.599 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:34.593+0000 7f8a09f8f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8a04109780 con 0x7f89f0003530 2024-09-11T23:09:34.599 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:34.593+0000 7f8a09f8f640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f8a04109600 con 0x7f8a041977e0 2024-09-11T23:09:34.599 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:34.593+0000 7f8a037fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89f0003530 0x7f8a041972a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:09:34.599 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:34.593+0000 7f8a037fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89f0003530 0x7f8a041972a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.160:42788/0 (socket says 172.21.15.160:42788) 2024-09-11T23:09:34.599 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:34.593+0000 7f8a037fe640 1 -- 172.21.15.160:0/3870254626 learned_addr learned my addr 172.21.15.160:0/3870254626 (peer_addr_for_me v2:172.21.15.160:0/0) 2024-09-11T23:09:34.599 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:34.593+0000 7f89fbfff640 1 --2- 172.21.15.160:0/3870254626 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8a041977e0 0x7f8a0419bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:09:34.599 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:34.593+0000 7f89fbfff640 1 -- 172.21.15.160:0/3870254626 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8a041977e0 msgr2=0x7f8a0419bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-11T23:09:34.599 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:34.593+0000 7f89fbfff640 1 -- 172.21.15.160:0/3870254626 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8a041977e0 msgr2=0x7f8a0419bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-11T23:09:34.600 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:34.593+0000 7f89fbfff640 1 --2- 172.21.15.160:0/3870254626 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8a041977e0 0x7f8a0419bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T23:09:34.600 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:34.593+0000 7f89fbfff640 1 --2- 172.21.15.160:0/3870254626 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8a041977e0 0x7f8a0419bb70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T23:09:34.600 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:34.594+0000 7f8a037fe640 1 -- 172.21.15.160:0/3870254626 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8a041977e0 msgr2=0x7f8a0419bb70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T23:09:34.600 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:34.594+0000 7f8a037fe640 1 --2- 172.21.15.160:0/3870254626 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8a041977e0 0x7f8a0419bb70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:09:34.600 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:34.594+0000 7f8a037fe640 1 -- 172.21.15.160:0/3870254626 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a04197e00 con 0x7f89f0003530 2024-09-11T23:09:34.600 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:34.594+0000 7f8a037fe640 1 --2- 172.21.15.160:0/3870254626 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89f0003530 0x7f8a041972a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f89f4036040 tx=0x7f89f4032c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:09:34.600 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:34.594+0000 7f8a017fa640 1 -- 172.21.15.160:0/3870254626 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f89f4038040 con 0x7f89f0003530 2024-09-11T23:09:34.600 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:34.594+0000 7f8a017fa640 1 -- 172.21.15.160:0/3870254626 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f89f4005040 con 0x7f89f0003530 2024-09-11T23:09:34.600 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:34.594+0000 7f8a09f8f640 1 -- 172.21.15.160:0/3870254626 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a0419c0b0 con 0x7f89f0003530 2024-09-11T23:09:34.600 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:34.594+0000 7f8a017fa640 1 -- 172.21.15.160:0/3870254626 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f89f4004ac0 con 0x7f89f0003530 2024-09-11T23:09:34.600 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:34.594+0000 7f8a09f8f640 1 -- 172.21.15.160:0/3870254626 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a0419c5f0 con 0x7f89f0003530 2024-09-11T23:09:34.600 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:34.595+0000 7f8a017fa640 1 -- 172.21.15.160:0/3870254626 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f89f4043070 con 0x7f89f0003530 2024-09-11T23:09:34.600 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:34.596+0000 7f8a017fa640 1 --2- 172.21.15.160:0/3870254626 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f89e4038e50 0x7f89e403b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:09:34.601 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:34.596+0000 7f8a017fa640 1 -- 172.21.15.160:0/3870254626 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f89f4041070 con 0x7f89f0003530 2024-09-11T23:09:34.601 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:34.596+0000 7f8a09f8f640 1 -- 172.21.15.160:0/3870254626 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a04102da0 con 0x7f89f0003530 2024-09-11T23:09:34.601 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:34.596+0000 7f89fbfff640 1 --2- 172.21.15.160:0/3870254626 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f89e4038e50 0x7f89e403b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:09:34.601 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:34.597+0000 7f89fbfff640 1 --2- 172.21.15.160:0/3870254626 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f89e4038e50 0x7f89e403b310 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f89ec006fd0 tx=0x7f89ec008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:09:34.603 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:34.602+0000 7f8a017fa640 1 -- 172.21.15.160:0/3870254626 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f89f4043c20 con 0x7f89f0003530 2024-09-11T23:09:34.815 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:34 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T23:09:34.815 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:34 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T23:09:34.815 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:34 smithi037 ceph-mon[30630]: mon.a calling monitor election 2024-09-11T23:09:34.815 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:34 smithi037 ceph-mon[30630]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:09:34.815 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:34 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T23:09:34.815 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:34 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T23:09:34.815 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:34 smithi037 ceph-mon[30630]: mon.c calling monitor election 2024-09-11T23:09:34.815 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:34 smithi037 ceph-mon[30630]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:09:34.815 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:34 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T23:09:34.815 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:34 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T23:09:34.816 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:34 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T23:09:34.816 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:34 smithi037 ceph-mon[30630]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-11T23:09:34.816 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:34 smithi037 ceph-mon[30630]: monmap epoch 2 2024-09-11T23:09:34.816 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:34 smithi037 ceph-mon[30630]: fsid 8b03efce-7092-11ef-bcea-c7b262605968 2024-09-11T23:09:34.816 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:34 smithi037 ceph-mon[30630]: last_changed 2024-09-11T23:09:29.261155+0000 2024-09-11T23:09:34.816 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:34 smithi037 ceph-mon[30630]: created 2024-09-11T23:07:45.034404+0000 2024-09-11T23:09:34.816 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:34 smithi037 ceph-mon[30630]: min_mon_release 19 (squid) 2024-09-11T23:09:34.816 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:34 smithi037 ceph-mon[30630]: election_strategy: 1 2024-09-11T23:09:34.816 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:34 smithi037 ceph-mon[30630]: 0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-11T23:09:34.816 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:34 smithi037 ceph-mon[30630]: 1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.c 2024-09-11T23:09:34.816 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:34 smithi037 ceph-mon[30630]: fsmap 2024-09-11T23:09:34.816 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:34 smithi037 ceph-mon[30630]: osdmap e4: 0 total, 0 up, 0 in 2024-09-11T23:09:34.816 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:34 smithi037 ceph-mon[30630]: mgrmap e13: x(active, since 42s) 2024-09-11T23:09:34.817 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:34 smithi037 ceph-mon[30630]: overall HEALTH_OK 2024-09-11T23:09:34.817 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:34 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:34.817 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:34 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:34.817 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:34 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:34.817 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:34 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-11T23:09:34.817 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:34 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:09:34.838 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:34.836+0000 7f8a09f8f640 1 -- 172.21.15.160:0/3870254626 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f8a0419c8a0 con 0x7f89f0003530 2024-09-11T23:09:34.839 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:34.837+0000 7f8a017fa640 1 -- 172.21.15.160:0/3870254626 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7f89f4034000 con 0x7f89f0003530 2024-09-11T23:09:34.839 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-11T23:09:34.839 INFO:teuthology.orchestra.run.smithi160.stdout:{"epoch":2,"fsid":"8b03efce-7092-11ef-bcea-c7b262605968","modified":"2024-09-11T23:09:29.261155Z","created":"2024-09-11T23:07:45.034404Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:3300","nonce":0},{"type":"v1","addr":"172.21.15.37:6789","nonce":0}]},"addr":"172.21.15.37:6789/0","public_addr":"172.21.15.37:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:3300","nonce":0},{"type":"v1","addr":"172.21.15.160:6789","nonce":0}]},"addr":"172.21.15.160:6789/0","public_addr":"172.21.15.160:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-11T23:09:34.839 INFO:teuthology.orchestra.run.smithi160.stderr:dumped monmap epoch 2 2024-09-11T23:09:34.841 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:34.839+0000 7f8a09f8f640 1 -- 172.21.15.160:0/3870254626 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f89e4038e50 msgr2=0x7f89e403b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:09:34.841 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:34.839+0000 7f8a09f8f640 1 --2- 172.21.15.160:0/3870254626 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f89e4038e50 0x7f89e403b310 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f89ec006fd0 tx=0x7f89ec008040 comp rx=0 tx=0).stop 2024-09-11T23:09:34.841 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:34.839+0000 7f8a09f8f640 1 -- 172.21.15.160:0/3870254626 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89f0003530 msgr2=0x7f8a041972a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:09:34.841 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:34.839+0000 7f8a09f8f640 1 --2- 172.21.15.160:0/3870254626 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89f0003530 0x7f8a041972a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f89f4036040 tx=0x7f89f4032c90 comp rx=0 tx=0).stop 2024-09-11T23:09:34.841 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:34.840+0000 7f8a09f8f640 1 -- 172.21.15.160:0/3870254626 shutdown_connections 2024-09-11T23:09:34.841 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:34.840+0000 7f8a09f8f640 1 --2- 172.21.15.160:0/3870254626 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f89e4038e50 0x7f89e403b310 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:09:34.841 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:34.840+0000 7f8a09f8f640 1 --2- 172.21.15.160:0/3870254626 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8a041977e0 0x7f8a0419bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:09:34.841 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:34.840+0000 7f8a09f8f640 1 --2- 172.21.15.160:0/3870254626 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89f0003530 0x7f8a041972a0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:09:34.841 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:34.840+0000 7f8a09f8f640 1 -- 172.21.15.160:0/3870254626 >> 172.21.15.160:0/3870254626 conn(0x7f8a040fd320 msgr2=0x7f8a040ff250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:09:34.842 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:34.840+0000 7f8a09f8f640 1 -- 172.21.15.160:0/3870254626 shutdown_connections 2024-09-11T23:09:34.842 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:34.840+0000 7f8a09f8f640 1 -- 172.21.15.160:0/3870254626 wait complete. 2024-09-11T23:09:35.383 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:35 smithi160 ceph-mon[35055]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:09:35.383 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:35 smithi160 ceph-mon[35055]: Deploying daemon mon.b on smithi123 2024-09-11T23:09:35.383 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:35 smithi160 ceph-mon[35055]: from='client.? 172.21.15.160:0/3870254626' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-11T23:09:35.383 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:35 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T23:09:35.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:35 smithi037 ceph-mon[30630]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:09:35.815 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:35 smithi037 ceph-mon[30630]: Deploying daemon mon.b on smithi123 2024-09-11T23:09:35.815 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:35 smithi037 ceph-mon[30630]: from='client.? 172.21.15.160:0/3870254626' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-11T23:09:35.815 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:35 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T23:09:36.413 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-11T23:09:36.413 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-11T23:09:36.666 INFO:teuthology.orchestra.run.smithi160.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T23:09:37.044 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:37.042+0000 7fa716843640 1 -- 172.21.15.160:0/840841514 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa710102840 msgr2=0x7fa710102c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:09:37.044 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:37.042+0000 7fa716843640 1 --2- 172.21.15.160:0/840841514 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa710102840 0x7fa710102c20 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa700009880 tx=0x7fa70002a670 comp rx=0 tx=0).stop 2024-09-11T23:09:37.045 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:37.042+0000 7fa716843640 1 -- 172.21.15.160:0/840841514 shutdown_connections 2024-09-11T23:09:37.045 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:37.042+0000 7fa716843640 1 --2- 172.21.15.160:0/840841514 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa710102840 0x7fa710102c20 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:09:37.045 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:37.042+0000 7fa716843640 1 -- 172.21.15.160:0/840841514 >> 172.21.15.160:0/840841514 conn(0x7fa7100fc280 msgr2=0x7fa7100fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:09:37.045 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:37.042+0000 7fa716843640 1 -- 172.21.15.160:0/840841514 shutdown_connections 2024-09-11T23:09:37.045 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:37.042+0000 7fa716843640 1 -- 172.21.15.160:0/840841514 wait complete. 2024-09-11T23:09:37.045 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:37.042+0000 7fa716843640 1 Processor -- start 2024-09-11T23:09:37.045 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:37.042+0000 7fa716843640 1 -- start start 2024-09-11T23:09:37.045 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:37.043+0000 7fa716843640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa710102840 0x7fa7101974a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:09:37.045 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:37.043+0000 7fa716843640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7101979e0 0x7fa71019bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:09:37.045 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:37.043+0000 7fa716843640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa71010bdb0 con 0x7fa7101979e0 2024-09-11T23:09:37.045 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:37.043+0000 7fa716843640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fa71010bc30 con 0x7fa710102840 2024-09-11T23:09:37.045 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:37.043+0000 7fa70ffff640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa710102840 0x7fa7101974a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:09:37.046 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:37.043+0000 7fa70ffff640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa710102840 0x7fa7101974a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:33624/0 (socket says 172.21.15.160:33624) 2024-09-11T23:09:37.046 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:37.043+0000 7fa70ffff640 1 -- 172.21.15.160:0/645279424 learned_addr learned my addr 172.21.15.160:0/645279424 (peer_addr_for_me v2:172.21.15.160:0/0) 2024-09-11T23:09:37.046 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:37.043+0000 7fa70ffff640 1 -- 172.21.15.160:0/645279424 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa710102840 msgr2=0x7fa7101974a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-11T23:09:37.046 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:37.043+0000 7fa70ffff640 1 -- 172.21.15.160:0/645279424 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa710102840 msgr2=0x7fa7101974a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-11T23:09:37.046 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:37.043+0000 7fa70f7fe640 1 --2- 172.21.15.160:0/645279424 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7101979e0 0x7fa71019bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:09:37.046 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:37.043+0000 7fa70ffff640 1 --2- 172.21.15.160:0/645279424 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa710102840 0x7fa7101974a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T23:09:37.046 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:37.043+0000 7fa70ffff640 1 --2- 172.21.15.160:0/645279424 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa710102840 0x7fa7101974a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T23:09:37.046 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:37.043+0000 7fa70f7fe640 1 -- 172.21.15.160:0/645279424 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa710102840 msgr2=0x7fa7101974a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T23:09:37.046 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:37.043+0000 7fa70f7fe640 1 --2- 172.21.15.160:0/645279424 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa710102840 0x7fa7101974a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:09:37.046 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:37.043+0000 7fa70f7fe640 1 -- 172.21.15.160:0/645279424 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa710198000 con 0x7fa7101979e0 2024-09-11T23:09:37.048 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:37.044+0000 7fa70f7fe640 1 --2- 172.21.15.160:0/645279424 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7101979e0 0x7fa71019bd20 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa70400b3d0 tx=0x7fa70400b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:09:37.049 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:37.044+0000 7fa70d7fa640 1 -- 172.21.15.160:0/645279424 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7fa704011630 con 0x7fa7101979e0 2024-09-11T23:09:37.049 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:37.044+0000 7fa716843640 1 -- 172.21.15.160:0/645279424 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa71019c260 con 0x7fa7101979e0 2024-09-11T23:09:37.049 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:37.044+0000 7fa70d7fa640 1 -- 172.21.15.160:0/645279424 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa704011cb0 con 0x7fa7101979e0 2024-09-11T23:09:37.049 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:37.044+0000 7fa70d7fa640 1 -- 172.21.15.160:0/645279424 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7fa704010df0 con 0x7fa7101979e0 2024-09-11T23:09:37.049 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:37.044+0000 7fa716843640 1 -- 172.21.15.160:0/645279424 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa71019c7a0 con 0x7fa7101979e0 2024-09-11T23:09:37.049 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:37.045+0000 7fa716843640 1 -- 172.21.15.160:0/645279424 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa71006a4f0 con 0x7fa7101979e0 2024-09-11T23:09:37.049 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:37.045+0000 7fa70d7fa640 1 -- 172.21.15.160:0/645279424 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fa704018020 con 0x7fa7101979e0 2024-09-11T23:09:37.049 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:37.045+0000 7fa70d7fa640 1 --2- 172.21.15.160:0/645279424 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fa6f8038e00 0x7fa6f803b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:09:37.049 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:37.045+0000 7fa70d7fa640 1 -- 172.21.15.160:0/645279424 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fa70404bcb0 con 0x7fa7101979e0 2024-09-11T23:09:37.049 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:37.045+0000 7fa70ffff640 1 --2- 172.21.15.160:0/645279424 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fa6f8038e00 0x7fa6f803b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:09:37.049 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:37.046+0000 7fa70ffff640 1 --2- 172.21.15.160:0/645279424 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fa6f8038e00 0x7fa6f803b2c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa7000096c0 tx=0x7fa700005a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:09:37.052 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:37.051+0000 7fa70d7fa640 1 -- 172.21.15.160:0/645279424 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa70401f020 con 0x7fa7101979e0 2024-09-11T23:09:37.279 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:37.278+0000 7fa716843640 1 -- 172.21.15.160:0/645279424 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fa71019cab0 con 0x7fa7101979e0 2024-09-11T23:09:37.279 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:37.278+0000 7fa70d7fa640 1 -- 172.21.15.160:0/645279424 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7fa7040172c0 con 0x7fa7101979e0 2024-09-11T23:09:37.280 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-11T23:09:37.280 INFO:teuthology.orchestra.run.smithi160.stdout:{"epoch":2,"fsid":"8b03efce-7092-11ef-bcea-c7b262605968","modified":"2024-09-11T23:09:29.261155Z","created":"2024-09-11T23:07:45.034404Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:3300","nonce":0},{"type":"v1","addr":"172.21.15.37:6789","nonce":0}]},"addr":"172.21.15.37:6789/0","public_addr":"172.21.15.37:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:3300","nonce":0},{"type":"v1","addr":"172.21.15.160:6789","nonce":0}]},"addr":"172.21.15.160:6789/0","public_addr":"172.21.15.160:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-11T23:09:37.280 INFO:teuthology.orchestra.run.smithi160.stderr:dumped monmap epoch 2 2024-09-11T23:09:37.282 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:37.281+0000 7fa716843640 1 -- 172.21.15.160:0/645279424 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fa6f8038e00 msgr2=0x7fa6f803b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:09:37.282 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:37.281+0000 7fa716843640 1 --2- 172.21.15.160:0/645279424 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fa6f8038e00 0x7fa6f803b2c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa7000096c0 tx=0x7fa700005a40 comp rx=0 tx=0).stop 2024-09-11T23:09:37.282 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:37.281+0000 7fa716843640 1 -- 172.21.15.160:0/645279424 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7101979e0 msgr2=0x7fa71019bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:09:37.282 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:37.281+0000 7fa716843640 1 --2- 172.21.15.160:0/645279424 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7101979e0 0x7fa71019bd20 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa70400b3d0 tx=0x7fa70400b890 comp rx=0 tx=0).stop 2024-09-11T23:09:37.282 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:37.281+0000 7fa716843640 1 -- 172.21.15.160:0/645279424 shutdown_connections 2024-09-11T23:09:37.282 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:37.281+0000 7fa716843640 1 --2- 172.21.15.160:0/645279424 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fa6f8038e00 0x7fa6f803b2c0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:09:37.282 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:37.281+0000 7fa716843640 1 --2- 172.21.15.160:0/645279424 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7101979e0 0x7fa71019bd20 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:09:37.283 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:37.281+0000 7fa716843640 1 --2- 172.21.15.160:0/645279424 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa710102840 0x7fa7101974a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:09:37.283 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:37.281+0000 7fa716843640 1 -- 172.21.15.160:0/645279424 >> 172.21.15.160:0/645279424 conn(0x7fa7100fc280 msgr2=0x7fa710105600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:09:37.283 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:37.281+0000 7fa716843640 1 -- 172.21.15.160:0/645279424 shutdown_connections 2024-09-11T23:09:37.283 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:37.281+0000 7fa716843640 1 -- 172.21.15.160:0/645279424 wait complete. 2024-09-11T23:09:37.617 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:37 smithi037 ceph-mon[30630]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:09:37.617 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:37 smithi037 ceph-mon[30630]: from='client.? 172.21.15.160:0/645279424' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-11T23:09:37.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:37 smithi160 ceph-mon[35055]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:09:37.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:37 smithi160 ceph-mon[35055]: from='client.? 172.21.15.160:0/645279424' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-11T23:09:38.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:37 smithi123 systemd[1]: Started Ceph mon.b for 8b03efce-7092-11ef-bcea-c7b262605968. 2024-09-11T23:09:38.893 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-11T23:09:38.893 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-11T23:09:39.145 INFO:teuthology.orchestra.run.smithi160.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T23:09:43.199 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:43.198+0000 7f9944932640 1 -- 172.21.15.160:0/597629414 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9928003530 msgr2=0x7f99280059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:09:43.199 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:43.198+0000 7f9944932640 1 --2- 172.21.15.160:0/597629414 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9928003530 0x7f99280059c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9940102af0 tx=0x7f993402c3f0 comp rx=0 tx=0).stop 2024-09-11T23:09:43.199 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:43.199+0000 7f9944932640 1 -- 172.21.15.160:0/597629414 shutdown_connections 2024-09-11T23:09:43.199 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:43.199+0000 7f9944932640 1 --2- 172.21.15.160:0/597629414 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9928003530 0x7f99280059c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:09:43.199 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:43.199+0000 7f9944932640 1 -- 172.21.15.160:0/597629414 >> 172.21.15.160:0/597629414 conn(0x7f99400fd320 msgr2=0x7f99400ff740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:09:43.199 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:43.199+0000 7f9944932640 1 -- 172.21.15.160:0/597629414 shutdown_connections 2024-09-11T23:09:43.200 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:43.199+0000 7f9944932640 1 -- 172.21.15.160:0/597629414 wait complete. 2024-09-11T23:09:43.200 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:43.200+0000 7f9944932640 1 Processor -- start 2024-09-11T23:09:43.200 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:43.200+0000 7f9944932640 1 -- start start 2024-09-11T23:09:43.202 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:43.201+0000 7f9944932640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9928003530 0x7f9940197300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:09:43.202 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:43.201+0000 7f9944932640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9940197840 0x7f994019bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:09:43.203 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:43.201+0000 7f9944932640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f994019c110 0x7f994019c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:09:43.203 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:43.201+0000 7f9944932640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9940109780 con 0x7f9928003530 2024-09-11T23:09:43.203 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:43.201+0000 7f9944932640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f9940109600 con 0x7f9940197840 2024-09-11T23:09:43.203 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:43.201+0000 7f9944932640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f9940109900 con 0x7f994019c110 2024-09-11T23:09:43.203 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:43.201+0000 7f993ed9d640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f994019c110 0x7f994019c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:09:43.203 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:43.201+0000 7f993e59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9928003530 0x7f9940197300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:09:43.203 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:43.201+0000 7f993ed9d640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f994019c110 0x7f994019c5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:45712/0 (socket says 172.21.15.160:45712) 2024-09-11T23:09:43.203 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:43.201+0000 7f993ed9d640 1 -- 172.21.15.160:0/2449575093 learned_addr learned my addr 172.21.15.160:0/2449575093 (peer_addr_for_me v2:172.21.15.160:0/0) 2024-09-11T23:09:43.203 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:43.201+0000 7f993dd9b640 1 --2- 172.21.15.160:0/2449575093 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9940197840 0x7f994019bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:09:43.203 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:43.201+0000 7f993ed9d640 1 -- 172.21.15.160:0/2449575093 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f994019c110 msgr2=0x7f994019c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2024-09-11T23:09:43.203 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:43.201+0000 7f993ed9d640 1 -- 172.21.15.160:0/2449575093 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f994019c110 msgr2=0x7f994019c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-11T23:09:43.204 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:43.201+0000 7f993ed9d640 1 --2- 172.21.15.160:0/2449575093 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f994019c110 0x7f994019c5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T23:09:43.204 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:43.201+0000 7f993ed9d640 1 --2- 172.21.15.160:0/2449575093 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f994019c110 0x7f994019c5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T23:09:43.204 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:43.201+0000 7f993dd9b640 1 -- 172.21.15.160:0/2449575093 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9940197840 msgr2=0x7f994019bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-11T23:09:43.204 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:43.201+0000 7f993dd9b640 1 -- 172.21.15.160:0/2449575093 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9940197840 msgr2=0x7f994019bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-11T23:09:43.204 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:43.201+0000 7f993dd9b640 1 --2- 172.21.15.160:0/2449575093 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9940197840 0x7f994019bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T23:09:43.204 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:43.201+0000 7f993dd9b640 1 --2- 172.21.15.160:0/2449575093 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9940197840 0x7f994019bbd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T23:09:43.204 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:43.201+0000 7f993e59c640 1 -- 172.21.15.160:0/2449575093 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f994019c110 msgr2=0x7f994019c5c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T23:09:43.204 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:43.201+0000 7f993e59c640 1 --2- 172.21.15.160:0/2449575093 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f994019c110 0x7f994019c5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:09:43.205 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:43.201+0000 7f993e59c640 1 -- 172.21.15.160:0/2449575093 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9940197840 msgr2=0x7f994019bbd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T23:09:43.205 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:43.201+0000 7f993e59c640 1 --2- 172.21.15.160:0/2449575093 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9940197840 0x7f994019bbd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:09:43.205 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:43.201+0000 7f993e59c640 1 -- 172.21.15.160:0/2449575093 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99401a3e80 con 0x7f9928003530 2024-09-11T23:09:43.205 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:43.202+0000 7f993e59c640 1 --2- 172.21.15.160:0/2449575093 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9928003530 0x7f9940197300 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9934005f10 tx=0x7f99340048d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:09:43.205 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:43.202+0000 7f992f7fe640 1 -- 172.21.15.160:0/2449575093 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9934012450 con 0x7f9928003530 2024-09-11T23:09:43.205 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:43.202+0000 7f992f7fe640 1 -- 172.21.15.160:0/2449575093 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9934042070 con 0x7f9928003530 2024-09-11T23:09:43.205 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:43.202+0000 7f9944932640 1 -- 172.21.15.160:0/2449575093 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99401a4050 con 0x7f9928003530 2024-09-11T23:09:43.205 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:43.202+0000 7f992f7fe640 1 -- 172.21.15.160:0/2449575093 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f993403d8f0 con 0x7f9928003530 2024-09-11T23:09:43.205 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:43.202+0000 7f9944932640 1 -- 172.21.15.160:0/2449575093 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99401a45b0 con 0x7f9928003530 2024-09-11T23:09:43.206 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:43.203+0000 7f992f7fe640 1 -- 172.21.15.160:0/2449575093 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f993403da90 con 0x7f9928003530 2024-09-11T23:09:43.206 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:43.203+0000 7f992f7fe640 1 --2- 172.21.15.160:0/2449575093 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f99200394f0 0x7f992003b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:09:43.206 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:43.203+0000 7f992f7fe640 1 -- 172.21.15.160:0/2449575093 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f993406e750 con 0x7f9928003530 2024-09-11T23:09:43.206 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:43.203+0000 7f9944932640 1 -- 172.21.15.160:0/2449575093 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f994010a8b0 con 0x7f9928003530 2024-09-11T23:09:43.206 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:43.204+0000 7f993dd9b640 1 --2- 172.21.15.160:0/2449575093 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f99200394f0 0x7f992003b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:09:43.206 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:43.204+0000 7f993dd9b640 1 --2- 172.21.15.160:0/2449575093 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f99200394f0 0x7f992003b9b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9930006fd0 tx=0x7f9930008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:09:43.209 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:43.209+0000 7f992f7fe640 1 -- 172.21.15.160:0/2449575093 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9934045c20 con 0x7f9928003530 2024-09-11T23:09:43.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:43 smithi037 ceph-mon[30630]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:09:43.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:43 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T23:09:43.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:43 smithi037 ceph-mon[30630]: mon.c calling monitor election 2024-09-11T23:09:43.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:43 smithi037 ceph-mon[30630]: mon.a calling monitor election 2024-09-11T23:09:43.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:43 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:09:43.316 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:43 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T23:09:43.316 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:43 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:09:43.316 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:43 smithi037 ceph-mon[30630]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:09:43.316 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:43 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:09:43.316 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:43 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:09:43.316 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:43 smithi037 ceph-mon[30630]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:09:43.316 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:43 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:09:43.316 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:43 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:09:43.316 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:43 smithi037 ceph-mon[30630]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-11T23:09:43.316 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:43 smithi037 ceph-mon[30630]: monmap epoch 3 2024-09-11T23:09:43.316 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:43 smithi037 ceph-mon[30630]: fsid 8b03efce-7092-11ef-bcea-c7b262605968 2024-09-11T23:09:43.317 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:43 smithi037 ceph-mon[30630]: last_changed 2024-09-11T23:09:37.999511+0000 2024-09-11T23:09:43.317 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:43 smithi037 ceph-mon[30630]: created 2024-09-11T23:07:45.034404+0000 2024-09-11T23:09:43.317 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:43 smithi037 ceph-mon[30630]: min_mon_release 19 (squid) 2024-09-11T23:09:43.317 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:43 smithi037 ceph-mon[30630]: election_strategy: 1 2024-09-11T23:09:43.317 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:43 smithi037 ceph-mon[30630]: 0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-11T23:09:43.317 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:43 smithi037 ceph-mon[30630]: 1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.c 2024-09-11T23:09:43.317 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:43 smithi037 ceph-mon[30630]: 2: [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] mon.b 2024-09-11T23:09:43.317 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:43 smithi037 ceph-mon[30630]: fsmap 2024-09-11T23:09:43.317 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:43 smithi037 ceph-mon[30630]: osdmap e4: 0 total, 0 up, 0 in 2024-09-11T23:09:43.317 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:43 smithi037 ceph-mon[30630]: mgrmap e13: x(active, since 51s) 2024-09-11T23:09:43.317 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:43 smithi037 ceph-mon[30630]: overall HEALTH_OK 2024-09-11T23:09:43.317 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:43 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:43.317 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:43 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:43.317 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:43 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:43.318 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:43 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:43.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:43 smithi160 ceph-mon[35055]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:09:43.435 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:43 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T23:09:43.435 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:43 smithi160 ceph-mon[35055]: mon.c calling monitor election 2024-09-11T23:09:43.435 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:43 smithi160 ceph-mon[35055]: mon.a calling monitor election 2024-09-11T23:09:43.435 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:43 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:09:43.435 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:43 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T23:09:43.435 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:43 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:09:43.436 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:43 smithi160 ceph-mon[35055]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:09:43.436 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:43 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:09:43.436 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:43 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:09:43.436 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:43 smithi160 ceph-mon[35055]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:09:43.436 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:43 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:09:43.437 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:43 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:09:43.437 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:43 smithi160 ceph-mon[35055]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-11T23:09:43.437 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:43 smithi160 ceph-mon[35055]: monmap epoch 3 2024-09-11T23:09:43.437 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:43 smithi160 ceph-mon[35055]: fsid 8b03efce-7092-11ef-bcea-c7b262605968 2024-09-11T23:09:43.437 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:43 smithi160 ceph-mon[35055]: last_changed 2024-09-11T23:09:37.999511+0000 2024-09-11T23:09:43.437 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:43 smithi160 ceph-mon[35055]: created 2024-09-11T23:07:45.034404+0000 2024-09-11T23:09:43.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:43 smithi160 ceph-mon[35055]: min_mon_release 19 (squid) 2024-09-11T23:09:43.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:43 smithi160 ceph-mon[35055]: election_strategy: 1 2024-09-11T23:09:43.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:43 smithi160 ceph-mon[35055]: 0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-11T23:09:43.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:43 smithi160 ceph-mon[35055]: 1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.c 2024-09-11T23:09:43.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:43 smithi160 ceph-mon[35055]: 2: [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] mon.b 2024-09-11T23:09:43.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:43 smithi160 ceph-mon[35055]: fsmap 2024-09-11T23:09:43.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:43 smithi160 ceph-mon[35055]: osdmap e4: 0 total, 0 up, 0 in 2024-09-11T23:09:43.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:43 smithi160 ceph-mon[35055]: mgrmap e13: x(active, since 51s) 2024-09-11T23:09:43.439 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:43 smithi160 ceph-mon[35055]: overall HEALTH_OK 2024-09-11T23:09:43.439 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:43 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:43.439 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:43 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:43.439 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:43 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:43.439 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:43 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:43.449 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:43.449+0000 7f9944932640 1 -- 172.21.15.160:0/2449575093 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f9940106020 con 0x7f9928003530 2024-09-11T23:09:43.450 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:43.449+0000 7f992f7fe640 1 -- 172.21.15.160:0/2449575093 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1283 (secure 0 0 0) 0x7f9934034de0 con 0x7f9928003530 2024-09-11T23:09:43.450 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-11T23:09:43.450 INFO:teuthology.orchestra.run.smithi160.stdout:{"epoch":3,"fsid":"8b03efce-7092-11ef-bcea-c7b262605968","modified":"2024-09-11T23:09:37.999511Z","created":"2024-09-11T23:07:45.034404Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:3300","nonce":0},{"type":"v1","addr":"172.21.15.37:6789","nonce":0}]},"addr":"172.21.15.37:6789/0","public_addr":"172.21.15.37:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:3300","nonce":0},{"type":"v1","addr":"172.21.15.160:6789","nonce":0}]},"addr":"172.21.15.160:6789/0","public_addr":"172.21.15.160:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-11T23:09:43.450 INFO:teuthology.orchestra.run.smithi160.stderr:dumped monmap epoch 3 2024-09-11T23:09:43.452 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:43.452+0000 7f9944932640 1 -- 172.21.15.160:0/2449575093 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f99200394f0 msgr2=0x7f992003b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:09:43.452 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:43.452+0000 7f9944932640 1 --2- 172.21.15.160:0/2449575093 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f99200394f0 0x7f992003b9b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9930006fd0 tx=0x7f9930008040 comp rx=0 tx=0).stop 2024-09-11T23:09:43.452 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:43.452+0000 7f9944932640 1 -- 172.21.15.160:0/2449575093 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9928003530 msgr2=0x7f9940197300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:09:43.452 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:43.452+0000 7f9944932640 1 --2- 172.21.15.160:0/2449575093 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9928003530 0x7f9940197300 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9934005f10 tx=0x7f99340048d0 comp rx=0 tx=0).stop 2024-09-11T23:09:43.452 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:43.452+0000 7f9944932640 1 -- 172.21.15.160:0/2449575093 shutdown_connections 2024-09-11T23:09:43.453 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:43.452+0000 7f9944932640 1 --2- 172.21.15.160:0/2449575093 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f99200394f0 0x7f992003b9b0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:09:43.453 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:43.452+0000 7f9944932640 1 --2- 172.21.15.160:0/2449575093 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9940197840 0x7f994019bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:09:43.453 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:43.452+0000 7f9944932640 1 --2- 172.21.15.160:0/2449575093 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f994019c110 0x7f994019c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:09:43.453 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:43.452+0000 7f9944932640 1 --2- 172.21.15.160:0/2449575093 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9928003530 0x7f9940197300 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:09:43.453 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:43.452+0000 7f9944932640 1 -- 172.21.15.160:0/2449575093 >> 172.21.15.160:0/2449575093 conn(0x7f99400fd320 msgr2=0x7f99400ff2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:09:43.453 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:43.452+0000 7f9944932640 1 -- 172.21.15.160:0/2449575093 shutdown_connections 2024-09-11T23:09:43.453 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:43.452+0000 7f9944932640 1 -- 172.21.15.160:0/2449575093 wait complete. 2024-09-11T23:09:44.065 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-11T23:09:44.065 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph config generate-minimal-conf 2024-09-11T23:09:44.430 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:44 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:09:44.430 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:44 smithi160 ceph-mon[35055]: from='client.? 172.21.15.160:0/2449575093' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-11T23:09:44.430 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:44 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:09:44.445 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:09:44.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:44 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:09:44.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:44 smithi037 ceph-mon[30630]: from='client.? 172.21.15.160:0/2449575093' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-11T23:09:44.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:44 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:09:44.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:44.916+0000 7f21ca200640 1 -- 172.21.15.37:0/1807593161 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21c4107660 msgr2=0x7f21c4107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:09:44.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:44.916+0000 7f21ca200640 1 --2- 172.21.15.37:0/1807593161 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21c4107660 0x7f21c4107a40 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f21b4009880 tx=0x7f21b402a5d0 comp rx=0 tx=0).stop 2024-09-11T23:09:44.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:44.916+0000 7f21ca200640 1 -- 172.21.15.37:0/1807593161 shutdown_connections 2024-09-11T23:09:44.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:44.916+0000 7f21ca200640 1 --2- 172.21.15.37:0/1807593161 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21c4107660 0x7f21c4107a40 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:09:44.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:44.916+0000 7f21ca200640 1 -- 172.21.15.37:0/1807593161 >> 172.21.15.37:0/1807593161 conn(0x7f21c40fd290 msgr2=0x7f21c40ff6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:09:44.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:44.916+0000 7f21ca200640 1 -- 172.21.15.37:0/1807593161 shutdown_connections 2024-09-11T23:09:44.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:44.916+0000 7f21ca200640 1 -- 172.21.15.37:0/1807593161 wait complete. 2024-09-11T23:09:44.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:44.917+0000 7f21ca200640 1 Processor -- start 2024-09-11T23:09:44.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:44.917+0000 7f21ca200640 1 -- start start 2024-09-11T23:09:44.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:44.918+0000 7f21ca200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f21c4107660 0x7f21c4199570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:09:44.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:44.918+0000 7f21ca200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21c4199ab0 0x7f21c419de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:09:44.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:44.918+0000 7f21ca200640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f21c419e380 0x7f21c419e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:09:44.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:44.918+0000 7f21ca200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f21c410bc90 con 0x7f21c4199ab0 2024-09-11T23:09:44.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:44.918+0000 7f21ca200640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f21c410bb10 con 0x7f21c4107660 2024-09-11T23:09:44.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:44.918+0000 7f21ca200640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f21c410be10 con 0x7f21c419e380 2024-09-11T23:09:44.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:44.918+0000 7f21c2a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21c4199ab0 0x7f21c419de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:09:44.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:44.918+0000 7f21c3400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f21c4107660 0x7f21c4199570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:09:44.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:44.918+0000 7f21c3400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f21c4107660 0x7f21c4199570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.37:45892/0 (socket says 172.21.15.37:45892) 2024-09-11T23:09:44.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:44.918+0000 7f21c3400640 1 -- 172.21.15.37:0/555962798 learned_addr learned my addr 172.21.15.37:0/555962798 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:09:44.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:44.918+0000 7f21c3e00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f21c419e380 0x7f21c419e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:09:44.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:44.918+0000 7f21c3400640 1 -- 172.21.15.37:0/555962798 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f21c4107660 msgr2=0x7f21c4199570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-11T23:09:44.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:44.918+0000 7f21c3400640 1 -- 172.21.15.37:0/555962798 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f21c4107660 msgr2=0x7f21c4199570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-11T23:09:44.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:44.918+0000 7f21c3400640 1 --2- 172.21.15.37:0/555962798 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f21c4107660 0x7f21c4199570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T23:09:44.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:44.918+0000 7f21c3400640 1 --2- 172.21.15.37:0/555962798 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f21c4107660 0x7f21c4199570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T23:09:44.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:44.919+0000 7f21c3e00640 1 -- 172.21.15.37:0/555962798 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f21c4107660 msgr2=0x7f21c4199570 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T23:09:44.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:44.919+0000 7f21c3e00640 1 --2- 172.21.15.37:0/555962798 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f21c4107660 0x7f21c4199570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:09:44.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:44.919+0000 7f21c3e00640 1 -- 172.21.15.37:0/555962798 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21c4199ab0 msgr2=0x7f21c419de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:09:44.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:44.919+0000 7f21c3e00640 1 --2- 172.21.15.37:0/555962798 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21c4199ab0 0x7f21c419de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:09:44.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:44.919+0000 7f21c3e00640 1 -- 172.21.15.37:0/555962798 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21c41a60f0 con 0x7f21c419e380 2024-09-11T23:09:44.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:44.919+0000 7f21c2a00640 1 --2- 172.21.15.37:0/555962798 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21c4199ab0 0x7f21c419de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:09:44.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:44.919+0000 7f21c3e00640 1 --2- 172.21.15.37:0/555962798 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f21c419e380 0x7f21c419e830 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f21bc00bd50 tx=0x7f21bc00be40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:09:44.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:44.919+0000 7f21bbe00640 1 -- 172.21.15.37:0/555962798 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21bc019070 con 0x7f21c419e380 2024-09-11T23:09:44.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:44.919+0000 7f21bbe00640 1 -- 172.21.15.37:0/555962798 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f21bc014920 con 0x7f21c419e380 2024-09-11T23:09:44.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:44.919+0000 7f21bbe00640 1 -- 172.21.15.37:0/555962798 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21bc012990 con 0x7f21c419e380 2024-09-11T23:09:44.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:44.919+0000 7f21ca200640 1 -- 172.21.15.37:0/555962798 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21c41a6320 con 0x7f21c419e380 2024-09-11T23:09:44.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:44.920+0000 7f21ca200640 1 -- 172.21.15.37:0/555962798 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21c41a6860 con 0x7f21c419e380 2024-09-11T23:09:44.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:44.921+0000 7f21bbe00640 1 -- 172.21.15.37:0/555962798 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f21bc01c070 con 0x7f21c419e380 2024-09-11T23:09:44.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:44.921+0000 7f21ca200640 1 -- 172.21.15.37:0/555962798 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21c4107ac0 con 0x7f21c419e380 2024-09-11T23:09:44.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:44.921+0000 7f21bbe00640 1 --2- 172.21.15.37:0/555962798 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f21a80394f0 0x7f21a803b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:09:44.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:44.921+0000 7f21bbe00640 1 -- 172.21.15.37:0/555962798 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f21bc04be50 con 0x7f21c419e380 2024-09-11T23:09:44.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:44.922+0000 7f21c3400640 1 --2- 172.21.15.37:0/555962798 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f21a80394f0 0x7f21a803b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:09:44.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:44.922+0000 7f21c3400640 1 --2- 172.21.15.37:0/555962798 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f21a80394f0 0x7f21a803b9b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f21b4005ab0 tx=0x7f21b4005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:09:44.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:44.928+0000 7f21bbe00640 1 -- 172.21.15.37:0/555962798 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f21bc04b6c0 con 0x7f21c419e380 2024-09-11T23:09:45.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:45.122+0000 7f21ca200640 1 -- 172.21.15.37:0/555962798 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f21c41a6c00 con 0x7f21c419e380 2024-09-11T23:09:45.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:45.123+0000 7f21bbe00640 1 -- 172.21.15.37:0/555962798 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+275 (secure 0 0 0) 0x7f21bc00e090 con 0x7f21c419e380 2024-09-11T23:09:45.125 INFO:teuthology.orchestra.run.smithi037.stdout:# minimal ceph.conf for 8b03efce-7092-11ef-bcea-c7b262605968 2024-09-11T23:09:45.125 INFO:teuthology.orchestra.run.smithi037.stdout:[global] 2024-09-11T23:09:45.125 INFO:teuthology.orchestra.run.smithi037.stdout: fsid = 8b03efce-7092-11ef-bcea-c7b262605968 2024-09-11T23:09:45.125 INFO:teuthology.orchestra.run.smithi037.stdout: mon_host = [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] 2024-09-11T23:09:45.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:45.125+0000 7f21ca200640 1 -- 172.21.15.37:0/555962798 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f21a80394f0 msgr2=0x7f21a803b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:09:45.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:45.125+0000 7f21ca200640 1 --2- 172.21.15.37:0/555962798 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f21a80394f0 0x7f21a803b9b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f21b4005ab0 tx=0x7f21b4005a20 comp rx=0 tx=0).stop 2024-09-11T23:09:45.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:45.125+0000 7f21ca200640 1 -- 172.21.15.37:0/555962798 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f21c419e380 msgr2=0x7f21c419e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:09:45.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:45.125+0000 7f21ca200640 1 --2- 172.21.15.37:0/555962798 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f21c419e380 0x7f21c419e830 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f21bc00bd50 tx=0x7f21bc00be40 comp rx=0 tx=0).stop 2024-09-11T23:09:45.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:45.125+0000 7f21ca200640 1 -- 172.21.15.37:0/555962798 shutdown_connections 2024-09-11T23:09:45.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:45.125+0000 7f21ca200640 1 --2- 172.21.15.37:0/555962798 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f21a80394f0 0x7f21a803b9b0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:09:45.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:45.125+0000 7f21ca200640 1 --2- 172.21.15.37:0/555962798 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f21c419e380 0x7f21c419e830 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:09:45.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:45.125+0000 7f21ca200640 1 --2- 172.21.15.37:0/555962798 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21c4199ab0 0x7f21c419de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:09:45.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:45.125+0000 7f21ca200640 1 --2- 172.21.15.37:0/555962798 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f21c4107660 0x7f21c4199570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:09:45.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:45.125+0000 7f21ca200640 1 -- 172.21.15.37:0/555962798 >> 172.21.15.37:0/555962798 conn(0x7f21c40fd290 msgr2=0x7f21c4074420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:09:45.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:45.126+0000 7f21ca200640 1 -- 172.21.15.37:0/555962798 shutdown_connections 2024-09-11T23:09:45.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:45.126+0000 7f21ca200640 1 -- 172.21.15.37:0/555962798 wait complete. 2024-09-11T23:09:45.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:45 smithi123 ceph-mon[35438]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:09:45.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:45 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T23:09:45.502 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:45 smithi123 ceph-mon[35438]: mon.c calling monitor election 2024-09-11T23:09:45.502 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:45 smithi123 ceph-mon[35438]: mon.a calling monitor election 2024-09-11T23:09:45.502 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:45 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:09:45.502 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:45 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T23:09:45.502 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:45 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:09:45.502 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:45 smithi123 ceph-mon[35438]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:09:45.502 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:45 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:09:45.502 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:45 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:09:45.502 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:45 smithi123 ceph-mon[35438]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:09:45.502 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:45 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:09:45.502 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:45 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:09:45.502 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:45 smithi123 ceph-mon[35438]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-11T23:09:45.502 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:45 smithi123 ceph-mon[35438]: monmap epoch 3 2024-09-11T23:09:45.503 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:45 smithi123 ceph-mon[35438]: fsid 8b03efce-7092-11ef-bcea-c7b262605968 2024-09-11T23:09:45.503 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:45 smithi123 ceph-mon[35438]: last_changed 2024-09-11T23:09:37.999511+0000 2024-09-11T23:09:45.503 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:45 smithi123 ceph-mon[35438]: created 2024-09-11T23:07:45.034404+0000 2024-09-11T23:09:45.503 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:45 smithi123 ceph-mon[35438]: min_mon_release 19 (squid) 2024-09-11T23:09:45.503 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:45 smithi123 ceph-mon[35438]: election_strategy: 1 2024-09-11T23:09:45.503 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:45 smithi123 ceph-mon[35438]: 0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-11T23:09:45.503 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:45 smithi123 ceph-mon[35438]: 1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.c 2024-09-11T23:09:45.503 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:45 smithi123 ceph-mon[35438]: 2: [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] mon.b 2024-09-11T23:09:45.503 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:45 smithi123 ceph-mon[35438]: fsmap 2024-09-11T23:09:45.503 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:45 smithi123 ceph-mon[35438]: osdmap e4: 0 total, 0 up, 0 in 2024-09-11T23:09:45.503 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:45 smithi123 ceph-mon[35438]: mgrmap e13: x(active, since 51s) 2024-09-11T23:09:45.503 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:45 smithi123 ceph-mon[35438]: overall HEALTH_OK 2024-09-11T23:09:45.503 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:45 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:45.504 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:45 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:45.504 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:45 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:45.504 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:45 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:45.504 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:45 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:09:45.504 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:45 smithi123 ceph-mon[35438]: from='client.? 172.21.15.160:0/2449575093' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-11T23:09:45.504 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:45 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:09:45.900 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-11T23:09:45.900 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-11T23:09:45.900 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/ceph/ceph.conf 2024-09-11T23:09:45.959 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-11T23:09:45.959 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-11T23:09:46.059 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-11T23:09:46.059 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/etc/ceph/ceph.conf 2024-09-11T23:09:46.088 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-11T23:09:46.088 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-11T23:09:46.125 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:45 smithi123 ceph-mon[35438]: mon.b calling monitor election 2024-09-11T23:09:46.125 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:45 smithi123 ceph-mon[35438]: mon.b calling monitor election 2024-09-11T23:09:46.125 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:45 smithi123 ceph-mon[35438]: mon.c calling monitor election 2024-09-11T23:09:46.125 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:45 smithi123 ceph-mon[35438]: mon.a calling monitor election 2024-09-11T23:09:46.125 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:45 smithi123 ceph-mon[35438]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-11T23:09:46.125 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:45 smithi123 ceph-mon[35438]: monmap epoch 3 2024-09-11T23:09:46.125 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:45 smithi123 ceph-mon[35438]: fsid 8b03efce-7092-11ef-bcea-c7b262605968 2024-09-11T23:09:46.125 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:45 smithi123 ceph-mon[35438]: last_changed 2024-09-11T23:09:37.999511+0000 2024-09-11T23:09:46.126 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:45 smithi123 ceph-mon[35438]: created 2024-09-11T23:07:45.034404+0000 2024-09-11T23:09:46.126 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:45 smithi123 ceph-mon[35438]: min_mon_release 19 (squid) 2024-09-11T23:09:46.126 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:45 smithi123 ceph-mon[35438]: election_strategy: 1 2024-09-11T23:09:46.126 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:45 smithi123 ceph-mon[35438]: 0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-11T23:09:46.126 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:45 smithi123 ceph-mon[35438]: 1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.c 2024-09-11T23:09:46.126 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:45 smithi123 ceph-mon[35438]: 2: [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] mon.b 2024-09-11T23:09:46.126 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:45 smithi123 ceph-mon[35438]: fsmap 2024-09-11T23:09:46.126 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:45 smithi123 ceph-mon[35438]: osdmap e4: 0 total, 0 up, 0 in 2024-09-11T23:09:46.126 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:45 smithi123 ceph-mon[35438]: mgrmap e13: x(active, since 53s) 2024-09-11T23:09:46.126 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:45 smithi123 ceph-mon[35438]: overall HEALTH_OK 2024-09-11T23:09:46.126 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:45 smithi123 ceph-mon[35438]: from='client.? 172.21.15.37:0/555962798' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:09:46.126 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:45 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:46.126 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:45 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:46.126 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:45 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:46.127 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:45 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:46.127 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:45 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:46.127 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:45 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:46.152 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-11T23:09:46.152 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/etc/ceph/ceph.conf 2024-09-11T23:09:46.179 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:45 smithi160 ceph-mon[35055]: mon.b calling monitor election 2024-09-11T23:09:46.179 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:45 smithi160 ceph-mon[35055]: mon.b calling monitor election 2024-09-11T23:09:46.179 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:45 smithi160 ceph-mon[35055]: mon.c calling monitor election 2024-09-11T23:09:46.179 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:45 smithi160 ceph-mon[35055]: mon.a calling monitor election 2024-09-11T23:09:46.179 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:45 smithi160 ceph-mon[35055]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-11T23:09:46.179 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:45 smithi160 ceph-mon[35055]: monmap epoch 3 2024-09-11T23:09:46.179 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:45 smithi160 ceph-mon[35055]: fsid 8b03efce-7092-11ef-bcea-c7b262605968 2024-09-11T23:09:46.179 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:45 smithi160 ceph-mon[35055]: last_changed 2024-09-11T23:09:37.999511+0000 2024-09-11T23:09:46.179 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:45 smithi160 ceph-mon[35055]: created 2024-09-11T23:07:45.034404+0000 2024-09-11T23:09:46.179 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:45 smithi160 ceph-mon[35055]: min_mon_release 19 (squid) 2024-09-11T23:09:46.179 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:45 smithi160 ceph-mon[35055]: election_strategy: 1 2024-09-11T23:09:46.179 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:45 smithi160 ceph-mon[35055]: 0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-11T23:09:46.180 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:45 smithi160 ceph-mon[35055]: 1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.c 2024-09-11T23:09:46.180 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:45 smithi160 ceph-mon[35055]: 2: [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] mon.b 2024-09-11T23:09:46.180 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:45 smithi160 ceph-mon[35055]: fsmap 2024-09-11T23:09:46.180 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:45 smithi160 ceph-mon[35055]: osdmap e4: 0 total, 0 up, 0 in 2024-09-11T23:09:46.180 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:45 smithi160 ceph-mon[35055]: mgrmap e13: x(active, since 53s) 2024-09-11T23:09:46.180 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:45 smithi160 ceph-mon[35055]: overall HEALTH_OK 2024-09-11T23:09:46.180 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:45 smithi160 ceph-mon[35055]: from='client.? 172.21.15.37:0/555962798' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:09:46.180 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:45 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:46.180 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:45 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:46.180 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:45 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:46.180 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:45 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:46.180 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:45 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:46.180 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:45 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:46.183 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-11T23:09:46.183 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-11T23:09:46.252 INFO:tasks.cephadm:Adding mgr.x on smithi037 2024-09-11T23:09:46.252 INFO:tasks.cephadm:Adding mgr.y on smithi123 2024-09-11T23:09:46.252 INFO:tasks.cephadm:Adding mgr.z on smithi160 2024-09-11T23:09:46.252 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph orch apply mgr '3;smithi037=x;smithi123=y;smithi160=z' 2024-09-11T23:09:46.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:45 smithi037 ceph-mon[30630]: mon.b calling monitor election 2024-09-11T23:09:46.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:45 smithi037 ceph-mon[30630]: mon.b calling monitor election 2024-09-11T23:09:46.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:45 smithi037 ceph-mon[30630]: mon.c calling monitor election 2024-09-11T23:09:46.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:45 smithi037 ceph-mon[30630]: mon.a calling monitor election 2024-09-11T23:09:46.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:45 smithi037 ceph-mon[30630]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-11T23:09:46.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:45 smithi037 ceph-mon[30630]: monmap epoch 3 2024-09-11T23:09:46.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:45 smithi037 ceph-mon[30630]: fsid 8b03efce-7092-11ef-bcea-c7b262605968 2024-09-11T23:09:46.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:45 smithi037 ceph-mon[30630]: last_changed 2024-09-11T23:09:37.999511+0000 2024-09-11T23:09:46.316 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:45 smithi037 ceph-mon[30630]: created 2024-09-11T23:07:45.034404+0000 2024-09-11T23:09:46.316 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:45 smithi037 ceph-mon[30630]: min_mon_release 19 (squid) 2024-09-11T23:09:46.316 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:45 smithi037 ceph-mon[30630]: election_strategy: 1 2024-09-11T23:09:46.316 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:45 smithi037 ceph-mon[30630]: 0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-11T23:09:46.316 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:45 smithi037 ceph-mon[30630]: 1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.c 2024-09-11T23:09:46.316 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:45 smithi037 ceph-mon[30630]: 2: [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] mon.b 2024-09-11T23:09:46.316 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:45 smithi037 ceph-mon[30630]: fsmap 2024-09-11T23:09:46.316 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:45 smithi037 ceph-mon[30630]: osdmap e4: 0 total, 0 up, 0 in 2024-09-11T23:09:46.316 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:45 smithi037 ceph-mon[30630]: mgrmap e13: x(active, since 53s) 2024-09-11T23:09:46.316 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:45 smithi037 ceph-mon[30630]: overall HEALTH_OK 2024-09-11T23:09:46.316 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:45 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/555962798' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:09:46.316 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:45 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:46.316 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:45 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:46.316 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:45 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:46.317 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:45 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:46.317 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:45 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:46.317 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:45 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:46.535 INFO:teuthology.orchestra.run.smithi160.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T23:09:46.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:46 smithi160 ceph-mon[35055]: Updating smithi160:/var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T23:09:46.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:46 smithi160 ceph-mon[35055]: Updating smithi123:/var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T23:09:46.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:46 smithi160 ceph-mon[35055]: Updating smithi037:/var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T23:09:46.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:46 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:46.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:46 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:09:46.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:46 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:46.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:46 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:46.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:46 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:46.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:46 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:46.935 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:46 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-11T23:09:46.935 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:46 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-11T23:09:46.935 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:46 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:09:46.942 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:46.934+0000 7ff91fa8c640 1 -- 172.21.15.160:0/3302278691 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff918102240 msgr2=0x7ff918104630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:09:46.942 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:46.934+0000 7ff91fa8c640 1 --2- 172.21.15.160:0/3302278691 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff918102240 0x7ff918104630 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff90c009880 tx=0x7ff90c02a5d0 comp rx=0 tx=0).stop 2024-09-11T23:09:46.943 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:46.934+0000 7ff91fa8c640 1 -- 172.21.15.160:0/3302278691 shutdown_connections 2024-09-11T23:09:46.943 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:46.934+0000 7ff91fa8c640 1 --2- 172.21.15.160:0/3302278691 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff918102240 0x7ff918104630 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:09:46.943 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:46.934+0000 7ff91fa8c640 1 -- 172.21.15.160:0/3302278691 >> 172.21.15.160:0/3302278691 conn(0x7ff9180fbda0 msgr2=0x7ff9180fe1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:09:46.943 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:46.934+0000 7ff91fa8c640 1 -- 172.21.15.160:0/3302278691 shutdown_connections 2024-09-11T23:09:46.943 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:46.934+0000 7ff91fa8c640 1 -- 172.21.15.160:0/3302278691 wait complete. 2024-09-11T23:09:46.943 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:46.934+0000 7ff91fa8c640 1 Processor -- start 2024-09-11T23:09:46.943 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:46.934+0000 7ff91fa8c640 1 -- start start 2024-09-11T23:09:46.943 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:46.935+0000 7ff91fa8c640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff918102240 0x7ff918196f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:09:46.943 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:46.935+0000 7ff91fa8c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9181974a0 0x7ff91819c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:09:46.943 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:46.935+0000 7ff91fa8c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff918197920 0x7ff91819eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:09:46.944 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:46.935+0000 7ff91fa8c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff9181077a0 con 0x7ff9181974a0 2024-09-11T23:09:46.944 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:46.935+0000 7ff91fa8c640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7ff918107620 con 0x7ff918197920 2024-09-11T23:09:46.944 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:46.935+0000 7ff91fa8c640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7ff918107920 con 0x7ff918102240 2024-09-11T23:09:46.944 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:46.935+0000 7ff91d828640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff918102240 0x7ff918196f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:09:46.944 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:46.935+0000 7ff91d828640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff918102240 0x7ff918196f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:45724/0 (socket says 172.21.15.160:45724) 2024-09-11T23:09:46.944 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:46.935+0000 7ff91d828640 1 -- 172.21.15.160:0/1577958856 learned_addr learned my addr 172.21.15.160:0/1577958856 (peer_addr_for_me v2:172.21.15.160:0/0) 2024-09-11T23:09:46.944 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:46.935+0000 7ff91d027640 1 --2- 172.21.15.160:0/1577958856 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9181974a0 0x7ff91819c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:09:46.944 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:46.935+0000 7ff91d828640 1 -- 172.21.15.160:0/1577958856 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff918197920 msgr2=0x7ff91819eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:09:46.944 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:46.935+0000 7ff91d828640 1 --2- 172.21.15.160:0/1577958856 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff918197920 0x7ff91819eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:09:46.944 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:46.935+0000 7ff91d828640 1 -- 172.21.15.160:0/1577958856 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9181974a0 msgr2=0x7ff91819c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:09:46.944 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:46.935+0000 7ff91d828640 1 --2- 172.21.15.160:0/1577958856 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9181974a0 0x7ff91819c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:09:46.944 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:46.935+0000 7ff91d828640 1 -- 172.21.15.160:0/1577958856 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff91819f360 con 0x7ff918102240 2024-09-11T23:09:46.944 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:46.935+0000 7ff91d027640 1 --2- 172.21.15.160:0/1577958856 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9181974a0 0x7ff91819c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:09:46.945 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:46.935+0000 7ff91d828640 1 --2- 172.21.15.160:0/1577958856 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff918102240 0x7ff918196f60 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff90c000c00 tx=0x7ff90c004430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:09:46.945 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:46.935+0000 7ff90affd640 1 -- 172.21.15.160:0/1577958856 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff90c03f030 con 0x7ff918102240 2024-09-11T23:09:46.945 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:46.935+0000 7ff90affd640 1 -- 172.21.15.160:0/1577958856 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff90c003ce0 con 0x7ff918102240 2024-09-11T23:09:46.945 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:46.935+0000 7ff91fa8c640 1 -- 172.21.15.160:0/1577958856 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff91819f5f0 con 0x7ff918102240 2024-09-11T23:09:46.945 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:46.935+0000 7ff90affd640 1 -- 172.21.15.160:0/1577958856 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff90c035070 con 0x7ff918102240 2024-09-11T23:09:46.945 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:46.936+0000 7ff91fa8c640 1 -- 172.21.15.160:0/1577958856 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff91819fba0 con 0x7ff918102240 2024-09-11T23:09:46.945 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:46.936+0000 7ff90affd640 1 -- 172.21.15.160:0/1577958856 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7ff90c042030 con 0x7ff918102240 2024-09-11T23:09:46.945 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:46.936+0000 7ff90affd640 1 --2- 172.21.15.160:0/1577958856 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7ff9040394f0 0x7ff90403b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:09:46.945 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:46.936+0000 7ff90affd640 1 -- 172.21.15.160:0/1577958856 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7ff90c06c9f0 con 0x7ff918102240 2024-09-11T23:09:46.945 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:46.937+0000 7ff91fa8c640 1 -- 172.21.15.160:0/1577958856 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff918190560 con 0x7ff918102240 2024-09-11T23:09:46.945 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:46.937+0000 7ff91d027640 1 --2- 172.21.15.160:0/1577958856 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7ff9040394f0 0x7ff90403b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:09:46.945 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:46.937+0000 7ff91d027640 1 --2- 172.21.15.160:0/1577958856 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7ff9040394f0 0x7ff90403b9b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff914006fd0 tx=0x7ff914008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:09:46.945 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:46.941+0000 7ff90affd640 1 -- 172.21.15.160:0/1577958856 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff90c04c350 con 0x7ff918102240 2024-09-11T23:09:47.121 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:47.120+0000 7ff91fa8c640 1 -- 172.21.15.160:0/1577958856 --> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi037=x;smithi123=y;smithi160=z", "target": ["mon-mgr", ""]}) -- 0x7ff9180626c0 con 0x7ff9040394f0 2024-09-11T23:09:47.126 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:47.126+0000 7ff90affd640 1 -- 172.21.15.160:0/1577958856 <== mgr.14150 v2:172.21.15.37:6800/31543269 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7ff9180626c0 con 0x7ff9040394f0 2024-09-11T23:09:47.127 INFO:teuthology.orchestra.run.smithi160.stdout:Scheduled mgr update... 2024-09-11T23:09:47.129 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:47.128+0000 7ff91fa8c640 1 -- 172.21.15.160:0/1577958856 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7ff9040394f0 msgr2=0x7ff90403b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:09:47.129 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:47.128+0000 7ff91fa8c640 1 --2- 172.21.15.160:0/1577958856 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7ff9040394f0 0x7ff90403b9b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff914006fd0 tx=0x7ff914008040 comp rx=0 tx=0).stop 2024-09-11T23:09:47.129 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:47.128+0000 7ff91fa8c640 1 -- 172.21.15.160:0/1577958856 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff918102240 msgr2=0x7ff918196f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:09:47.129 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:47.128+0000 7ff91fa8c640 1 --2- 172.21.15.160:0/1577958856 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff918102240 0x7ff918196f60 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff90c000c00 tx=0x7ff90c004430 comp rx=0 tx=0).stop 2024-09-11T23:09:47.129 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:47.128+0000 7ff91fa8c640 1 -- 172.21.15.160:0/1577958856 shutdown_connections 2024-09-11T23:09:47.129 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:47.128+0000 7ff91fa8c640 1 --2- 172.21.15.160:0/1577958856 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7ff9040394f0 0x7ff90403b9b0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:09:47.129 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:47.128+0000 7ff91fa8c640 1 --2- 172.21.15.160:0/1577958856 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff918197920 0x7ff91819eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:09:47.130 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:47.128+0000 7ff91fa8c640 1 --2- 172.21.15.160:0/1577958856 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9181974a0 0x7ff91819c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:09:47.130 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:47.128+0000 7ff91fa8c640 1 --2- 172.21.15.160:0/1577958856 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff918102240 0x7ff918196f60 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:09:47.130 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:47.128+0000 7ff91fa8c640 1 -- 172.21.15.160:0/1577958856 >> 172.21.15.160:0/1577958856 conn(0x7ff9180fbda0 msgr2=0x7ff9180fc8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:09:47.130 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:47.128+0000 7ff91fa8c640 1 -- 172.21.15.160:0/1577958856 shutdown_connections 2024-09-11T23:09:47.130 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:09:47.128+0000 7ff91fa8c640 1 -- 172.21.15.160:0/1577958856 wait complete. 2024-09-11T23:09:47.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:46 smithi123 ceph-mon[35438]: Updating smithi160:/var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T23:09:47.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:46 smithi123 ceph-mon[35438]: Updating smithi123:/var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T23:09:47.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:46 smithi123 ceph-mon[35438]: Updating smithi037:/var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T23:09:47.252 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:46 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:47.252 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:46 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:09:47.252 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:46 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:47.252 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:46 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:47.252 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:46 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:47.252 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:46 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:47.252 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:46 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-11T23:09:47.252 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:46 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-11T23:09:47.252 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:46 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:09:47.253 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:46 smithi037 ceph-mon[30630]: Updating smithi160:/var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T23:09:47.253 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:46 smithi037 ceph-mon[30630]: Updating smithi123:/var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T23:09:47.254 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:46 smithi037 ceph-mon[30630]: Updating smithi037:/var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T23:09:47.254 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:46 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:47.254 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:46 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:09:47.254 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:46 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:47.254 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:46 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:47.254 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:46 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:47.254 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:46 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:47.254 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:46 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-11T23:09:47.254 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:46 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-11T23:09:47.254 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:46 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:09:47.749 DEBUG:teuthology.orchestra.run.smithi123:mgr.y> sudo journalctl -f -n 0 -u ceph-8b03efce-7092-11ef-bcea-c7b262605968@mgr.y.service 2024-09-11T23:09:47.752 DEBUG:teuthology.orchestra.run.smithi160:mgr.z> sudo journalctl -f -n 0 -u ceph-8b03efce-7092-11ef-bcea-c7b262605968@mgr.z.service 2024-09-11T23:09:47.754 INFO:tasks.cephadm:Deploying OSDs... 2024-09-11T23:09:47.754 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-11T23:09:47.754 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/scratch_devs of=/dev/stdout 2024-09-11T23:09:47.790 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-11T23:09:47.790 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_1 2024-09-11T23:09:47.866 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-11T23:09:47.866 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T23:09:47.866 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 6h/6d Inode: 634 Links: 1 2024-09-11T23:09:47.866 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T23:09:47.866 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T23:09:47.866 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2024-09-11 23:09:04.867417720 +0000 2024-09-11T23:09:47.866 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2024-09-11 23:04:40.556570947 +0000 2024-09-11T23:09:47.866 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2024-09-11 23:04:40.556570947 +0000 2024-09-11T23:09:47.866 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: 2024-09-11 23:04:40.556570947 +0000 2024-09-11T23:09:47.867 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-11T23:09:47.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:47 smithi160 ceph-mon[35055]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:09:47.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:47 smithi160 ceph-mon[35055]: Reconfiguring mon.a (unknown last config time)... 2024-09-11T23:09:47.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:47 smithi160 ceph-mon[35055]: Reconfiguring daemon mon.a on smithi037 2024-09-11T23:09:47.935 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:47 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:47.935 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:47 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:47.935 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:47 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:47.935 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:47 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:47.935 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:47 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-11T23:09:47.935 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:47 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-11T23:09:47.935 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:47 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:09:47.961 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2024-09-11T23:09:47.962 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2024-09-11T23:09:47.962 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.000273948 s, 1.9 MB/s 2024-09-11T23:09:47.964 DEBUG:teuthology.orchestra.run.smithi037:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-11T23:09:48.004 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_2 2024-09-11T23:09:48.082 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-11T23:09:48.082 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T23:09:48.082 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 6h/6d Inode: 651 Links: 1 2024-09-11T23:09:48.082 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T23:09:48.082 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T23:09:48.082 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2024-09-11 23:09:04.913417143 +0000 2024-09-11T23:09:48.082 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2024-09-11 23:04:41.026564959 +0000 2024-09-11T23:09:48.082 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2024-09-11 23:04:41.026564959 +0000 2024-09-11T23:09:48.082 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: 2024-09-11 23:04:41.026564959 +0000 2024-09-11T23:09:48.083 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-11T23:09:48.160 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:47 smithi037 ceph-mon[30630]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:09:48.160 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:47 smithi037 ceph-mon[30630]: Reconfiguring mon.a (unknown last config time)... 2024-09-11T23:09:48.160 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:47 smithi037 ceph-mon[30630]: Reconfiguring daemon mon.a on smithi037 2024-09-11T23:09:48.160 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:47 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:48.160 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:47 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:48.160 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:47 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:48.160 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:47 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:48.161 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:47 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-11T23:09:48.161 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:47 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-11T23:09:48.161 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:47 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:09:48.176 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2024-09-11T23:09:48.176 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2024-09-11T23:09:48.176 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.000341779 s, 1.5 MB/s 2024-09-11T23:09:48.178 DEBUG:teuthology.orchestra.run.smithi037:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-11T23:09:48.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:47 smithi123 ceph-mon[35438]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:09:48.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:47 smithi123 ceph-mon[35438]: Reconfiguring mon.a (unknown last config time)... 2024-09-11T23:09:48.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:47 smithi123 ceph-mon[35438]: Reconfiguring daemon mon.a on smithi037 2024-09-11T23:09:48.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:47 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:48.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:47 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:48.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:47 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:48.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:47 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:48.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:47 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-11T23:09:48.252 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:47 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-11T23:09:48.252 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:47 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:09:48.257 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_3 2024-09-11T23:09:48.335 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-11T23:09:48.335 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T23:09:48.335 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 6h/6d Inode: 671 Links: 1 2024-09-11T23:09:48.335 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T23:09:48.335 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T23:09:48.335 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2024-09-11 23:09:04.973416390 +0000 2024-09-11T23:09:48.335 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2024-09-11 23:04:41.502558894 +0000 2024-09-11T23:09:48.335 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2024-09-11 23:04:41.502558894 +0000 2024-09-11T23:09:48.335 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: 2024-09-11 23:04:41.502558894 +0000 2024-09-11T23:09:48.336 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-11T23:09:48.433 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2024-09-11T23:09:48.433 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2024-09-11T23:09:48.434 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.000272 s, 1.9 MB/s 2024-09-11T23:09:48.436 DEBUG:teuthology.orchestra.run.smithi037:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-11T23:09:48.477 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_4 2024-09-11T23:09:48.552 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-11T23:09:48.552 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T23:09:48.553 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 6h/6d Inode: 689 Links: 1 2024-09-11T23:09:48.553 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T23:09:48.553 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T23:09:48.553 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2024-09-11 23:09:05.019415812 +0000 2024-09-11T23:09:48.553 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2024-09-11 23:04:41.987552715 +0000 2024-09-11T23:09:48.553 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2024-09-11 23:04:41.988552702 +0000 2024-09-11T23:09:48.553 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: 2024-09-11 23:04:41.987552715 +0000 2024-09-11T23:09:48.553 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-11T23:09:48.647 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2024-09-11T23:09:48.647 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2024-09-11T23:09:48.647 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.000284366 s, 1.8 MB/s 2024-09-11T23:09:48.650 DEBUG:teuthology.orchestra.run.smithi037:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-11T23:09:48.686 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-11T23:09:48.687 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/scratch_devs of=/dev/stdout 2024-09-11T23:09:48.706 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-11T23:09:48.706 DEBUG:teuthology.orchestra.run.smithi123:> stat /dev/vg_nvme/lv_1 2024-09-11T23:09:48.765 INFO:teuthology.orchestra.run.smithi123.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-11T23:09:48.765 INFO:teuthology.orchestra.run.smithi123.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T23:09:48.765 INFO:teuthology.orchestra.run.smithi123.stdout:Device: 5h/5d Inode: 664 Links: 1 2024-09-11T23:09:48.766 INFO:teuthology.orchestra.run.smithi123.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T23:09:48.766 INFO:teuthology.orchestra.run.smithi123.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T23:09:48.766 INFO:teuthology.orchestra.run.smithi123.stdout:Access: 2024-09-11 23:09:37.425949906 +0000 2024-09-11T23:09:48.766 INFO:teuthology.orchestra.run.smithi123.stdout:Modify: 2024-09-11 23:04:01.427492868 +0000 2024-09-11T23:09:48.766 INFO:teuthology.orchestra.run.smithi123.stdout:Change: 2024-09-11 23:04:01.427492868 +0000 2024-09-11T23:09:48.766 INFO:teuthology.orchestra.run.smithi123.stdout: Birth: 2024-09-11 23:04:01.427492868 +0000 2024-09-11T23:09:48.766 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-11T23:09:48.833 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-11T23:09:48.834 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-11T23:09:48.834 INFO:teuthology.orchestra.run.smithi123.stderr:512 bytes copied, 0.000298738 s, 1.7 MB/s 2024-09-11T23:09:48.835 DEBUG:teuthology.orchestra.run.smithi123:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-11T23:09:48.894 DEBUG:teuthology.orchestra.run.smithi123:> stat /dev/vg_nvme/lv_2 2024-09-11T23:09:48.952 INFO:teuthology.orchestra.run.smithi123.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-11T23:09:48.952 INFO:teuthology.orchestra.run.smithi123.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T23:09:48.952 INFO:teuthology.orchestra.run.smithi123.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-11T23:09:48.952 INFO:teuthology.orchestra.run.smithi123.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T23:09:48.952 INFO:teuthology.orchestra.run.smithi123.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T23:09:48.952 INFO:teuthology.orchestra.run.smithi123.stdout:Access: 2024-09-11 23:09:37.426949883 +0000 2024-09-11T23:09:48.952 INFO:teuthology.orchestra.run.smithi123.stdout:Modify: 2024-09-11 23:04:01.756485305 +0000 2024-09-11T23:09:48.952 INFO:teuthology.orchestra.run.smithi123.stdout:Change: 2024-09-11 23:04:01.756485305 +0000 2024-09-11T23:09:48.952 INFO:teuthology.orchestra.run.smithi123.stdout: Birth: 2024-09-11 23:04:01.756485305 +0000 2024-09-11T23:09:48.952 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-11T23:09:49.018 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-11T23:09:49.018 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-11T23:09:49.018 INFO:teuthology.orchestra.run.smithi123.stderr:512 bytes copied, 0.000218866 s, 2.3 MB/s 2024-09-11T23:09:49.020 DEBUG:teuthology.orchestra.run.smithi123:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-11T23:09:49.079 DEBUG:teuthology.orchestra.run.smithi123:> stat /dev/vg_nvme/lv_3 2024-09-11T23:09:49.136 INFO:teuthology.orchestra.run.smithi123.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-11T23:09:49.136 INFO:teuthology.orchestra.run.smithi123.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T23:09:49.136 INFO:teuthology.orchestra.run.smithi123.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-11T23:09:49.136 INFO:teuthology.orchestra.run.smithi123.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T23:09:49.136 INFO:teuthology.orchestra.run.smithi123.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T23:09:49.136 INFO:teuthology.orchestra.run.smithi123.stdout:Access: 2024-09-11 23:09:37.426949883 +0000 2024-09-11T23:09:49.137 INFO:teuthology.orchestra.run.smithi123.stdout:Modify: 2024-09-11 23:04:02.078477902 +0000 2024-09-11T23:09:49.137 INFO:teuthology.orchestra.run.smithi123.stdout:Change: 2024-09-11 23:04:02.078477902 +0000 2024-09-11T23:09:49.137 INFO:teuthology.orchestra.run.smithi123.stdout: Birth: 2024-09-11 23:04:02.078477902 +0000 2024-09-11T23:09:49.137 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-11T23:09:49.180 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:48 smithi037 ceph-mon[30630]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi037=x;smithi123=y;smithi160=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:09:49.180 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:48 smithi037 ceph-mon[30630]: Saving service mgr spec with placement smithi037=x;smithi123=y;smithi160=z;count:3 2024-09-11T23:09:49.180 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:48 smithi037 ceph-mon[30630]: Reconfiguring mgr.x (unknown last config time)... 2024-09-11T23:09:49.180 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:48 smithi037 ceph-mon[30630]: Reconfiguring daemon mgr.x on smithi037 2024-09-11T23:09:49.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:48 smithi160 ceph-mon[35055]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi037=x;smithi123=y;smithi160=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:09:49.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:48 smithi160 ceph-mon[35055]: Saving service mgr spec with placement smithi037=x;smithi123=y;smithi160=z;count:3 2024-09-11T23:09:49.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:48 smithi160 ceph-mon[35055]: Reconfiguring mgr.x (unknown last config time)... 2024-09-11T23:09:49.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:48 smithi160 ceph-mon[35055]: Reconfiguring daemon mgr.x on smithi037 2024-09-11T23:09:49.199 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:48 smithi123 ceph-mon[35438]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi037=x;smithi123=y;smithi160=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:09:49.199 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:48 smithi123 ceph-mon[35438]: Saving service mgr spec with placement smithi037=x;smithi123=y;smithi160=z;count:3 2024-09-11T23:09:49.200 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:48 smithi123 ceph-mon[35438]: Reconfiguring mgr.x (unknown last config time)... 2024-09-11T23:09:49.200 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:48 smithi123 ceph-mon[35438]: Reconfiguring daemon mgr.x on smithi037 2024-09-11T23:09:49.202 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-11T23:09:49.202 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-11T23:09:49.202 INFO:teuthology.orchestra.run.smithi123.stderr:512 bytes copied, 0.000245573 s, 2.1 MB/s 2024-09-11T23:09:49.203 DEBUG:teuthology.orchestra.run.smithi123:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-11T23:09:49.262 DEBUG:teuthology.orchestra.run.smithi123:> stat /dev/vg_nvme/lv_4 2024-09-11T23:09:49.318 INFO:teuthology.orchestra.run.smithi123.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-11T23:09:49.318 INFO:teuthology.orchestra.run.smithi123.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T23:09:49.319 INFO:teuthology.orchestra.run.smithi123.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-11T23:09:49.319 INFO:teuthology.orchestra.run.smithi123.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T23:09:49.319 INFO:teuthology.orchestra.run.smithi123.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T23:09:49.319 INFO:teuthology.orchestra.run.smithi123.stdout:Access: 2024-09-11 23:09:37.427949861 +0000 2024-09-11T23:09:49.319 INFO:teuthology.orchestra.run.smithi123.stdout:Modify: 2024-09-11 23:04:02.401470477 +0000 2024-09-11T23:09:49.319 INFO:teuthology.orchestra.run.smithi123.stdout:Change: 2024-09-11 23:04:02.401470477 +0000 2024-09-11T23:09:49.319 INFO:teuthology.orchestra.run.smithi123.stdout: Birth: 2024-09-11 23:04:02.401470477 +0000 2024-09-11T23:09:49.319 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-11T23:09:49.383 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-11T23:09:49.384 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-11T23:09:49.384 INFO:teuthology.orchestra.run.smithi123.stderr:512 bytes copied, 0.000265328 s, 1.9 MB/s 2024-09-11T23:09:49.385 DEBUG:teuthology.orchestra.run.smithi123:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-11T23:09:49.444 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-11T23:09:49.444 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/scratch_devs of=/dev/stdout 2024-09-11T23:09:49.464 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-11T23:09:49.464 DEBUG:teuthology.orchestra.run.smithi160:> stat /dev/vg_nvme/lv_1 2024-09-11T23:09:49.523 INFO:teuthology.orchestra.run.smithi160.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-11T23:09:49.523 INFO:teuthology.orchestra.run.smithi160.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T23:09:49.523 INFO:teuthology.orchestra.run.smithi160.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-11T23:09:49.523 INFO:teuthology.orchestra.run.smithi160.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T23:09:49.523 INFO:teuthology.orchestra.run.smithi160.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T23:09:49.523 INFO:teuthology.orchestra.run.smithi160.stdout:Access: 2024-09-11 23:09:28.746885142 +0000 2024-09-11T23:09:49.523 INFO:teuthology.orchestra.run.smithi160.stdout:Modify: 2024-09-11 23:04:08.846982028 +0000 2024-09-11T23:09:49.524 INFO:teuthology.orchestra.run.smithi160.stdout:Change: 2024-09-11 23:04:08.846982028 +0000 2024-09-11T23:09:49.524 INFO:teuthology.orchestra.run.smithi160.stdout: Birth: 2024-09-11 23:04:08.846982028 +0000 2024-09-11T23:09:49.524 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-11T23:09:49.592 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records in 2024-09-11T23:09:49.592 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records out 2024-09-11T23:09:49.593 INFO:teuthology.orchestra.run.smithi160.stderr:512 bytes copied, 0.000312215 s, 1.6 MB/s 2024-09-11T23:09:49.594 DEBUG:teuthology.orchestra.run.smithi160:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-11T23:09:49.653 DEBUG:teuthology.orchestra.run.smithi160:> stat /dev/vg_nvme/lv_2 2024-09-11T23:09:49.712 INFO:teuthology.orchestra.run.smithi160.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-11T23:09:49.712 INFO:teuthology.orchestra.run.smithi160.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T23:09:49.712 INFO:teuthology.orchestra.run.smithi160.stdout:Device: 5h/5d Inode: 683 Links: 1 2024-09-11T23:09:49.712 INFO:teuthology.orchestra.run.smithi160.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T23:09:49.713 INFO:teuthology.orchestra.run.smithi160.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T23:09:49.713 INFO:teuthology.orchestra.run.smithi160.stdout:Access: 2024-09-11 23:09:28.746885142 +0000 2024-09-11T23:09:49.713 INFO:teuthology.orchestra.run.smithi160.stdout:Modify: 2024-09-11 23:04:09.164978096 +0000 2024-09-11T23:09:49.713 INFO:teuthology.orchestra.run.smithi160.stdout:Change: 2024-09-11 23:04:09.164978096 +0000 2024-09-11T23:09:49.713 INFO:teuthology.orchestra.run.smithi160.stdout: Birth: 2024-09-11 23:04:09.164978096 +0000 2024-09-11T23:09:49.713 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-11T23:09:49.778 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records in 2024-09-11T23:09:49.778 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records out 2024-09-11T23:09:49.779 INFO:teuthology.orchestra.run.smithi160.stderr:512 bytes copied, 0.000251174 s, 2.0 MB/s 2024-09-11T23:09:49.780 DEBUG:teuthology.orchestra.run.smithi160:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-11T23:09:49.838 DEBUG:teuthology.orchestra.run.smithi160:> stat /dev/vg_nvme/lv_3 2024-09-11T23:09:49.896 INFO:teuthology.orchestra.run.smithi160.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-11T23:09:49.896 INFO:teuthology.orchestra.run.smithi160.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T23:09:49.896 INFO:teuthology.orchestra.run.smithi160.stdout:Device: 5h/5d Inode: 702 Links: 1 2024-09-11T23:09:49.896 INFO:teuthology.orchestra.run.smithi160.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T23:09:49.896 INFO:teuthology.orchestra.run.smithi160.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T23:09:49.896 INFO:teuthology.orchestra.run.smithi160.stdout:Access: 2024-09-11 23:09:28.746885142 +0000 2024-09-11T23:09:49.896 INFO:teuthology.orchestra.run.smithi160.stdout:Modify: 2024-09-11 23:04:09.485974127 +0000 2024-09-11T23:09:49.897 INFO:teuthology.orchestra.run.smithi160.stdout:Change: 2024-09-11 23:04:09.485974127 +0000 2024-09-11T23:09:49.897 INFO:teuthology.orchestra.run.smithi160.stdout: Birth: 2024-09-11 23:04:09.485974127 +0000 2024-09-11T23:09:49.897 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-11T23:09:49.923 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:49 smithi123 ceph-mon[35438]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:09:49.924 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:49 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:49.924 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:49 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:49.924 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:49 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-11T23:09:49.924 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:49 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-11T23:09:49.924 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:49 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:09:49.961 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records in 2024-09-11T23:09:49.961 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records out 2024-09-11T23:09:49.961 INFO:teuthology.orchestra.run.smithi160.stderr:512 bytes copied, 0.000213756 s, 2.4 MB/s 2024-09-11T23:09:49.962 DEBUG:teuthology.orchestra.run.smithi160:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-11T23:09:50.020 DEBUG:teuthology.orchestra.run.smithi160:> stat /dev/vg_nvme/lv_4 2024-09-11T23:09:50.076 INFO:teuthology.orchestra.run.smithi160.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-11T23:09:50.076 INFO:teuthology.orchestra.run.smithi160.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T23:09:50.076 INFO:teuthology.orchestra.run.smithi160.stdout:Device: 5h/5d Inode: 719 Links: 1 2024-09-11T23:09:50.077 INFO:teuthology.orchestra.run.smithi160.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T23:09:50.077 INFO:teuthology.orchestra.run.smithi160.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T23:09:50.077 INFO:teuthology.orchestra.run.smithi160.stdout:Access: 2024-09-11 23:09:28.747885130 +0000 2024-09-11T23:09:50.077 INFO:teuthology.orchestra.run.smithi160.stdout:Modify: 2024-09-11 23:04:09.811970097 +0000 2024-09-11T23:09:50.077 INFO:teuthology.orchestra.run.smithi160.stdout:Change: 2024-09-11 23:04:09.811970097 +0000 2024-09-11T23:09:50.077 INFO:teuthology.orchestra.run.smithi160.stdout: Birth: 2024-09-11 23:04:09.811970097 +0000 2024-09-11T23:09:50.077 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-11T23:09:50.138 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:49 smithi160 ceph-mon[35055]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:09:50.138 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:49 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:50.138 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:49 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:50.138 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:49 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-11T23:09:50.138 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:49 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-11T23:09:50.139 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:49 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:09:50.140 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records in 2024-09-11T23:09:50.140 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records out 2024-09-11T23:09:50.141 INFO:teuthology.orchestra.run.smithi160.stderr:512 bytes copied, 0.000281566 s, 1.8 MB/s 2024-09-11T23:09:50.142 DEBUG:teuthology.orchestra.run.smithi160:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-11T23:09:50.199 INFO:tasks.cephadm:Deploying osd.0 on smithi037 with /dev/vg_nvme/lv_4... 2024-09-11T23:09:50.199 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-11T23:09:50.254 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:49 smithi037 ceph-mon[30630]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:09:50.254 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:49 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:50.254 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:49 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:50.254 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:49 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-11T23:09:50.254 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:49 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-11T23:09:50.254 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:49 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:09:50.576 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:09:50.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:50 smithi037 ceph-mon[30630]: Reconfiguring mon.b (monmap changed)... 2024-09-11T23:09:50.975 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:50 smithi037 ceph-mon[30630]: Reconfiguring daemon mon.b on smithi123 2024-09-11T23:09:50.975 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:50 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:50.975 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:50 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:50.975 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:50 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-11T23:09:50.975 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:50 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-11T23:09:50.975 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:50 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:09:51.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:50 smithi160 ceph-mon[35055]: Reconfiguring mon.b (monmap changed)... 2024-09-11T23:09:51.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:50 smithi160 ceph-mon[35055]: Reconfiguring daemon mon.b on smithi123 2024-09-11T23:09:51.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:50 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:51.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:50 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:51.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:50 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-11T23:09:51.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:50 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-11T23:09:51.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:50 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:09:51.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:50 smithi123 ceph-mon[35438]: Reconfiguring mon.b (monmap changed)... 2024-09-11T23:09:51.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:50 smithi123 ceph-mon[35438]: Reconfiguring daemon mon.b on smithi123 2024-09-11T23:09:51.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:50 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:51.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:50 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:51.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:50 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-11T23:09:51.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:50 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-11T23:09:51.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:50 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:09:51.970 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:51 smithi037 ceph-mon[30630]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:09:51.971 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:51 smithi037 ceph-mon[30630]: Reconfiguring mon.c (monmap changed)... 2024-09-11T23:09:51.971 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:51 smithi037 ceph-mon[30630]: Reconfiguring daemon mon.c on smithi160 2024-09-11T23:09:51.971 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:51 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:51.971 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:51 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:51.971 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:51 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:09:51.971 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:51 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:09:51.971 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:51 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:09:51.971 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:51 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:51.971 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:51 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-11T23:09:51.971 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:51 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-11T23:09:51.971 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:51 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-11T23:09:51.971 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:51 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:09:52.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:51 smithi160 ceph-mon[35055]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:09:52.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:51 smithi160 ceph-mon[35055]: Reconfiguring mon.c (monmap changed)... 2024-09-11T23:09:52.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:51 smithi160 ceph-mon[35055]: Reconfiguring daemon mon.c on smithi160 2024-09-11T23:09:52.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:51 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:52.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:51 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:52.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:51 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:09:52.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:51 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:09:52.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:51 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:09:52.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:51 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:52.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:51 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-11T23:09:52.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:51 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-11T23:09:52.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:51 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-11T23:09:52.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:51 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:09:52.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:51 smithi123 ceph-mon[35438]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:09:52.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:51 smithi123 ceph-mon[35438]: Reconfiguring mon.c (monmap changed)... 2024-09-11T23:09:52.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:51 smithi123 ceph-mon[35438]: Reconfiguring daemon mon.c on smithi160 2024-09-11T23:09:52.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:51 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:52.252 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:51 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:52.252 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:51 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:09:52.252 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:51 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:09:52.252 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:51 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:09:52.252 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:51 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:52.252 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:51 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-11T23:09:52.252 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:51 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-11T23:09:52.252 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:51 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-11T23:09:52.252 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:51 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:09:53.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:52 smithi037 ceph-mon[30630]: Deploying daemon mgr.z on smithi160 2024-09-11T23:09:53.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:52 smithi160 ceph-mon[35055]: Deploying daemon mgr.z on smithi160 2024-09-11T23:09:53.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:52 smithi123 ceph-mon[35438]: Deploying daemon mgr.z on smithi160 2024-09-11T23:09:53.466 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:09:53.497 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi037:vg_nvme/lv_4 2024-09-11T23:09:53.860 INFO:journalctl@ceph.mgr.z.smithi160.stdout:Sep 11 23:09:53 smithi160 systemd[1]: Starting Ceph mgr.z for 8b03efce-7092-11ef-bcea-c7b262605968... 2024-09-11T23:09:53.864 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:09:54.120 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:53 smithi160 ceph-mon[35055]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:09:54.120 INFO:journalctl@ceph.mgr.z.smithi160.stdout:Sep 11 23:09:53 smithi160 podman[36846]: 2024-09-11 23:09:53.859747415 +0000 UTC m=+0.112963543 container create 16f8fc961ace97ea3195c2bd3d15ca25d183d4b8b05659df36f266a23ad6e1f8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-z, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-11T23:09:54.120 INFO:journalctl@ceph.mgr.z.smithi160.stdout:Sep 11 23:09:53 smithi160 podman[36846]: 2024-09-11 23:09:53.762947507 +0000 UTC m=+0.016163602 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T23:09:54.120 INFO:journalctl@ceph.mgr.z.smithi160.stdout:Sep 11 23:09:54 smithi160 podman[36846]: 2024-09-11 23:09:54.037164976 +0000 UTC m=+0.290381070 container init 16f8fc961ace97ea3195c2bd3d15ca25d183d4b8b05659df36f266a23ad6e1f8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-z, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-11T23:09:54.120 INFO:journalctl@ceph.mgr.z.smithi160.stdout:Sep 11 23:09:54 smithi160 podman[36846]: 2024-09-11 23:09:54.040040543 +0000 UTC m=+0.293256634 container start 16f8fc961ace97ea3195c2bd3d15ca25d183d4b8b05659df36f266a23ad6e1f8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-z, ceph=True, GIT_CLEAN=True, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T23:09:54.121 INFO:journalctl@ceph.mgr.z.smithi160.stdout:Sep 11 23:09:54 smithi160 ceph-mgr[36865]: -- 172.21.15.160:0/2378721416 <== mon.1 v2:172.21.15.160:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556e15c450e0 con 0x556e15c22800 2024-09-11T23:09:54.121 INFO:journalctl@ceph.mgr.z.smithi160.stdout:Sep 11 23:09:54 smithi160 bash[36846]: 16f8fc961ace97ea3195c2bd3d15ca25d183d4b8b05659df36f266a23ad6e1f8 2024-09-11T23:09:54.140 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:53 smithi037 ceph-mon[30630]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:09:54.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:53 smithi123 ceph-mon[35438]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:09:54.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:54.361+0000 7f4ca0200640 1 -- 172.21.15.37:0/1232673786 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c98077df0 msgr2=0x7f4c98078250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:09:54.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:54.361+0000 7f4ca0200640 1 --2- 172.21.15.37:0/1232673786 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c98077df0 0x7f4c98078250 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4c84009900 tx=0x7f4c8402a3f0 comp rx=0 tx=0).stop 2024-09-11T23:09:54.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:54.361+0000 7f4ca0200640 1 -- 172.21.15.37:0/1232673786 shutdown_connections 2024-09-11T23:09:54.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:54.361+0000 7f4ca0200640 1 --2- 172.21.15.37:0/1232673786 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4c98078790 0x7f4c98079030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:09:54.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:54.361+0000 7f4ca0200640 1 --2- 172.21.15.37:0/1232673786 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c98077df0 0x7f4c98078250 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:09:54.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:54.361+0000 7f4ca0200640 1 --2- 172.21.15.37:0/1232673786 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4c98076ba0 0x7f4c98076fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:09:54.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:54.361+0000 7f4ca0200640 1 -- 172.21.15.37:0/1232673786 >> 172.21.15.37:0/1232673786 conn(0x7f4c980ff5b0 msgr2=0x7f4c981019d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:09:54.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:54.361+0000 7f4ca0200640 1 -- 172.21.15.37:0/1232673786 shutdown_connections 2024-09-11T23:09:54.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:54.361+0000 7f4ca0200640 1 -- 172.21.15.37:0/1232673786 wait complete. 2024-09-11T23:09:54.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:54.362+0000 7f4ca0200640 1 Processor -- start 2024-09-11T23:09:54.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:54.362+0000 7f4ca0200640 1 -- start start 2024-09-11T23:09:54.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:54.362+0000 7f4ca0200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c98076ba0 0x7f4c9819e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:09:54.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:54.362+0000 7f4ca0200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4c98077df0 0x7f4c9819e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:09:54.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:54.362+0000 7f4ca0200640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4c98078790 0x7f4c981a5a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:09:54.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:54.362+0000 7f4ca0200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4c98113ed0 con 0x7f4c98076ba0 2024-09-11T23:09:54.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:54.362+0000 7f4ca0200640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f4c98113d50 con 0x7f4c98077df0 2024-09-11T23:09:54.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:54.362+0000 7f4ca0200640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f4c98114050 con 0x7f4c98078790 2024-09-11T23:09:54.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:54.363+0000 7f4c9ce00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4c98077df0 0x7f4c9819e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:09:54.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:54.363+0000 7f4c9e200640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4c98078790 0x7f4c981a5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:09:54.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:54.363+0000 7f4c9ce00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4c98077df0 0x7f4c9819e9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.37:46262/0 (socket says 172.21.15.37:46262) 2024-09-11T23:09:54.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:54.363+0000 7f4c9ce00640 1 -- 172.21.15.37:0/579706995 learned_addr learned my addr 172.21.15.37:0/579706995 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:09:54.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:54.363+0000 7f4c9e200640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4c98078790 0x7f4c981a5a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.37:45556/0 (socket says 172.21.15.37:45556) 2024-09-11T23:09:54.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:54.363+0000 7f4c9d800640 1 --2- 172.21.15.37:0/579706995 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c98076ba0 0x7f4c9819e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:09:54.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:54.363+0000 7f4c9e200640 1 -- 172.21.15.37:0/579706995 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4c98077df0 msgr2=0x7f4c9819e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:09:54.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:54.363+0000 7f4c9e200640 1 --2- 172.21.15.37:0/579706995 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4c98077df0 0x7f4c9819e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:09:54.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:54.363+0000 7f4c9e200640 1 -- 172.21.15.37:0/579706995 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c98076ba0 msgr2=0x7f4c9819e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:09:54.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:54.363+0000 7f4c9e200640 1 --2- 172.21.15.37:0/579706995 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c98076ba0 0x7f4c9819e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:09:54.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:54.363+0000 7f4c9e200640 1 -- 172.21.15.37:0/579706995 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c981a60e0 con 0x7f4c98078790 2024-09-11T23:09:54.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:54.363+0000 7f4c9e200640 1 --2- 172.21.15.37:0/579706995 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4c98078790 0x7f4c981a5a70 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4c90009fd0 tx=0x7f4c9000ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:09:54.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:54.363+0000 7f4c96000640 1 -- 172.21.15.37:0/579706995 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c9000ce20 con 0x7f4c98078790 2024-09-11T23:09:54.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:54.363+0000 7f4c96000640 1 -- 172.21.15.37:0/579706995 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4c90005020 con 0x7f4c98078790 2024-09-11T23:09:54.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:54.363+0000 7f4c96000640 1 -- 172.21.15.37:0/579706995 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c90010720 con 0x7f4c98078790 2024-09-11T23:09:54.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:54.363+0000 7f4ca0200640 1 -- 172.21.15.37:0/579706995 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c981a63d0 con 0x7f4c98078790 2024-09-11T23:09:54.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:54.364+0000 7f4ca0200640 1 -- 172.21.15.37:0/579706995 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c981a6910 con 0x7f4c98078790 2024-09-11T23:09:54.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:54.365+0000 7f4c96000640 1 -- 172.21.15.37:0/579706995 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f4c90004b20 con 0x7f4c98078790 2024-09-11T23:09:54.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:54.365+0000 7f4ca0200640 1 -- 172.21.15.37:0/579706995 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c98110780 con 0x7f4c98078790 2024-09-11T23:09:54.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:54.365+0000 7f4c96000640 1 --2- 172.21.15.37:0/579706995 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f4c800392c0 0x7f4c8003b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:09:54.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:54.365+0000 7f4c96000640 1 -- 172.21.15.37:0/579706995 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f4c9004cac0 con 0x7f4c98078790 2024-09-11T23:09:54.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:54.365+0000 7f4c9d800640 1 --2- 172.21.15.37:0/579706995 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f4c800392c0 0x7f4c8003b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:09:54.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:54.366+0000 7f4c9d800640 1 --2- 172.21.15.37:0/579706995 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f4c800392c0 0x7f4c8003b780 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c009bd0 tx=0x7f4c8c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:09:54.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:54.370+0000 7f4c96000640 1 -- 172.21.15.37:0/579706995 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4c900071c0 con 0x7f4c98078790 2024-09-11T23:09:54.372 INFO:journalctl@ceph.mgr.z.smithi160.stdout:Sep 11 23:09:54 smithi160 systemd[1]: Started Ceph mgr.z for 8b03efce-7092-11ef-bcea-c7b262605968. 2024-09-11T23:09:54.372 INFO:journalctl@ceph.mgr.z.smithi160.stdout:Sep 11 23:09:54 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-z[36861]: 2024-09-11T23:09:54.162+0000 7f97178b3040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-11T23:09:54.372 INFO:journalctl@ceph.mgr.z.smithi160.stdout:Sep 11 23:09:54 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-z[36861]: 2024-09-11T23:09:54.222+0000 7f97178b3040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-11T23:09:54.372 INFO:journalctl@ceph.mgr.z.smithi160.stdout:Sep 11 23:09:54 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-z[36861]: 2024-09-11T23:09:54.372+0000 7f97178b3040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-11T23:09:54.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:54.563+0000 7f4ca0200640 1 -- 172.21.15.37:0/579706995 --> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f4c98062630 con 0x7f4c800392c0 2024-09-11T23:09:54.684 INFO:journalctl@ceph.mgr.z.smithi160.stdout:Sep 11 23:09:54 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-z[36861]: 2024-09-11T23:09:54.438+0000 7f97178b3040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-11T23:09:54.684 INFO:journalctl@ceph.mgr.z.smithi160.stdout:Sep 11 23:09:54 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-z[36861]: 2024-09-11T23:09:54.586+0000 7f97178b3040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-11T23:09:55.040 INFO:journalctl@ceph.mgr.z.smithi160.stdout:Sep 11 23:09:54 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-z[36861]: 2024-09-11T23:09:54.727+0000 7f97178b3040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-11T23:09:55.041 INFO:journalctl@ceph.mgr.z.smithi160.stdout:Sep 11 23:09:55 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-z[36861]: 2024-09-11T23:09:55.040+0000 7f97178b3040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-11T23:09:55.292 INFO:journalctl@ceph.mgr.z.smithi160.stdout:Sep 11 23:09:55 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-z[36861]: 2024-09-11T23:09:55.101+0000 7f97178b3040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-11T23:09:55.292 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:55 smithi160 ceph-mon[35055]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:09:55.293 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:55 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:55.293 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:55 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:55.293 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:55 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:55.293 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:55 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-11T23:09:55.293 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:55 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-11T23:09:55.293 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:55 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-11T23:09:55.293 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:55 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:09:55.293 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:55 smithi160 ceph-mon[35055]: Deploying daemon mgr.y on smithi123 2024-09-11T23:09:55.293 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:55 smithi160 ceph-mon[35055]: from='client.24115 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:09:55.293 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:55 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:09:55.293 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:55 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:09:55.293 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:55 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:09:55.411 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:55 smithi037 ceph-mon[30630]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:09:55.411 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:55 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:55.411 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:55 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:55.411 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:55 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:55.411 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:55 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-11T23:09:55.411 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:55 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-11T23:09:55.411 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:55 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-11T23:09:55.411 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:55 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:09:55.411 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:55 smithi037 ceph-mon[30630]: Deploying daemon mgr.y on smithi123 2024-09-11T23:09:55.411 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:55 smithi037 ceph-mon[30630]: from='client.24115 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:09:55.412 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:55 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:09:55.412 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:55 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:09:55.412 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:55 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:09:55.465 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:55 smithi123 ceph-mon[35438]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:09:55.465 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:55 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:55.465 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:55 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:55.465 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:55 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:55.466 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:55 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-11T23:09:55.466 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:55 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-11T23:09:55.466 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:55 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-11T23:09:55.466 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:55 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:09:55.466 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:55 smithi123 ceph-mon[35438]: Deploying daemon mgr.y on smithi123 2024-09-11T23:09:55.466 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:55 smithi123 ceph-mon[35438]: from='client.24115 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:09:55.466 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:55 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:09:55.466 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:55 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:09:55.466 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:55 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:09:55.675 INFO:journalctl@ceph.mgr.z.smithi160.stdout:Sep 11 23:09:55 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-z[36861]: 2024-09-11T23:09:55.292+0000 7f97178b3040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-11T23:09:56.128 INFO:journalctl@ceph.mgr.y.smithi123.stdout:Sep 11 23:09:55 smithi123 systemd[1]: Starting Ceph mgr.y for 8b03efce-7092-11ef-bcea-c7b262605968... 2024-09-11T23:09:56.411 INFO:journalctl@ceph.mgr.y.smithi123.stdout:Sep 11 23:09:56 smithi123 podman[36786]: 2024-09-11 23:09:56.029978052 +0000 UTC m=+0.015616695 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T23:09:56.412 INFO:journalctl@ceph.mgr.y.smithi123.stdout:Sep 11 23:09:56 smithi123 podman[36786]: 2024-09-11 23:09:56.133957082 +0000 UTC m=+0.119595714 container create fd87b2de8d1182542042d507b92adc250105ea27209df2bc41de9d52ec0519d8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-y, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-11T23:09:56.412 INFO:journalctl@ceph.mgr.y.smithi123.stdout:Sep 11 23:09:56 smithi123 podman[36786]: 2024-09-11 23:09:56.328174927 +0000 UTC m=+0.313813558 container init fd87b2de8d1182542042d507b92adc250105ea27209df2bc41de9d52ec0519d8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-y, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS) 2024-09-11T23:09:56.412 INFO:journalctl@ceph.mgr.y.smithi123.stdout:Sep 11 23:09:56 smithi123 podman[36786]: 2024-09-11 23:09:56.331660024 +0000 UTC m=+0.317298656 container start fd87b2de8d1182542042d507b92adc250105ea27209df2bc41de9d52ec0519d8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-y, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-11T23:09:56.412 INFO:journalctl@ceph.mgr.y.smithi123.stdout:Sep 11 23:09:56 smithi123 ceph-mgr[36805]: -- 172.21.15.123:0/349154677 <== mon.2 v2:172.21.15.123:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5581bbb8f0e0 con 0x5581bbb6d000 2024-09-11T23:09:56.412 INFO:journalctl@ceph.mgr.y.smithi123.stdout:Sep 11 23:09:56 smithi123 bash[36786]: fd87b2de8d1182542042d507b92adc250105ea27209df2bc41de9d52ec0519d8 2024-09-11T23:09:56.664 INFO:journalctl@ceph.mgr.y.smithi123.stdout:Sep 11 23:09:56 smithi123 systemd[1]: Started Ceph mgr.y for 8b03efce-7092-11ef-bcea-c7b262605968. 2024-09-11T23:09:56.664 INFO:journalctl@ceph.mgr.y.smithi123.stdout:Sep 11 23:09:56 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-y[36801]: 2024-09-11T23:09:56.451+0000 7efc19e14040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-11T23:09:56.664 INFO:journalctl@ceph.mgr.y.smithi123.stdout:Sep 11 23:09:56 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-y[36801]: 2024-09-11T23:09:56.512+0000 7efc19e14040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-11T23:09:56.665 INFO:journalctl@ceph.mgr.y.smithi123.stdout:Sep 11 23:09:56 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-y[36801]: 2024-09-11T23:09:56.663+0000 7efc19e14040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-11T23:09:56.684 INFO:journalctl@ceph.mgr.z.smithi160.stdout:Sep 11 23:09:56 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-z[36861]: 2024-09-11T23:09:56.223+0000 7f97178b3040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-11T23:09:56.684 INFO:journalctl@ceph.mgr.z.smithi160.stdout:Sep 11 23:09:56 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-z[36861]: 2024-09-11T23:09:56.293+0000 7f97178b3040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-11T23:09:57.001 INFO:journalctl@ceph.mgr.y.smithi123.stdout:Sep 11 23:09:56 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-y[36801]: 2024-09-11T23:09:56.733+0000 7efc19e14040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-11T23:09:57.001 INFO:journalctl@ceph.mgr.y.smithi123.stdout:Sep 11 23:09:56 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-y[36801]: 2024-09-11T23:09:56.896+0000 7efc19e14040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-11T23:09:57.335 INFO:journalctl@ceph.mgr.z.smithi160.stdout:Sep 11 23:09:57 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-z[36861]: 2024-09-11T23:09:57.069+0000 7f97178b3040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-11T23:09:57.335 INFO:journalctl@ceph.mgr.z.smithi160.stdout:Sep 11 23:09:57 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-z[36861]: 2024-09-11T23:09:57.185+0000 7f97178b3040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-11T23:09:57.371 INFO:journalctl@ceph.mgr.y.smithi123.stdout:Sep 11 23:09:57 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-y[36801]: 2024-09-11T23:09:57.061+0000 7efc19e14040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-11T23:09:57.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:57 smithi037 ceph-mon[30630]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:09:57.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:57 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:57.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:57 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:57.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:57 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:57.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:57 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:57.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:57 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:09:57.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:57 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:57.620 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:57 smithi160 ceph-mon[35055]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:09:57.620 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:57 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:57.620 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:57 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:57.620 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:57 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:57.620 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:57 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:57.620 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:57 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:09:57.621 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:57 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:57.621 INFO:journalctl@ceph.mgr.z.smithi160.stdout:Sep 11 23:09:57 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-z[36861]: 2024-09-11T23:09:57.333+0000 7f97178b3040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-11T23:09:57.621 INFO:journalctl@ceph.mgr.z.smithi160.stdout:Sep 11 23:09:57 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-z[36861]: 2024-09-11T23:09:57.398+0000 7f97178b3040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-11T23:09:57.621 INFO:journalctl@ceph.mgr.z.smithi160.stdout:Sep 11 23:09:57 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-z[36861]: 2024-09-11T23:09:57.550+0000 7f97178b3040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-11T23:09:57.621 INFO:journalctl@ceph.mgr.z.smithi160.stdout:Sep 11 23:09:57 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-z[36861]: 2024-09-11T23:09:57.619+0000 7f97178b3040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-11T23:09:57.646 INFO:journalctl@ceph.mgr.y.smithi123.stdout:Sep 11 23:09:57 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-y[36801]: 2024-09-11T23:09:57.386+0000 7efc19e14040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-11T23:09:57.646 INFO:journalctl@ceph.mgr.y.smithi123.stdout:Sep 11 23:09:57 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-y[36801]: 2024-09-11T23:09:57.447+0000 7efc19e14040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-11T23:09:57.647 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:57 smithi123 ceph-mon[35438]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:09:57.647 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:57 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:57.647 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:57 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:57.647 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:57 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:57.647 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:57 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:57.647 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:57 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:09:57.647 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:57 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:57.922 INFO:journalctl@ceph.mgr.z.smithi160.stdout:Sep 11 23:09:57 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-z[36861]: 2024-09-11T23:09:57.685+0000 7f97178b3040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-11T23:09:57.923 INFO:journalctl@ceph.mgr.z.smithi160.stdout:Sep 11 23:09:57 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-z[36861]: 2024-09-11T23:09:57.853+0000 7f97178b3040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-11T23:09:57.923 INFO:journalctl@ceph.mgr.z.smithi160.stdout:Sep 11 23:09:57 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-z[36861]: 2024-09-11T23:09:57.922+0000 7f97178b3040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-11T23:09:58.001 INFO:journalctl@ceph.mgr.y.smithi123.stdout:Sep 11 23:09:57 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-y[36801]: 2024-09-11T23:09:57.646+0000 7efc19e14040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-11T23:09:58.184 INFO:journalctl@ceph.mgr.z.smithi160.stdout:Sep 11 23:09:57 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-z[36861]: 2024-09-11T23:09:57.989+0000 7f97178b3040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-11T23:09:58.184 INFO:journalctl@ceph.mgr.z.smithi160.stdout:Sep 11 23:09:58 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-z[36861]: 2024-09-11T23:09:58.076+0000 7f97178b3040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-11T23:09:58.184 INFO:journalctl@ceph.mgr.z.smithi160.stdout:Sep 11 23:09:58 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-z[36861]: 2024-09-11T23:09:58.135+0000 7f97178b3040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-11T23:09:58.646 INFO:journalctl@ceph.mgr.z.smithi160.stdout:Sep 11 23:09:58 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-z[36861]: 2024-09-11T23:09:58.195+0000 7f97178b3040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-11T23:09:58.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:58 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:58.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:58 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:58.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:58 smithi160 ceph-mon[35055]: from='client.? 172.21.15.37:0/447565236' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f76ccb11-fe3b-4df1-9a71-e6ca50de80e4"}]: dispatch 2024-09-11T23:09:58.935 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:58 smithi160 ceph-mon[35055]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f76ccb11-fe3b-4df1-9a71-e6ca50de80e4"}]: dispatch 2024-09-11T23:09:58.935 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:58 smithi160 ceph-mon[35055]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f76ccb11-fe3b-4df1-9a71-e6ca50de80e4"}]': finished 2024-09-11T23:09:58.935 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:58 smithi160 ceph-mon[35055]: osdmap e5: 1 total, 0 up, 1 in 2024-09-11T23:09:58.935 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:58 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T23:09:58.935 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:58 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:58.935 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:58 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:58.935 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:58 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:09:58.935 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:58 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:09:58.935 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:58 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:58.935 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:58 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:09:58.935 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:58 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:09:58.935 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:58 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:09:58.935 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:58 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:58.935 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:58 smithi160 ceph-mon[35055]: from='client.? 172.21.15.37:0/373291402' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:09:59.001 INFO:journalctl@ceph.mgr.y.smithi123.stdout:Sep 11 23:09:58 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-y[36801]: 2024-09-11T23:09:58.531+0000 7efc19e14040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-11T23:09:59.001 INFO:journalctl@ceph.mgr.y.smithi123.stdout:Sep 11 23:09:58 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-y[36801]: 2024-09-11T23:09:58.598+0000 7efc19e14040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-11T23:09:59.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:58 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:59.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:58 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:59.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:58 smithi123 ceph-mon[35438]: from='client.? 172.21.15.37:0/447565236' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f76ccb11-fe3b-4df1-9a71-e6ca50de80e4"}]: dispatch 2024-09-11T23:09:59.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:58 smithi123 ceph-mon[35438]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f76ccb11-fe3b-4df1-9a71-e6ca50de80e4"}]: dispatch 2024-09-11T23:09:59.002 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:58 smithi123 ceph-mon[35438]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f76ccb11-fe3b-4df1-9a71-e6ca50de80e4"}]': finished 2024-09-11T23:09:59.002 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:58 smithi123 ceph-mon[35438]: osdmap e5: 1 total, 0 up, 1 in 2024-09-11T23:09:59.002 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:58 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T23:09:59.002 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:58 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:59.002 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:58 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:59.002 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:58 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:09:59.002 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:58 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:09:59.002 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:58 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:59.002 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:58 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:09:59.002 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:58 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:09:59.002 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:58 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:09:59.002 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:58 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:59.002 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:58 smithi123 ceph-mon[35438]: from='client.? 172.21.15.37:0/373291402' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:09:59.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:58 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:59.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:58 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:59.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:58 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/447565236' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f76ccb11-fe3b-4df1-9a71-e6ca50de80e4"}]: dispatch 2024-09-11T23:09:59.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:58 smithi037 ceph-mon[30630]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f76ccb11-fe3b-4df1-9a71-e6ca50de80e4"}]: dispatch 2024-09-11T23:09:59.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:58 smithi037 ceph-mon[30630]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f76ccb11-fe3b-4df1-9a71-e6ca50de80e4"}]': finished 2024-09-11T23:09:59.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:58 smithi037 ceph-mon[30630]: osdmap e5: 1 total, 0 up, 1 in 2024-09-11T23:09:59.066 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:58 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T23:09:59.066 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:58 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:59.066 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:58 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:59.066 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:58 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:09:59.066 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:58 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:09:59.066 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:58 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:59.066 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:58 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:09:59.066 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:58 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:09:59.066 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:58 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:09:59.067 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:58 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:09:59.067 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:58 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/373291402' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:09:59.434 INFO:journalctl@ceph.mgr.z.smithi160.stdout:Sep 11 23:09:58 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-z[36861]: 2024-09-11T23:09:58.987+0000 7f97178b3040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-11T23:09:59.560 INFO:journalctl@ceph.mgr.y.smithi123.stdout:Sep 11 23:09:59 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-y[36801]: 2024-09-11T23:09:59.307+0000 7efc19e14040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-11T23:09:59.561 INFO:journalctl@ceph.mgr.y.smithi123.stdout:Sep 11 23:09:59 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-y[36801]: 2024-09-11T23:09:59.420+0000 7efc19e14040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-11T23:09:59.561 INFO:journalctl@ceph.mgr.y.smithi123.stdout:Sep 11 23:09:59 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-y[36801]: 2024-09-11T23:09:59.560+0000 7efc19e14040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-11T23:09:59.836 INFO:journalctl@ceph.mgr.y.smithi123.stdout:Sep 11 23:09:59 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-y[36801]: 2024-09-11T23:09:59.621+0000 7efc19e14040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-11T23:09:59.836 INFO:journalctl@ceph.mgr.y.smithi123.stdout:Sep 11 23:09:59 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-y[36801]: 2024-09-11T23:09:59.768+0000 7efc19e14040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-11T23:09:59.836 INFO:journalctl@ceph.mgr.y.smithi123.stdout:Sep 11 23:09:59 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-y[36801]: 2024-09-11T23:09:59.836+0000 7efc19e14040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-11T23:09:59.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:09:59.912+0000 7f4c96000640 1 -- 172.21.15.37:0/579706995 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mgrmap(e 14) ==== 92060+0+0 (secure 0 0 0) 0x7f4c90017cd0 con 0x7f4c98078790 2024-09-11T23:10:00.118 INFO:journalctl@ceph.mgr.y.smithi123.stdout:Sep 11 23:09:59 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-y[36801]: 2024-09-11T23:09:59.895+0000 7efc19e14040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-11T23:10:00.118 INFO:journalctl@ceph.mgr.y.smithi123.stdout:Sep 11 23:10:00 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-y[36801]: 2024-09-11T23:10:00.053+0000 7efc19e14040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-11T23:10:00.118 INFO:journalctl@ceph.mgr.y.smithi123.stdout:Sep 11 23:10:00 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-y[36801]: 2024-09-11T23:10:00.117+0000 7efc19e14040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-11T23:10:00.118 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:59 smithi123 ceph-mon[35438]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:10:00.118 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:59 smithi123 ceph-mon[35438]: Standby manager daemon z started 2024-09-11T23:10:00.119 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:59 smithi123 ceph-mon[35438]: from='mgr.? 172.21.15.160:0/3564110784' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-11T23:10:00.119 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:59 smithi123 ceph-mon[35438]: from='mgr.? 172.21.15.160:0/3564110784' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-11T23:10:00.119 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:59 smithi123 ceph-mon[35438]: from='mgr.? 172.21.15.160:0/3564110784' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-11T23:10:00.119 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:09:59 smithi123 ceph-mon[35438]: from='mgr.? 172.21.15.160:0/3564110784' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-11T23:10:00.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:59 smithi160 ceph-mon[35055]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:10:00.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:59 smithi160 ceph-mon[35055]: Standby manager daemon z started 2024-09-11T23:10:00.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:59 smithi160 ceph-mon[35055]: from='mgr.? 172.21.15.160:0/3564110784' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-11T23:10:00.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:59 smithi160 ceph-mon[35055]: from='mgr.? 172.21.15.160:0/3564110784' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-11T23:10:00.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:59 smithi160 ceph-mon[35055]: from='mgr.? 172.21.15.160:0/3564110784' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-11T23:10:00.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:09:59 smithi160 ceph-mon[35055]: from='mgr.? 172.21.15.160:0/3564110784' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-11T23:10:00.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:59 smithi037 ceph-mon[30630]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:10:00.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:59 smithi037 ceph-mon[30630]: Standby manager daemon z started 2024-09-11T23:10:00.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:59 smithi037 ceph-mon[30630]: from='mgr.? 172.21.15.160:0/3564110784' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-11T23:10:00.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:59 smithi037 ceph-mon[30630]: from='mgr.? 172.21.15.160:0/3564110784' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-11T23:10:00.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:59 smithi037 ceph-mon[30630]: from='mgr.? 172.21.15.160:0/3564110784' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-11T23:10:00.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:09:59 smithi037 ceph-mon[30630]: from='mgr.? 172.21.15.160:0/3564110784' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-11T23:10:00.385 INFO:journalctl@ceph.mgr.y.smithi123.stdout:Sep 11 23:10:00 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-y[36801]: 2024-09-11T23:10:00.184+0000 7efc19e14040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-11T23:10:00.385 INFO:journalctl@ceph.mgr.y.smithi123.stdout:Sep 11 23:10:00 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-y[36801]: 2024-09-11T23:10:00.267+0000 7efc19e14040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-11T23:10:00.385 INFO:journalctl@ceph.mgr.y.smithi123.stdout:Sep 11 23:10:00 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-y[36801]: 2024-09-11T23:10:00.326+0000 7efc19e14040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-11T23:10:00.385 INFO:journalctl@ceph.mgr.y.smithi123.stdout:Sep 11 23:10:00 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-y[36801]: 2024-09-11T23:10:00.384+0000 7efc19e14040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-11T23:10:01.171 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:00 smithi123 ceph-mon[35438]: mgrmap e14: x(active, since 67s), standbys: z 2024-09-11T23:10:01.171 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:00 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-11T23:10:01.171 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:00 smithi123 ceph-mon[35438]: overall HEALTH_OK 2024-09-11T23:10:01.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:00 smithi160 ceph-mon[35055]: mgrmap e14: x(active, since 67s), standbys: z 2024-09-11T23:10:01.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:00 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-11T23:10:01.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:00 smithi160 ceph-mon[35055]: overall HEALTH_OK 2024-09-11T23:10:01.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:00 smithi037 ceph-mon[30630]: mgrmap e14: x(active, since 67s), standbys: z 2024-09-11T23:10:01.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:00 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-11T23:10:01.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:00 smithi037 ceph-mon[30630]: overall HEALTH_OK 2024-09-11T23:10:01.501 INFO:journalctl@ceph.mgr.y.smithi123.stdout:Sep 11 23:10:01 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-y[36801]: 2024-09-11T23:10:01.170+0000 7efc19e14040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-11T23:10:01.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:10:01.926+0000 7f4c96000640 1 -- 172.21.15.37:0/579706995 <== mon.1 v2:172.21.15.160:3300/0 8 ==== mgrmap(e 15) ==== 137777+0+0 (secure 0 0 0) 0x7f4c9001fb30 con 0x7f4c98078790 2024-09-11T23:10:02.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:01 smithi160 ceph-mon[35055]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:10:02.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:01 smithi160 ceph-mon[35055]: Standby manager daemon y started 2024-09-11T23:10:02.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:01 smithi160 ceph-mon[35055]: from='mgr.? 172.21.15.123:0/3649169826' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-11T23:10:02.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:01 smithi160 ceph-mon[35055]: from='mgr.? 172.21.15.123:0/3649169826' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-11T23:10:02.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:01 smithi160 ceph-mon[35055]: from='mgr.? 172.21.15.123:0/3649169826' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-11T23:10:02.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:01 smithi160 ceph-mon[35055]: from='mgr.? 172.21.15.123:0/3649169826' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-11T23:10:02.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:01 smithi123 ceph-mon[35438]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:10:02.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:01 smithi123 ceph-mon[35438]: Standby manager daemon y started 2024-09-11T23:10:02.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:01 smithi123 ceph-mon[35438]: from='mgr.? 172.21.15.123:0/3649169826' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-11T23:10:02.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:01 smithi123 ceph-mon[35438]: from='mgr.? 172.21.15.123:0/3649169826' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-11T23:10:02.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:01 smithi123 ceph-mon[35438]: from='mgr.? 172.21.15.123:0/3649169826' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-11T23:10:02.252 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:01 smithi123 ceph-mon[35438]: from='mgr.? 172.21.15.123:0/3649169826' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-11T23:10:02.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:01 smithi037 ceph-mon[30630]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:10:02.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:01 smithi037 ceph-mon[30630]: Standby manager daemon y started 2024-09-11T23:10:02.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:01 smithi037 ceph-mon[30630]: from='mgr.? 172.21.15.123:0/3649169826' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-11T23:10:02.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:01 smithi037 ceph-mon[30630]: from='mgr.? 172.21.15.123:0/3649169826' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-11T23:10:02.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:01 smithi037 ceph-mon[30630]: from='mgr.? 172.21.15.123:0/3649169826' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-11T23:10:02.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:01 smithi037 ceph-mon[30630]: from='mgr.? 172.21.15.123:0/3649169826' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-11T23:10:03.029 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:02 smithi037 ceph-mon[30630]: mgrmap e15: x(active, since 69s), standbys: z, y 2024-09-11T23:10:03.029 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:02 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-11T23:10:03.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:02 smithi160 ceph-mon[35055]: mgrmap e15: x(active, since 69s), standbys: z, y 2024-09-11T23:10:03.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:02 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-11T23:10:03.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:02 smithi123 ceph-mon[35438]: mgrmap e15: x(active, since 69s), standbys: z, y 2024-09-11T23:10:03.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:02 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-11T23:10:04.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:03 smithi160 ceph-mon[35055]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:10:04.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:03 smithi123 ceph-mon[35438]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:10:04.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:03 smithi037 ceph-mon[30630]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:10:06.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:05 smithi037 ceph-mon[30630]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:10:06.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:05 smithi160 ceph-mon[35055]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:10:06.254 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:05 smithi123 ceph-mon[35438]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:10:06.986 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:06 smithi037 ceph-mon[30630]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:10:06.986 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:06 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-11T23:10:06.986 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:06 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:10:06.986 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:06 smithi037 ceph-mon[30630]: Deploying daemon osd.0 on smithi037 2024-09-11T23:10:07.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:06 smithi123 ceph-mon[35438]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:10:07.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:06 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-11T23:10:07.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:06 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:10:07.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:06 smithi123 ceph-mon[35438]: Deploying daemon osd.0 on smithi037 2024-09-11T23:10:07.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:06 smithi160 ceph-mon[35055]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:10:07.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:06 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-11T23:10:07.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:06 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:10:07.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:06 smithi160 ceph-mon[35055]: Deploying daemon osd.0 on smithi037 2024-09-11T23:10:09.262 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:09 smithi037 ceph-mon[30630]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:10:09.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:09 smithi160 ceph-mon[35055]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:10:09.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:09 smithi123 ceph-mon[35438]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:10:11.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:11 smithi037 ceph-mon[30630]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:10:11.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:11 smithi160 ceph-mon[35055]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:10:11.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:11 smithi123 ceph-mon[35438]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:10:13.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:13 smithi037 ceph-mon[30630]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:10:13.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:13 smithi160 ceph-mon[35055]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:10:13.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:13 smithi123 ceph-mon[35438]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:10:15.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:15 smithi037 ceph-mon[30630]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:10:15.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:15 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:10:15.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:15 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:10:15.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:15 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:10:15.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:15 smithi123 ceph-mon[35438]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:10:15.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:15 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:10:15.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:15 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:10:15.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:15 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:10:15.435 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:15 smithi160 ceph-mon[35055]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:10:15.525 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:15 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:10:15.526 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:15 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:10:15.526 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:15 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:10:17.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:17 smithi037 ceph-mon[30630]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:10:17.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:17 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:10:17.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:17 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:10:17.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:17 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:10:17.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:17 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:10:17.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:17 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:10:17.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:17 smithi160 ceph-mon[35055]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:10:17.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:17 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:10:17.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:17 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:10:17.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:17 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:10:17.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:17 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:10:17.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:17 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:10:17.505 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:17 smithi123 ceph-mon[35438]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:10:17.505 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:17 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:10:17.505 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:17 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:10:17.505 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:17 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:10:17.505 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:17 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:10:17.505 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:17 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:10:19.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:10:19.069+0000 7f4c96000640 1 -- 172.21.15.37:0/579706995 <== mgr.14150 v2:172.21.15.37:6800/31543269 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f4c98062630 con 0x7f4c800392c0 2024-09-11T23:10:19.070 INFO:teuthology.orchestra.run.smithi037.stdout:Created osd(s) 0 on host 'smithi037' 2024-09-11T23:10:19.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:10:19.072+0000 7f4ca0200640 1 -- 172.21.15.37:0/579706995 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f4c800392c0 msgr2=0x7f4c8003b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:10:19.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:10:19.072+0000 7f4ca0200640 1 --2- 172.21.15.37:0/579706995 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f4c800392c0 0x7f4c8003b780 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c009bd0 tx=0x7f4c8c005f90 comp rx=0 tx=0).stop 2024-09-11T23:10:19.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:10:19.072+0000 7f4ca0200640 1 -- 172.21.15.37:0/579706995 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4c98078790 msgr2=0x7f4c981a5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:10:19.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:10:19.072+0000 7f4ca0200640 1 --2- 172.21.15.37:0/579706995 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4c98078790 0x7f4c981a5a70 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4c90009fd0 tx=0x7f4c9000ef10 comp rx=0 tx=0).stop 2024-09-11T23:10:19.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:10:19.072+0000 7f4ca0200640 1 -- 172.21.15.37:0/579706995 shutdown_connections 2024-09-11T23:10:19.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:10:19.072+0000 7f4ca0200640 1 --2- 172.21.15.37:0/579706995 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f4c800392c0 0x7f4c8003b780 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:10:19.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:10:19.072+0000 7f4ca0200640 1 --2- 172.21.15.37:0/579706995 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4c98077df0 0x7f4c9819e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:10:19.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:10:19.072+0000 7f4ca0200640 1 --2- 172.21.15.37:0/579706995 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4c98078790 0x7f4c981a5a70 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:10:19.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:10:19.072+0000 7f4ca0200640 1 --2- 172.21.15.37:0/579706995 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c98076ba0 0x7f4c9819e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:10:19.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:10:19.072+0000 7f4ca0200640 1 -- 172.21.15.37:0/579706995 >> 172.21.15.37:0/579706995 conn(0x7f4c980ff5b0 msgr2=0x7f4c98101040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:10:19.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:10:19.072+0000 7f4ca0200640 1 -- 172.21.15.37:0/579706995 shutdown_connections 2024-09-11T23:10:19.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:10:19.072+0000 7f4ca0200640 1 -- 172.21.15.37:0/579706995 wait complete. 2024-09-11T23:10:19.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:19 smithi037 ceph-mon[30630]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:10:19.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:19 smithi160 ceph-mon[35055]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:10:19.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:19 smithi123 ceph-mon[35438]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:10:19.799 DEBUG:teuthology.orchestra.run.smithi037:osd.0> sudo journalctl -f -n 0 -u ceph-8b03efce-7092-11ef-bcea-c7b262605968@osd.0.service 2024-09-11T23:10:19.803 INFO:tasks.cephadm:Deploying osd.1 on smithi123 with /dev/vg_nvme/lv_4... 2024-09-11T23:10:19.804 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-11T23:10:20.054 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T23:10:20.175 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:20 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:10:20.175 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:20 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:10:20.175 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:20 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:10:20.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:20 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:10:20.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:20 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:10:20.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:20 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:10:20.315 INFO:journalctl@ceph.osd.0.smithi037.stdout:Sep 11 23:10:20 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-0[44334]: 2024-09-11T23:10:20.112+0000 7fe38ae30640 -1 osd.0 0 log_to_monitors true 2024-09-11T23:10:20.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:20 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:10:20.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:20 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:10:20.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:20 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:10:21.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:21 smithi037 ceph-mon[30630]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:10:21.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:21 smithi037 ceph-mon[30630]: from='osd.0 [v2:172.21.15.37:6802/1678472768,v1:172.21.15.37:6803/1678472768]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-11T23:10:21.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:21 smithi037 ceph-mon[30630]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-11T23:10:21.329 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:21 smithi123 ceph-mon[35438]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:10:21.329 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:21 smithi123 ceph-mon[35438]: from='osd.0 [v2:172.21.15.37:6802/1678472768,v1:172.21.15.37:6803/1678472768]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-11T23:10:21.330 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:21 smithi123 ceph-mon[35438]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-11T23:10:21.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:21 smithi160 ceph-mon[35055]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:10:21.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:21 smithi160 ceph-mon[35055]: from='osd.0 [v2:172.21.15.37:6802/1678472768,v1:172.21.15.37:6803/1678472768]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-11T23:10:21.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:21 smithi160 ceph-mon[35055]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-11T23:10:22.375 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:22 smithi123 ceph-mon[35438]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-11T23:10:22.375 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:22 smithi123 ceph-mon[35438]: osdmap e6: 1 total, 0 up, 1 in 2024-09-11T23:10:22.375 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:22 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T23:10:22.375 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:22 smithi123 ceph-mon[35438]: from='osd.0 [v2:172.21.15.37:6802/1678472768,v1:172.21.15.37:6803/1678472768]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]: dispatch 2024-09-11T23:10:22.375 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:22 smithi123 ceph-mon[35438]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]: dispatch 2024-09-11T23:10:22.379 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-11T23:10:22.405 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi123:vg_nvme/lv_4 2024-09-11T23:10:22.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:22 smithi160 ceph-mon[35055]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-11T23:10:22.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:22 smithi160 ceph-mon[35055]: osdmap e6: 1 total, 0 up, 1 in 2024-09-11T23:10:22.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:22 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T23:10:22.435 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:22 smithi160 ceph-mon[35055]: from='osd.0 [v2:172.21.15.37:6802/1678472768,v1:172.21.15.37:6803/1678472768]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]: dispatch 2024-09-11T23:10:22.435 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:22 smithi160 ceph-mon[35055]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]: dispatch 2024-09-11T23:10:22.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:22 smithi037 ceph-mon[30630]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-11T23:10:22.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:22 smithi037 ceph-mon[30630]: osdmap e6: 1 total, 0 up, 1 in 2024-09-11T23:10:22.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:22 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T23:10:22.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:22 smithi037 ceph-mon[30630]: from='osd.0 [v2:172.21.15.37:6802/1678472768,v1:172.21.15.37:6803/1678472768]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]: dispatch 2024-09-11T23:10:22.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:22 smithi037 ceph-mon[30630]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]: dispatch 2024-09-11T23:10:22.654 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T23:10:23.064 INFO:journalctl@ceph.osd.0.smithi037.stdout:Sep 11 23:10:22 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-0[44334]: 2024-09-11T23:10:22.826+0000 7fe386000640 -1 osd.0 0 waiting for initial osdmap 2024-09-11T23:10:23.065 INFO:journalctl@ceph.osd.0.smithi037.stdout:Sep 11 23:10:22 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-0[44334]: 2024-09-11T23:10:22.843+0000 7fe37b600640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T23:10:23.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:10:23.069+0000 7f14e7d9d640 1 -- 172.21.15.123:0/3335006412 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f14e01026b0 msgr2=0x7f14e0108f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:10:23.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:10:23.069+0000 7f14e7d9d640 1 --2- 172.21.15.123:0/3335006412 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f14e01026b0 0x7f14e0108f40 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f14d8009ca0 tx=0x7f14d802a8c0 comp rx=0 tx=0).stop 2024-09-11T23:10:23.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:10:23.069+0000 7f14e7d9d640 1 -- 172.21.15.123:0/3335006412 shutdown_connections 2024-09-11T23:10:23.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:10:23.069+0000 7f14e7d9d640 1 --2- 172.21.15.123:0/3335006412 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f14e01026b0 0x7f14e0108f40 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:10:23.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:10:23.069+0000 7f14e7d9d640 1 --2- 172.21.15.123:0/3335006412 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f14e0101cf0 0x7f14e0102170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:10:23.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:10:23.069+0000 7f14e7d9d640 1 --2- 172.21.15.123:0/3335006412 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14e0100af0 0x7f14e0100ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:10:23.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:10:23.069+0000 7f14e7d9d640 1 -- 172.21.15.123:0/3335006412 >> 172.21.15.123:0/3335006412 conn(0x7f14e00fc280 msgr2=0x7f14e00fe6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:10:23.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:10:23.069+0000 7f14e7d9d640 1 -- 172.21.15.123:0/3335006412 shutdown_connections 2024-09-11T23:10:23.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:10:23.069+0000 7f14e7d9d640 1 -- 172.21.15.123:0/3335006412 wait complete. 2024-09-11T23:10:23.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:10:23.070+0000 7f14e7d9d640 1 Processor -- start 2024-09-11T23:10:23.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:10:23.070+0000 7f14e7d9d640 1 -- start start 2024-09-11T23:10:23.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:10:23.070+0000 7f14e7d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14e0100af0 0x7f14e006b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:10:23.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:10:23.070+0000 7f14e7d9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f14e0101cf0 0x7f14e019cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:10:23.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:10:23.070+0000 7f14e7d9d640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f14e01026b0 0x7f14e019f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:10:23.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:10:23.070+0000 7f14e7d9d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f14e010c770 con 0x7f14e0100af0 2024-09-11T23:10:23.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:10:23.070+0000 7f14e7d9d640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f14e010c5f0 con 0x7f14e0101cf0 2024-09-11T23:10:23.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:10:23.070+0000 7f14e7d9d640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f14e010c8f0 con 0x7f14e01026b0 2024-09-11T23:10:23.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:10:23.070+0000 7f14e5338640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f14e0101cf0 0x7f14e019cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:10:23.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:10:23.070+0000 7f14e5338640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f14e0101cf0 0x7f14e019cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56574/0 (socket says 172.21.15.123:56574) 2024-09-11T23:10:23.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:10:23.070+0000 7f14e5338640 1 -- 172.21.15.123:0/2566126483 learned_addr learned my addr 172.21.15.123:0/2566126483 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-11T23:10:23.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:10:23.070+0000 7f14e5b39640 1 --2- 172.21.15.123:0/2566126483 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14e0100af0 0x7f14e006b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:10:23.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:10:23.071+0000 7f14e633a640 1 --2- 172.21.15.123:0/2566126483 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f14e01026b0 0x7f14e019f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:10:23.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:10:23.071+0000 7f14e5338640 1 -- 172.21.15.123:0/2566126483 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f14e01026b0 msgr2=0x7f14e019f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:10:23.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:10:23.071+0000 7f14e5338640 1 --2- 172.21.15.123:0/2566126483 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f14e01026b0 0x7f14e019f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:10:23.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:10:23.071+0000 7f14e5338640 1 -- 172.21.15.123:0/2566126483 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14e0100af0 msgr2=0x7f14e006b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:10:23.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:10:23.071+0000 7f14e5338640 1 --2- 172.21.15.123:0/2566126483 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14e0100af0 0x7f14e006b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:10:23.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:10:23.071+0000 7f14e5338640 1 -- 172.21.15.123:0/2566126483 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14e019fb50 con 0x7f14e0101cf0 2024-09-11T23:10:23.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:10:23.071+0000 7f14e5338640 1 --2- 172.21.15.123:0/2566126483 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f14e0101cf0 0x7f14e019cc20 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f14d000d770 tx=0x7f14d000dc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:10:23.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:10:23.071+0000 7f14d6ffd640 1 -- 172.21.15.123:0/2566126483 <== mon.2 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14d0017070 con 0x7f14e0101cf0 2024-09-11T23:10:23.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:10:23.071+0000 7f14e7d9d640 1 -- 172.21.15.123:0/2566126483 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14e019fde0 con 0x7f14e0101cf0 2024-09-11T23:10:23.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:10:23.071+0000 7f14d6ffd640 1 -- 172.21.15.123:0/2566126483 <== mon.2 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f14d0005500 con 0x7f14e0101cf0 2024-09-11T23:10:23.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:10:23.071+0000 7f14d6ffd640 1 -- 172.21.15.123:0/2566126483 <== mon.2 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14d0004e00 con 0x7f14e0101cf0 2024-09-11T23:10:23.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:10:23.071+0000 7f14e7d9d640 1 -- 172.21.15.123:0/2566126483 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14e01a0290 con 0x7f14e0101cf0 2024-09-11T23:10:23.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:10:23.072+0000 7f14e7d9d640 1 -- 172.21.15.123:0/2566126483 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14e0107ef0 con 0x7f14e0101cf0 2024-09-11T23:10:23.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:10:23.073+0000 7f14d6ffd640 1 -- 172.21.15.123:0/2566126483 <== mon.2 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 15) ==== 137777+0+0 (secure 0 0 0) 0x7f14d0004fa0 con 0x7f14e0101cf0 2024-09-11T23:10:23.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:10:23.074+0000 7f14d6ffd640 1 --2- 172.21.15.123:0/2566126483 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f14cc0a2af0 0x7f14cc0a4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:10:23.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:10:23.074+0000 7f14d6ffd640 1 -- 172.21.15.123:0/2566126483 <== mon.2 v2:172.21.15.123:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1487+0+0 (secure 0 0 0) 0x7f14d00cd160 con 0x7f14e0101cf0 2024-09-11T23:10:23.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:10:23.074+0000 7f14e5b39640 1 --2- 172.21.15.123:0/2566126483 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f14cc0a2af0 0x7f14cc0a4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:10:23.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:10:23.075+0000 7f14e5b39640 1 --2- 172.21.15.123:0/2566126483 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f14cc0a2af0 0x7f14cc0a4fb0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f14dc005fd0 tx=0x7f14dc00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:10:23.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:10:23.078+0000 7f14d6ffd640 1 -- 172.21.15.123:0/2566126483 <== mon.2 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f14d009b600 con 0x7f14e0101cf0 2024-09-11T23:10:23.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:23 smithi123 ceph-mon[35438]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:10:23.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:23 smithi123 ceph-mon[35438]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2024-09-11T23:10:23.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:23 smithi123 ceph-mon[35438]: osdmap e7: 1 total, 0 up, 1 in 2024-09-11T23:10:23.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:23 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T23:10:23.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:23 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T23:10:23.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:23 smithi123 ceph-mon[35438]: from='osd.0 ' entity='osd.0' 2024-09-11T23:10:23.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:10:23.261+0000 7f14e7d9d640 1 -- 172.21.15.123:0/2566126483 --> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi123:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f14e0062630 con 0x7f14cc0a2af0 2024-09-11T23:10:23.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:23 smithi160 ceph-mon[35055]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:10:23.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:23 smithi160 ceph-mon[35055]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2024-09-11T23:10:23.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:23 smithi160 ceph-mon[35055]: osdmap e7: 1 total, 0 up, 1 in 2024-09-11T23:10:23.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:23 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T23:10:23.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:23 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T23:10:23.435 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:23 smithi160 ceph-mon[35055]: from='osd.0 ' entity='osd.0' 2024-09-11T23:10:23.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:23 smithi037 ceph-mon[30630]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:10:23.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:23 smithi037 ceph-mon[30630]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2024-09-11T23:10:23.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:23 smithi037 ceph-mon[30630]: osdmap e7: 1 total, 0 up, 1 in 2024-09-11T23:10:23.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:23 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T23:10:23.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:23 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T23:10:23.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:23 smithi037 ceph-mon[30630]: from='osd.0 ' entity='osd.0' 2024-09-11T23:10:24.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:24 smithi123 ceph-mon[35438]: purged_snaps scrub starts 2024-09-11T23:10:24.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:24 smithi123 ceph-mon[35438]: purged_snaps scrub ok 2024-09-11T23:10:24.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:24 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T23:10:24.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:24 smithi123 ceph-mon[35438]: from='client.24137 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi123:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:10:24.252 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:24 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:10:24.252 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:24 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:10:24.252 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:24 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:10:24.252 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:24 smithi123 ceph-mon[35438]: Detected new or changed devices on smithi037 2024-09-11T23:10:24.252 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:24 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:10:24.252 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:24 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:10:24.253 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:24 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:10:24.253 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:24 smithi123 ceph-mon[35438]: Adjusting osd_memory_target on smithi037 to 17094M 2024-09-11T23:10:24.253 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:24 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:10:24.253 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:24 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:10:24.253 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:24 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:10:24.254 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:24 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:10:24.254 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:24 smithi123 ceph-mon[35438]: osd.0 [v2:172.21.15.37:6802/1678472768,v1:172.21.15.37:6803/1678472768] boot 2024-09-11T23:10:24.254 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:24 smithi123 ceph-mon[35438]: osdmap e8: 1 total, 1 up, 1 in 2024-09-11T23:10:24.254 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:24 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T23:10:24.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:24 smithi160 ceph-mon[35055]: purged_snaps scrub starts 2024-09-11T23:10:24.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:24 smithi160 ceph-mon[35055]: purged_snaps scrub ok 2024-09-11T23:10:24.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:24 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T23:10:24.435 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:24 smithi160 ceph-mon[35055]: from='client.24137 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi123:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:10:24.435 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:24 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:10:24.435 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:24 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:10:24.435 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:24 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:10:24.435 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:24 smithi160 ceph-mon[35055]: Detected new or changed devices on smithi037 2024-09-11T23:10:24.435 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:24 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:10:24.435 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:24 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:10:24.435 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:24 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:10:24.435 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:24 smithi160 ceph-mon[35055]: Adjusting osd_memory_target on smithi037 to 17094M 2024-09-11T23:10:24.435 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:24 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:10:24.435 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:24 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:10:24.435 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:24 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:10:24.435 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:24 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:10:24.436 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:24 smithi160 ceph-mon[35055]: osd.0 [v2:172.21.15.37:6802/1678472768,v1:172.21.15.37:6803/1678472768] boot 2024-09-11T23:10:24.436 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:24 smithi160 ceph-mon[35055]: osdmap e8: 1 total, 1 up, 1 in 2024-09-11T23:10:24.436 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:24 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T23:10:24.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:24 smithi037 ceph-mon[30630]: purged_snaps scrub starts 2024-09-11T23:10:24.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:24 smithi037 ceph-mon[30630]: purged_snaps scrub ok 2024-09-11T23:10:24.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:24 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T23:10:24.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:24 smithi037 ceph-mon[30630]: from='client.24137 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi123:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:10:24.566 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:24 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:10:24.566 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:24 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:10:24.566 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:24 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:10:24.566 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:24 smithi037 ceph-mon[30630]: Detected new or changed devices on smithi037 2024-09-11T23:10:24.566 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:24 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:10:24.567 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:24 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:10:24.567 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:24 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:10:24.567 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:24 smithi037 ceph-mon[30630]: Adjusting osd_memory_target on smithi037 to 17094M 2024-09-11T23:10:24.567 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:24 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:10:24.567 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:24 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:10:24.567 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:24 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:10:24.567 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:24 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:10:24.568 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:24 smithi037 ceph-mon[30630]: osd.0 [v2:172.21.15.37:6802/1678472768,v1:172.21.15.37:6803/1678472768] boot 2024-09-11T23:10:24.568 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:24 smithi037 ceph-mon[30630]: osdmap e8: 1 total, 1 up, 1 in 2024-09-11T23:10:24.568 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:24 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T23:10:26.113 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:25 smithi123 ceph-mon[35438]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:10:26.114 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:25 smithi123 ceph-mon[35438]: osdmap e9: 1 total, 1 up, 1 in 2024-09-11T23:10:26.114 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:25 smithi123 ceph-mon[35438]: from='client.? 172.21.15.123:0/3505065917' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "13d26eed-1160-4b15-b66b-66c89066c66f"}]: dispatch 2024-09-11T23:10:26.114 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:25 smithi123 ceph-mon[35438]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "13d26eed-1160-4b15-b66b-66c89066c66f"}]: dispatch 2024-09-11T23:10:26.114 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:25 smithi123 ceph-mon[35438]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "13d26eed-1160-4b15-b66b-66c89066c66f"}]': finished 2024-09-11T23:10:26.114 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:25 smithi123 ceph-mon[35438]: osdmap e10: 2 total, 1 up, 2 in 2024-09-11T23:10:26.115 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:25 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T23:10:26.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:25 smithi160 ceph-mon[35055]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:10:26.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:25 smithi160 ceph-mon[35055]: osdmap e9: 1 total, 1 up, 1 in 2024-09-11T23:10:26.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:25 smithi160 ceph-mon[35055]: from='client.? 172.21.15.123:0/3505065917' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "13d26eed-1160-4b15-b66b-66c89066c66f"}]: dispatch 2024-09-11T23:10:26.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:25 smithi160 ceph-mon[35055]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "13d26eed-1160-4b15-b66b-66c89066c66f"}]: dispatch 2024-09-11T23:10:26.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:25 smithi160 ceph-mon[35055]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "13d26eed-1160-4b15-b66b-66c89066c66f"}]': finished 2024-09-11T23:10:26.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:25 smithi160 ceph-mon[35055]: osdmap e10: 2 total, 1 up, 2 in 2024-09-11T23:10:26.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:25 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T23:10:26.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:25 smithi037 ceph-mon[30630]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:10:26.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:25 smithi037 ceph-mon[30630]: osdmap e9: 1 total, 1 up, 1 in 2024-09-11T23:10:26.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:25 smithi037 ceph-mon[30630]: from='client.? 172.21.15.123:0/3505065917' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "13d26eed-1160-4b15-b66b-66c89066c66f"}]: dispatch 2024-09-11T23:10:26.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:25 smithi037 ceph-mon[30630]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "13d26eed-1160-4b15-b66b-66c89066c66f"}]: dispatch 2024-09-11T23:10:26.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:25 smithi037 ceph-mon[30630]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "13d26eed-1160-4b15-b66b-66c89066c66f"}]': finished 2024-09-11T23:10:26.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:25 smithi037 ceph-mon[30630]: osdmap e10: 2 total, 1 up, 2 in 2024-09-11T23:10:26.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:25 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T23:10:27.128 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:26 smithi037 ceph-mon[30630]: from='client.? 172.21.15.123:0/827791832' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:10:27.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:26 smithi160 ceph-mon[35055]: from='client.? 172.21.15.123:0/827791832' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:10:27.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:26 smithi123 ceph-mon[35438]: from='client.? 172.21.15.123:0/827791832' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:10:28.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:27 smithi160 ceph-mon[35055]: pgmap v47: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:10:28.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:27 smithi123 ceph-mon[35438]: pgmap v47: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:10:28.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:27 smithi037 ceph-mon[30630]: pgmap v47: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:10:30.175 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:29 smithi123 ceph-mon[35438]: pgmap v48: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:10:30.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:29 smithi160 ceph-mon[35055]: pgmap v48: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:10:30.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:29 smithi037 ceph-mon[30630]: pgmap v48: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:10:32.139 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:31 smithi123 ceph-mon[35438]: pgmap v49: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:10:32.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:31 smithi160 ceph-mon[35055]: pgmap v49: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:10:32.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:31 smithi037 ceph-mon[30630]: pgmap v49: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:10:34.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:33 smithi123 ceph-mon[35438]: pgmap v50: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:10:34.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:33 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-11T23:10:34.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:33 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:10:34.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:33 smithi160 ceph-mon[35055]: pgmap v50: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:10:34.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:33 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-11T23:10:34.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:33 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:10:34.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:33 smithi037 ceph-mon[30630]: pgmap v50: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:10:34.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:33 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-11T23:10:34.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:33 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:10:35.069 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:34 smithi123 ceph-mon[35438]: Deploying daemon osd.1 on smithi123 2024-09-11T23:10:35.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:34 smithi160 ceph-mon[35055]: Deploying daemon osd.1 on smithi123 2024-09-11T23:10:35.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:34 smithi037 ceph-mon[30630]: Deploying daemon osd.1 on smithi123 2024-09-11T23:10:36.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:35 smithi160 ceph-mon[35055]: pgmap v51: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:10:36.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:35 smithi123 ceph-mon[35438]: pgmap v51: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:10:36.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:35 smithi037 ceph-mon[30630]: pgmap v51: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:10:38.117 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:37 smithi037 ceph-mon[30630]: pgmap v52: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:10:38.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:37 smithi160 ceph-mon[35055]: pgmap v52: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:10:38.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:37 smithi123 ceph-mon[35438]: pgmap v52: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:10:40.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:39 smithi037 ceph-mon[30630]: pgmap v53: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:10:40.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:39 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:10:40.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:39 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:10:40.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:39 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:10:40.121 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:39 smithi123 ceph-mon[35438]: pgmap v53: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:10:40.121 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:39 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:10:40.121 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:39 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:10:40.121 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:39 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:10:40.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:39 smithi160 ceph-mon[35055]: pgmap v53: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:10:40.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:39 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:10:40.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:39 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:10:40.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:39 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:10:42.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:41 smithi160 ceph-mon[35055]: pgmap v54: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:10:42.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:41 smithi123 ceph-mon[35438]: pgmap v54: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:10:42.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:41 smithi037 ceph-mon[30630]: pgmap v54: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:10:43.293 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:43 smithi123 ceph-mon[35438]: pgmap v55: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:10:43.293 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:43 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:10:43.293 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:43 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:10:43.293 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:43 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:10:43.293 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:43 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:10:43.293 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:43 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:10:43.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:43 smithi037 ceph-mon[30630]: pgmap v55: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:10:43.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:43 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:10:43.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:43 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:10:43.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:43 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:10:43.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:43 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:10:43.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:43 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:10:43.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:43 smithi160 ceph-mon[35055]: pgmap v55: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:10:43.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:43 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:10:43.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:43 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:10:43.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:43 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:10:43.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:43 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:10:43.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:43 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:10:43.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:10:43.612+0000 7f14d6ffd640 1 -- 172.21.15.123:0/2566126483 <== mgr.14150 v2:172.21.15.37:6800/31543269 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f14e0062630 con 0x7f14cc0a2af0 2024-09-11T23:10:43.613 INFO:teuthology.orchestra.run.smithi123.stdout:Created osd(s) 1 on host 'smithi123' 2024-09-11T23:10:43.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:10:43.615+0000 7f14e7d9d640 1 -- 172.21.15.123:0/2566126483 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f14cc0a2af0 msgr2=0x7f14cc0a4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:10:43.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:10:43.615+0000 7f14e7d9d640 1 --2- 172.21.15.123:0/2566126483 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f14cc0a2af0 0x7f14cc0a4fb0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f14dc005fd0 tx=0x7f14dc00b410 comp rx=0 tx=0).stop 2024-09-11T23:10:43.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:10:43.615+0000 7f14e7d9d640 1 -- 172.21.15.123:0/2566126483 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f14e0101cf0 msgr2=0x7f14e019cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:10:43.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:10:43.615+0000 7f14e7d9d640 1 --2- 172.21.15.123:0/2566126483 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f14e0101cf0 0x7f14e019cc20 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f14d000d770 tx=0x7f14d000dc30 comp rx=0 tx=0).stop 2024-09-11T23:10:43.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:10:43.615+0000 7f14e7d9d640 1 -- 172.21.15.123:0/2566126483 shutdown_connections 2024-09-11T23:10:43.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:10:43.615+0000 7f14e7d9d640 1 --2- 172.21.15.123:0/2566126483 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f14cc0a2af0 0x7f14cc0a4fb0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:10:43.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:10:43.615+0000 7f14e7d9d640 1 --2- 172.21.15.123:0/2566126483 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f14e0101cf0 0x7f14e019cc20 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:10:43.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:10:43.615+0000 7f14e7d9d640 1 --2- 172.21.15.123:0/2566126483 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f14e01026b0 0x7f14e019f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:10:43.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:10:43.615+0000 7f14e7d9d640 1 --2- 172.21.15.123:0/2566126483 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14e0100af0 0x7f14e006b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:10:43.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:10:43.615+0000 7f14e7d9d640 1 -- 172.21.15.123:0/2566126483 >> 172.21.15.123:0/2566126483 conn(0x7f14e00fc280 msgr2=0x7f14e01050c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:10:43.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:10:43.615+0000 7f14e7d9d640 1 -- 172.21.15.123:0/2566126483 shutdown_connections 2024-09-11T23:10:43.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:10:43.615+0000 7f14e7d9d640 1 -- 172.21.15.123:0/2566126483 wait complete. 2024-09-11T23:10:44.205 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:44 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:10:44.205 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:44 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:10:44.205 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:44 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:10:44.231 DEBUG:teuthology.orchestra.run.smithi123:osd.1> sudo journalctl -f -n 0 -u ceph-8b03efce-7092-11ef-bcea-c7b262605968@osd.1.service 2024-09-11T23:10:44.233 INFO:tasks.cephadm:Deploying osd.2 on smithi160 with /dev/vg_nvme/lv_4... 2024-09-11T23:10:44.234 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-11T23:10:44.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:44 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:10:44.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:44 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:10:44.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:44 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:10:44.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:44 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:10:44.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:44 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:10:44.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:44 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:10:44.485 INFO:teuthology.orchestra.run.smithi160.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T23:10:45.764 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:45 smithi160 ceph-mon[35055]: pgmap v56: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:10:45.863 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:45 smithi123 ceph-mon[35438]: pgmap v56: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:10:46.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:45 smithi037 ceph-mon[30630]: pgmap v56: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:10:46.251 INFO:journalctl@ceph.osd.1.smithi123.stdout:Sep 11 23:10:45 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-1[39896]: 2024-09-11T23:10:45.974+0000 7f2bcecc1640 -1 osd.1 0 log_to_monitors true 2024-09-11T23:10:46.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:46 smithi123 ceph-mon[35438]: from='osd.1 [v2:172.21.15.123:6800/141504725,v1:172.21.15.123:6801/141504725]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-11T23:10:46.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:46 smithi123 ceph-mon[35438]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-11T23:10:46.807 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:46 smithi160 ceph-mon[35055]: from='osd.1 [v2:172.21.15.123:6800/141504725,v1:172.21.15.123:6801/141504725]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-11T23:10:46.807 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:46 smithi160 ceph-mon[35055]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-11T23:10:46.809 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-11T23:10:46.836 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi160:vg_nvme/lv_4 2024-09-11T23:10:47.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:46 smithi037 ceph-mon[30630]: from='osd.1 [v2:172.21.15.123:6800/141504725,v1:172.21.15.123:6801/141504725]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-11T23:10:47.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:46 smithi037 ceph-mon[30630]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-11T23:10:47.086 INFO:teuthology.orchestra.run.smithi160.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T23:10:47.578 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:10:47.575+0000 7f3141fd7640 1 -- 172.21.15.160:0/2273184227 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f313c104fc0 msgr2=0x7f313c1073b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:10:47.579 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:10:47.575+0000 7f3141fd7640 1 --2- 172.21.15.160:0/2273184227 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f313c104fc0 0x7f313c1073b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3124009900 tx=0x7f312402a410 comp rx=0 tx=0).stop 2024-09-11T23:10:47.579 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:10:47.575+0000 7f3141fd7640 1 -- 172.21.15.160:0/2273184227 shutdown_connections 2024-09-11T23:10:47.579 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:10:47.575+0000 7f3141fd7640 1 --2- 172.21.15.160:0/2273184227 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f313c1078f0 0x7f313c109d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:10:47.579 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:10:47.575+0000 7f3141fd7640 1 --2- 172.21.15.160:0/2273184227 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f313c104fc0 0x7f313c1073b0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:10:47.579 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:10:47.575+0000 7f3141fd7640 1 --2- 172.21.15.160:0/2273184227 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f313c102690 0x7f313c104a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:10:47.579 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:10:47.575+0000 7f3141fd7640 1 -- 172.21.15.160:0/2273184227 >> 172.21.15.160:0/2273184227 conn(0x7f313c0fc290 msgr2=0x7f313c0fe6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:10:47.579 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:10:47.575+0000 7f3141fd7640 1 -- 172.21.15.160:0/2273184227 shutdown_connections 2024-09-11T23:10:47.579 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:10:47.575+0000 7f3141fd7640 1 -- 172.21.15.160:0/2273184227 wait complete. 2024-09-11T23:10:47.579 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:10:47.576+0000 7f3141fd7640 1 Processor -- start 2024-09-11T23:10:47.579 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:10:47.576+0000 7f3141fd7640 1 -- start start 2024-09-11T23:10:47.580 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:10:47.576+0000 7f3141fd7640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f313c102690 0x7f313c197f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:10:47.580 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:10:47.576+0000 7f3141fd7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f313c104fc0 0x7f313c1984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:10:47.580 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:10:47.576+0000 7f3141fd7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f313c1078f0 0x7f313c19f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:10:47.580 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:10:47.576+0000 7f3141fd7640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f313c10d8e0 con 0x7f313c104fc0 2024-09-11T23:10:47.580 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:10:47.576+0000 7f3141fd7640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f313c10d760 con 0x7f313c1078f0 2024-09-11T23:10:47.580 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:10:47.576+0000 7f3141fd7640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f313c10da60 con 0x7f313c102690 2024-09-11T23:10:47.580 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:10:47.576+0000 7f313b7fe640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f313c102690 0x7f313c197f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:10:47.580 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:10:47.576+0000 7f313b7fe640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f313c102690 0x7f313c197f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:50586/0 (socket says 172.21.15.160:50586) 2024-09-11T23:10:47.580 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:10:47.576+0000 7f313b7fe640 1 -- 172.21.15.160:0/1969076547 learned_addr learned my addr 172.21.15.160:0/1969076547 (peer_addr_for_me v2:172.21.15.160:0/0) 2024-09-11T23:10:47.580 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:10:47.576+0000 7f3133fff640 1 --2- 172.21.15.160:0/1969076547 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f313c104fc0 0x7f313c1984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:10:47.580 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:10:47.576+0000 7f313bfff640 1 --2- 172.21.15.160:0/1969076547 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f313c1078f0 0x7f313c19f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:10:47.581 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:10:47.577+0000 7f313b7fe640 1 -- 172.21.15.160:0/1969076547 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f313c1078f0 msgr2=0x7f313c19f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:10:47.581 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:10:47.577+0000 7f313b7fe640 1 --2- 172.21.15.160:0/1969076547 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f313c1078f0 0x7f313c19f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:10:47.581 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:10:47.577+0000 7f313b7fe640 1 -- 172.21.15.160:0/1969076547 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f313c104fc0 msgr2=0x7f313c1984b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:10:47.581 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:10:47.577+0000 7f313b7fe640 1 --2- 172.21.15.160:0/1969076547 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f313c104fc0 0x7f313c1984b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:10:47.581 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:10:47.577+0000 7f313b7fe640 1 -- 172.21.15.160:0/1969076547 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f313c19fba0 con 0x7f313c102690 2024-09-11T23:10:47.581 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:10:47.577+0000 7f313b7fe640 1 --2- 172.21.15.160:0/1969076547 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f313c102690 0x7f313c197f70 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f312c00d770 tx=0x7f312c00dc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:10:47.581 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:10:47.577+0000 7f31397fa640 1 -- 172.21.15.160:0/1969076547 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f312c017070 con 0x7f313c102690 2024-09-11T23:10:47.581 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:10:47.577+0000 7f31397fa640 1 -- 172.21.15.160:0/1969076547 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f312c005500 con 0x7f313c102690 2024-09-11T23:10:47.581 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:10:47.577+0000 7f3141fd7640 1 -- 172.21.15.160:0/1969076547 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f313c19fe90 con 0x7f313c102690 2024-09-11T23:10:47.581 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:10:47.577+0000 7f31397fa640 1 -- 172.21.15.160:0/1969076547 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f312c004e00 con 0x7f313c102690 2024-09-11T23:10:47.581 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:10:47.577+0000 7f3141fd7640 1 -- 172.21.15.160:0/1969076547 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f313c1a0290 con 0x7f313c102690 2024-09-11T23:10:47.582 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:10:47.578+0000 7f3141fd7640 1 -- 172.21.15.160:0/1969076547 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f313c0fdd80 con 0x7f313c102690 2024-09-11T23:10:47.582 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:10:47.579+0000 7f31397fa640 1 -- 172.21.15.160:0/1969076547 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 15) ==== 137777+0+0 (secure 0 0 0) 0x7f312c004fa0 con 0x7f313c102690 2024-09-11T23:10:47.583 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:10:47.580+0000 7f31397fa640 1 --2- 172.21.15.160:0/1969076547 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f31280a2b20 0x7f31280a4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:10:47.583 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:10:47.580+0000 7f31397fa640 1 -- 172.21.15.160:0/1969076547 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(11..11 src has 1..11) ==== 1903+0+0 (secure 0 0 0) 0x7f312c0ccfe0 con 0x7f313c102690 2024-09-11T23:10:47.583 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:10:47.580+0000 7f3133fff640 1 --2- 172.21.15.160:0/1969076547 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f31280a2b20 0x7f31280a4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:10:47.583 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:10:47.581+0000 7f3133fff640 1 --2- 172.21.15.160:0/1969076547 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f31280a2b20 0x7f31280a4fe0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f312402aa00 tx=0x7f31240315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:10:47.586 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:10:47.585+0000 7f31397fa640 1 -- 172.21.15.160:0/1969076547 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f312c09b260 con 0x7f313c102690 2024-09-11T23:10:47.762 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:10:47.761+0000 7f3141fd7640 1 -- 172.21.15.160:0/1969076547 --> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi160:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f313c062630 con 0x7f31280a2b20 2024-09-11T23:10:47.763 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:47 smithi160 ceph-mon[35055]: pgmap v57: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:10:47.763 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:47 smithi160 ceph-mon[35055]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-11T23:10:47.763 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:47 smithi160 ceph-mon[35055]: from='osd.1 [v2:172.21.15.123:6800/141504725,v1:172.21.15.123:6801/141504725]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]: dispatch 2024-09-11T23:10:47.763 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:47 smithi160 ceph-mon[35055]: osdmap e11: 2 total, 1 up, 2 in 2024-09-11T23:10:47.763 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:47 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T23:10:47.763 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:47 smithi160 ceph-mon[35055]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]: dispatch 2024-09-11T23:10:47.763 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:47 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:10:47.763 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:47 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:10:47.763 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:47 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:10:47.763 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:47 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:10:47.764 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:47 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:10:47.764 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:47 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:10:47.764 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:47 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:10:48.001 INFO:journalctl@ceph.osd.1.smithi123.stdout:Sep 11 23:10:47 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-1[39896]: 2024-09-11T23:10:47.640+0000 7f2bcac44640 -1 osd.1 0 waiting for initial osdmap 2024-09-11T23:10:48.001 INFO:journalctl@ceph.osd.1.smithi123.stdout:Sep 11 23:10:47 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-1[39896]: 2024-09-11T23:10:47.643+0000 7f2bc6a6c640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T23:10:48.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:47 smithi123 ceph-mon[35438]: pgmap v57: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:10:48.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:47 smithi123 ceph-mon[35438]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-11T23:10:48.002 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:47 smithi123 ceph-mon[35438]: from='osd.1 [v2:172.21.15.123:6800/141504725,v1:172.21.15.123:6801/141504725]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]: dispatch 2024-09-11T23:10:48.002 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:47 smithi123 ceph-mon[35438]: osdmap e11: 2 total, 1 up, 2 in 2024-09-11T23:10:48.002 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:47 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T23:10:48.002 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:47 smithi123 ceph-mon[35438]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]: dispatch 2024-09-11T23:10:48.002 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:47 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:10:48.002 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:47 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:10:48.002 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:47 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:10:48.002 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:47 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:10:48.002 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:47 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:10:48.002 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:47 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:10:48.002 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:47 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:10:48.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:47 smithi037 ceph-mon[30630]: pgmap v57: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:10:48.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:47 smithi037 ceph-mon[30630]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-11T23:10:48.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:47 smithi037 ceph-mon[30630]: from='osd.1 [v2:172.21.15.123:6800/141504725,v1:172.21.15.123:6801/141504725]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]: dispatch 2024-09-11T23:10:48.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:47 smithi037 ceph-mon[30630]: osdmap e11: 2 total, 1 up, 2 in 2024-09-11T23:10:48.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:47 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T23:10:48.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:47 smithi037 ceph-mon[30630]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]: dispatch 2024-09-11T23:10:48.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:47 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:10:48.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:47 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:10:48.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:47 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:10:48.066 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:47 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:10:48.066 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:47 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:10:48.066 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:47 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:10:48.066 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:47 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:10:48.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:48 smithi160 ceph-mon[35055]: Detected new or changed devices on smithi123 2024-09-11T23:10:48.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:48 smithi160 ceph-mon[35055]: Adjusting osd_memory_target on smithi123 to 17088M 2024-09-11T23:10:48.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:48 smithi160 ceph-mon[35055]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]': finished 2024-09-11T23:10:48.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:48 smithi160 ceph-mon[35055]: osdmap e12: 2 total, 1 up, 2 in 2024-09-11T23:10:48.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:48 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T23:10:48.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:48 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T23:10:48.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:48 smithi160 ceph-mon[35055]: from='client.24163 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi160:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:10:48.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:48 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:10:48.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:48 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:10:48.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:48 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:10:49.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:48 smithi123 ceph-mon[35438]: Detected new or changed devices on smithi123 2024-09-11T23:10:49.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:48 smithi123 ceph-mon[35438]: Adjusting osd_memory_target on smithi123 to 17088M 2024-09-11T23:10:49.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:48 smithi123 ceph-mon[35438]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]': finished 2024-09-11T23:10:49.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:48 smithi123 ceph-mon[35438]: osdmap e12: 2 total, 1 up, 2 in 2024-09-11T23:10:49.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:48 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T23:10:49.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:48 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T23:10:49.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:48 smithi123 ceph-mon[35438]: from='client.24163 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi160:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:10:49.002 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:48 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:10:49.002 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:48 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:10:49.004 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:48 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:10:49.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:48 smithi037 ceph-mon[30630]: Detected new or changed devices on smithi123 2024-09-11T23:10:49.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:48 smithi037 ceph-mon[30630]: Adjusting osd_memory_target on smithi123 to 17088M 2024-09-11T23:10:49.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:48 smithi037 ceph-mon[30630]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]': finished 2024-09-11T23:10:49.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:48 smithi037 ceph-mon[30630]: osdmap e12: 2 total, 1 up, 2 in 2024-09-11T23:10:49.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:48 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T23:10:49.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:48 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T23:10:49.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:48 smithi037 ceph-mon[30630]: from='client.24163 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi160:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:10:49.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:48 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:10:49.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:48 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:10:49.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:48 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:10:49.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:49 smithi160 ceph-mon[35055]: purged_snaps scrub starts 2024-09-11T23:10:49.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:49 smithi160 ceph-mon[35055]: purged_snaps scrub ok 2024-09-11T23:10:49.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:49 smithi160 ceph-mon[35055]: pgmap v60: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:10:49.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:49 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T23:10:49.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:49 smithi160 ceph-mon[35055]: osd.1 [v2:172.21.15.123:6800/141504725,v1:172.21.15.123:6801/141504725] boot 2024-09-11T23:10:49.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:49 smithi160 ceph-mon[35055]: osdmap e13: 2 total, 2 up, 2 in 2024-09-11T23:10:49.935 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:49 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T23:10:50.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:49 smithi123 ceph-mon[35438]: purged_snaps scrub starts 2024-09-11T23:10:50.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:49 smithi123 ceph-mon[35438]: purged_snaps scrub ok 2024-09-11T23:10:50.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:49 smithi123 ceph-mon[35438]: pgmap v60: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:10:50.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:49 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T23:10:50.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:49 smithi123 ceph-mon[35438]: osd.1 [v2:172.21.15.123:6800/141504725,v1:172.21.15.123:6801/141504725] boot 2024-09-11T23:10:50.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:49 smithi123 ceph-mon[35438]: osdmap e13: 2 total, 2 up, 2 in 2024-09-11T23:10:50.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:49 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T23:10:50.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:49 smithi037 ceph-mon[30630]: purged_snaps scrub starts 2024-09-11T23:10:50.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:49 smithi037 ceph-mon[30630]: purged_snaps scrub ok 2024-09-11T23:10:50.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:49 smithi037 ceph-mon[30630]: pgmap v60: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:10:50.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:49 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T23:10:50.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:49 smithi037 ceph-mon[30630]: osd.1 [v2:172.21.15.123:6800/141504725,v1:172.21.15.123:6801/141504725] boot 2024-09-11T23:10:50.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:49 smithi037 ceph-mon[30630]: osdmap e13: 2 total, 2 up, 2 in 2024-09-11T23:10:50.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:49 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T23:10:50.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:50 smithi160 ceph-mon[35055]: osdmap e14: 2 total, 2 up, 2 in 2024-09-11T23:10:50.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:50 smithi160 ceph-mon[35055]: from='client.? 172.21.15.160:0/2684720846' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "53daf4d5-2a43-4a89-bae9-f32b89b517f2"}]: dispatch 2024-09-11T23:10:50.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:50 smithi160 ceph-mon[35055]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "53daf4d5-2a43-4a89-bae9-f32b89b517f2"}]: dispatch 2024-09-11T23:10:50.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:50 smithi160 ceph-mon[35055]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "53daf4d5-2a43-4a89-bae9-f32b89b517f2"}]': finished 2024-09-11T23:10:50.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:50 smithi160 ceph-mon[35055]: osdmap e15: 3 total, 2 up, 3 in 2024-09-11T23:10:50.935 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:50 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T23:10:50.935 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:50 smithi160 ceph-mon[35055]: from='client.? 172.21.15.160:0/659785667' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:10:51.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:50 smithi123 ceph-mon[35438]: osdmap e14: 2 total, 2 up, 2 in 2024-09-11T23:10:51.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:50 smithi123 ceph-mon[35438]: from='client.? 172.21.15.160:0/2684720846' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "53daf4d5-2a43-4a89-bae9-f32b89b517f2"}]: dispatch 2024-09-11T23:10:51.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:50 smithi123 ceph-mon[35438]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "53daf4d5-2a43-4a89-bae9-f32b89b517f2"}]: dispatch 2024-09-11T23:10:51.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:50 smithi123 ceph-mon[35438]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "53daf4d5-2a43-4a89-bae9-f32b89b517f2"}]': finished 2024-09-11T23:10:51.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:50 smithi123 ceph-mon[35438]: osdmap e15: 3 total, 2 up, 3 in 2024-09-11T23:10:51.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:50 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T23:10:51.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:50 smithi123 ceph-mon[35438]: from='client.? 172.21.15.160:0/659785667' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:10:51.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:50 smithi037 ceph-mon[30630]: osdmap e14: 2 total, 2 up, 2 in 2024-09-11T23:10:51.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:50 smithi037 ceph-mon[30630]: from='client.? 172.21.15.160:0/2684720846' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "53daf4d5-2a43-4a89-bae9-f32b89b517f2"}]: dispatch 2024-09-11T23:10:51.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:50 smithi037 ceph-mon[30630]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "53daf4d5-2a43-4a89-bae9-f32b89b517f2"}]: dispatch 2024-09-11T23:10:51.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:50 smithi037 ceph-mon[30630]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "53daf4d5-2a43-4a89-bae9-f32b89b517f2"}]': finished 2024-09-11T23:10:51.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:50 smithi037 ceph-mon[30630]: osdmap e15: 3 total, 2 up, 3 in 2024-09-11T23:10:51.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:50 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T23:10:51.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:50 smithi037 ceph-mon[30630]: from='client.? 172.21.15.160:0/659785667' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:10:51.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:51 smithi160 ceph-mon[35055]: pgmap v63: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:10:52.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:51 smithi123 ceph-mon[35438]: pgmap v63: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:10:52.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:51 smithi037 ceph-mon[30630]: pgmap v63: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:10:53.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:53 smithi160 ceph-mon[35055]: pgmap v65: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:10:54.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:53 smithi123 ceph-mon[35438]: pgmap v65: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:10:54.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:53 smithi037 ceph-mon[30630]: pgmap v65: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:10:55.681 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:55 smithi160 ceph-mon[35055]: pgmap v66: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:10:56.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:55 smithi123 ceph-mon[35438]: pgmap v66: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:10:56.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:55 smithi037 ceph-mon[30630]: pgmap v66: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:10:57.785 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:57 smithi160 ceph-mon[35055]: pgmap v67: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:10:58.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:57 smithi123 ceph-mon[35438]: pgmap v67: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:10:58.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:57 smithi037 ceph-mon[30630]: pgmap v67: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:10:58.833 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:58 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-11T23:10:58.833 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:58 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:10:59.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:58 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-11T23:10:59.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:58 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:10:59.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:58 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-11T23:10:59.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:58 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:10:59.903 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:59 smithi160 ceph-mon[35055]: pgmap v68: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:10:59.903 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:10:59 smithi160 ceph-mon[35055]: Deploying daemon osd.2 on smithi160 2024-09-11T23:11:00.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:59 smithi123 ceph-mon[35438]: pgmap v68: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:11:00.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:10:59 smithi123 ceph-mon[35438]: Deploying daemon osd.2 on smithi160 2024-09-11T23:11:00.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:59 smithi037 ceph-mon[30630]: pgmap v68: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:11:00.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:10:59 smithi037 ceph-mon[30630]: Deploying daemon osd.2 on smithi160 2024-09-11T23:11:01.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:01 smithi160 ceph-mon[35055]: pgmap v69: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:11:02.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:01 smithi123 ceph-mon[35438]: pgmap v69: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:11:02.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:01 smithi037 ceph-mon[30630]: pgmap v69: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:11:03.822 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:03 smithi160 ceph-mon[35055]: pgmap v70: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:11:04.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:03 smithi123 ceph-mon[35438]: pgmap v70: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:11:04.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:03 smithi037 ceph-mon[30630]: pgmap v70: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:11:05.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:04 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:11:05.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:04 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:11:05.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:04 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:11:05.019 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:04 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:11:05.020 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:04 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:11:05.020 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:04 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:11:05.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:04 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:11:05.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:04 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:11:05.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:04 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:11:05.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:05 smithi160 ceph-mon[35055]: pgmap v71: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:11:06.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:05 smithi123 ceph-mon[35438]: pgmap v71: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:11:06.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:05 smithi037 ceph-mon[30630]: pgmap v71: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:11:07.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:07 smithi123 ceph-mon[35438]: pgmap v72: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:11:07.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:07 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:11:07.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:07 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:11:07.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:07 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:11:07.502 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:07 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:11:07.502 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:07 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:11:07.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:07 smithi160 ceph-mon[35055]: pgmap v72: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:11:07.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:07 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:11:07.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:07 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:11:07.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:07 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:11:07.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:07 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:11:07.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:07 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:11:07.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:07 smithi037 ceph-mon[30630]: pgmap v72: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:11:07.815 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:07 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:11:07.815 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:07 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:11:07.815 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:07 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:11:07.815 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:07 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:11:07.815 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:07 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:11:08.333 INFO:teuthology.orchestra.run.smithi160.stdout:Created osd(s) 2 on host 'smithi160' 2024-09-11T23:11:08.334 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:11:08.333+0000 7f31397fa640 1 -- 172.21.15.160:0/1969076547 <== mgr.14150 v2:172.21.15.37:6800/31543269 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f313c062630 con 0x7f31280a2b20 2024-09-11T23:11:08.336 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:11:08.335+0000 7f3141fd7640 1 -- 172.21.15.160:0/1969076547 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f31280a2b20 msgr2=0x7f31280a4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:11:08.336 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:11:08.335+0000 7f3141fd7640 1 --2- 172.21.15.160:0/1969076547 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f31280a2b20 0x7f31280a4fe0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f312402aa00 tx=0x7f31240315b0 comp rx=0 tx=0).stop 2024-09-11T23:11:08.336 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:11:08.335+0000 7f3141fd7640 1 -- 172.21.15.160:0/1969076547 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f313c102690 msgr2=0x7f313c197f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:11:08.336 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:11:08.335+0000 7f3141fd7640 1 --2- 172.21.15.160:0/1969076547 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f313c102690 0x7f313c197f70 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f312c00d770 tx=0x7f312c00dc30 comp rx=0 tx=0).stop 2024-09-11T23:11:08.336 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:11:08.336+0000 7f3141fd7640 1 -- 172.21.15.160:0/1969076547 shutdown_connections 2024-09-11T23:11:08.336 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:11:08.336+0000 7f3141fd7640 1 --2- 172.21.15.160:0/1969076547 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f31280a2b20 0x7f31280a4fe0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:11:08.336 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:11:08.336+0000 7f3141fd7640 1 --2- 172.21.15.160:0/1969076547 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f313c1078f0 0x7f313c19f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:11:08.336 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:11:08.336+0000 7f3141fd7640 1 --2- 172.21.15.160:0/1969076547 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f313c104fc0 0x7f313c1984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:11:08.336 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:11:08.336+0000 7f3141fd7640 1 --2- 172.21.15.160:0/1969076547 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f313c102690 0x7f313c197f70 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:11:08.337 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:11:08.336+0000 7f3141fd7640 1 -- 172.21.15.160:0/1969076547 >> 172.21.15.160:0/1969076547 conn(0x7f313c0fc290 msgr2=0x7f313c102fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:11:08.337 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:11:08.336+0000 7f3141fd7640 1 -- 172.21.15.160:0/1969076547 shutdown_connections 2024-09-11T23:11:08.337 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:11:08.336+0000 7f3141fd7640 1 -- 172.21.15.160:0/1969076547 wait complete. 2024-09-11T23:11:08.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:08 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:11:08.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:08 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:11:08.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:08 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:11:08.717 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:08 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:11:08.717 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:08 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:11:08.717 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:08 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:11:08.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:08 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:11:08.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:08 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:11:08.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:08 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:11:08.971 DEBUG:teuthology.orchestra.run.smithi160:osd.2> sudo journalctl -f -n 0 -u ceph-8b03efce-7092-11ef-bcea-c7b262605968@osd.2.service 2024-09-11T23:11:08.974 INFO:tasks.cephadm:Deploying osd.3 on smithi037 with /dev/vg_nvme/lv_3... 2024-09-11T23:11:08.974 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-11T23:11:09.353 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:11:09.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:09 smithi160 ceph-mon[35055]: pgmap v73: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:11:09.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:09 smithi123 ceph-mon[35438]: pgmap v73: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:11:09.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:09 smithi037 ceph-mon[30630]: pgmap v73: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:11:10.684 INFO:journalctl@ceph.osd.2.smithi160.stdout:Sep 11 23:11:10 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-2[40045]: 2024-09-11T23:11:10.433+0000 7f773aada640 -1 osd.2 0 log_to_monitors true 2024-09-11T23:11:11.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:11 smithi160 ceph-mon[35055]: pgmap v74: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:11:11.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:11 smithi160 ceph-mon[35055]: from='osd.2 [v2:172.21.15.160:6800/1866489133,v1:172.21.15.160:6801/1866489133]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-11T23:11:11.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:11 smithi160 ceph-mon[35055]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-11T23:11:11.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:11 smithi123 ceph-mon[35438]: pgmap v74: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:11:11.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:11 smithi123 ceph-mon[35438]: from='osd.2 [v2:172.21.15.160:6800/1866489133,v1:172.21.15.160:6801/1866489133]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-11T23:11:11.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:11 smithi123 ceph-mon[35438]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-11T23:11:11.777 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:11 smithi037 ceph-mon[30630]: pgmap v74: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:11:11.777 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:11 smithi037 ceph-mon[30630]: from='osd.2 [v2:172.21.15.160:6800/1866489133,v1:172.21.15.160:6801/1866489133]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-11T23:11:11.777 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:11 smithi037 ceph-mon[30630]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-11T23:11:12.663 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:12 smithi037 ceph-mon[30630]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-11T23:11:12.663 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:12 smithi037 ceph-mon[30630]: osdmap e16: 3 total, 2 up, 3 in 2024-09-11T23:11:12.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:12 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T23:11:12.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:12 smithi037 ceph-mon[30630]: from='osd.2 [v2:172.21.15.160:6800/1866489133,v1:172.21.15.160:6801/1866489133]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-09-11T23:11:12.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:12 smithi037 ceph-mon[30630]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-09-11T23:11:12.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:12 smithi037 ceph-mon[30630]: Detected new or changed devices on smithi160 2024-09-11T23:11:12.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:12 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:11:12.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:12 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:11:12.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:12 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:11:12.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:12 smithi037 ceph-mon[30630]: Adjusting osd_memory_target on smithi160 to 17088M 2024-09-11T23:11:12.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:12 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:11:12.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:12 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:11:12.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:12 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:11:12.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:12 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:11:12.672 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:11:12.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:12 smithi160 ceph-mon[35055]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-11T23:11:12.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:12 smithi160 ceph-mon[35055]: osdmap e16: 3 total, 2 up, 3 in 2024-09-11T23:11:12.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:12 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T23:11:12.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:12 smithi160 ceph-mon[35055]: from='osd.2 [v2:172.21.15.160:6800/1866489133,v1:172.21.15.160:6801/1866489133]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-09-11T23:11:12.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:12 smithi160 ceph-mon[35055]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-09-11T23:11:12.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:12 smithi160 ceph-mon[35055]: Detected new or changed devices on smithi160 2024-09-11T23:11:12.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:12 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:11:12.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:12 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:11:12.685 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:12 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:11:12.685 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:12 smithi160 ceph-mon[35055]: Adjusting osd_memory_target on smithi160 to 17088M 2024-09-11T23:11:12.685 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:12 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:11:12.685 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:12 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:11:12.685 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:12 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:11:12.685 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:12 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:11:12.703 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi037:vg_nvme/lv_3 2024-09-11T23:11:12.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:12 smithi123 ceph-mon[35438]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-11T23:11:12.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:12 smithi123 ceph-mon[35438]: osdmap e16: 3 total, 2 up, 3 in 2024-09-11T23:11:12.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:12 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T23:11:12.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:12 smithi123 ceph-mon[35438]: from='osd.2 [v2:172.21.15.160:6800/1866489133,v1:172.21.15.160:6801/1866489133]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-09-11T23:11:12.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:12 smithi123 ceph-mon[35438]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-09-11T23:11:12.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:12 smithi123 ceph-mon[35438]: Detected new or changed devices on smithi160 2024-09-11T23:11:12.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:12 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:11:12.752 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:12 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:11:12.752 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:12 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:11:12.752 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:12 smithi123 ceph-mon[35438]: Adjusting osd_memory_target on smithi160 to 17088M 2024-09-11T23:11:12.752 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:12 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:11:12.752 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:12 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:11:12.752 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:12 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:11:12.752 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:12 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:11:13.079 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:11:13.393 INFO:journalctl@ceph.osd.2.smithi160.stdout:Sep 11 23:11:13 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-2[40045]: 2024-09-11T23:11:13.039+0000 7f7736a5d640 -1 osd.2 0 waiting for initial osdmap 2024-09-11T23:11:13.394 INFO:journalctl@ceph.osd.2.smithi160.stdout:Sep 11 23:11:13 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-2[40045]: 2024-09-11T23:11:13.043+0000 7f772e87d640 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T23:11:13.483 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:13 smithi037 ceph-mon[30630]: pgmap v76: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:11:13.483 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:13 smithi037 ceph-mon[30630]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]': finished 2024-09-11T23:11:13.483 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:13 smithi037 ceph-mon[30630]: osdmap e17: 3 total, 2 up, 3 in 2024-09-11T23:11:13.483 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:13 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T23:11:13.484 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:13 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T23:11:13.484 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:13 smithi037 ceph-mon[30630]: from='osd.2 ' entity='osd.2' 2024-09-11T23:11:13.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:11:13.598+0000 7fb3f3400640 1 -- 172.21.15.37:0/871521586 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb3ec103e00 msgr2=0x7fb3ec104200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:11:13.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:11:13.598+0000 7fb3f3400640 1 --2- 172.21.15.37:0/871521586 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb3ec103e00 0x7fb3ec104200 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fb3e0009900 tx=0x7fb3e002a3f0 comp rx=0 tx=0).stop 2024-09-11T23:11:13.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:11:13.598+0000 7fb3f3400640 1 -- 172.21.15.37:0/871521586 shutdown_connections 2024-09-11T23:11:13.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:11:13.598+0000 7fb3f3400640 1 --2- 172.21.15.37:0/871521586 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3ec105920 0x7fb3ec10c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:11:13.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:11:13.598+0000 7fb3f3400640 1 --2- 172.21.15.37:0/871521586 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3ec104f60 0x7fb3ec1053e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:11:13.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:11:13.598+0000 7fb3f3400640 1 --2- 172.21.15.37:0/871521586 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb3ec103e00 0x7fb3ec104200 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:11:13.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:11:13.598+0000 7fb3f3400640 1 -- 172.21.15.37:0/871521586 >> 172.21.15.37:0/871521586 conn(0x7fb3ec0ff5b0 msgr2=0x7fb3ec1019d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:11:13.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:11:13.598+0000 7fb3f3400640 1 -- 172.21.15.37:0/871521586 shutdown_connections 2024-09-11T23:11:13.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:11:13.598+0000 7fb3f3400640 1 -- 172.21.15.37:0/871521586 wait complete. 2024-09-11T23:11:13.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:11:13.599+0000 7fb3f3400640 1 Processor -- start 2024-09-11T23:11:13.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:11:13.599+0000 7fb3f3400640 1 -- start start 2024-09-11T23:11:13.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:11:13.600+0000 7fb3f3400640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb3ec103e00 0x7fb3ec079fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:11:13.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:11:13.600+0000 7fb3f3400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3ec104f60 0x7fb3ec07a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:11:13.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:11:13.600+0000 7fb3f3400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3ec105920 0x7fb3ec076b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:11:13.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:11:13.600+0000 7fb3f3400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb3ec10fa90 con 0x7fb3ec104f60 2024-09-11T23:11:13.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:11:13.600+0000 7fb3f3400640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fb3ec10f910 con 0x7fb3ec105920 2024-09-11T23:11:13.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:11:13.600+0000 7fb3f3400640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fb3ec10fc10 con 0x7fb3ec103e00 2024-09-11T23:11:13.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:11:13.600+0000 7fb3ebe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3ec104f60 0x7fb3ec07a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:11:13.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:11:13.600+0000 7fb3ebe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3ec104f60 0x7fb3ec07a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58588/0 (socket says 172.21.15.37:58588) 2024-09-11T23:11:13.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:11:13.600+0000 7fb3ebe00640 1 -- 172.21.15.37:0/544908020 learned_addr learned my addr 172.21.15.37:0/544908020 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:11:13.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:11:13.600+0000 7fb3f0a00640 1 --2- 172.21.15.37:0/544908020 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb3ec103e00 0x7fb3ec079fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:11:13.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:11:13.600+0000 7fb3f1400640 1 --2- 172.21.15.37:0/544908020 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3ec105920 0x7fb3ec076b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:11:13.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:11:13.601+0000 7fb3ebe00640 1 -- 172.21.15.37:0/544908020 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb3ec103e00 msgr2=0x7fb3ec079fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:11:13.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:11:13.601+0000 7fb3ebe00640 1 --2- 172.21.15.37:0/544908020 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb3ec103e00 0x7fb3ec079fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:11:13.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:11:13.601+0000 7fb3ebe00640 1 -- 172.21.15.37:0/544908020 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3ec105920 msgr2=0x7fb3ec076b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:11:13.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:11:13.601+0000 7fb3ebe00640 1 --2- 172.21.15.37:0/544908020 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3ec105920 0x7fb3ec076b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:11:13.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:11:13.601+0000 7fb3ebe00640 1 -- 172.21.15.37:0/544908020 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3ec0773c0 con 0x7fb3ec104f60 2024-09-11T23:11:13.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:11:13.601+0000 7fb3f1400640 1 --2- 172.21.15.37:0/544908020 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3ec105920 0x7fb3ec076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:11:13.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:11:13.601+0000 7fb3ebe00640 1 --2- 172.21.15.37:0/544908020 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3ec104f60 0x7fb3ec07a4e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb3d800e9c0 tx=0x7fb3d800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:11:13.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:11:13.601+0000 7fb3e9600640 1 -- 172.21.15.37:0/544908020 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3d800cd80 con 0x7fb3ec104f60 2024-09-11T23:11:13.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:11:13.601+0000 7fb3e9600640 1 -- 172.21.15.37:0/544908020 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb3d80035f0 con 0x7fb3ec104f60 2024-09-11T23:11:13.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:11:13.601+0000 7fb3f3400640 1 -- 172.21.15.37:0/544908020 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3ec1a6540 con 0x7fb3ec104f60 2024-09-11T23:11:13.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:11:13.601+0000 7fb3e9600640 1 -- 172.21.15.37:0/544908020 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3d8010690 con 0x7fb3ec104f60 2024-09-11T23:11:13.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:11:13.601+0000 7fb3f3400640 1 -- 172.21.15.37:0/544908020 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3ec1a6930 con 0x7fb3ec104f60 2024-09-11T23:11:13.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:11:13.603+0000 7fb3f3400640 1 -- 172.21.15.37:0/544908020 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3ec104200 con 0x7fb3ec104f60 2024-09-11T23:11:13.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:11:13.605+0000 7fb3e9600640 1 -- 172.21.15.37:0/544908020 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 15) ==== 137777+0+0 (secure 0 0 0) 0x7fb3d80037a0 con 0x7fb3ec104f60 2024-09-11T23:11:13.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:11:13.606+0000 7fb3e9600640 1 --2- 172.21.15.37:0/544908020 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fb3d40a2b70 0x7fb3d40a5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:11:13.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:11:13.607+0000 7fb3e9600640 1 -- 172.21.15.37:0/544908020 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 2571+0+0 (secure 0 0 0) 0x7fb3d80cdd40 con 0x7fb3ec104f60 2024-09-11T23:11:13.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:11:13.607+0000 7fb3f0a00640 1 --2- 172.21.15.37:0/544908020 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fb3d40a2b70 0x7fb3d40a5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:11:13.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:11:13.607+0000 7fb3f0a00640 1 --2- 172.21.15.37:0/544908020 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fb3d40a2b70 0x7fb3d40a5030 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb3e00314e0 tx=0x7fb3e0000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:11:13.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:11:13.611+0000 7fb3e9600640 1 -- 172.21.15.37:0/544908020 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb3d809c350 con 0x7fb3ec104f60 2024-09-11T23:11:13.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:13 smithi160 ceph-mon[35055]: pgmap v76: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:11:13.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:13 smithi160 ceph-mon[35055]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]': finished 2024-09-11T23:11:13.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:13 smithi160 ceph-mon[35055]: osdmap e17: 3 total, 2 up, 3 in 2024-09-11T23:11:13.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:13 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T23:11:13.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:13 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T23:11:13.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:13 smithi160 ceph-mon[35055]: from='osd.2 ' entity='osd.2' 2024-09-11T23:11:13.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:13 smithi123 ceph-mon[35438]: pgmap v76: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:11:13.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:13 smithi123 ceph-mon[35438]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]': finished 2024-09-11T23:11:13.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:13 smithi123 ceph-mon[35438]: osdmap e17: 3 total, 2 up, 3 in 2024-09-11T23:11:13.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:13 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T23:11:13.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:13 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T23:11:13.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:13 smithi123 ceph-mon[35438]: from='osd.2 ' entity='osd.2' 2024-09-11T23:11:13.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:11:13.804+0000 7fb3f3400640 1 -- 172.21.15.37:0/544908020 --> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fb3ec062630 con 0x7fb3d40a2b70 2024-09-11T23:11:14.678 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:14 smithi037 ceph-mon[30630]: purged_snaps scrub starts 2024-09-11T23:11:14.678 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:14 smithi037 ceph-mon[30630]: purged_snaps scrub ok 2024-09-11T23:11:14.678 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:14 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T23:11:14.678 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:14 smithi037 ceph-mon[30630]: from='client.14265 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:11:14.678 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:14 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:11:14.678 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:14 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:11:14.678 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:14 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:11:14.678 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:14 smithi037 ceph-mon[30630]: osd.2 [v2:172.21.15.160:6800/1866489133,v1:172.21.15.160:6801/1866489133] boot 2024-09-11T23:11:14.678 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:14 smithi037 ceph-mon[30630]: osdmap e18: 3 total, 3 up, 3 in 2024-09-11T23:11:14.679 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:14 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T23:11:14.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:14 smithi160 ceph-mon[35055]: purged_snaps scrub starts 2024-09-11T23:11:14.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:14 smithi160 ceph-mon[35055]: purged_snaps scrub ok 2024-09-11T23:11:14.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:14 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T23:11:14.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:14 smithi160 ceph-mon[35055]: from='client.14265 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:11:14.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:14 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:11:14.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:14 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:11:14.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:14 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:11:14.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:14 smithi160 ceph-mon[35055]: osd.2 [v2:172.21.15.160:6800/1866489133,v1:172.21.15.160:6801/1866489133] boot 2024-09-11T23:11:14.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:14 smithi160 ceph-mon[35055]: osdmap e18: 3 total, 3 up, 3 in 2024-09-11T23:11:14.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:14 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T23:11:14.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:14 smithi123 ceph-mon[35438]: purged_snaps scrub starts 2024-09-11T23:11:14.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:14 smithi123 ceph-mon[35438]: purged_snaps scrub ok 2024-09-11T23:11:14.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:14 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T23:11:14.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:14 smithi123 ceph-mon[35438]: from='client.14265 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:11:14.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:14 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:11:14.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:14 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:11:14.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:14 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:11:14.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:14 smithi123 ceph-mon[35438]: osd.2 [v2:172.21.15.160:6800/1866489133,v1:172.21.15.160:6801/1866489133] boot 2024-09-11T23:11:14.752 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:14 smithi123 ceph-mon[35438]: osdmap e18: 3 total, 3 up, 3 in 2024-09-11T23:11:14.752 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:14 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T23:11:15.557 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:15 smithi037 ceph-mon[30630]: pgmap v78: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:11:15.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:15 smithi160 ceph-mon[35055]: pgmap v78: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:11:15.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:15 smithi123 ceph-mon[35438]: pgmap v78: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:11:16.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:16 smithi160 ceph-mon[35055]: osdmap e19: 3 total, 3 up, 3 in 2024-09-11T23:11:16.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:16 smithi037 ceph-mon[30630]: osdmap e19: 3 total, 3 up, 3 in 2024-09-11T23:11:17.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:16 smithi123 ceph-mon[35438]: osdmap e19: 3 total, 3 up, 3 in 2024-09-11T23:11:17.814 INFO:journalctl@ceph.osd.0.smithi037.stdout:Sep 11 23:11:17 smithi037 sudo[48901]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-11T23:11:17.814 INFO:journalctl@ceph.osd.0.smithi037.stdout:Sep 11 23:11:17 smithi037 sudo[48901]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T23:11:17.815 INFO:journalctl@ceph.osd.0.smithi037.stdout:Sep 11 23:11:17 smithi037 sudo[48901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T23:11:17.815 INFO:journalctl@ceph.osd.0.smithi037.stdout:Sep 11 23:11:17 smithi037 sudo[48901]: pam_unix(sudo:session): session closed for user root 2024-09-11T23:11:17.815 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:17 smithi037 ceph-mon[30630]: pgmap v81: 0 pgs: ; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:11:17.815 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:17 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-11T23:11:17.815 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:17 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-11T23:11:17.815 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:17 smithi037 ceph-mon[30630]: osdmap e20: 3 total, 3 up, 3 in 2024-09-11T23:11:17.815 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:17 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-11T23:11:17.815 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:17 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/1984121923' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7c819225-964b-44f2-93e5-1d7585eb0b36"}]: dispatch 2024-09-11T23:11:17.815 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:17 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-11T23:11:17.816 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:17 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/1984121923' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7c819225-964b-44f2-93e5-1d7585eb0b36"}]': finished 2024-09-11T23:11:17.816 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:17 smithi037 ceph-mon[30630]: osdmap e21: 4 total, 3 up, 4 in 2024-09-11T23:11:17.816 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:17 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T23:11:17.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:17 smithi160 ceph-mon[35055]: pgmap v81: 0 pgs: ; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:11:17.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:17 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-11T23:11:17.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:17 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-11T23:11:17.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:17 smithi160 ceph-mon[35055]: osdmap e20: 3 total, 3 up, 3 in 2024-09-11T23:11:17.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:17 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-11T23:11:17.935 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:17 smithi160 ceph-mon[35055]: from='client.? 172.21.15.37:0/1984121923' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7c819225-964b-44f2-93e5-1d7585eb0b36"}]: dispatch 2024-09-11T23:11:17.935 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:17 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-11T23:11:17.935 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:17 smithi160 ceph-mon[35055]: from='client.? 172.21.15.37:0/1984121923' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7c819225-964b-44f2-93e5-1d7585eb0b36"}]': finished 2024-09-11T23:11:17.935 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:17 smithi160 ceph-mon[35055]: osdmap e21: 4 total, 3 up, 4 in 2024-09-11T23:11:17.935 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:17 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T23:11:18.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:17 smithi123 ceph-mon[35438]: pgmap v81: 0 pgs: ; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:11:18.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:17 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-11T23:11:18.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:17 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-11T23:11:18.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:17 smithi123 ceph-mon[35438]: osdmap e20: 3 total, 3 up, 3 in 2024-09-11T23:11:18.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:17 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-11T23:11:18.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:17 smithi123 ceph-mon[35438]: from='client.? 172.21.15.37:0/1984121923' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7c819225-964b-44f2-93e5-1d7585eb0b36"}]: dispatch 2024-09-11T23:11:18.002 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:17 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-11T23:11:18.002 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:17 smithi123 ceph-mon[35438]: from='client.? 172.21.15.37:0/1984121923' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7c819225-964b-44f2-93e5-1d7585eb0b36"}]': finished 2024-09-11T23:11:18.002 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:17 smithi123 ceph-mon[35438]: osdmap e21: 4 total, 3 up, 4 in 2024-09-11T23:11:18.002 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:17 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T23:11:18.556 INFO:journalctl@ceph.osd.0.smithi037.stdout:Sep 11 23:11:18 smithi037 sudo[48950]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-11T23:11:18.556 INFO:journalctl@ceph.osd.0.smithi037.stdout:Sep 11 23:11:18 smithi037 sudo[48950]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T23:11:18.556 INFO:journalctl@ceph.osd.0.smithi037.stdout:Sep 11 23:11:18 smithi037 sudo[48950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T23:11:18.556 INFO:journalctl@ceph.osd.0.smithi037.stdout:Sep 11 23:11:18 smithi037 sudo[48950]: pam_unix(sudo:session): session closed for user root 2024-09-11T23:11:18.659 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:18 smithi123 ceph-mon[35438]: from='client.? 172.21.15.37:0/1760173641' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:11:18.660 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:18 smithi123 ceph-mon[35438]: osdmap e22: 4 total, 3 up, 4 in 2024-09-11T23:11:18.660 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:18 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T23:11:18.660 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:18 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:11:18.660 INFO:journalctl@ceph.osd.1.smithi123.stdout:Sep 11 23:11:18 smithi123 sudo[43887]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-11T23:11:18.660 INFO:journalctl@ceph.osd.1.smithi123.stdout:Sep 11 23:11:18 smithi123 sudo[43887]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T23:11:18.660 INFO:journalctl@ceph.osd.1.smithi123.stdout:Sep 11 23:11:18 smithi123 sudo[43887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T23:11:18.661 INFO:journalctl@ceph.osd.1.smithi123.stdout:Sep 11 23:11:18 smithi123 sudo[43887]: pam_unix(sudo:session): session closed for user root 2024-09-11T23:11:18.826 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:18 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/1760173641' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:11:18.826 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:18 smithi037 ceph-mon[30630]: osdmap e22: 4 total, 3 up, 4 in 2024-09-11T23:11:18.827 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:18 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T23:11:18.827 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:18 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:11:18.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:11:18.915+0000 7fb3e9600640 1 -- 172.21.15.37:0/544908020 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fb3d80982c0 con 0x7fb3ec104f60 2024-09-11T23:11:18.931 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:18 smithi160 ceph-mon[35055]: from='client.? 172.21.15.37:0/1760173641' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:11:18.931 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:18 smithi160 ceph-mon[35055]: osdmap e22: 4 total, 3 up, 4 in 2024-09-11T23:11:18.931 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:18 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T23:11:18.931 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:18 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:11:19.002 INFO:journalctl@ceph.osd.1.smithi123.stdout:Sep 11 23:11:18 smithi123 sudo[43890]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-11T23:11:19.002 INFO:journalctl@ceph.osd.1.smithi123.stdout:Sep 11 23:11:18 smithi123 sudo[43890]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T23:11:19.002 INFO:journalctl@ceph.osd.1.smithi123.stdout:Sep 11 23:11:18 smithi123 sudo[43890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T23:11:19.002 INFO:journalctl@ceph.osd.1.smithi123.stdout:Sep 11 23:11:18 smithi123 sudo[43890]: pam_unix(sudo:session): session closed for user root 2024-09-11T23:11:19.184 INFO:journalctl@ceph.osd.2.smithi160.stdout:Sep 11 23:11:18 smithi160 sudo[43677]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-11T23:11:19.184 INFO:journalctl@ceph.osd.2.smithi160.stdout:Sep 11 23:11:18 smithi160 sudo[43677]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T23:11:19.184 INFO:journalctl@ceph.osd.2.smithi160.stdout:Sep 11 23:11:18 smithi160 sudo[43677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T23:11:19.184 INFO:journalctl@ceph.osd.2.smithi160.stdout:Sep 11 23:11:18 smithi160 sudo[43677]: pam_unix(sudo:session): session closed for user root 2024-09-11T23:11:19.684 INFO:journalctl@ceph.osd.2.smithi160.stdout:Sep 11 23:11:19 smithi160 sudo[43680]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-11T23:11:19.684 INFO:journalctl@ceph.osd.2.smithi160.stdout:Sep 11 23:11:19 smithi160 sudo[43680]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T23:11:19.684 INFO:journalctl@ceph.osd.2.smithi160.stdout:Sep 11 23:11:19 smithi160 sudo[43680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T23:11:19.684 INFO:journalctl@ceph.osd.2.smithi160.stdout:Sep 11 23:11:19 smithi160 sudo[43680]: pam_unix(sudo:session): session closed for user root 2024-09-11T23:11:20.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:19 smithi037 sudo[49338]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-11T23:11:20.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:19 smithi037 sudo[49338]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T23:11:20.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:19 smithi037 sudo[49338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T23:11:20.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:19 smithi037 sudo[49338]: pam_unix(sudo:session): session closed for user root 2024-09-11T23:11:20.625 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:20 smithi160 ceph-mon[35055]: pgmap v85: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:11:20.625 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:20 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:11:20.625 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:20 smithi160 ceph-mon[35055]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-11T23:11:20.625 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:20 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:11:20.625 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:20 smithi160 ceph-mon[35055]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-11T23:11:20.626 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:20 smithi160 ceph-mon[35055]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-11T23:11:20.626 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:20 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T23:11:20.626 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:20 smithi160 sudo[43683]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-11T23:11:20.626 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:20 smithi160 sudo[43683]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T23:11:20.626 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:20 smithi160 sudo[43683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T23:11:20.626 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:20 smithi160 sudo[43683]: pam_unix(sudo:session): session closed for user root 2024-09-11T23:11:20.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:20 smithi123 ceph-mon[35438]: pgmap v85: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:11:20.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:20 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:11:20.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:20 smithi123 ceph-mon[35438]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-11T23:11:20.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:20 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:11:20.752 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:20 smithi123 ceph-mon[35438]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-11T23:11:20.752 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:20 smithi123 ceph-mon[35438]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-11T23:11:20.752 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:20 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T23:11:20.815 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:20 smithi037 sudo[49711]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-11T23:11:20.815 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:20 smithi037 sudo[49711]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T23:11:20.815 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:20 smithi037 sudo[49711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T23:11:20.815 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:20 smithi037 sudo[49711]: pam_unix(sudo:session): session closed for user root 2024-09-11T23:11:20.815 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:20 smithi037 ceph-mon[30630]: pgmap v85: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:11:20.815 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:20 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:11:20.815 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:20 smithi037 ceph-mon[30630]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-11T23:11:20.815 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:20 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:11:20.815 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:20 smithi037 ceph-mon[30630]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-11T23:11:20.815 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:20 smithi037 ceph-mon[30630]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-11T23:11:20.816 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:20 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T23:11:20.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:20 smithi160 sudo[43686]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-11T23:11:20.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:20 smithi160 sudo[43686]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T23:11:20.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:20 smithi160 sudo[43686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T23:11:20.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:20 smithi160 sudo[43686]: pam_unix(sudo:session): session closed for user root 2024-09-11T23:11:21.364 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:21 smithi123 sudo[43893]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-11T23:11:21.364 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:21 smithi123 sudo[43893]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T23:11:21.364 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:21 smithi123 sudo[43893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T23:11:21.364 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:21 smithi123 sudo[43893]: pam_unix(sudo:session): session closed for user root 2024-09-11T23:11:21.669 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:21 smithi037 ceph-mon[30630]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:11:21.669 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:21 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:11:21.669 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:21 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T23:11:21.669 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:21 smithi037 ceph-mon[30630]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-11T23:11:21.669 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:21 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T23:11:21.669 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:21 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:11:21.670 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:21 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T23:11:21.670 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:21 smithi037 ceph-mon[30630]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-11T23:11:21.670 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:21 smithi037 ceph-mon[30630]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-11T23:11:21.670 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:21 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T23:11:21.670 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:21 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:11:21.670 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:21 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T23:11:21.670 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:21 smithi037 ceph-mon[30630]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-11T23:11:21.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:21 smithi160 ceph-mon[35055]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:11:21.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:21 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:11:21.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:21 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T23:11:21.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:21 smithi160 ceph-mon[35055]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-11T23:11:21.685 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:21 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T23:11:21.685 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:21 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:11:21.685 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:21 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T23:11:21.685 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:21 smithi160 ceph-mon[35055]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-11T23:11:21.685 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:21 smithi160 ceph-mon[35055]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-11T23:11:21.685 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:21 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T23:11:21.685 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:21 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:11:21.685 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:21 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T23:11:21.685 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:21 smithi160 ceph-mon[35055]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-11T23:11:21.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:21 smithi123 sudo[43896]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-11T23:11:21.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:21 smithi123 sudo[43896]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T23:11:21.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:21 smithi123 sudo[43896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T23:11:21.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:21 smithi123 sudo[43896]: pam_unix(sudo:session): session closed for user root 2024-09-11T23:11:21.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:21 smithi123 ceph-mon[35438]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:11:21.752 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:21 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:11:21.752 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:21 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T23:11:21.752 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:21 smithi123 ceph-mon[35438]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-11T23:11:21.752 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:21 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T23:11:21.752 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:21 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:11:21.752 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:21 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T23:11:21.752 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:21 smithi123 ceph-mon[35438]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-11T23:11:21.752 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:21 smithi123 ceph-mon[35438]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-11T23:11:21.752 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:21 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T23:11:21.752 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:21 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:11:21.752 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:21 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T23:11:21.752 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:21 smithi123 ceph-mon[35438]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-11T23:11:23.668 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:23 smithi037 ceph-mon[30630]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:11:23.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:23 smithi160 ceph-mon[35055]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:11:23.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:23 smithi123 ceph-mon[35438]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:11:25.679 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:25 smithi037 ceph-mon[30630]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:11:25.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:25 smithi160 ceph-mon[35055]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:11:25.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:25 smithi123 ceph-mon[35438]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:11:26.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:26 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-11T23:11:26.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:26 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:11:26.696 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:26 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-11T23:11:26.696 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:26 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:11:26.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:26 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-11T23:11:26.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:26 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:11:27.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:27 smithi160 ceph-mon[35055]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 44 KiB/s wr, 3 op/s 2024-09-11T23:11:27.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:27 smithi160 ceph-mon[35055]: Deploying daemon osd.3 on smithi037 2024-09-11T23:11:27.718 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:27 smithi037 ceph-mon[30630]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 44 KiB/s wr, 3 op/s 2024-09-11T23:11:27.718 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:27 smithi037 ceph-mon[30630]: Deploying daemon osd.3 on smithi037 2024-09-11T23:11:27.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:27 smithi123 ceph-mon[35438]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 44 KiB/s wr, 3 op/s 2024-09-11T23:11:27.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:27 smithi123 ceph-mon[35438]: Deploying daemon osd.3 on smithi037 2024-09-11T23:11:29.521 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:29 smithi037 ceph-mon[30630]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 33 KiB/s wr, 2 op/s 2024-09-11T23:11:29.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:29 smithi160 ceph-mon[35055]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 33 KiB/s wr, 2 op/s 2024-09-11T23:11:29.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:29 smithi123 ceph-mon[35438]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 33 KiB/s wr, 2 op/s 2024-09-11T23:11:31.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:31 smithi160 ceph-mon[35055]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 921 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-11T23:11:31.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:31 smithi123 ceph-mon[35438]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 921 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-11T23:11:31.815 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:31 smithi037 ceph-mon[30630]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 921 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-11T23:11:33.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:33 smithi160 ceph-mon[35055]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-11T23:11:33.729 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:33 smithi037 ceph-mon[30630]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-11T23:11:33.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:33 smithi123 ceph-mon[35438]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-11T23:11:34.652 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:34 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:11:34.652 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:34 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:11:34.652 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:34 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:11:34.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:34 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:11:34.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:34 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:11:34.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:34 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:11:34.700 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:34 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:11:34.700 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:34 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:11:34.700 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:34 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:11:36.038 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:35 smithi037 ceph-mon[30630]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-11T23:11:36.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:35 smithi160 ceph-mon[35055]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-11T23:11:36.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:35 smithi123 ceph-mon[35438]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-11T23:11:38.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:37 smithi037 ceph-mon[30630]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-11T23:11:38.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:37 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:11:38.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:37 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:11:38.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:37 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:11:38.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:37 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:11:38.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:37 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:11:38.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:37 smithi160 ceph-mon[35055]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-11T23:11:38.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:37 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:11:38.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:37 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:11:38.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:37 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:11:38.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:37 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:11:38.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:37 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:11:38.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:37 smithi123 ceph-mon[35438]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-11T23:11:38.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:37 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:11:38.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:37 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:11:38.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:37 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:11:38.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:37 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:11:38.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:37 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:11:38.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:11:38.551+0000 7fb3e9600640 1 -- 172.21.15.37:0/544908020 <== mgr.14150 v2:172.21.15.37:6800/31543269 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fb3ec062630 con 0x7fb3d40a2b70 2024-09-11T23:11:38.552 INFO:teuthology.orchestra.run.smithi037.stdout:Created osd(s) 3 on host 'smithi037' 2024-09-11T23:11:38.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:11:38.554+0000 7fb3f3400640 1 -- 172.21.15.37:0/544908020 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fb3d40a2b70 msgr2=0x7fb3d40a5030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:11:38.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:11:38.554+0000 7fb3f3400640 1 --2- 172.21.15.37:0/544908020 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fb3d40a2b70 0x7fb3d40a5030 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb3e00314e0 tx=0x7fb3e0000bc0 comp rx=0 tx=0).stop 2024-09-11T23:11:38.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:11:38.554+0000 7fb3f3400640 1 -- 172.21.15.37:0/544908020 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3ec104f60 msgr2=0x7fb3ec07a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:11:38.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:11:38.554+0000 7fb3f3400640 1 --2- 172.21.15.37:0/544908020 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3ec104f60 0x7fb3ec07a4e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb3d800e9c0 tx=0x7fb3d800ee80 comp rx=0 tx=0).stop 2024-09-11T23:11:38.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:11:38.554+0000 7fb3f3400640 1 -- 172.21.15.37:0/544908020 shutdown_connections 2024-09-11T23:11:38.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:11:38.554+0000 7fb3f3400640 1 --2- 172.21.15.37:0/544908020 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fb3d40a2b70 0x7fb3d40a5030 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:11:38.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:11:38.554+0000 7fb3f3400640 1 --2- 172.21.15.37:0/544908020 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3ec105920 0x7fb3ec076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:11:38.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:11:38.554+0000 7fb3f3400640 1 --2- 172.21.15.37:0/544908020 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3ec104f60 0x7fb3ec07a4e0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:11:38.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:11:38.554+0000 7fb3f3400640 1 --2- 172.21.15.37:0/544908020 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb3ec103e00 0x7fb3ec079fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:11:38.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:11:38.554+0000 7fb3f3400640 1 -- 172.21.15.37:0/544908020 >> 172.21.15.37:0/544908020 conn(0x7fb3ec0ff5b0 msgr2=0x7fb3ec108370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:11:38.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:11:38.554+0000 7fb3f3400640 1 -- 172.21.15.37:0/544908020 shutdown_connections 2024-09-11T23:11:38.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:11:38.554+0000 7fb3f3400640 1 -- 172.21.15.37:0/544908020 wait complete. 2024-09-11T23:11:39.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:38 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:11:39.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:38 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:11:39.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:38 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:11:39.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:38 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:11:39.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:38 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:11:39.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:38 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:11:39.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:38 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:11:39.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:38 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:11:39.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:38 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:11:39.372 DEBUG:teuthology.orchestra.run.smithi037:osd.3> sudo journalctl -f -n 0 -u ceph-8b03efce-7092-11ef-bcea-c7b262605968@osd.3.service 2024-09-11T23:11:39.376 INFO:tasks.cephadm:Deploying osd.4 on smithi123 with /dev/vg_nvme/lv_3... 2024-09-11T23:11:39.377 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-11T23:11:39.629 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T23:11:39.918 INFO:journalctl@ceph.osd.3.smithi037.stdout:Sep 11 23:11:39 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-3[50928]: 2024-09-11T23:11:39.824+0000 7f4fe5835640 -1 osd.3 0 log_to_monitors true 2024-09-11T23:11:40.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:39 smithi123 ceph-mon[35438]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:11:40.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:39 smithi123 ceph-mon[35438]: from='osd.3 [v2:172.21.15.37:6810/412656036,v1:172.21.15.37:6811/412656036]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-11T23:11:40.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:39 smithi160 ceph-mon[35055]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:11:40.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:39 smithi160 ceph-mon[35055]: from='osd.3 [v2:172.21.15.37:6810/412656036,v1:172.21.15.37:6811/412656036]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-11T23:11:40.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:39 smithi037 ceph-mon[30630]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:11:40.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:39 smithi037 ceph-mon[30630]: from='osd.3 [v2:172.21.15.37:6810/412656036,v1:172.21.15.37:6811/412656036]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-11T23:11:41.084 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:40 smithi123 ceph-mon[35438]: from='osd.3 [v2:172.21.15.37:6810/412656036,v1:172.21.15.37:6811/412656036]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-11T23:11:41.084 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:40 smithi123 ceph-mon[35438]: osdmap e23: 4 total, 3 up, 4 in 2024-09-11T23:11:41.084 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:40 smithi123 ceph-mon[35438]: from='osd.3 [v2:172.21.15.37:6810/412656036,v1:172.21.15.37:6811/412656036]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]: dispatch 2024-09-11T23:11:41.084 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:40 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T23:11:41.085 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:40 smithi123 ceph-mon[35438]: from='osd.3 [v2:172.21.15.37:6810/412656036,v1:172.21.15.37:6811/412656036]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2024-09-11T23:11:41.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:40 smithi160 ceph-mon[35055]: from='osd.3 [v2:172.21.15.37:6810/412656036,v1:172.21.15.37:6811/412656036]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-11T23:11:41.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:40 smithi160 ceph-mon[35055]: osdmap e23: 4 total, 3 up, 4 in 2024-09-11T23:11:41.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:40 smithi160 ceph-mon[35055]: from='osd.3 [v2:172.21.15.37:6810/412656036,v1:172.21.15.37:6811/412656036]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]: dispatch 2024-09-11T23:11:41.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:40 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T23:11:41.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:40 smithi160 ceph-mon[35055]: from='osd.3 [v2:172.21.15.37:6810/412656036,v1:172.21.15.37:6811/412656036]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2024-09-11T23:11:41.261 INFO:journalctl@ceph.osd.3.smithi037.stdout:Sep 11 23:11:40 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-3[50928]: 2024-09-11T23:11:40.932+0000 7f4fe0000640 -1 osd.3 0 waiting for initial osdmap 2024-09-11T23:11:41.261 INFO:journalctl@ceph.osd.3.smithi037.stdout:Sep 11 23:11:40 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-3[50928]: 2024-09-11T23:11:40.938+0000 7f4fdb000640 -1 osd.3 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T23:11:41.261 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:40 smithi037 ceph-mon[30630]: from='osd.3 [v2:172.21.15.37:6810/412656036,v1:172.21.15.37:6811/412656036]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-11T23:11:41.262 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:40 smithi037 ceph-mon[30630]: osdmap e23: 4 total, 3 up, 4 in 2024-09-11T23:11:41.262 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:40 smithi037 ceph-mon[30630]: from='osd.3 [v2:172.21.15.37:6810/412656036,v1:172.21.15.37:6811/412656036]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]: dispatch 2024-09-11T23:11:41.262 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:40 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T23:11:41.262 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:40 smithi037 ceph-mon[30630]: from='osd.3 [v2:172.21.15.37:6810/412656036,v1:172.21.15.37:6811/412656036]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2024-09-11T23:11:42.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:41 smithi123 ceph-mon[35438]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:11:42.002 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:41 smithi123 ceph-mon[35438]: osdmap e24: 4 total, 3 up, 4 in 2024-09-11T23:11:42.002 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:41 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T23:11:42.002 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:41 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T23:11:42.112 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-11T23:11:42.139 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi123:vg_nvme/lv_3 2024-09-11T23:11:42.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:41 smithi160 ceph-mon[35055]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:11:42.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:41 smithi160 ceph-mon[35055]: osdmap e24: 4 total, 3 up, 4 in 2024-09-11T23:11:42.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:41 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T23:11:42.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:41 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T23:11:42.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:41 smithi037 ceph-mon[30630]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:11:42.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:41 smithi037 ceph-mon[30630]: osdmap e24: 4 total, 3 up, 4 in 2024-09-11T23:11:42.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:41 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T23:11:42.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:41 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T23:11:42.387 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T23:11:42.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:11:42.854+0000 7f57bb632640 1 -- 172.21.15.123:0/1213234349 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f57b4102e00 msgr2=0x7f57b4103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:11:42.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:11:42.854+0000 7f57bb632640 1 --2- 172.21.15.123:0/1213234349 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f57b4102e00 0x7f57b4103280 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f57b0009900 tx=0x7f57b002a410 comp rx=0 tx=0).stop 2024-09-11T23:11:42.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:11:42.854+0000 7f57bb632640 1 -- 172.21.15.123:0/1213234349 shutdown_connections 2024-09-11T23:11:42.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:11:42.854+0000 7f57bb632640 1 --2- 172.21.15.123:0/1213234349 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f57b4102e00 0x7f57b4103280 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:11:42.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:11:42.854+0000 7f57bb632640 1 --2- 172.21.15.123:0/1213234349 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57b41037c0 0x7f57b410a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:11:42.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:11:42.854+0000 7f57bb632640 1 --2- 172.21.15.123:0/1213234349 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f57b4101c00 0x7f57b4102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:11:42.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:11:42.854+0000 7f57bb632640 1 -- 172.21.15.123:0/1213234349 >> 172.21.15.123:0/1213234349 conn(0x7f57b40fd390 msgr2=0x7f57b40ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:11:42.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:11:42.854+0000 7f57bb632640 1 -- 172.21.15.123:0/1213234349 shutdown_connections 2024-09-11T23:11:42.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:11:42.854+0000 7f57bb632640 1 -- 172.21.15.123:0/1213234349 wait complete. 2024-09-11T23:11:42.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:11:42.855+0000 7f57bb632640 1 Processor -- start 2024-09-11T23:11:42.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:11:42.855+0000 7f57bb632640 1 -- start start 2024-09-11T23:11:42.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:11:42.855+0000 7f57bb632640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f57b4101c00 0x7f57b4197f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:11:42.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:11:42.855+0000 7f57bb632640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57b4102e00 0x7f57b4198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:11:42.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:11:42.855+0000 7f57bb632640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f57b41037c0 0x7f57b419f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:11:42.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:11:42.855+0000 7f57bb632640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f57b410d8d0 con 0x7f57b4102e00 2024-09-11T23:11:42.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:11:42.855+0000 7f57bb632640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f57b410d750 con 0x7f57b4101c00 2024-09-11T23:11:42.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:11:42.855+0000 7f57bb632640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f57b410da50 con 0x7f57b41037c0 2024-09-11T23:11:42.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:11:42.855+0000 7f57b93ce640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f57b4101c00 0x7f57b4197f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:11:42.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:11:42.855+0000 7f57b93ce640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f57b4101c00 0x7f57b4197f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:55838/0 (socket says 172.21.15.123:55838) 2024-09-11T23:11:42.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:11:42.855+0000 7f57b93ce640 1 -- 172.21.15.123:0/1852350347 learned_addr learned my addr 172.21.15.123:0/1852350347 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-11T23:11:42.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:11:42.855+0000 7f57b8bcd640 1 --2- 172.21.15.123:0/1852350347 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57b4102e00 0x7f57b4198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:11:42.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:11:42.855+0000 7f57b93ce640 1 -- 172.21.15.123:0/1852350347 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f57b41037c0 msgr2=0x7f57b419f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:11:42.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:11:42.855+0000 7f57b93ce640 1 --2- 172.21.15.123:0/1852350347 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f57b41037c0 0x7f57b419f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:11:42.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:11:42.855+0000 7f57b93ce640 1 -- 172.21.15.123:0/1852350347 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57b4102e00 msgr2=0x7f57b4198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:11:42.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:11:42.855+0000 7f57b93ce640 1 --2- 172.21.15.123:0/1852350347 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57b4102e00 0x7f57b4198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:11:42.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:11:42.855+0000 7f57b93ce640 1 -- 172.21.15.123:0/1852350347 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57b419fb60 con 0x7f57b4101c00 2024-09-11T23:11:42.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:11:42.855+0000 7f57b8bcd640 1 --2- 172.21.15.123:0/1852350347 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57b4102e00 0x7f57b4198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:11:42.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:11:42.856+0000 7f57b93ce640 1 --2- 172.21.15.123:0/1852350347 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f57b4101c00 0x7f57b4197f30 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f57a400d950 tx=0x7f57a400de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:11:42.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:11:42.856+0000 7f57aa7fc640 1 -- 172.21.15.123:0/1852350347 <== mon.2 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57a4017070 con 0x7f57b4101c00 2024-09-11T23:11:42.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:11:42.856+0000 7f57bb632640 1 -- 172.21.15.123:0/1852350347 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57b419fe50 con 0x7f57b4101c00 2024-09-11T23:11:42.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:11:42.856+0000 7f57aa7fc640 1 -- 172.21.15.123:0/1852350347 <== mon.2 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f57a4009c30 con 0x7f57b4101c00 2024-09-11T23:11:42.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:11:42.856+0000 7f57aa7fc640 1 -- 172.21.15.123:0/1852350347 <== mon.2 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57a400f600 con 0x7f57b4101c00 2024-09-11T23:11:42.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:11:42.856+0000 7f57bb632640 1 -- 172.21.15.123:0/1852350347 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57b41a02b0 con 0x7f57b4101c00 2024-09-11T23:11:42.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:11:42.857+0000 7f57bb632640 1 -- 172.21.15.123:0/1852350347 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57b41090a0 con 0x7f57b4101c00 2024-09-11T23:11:42.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:11:42.858+0000 7f57aa7fc640 1 -- 172.21.15.123:0/1852350347 <== mon.2 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f57a401a070 con 0x7f57b4101c00 2024-09-11T23:11:42.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:11:42.858+0000 7f57aa7fc640 1 --2- 172.21.15.123:0/1852350347 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f57a00a2bb0 0x7f57a00a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:11:42.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:11:42.859+0000 7f57aa7fc640 1 -- 172.21.15.123:0/1852350347 <== mon.2 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 3702+0+0 (secure 0 0 0) 0x7f57a40cda10 con 0x7f57b4101c00 2024-09-11T23:11:42.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:11:42.859+0000 7f57b8bcd640 1 --2- 172.21.15.123:0/1852350347 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f57a00a2bb0 0x7f57a00a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:11:42.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:11:42.859+0000 7f57b8bcd640 1 --2- 172.21.15.123:0/1852350347 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f57a00a2bb0 0x7f57a00a5070 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f57b002a930 tx=0x7f57b0000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:11:42.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:11:42.863+0000 7f57aa7fc640 1 -- 172.21.15.123:0/1852350347 <== mon.2 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f57a409bad0 con 0x7f57b4101c00 2024-09-11T23:11:43.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:11:43.041+0000 7f57bb632640 1 -- 172.21.15.123:0/1852350347 --> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi123:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f57b4062630 con 0x7f57a00a2bb0 2024-09-11T23:11:43.042 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:42 smithi123 ceph-mon[35438]: purged_snaps scrub starts 2024-09-11T23:11:43.042 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:42 smithi123 ceph-mon[35438]: purged_snaps scrub ok 2024-09-11T23:11:43.042 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:42 smithi123 ceph-mon[35438]: osd.3 [v2:172.21.15.37:6810/412656036,v1:172.21.15.37:6811/412656036] boot 2024-09-11T23:11:43.042 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:42 smithi123 ceph-mon[35438]: osdmap e25: 4 total, 4 up, 4 in 2024-09-11T23:11:43.043 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:42 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T23:11:43.043 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:42 smithi123 ceph-mon[35438]: osdmap e26: 4 total, 4 up, 4 in 2024-09-11T23:11:43.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:42 smithi160 ceph-mon[35055]: purged_snaps scrub starts 2024-09-11T23:11:43.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:42 smithi160 ceph-mon[35055]: purged_snaps scrub ok 2024-09-11T23:11:43.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:42 smithi160 ceph-mon[35055]: osd.3 [v2:172.21.15.37:6810/412656036,v1:172.21.15.37:6811/412656036] boot 2024-09-11T23:11:43.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:42 smithi160 ceph-mon[35055]: osdmap e25: 4 total, 4 up, 4 in 2024-09-11T23:11:43.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:42 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T23:11:43.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:42 smithi160 ceph-mon[35055]: osdmap e26: 4 total, 4 up, 4 in 2024-09-11T23:11:43.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:42 smithi037 ceph-mon[30630]: purged_snaps scrub starts 2024-09-11T23:11:43.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:42 smithi037 ceph-mon[30630]: purged_snaps scrub ok 2024-09-11T23:11:43.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:42 smithi037 ceph-mon[30630]: osd.3 [v2:172.21.15.37:6810/412656036,v1:172.21.15.37:6811/412656036] boot 2024-09-11T23:11:43.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:42 smithi037 ceph-mon[30630]: osdmap e25: 4 total, 4 up, 4 in 2024-09-11T23:11:43.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:42 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T23:11:43.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:42 smithi037 ceph-mon[30630]: osdmap e26: 4 total, 4 up, 4 in 2024-09-11T23:11:44.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:43 smithi123 ceph-mon[35438]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:11:44.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:43 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:11:44.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:43 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:11:44.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:43 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:11:44.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:43 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:11:44.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:43 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:11:44.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:43 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:11:44.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:43 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:11:44.002 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:43 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:11:44.002 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:43 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:11:44.002 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:43 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:11:44.002 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:43 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:11:44.002 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:43 smithi123 ceph-mon[35438]: osdmap e27: 4 total, 4 up, 4 in 2024-09-11T23:11:44.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:43 smithi037 ceph-mon[30630]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:11:44.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:43 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:11:44.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:43 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:11:44.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:43 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:11:44.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:43 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:11:44.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:43 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:11:44.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:43 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:11:44.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:43 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:11:44.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:43 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:11:44.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:43 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:11:44.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:43 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:11:44.316 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:43 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:11:44.316 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:43 smithi037 ceph-mon[30630]: osdmap e27: 4 total, 4 up, 4 in 2024-09-11T23:11:44.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:43 smithi160 ceph-mon[35055]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:11:44.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:43 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:11:44.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:43 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:11:44.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:43 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:11:44.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:43 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:11:44.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:43 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:11:44.435 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:43 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:11:44.435 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:43 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:11:44.435 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:43 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:11:44.435 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:43 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:11:44.435 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:43 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:11:44.435 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:43 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:11:44.435 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:43 smithi160 ceph-mon[35055]: osdmap e27: 4 total, 4 up, 4 in 2024-09-11T23:11:45.158 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:44 smithi123 ceph-mon[35438]: from='client.24221 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi123:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:11:45.159 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:44 smithi123 ceph-mon[35438]: Detected new or changed devices on smithi037 2024-09-11T23:11:45.159 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:44 smithi123 ceph-mon[35438]: Adjusting osd_memory_target on smithi037 to 8547M 2024-09-11T23:11:45.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:44 smithi037 ceph-mon[30630]: from='client.24221 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi123:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:11:45.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:44 smithi037 ceph-mon[30630]: Detected new or changed devices on smithi037 2024-09-11T23:11:45.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:44 smithi037 ceph-mon[30630]: Adjusting osd_memory_target on smithi037 to 8547M 2024-09-11T23:11:45.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:44 smithi160 ceph-mon[35055]: from='client.24221 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi123:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:11:45.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:44 smithi160 ceph-mon[35055]: Detected new or changed devices on smithi037 2024-09-11T23:11:45.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:44 smithi160 ceph-mon[35055]: Adjusting osd_memory_target on smithi037 to 8547M 2024-09-11T23:11:46.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:45 smithi123 ceph-mon[35438]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 121 MiB used, 357 GiB / 358 GiB avail 2024-09-11T23:11:46.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:45 smithi123 ceph-mon[35438]: osdmap e28: 4 total, 4 up, 4 in 2024-09-11T23:11:46.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:45 smithi123 ceph-mon[35438]: from='client.? 172.21.15.123:0/1977656452' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e5ab5638-8c7e-4433-8dd0-ba57e28f39b6"}]: dispatch 2024-09-11T23:11:46.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:45 smithi123 ceph-mon[35438]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e5ab5638-8c7e-4433-8dd0-ba57e28f39b6"}]: dispatch 2024-09-11T23:11:46.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:45 smithi123 ceph-mon[35438]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e5ab5638-8c7e-4433-8dd0-ba57e28f39b6"}]': finished 2024-09-11T23:11:46.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:45 smithi123 ceph-mon[35438]: osdmap e29: 5 total, 4 up, 5 in 2024-09-11T23:11:46.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:45 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T23:11:46.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:45 smithi037 ceph-mon[30630]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 121 MiB used, 357 GiB / 358 GiB avail 2024-09-11T23:11:46.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:45 smithi037 ceph-mon[30630]: osdmap e28: 4 total, 4 up, 4 in 2024-09-11T23:11:46.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:45 smithi037 ceph-mon[30630]: from='client.? 172.21.15.123:0/1977656452' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e5ab5638-8c7e-4433-8dd0-ba57e28f39b6"}]: dispatch 2024-09-11T23:11:46.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:45 smithi037 ceph-mon[30630]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e5ab5638-8c7e-4433-8dd0-ba57e28f39b6"}]: dispatch 2024-09-11T23:11:46.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:45 smithi037 ceph-mon[30630]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e5ab5638-8c7e-4433-8dd0-ba57e28f39b6"}]': finished 2024-09-11T23:11:46.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:45 smithi037 ceph-mon[30630]: osdmap e29: 5 total, 4 up, 5 in 2024-09-11T23:11:46.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:45 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T23:11:46.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:45 smithi160 ceph-mon[35055]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 121 MiB used, 357 GiB / 358 GiB avail 2024-09-11T23:11:46.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:45 smithi160 ceph-mon[35055]: osdmap e28: 4 total, 4 up, 4 in 2024-09-11T23:11:46.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:45 smithi160 ceph-mon[35055]: from='client.? 172.21.15.123:0/1977656452' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e5ab5638-8c7e-4433-8dd0-ba57e28f39b6"}]: dispatch 2024-09-11T23:11:46.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:45 smithi160 ceph-mon[35055]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e5ab5638-8c7e-4433-8dd0-ba57e28f39b6"}]: dispatch 2024-09-11T23:11:46.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:45 smithi160 ceph-mon[35055]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e5ab5638-8c7e-4433-8dd0-ba57e28f39b6"}]': finished 2024-09-11T23:11:46.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:45 smithi160 ceph-mon[35055]: osdmap e29: 5 total, 4 up, 5 in 2024-09-11T23:11:46.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:45 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T23:11:47.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:46 smithi160 ceph-mon[35055]: from='client.? 172.21.15.123:0/3430345569' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:11:47.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:46 smithi123 ceph-mon[35438]: from='client.? 172.21.15.123:0/3430345569' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:11:47.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:46 smithi037 ceph-mon[30630]: from='client.? 172.21.15.123:0/3430345569' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:11:48.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:47 smithi123 ceph-mon[35438]: pgmap v106: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-11T23:11:48.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:47 smithi037 ceph-mon[30630]: pgmap v106: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-11T23:11:48.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:47 smithi160 ceph-mon[35055]: pgmap v106: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-11T23:11:50.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:49 smithi123 ceph-mon[35438]: pgmap v107: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 121 MiB used, 357 GiB / 358 GiB avail; 114 KiB/s, 0 objects/s recovering 2024-09-11T23:11:50.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:49 smithi037 ceph-mon[30630]: pgmap v107: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 121 MiB used, 357 GiB / 358 GiB avail; 114 KiB/s, 0 objects/s recovering 2024-09-11T23:11:50.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:49 smithi160 ceph-mon[35055]: pgmap v107: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 121 MiB used, 357 GiB / 358 GiB avail; 114 KiB/s, 0 objects/s recovering 2024-09-11T23:11:52.128 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:51 smithi123 ceph-mon[35438]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 95 KiB/s, 0 objects/s recovering 2024-09-11T23:11:52.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:51 smithi037 ceph-mon[30630]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 95 KiB/s, 0 objects/s recovering 2024-09-11T23:11:52.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:51 smithi160 ceph-mon[35055]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 95 KiB/s, 0 objects/s recovering 2024-09-11T23:11:53.148 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:53 smithi123 ceph-mon[35438]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-11T23:11:53.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:53 smithi037 ceph-mon[30630]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-11T23:11:53.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:53 smithi160 ceph-mon[35055]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-11T23:11:54.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:54 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-11T23:11:54.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:54 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:11:54.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:54 smithi123 ceph-mon[35438]: Deploying daemon osd.4 on smithi123 2024-09-11T23:11:54.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:54 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-11T23:11:54.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:54 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:11:54.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:54 smithi037 ceph-mon[30630]: Deploying daemon osd.4 on smithi123 2024-09-11T23:11:54.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:54 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-11T23:11:54.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:54 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:11:54.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:54 smithi160 ceph-mon[35055]: Deploying daemon osd.4 on smithi123 2024-09-11T23:11:55.162 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:55 smithi123 ceph-mon[35438]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-11T23:11:55.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:55 smithi037 ceph-mon[30630]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-11T23:11:55.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:55 smithi160 ceph-mon[35055]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-11T23:11:57.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:57 smithi123 ceph-mon[35438]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-11T23:11:57.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:57 smithi037 ceph-mon[30630]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-11T23:11:57.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:57 smithi160 ceph-mon[35055]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-11T23:11:59.175 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:11:59 smithi123 ceph-mon[35438]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-11T23:11:59.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:11:59 smithi037 ceph-mon[30630]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-11T23:11:59.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:11:59 smithi160 ceph-mon[35055]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-11T23:12:00.158 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:00 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:12:00.158 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:00 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:12:00.159 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:00 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:12:00.293 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:00 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:12:00.293 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:00 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:12:00.293 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:00 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:12:00.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:00 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:12:00.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:00 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:12:00.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:00 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:12:01.657 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:01 smithi123 ceph-mon[35438]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-11T23:12:01.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:01 smithi037 ceph-mon[30630]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-11T23:12:01.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:01 smithi160 ceph-mon[35055]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-11T23:12:03.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:02 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:12:03.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:02 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:12:03.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:02 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:12:03.002 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:02 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:12:03.002 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:02 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:12:03.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:02 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:12:03.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:02 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:12:03.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:02 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:12:03.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:02 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:12:03.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:02 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:12:03.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:02 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:12:03.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:02 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:12:03.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:02 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:12:03.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:02 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:12:03.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:02 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:12:03.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:12:03.571+0000 7f57aa7fc640 1 -- 172.21.15.123:0/1852350347 <== mgr.14150 v2:172.21.15.37:6800/31543269 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f57b4062630 con 0x7f57a00a2bb0 2024-09-11T23:12:03.571 INFO:teuthology.orchestra.run.smithi123.stdout:Created osd(s) 4 on host 'smithi123' 2024-09-11T23:12:03.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:12:03.573+0000 7f57bb632640 1 -- 172.21.15.123:0/1852350347 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f57a00a2bb0 msgr2=0x7f57a00a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:12:03.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:12:03.573+0000 7f57bb632640 1 --2- 172.21.15.123:0/1852350347 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f57a00a2bb0 0x7f57a00a5070 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f57b002a930 tx=0x7f57b0000bc0 comp rx=0 tx=0).stop 2024-09-11T23:12:03.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:12:03.573+0000 7f57bb632640 1 -- 172.21.15.123:0/1852350347 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f57b4101c00 msgr2=0x7f57b4197f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:12:03.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:12:03.573+0000 7f57bb632640 1 --2- 172.21.15.123:0/1852350347 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f57b4101c00 0x7f57b4197f30 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f57a400d950 tx=0x7f57a400de10 comp rx=0 tx=0).stop 2024-09-11T23:12:03.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:12:03.573+0000 7f57bb632640 1 -- 172.21.15.123:0/1852350347 shutdown_connections 2024-09-11T23:12:03.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:12:03.573+0000 7f57bb632640 1 --2- 172.21.15.123:0/1852350347 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f57a00a2bb0 0x7f57a00a5070 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:12:03.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:12:03.573+0000 7f57bb632640 1 --2- 172.21.15.123:0/1852350347 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f57b41037c0 0x7f57b419f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:12:03.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:12:03.573+0000 7f57bb632640 1 --2- 172.21.15.123:0/1852350347 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57b4102e00 0x7f57b4198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:12:03.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:12:03.573+0000 7f57bb632640 1 --2- 172.21.15.123:0/1852350347 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f57b4101c00 0x7f57b4197f30 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:12:03.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:12:03.573+0000 7f57bb632640 1 -- 172.21.15.123:0/1852350347 >> 172.21.15.123:0/1852350347 conn(0x7f57b40fd390 msgr2=0x7f57b4106270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:12:03.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:12:03.573+0000 7f57bb632640 1 -- 172.21.15.123:0/1852350347 shutdown_connections 2024-09-11T23:12:03.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:12:03.573+0000 7f57bb632640 1 -- 172.21.15.123:0/1852350347 wait complete. 2024-09-11T23:12:03.933 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:03 smithi123 ceph-mon[35438]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-11T23:12:03.934 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:03 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:12:03.934 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:03 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:12:03.934 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:03 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:12:04.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:03 smithi037 ceph-mon[30630]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-11T23:12:04.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:03 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:12:04.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:03 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:12:04.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:03 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:12:04.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:03 smithi160 ceph-mon[35055]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-11T23:12:04.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:03 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:12:04.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:03 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:12:04.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:03 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:12:04.219 DEBUG:teuthology.orchestra.run.smithi123:osd.4> sudo journalctl -f -n 0 -u ceph-8b03efce-7092-11ef-bcea-c7b262605968@osd.4.service 2024-09-11T23:12:04.221 INFO:tasks.cephadm:Deploying osd.5 on smithi160 with /dev/vg_nvme/lv_3... 2024-09-11T23:12:04.222 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-11T23:12:04.478 INFO:teuthology.orchestra.run.smithi160.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T23:12:05.751 INFO:journalctl@ceph.osd.4.smithi123.stdout:Sep 11 23:12:05 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-4[46656]: 2024-09-11T23:12:05.466+0000 7faa38ab8640 -1 osd.4 0 log_to_monitors true 2024-09-11T23:12:05.833 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:05 smithi160 ceph-mon[35055]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-11T23:12:05.834 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:05 smithi160 ceph-mon[35055]: from='osd.4 [v2:172.21.15.123:6808/3228822066,v1:172.21.15.123:6809/3228822066]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-11T23:12:05.834 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:05 smithi160 ceph-mon[35055]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-11T23:12:06.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:05 smithi037 ceph-mon[30630]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-11T23:12:06.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:05 smithi037 ceph-mon[30630]: from='osd.4 [v2:172.21.15.123:6808/3228822066,v1:172.21.15.123:6809/3228822066]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-11T23:12:06.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:05 smithi037 ceph-mon[30630]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-11T23:12:06.150 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:05 smithi123 ceph-mon[35438]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-11T23:12:06.151 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:05 smithi123 ceph-mon[35438]: from='osd.4 [v2:172.21.15.123:6808/3228822066,v1:172.21.15.123:6809/3228822066]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-11T23:12:06.151 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:05 smithi123 ceph-mon[35438]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-11T23:12:06.940 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:06 smithi123 ceph-mon[35438]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-11T23:12:06.940 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:06 smithi123 ceph-mon[35438]: osdmap e30: 5 total, 4 up, 5 in 2024-09-11T23:12:06.940 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:06 smithi123 ceph-mon[35438]: from='osd.4 [v2:172.21.15.123:6808/3228822066,v1:172.21.15.123:6809/3228822066]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]: dispatch 2024-09-11T23:12:06.940 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:06 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T23:12:06.940 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:06 smithi123 ceph-mon[35438]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]: dispatch 2024-09-11T23:12:06.940 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:06 smithi123 ceph-mon[35438]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]': finished 2024-09-11T23:12:06.984 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:06 smithi160 ceph-mon[35055]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-11T23:12:06.985 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:06 smithi160 ceph-mon[35055]: osdmap e30: 5 total, 4 up, 5 in 2024-09-11T23:12:06.985 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:06 smithi160 ceph-mon[35055]: from='osd.4 [v2:172.21.15.123:6808/3228822066,v1:172.21.15.123:6809/3228822066]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]: dispatch 2024-09-11T23:12:06.985 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:06 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T23:12:06.985 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:06 smithi160 ceph-mon[35055]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]: dispatch 2024-09-11T23:12:06.985 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:06 smithi160 ceph-mon[35055]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]': finished 2024-09-11T23:12:06.987 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-11T23:12:07.013 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi160:vg_nvme/lv_3 2024-09-11T23:12:07.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:06 smithi037 ceph-mon[30630]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-11T23:12:07.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:06 smithi037 ceph-mon[30630]: osdmap e30: 5 total, 4 up, 5 in 2024-09-11T23:12:07.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:06 smithi037 ceph-mon[30630]: from='osd.4 [v2:172.21.15.123:6808/3228822066,v1:172.21.15.123:6809/3228822066]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]: dispatch 2024-09-11T23:12:07.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:06 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T23:12:07.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:06 smithi037 ceph-mon[30630]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]: dispatch 2024-09-11T23:12:07.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:06 smithi037 ceph-mon[30630]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]': finished 2024-09-11T23:12:07.261 INFO:teuthology.orchestra.run.smithi160.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T23:12:07.713 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:12:07.703+0000 7f39e4ed1640 1 -- 172.21.15.160:0/830863993 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f39e0101c00 msgr2=0x7f39e0102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:12:07.713 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:12:07.703+0000 7f39e4ed1640 1 --2- 172.21.15.160:0/830863993 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f39e0101c00 0x7f39e0102000 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f39d4009900 tx=0x7f39d402a410 comp rx=0 tx=0).stop 2024-09-11T23:12:07.713 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:12:07.704+0000 7f39e4ed1640 1 -- 172.21.15.160:0/830863993 shutdown_connections 2024-09-11T23:12:07.713 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:12:07.704+0000 7f39e4ed1640 1 --2- 172.21.15.160:0/830863993 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f39e01037c0 0x7f39e010a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:12:07.713 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:12:07.704+0000 7f39e4ed1640 1 --2- 172.21.15.160:0/830863993 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39e0102e00 0x7f39e0103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:12:07.713 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:12:07.704+0000 7f39e4ed1640 1 --2- 172.21.15.160:0/830863993 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f39e0101c00 0x7f39e0102000 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:12:07.713 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:12:07.704+0000 7f39e4ed1640 1 -- 172.21.15.160:0/830863993 >> 172.21.15.160:0/830863993 conn(0x7f39e00fd390 msgr2=0x7f39e00ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:12:07.713 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:12:07.704+0000 7f39e4ed1640 1 -- 172.21.15.160:0/830863993 shutdown_connections 2024-09-11T23:12:07.713 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:12:07.704+0000 7f39e4ed1640 1 -- 172.21.15.160:0/830863993 wait complete. 2024-09-11T23:12:07.713 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:12:07.704+0000 7f39e4ed1640 1 Processor -- start 2024-09-11T23:12:07.714 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:12:07.704+0000 7f39e4ed1640 1 -- start start 2024-09-11T23:12:07.714 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:12:07.704+0000 7f39e4ed1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39e0101c00 0x7f39e0075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:12:07.714 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:12:07.704+0000 7f39e4ed1640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f39e0102e00 0x7f39e00745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:12:07.714 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:12:07.705+0000 7f39e4ed1640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f39e01037c0 0x7f39e0074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:12:07.714 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:12:07.705+0000 7f39e4ed1640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f39e010d860 con 0x7f39e0101c00 2024-09-11T23:12:07.714 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:12:07.705+0000 7f39e4ed1640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f39e010d6e0 con 0x7f39e01037c0 2024-09-11T23:12:07.714 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:12:07.705+0000 7f39e4ed1640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f39e010d9e0 con 0x7f39e0102e00 2024-09-11T23:12:07.714 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:12:07.705+0000 7f39ddd9b640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f39e0102e00 0x7f39e00745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:12:07.714 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:12:07.705+0000 7f39ddd9b640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f39e0102e00 0x7f39e00745e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:33072/0 (socket says 172.21.15.160:33072) 2024-09-11T23:12:07.714 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:12:07.705+0000 7f39ddd9b640 1 -- 172.21.15.160:0/2188823747 learned_addr learned my addr 172.21.15.160:0/2188823747 (peer_addr_for_me v2:172.21.15.160:0/0) 2024-09-11T23:12:07.714 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:12:07.705+0000 7f39de59c640 1 --2- 172.21.15.160:0/2188823747 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39e0101c00 0x7f39e0075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:12:07.714 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:12:07.705+0000 7f39ded9d640 1 --2- 172.21.15.160:0/2188823747 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f39e01037c0 0x7f39e0074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:12:07.715 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:12:07.705+0000 7f39ddd9b640 1 -- 172.21.15.160:0/2188823747 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f39e01037c0 msgr2=0x7f39e0074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:12:07.715 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:12:07.705+0000 7f39ddd9b640 1 --2- 172.21.15.160:0/2188823747 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f39e01037c0 0x7f39e0074b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:12:07.715 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:12:07.705+0000 7f39ddd9b640 1 -- 172.21.15.160:0/2188823747 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39e0101c00 msgr2=0x7f39e0075f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:12:07.715 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:12:07.705+0000 7f39ddd9b640 1 --2- 172.21.15.160:0/2188823747 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39e0101c00 0x7f39e0075f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:12:07.715 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:12:07.705+0000 7f39ddd9b640 1 -- 172.21.15.160:0/2188823747 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39e00753e0 con 0x7f39e0102e00 2024-09-11T23:12:07.715 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:12:07.705+0000 7f39de59c640 1 --2- 172.21.15.160:0/2188823747 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39e0101c00 0x7f39e0075f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:12:07.715 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:12:07.705+0000 7f39ddd9b640 1 --2- 172.21.15.160:0/2188823747 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f39e0102e00 0x7f39e00745e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f39d000c890 tx=0x7f39d000cd50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:12:07.715 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:12:07.705+0000 7f39cf7fe640 1 -- 172.21.15.160:0/2188823747 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39d0004220 con 0x7f39e0102e00 2024-09-11T23:12:07.715 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:12:07.705+0000 7f39cf7fe640 1 -- 172.21.15.160:0/2188823747 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f39d00043c0 con 0x7f39e0102e00 2024-09-11T23:12:07.715 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:12:07.705+0000 7f39e4ed1640 1 -- 172.21.15.160:0/2188823747 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39e01a1fe0 con 0x7f39e0102e00 2024-09-11T23:12:07.715 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:12:07.705+0000 7f39cf7fe640 1 -- 172.21.15.160:0/2188823747 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39d00049e0 con 0x7f39e0102e00 2024-09-11T23:12:07.715 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:12:07.705+0000 7f39e4ed1640 1 -- 172.21.15.160:0/2188823747 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39e01a24e0 con 0x7f39e0102e00 2024-09-11T23:12:07.715 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:12:07.706+0000 7f39e4ed1640 1 -- 172.21.15.160:0/2188823747 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39e0109020 con 0x7f39e0102e00 2024-09-11T23:12:07.716 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:12:07.708+0000 7f39cf7fe640 1 -- 172.21.15.160:0/2188823747 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f39d00079b0 con 0x7f39e0102e00 2024-09-11T23:12:07.716 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:12:07.709+0000 7f39cf7fe640 1 --2- 172.21.15.160:0/2188823747 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f39c80a2c00 0x7f39c80a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:12:07.716 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:12:07.709+0000 7f39cf7fe640 1 -- 172.21.15.160:0/2188823747 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 3821+0+0 (secure 0 0 0) 0x7f39d00cdf10 con 0x7f39e0102e00 2024-09-11T23:12:07.716 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:12:07.709+0000 7f39de59c640 1 --2- 172.21.15.160:0/2188823747 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f39c80a2c00 0x7f39c80a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:12:07.716 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:12:07.710+0000 7f39de59c640 1 --2- 172.21.15.160:0/2188823747 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f39c80a2c00 0x7f39c80a50c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f39d4006010 tx=0x7f39d4000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:12:07.716 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:12:07.712+0000 7f39cf7fe640 1 -- 172.21.15.160:0/2188823747 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f39d0014030 con 0x7f39e0102e00 2024-09-11T23:12:07.751 INFO:journalctl@ceph.osd.4.smithi123.stdout:Sep 11 23:12:07 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-4[46656]: 2024-09-11T23:12:07.415+0000 7faa34a3b640 -1 osd.4 0 waiting for initial osdmap 2024-09-11T23:12:07.751 INFO:journalctl@ceph.osd.4.smithi123.stdout:Sep 11 23:12:07 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-4[46656]: 2024-09-11T23:12:07.420+0000 7faa2c85b640 -1 osd.4 31 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T23:12:07.890 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:12:07.889+0000 7f39e4ed1640 1 -- 172.21.15.160:0/2188823747 --> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi160:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f39e0062630 con 0x7f39c80a2c00 2024-09-11T23:12:07.891 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:07 smithi160 ceph-mon[35055]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-11T23:12:07.891 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:07 smithi160 ceph-mon[35055]: osdmap e31: 5 total, 4 up, 5 in 2024-09-11T23:12:07.891 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:07 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T23:12:07.891 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:07 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T23:12:07.891 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:07 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:12:07.891 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:07 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:12:07.891 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:07 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:12:07.891 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:07 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:12:07.891 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:07 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:12:07.892 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:07 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:12:07.892 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:07 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:12:07.892 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:07 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:12:07.892 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:07 smithi160 ceph-mon[35055]: from='osd.4 ' entity='osd.4' 2024-09-11T23:12:08.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:07 smithi037 ceph-mon[30630]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-11T23:12:08.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:07 smithi037 ceph-mon[30630]: osdmap e31: 5 total, 4 up, 5 in 2024-09-11T23:12:08.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:07 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T23:12:08.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:07 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T23:12:08.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:07 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:12:08.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:07 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:12:08.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:07 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:12:08.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:07 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:12:08.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:07 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:12:08.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:07 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:12:08.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:07 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:12:08.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:07 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:12:08.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:07 smithi037 ceph-mon[30630]: from='osd.4 ' entity='osd.4' 2024-09-11T23:12:08.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:07 smithi123 ceph-mon[35438]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-11T23:12:08.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:07 smithi123 ceph-mon[35438]: osdmap e31: 5 total, 4 up, 5 in 2024-09-11T23:12:08.252 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:07 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T23:12:08.252 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:07 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T23:12:08.252 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:07 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:12:08.252 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:07 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:12:08.252 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:07 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:12:08.252 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:07 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:12:08.252 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:07 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:12:08.253 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:07 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:12:08.253 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:07 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:12:08.253 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:07 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:12:08.253 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:07 smithi123 ceph-mon[35438]: from='osd.4 ' entity='osd.4' 2024-09-11T23:12:08.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:08 smithi160 ceph-mon[35055]: purged_snaps scrub starts 2024-09-11T23:12:08.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:08 smithi160 ceph-mon[35055]: purged_snaps scrub ok 2024-09-11T23:12:08.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:08 smithi160 ceph-mon[35055]: Detected new or changed devices on smithi123 2024-09-11T23:12:08.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:08 smithi160 ceph-mon[35055]: Adjusting osd_memory_target on smithi123 to 8544M 2024-09-11T23:12:08.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:08 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T23:12:08.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:08 smithi160 ceph-mon[35055]: from='client.24238 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi160:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:12:08.935 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:08 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:12:08.935 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:08 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:12:08.935 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:08 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:12:08.935 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:08 smithi160 ceph-mon[35055]: osd.4 [v2:172.21.15.123:6808/3228822066,v1:172.21.15.123:6809/3228822066] boot 2024-09-11T23:12:08.935 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:08 smithi160 ceph-mon[35055]: osdmap e32: 5 total, 5 up, 5 in 2024-09-11T23:12:08.935 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:08 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T23:12:09.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:08 smithi037 ceph-mon[30630]: purged_snaps scrub starts 2024-09-11T23:12:09.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:08 smithi037 ceph-mon[30630]: purged_snaps scrub ok 2024-09-11T23:12:09.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:08 smithi037 ceph-mon[30630]: Detected new or changed devices on smithi123 2024-09-11T23:12:09.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:08 smithi037 ceph-mon[30630]: Adjusting osd_memory_target on smithi123 to 8544M 2024-09-11T23:12:09.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:08 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T23:12:09.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:08 smithi037 ceph-mon[30630]: from='client.24238 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi160:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:12:09.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:08 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:12:09.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:08 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:12:09.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:08 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:12:09.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:08 smithi037 ceph-mon[30630]: osd.4 [v2:172.21.15.123:6808/3228822066,v1:172.21.15.123:6809/3228822066] boot 2024-09-11T23:12:09.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:08 smithi037 ceph-mon[30630]: osdmap e32: 5 total, 5 up, 5 in 2024-09-11T23:12:09.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:08 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T23:12:09.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:08 smithi123 ceph-mon[35438]: purged_snaps scrub starts 2024-09-11T23:12:09.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:08 smithi123 ceph-mon[35438]: purged_snaps scrub ok 2024-09-11T23:12:09.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:08 smithi123 ceph-mon[35438]: Detected new or changed devices on smithi123 2024-09-11T23:12:09.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:08 smithi123 ceph-mon[35438]: Adjusting osd_memory_target on smithi123 to 8544M 2024-09-11T23:12:09.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:08 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T23:12:09.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:08 smithi123 ceph-mon[35438]: from='client.24238 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi160:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:12:09.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:08 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:12:09.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:08 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:12:09.252 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:08 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:12:09.252 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:08 smithi123 ceph-mon[35438]: osd.4 [v2:172.21.15.123:6808/3228822066,v1:172.21.15.123:6809/3228822066] boot 2024-09-11T23:12:09.252 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:08 smithi123 ceph-mon[35438]: osdmap e32: 5 total, 5 up, 5 in 2024-09-11T23:12:09.252 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:08 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T23:12:09.914 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:09 smithi160 ceph-mon[35055]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-11T23:12:09.914 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:09 smithi160 ceph-mon[35055]: osdmap e33: 5 total, 5 up, 5 in 2024-09-11T23:12:10.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:09 smithi037 ceph-mon[30630]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-11T23:12:10.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:09 smithi037 ceph-mon[30630]: osdmap e33: 5 total, 5 up, 5 in 2024-09-11T23:12:10.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:09 smithi123 ceph-mon[35438]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-11T23:12:10.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:09 smithi123 ceph-mon[35438]: osdmap e33: 5 total, 5 up, 5 in 2024-09-11T23:12:11.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:10 smithi037 ceph-mon[30630]: from='client.? 172.21.15.160:0/1486650070' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7f080d49-eec8-4cd9-b410-b2e84139292e"}]: dispatch 2024-09-11T23:12:11.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:10 smithi037 ceph-mon[30630]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7f080d49-eec8-4cd9-b410-b2e84139292e"}]: dispatch 2024-09-11T23:12:11.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:10 smithi037 ceph-mon[30630]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7f080d49-eec8-4cd9-b410-b2e84139292e"}]': finished 2024-09-11T23:12:11.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:10 smithi037 ceph-mon[30630]: osdmap e34: 6 total, 5 up, 6 in 2024-09-11T23:12:11.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:10 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T23:12:11.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:10 smithi160 ceph-mon[35055]: from='client.? 172.21.15.160:0/1486650070' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7f080d49-eec8-4cd9-b410-b2e84139292e"}]: dispatch 2024-09-11T23:12:11.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:10 smithi160 ceph-mon[35055]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7f080d49-eec8-4cd9-b410-b2e84139292e"}]: dispatch 2024-09-11T23:12:11.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:10 smithi160 ceph-mon[35055]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7f080d49-eec8-4cd9-b410-b2e84139292e"}]': finished 2024-09-11T23:12:11.186 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:10 smithi160 ceph-mon[35055]: osdmap e34: 6 total, 5 up, 6 in 2024-09-11T23:12:11.186 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:10 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T23:12:11.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:10 smithi123 ceph-mon[35438]: from='client.? 172.21.15.160:0/1486650070' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7f080d49-eec8-4cd9-b410-b2e84139292e"}]: dispatch 2024-09-11T23:12:11.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:10 smithi123 ceph-mon[35438]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7f080d49-eec8-4cd9-b410-b2e84139292e"}]: dispatch 2024-09-11T23:12:11.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:10 smithi123 ceph-mon[35438]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7f080d49-eec8-4cd9-b410-b2e84139292e"}]': finished 2024-09-11T23:12:11.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:10 smithi123 ceph-mon[35438]: osdmap e34: 6 total, 5 up, 6 in 2024-09-11T23:12:11.252 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:10 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T23:12:12.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:11 smithi037 ceph-mon[30630]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:12:12.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:11 smithi037 ceph-mon[30630]: from='client.? 172.21.15.160:0/1093151210' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:12:12.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:11 smithi160 ceph-mon[35055]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:12:12.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:11 smithi160 ceph-mon[35055]: from='client.? 172.21.15.160:0/1093151210' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:12:12.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:11 smithi123 ceph-mon[35438]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:12:12.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:11 smithi123 ceph-mon[35438]: from='client.? 172.21.15.160:0/1093151210' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:12:14.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:13 smithi037 ceph-mon[30630]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:12:14.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:13 smithi160 ceph-mon[35055]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:12:14.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:13 smithi123 ceph-mon[35438]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:12:16.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:15 smithi037 ceph-mon[30630]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:12:16.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:15 smithi160 ceph-mon[35055]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:12:16.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:15 smithi123 ceph-mon[35438]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:12:18.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:17 smithi037 ceph-mon[30630]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:12:18.141 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:17 smithi160 ceph-mon[35055]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:12:18.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:17 smithi123 ceph-mon[35438]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:12:19.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:18 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-11T23:12:19.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:18 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:12:19.110 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:18 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-11T23:12:19.111 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:18 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:12:19.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:18 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-11T23:12:19.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:18 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:12:20.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:19 smithi037 ceph-mon[30630]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:12:20.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:19 smithi037 ceph-mon[30630]: Deploying daemon osd.5 on smithi160 2024-09-11T23:12:20.132 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:19 smithi160 ceph-mon[35055]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:12:20.132 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:19 smithi160 ceph-mon[35055]: Deploying daemon osd.5 on smithi160 2024-09-11T23:12:20.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:19 smithi123 ceph-mon[35438]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:12:20.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:19 smithi123 ceph-mon[35438]: Deploying daemon osd.5 on smithi160 2024-09-11T23:12:22.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:21 smithi037 ceph-mon[30630]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:12:22.109 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:21 smithi160 ceph-mon[35055]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:12:22.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:21 smithi123 ceph-mon[35438]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:12:24.079 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:23 smithi160 ceph-mon[35055]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:12:24.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:23 smithi123 ceph-mon[35438]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:12:24.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:23 smithi037 ceph-mon[30630]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:12:24.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:24 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:12:24.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:24 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:12:24.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:24 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:12:25.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:24 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:12:25.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:24 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:12:25.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:24 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:12:25.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:24 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:12:25.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:24 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:12:25.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:24 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:12:26.132 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:25 smithi160 ceph-mon[35055]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:12:26.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:25 smithi123 ceph-mon[35438]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:12:26.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:25 smithi037 ceph-mon[30630]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:12:28.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:27 smithi160 ceph-mon[35055]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:12:28.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:27 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:12:28.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:27 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:12:28.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:27 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:12:28.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:27 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:12:28.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:27 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:12:28.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:27 smithi123 ceph-mon[35438]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:12:28.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:27 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:12:28.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:27 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:12:28.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:27 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:12:28.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:27 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:12:28.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:27 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:12:28.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:27 smithi037 ceph-mon[30630]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:12:28.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:27 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:12:28.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:27 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:12:28.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:27 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:12:28.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:27 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:12:28.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:27 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:12:28.676 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:12:28.676+0000 7f39cf7fe640 1 -- 172.21.15.160:0/2188823747 <== mgr.14150 v2:172.21.15.37:6800/31543269 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f39e0062630 con 0x7f39c80a2c00 2024-09-11T23:12:28.677 INFO:teuthology.orchestra.run.smithi160.stdout:Created osd(s) 5 on host 'smithi160' 2024-09-11T23:12:28.678 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:12:28.678+0000 7f39e4ed1640 1 -- 172.21.15.160:0/2188823747 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f39c80a2c00 msgr2=0x7f39c80a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:12:28.678 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:12:28.678+0000 7f39e4ed1640 1 --2- 172.21.15.160:0/2188823747 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f39c80a2c00 0x7f39c80a50c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f39d4006010 tx=0x7f39d4000bc0 comp rx=0 tx=0).stop 2024-09-11T23:12:28.679 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:12:28.678+0000 7f39e4ed1640 1 -- 172.21.15.160:0/2188823747 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f39e0102e00 msgr2=0x7f39e00745e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:12:28.679 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:12:28.678+0000 7f39e4ed1640 1 --2- 172.21.15.160:0/2188823747 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f39e0102e00 0x7f39e00745e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f39d000c890 tx=0x7f39d000cd50 comp rx=0 tx=0).stop 2024-09-11T23:12:28.679 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:12:28.678+0000 7f39e4ed1640 1 -- 172.21.15.160:0/2188823747 shutdown_connections 2024-09-11T23:12:28.679 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:12:28.678+0000 7f39e4ed1640 1 --2- 172.21.15.160:0/2188823747 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f39c80a2c00 0x7f39c80a50c0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:12:28.679 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:12:28.678+0000 7f39e4ed1640 1 --2- 172.21.15.160:0/2188823747 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f39e01037c0 0x7f39e0074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:12:28.679 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:12:28.678+0000 7f39e4ed1640 1 --2- 172.21.15.160:0/2188823747 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f39e0102e00 0x7f39e00745e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:12:28.679 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:12:28.678+0000 7f39e4ed1640 1 --2- 172.21.15.160:0/2188823747 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39e0101c00 0x7f39e0075f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:12:28.679 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:12:28.678+0000 7f39e4ed1640 1 -- 172.21.15.160:0/2188823747 >> 172.21.15.160:0/2188823747 conn(0x7f39e00fd390 msgr2=0x7f39e01061f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:12:28.679 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:12:28.678+0000 7f39e4ed1640 1 -- 172.21.15.160:0/2188823747 shutdown_connections 2024-09-11T23:12:28.679 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:12:28.678+0000 7f39e4ed1640 1 -- 172.21.15.160:0/2188823747 wait complete. 2024-09-11T23:12:28.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:28 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:12:28.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:28 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:12:28.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:28 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:12:29.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:28 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:12:29.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:28 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:12:29.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:28 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:12:29.293 DEBUG:teuthology.orchestra.run.smithi160:osd.5> sudo journalctl -f -n 0 -u ceph-8b03efce-7092-11ef-bcea-c7b262605968@osd.5.service 2024-09-11T23:12:29.295 INFO:tasks.cephadm:Deploying osd.6 on smithi037 with /dev/vg_nvme/lv_2... 2024-09-11T23:12:29.296 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-11T23:12:29.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:28 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:12:29.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:28 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:12:29.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:28 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:12:29.674 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:12:30.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:29 smithi037 ceph-mon[30630]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:12:30.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:29 smithi160 ceph-mon[35055]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:12:30.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:29 smithi123 ceph-mon[35438]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:12:31.417 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 11 23:12:30 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-5[46502]: 2024-09-11T23:12:30.994+0000 7faa79733640 -1 osd.5 0 log_to_monitors true 2024-09-11T23:12:32.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:31 smithi037 ceph-mon[30630]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:12:32.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:31 smithi037 ceph-mon[30630]: from='osd.5 [v2:172.21.15.160:6808/1618319675,v1:172.21.15.160:6809/1618319675]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-11T23:12:32.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:31 smithi037 ceph-mon[30630]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-11T23:12:32.093 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:31 smithi160 ceph-mon[35055]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:12:32.093 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:31 smithi160 ceph-mon[35055]: from='osd.5 [v2:172.21.15.160:6808/1618319675,v1:172.21.15.160:6809/1618319675]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-11T23:12:32.093 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:31 smithi160 ceph-mon[35055]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-11T23:12:32.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:31 smithi123 ceph-mon[35438]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:12:32.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:31 smithi123 ceph-mon[35438]: from='osd.5 [v2:172.21.15.160:6808/1618319675,v1:172.21.15.160:6809/1618319675]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-11T23:12:32.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:31 smithi123 ceph-mon[35438]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-11T23:12:33.090 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:32 smithi037 ceph-mon[30630]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-11T23:12:33.090 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:32 smithi037 ceph-mon[30630]: osdmap e35: 6 total, 5 up, 6 in 2024-09-11T23:12:33.090 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:32 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T23:12:33.090 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:32 smithi037 ceph-mon[30630]: from='osd.5 [v2:172.21.15.160:6808/1618319675,v1:172.21.15.160:6809/1618319675]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-09-11T23:12:33.091 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:32 smithi037 ceph-mon[30630]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-09-11T23:12:33.091 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:32 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:12:33.091 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:32 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:12:33.091 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:32 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:12:33.091 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:32 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:12:33.091 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:32 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:12:33.091 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:32 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:12:33.091 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:32 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:12:33.091 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:32 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:12:33.096 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:12:33.129 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi037:vg_nvme/lv_2 2024-09-11T23:12:33.184 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 11 23:12:32 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-5[46502]: 2024-09-11T23:12:32.870+0000 7faa756b6640 -1 osd.5 0 waiting for initial osdmap 2024-09-11T23:12:33.184 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 11 23:12:32 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-5[46502]: 2024-09-11T23:12:32.877+0000 7faa714de640 -1 osd.5 36 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T23:12:33.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:32 smithi160 ceph-mon[35055]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-11T23:12:33.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:32 smithi160 ceph-mon[35055]: osdmap e35: 6 total, 5 up, 6 in 2024-09-11T23:12:33.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:32 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T23:12:33.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:32 smithi160 ceph-mon[35055]: from='osd.5 [v2:172.21.15.160:6808/1618319675,v1:172.21.15.160:6809/1618319675]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-09-11T23:12:33.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:32 smithi160 ceph-mon[35055]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-09-11T23:12:33.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:32 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:12:33.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:32 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:12:33.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:32 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:12:33.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:32 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:12:33.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:32 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:12:33.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:32 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:12:33.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:32 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:12:33.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:32 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:12:33.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:32 smithi123 ceph-mon[35438]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-11T23:12:33.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:32 smithi123 ceph-mon[35438]: osdmap e35: 6 total, 5 up, 6 in 2024-09-11T23:12:33.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:32 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T23:12:33.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:32 smithi123 ceph-mon[35438]: from='osd.5 [v2:172.21.15.160:6808/1618319675,v1:172.21.15.160:6809/1618319675]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-09-11T23:12:33.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:32 smithi123 ceph-mon[35438]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-09-11T23:12:33.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:32 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:12:33.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:32 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:12:33.252 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:32 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:12:33.252 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:32 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:12:33.252 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:32 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:12:33.252 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:32 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:12:33.252 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:32 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:12:33.252 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:32 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:12:33.548 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:12:34.027 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:33 smithi037 ceph-mon[30630]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:12:34.028 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:33 smithi037 ceph-mon[30630]: Detected new or changed devices on smithi160 2024-09-11T23:12:34.028 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:33 smithi037 ceph-mon[30630]: Adjusting osd_memory_target on smithi160 to 8544M 2024-09-11T23:12:34.028 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:33 smithi037 ceph-mon[30630]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]': finished 2024-09-11T23:12:34.028 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:33 smithi037 ceph-mon[30630]: osdmap e36: 6 total, 5 up, 6 in 2024-09-11T23:12:34.028 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:33 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T23:12:34.028 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:33 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T23:12:34.152 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:33 smithi123 ceph-mon[35438]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:12:34.152 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:33 smithi123 ceph-mon[35438]: Detected new or changed devices on smithi160 2024-09-11T23:12:34.152 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:33 smithi123 ceph-mon[35438]: Adjusting osd_memory_target on smithi160 to 8544M 2024-09-11T23:12:34.152 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:33 smithi123 ceph-mon[35438]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]': finished 2024-09-11T23:12:34.153 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:33 smithi123 ceph-mon[35438]: osdmap e36: 6 total, 5 up, 6 in 2024-09-11T23:12:34.153 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:33 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T23:12:34.153 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:33 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T23:12:34.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:12:34.142+0000 7fe06ee00640 1 -- 172.21.15.37:0/3937356704 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe068076ba0 msgr2=0x7fe068076fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:12:34.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:12:34.142+0000 7fe06ee00640 1 --2- 172.21.15.37:0/3937356704 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe068076ba0 0x7fe068076fa0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe05c009900 tx=0x7fe05c02a3f0 comp rx=0 tx=0).stop 2024-09-11T23:12:34.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:12:34.142+0000 7fe06ee00640 1 -- 172.21.15.37:0/3937356704 shutdown_connections 2024-09-11T23:12:34.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:12:34.142+0000 7fe06ee00640 1 --2- 172.21.15.37:0/3937356704 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe068077df0 0x7fe068078250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:12:34.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:12:34.142+0000 7fe06ee00640 1 --2- 172.21.15.37:0/3937356704 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe068078790 0x7fe068079030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:12:34.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:12:34.142+0000 7fe06ee00640 1 --2- 172.21.15.37:0/3937356704 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe068076ba0 0x7fe068076fa0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:12:34.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:12:34.142+0000 7fe06ee00640 1 -- 172.21.15.37:0/3937356704 >> 172.21.15.37:0/3937356704 conn(0x7fe0680ff3e0 msgr2=0x7fe068101820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:12:34.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:12:34.142+0000 7fe06ee00640 1 -- 172.21.15.37:0/3937356704 shutdown_connections 2024-09-11T23:12:34.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:12:34.142+0000 7fe06ee00640 1 -- 172.21.15.37:0/3937356704 wait complete. 2024-09-11T23:12:34.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:12:34.143+0000 7fe06ee00640 1 Processor -- start 2024-09-11T23:12:34.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:12:34.143+0000 7fe06ee00640 1 -- start start 2024-09-11T23:12:34.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:12:34.143+0000 7fe06ee00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe068076ba0 0x7fe06819e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:12:34.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:12:34.143+0000 7fe06ee00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe068077df0 0x7fe06819e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:12:34.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:12:34.143+0000 7fe06ee00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe068078790 0x7fe0681a58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:12:34.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:12:34.143+0000 7fe06ee00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe068113cf0 con 0x7fe068076ba0 2024-09-11T23:12:34.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:12:34.143+0000 7fe06ee00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe068113b70 con 0x7fe068078790 2024-09-11T23:12:34.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:12:34.143+0000 7fe06ee00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fe068113e70 con 0x7fe068077df0 2024-09-11T23:12:34.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:12:34.144+0000 7fe06da00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe068076ba0 0x7fe06819e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:12:34.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:12:34.144+0000 7fe06d000640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe068077df0 0x7fe06819e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:12:34.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:12:34.144+0000 7fe06da00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe068076ba0 0x7fe06819e320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36684/0 (socket says 172.21.15.37:36684) 2024-09-11T23:12:34.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:12:34.144+0000 7fe06da00640 1 -- 172.21.15.37:0/2982988232 learned_addr learned my addr 172.21.15.37:0/2982988232 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:12:34.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:12:34.144+0000 7fe06e400640 1 --2- 172.21.15.37:0/2982988232 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe068078790 0x7fe0681a58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:12:34.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:12:34.144+0000 7fe06d000640 1 -- 172.21.15.37:0/2982988232 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe068078790 msgr2=0x7fe0681a58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:12:34.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:12:34.144+0000 7fe06d000640 1 --2- 172.21.15.37:0/2982988232 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe068078790 0x7fe0681a58e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:12:34.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:12:34.144+0000 7fe06d000640 1 -- 172.21.15.37:0/2982988232 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe068076ba0 msgr2=0x7fe06819e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:12:34.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:12:34.144+0000 7fe06d000640 1 --2- 172.21.15.37:0/2982988232 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe068076ba0 0x7fe06819e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:12:34.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:12:34.144+0000 7fe06d000640 1 -- 172.21.15.37:0/2982988232 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0681a5f50 con 0x7fe068077df0 2024-09-11T23:12:34.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:12:34.144+0000 7fe06da00640 1 --2- 172.21.15.37:0/2982988232 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe068076ba0 0x7fe06819e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:12:34.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:12:34.144+0000 7fe06d000640 1 --2- 172.21.15.37:0/2982988232 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe068077df0 0x7fe06819e860 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe05400e9f0 tx=0x7fe05400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:12:34.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:12:34.145+0000 7fe066000640 1 -- 172.21.15.37:0/2982988232 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe05400ccc0 con 0x7fe068077df0 2024-09-11T23:12:34.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:12:34.145+0000 7fe066000640 1 -- 172.21.15.37:0/2982988232 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe054005020 con 0x7fe068077df0 2024-09-11T23:12:34.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:12:34.145+0000 7fe066000640 1 -- 172.21.15.37:0/2982988232 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0540049e0 con 0x7fe068077df0 2024-09-11T23:12:34.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:12:34.145+0000 7fe06ee00640 1 -- 172.21.15.37:0/2982988232 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0681a6240 con 0x7fe068077df0 2024-09-11T23:12:34.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:12:34.145+0000 7fe06ee00640 1 -- 172.21.15.37:0/2982988232 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0681a6730 con 0x7fe068077df0 2024-09-11T23:12:34.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:12:34.146+0000 7fe06ee00640 1 -- 172.21.15.37:0/2982988232 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0681105d0 con 0x7fe068077df0 2024-09-11T23:12:34.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:12:34.148+0000 7fe066000640 1 -- 172.21.15.37:0/2982988232 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fe054005560 con 0x7fe068077df0 2024-09-11T23:12:34.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:12:34.149+0000 7fe066000640 1 --2- 172.21.15.37:0/2982988232 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fe0500a2c30 0x7fe0500a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:12:34.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:12:34.149+0000 7fe066000640 1 -- 172.21.15.37:0/2982988232 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4566+0+0 (secure 0 0 0) 0x7fe0540ce1b0 con 0x7fe068077df0 2024-09-11T23:12:34.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:12:34.149+0000 7fe06da00640 1 --2- 172.21.15.37:0/2982988232 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fe0500a2c30 0x7fe0500a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:12:34.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:12:34.150+0000 7fe06da00640 1 --2- 172.21.15.37:0/2982988232 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fe0500a2c30 0x7fe0500a50f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe05c031440 tx=0x7fe05c0315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:12:34.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:12:34.151+0000 7fe066000640 1 -- 172.21.15.37:0/2982988232 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe0540051d0 con 0x7fe068077df0 2024-09-11T23:12:34.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:33 smithi160 ceph-mon[35055]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:12:34.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:33 smithi160 ceph-mon[35055]: Detected new or changed devices on smithi160 2024-09-11T23:12:34.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:33 smithi160 ceph-mon[35055]: Adjusting osd_memory_target on smithi160 to 8544M 2024-09-11T23:12:34.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:33 smithi160 ceph-mon[35055]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]': finished 2024-09-11T23:12:34.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:33 smithi160 ceph-mon[35055]: osdmap e36: 6 total, 5 up, 6 in 2024-09-11T23:12:34.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:33 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T23:12:34.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:33 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T23:12:34.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:12:34.347+0000 7fe06ee00640 1 -- 172.21.15.37:0/2982988232 --> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fe068062630 con 0x7fe0500a2c30 2024-09-11T23:12:35.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:34 smithi160 ceph-mon[35055]: purged_snaps scrub starts 2024-09-11T23:12:35.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:34 smithi160 ceph-mon[35055]: purged_snaps scrub ok 2024-09-11T23:12:35.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:34 smithi160 ceph-mon[35055]: osd.5 [v2:172.21.15.160:6808/1618319675,v1:172.21.15.160:6809/1618319675] boot 2024-09-11T23:12:35.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:34 smithi160 ceph-mon[35055]: osdmap e37: 6 total, 6 up, 6 in 2024-09-11T23:12:35.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:34 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T23:12:35.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:34 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:12:35.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:34 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:12:35.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:34 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:12:35.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:34 smithi037 ceph-mon[30630]: purged_snaps scrub starts 2024-09-11T23:12:35.251 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:34 smithi037 ceph-mon[30630]: purged_snaps scrub ok 2024-09-11T23:12:35.251 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:34 smithi037 ceph-mon[30630]: osd.5 [v2:172.21.15.160:6808/1618319675,v1:172.21.15.160:6809/1618319675] boot 2024-09-11T23:12:35.251 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:34 smithi037 ceph-mon[30630]: osdmap e37: 6 total, 6 up, 6 in 2024-09-11T23:12:35.251 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:34 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T23:12:35.251 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:34 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:12:35.251 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:34 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:12:35.251 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:34 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:12:35.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:34 smithi123 ceph-mon[35438]: purged_snaps scrub starts 2024-09-11T23:12:35.252 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:34 smithi123 ceph-mon[35438]: purged_snaps scrub ok 2024-09-11T23:12:35.252 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:34 smithi123 ceph-mon[35438]: osd.5 [v2:172.21.15.160:6808/1618319675,v1:172.21.15.160:6809/1618319675] boot 2024-09-11T23:12:35.252 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:34 smithi123 ceph-mon[35438]: osdmap e37: 6 total, 6 up, 6 in 2024-09-11T23:12:35.252 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:34 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T23:12:35.252 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:34 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:12:35.252 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:34 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:12:35.252 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:34 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:12:36.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:35 smithi160 ceph-mon[35055]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-11T23:12:36.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:35 smithi160 ceph-mon[35055]: from='client.24265 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:12:36.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:35 smithi160 ceph-mon[35055]: osdmap e38: 6 total, 6 up, 6 in 2024-09-11T23:12:36.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:35 smithi123 ceph-mon[35438]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-11T23:12:36.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:35 smithi123 ceph-mon[35438]: from='client.24265 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:12:36.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:35 smithi123 ceph-mon[35438]: osdmap e38: 6 total, 6 up, 6 in 2024-09-11T23:12:36.252 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:35 smithi037 ceph-mon[30630]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-11T23:12:36.252 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:35 smithi037 ceph-mon[30630]: from='client.24265 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:12:36.252 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:35 smithi037 ceph-mon[30630]: osdmap e38: 6 total, 6 up, 6 in 2024-09-11T23:12:37.158 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:36 smithi037 ceph-mon[30630]: osdmap e39: 6 total, 6 up, 6 in 2024-09-11T23:12:37.186 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:36 smithi160 ceph-mon[35055]: osdmap e39: 6 total, 6 up, 6 in 2024-09-11T23:12:37.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:36 smithi123 ceph-mon[35438]: osdmap e39: 6 total, 6 up, 6 in 2024-09-11T23:12:38.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:37 smithi160 ceph-mon[35055]: pgmap v141: 1 pgs: 1 remapped+peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-11T23:12:38.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:37 smithi160 ceph-mon[35055]: osdmap e40: 6 total, 6 up, 6 in 2024-09-11T23:12:38.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:37 smithi160 ceph-mon[35055]: from='client.? 172.21.15.37:0/2806698425' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d0881c4e-bd8d-4575-8c81-94d21825c227"}]: dispatch 2024-09-11T23:12:38.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:37 smithi160 ceph-mon[35055]: from='client.? 172.21.15.37:0/2806698425' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d0881c4e-bd8d-4575-8c81-94d21825c227"}]': finished 2024-09-11T23:12:38.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:37 smithi160 ceph-mon[35055]: osdmap e41: 7 total, 6 up, 7 in 2024-09-11T23:12:38.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:37 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T23:12:38.238 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:37 smithi037 ceph-mon[30630]: pgmap v141: 1 pgs: 1 remapped+peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-11T23:12:38.238 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:37 smithi037 ceph-mon[30630]: osdmap e40: 6 total, 6 up, 6 in 2024-09-11T23:12:38.238 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:37 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/2806698425' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d0881c4e-bd8d-4575-8c81-94d21825c227"}]: dispatch 2024-09-11T23:12:38.238 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:37 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/2806698425' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d0881c4e-bd8d-4575-8c81-94d21825c227"}]': finished 2024-09-11T23:12:38.238 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:37 smithi037 ceph-mon[30630]: osdmap e41: 7 total, 6 up, 7 in 2024-09-11T23:12:38.238 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:37 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T23:12:38.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:37 smithi123 ceph-mon[35438]: pgmap v141: 1 pgs: 1 remapped+peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-11T23:12:38.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:37 smithi123 ceph-mon[35438]: osdmap e40: 6 total, 6 up, 6 in 2024-09-11T23:12:38.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:37 smithi123 ceph-mon[35438]: from='client.? 172.21.15.37:0/2806698425' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d0881c4e-bd8d-4575-8c81-94d21825c227"}]: dispatch 2024-09-11T23:12:38.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:37 smithi123 ceph-mon[35438]: from='client.? 172.21.15.37:0/2806698425' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d0881c4e-bd8d-4575-8c81-94d21825c227"}]': finished 2024-09-11T23:12:38.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:37 smithi123 ceph-mon[35438]: osdmap e41: 7 total, 6 up, 7 in 2024-09-11T23:12:38.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:37 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T23:12:39.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:38 smithi160 ceph-mon[35055]: from='client.? 172.21.15.37:0/2756579935' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:12:39.249 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:38 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/2756579935' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:12:39.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:38 smithi123 ceph-mon[35438]: from='client.? 172.21.15.37:0/2756579935' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:12:40.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:39 smithi160 ceph-mon[35055]: pgmap v144: 1 pgs: 1 remapped+peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-11T23:12:40.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:39 smithi123 ceph-mon[35438]: pgmap v144: 1 pgs: 1 remapped+peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-11T23:12:40.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:39 smithi037 ceph-mon[30630]: pgmap v144: 1 pgs: 1 remapped+peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-11T23:12:42.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:41 smithi160 ceph-mon[35055]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 113 KiB/s, 0 objects/s recovering 2024-09-11T23:12:42.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:41 smithi123 ceph-mon[35438]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 113 KiB/s, 0 objects/s recovering 2024-09-11T23:12:42.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:41 smithi037 ceph-mon[30630]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 113 KiB/s, 0 objects/s recovering 2024-09-11T23:12:44.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:43 smithi160 ceph-mon[35055]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 95 KiB/s, 0 objects/s recovering 2024-09-11T23:12:44.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:43 smithi123 ceph-mon[35438]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 95 KiB/s, 0 objects/s recovering 2024-09-11T23:12:44.263 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:43 smithi037 ceph-mon[30630]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 95 KiB/s, 0 objects/s recovering 2024-09-11T23:12:46.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:45 smithi037 ceph-mon[30630]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-11T23:12:46.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:45 smithi160 ceph-mon[35055]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-11T23:12:46.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:45 smithi123 ceph-mon[35438]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-11T23:12:48.050 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:47 smithi037 ceph-mon[30630]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-09-11T23:12:48.050 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:47 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-11T23:12:48.050 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:47 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:12:48.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:47 smithi160 ceph-mon[35055]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-09-11T23:12:48.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:47 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-11T23:12:48.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:47 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:12:48.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:47 smithi123 ceph-mon[35438]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-09-11T23:12:48.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:47 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-11T23:12:48.252 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:47 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:12:49.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:48 smithi037 ceph-mon[30630]: Deploying daemon osd.6 on smithi037 2024-09-11T23:12:49.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:48 smithi160 ceph-mon[35055]: Deploying daemon osd.6 on smithi037 2024-09-11T23:12:49.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:48 smithi123 ceph-mon[35438]: Deploying daemon osd.6 on smithi037 2024-09-11T23:12:50.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:49 smithi160 ceph-mon[35055]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-09-11T23:12:50.185 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:49 smithi037 ceph-mon[30630]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-09-11T23:12:50.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:49 smithi123 ceph-mon[35438]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-09-11T23:12:51.964 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:51 smithi037 ceph-mon[30630]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-11T23:12:52.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:51 smithi160 ceph-mon[35055]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-11T23:12:52.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:51 smithi123 ceph-mon[35438]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-11T23:12:54.243 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:53 smithi037 ceph-mon[30630]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-11T23:12:54.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:53 smithi123 ceph-mon[35438]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-11T23:12:54.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:53 smithi160 ceph-mon[35055]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-11T23:12:56.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:55 smithi160 ceph-mon[35055]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-11T23:12:56.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:55 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:12:56.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:55 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:12:56.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:55 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:12:56.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:55 smithi123 ceph-mon[35438]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-11T23:12:56.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:55 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:12:56.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:55 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:12:56.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:55 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:12:56.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:55 smithi037 ceph-mon[30630]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-11T23:12:56.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:55 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:12:56.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:55 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:12:56.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:55 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:12:58.252 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:57 smithi123 ceph-mon[35438]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-11T23:12:58.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:57 smithi037 ceph-mon[30630]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-11T23:12:58.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:57 smithi160 ceph-mon[35055]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-11T23:12:59.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:59 smithi037 ceph-mon[30630]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-11T23:12:59.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:59 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:12:59.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:59 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:12:59.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:59 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:12:59.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:59 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:12:59.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:12:59 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:12:59.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:12:59.482+0000 7fe066000640 1 -- 172.21.15.37:0/2982988232 <== mgr.14150 v2:172.21.15.37:6800/31543269 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fe068062630 con 0x7fe0500a2c30 2024-09-11T23:12:59.483 INFO:teuthology.orchestra.run.smithi037.stdout:Created osd(s) 6 on host 'smithi037' 2024-09-11T23:12:59.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:12:59.484+0000 7fe06ee00640 1 -- 172.21.15.37:0/2982988232 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fe0500a2c30 msgr2=0x7fe0500a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:12:59.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:12:59.484+0000 7fe06ee00640 1 --2- 172.21.15.37:0/2982988232 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fe0500a2c30 0x7fe0500a50f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe05c031440 tx=0x7fe05c0315b0 comp rx=0 tx=0).stop 2024-09-11T23:12:59.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:12:59.484+0000 7fe06ee00640 1 -- 172.21.15.37:0/2982988232 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe068077df0 msgr2=0x7fe06819e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:12:59.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:12:59.484+0000 7fe06ee00640 1 --2- 172.21.15.37:0/2982988232 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe068077df0 0x7fe06819e860 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe05400e9f0 tx=0x7fe05400eeb0 comp rx=0 tx=0).stop 2024-09-11T23:12:59.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:12:59.485+0000 7fe06ee00640 1 -- 172.21.15.37:0/2982988232 shutdown_connections 2024-09-11T23:12:59.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:12:59.485+0000 7fe06ee00640 1 --2- 172.21.15.37:0/2982988232 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fe0500a2c30 0x7fe0500a50f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:12:59.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:12:59.485+0000 7fe06ee00640 1 --2- 172.21.15.37:0/2982988232 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe068078790 0x7fe0681a58e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:12:59.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:12:59.485+0000 7fe06ee00640 1 --2- 172.21.15.37:0/2982988232 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe068077df0 0x7fe06819e860 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:12:59.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:12:59.485+0000 7fe06ee00640 1 --2- 172.21.15.37:0/2982988232 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe068076ba0 0x7fe06819e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:12:59.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:12:59.485+0000 7fe06ee00640 1 -- 172.21.15.37:0/2982988232 >> 172.21.15.37:0/2982988232 conn(0x7fe0680ff3e0 msgr2=0x7fe068100e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:12:59.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:12:59.485+0000 7fe06ee00640 1 -- 172.21.15.37:0/2982988232 shutdown_connections 2024-09-11T23:12:59.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:12:59.485+0000 7fe06ee00640 1 -- 172.21.15.37:0/2982988232 wait complete. 2024-09-11T23:12:59.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:59 smithi123 ceph-mon[35438]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-11T23:12:59.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:59 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:12:59.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:59 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:12:59.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:59 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:12:59.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:59 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:12:59.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:12:59 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:12:59.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:59 smithi160 ceph-mon[35055]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-11T23:12:59.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:59 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:12:59.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:59 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:12:59.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:59 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:12:59.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:59 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:12:59.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:12:59 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:13:00.219 DEBUG:teuthology.orchestra.run.smithi037:osd.6> sudo journalctl -f -n 0 -u ceph-8b03efce-7092-11ef-bcea-c7b262605968@osd.6.service 2024-09-11T23:13:00.223 INFO:tasks.cephadm:Deploying osd.7 on smithi123 with /dev/vg_nvme/lv_2... 2024-09-11T23:13:00.223 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-11T23:13:00.436 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:00 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:13:00.436 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:00 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:13:00.437 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:00 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:13:00.475 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T23:13:00.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:00 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:13:00.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:00 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:13:00.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:00 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:13:00.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:00 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:13:00.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:00 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:13:00.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:00 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:13:00.741 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 11 23:13:00 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-6[57869]: 2024-09-11T23:13:00.437+0000 7f44a6461640 -1 osd.6 0 log_to_monitors true 2024-09-11T23:13:01.486 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:01 smithi037 ceph-mon[30630]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-11T23:13:01.486 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:01 smithi037 ceph-mon[30630]: from='osd.6 [v2:172.21.15.37:6818/3541251299,v1:172.21.15.37:6819/3541251299]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-11T23:13:01.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:01 smithi123 ceph-mon[35438]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-11T23:13:01.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:01 smithi123 ceph-mon[35438]: from='osd.6 [v2:172.21.15.37:6818/3541251299,v1:172.21.15.37:6819/3541251299]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-11T23:13:01.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:01 smithi160 ceph-mon[35055]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-11T23:13:01.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:01 smithi160 ceph-mon[35055]: from='osd.6 [v2:172.21.15.37:6818/3541251299,v1:172.21.15.37:6819/3541251299]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-11T23:13:02.333 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:02 smithi037 ceph-mon[30630]: from='osd.6 [v2:172.21.15.37:6818/3541251299,v1:172.21.15.37:6819/3541251299]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-11T23:13:02.334 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:02 smithi037 ceph-mon[30630]: osdmap e42: 7 total, 6 up, 7 in 2024-09-11T23:13:02.334 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:02 smithi037 ceph-mon[30630]: from='osd.6 [v2:172.21.15.37:6818/3541251299,v1:172.21.15.37:6819/3541251299]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]: dispatch 2024-09-11T23:13:02.334 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:02 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T23:13:02.405 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:02 smithi123 ceph-mon[35438]: from='osd.6 [v2:172.21.15.37:6818/3541251299,v1:172.21.15.37:6819/3541251299]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-11T23:13:02.406 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:02 smithi123 ceph-mon[35438]: osdmap e42: 7 total, 6 up, 7 in 2024-09-11T23:13:02.406 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:02 smithi123 ceph-mon[35438]: from='osd.6 [v2:172.21.15.37:6818/3541251299,v1:172.21.15.37:6819/3541251299]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]: dispatch 2024-09-11T23:13:02.406 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:02 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T23:13:02.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:02 smithi160 ceph-mon[35055]: from='osd.6 [v2:172.21.15.37:6818/3541251299,v1:172.21.15.37:6819/3541251299]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-11T23:13:02.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:02 smithi160 ceph-mon[35055]: osdmap e42: 7 total, 6 up, 7 in 2024-09-11T23:13:02.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:02 smithi160 ceph-mon[35055]: from='osd.6 [v2:172.21.15.37:6818/3541251299,v1:172.21.15.37:6819/3541251299]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]: dispatch 2024-09-11T23:13:02.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:02 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T23:13:03.205 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-11T23:13:03.232 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi123:vg_nvme/lv_2 2024-09-11T23:13:03.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:03 smithi037 ceph-mon[30630]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-11T23:13:03.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:03 smithi037 ceph-mon[30630]: from='osd.6 [v2:172.21.15.37:6818/3541251299,v1:172.21.15.37:6819/3541251299]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2024-09-11T23:13:03.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:03 smithi037 ceph-mon[30630]: osdmap e43: 7 total, 6 up, 7 in 2024-09-11T23:13:03.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:03 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T23:13:03.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:03 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T23:13:03.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:03 smithi037 ceph-mon[30630]: from='osd.6 [v2:172.21.15.37:6818/3541251299,v1:172.21.15.37:6819/3541251299]' entity='osd.6' 2024-09-11T23:13:03.316 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 11 23:13:03 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-6[57869]: 2024-09-11T23:13:03.023+0000 7f44a1a00640 -1 osd.6 0 waiting for initial osdmap 2024-09-11T23:13:03.316 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 11 23:13:03 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-6[57869]: 2024-09-11T23:13:03.049+0000 7f4497000640 -1 osd.6 43 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T23:13:03.479 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T23:13:03.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:03 smithi123 ceph-mon[35438]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-11T23:13:03.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:03 smithi123 ceph-mon[35438]: from='osd.6 [v2:172.21.15.37:6818/3541251299,v1:172.21.15.37:6819/3541251299]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2024-09-11T23:13:03.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:03 smithi123 ceph-mon[35438]: osdmap e43: 7 total, 6 up, 7 in 2024-09-11T23:13:03.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:03 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T23:13:03.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:03 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T23:13:03.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:03 smithi123 ceph-mon[35438]: from='osd.6 [v2:172.21.15.37:6818/3541251299,v1:172.21.15.37:6819/3541251299]' entity='osd.6' 2024-09-11T23:13:03.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:03 smithi160 ceph-mon[35055]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-11T23:13:03.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:03 smithi160 ceph-mon[35055]: from='osd.6 [v2:172.21.15.37:6818/3541251299,v1:172.21.15.37:6819/3541251299]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2024-09-11T23:13:03.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:03 smithi160 ceph-mon[35055]: osdmap e43: 7 total, 6 up, 7 in 2024-09-11T23:13:03.685 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:03 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T23:13:03.685 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:03 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T23:13:03.685 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:03 smithi160 ceph-mon[35055]: from='osd.6 [v2:172.21.15.37:6818/3541251299,v1:172.21.15.37:6819/3541251299]' entity='osd.6' 2024-09-11T23:13:03.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:13:03.947+0000 7f016c618640 1 -- 172.21.15.123:0/3395007479 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0164107960 msgr2=0x7f0164109d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:13:03.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:13:03.947+0000 7f016c618640 1 --2- 172.21.15.123:0/3395007479 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0164107960 0x7f0164109d50 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f015c009ca0 tx=0x7f015c02a8c0 comp rx=0 tx=0).stop 2024-09-11T23:13:03.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:13:03.947+0000 7f016c618640 1 -- 172.21.15.123:0/3395007479 shutdown_connections 2024-09-11T23:13:03.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:13:03.947+0000 7f016c618640 1 --2- 172.21.15.123:0/3395007479 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0164107960 0x7f0164109d50 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:13:03.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:13:03.947+0000 7f016c618640 1 --2- 172.21.15.123:0/3395007479 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0164105030 0x7f0164107420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:13:03.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:13:03.947+0000 7f016c618640 1 --2- 172.21.15.123:0/3395007479 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0164102700 0x7f0164104af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:13:03.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:13:03.947+0000 7f016c618640 1 -- 172.21.15.123:0/3395007479 >> 172.21.15.123:0/3395007479 conn(0x7f01640fc2a0 msgr2=0x7f01640fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:13:03.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:13:03.947+0000 7f016c618640 1 -- 172.21.15.123:0/3395007479 shutdown_connections 2024-09-11T23:13:03.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:13:03.947+0000 7f016c618640 1 -- 172.21.15.123:0/3395007479 wait complete. 2024-09-11T23:13:03.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:13:03.948+0000 7f016c618640 1 Processor -- start 2024-09-11T23:13:03.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:13:03.948+0000 7f016c618640 1 -- start start 2024-09-11T23:13:03.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:13:03.948+0000 7f016c618640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0164102700 0x7f0164197f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:13:03.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:13:03.948+0000 7f016c618640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0164105030 0x7f01641984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:13:03.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:13:03.948+0000 7f016c618640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0164107960 0x7f016419f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:13:03.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:13:03.948+0000 7f016c618640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f016410d930 con 0x7f0164107960 2024-09-11T23:13:03.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:13:03.948+0000 7f016c618640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f016410d7b0 con 0x7f0164102700 2024-09-11T23:13:03.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:13:03.948+0000 7f016c618640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f016410dab0 con 0x7f0164105030 2024-09-11T23:13:03.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:13:03.948+0000 7f016a3b4640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0164102700 0x7f0164197f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:13:03.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:13:03.948+0000 7f016a3b4640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0164102700 0x7f0164197f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47232/0 (socket says 172.21.15.123:47232) 2024-09-11T23:13:03.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:13:03.948+0000 7f016a3b4640 1 -- 172.21.15.123:0/3726110161 learned_addr learned my addr 172.21.15.123:0/3726110161 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-11T23:13:03.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:13:03.948+0000 7f0169bb3640 1 --2- 172.21.15.123:0/3726110161 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0164105030 0x7f01641984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:13:03.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:13:03.948+0000 7f016a3b4640 1 -- 172.21.15.123:0/3726110161 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0164105030 msgr2=0x7f01641984d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:13:03.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:13:03.948+0000 7f016abb5640 1 --2- 172.21.15.123:0/3726110161 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0164107960 0x7f016419f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:13:03.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:13:03.948+0000 7f016a3b4640 1 --2- 172.21.15.123:0/3726110161 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0164105030 0x7f01641984d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:13:03.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:13:03.948+0000 7f016a3b4640 1 -- 172.21.15.123:0/3726110161 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0164107960 msgr2=0x7f016419f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:13:03.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:13:03.949+0000 7f016a3b4640 1 --2- 172.21.15.123:0/3726110161 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0164107960 0x7f016419f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:13:03.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:13:03.949+0000 7f016a3b4640 1 -- 172.21.15.123:0/3726110161 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f016419fbc0 con 0x7f0164102700 2024-09-11T23:13:03.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:13:03.949+0000 7f0169bb3640 1 --2- 172.21.15.123:0/3726110161 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0164105030 0x7f01641984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:13:03.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:13:03.949+0000 7f016abb5640 1 --2- 172.21.15.123:0/3726110161 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0164107960 0x7f016419f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:13:03.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:13:03.949+0000 7f016a3b4640 1 --2- 172.21.15.123:0/3726110161 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0164102700 0x7f0164197f90 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f015800d770 tx=0x7f015800dc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:13:03.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:13:03.949+0000 7f01577fe640 1 -- 172.21.15.123:0/3726110161 <== mon.2 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0158017070 con 0x7f0164102700 2024-09-11T23:13:03.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:13:03.949+0000 7f01577fe640 1 -- 172.21.15.123:0/3726110161 <== mon.2 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0158005500 con 0x7f0164102700 2024-09-11T23:13:03.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:13:03.949+0000 7f01577fe640 1 -- 172.21.15.123:0/3726110161 <== mon.2 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0158004e00 con 0x7f0164102700 2024-09-11T23:13:03.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:13:03.949+0000 7f016c618640 1 -- 172.21.15.123:0/3726110161 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f016419feb0 con 0x7f0164102700 2024-09-11T23:13:03.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:13:03.949+0000 7f016c618640 1 -- 172.21.15.123:0/3726110161 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01641a0380 con 0x7f0164102700 2024-09-11T23:13:03.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:13:03.950+0000 7f016c618640 1 -- 172.21.15.123:0/3726110161 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01640fdd90 con 0x7f0164102700 2024-09-11T23:13:03.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:13:03.951+0000 7f01577fe640 1 -- 172.21.15.123:0/3726110161 <== mon.2 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f0158004fa0 con 0x7f0164102700 2024-09-11T23:13:03.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:13:03.951+0000 7f01577fe640 1 --2- 172.21.15.123:0/3726110161 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f01500a2c30 0x7f01500a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:13:03.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:13:03.952+0000 7f01577fe640 1 -- 172.21.15.123:0/3726110161 <== mon.2 v2:172.21.15.123:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 4685+0+0 (secure 0 0 0) 0x7f01580cd910 con 0x7f0164102700 2024-09-11T23:13:03.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:13:03.952+0000 7f0169bb3640 1 --2- 172.21.15.123:0/3726110161 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f01500a2c30 0x7f01500a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:13:03.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:13:03.952+0000 7f0169bb3640 1 --2- 172.21.15.123:0/3726110161 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f01500a2c30 0x7f01500a50f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0160006fd0 tx=0x7f0160008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:13:03.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:13:03.956+0000 7f01577fe640 1 -- 172.21.15.123:0/3726110161 <== mon.2 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f015809b6a0 con 0x7f0164102700 2024-09-11T23:13:04.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:13:04.132+0000 7f016c618640 1 -- 172.21.15.123:0/3726110161 --> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi123:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f0164062630 con 0x7f01500a2c30 2024-09-11T23:13:04.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:04 smithi123 ceph-mon[35438]: purged_snaps scrub starts 2024-09-11T23:13:04.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:04 smithi123 ceph-mon[35438]: purged_snaps scrub ok 2024-09-11T23:13:04.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:04 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T23:13:04.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:04 smithi123 ceph-mon[35438]: osd.6 [v2:172.21.15.37:6818/3541251299,v1:172.21.15.37:6819/3541251299] boot 2024-09-11T23:13:04.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:04 smithi123 ceph-mon[35438]: osdmap e44: 7 total, 7 up, 7 in 2024-09-11T23:13:04.502 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:04 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T23:13:04.502 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:04 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:13:04.502 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:04 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:13:04.502 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:04 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:13:04.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:04 smithi037 ceph-mon[30630]: purged_snaps scrub starts 2024-09-11T23:13:04.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:04 smithi037 ceph-mon[30630]: purged_snaps scrub ok 2024-09-11T23:13:04.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:04 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T23:13:04.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:04 smithi037 ceph-mon[30630]: osd.6 [v2:172.21.15.37:6818/3541251299,v1:172.21.15.37:6819/3541251299] boot 2024-09-11T23:13:04.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:04 smithi037 ceph-mon[30630]: osdmap e44: 7 total, 7 up, 7 in 2024-09-11T23:13:04.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:04 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T23:13:04.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:04 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:13:04.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:04 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:13:04.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:04 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:13:04.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:04 smithi160 ceph-mon[35055]: purged_snaps scrub starts 2024-09-11T23:13:04.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:04 smithi160 ceph-mon[35055]: purged_snaps scrub ok 2024-09-11T23:13:04.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:04 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T23:13:04.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:04 smithi160 ceph-mon[35055]: osd.6 [v2:172.21.15.37:6818/3541251299,v1:172.21.15.37:6819/3541251299] boot 2024-09-11T23:13:04.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:04 smithi160 ceph-mon[35055]: osdmap e44: 7 total, 7 up, 7 in 2024-09-11T23:13:04.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:04 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T23:13:04.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:04 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:13:04.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:04 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:13:04.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:04 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:13:05.931 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:05 smithi123 ceph-mon[35438]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-11T23:13:05.931 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:05 smithi123 ceph-mon[35438]: from='client.24293 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi123:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:13:05.931 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:05 smithi123 ceph-mon[35438]: Detected new or changed devices on smithi037 2024-09-11T23:13:05.931 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:05 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:13:05.931 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:05 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:13:05.931 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:05 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:13:05.932 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:05 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:13:05.932 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:05 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:13:05.932 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:05 smithi123 ceph-mon[35438]: Adjusting osd_memory_target on smithi037 to 5698M 2024-09-11T23:13:05.932 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:05 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:13:05.932 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:05 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:13:05.932 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:05 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:13:05.932 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:05 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:13:05.932 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:05 smithi123 ceph-mon[35438]: osdmap e45: 7 total, 7 up, 7 in 2024-09-11T23:13:06.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:05 smithi037 ceph-mon[30630]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-11T23:13:06.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:05 smithi037 ceph-mon[30630]: from='client.24293 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi123:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:13:06.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:05 smithi037 ceph-mon[30630]: Detected new or changed devices on smithi037 2024-09-11T23:13:06.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:05 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:13:06.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:05 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:13:06.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:05 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:13:06.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:05 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:13:06.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:05 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:13:06.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:05 smithi037 ceph-mon[30630]: Adjusting osd_memory_target on smithi037 to 5698M 2024-09-11T23:13:06.066 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:05 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:13:06.066 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:05 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:13:06.066 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:05 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:13:06.066 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:05 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:13:06.066 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:05 smithi037 ceph-mon[30630]: osdmap e45: 7 total, 7 up, 7 in 2024-09-11T23:13:06.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:05 smithi160 ceph-mon[35055]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-11T23:13:06.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:05 smithi160 ceph-mon[35055]: from='client.24293 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi123:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:13:06.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:05 smithi160 ceph-mon[35055]: Detected new or changed devices on smithi037 2024-09-11T23:13:06.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:05 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:13:06.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:05 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:13:06.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:05 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:13:06.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:05 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:13:06.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:05 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:13:06.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:05 smithi160 ceph-mon[35055]: Adjusting osd_memory_target on smithi037 to 5698M 2024-09-11T23:13:06.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:05 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:13:06.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:05 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:13:06.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:05 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:13:06.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:05 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:13:06.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:05 smithi160 ceph-mon[35055]: osdmap e45: 7 total, 7 up, 7 in 2024-09-11T23:13:07.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:06 smithi123 ceph-mon[35438]: from='client.? 172.21.15.123:0/3124964649' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "04fbec2e-91b5-4a89-a4a3-472398c45288"}]: dispatch 2024-09-11T23:13:07.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:06 smithi123 ceph-mon[35438]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "04fbec2e-91b5-4a89-a4a3-472398c45288"}]: dispatch 2024-09-11T23:13:07.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:06 smithi123 ceph-mon[35438]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "04fbec2e-91b5-4a89-a4a3-472398c45288"}]': finished 2024-09-11T23:13:07.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:06 smithi123 ceph-mon[35438]: osdmap e46: 8 total, 7 up, 8 in 2024-09-11T23:13:07.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:06 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T23:13:07.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:06 smithi037 ceph-mon[30630]: from='client.? 172.21.15.123:0/3124964649' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "04fbec2e-91b5-4a89-a4a3-472398c45288"}]: dispatch 2024-09-11T23:13:07.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:06 smithi037 ceph-mon[30630]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "04fbec2e-91b5-4a89-a4a3-472398c45288"}]: dispatch 2024-09-11T23:13:07.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:06 smithi037 ceph-mon[30630]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "04fbec2e-91b5-4a89-a4a3-472398c45288"}]': finished 2024-09-11T23:13:07.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:06 smithi037 ceph-mon[30630]: osdmap e46: 8 total, 7 up, 8 in 2024-09-11T23:13:07.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:06 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T23:13:07.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:06 smithi160 ceph-mon[35055]: from='client.? 172.21.15.123:0/3124964649' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "04fbec2e-91b5-4a89-a4a3-472398c45288"}]: dispatch 2024-09-11T23:13:07.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:06 smithi160 ceph-mon[35055]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "04fbec2e-91b5-4a89-a4a3-472398c45288"}]: dispatch 2024-09-11T23:13:07.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:06 smithi160 ceph-mon[35055]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "04fbec2e-91b5-4a89-a4a3-472398c45288"}]': finished 2024-09-11T23:13:07.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:06 smithi160 ceph-mon[35055]: osdmap e46: 8 total, 7 up, 8 in 2024-09-11T23:13:07.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:06 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T23:13:08.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:07 smithi123 ceph-mon[35438]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:13:08.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:07 smithi123 ceph-mon[35438]: from='client.? 172.21.15.123:0/2402919893' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:13:08.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:07 smithi037 ceph-mon[30630]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:13:08.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:07 smithi037 ceph-mon[30630]: from='client.? 172.21.15.123:0/2402919893' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:13:08.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:07 smithi160 ceph-mon[35055]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:13:08.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:07 smithi160 ceph-mon[35055]: from='client.? 172.21.15.123:0/2402919893' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:13:10.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:09 smithi123 ceph-mon[35438]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:13:10.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:09 smithi037 ceph-mon[30630]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:13:10.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:09 smithi160 ceph-mon[35055]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:13:11.858 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:11 smithi123 ceph-mon[35438]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:13:12.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:11 smithi037 ceph-mon[30630]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:13:12.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:11 smithi160 ceph-mon[35055]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:13:13.870 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:13 smithi123 ceph-mon[35438]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:13:14.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:13 smithi037 ceph-mon[30630]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:13:14.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:13 smithi160 ceph-mon[35055]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:13:15.830 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:15 smithi123 ceph-mon[35438]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:13:15.830 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:15 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-11T23:13:15.830 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:15 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:13:16.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:15 smithi037 ceph-mon[30630]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:13:16.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:15 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-11T23:13:16.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:15 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:13:16.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:15 smithi160 ceph-mon[35055]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:13:16.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:15 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-11T23:13:16.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:15 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:13:17.028 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:16 smithi123 ceph-mon[35438]: Deploying daemon osd.7 on smithi123 2024-09-11T23:13:17.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:16 smithi037 ceph-mon[30630]: Deploying daemon osd.7 on smithi123 2024-09-11T23:13:17.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:16 smithi160 ceph-mon[35055]: Deploying daemon osd.7 on smithi123 2024-09-11T23:13:17.832 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:17 smithi123 ceph-mon[35438]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:13:18.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:17 smithi037 ceph-mon[30630]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:13:18.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:17 smithi160 ceph-mon[35055]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:13:19.951 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:19 smithi123 ceph-mon[35438]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:13:20.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:19 smithi037 ceph-mon[30630]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:13:20.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:19 smithi160 ceph-mon[35055]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:13:21.931 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:21 smithi123 ceph-mon[35438]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:13:21.931 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:21 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:13:21.931 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:21 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:13:21.931 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:21 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:13:22.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:21 smithi037 ceph-mon[30630]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:13:22.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:21 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:13:22.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:21 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:13:22.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:21 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:13:22.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:21 smithi160 ceph-mon[35055]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:13:22.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:21 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:13:22.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:21 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:13:22.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:21 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:13:23.833 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:23 smithi123 ceph-mon[35438]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:13:24.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:23 smithi037 ceph-mon[30630]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:13:24.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:23 smithi160 ceph-mon[35055]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:13:25.088 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:24 smithi123 ceph-mon[35438]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:13:25.088 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:24 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:13:25.088 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:24 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:13:25.088 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:24 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:13:25.089 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:24 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:13:25.089 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:24 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:13:25.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:13:25.127+0000 7f01577fe640 1 -- 172.21.15.123:0/3726110161 <== mgr.14150 v2:172.21.15.37:6800/31543269 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f0164062630 con 0x7f01500a2c30 2024-09-11T23:13:25.129 INFO:teuthology.orchestra.run.smithi123.stdout:Created osd(s) 7 on host 'smithi123' 2024-09-11T23:13:25.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:13:25.130+0000 7f016c618640 1 -- 172.21.15.123:0/3726110161 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f01500a2c30 msgr2=0x7f01500a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:13:25.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:13:25.130+0000 7f016c618640 1 --2- 172.21.15.123:0/3726110161 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f01500a2c30 0x7f01500a50f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0160006fd0 tx=0x7f0160008040 comp rx=0 tx=0).stop 2024-09-11T23:13:25.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:13:25.130+0000 7f016c618640 1 -- 172.21.15.123:0/3726110161 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0164102700 msgr2=0x7f0164197f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:13:25.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:13:25.130+0000 7f016c618640 1 --2- 172.21.15.123:0/3726110161 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0164102700 0x7f0164197f90 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f015800d770 tx=0x7f015800dc30 comp rx=0 tx=0).stop 2024-09-11T23:13:25.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:13:25.130+0000 7f016c618640 1 -- 172.21.15.123:0/3726110161 shutdown_connections 2024-09-11T23:13:25.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:13:25.130+0000 7f016c618640 1 --2- 172.21.15.123:0/3726110161 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f01500a2c30 0x7f01500a50f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:13:25.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:13:25.130+0000 7f016c618640 1 --2- 172.21.15.123:0/3726110161 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0164107960 0x7f016419f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:13:25.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:13:25.130+0000 7f016c618640 1 --2- 172.21.15.123:0/3726110161 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0164105030 0x7f01641984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:13:25.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:13:25.130+0000 7f016c618640 1 --2- 172.21.15.123:0/3726110161 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0164102700 0x7f0164197f90 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:13:25.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:13:25.130+0000 7f016c618640 1 -- 172.21.15.123:0/3726110161 >> 172.21.15.123:0/3726110161 conn(0x7f01640fc2a0 msgr2=0x7f0164102fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:13:25.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:13:25.130+0000 7f016c618640 1 -- 172.21.15.123:0/3726110161 shutdown_connections 2024-09-11T23:13:25.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:13:25.130+0000 7f016c618640 1 -- 172.21.15.123:0/3726110161 wait complete. 2024-09-11T23:13:25.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:24 smithi037 ceph-mon[30630]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:13:25.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:24 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:13:25.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:24 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:13:25.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:24 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:13:25.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:24 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:13:25.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:24 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:13:25.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:24 smithi160 ceph-mon[35055]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:13:25.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:24 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:13:25.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:24 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:13:25.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:24 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:13:25.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:24 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:13:25.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:24 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:13:25.809 DEBUG:teuthology.orchestra.run.smithi123:osd.7> sudo journalctl -f -n 0 -u ceph-8b03efce-7092-11ef-bcea-c7b262605968@osd.7.service 2024-09-11T23:13:25.811 INFO:tasks.cephadm:Deploying osd.8 on smithi160 with /dev/vg_nvme/lv_2... 2024-09-11T23:13:25.812 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-11T23:13:26.069 INFO:teuthology.orchestra.run.smithi160.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T23:13:26.102 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:25 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:13:26.102 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:25 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:13:26.102 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:25 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:13:26.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:25 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:13:26.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:25 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:13:26.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:25 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:13:26.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:25 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:13:26.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:25 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:13:26.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:25 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:13:27.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:27 smithi123 ceph-mon[35438]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:13:27.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:27 smithi123 ceph-mon[35438]: from='osd.7 [v2:172.21.15.123:6816/4279933341,v1:172.21.15.123:6817/4279933341]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-11T23:13:27.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:27 smithi123 ceph-mon[35438]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-11T23:13:27.251 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 11 23:13:26 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-7[53549]: 2024-09-11T23:13:26.963+0000 7f58f409e640 -1 osd.7 0 log_to_monitors true 2024-09-11T23:13:27.381 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:27 smithi160 ceph-mon[35055]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:13:27.381 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:27 smithi160 ceph-mon[35055]: from='osd.7 [v2:172.21.15.123:6816/4279933341,v1:172.21.15.123:6817/4279933341]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-11T23:13:27.381 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:27 smithi160 ceph-mon[35055]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-11T23:13:27.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:27 smithi037 ceph-mon[30630]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:13:27.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:27 smithi037 ceph-mon[30630]: from='osd.7 [v2:172.21.15.123:6816/4279933341,v1:172.21.15.123:6817/4279933341]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-11T23:13:27.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:27 smithi037 ceph-mon[30630]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-11T23:13:28.274 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:28 smithi160 ceph-mon[35055]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-11T23:13:28.274 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:28 smithi160 ceph-mon[35055]: osdmap e47: 8 total, 7 up, 8 in 2024-09-11T23:13:28.274 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:28 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T23:13:28.274 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:28 smithi160 ceph-mon[35055]: from='osd.7 [v2:172.21.15.123:6816/4279933341,v1:172.21.15.123:6817/4279933341]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]: dispatch 2024-09-11T23:13:28.275 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:28 smithi160 ceph-mon[35055]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]: dispatch 2024-09-11T23:13:28.422 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:28 smithi123 ceph-mon[35438]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-11T23:13:28.422 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:28 smithi123 ceph-mon[35438]: osdmap e47: 8 total, 7 up, 8 in 2024-09-11T23:13:28.423 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:28 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T23:13:28.423 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:28 smithi123 ceph-mon[35438]: from='osd.7 [v2:172.21.15.123:6816/4279933341,v1:172.21.15.123:6817/4279933341]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]: dispatch 2024-09-11T23:13:28.423 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:28 smithi123 ceph-mon[35438]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]: dispatch 2024-09-11T23:13:28.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:28 smithi037 ceph-mon[30630]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-11T23:13:28.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:28 smithi037 ceph-mon[30630]: osdmap e47: 8 total, 7 up, 8 in 2024-09-11T23:13:28.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:28 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T23:13:28.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:28 smithi037 ceph-mon[30630]: from='osd.7 [v2:172.21.15.123:6816/4279933341,v1:172.21.15.123:6817/4279933341]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]: dispatch 2024-09-11T23:13:28.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:28 smithi037 ceph-mon[30630]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]: dispatch 2024-09-11T23:13:28.608 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-11T23:13:28.633 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi160:vg_nvme/lv_2 2024-09-11T23:13:28.883 INFO:teuthology.orchestra.run.smithi160.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T23:13:29.161 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 11 23:13:28 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-7[53549]: 2024-09-11T23:13:28.820+0000 7f58f0835640 -1 osd.7 0 waiting for initial osdmap 2024-09-11T23:13:29.161 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 11 23:13:28 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-7[53549]: 2024-09-11T23:13:28.828+0000 7f58e7e41640 -1 osd.7 48 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T23:13:29.269 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:29 smithi160 ceph-mon[35055]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:13:29.269 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:29 smithi160 ceph-mon[35055]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]': finished 2024-09-11T23:13:29.269 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:29 smithi160 ceph-mon[35055]: osdmap e48: 8 total, 7 up, 8 in 2024-09-11T23:13:29.269 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:29 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T23:13:29.269 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:29 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T23:13:29.269 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:29 smithi160 ceph-mon[35055]: Detected new or changed devices on smithi123 2024-09-11T23:13:29.269 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:29 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:13:29.269 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:29 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:13:29.270 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:29 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:13:29.270 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:29 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:13:29.270 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:29 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:13:29.270 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:29 smithi160 ceph-mon[35055]: Adjusting osd_memory_target on smithi123 to 5696M 2024-09-11T23:13:29.270 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:29 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:13:29.270 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:29 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:13:29.270 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:29 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:13:29.270 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:29 smithi160 ceph-mon[35055]: from='osd.7 ' entity='osd.7' 2024-09-11T23:13:29.270 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:29 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:13:29.270 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:29 smithi160 ceph-mon[35055]: osd.7 [v2:172.21.15.123:6816/4279933341,v1:172.21.15.123:6817/4279933341] boot 2024-09-11T23:13:29.270 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:29 smithi160 ceph-mon[35055]: osdmap e49: 8 total, 8 up, 8 in 2024-09-11T23:13:29.270 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:29 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T23:13:29.351 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:13:29.320+0000 7f92281e0640 1 -- 172.21.15.160:0/3017998597 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9220101cd0 msgr2=0x7f9220102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:13:29.351 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:13:29.320+0000 7f92281e0640 1 --2- 172.21.15.160:0/3017998597 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9220101cd0 0x7f9220102150 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9214009900 tx=0x7f921402a410 comp rx=0 tx=0).stop 2024-09-11T23:13:29.351 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:13:29.320+0000 7f92281e0640 1 -- 172.21.15.160:0/3017998597 shutdown_connections 2024-09-11T23:13:29.351 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:13:29.320+0000 7f92281e0640 1 --2- 172.21.15.160:0/3017998597 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9220102690 0x7f9220108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:13:29.351 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:13:29.320+0000 7f92281e0640 1 --2- 172.21.15.160:0/3017998597 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9220101cd0 0x7f9220102150 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:13:29.351 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:13:29.320+0000 7f92281e0640 1 --2- 172.21.15.160:0/3017998597 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9220100ad0 0x7f9220100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:13:29.351 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:13:29.320+0000 7f92281e0640 1 -- 172.21.15.160:0/3017998597 >> 172.21.15.160:0/3017998597 conn(0x7f92200fc280 msgr2=0x7f92200fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:13:29.351 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:13:29.320+0000 7f92281e0640 1 -- 172.21.15.160:0/3017998597 shutdown_connections 2024-09-11T23:13:29.352 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:13:29.320+0000 7f92281e0640 1 -- 172.21.15.160:0/3017998597 wait complete. 2024-09-11T23:13:29.352 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:13:29.320+0000 7f92281e0640 1 Processor -- start 2024-09-11T23:13:29.352 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:13:29.320+0000 7f92281e0640 1 -- start start 2024-09-11T23:13:29.352 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:13:29.321+0000 7f92281e0640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9220100ad0 0x7f9220198020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:13:29.352 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:13:29.321+0000 7f92281e0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9220101cd0 0x7f9220198560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:13:29.352 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:13:29.321+0000 7f92281e0640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9220102690 0x7f922019f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:13:29.352 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:13:29.321+0000 7f92281e0640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f922010c850 con 0x7f9220101cd0 2024-09-11T23:13:29.352 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:13:29.321+0000 7f92281e0640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f922010c6d0 con 0x7f9220100ad0 2024-09-11T23:13:29.352 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:13:29.321+0000 7f92281e0640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f922010c9d0 con 0x7f9220102690 2024-09-11T23:13:29.352 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:13:29.321+0000 7f922677d640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9220102690 0x7f922019f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:13:29.352 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:13:29.321+0000 7f9225f7c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9220100ad0 0x7f9220198020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:13:29.353 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:13:29.321+0000 7f922677d640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9220102690 0x7f922019f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:45194/0 (socket says 172.21.15.160:45194) 2024-09-11T23:13:29.353 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:13:29.321+0000 7f922677d640 1 -- 172.21.15.160:0/484258991 learned_addr learned my addr 172.21.15.160:0/484258991 (peer_addr_for_me v2:172.21.15.160:0/0) 2024-09-11T23:13:29.353 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:13:29.321+0000 7f922577b640 1 --2- 172.21.15.160:0/484258991 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9220101cd0 0x7f9220198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:13:29.353 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:13:29.321+0000 7f922677d640 1 -- 172.21.15.160:0/484258991 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9220100ad0 msgr2=0x7f9220198020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:13:29.353 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:13:29.321+0000 7f922677d640 1 --2- 172.21.15.160:0/484258991 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9220100ad0 0x7f9220198020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:13:29.353 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:13:29.321+0000 7f922677d640 1 -- 172.21.15.160:0/484258991 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9220101cd0 msgr2=0x7f9220198560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:13:29.353 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:13:29.321+0000 7f922677d640 1 --2- 172.21.15.160:0/484258991 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9220101cd0 0x7f9220198560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:13:29.353 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:13:29.321+0000 7f922677d640 1 -- 172.21.15.160:0/484258991 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f922019fc50 con 0x7f9220102690 2024-09-11T23:13:29.353 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:13:29.321+0000 7f922677d640 1 --2- 172.21.15.160:0/484258991 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9220102690 0x7f922019f5e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f921000c970 tx=0x7f921000ce30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:13:29.353 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:13:29.321+0000 7f921effd640 1 -- 172.21.15.160:0/484258991 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9210007bb0 con 0x7f9220102690 2024-09-11T23:13:29.353 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:13:29.321+0000 7f92281e0640 1 -- 172.21.15.160:0/484258991 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f922019ff40 con 0x7f9220102690 2024-09-11T23:13:29.353 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:13:29.321+0000 7f921effd640 1 -- 172.21.15.160:0/484258991 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9210007d50 con 0x7f9220102690 2024-09-11T23:13:29.354 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:13:29.321+0000 7f921effd640 1 -- 172.21.15.160:0/484258991 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f921000f450 con 0x7f9220102690 2024-09-11T23:13:29.354 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:13:29.322+0000 7f92281e0640 1 -- 172.21.15.160:0/484258991 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92201a0470 con 0x7f9220102690 2024-09-11T23:13:29.354 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:13:29.322+0000 7f92281e0640 1 -- 172.21.15.160:0/484258991 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92201a0700 con 0x7f9220102690 2024-09-11T23:13:29.354 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:13:29.324+0000 7f921effd640 1 -- 172.21.15.160:0/484258991 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f9210004ee0 con 0x7f9220102690 2024-09-11T23:13:29.354 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:13:29.324+0000 7f921effd640 1 --2- 172.21.15.160:0/484258991 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f92080a2bb0 0x7f92080a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:13:29.354 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:13:29.325+0000 7f921effd640 1 -- 172.21.15.160:0/484258991 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5430+0+0 (secure 0 0 0) 0x7f92100ce4c0 con 0x7f9220102690 2024-09-11T23:13:29.354 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:13:29.325+0000 7f9225f7c640 1 --2- 172.21.15.160:0/484258991 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f92080a2bb0 0x7f92080a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:13:29.354 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:13:29.325+0000 7f9225f7c640 1 --2- 172.21.15.160:0/484258991 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f92080a2bb0 0x7f92080a5070 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9220101b30 tx=0x7f921800d040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:13:29.354 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:13:29.327+0000 7f921effd640 1 -- 172.21.15.160:0/484258991 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9210014030 con 0x7f9220102690 2024-09-11T23:13:29.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:29 smithi123 ceph-mon[35438]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:13:29.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:29 smithi123 ceph-mon[35438]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]': finished 2024-09-11T23:13:29.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:29 smithi123 ceph-mon[35438]: osdmap e48: 8 total, 7 up, 8 in 2024-09-11T23:13:29.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:29 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T23:13:29.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:29 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T23:13:29.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:29 smithi123 ceph-mon[35438]: Detected new or changed devices on smithi123 2024-09-11T23:13:29.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:29 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:13:29.502 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:29 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:13:29.502 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:29 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:13:29.502 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:29 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:13:29.502 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:29 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:13:29.502 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:29 smithi123 ceph-mon[35438]: Adjusting osd_memory_target on smithi123 to 5696M 2024-09-11T23:13:29.502 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:29 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:13:29.502 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:29 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:13:29.502 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:29 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:13:29.502 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:29 smithi123 ceph-mon[35438]: from='osd.7 ' entity='osd.7' 2024-09-11T23:13:29.502 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:29 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:13:29.502 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:29 smithi123 ceph-mon[35438]: osd.7 [v2:172.21.15.123:6816/4279933341,v1:172.21.15.123:6817/4279933341] boot 2024-09-11T23:13:29.502 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:29 smithi123 ceph-mon[35438]: osdmap e49: 8 total, 8 up, 8 in 2024-09-11T23:13:29.502 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:29 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T23:13:29.504 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:13:29.503+0000 7f92281e0640 1 -- 172.21.15.160:0/484258991 --> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi160:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f92201a08d0 con 0x7f92080a2bb0 2024-09-11T23:13:29.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:29 smithi037 ceph-mon[30630]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:13:29.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:29 smithi037 ceph-mon[30630]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]': finished 2024-09-11T23:13:29.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:29 smithi037 ceph-mon[30630]: osdmap e48: 8 total, 7 up, 8 in 2024-09-11T23:13:29.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:29 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T23:13:29.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:29 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T23:13:29.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:29 smithi037 ceph-mon[30630]: Detected new or changed devices on smithi123 2024-09-11T23:13:29.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:29 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:13:29.566 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:29 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:13:29.566 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:29 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:13:29.566 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:29 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:13:29.566 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:29 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:13:29.566 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:29 smithi037 ceph-mon[30630]: Adjusting osd_memory_target on smithi123 to 5696M 2024-09-11T23:13:29.566 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:29 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:13:29.566 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:29 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:13:29.566 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:29 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:13:29.566 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:29 smithi037 ceph-mon[30630]: from='osd.7 ' entity='osd.7' 2024-09-11T23:13:29.566 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:29 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:13:29.566 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:29 smithi037 ceph-mon[30630]: osd.7 [v2:172.21.15.123:6816/4279933341,v1:172.21.15.123:6817/4279933341] boot 2024-09-11T23:13:29.566 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:29 smithi037 ceph-mon[30630]: osdmap e49: 8 total, 8 up, 8 in 2024-09-11T23:13:29.567 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:29 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T23:13:30.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:30 smithi160 ceph-mon[35055]: purged_snaps scrub starts 2024-09-11T23:13:30.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:30 smithi160 ceph-mon[35055]: purged_snaps scrub ok 2024-09-11T23:13:30.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:30 smithi160 ceph-mon[35055]: from='client.24304 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi160:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:13:30.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:30 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:13:30.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:30 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:13:30.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:30 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:13:30.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:30 smithi123 ceph-mon[35438]: purged_snaps scrub starts 2024-09-11T23:13:30.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:30 smithi123 ceph-mon[35438]: purged_snaps scrub ok 2024-09-11T23:13:30.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:30 smithi123 ceph-mon[35438]: from='client.24304 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi160:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:13:30.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:30 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:13:30.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:30 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:13:30.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:30 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:13:30.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:30 smithi037 ceph-mon[30630]: purged_snaps scrub starts 2024-09-11T23:13:30.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:30 smithi037 ceph-mon[30630]: purged_snaps scrub ok 2024-09-11T23:13:30.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:30 smithi037 ceph-mon[30630]: from='client.24304 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi160:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:13:30.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:30 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:13:30.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:30 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:13:30.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:30 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:13:31.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:31 smithi160 ceph-mon[35055]: pgmap v178: 1 pgs: 1 unknown; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:13:31.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:31 smithi160 ceph-mon[35055]: osdmap e50: 8 total, 8 up, 8 in 2024-09-11T23:13:31.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:31 smithi160 ceph-mon[35055]: osdmap e51: 8 total, 8 up, 8 in 2024-09-11T23:13:31.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:31 smithi123 ceph-mon[35438]: pgmap v178: 1 pgs: 1 unknown; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:13:31.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:31 smithi123 ceph-mon[35438]: osdmap e50: 8 total, 8 up, 8 in 2024-09-11T23:13:31.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:31 smithi123 ceph-mon[35438]: osdmap e51: 8 total, 8 up, 8 in 2024-09-11T23:13:31.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:31 smithi037 ceph-mon[30630]: pgmap v178: 1 pgs: 1 unknown; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:13:31.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:31 smithi037 ceph-mon[30630]: osdmap e50: 8 total, 8 up, 8 in 2024-09-11T23:13:31.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:31 smithi037 ceph-mon[30630]: osdmap e51: 8 total, 8 up, 8 in 2024-09-11T23:13:32.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:32 smithi160 ceph-mon[35055]: from='client.? 172.21.15.160:0/3063089812' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c77090a7-308e-4c6d-a56e-ce6f8e050ae5"}]: dispatch 2024-09-11T23:13:32.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:32 smithi160 ceph-mon[35055]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c77090a7-308e-4c6d-a56e-ce6f8e050ae5"}]: dispatch 2024-09-11T23:13:32.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:32 smithi160 ceph-mon[35055]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c77090a7-308e-4c6d-a56e-ce6f8e050ae5"}]': finished 2024-09-11T23:13:32.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:32 smithi160 ceph-mon[35055]: osdmap e52: 9 total, 8 up, 9 in 2024-09-11T23:13:32.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:32 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T23:13:32.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:32 smithi123 ceph-mon[35438]: from='client.? 172.21.15.160:0/3063089812' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c77090a7-308e-4c6d-a56e-ce6f8e050ae5"}]: dispatch 2024-09-11T23:13:32.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:32 smithi123 ceph-mon[35438]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c77090a7-308e-4c6d-a56e-ce6f8e050ae5"}]: dispatch 2024-09-11T23:13:32.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:32 smithi123 ceph-mon[35438]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c77090a7-308e-4c6d-a56e-ce6f8e050ae5"}]': finished 2024-09-11T23:13:32.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:32 smithi123 ceph-mon[35438]: osdmap e52: 9 total, 8 up, 9 in 2024-09-11T23:13:32.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:32 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T23:13:32.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:32 smithi037 ceph-mon[30630]: from='client.? 172.21.15.160:0/3063089812' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c77090a7-308e-4c6d-a56e-ce6f8e050ae5"}]: dispatch 2024-09-11T23:13:32.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:32 smithi037 ceph-mon[30630]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c77090a7-308e-4c6d-a56e-ce6f8e050ae5"}]: dispatch 2024-09-11T23:13:32.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:32 smithi037 ceph-mon[30630]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c77090a7-308e-4c6d-a56e-ce6f8e050ae5"}]': finished 2024-09-11T23:13:32.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:32 smithi037 ceph-mon[30630]: osdmap e52: 9 total, 8 up, 9 in 2024-09-11T23:13:32.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:32 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T23:13:33.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:33 smithi160 ceph-mon[35055]: pgmap v182: 1 pgs: 1 unknown; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:13:33.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:33 smithi160 ceph-mon[35055]: from='client.? 172.21.15.160:0/1126846870' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:13:33.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:33 smithi160 ceph-mon[35055]: osdmap e53: 9 total, 8 up, 9 in 2024-09-11T23:13:33.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:33 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T23:13:33.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:33 smithi123 ceph-mon[35438]: pgmap v182: 1 pgs: 1 unknown; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:13:33.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:33 smithi123 ceph-mon[35438]: from='client.? 172.21.15.160:0/1126846870' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:13:33.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:33 smithi123 ceph-mon[35438]: osdmap e53: 9 total, 8 up, 9 in 2024-09-11T23:13:33.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:33 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T23:13:33.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:33 smithi037 ceph-mon[30630]: pgmap v182: 1 pgs: 1 unknown; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:13:33.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:33 smithi037 ceph-mon[30630]: from='client.? 172.21.15.160:0/1126846870' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:13:33.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:33 smithi037 ceph-mon[30630]: osdmap e53: 9 total, 8 up, 9 in 2024-09-11T23:13:33.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:33 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T23:13:34.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:34 smithi123 ceph-mon[35438]: Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2024-09-11T23:13:34.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:34 smithi037 ceph-mon[30630]: Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2024-09-11T23:13:34.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:34 smithi160 ceph-mon[35055]: Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2024-09-11T23:13:35.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:35 smithi123 ceph-mon[35438]: pgmap v184: 1 pgs: 1 unknown; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:13:35.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:35 smithi037 ceph-mon[30630]: pgmap v184: 1 pgs: 1 unknown; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:13:35.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:35 smithi160 ceph-mon[35055]: pgmap v184: 1 pgs: 1 unknown; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:13:36.403 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:36 smithi160 ceph-mon[35055]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2024-09-11T23:13:36.403 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:36 smithi160 ceph-mon[35055]: Cluster is now healthy 2024-09-11T23:13:36.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:36 smithi037 ceph-mon[30630]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2024-09-11T23:13:36.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:36 smithi037 ceph-mon[30630]: Cluster is now healthy 2024-09-11T23:13:36.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:36 smithi123 ceph-mon[35438]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2024-09-11T23:13:36.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:36 smithi123 ceph-mon[35438]: Cluster is now healthy 2024-09-11T23:13:37.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:37 smithi160 ceph-mon[35055]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:13:37.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:37 smithi037 ceph-mon[30630]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:13:37.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:37 smithi123 ceph-mon[35438]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:13:39.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:39 smithi160 ceph-mon[35055]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:13:39.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:39 smithi037 ceph-mon[30630]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:13:39.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:39 smithi123 ceph-mon[35438]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:13:40.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:40 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-11T23:13:40.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:40 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:13:40.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:40 smithi160 ceph-mon[35055]: Deploying daemon osd.8 on smithi160 2024-09-11T23:13:40.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:40 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-11T23:13:40.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:40 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:13:40.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:40 smithi037 ceph-mon[30630]: Deploying daemon osd.8 on smithi160 2024-09-11T23:13:40.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:40 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-11T23:13:40.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:40 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:13:40.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:40 smithi123 ceph-mon[35438]: Deploying daemon osd.8 on smithi160 2024-09-11T23:13:41.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:41 smithi160 ceph-mon[35055]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:13:41.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:41 smithi037 ceph-mon[30630]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:13:41.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:41 smithi123 ceph-mon[35438]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:13:43.316 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:43 smithi160 ceph-mon[35055]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:13:43.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:43 smithi037 ceph-mon[30630]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:13:43.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:43 smithi123 ceph-mon[35438]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:13:45.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:45 smithi160 ceph-mon[35055]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:13:45.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:45 smithi123 ceph-mon[35438]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:13:45.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:45 smithi037 ceph-mon[30630]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:13:46.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:46 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:13:46.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:46 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:13:46.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:46 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:13:46.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:46 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:13:46.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:46 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:13:46.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:46 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:13:46.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:46 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:13:46.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:46 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:13:46.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:46 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:13:47.829 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:47 smithi160 ceph-mon[35055]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:13:48.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:47 smithi123 ceph-mon[35438]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:13:48.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:47 smithi037 ceph-mon[30630]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:13:49.629 INFO:teuthology.orchestra.run.smithi160.stdout:Created osd(s) 8 on host 'smithi160' 2024-09-11T23:13:49.630 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:13:49.628+0000 7f921effd640 1 -- 172.21.15.160:0/484258991 <== mgr.14150 v2:172.21.15.37:6800/31543269 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f92201a08d0 con 0x7f92080a2bb0 2024-09-11T23:13:49.631 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:13:49.630+0000 7f92281e0640 1 -- 172.21.15.160:0/484258991 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f92080a2bb0 msgr2=0x7f92080a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:13:49.631 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:13:49.630+0000 7f92281e0640 1 --2- 172.21.15.160:0/484258991 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f92080a2bb0 0x7f92080a5070 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9220101b30 tx=0x7f921800d040 comp rx=0 tx=0).stop 2024-09-11T23:13:49.631 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:13:49.630+0000 7f92281e0640 1 -- 172.21.15.160:0/484258991 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9220102690 msgr2=0x7f922019f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:13:49.631 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:13:49.630+0000 7f92281e0640 1 --2- 172.21.15.160:0/484258991 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9220102690 0x7f922019f5e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f921000c970 tx=0x7f921000ce30 comp rx=0 tx=0).stop 2024-09-11T23:13:49.632 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:13:49.630+0000 7f92281e0640 1 -- 172.21.15.160:0/484258991 shutdown_connections 2024-09-11T23:13:49.632 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:13:49.630+0000 7f92281e0640 1 --2- 172.21.15.160:0/484258991 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f92080a2bb0 0x7f92080a5070 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:13:49.632 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:13:49.630+0000 7f92281e0640 1 --2- 172.21.15.160:0/484258991 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9220102690 0x7f922019f5e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:13:49.632 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:13:49.630+0000 7f92281e0640 1 --2- 172.21.15.160:0/484258991 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9220101cd0 0x7f9220198560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:13:49.632 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:13:49.630+0000 7f92281e0640 1 --2- 172.21.15.160:0/484258991 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9220100ad0 0x7f9220198020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:13:49.632 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:13:49.630+0000 7f92281e0640 1 -- 172.21.15.160:0/484258991 >> 172.21.15.160:0/484258991 conn(0x7f92200fc280 msgr2=0x7f922006a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:13:49.632 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:13:49.630+0000 7f92281e0640 1 -- 172.21.15.160:0/484258991 shutdown_connections 2024-09-11T23:13:49.632 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:13:49.630+0000 7f92281e0640 1 -- 172.21.15.160:0/484258991 wait complete. 2024-09-11T23:13:49.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:49 smithi160 ceph-mon[35055]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:13:49.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:49 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:13:49.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:49 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:13:49.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:49 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:13:49.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:49 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:13:49.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:49 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:13:50.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:49 smithi123 ceph-mon[35438]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:13:50.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:49 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:13:50.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:49 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:13:50.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:49 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:13:50.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:49 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:13:50.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:49 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:13:50.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:49 smithi037 ceph-mon[30630]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:13:50.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:49 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:13:50.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:49 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:13:50.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:49 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:13:50.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:49 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:13:50.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:49 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:13:50.309 DEBUG:teuthology.orchestra.run.smithi160:osd.8> sudo journalctl -f -n 0 -u ceph-8b03efce-7092-11ef-bcea-c7b262605968@osd.8.service 2024-09-11T23:13:50.312 INFO:tasks.cephadm:Deploying osd.9 on smithi037 with /dev/vg_nvme/lv_1... 2024-09-11T23:13:50.312 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-11T23:13:50.696 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:13:50.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:50 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:13:50.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:50 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:13:50.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:50 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:13:50.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:50 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:13:50.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:50 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:13:50.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:50 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:13:51.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:50 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:13:51.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:50 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:13:51.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:50 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:13:51.602 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:13:51 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:13:51.255+0000 7f670de88640 -1 osd.8 0 log_to_monitors true 2024-09-11T23:13:51.855 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:51 smithi160 ceph-mon[35055]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:13:51.855 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:51 smithi160 ceph-mon[35055]: from='osd.8 [v2:172.21.15.160:6816/740968584,v1:172.21.15.160:6817/740968584]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-11T23:13:51.855 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:51 smithi160 ceph-mon[35055]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-11T23:13:51.884 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:51 smithi037 ceph-mon[30630]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:13:51.884 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:51 smithi037 ceph-mon[30630]: from='osd.8 [v2:172.21.15.160:6816/740968584,v1:172.21.15.160:6817/740968584]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-11T23:13:51.884 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:51 smithi037 ceph-mon[30630]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-11T23:13:52.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:51 smithi123 ceph-mon[35438]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:13:52.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:51 smithi123 ceph-mon[35438]: from='osd.8 [v2:172.21.15.160:6816/740968584,v1:172.21.15.160:6817/740968584]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-11T23:13:52.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:51 smithi123 ceph-mon[35438]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-11T23:13:52.772 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:52 smithi160 ceph-mon[35055]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-11T23:13:52.772 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:52 smithi160 ceph-mon[35055]: osdmap e54: 9 total, 8 up, 9 in 2024-09-11T23:13:52.772 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:52 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T23:13:52.772 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:52 smithi160 ceph-mon[35055]: from='osd.8 [v2:172.21.15.160:6816/740968584,v1:172.21.15.160:6817/740968584]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-09-11T23:13:52.772 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:52 smithi160 ceph-mon[35055]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-09-11T23:13:52.891 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:52 smithi037 ceph-mon[30630]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-11T23:13:52.892 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:52 smithi037 ceph-mon[30630]: osdmap e54: 9 total, 8 up, 9 in 2024-09-11T23:13:52.892 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:52 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T23:13:52.892 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:52 smithi037 ceph-mon[30630]: from='osd.8 [v2:172.21.15.160:6816/740968584,v1:172.21.15.160:6817/740968584]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-09-11T23:13:52.892 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:52 smithi037 ceph-mon[30630]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-09-11T23:13:53.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:52 smithi123 ceph-mon[35438]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-11T23:13:53.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:52 smithi123 ceph-mon[35438]: osdmap e54: 9 total, 8 up, 9 in 2024-09-11T23:13:53.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:52 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T23:13:53.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:52 smithi123 ceph-mon[35438]: from='osd.8 [v2:172.21.15.160:6816/740968584,v1:172.21.15.160:6817/740968584]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-09-11T23:13:53.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:52 smithi123 ceph-mon[35438]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-09-11T23:13:53.434 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:13:53 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:13:53.349+0000 7f6709e0b640 -1 osd.8 0 waiting for initial osdmap 2024-09-11T23:13:53.434 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:13:53 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:13:53.358+0000 7f6701c2b640 -1 osd.8 55 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T23:13:53.815 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:53 smithi037 ceph-mon[30630]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:13:53.815 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:53 smithi037 ceph-mon[30630]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]': finished 2024-09-11T23:13:53.815 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:53 smithi037 ceph-mon[30630]: osdmap e55: 9 total, 8 up, 9 in 2024-09-11T23:13:53.815 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:53 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T23:13:53.815 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:53 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T23:13:53.815 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:53 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:13:53.815 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:53 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:13:53.815 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:53 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:13:53.815 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:53 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:13:53.815 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:53 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:13:53.815 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:53 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:13:53.816 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:53 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:13:53.816 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:53 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:13:53.816 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:53 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:13:53.816 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:53 smithi037 ceph-mon[30630]: from='osd.8 ' entity='osd.8' 2024-09-11T23:13:53.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:53 smithi160 ceph-mon[35055]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:13:53.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:53 smithi160 ceph-mon[35055]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]': finished 2024-09-11T23:13:53.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:53 smithi160 ceph-mon[35055]: osdmap e55: 9 total, 8 up, 9 in 2024-09-11T23:13:53.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:53 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T23:13:53.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:53 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T23:13:53.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:53 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:13:53.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:53 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:13:53.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:53 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:13:53.935 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:53 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:13:53.935 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:53 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:13:53.935 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:53 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:13:53.935 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:53 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:13:53.935 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:53 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:13:53.935 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:53 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:13:53.935 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:53 smithi160 ceph-mon[35055]: from='osd.8 ' entity='osd.8' 2024-09-11T23:13:54.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:53 smithi123 ceph-mon[35438]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:13:54.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:53 smithi123 ceph-mon[35438]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]': finished 2024-09-11T23:13:54.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:53 smithi123 ceph-mon[35438]: osdmap e55: 9 total, 8 up, 9 in 2024-09-11T23:13:54.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:53 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T23:13:54.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:53 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T23:13:54.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:53 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:13:54.002 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:53 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:13:54.002 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:53 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:13:54.002 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:53 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:13:54.002 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:53 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:13:54.002 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:53 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:13:54.002 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:53 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:13:54.002 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:53 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:13:54.002 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:53 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:13:54.002 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:53 smithi123 ceph-mon[35438]: from='osd.8 ' entity='osd.8' 2024-09-11T23:13:54.370 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:13:54.402 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi037:vg_nvme/lv_1 2024-09-11T23:13:54.786 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:13:54.926 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:54 smithi037 ceph-mon[30630]: purged_snaps scrub starts 2024-09-11T23:13:54.926 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:54 smithi037 ceph-mon[30630]: purged_snaps scrub ok 2024-09-11T23:13:54.926 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:54 smithi037 ceph-mon[30630]: Detected new or changed devices on smithi160 2024-09-11T23:13:54.926 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:54 smithi037 ceph-mon[30630]: Adjusting osd_memory_target on smithi160 to 5696M 2024-09-11T23:13:54.926 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:54 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T23:13:54.926 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:54 smithi037 ceph-mon[30630]: osd.8 [v2:172.21.15.160:6816/740968584,v1:172.21.15.160:6817/740968584] boot 2024-09-11T23:13:54.926 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:54 smithi037 ceph-mon[30630]: osdmap e56: 9 total, 9 up, 9 in 2024-09-11T23:13:54.926 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:54 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T23:13:54.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:54 smithi160 ceph-mon[35055]: purged_snaps scrub starts 2024-09-11T23:13:54.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:54 smithi160 ceph-mon[35055]: purged_snaps scrub ok 2024-09-11T23:13:54.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:54 smithi160 ceph-mon[35055]: Detected new or changed devices on smithi160 2024-09-11T23:13:54.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:54 smithi160 ceph-mon[35055]: Adjusting osd_memory_target on smithi160 to 5696M 2024-09-11T23:13:54.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:54 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T23:13:54.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:54 smithi160 ceph-mon[35055]: osd.8 [v2:172.21.15.160:6816/740968584,v1:172.21.15.160:6817/740968584] boot 2024-09-11T23:13:54.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:54 smithi160 ceph-mon[35055]: osdmap e56: 9 total, 9 up, 9 in 2024-09-11T23:13:54.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:54 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T23:13:55.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:54 smithi123 ceph-mon[35438]: purged_snaps scrub starts 2024-09-11T23:13:55.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:54 smithi123 ceph-mon[35438]: purged_snaps scrub ok 2024-09-11T23:13:55.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:54 smithi123 ceph-mon[35438]: Detected new or changed devices on smithi160 2024-09-11T23:13:55.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:54 smithi123 ceph-mon[35438]: Adjusting osd_memory_target on smithi160 to 5696M 2024-09-11T23:13:55.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:54 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T23:13:55.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:54 smithi123 ceph-mon[35438]: osd.8 [v2:172.21.15.160:6816/740968584,v1:172.21.15.160:6817/740968584] boot 2024-09-11T23:13:55.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:54 smithi123 ceph-mon[35438]: osdmap e56: 9 total, 9 up, 9 in 2024-09-11T23:13:55.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:54 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T23:13:55.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:13:55.551+0000 7f9c9be00640 1 -- 172.21.15.37:0/700829056 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c9c076220 msgr2=0x7f9c9c074680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:13:55.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:13:55.551+0000 7f9c9be00640 1 --2- 172.21.15.37:0/700829056 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c9c076220 0x7f9c9c074680 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9c8c009900 tx=0x7f9c8c02a410 comp rx=0 tx=0).stop 2024-09-11T23:13:55.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:13:55.551+0000 7f9c9be00640 1 -- 172.21.15.37:0/700829056 shutdown_connections 2024-09-11T23:13:55.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:13:55.551+0000 7f9c9be00640 1 --2- 172.21.15.37:0/700829056 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9c9c10e020 0x7f9c9c110410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:13:55.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:13:55.551+0000 7f9c9be00640 1 --2- 172.21.15.37:0/700829056 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9c9c074c50 0x7f9c9c0750b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:13:55.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:13:55.551+0000 7f9c9be00640 1 --2- 172.21.15.37:0/700829056 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c9c076220 0x7f9c9c074680 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:13:55.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:13:55.551+0000 7f9c9be00640 1 -- 172.21.15.37:0/700829056 >> 172.21.15.37:0/700829056 conn(0x7f9c9c0fd1f0 msgr2=0x7f9c9c0ff610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:13:55.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:13:55.551+0000 7f9c9be00640 1 -- 172.21.15.37:0/700829056 shutdown_connections 2024-09-11T23:13:55.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:13:55.551+0000 7f9c9be00640 1 -- 172.21.15.37:0/700829056 wait complete. 2024-09-11T23:13:55.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:13:55.552+0000 7f9c9be00640 1 Processor -- start 2024-09-11T23:13:55.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:13:55.552+0000 7f9c9be00640 1 -- start start 2024-09-11T23:13:55.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:13:55.553+0000 7f9c9be00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9c9c074c50 0x7f9c9c19e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:13:55.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:13:55.553+0000 7f9c9be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c9c076220 0x7f9c9c19e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:13:55.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:13:55.553+0000 7f9c9be00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9c9c10e020 0x7f9c9c1a5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:13:55.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:13:55.553+0000 7f9c9be00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9c9c113ce0 con 0x7f9c9c076220 2024-09-11T23:13:55.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:13:55.553+0000 7f9c9be00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f9c9c113b60 con 0x7f9c9c074c50 2024-09-11T23:13:55.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:13:55.553+0000 7f9c9be00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f9c9c113e60 con 0x7f9c9c10e020 2024-09-11T23:13:55.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:13:55.553+0000 7f9c93e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c9c076220 0x7f9c9c19e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:13:55.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:13:55.553+0000 7f9c9aa00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9c9c074c50 0x7f9c9c19e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:13:55.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:13:55.553+0000 7f9c9b400640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9c9c10e020 0x7f9c9c1a5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:13:55.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:13:55.553+0000 7f9c9aa00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9c9c074c50 0x7f9c9c19e2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.37:56108/0 (socket says 172.21.15.37:56108) 2024-09-11T23:13:55.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:13:55.553+0000 7f9c93e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c9c076220 0x7f9c9c19e800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38802/0 (socket says 172.21.15.37:38802) 2024-09-11T23:13:55.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:13:55.553+0000 7f9c9aa00640 1 -- 172.21.15.37:0/2472420131 learned_addr learned my addr 172.21.15.37:0/2472420131 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:13:55.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:13:55.553+0000 7f9c9b400640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9c9c10e020 0x7f9c9c1a5880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.37:57178/0 (socket says 172.21.15.37:57178) 2024-09-11T23:13:55.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:13:55.553+0000 7f9c9b400640 1 -- 172.21.15.37:0/2472420131 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9c9c074c50 msgr2=0x7f9c9c19e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:13:55.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:13:55.553+0000 7f9c9b400640 1 --2- 172.21.15.37:0/2472420131 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9c9c074c50 0x7f9c9c19e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:13:55.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:13:55.553+0000 7f9c9b400640 1 -- 172.21.15.37:0/2472420131 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c9c076220 msgr2=0x7f9c9c19e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:13:55.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:13:55.553+0000 7f9c9b400640 1 --2- 172.21.15.37:0/2472420131 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c9c076220 0x7f9c9c19e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:13:55.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:13:55.553+0000 7f9c9b400640 1 -- 172.21.15.37:0/2472420131 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c9c1a5ef0 con 0x7f9c9c10e020 2024-09-11T23:13:55.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:13:55.554+0000 7f9c9b400640 1 --2- 172.21.15.37:0/2472420131 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9c9c10e020 0x7f9c9c1a5880 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9c94009fd0 tx=0x7f9c9400ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:13:55.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:13:55.554+0000 7f9c93400640 1 -- 172.21.15.37:0/2472420131 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c9400ce20 con 0x7f9c9c10e020 2024-09-11T23:13:55.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:13:55.554+0000 7f9c9be00640 1 -- 172.21.15.37:0/2472420131 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c9c1a61e0 con 0x7f9c9c10e020 2024-09-11T23:13:55.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:13:55.554+0000 7f9c93400640 1 -- 172.21.15.37:0/2472420131 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c94005020 con 0x7f9c9c10e020 2024-09-11T23:13:55.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:13:55.554+0000 7f9c93400640 1 -- 172.21.15.37:0/2472420131 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c94010720 con 0x7f9c9c10e020 2024-09-11T23:13:55.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:13:55.554+0000 7f9c9be00640 1 -- 172.21.15.37:0/2472420131 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c9c1a6720 con 0x7f9c9c10e020 2024-09-11T23:13:55.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:13:55.555+0000 7f9c9be00640 1 -- 172.21.15.37:0/2472420131 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c9c1040d0 con 0x7f9c9c10e020 2024-09-11T23:13:55.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:13:55.557+0000 7f9c93400640 1 -- 172.21.15.37:0/2472420131 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f9c94005540 con 0x7f9c9c10e020 2024-09-11T23:13:55.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:13:55.558+0000 7f9c93400640 1 --2- 172.21.15.37:0/2472420131 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f9c800a2c30 0x7f9c800a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:13:55.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:13:55.559+0000 7f9c93400640 1 -- 172.21.15.37:0/2472420131 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5858+0+0 (secure 0 0 0) 0x7f9c940cecf0 con 0x7f9c9c10e020 2024-09-11T23:13:55.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:13:55.559+0000 7f9c9aa00640 1 --2- 172.21.15.37:0/2472420131 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f9c800a2c30 0x7f9c800a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:13:55.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:13:55.559+0000 7f9c9aa00640 1 --2- 172.21.15.37:0/2472420131 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f9c800a2c30 0x7f9c800a50f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9c8c000c00 tx=0x7f9c8c0046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:13:55.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:13:55.560+0000 7f9c93400640 1 -- 172.21.15.37:0/2472420131 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9c9409c540 con 0x7f9c9c10e020 2024-09-11T23:13:55.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:13:55.756+0000 7f9c9be00640 1 -- 172.21.15.37:0/2472420131 --> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f9c9c062630 con 0x7f9c800a2c30 2024-09-11T23:13:55.757 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:55 smithi037 ceph-mon[30630]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:13:55.758 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:55 smithi037 ceph-mon[30630]: osdmap e57: 9 total, 9 up, 9 in 2024-09-11T23:13:55.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:55 smithi160 ceph-mon[35055]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:13:55.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:55 smithi160 ceph-mon[35055]: osdmap e57: 9 total, 9 up, 9 in 2024-09-11T23:13:56.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:55 smithi123 ceph-mon[35438]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:13:56.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:55 smithi123 ceph-mon[35438]: osdmap e57: 9 total, 9 up, 9 in 2024-09-11T23:13:56.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:56 smithi160 ceph-mon[35055]: osdmap e58: 9 total, 9 up, 9 in 2024-09-11T23:13:56.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:56 smithi160 ceph-mon[35055]: from='client.24331 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:13:56.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:56 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:13:56.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:56 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:13:56.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:56 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:13:57.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:56 smithi123 ceph-mon[35438]: osdmap e58: 9 total, 9 up, 9 in 2024-09-11T23:13:57.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:56 smithi123 ceph-mon[35438]: from='client.24331 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:13:57.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:56 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:13:57.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:56 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:13:57.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:56 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:13:57.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:56 smithi037 ceph-mon[30630]: osdmap e58: 9 total, 9 up, 9 in 2024-09-11T23:13:57.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:56 smithi037 ceph-mon[30630]: from='client.24331 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:13:57.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:56 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:13:57.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:56 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:13:57.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:56 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:13:57.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:57 smithi160 ceph-mon[35055]: pgmap v200: 1 pgs: 1 remapped+peering; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-09-11T23:13:57.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:57 smithi160 ceph-mon[35055]: osdmap e59: 9 total, 9 up, 9 in 2024-09-11T23:13:57.994 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:57 smithi037 ceph-mon[30630]: pgmap v200: 1 pgs: 1 remapped+peering; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-09-11T23:13:57.994 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:57 smithi037 ceph-mon[30630]: osdmap e59: 9 total, 9 up, 9 in 2024-09-11T23:13:58.000 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:57 smithi123 ceph-mon[35438]: pgmap v200: 1 pgs: 1 remapped+peering; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-09-11T23:13:58.000 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:57 smithi123 ceph-mon[35438]: osdmap e59: 9 total, 9 up, 9 in 2024-09-11T23:13:59.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:58 smithi123 ceph-mon[35438]: osdmap e60: 9 total, 9 up, 9 in 2024-09-11T23:13:59.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:58 smithi037 ceph-mon[30630]: osdmap e60: 9 total, 9 up, 9 in 2024-09-11T23:13:59.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:58 smithi160 ceph-mon[35055]: osdmap e60: 9 total, 9 up, 9 in 2024-09-11T23:13:59.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:59 smithi037 ceph-mon[30630]: pgmap v203: 1 pgs: 1 remapped+peering; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-09-11T23:13:59.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:59 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/1482876868' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bcd19bd4-88bc-46f7-b48c-af9e3d17aa96"}]: dispatch 2024-09-11T23:13:59.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:59 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/1482876868' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bcd19bd4-88bc-46f7-b48c-af9e3d17aa96"}]': finished 2024-09-11T23:13:59.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:59 smithi037 ceph-mon[30630]: osdmap e61: 10 total, 9 up, 10 in 2024-09-11T23:13:59.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:13:59 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T23:14:00.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:59 smithi123 ceph-mon[35438]: pgmap v203: 1 pgs: 1 remapped+peering; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-09-11T23:14:00.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:59 smithi123 ceph-mon[35438]: from='client.? 172.21.15.37:0/1482876868' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bcd19bd4-88bc-46f7-b48c-af9e3d17aa96"}]: dispatch 2024-09-11T23:14:00.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:59 smithi123 ceph-mon[35438]: from='client.? 172.21.15.37:0/1482876868' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bcd19bd4-88bc-46f7-b48c-af9e3d17aa96"}]': finished 2024-09-11T23:14:00.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:59 smithi123 ceph-mon[35438]: osdmap e61: 10 total, 9 up, 10 in 2024-09-11T23:14:00.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:13:59 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T23:14:00.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:59 smithi160 ceph-mon[35055]: pgmap v203: 1 pgs: 1 remapped+peering; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-09-11T23:14:00.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:59 smithi160 ceph-mon[35055]: from='client.? 172.21.15.37:0/1482876868' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bcd19bd4-88bc-46f7-b48c-af9e3d17aa96"}]: dispatch 2024-09-11T23:14:00.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:59 smithi160 ceph-mon[35055]: from='client.? 172.21.15.37:0/1482876868' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bcd19bd4-88bc-46f7-b48c-af9e3d17aa96"}]': finished 2024-09-11T23:14:00.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:59 smithi160 ceph-mon[35055]: osdmap e61: 10 total, 9 up, 10 in 2024-09-11T23:14:00.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:13:59 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T23:14:01.000 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:00 smithi123 ceph-mon[35438]: from='client.? 172.21.15.37:0/1852268663' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:14:01.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:00 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/1852268663' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:14:01.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:00 smithi160 ceph-mon[35055]: from='client.? 172.21.15.37:0/1852268663' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:14:02.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:01 smithi123 ceph-mon[35438]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 133 KiB/s, 0 objects/s recovering 2024-09-11T23:14:02.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:01 smithi037 ceph-mon[30630]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 133 KiB/s, 0 objects/s recovering 2024-09-11T23:14:02.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:01 smithi160 ceph-mon[35055]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 133 KiB/s, 0 objects/s recovering 2024-09-11T23:14:04.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:03 smithi123 ceph-mon[35438]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-11T23:14:04.037 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:03 smithi037 ceph-mon[30630]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-11T23:14:04.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:03 smithi160 ceph-mon[35055]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-11T23:14:06.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:05 smithi123 ceph-mon[35438]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-09-11T23:14:06.028 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:05 smithi037 ceph-mon[30630]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-09-11T23:14:06.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:05 smithi160 ceph-mon[35055]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-09-11T23:14:07.758 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:07 smithi037 ceph-mon[30630]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-09-11T23:14:07.986 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:07 smithi160 ceph-mon[35055]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-09-11T23:14:08.000 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:07 smithi123 ceph-mon[35438]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-09-11T23:14:10.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:09 smithi123 ceph-mon[35438]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-11T23:14:10.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:09 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-11T23:14:10.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:09 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:14:10.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:09 smithi123 ceph-mon[35438]: Deploying daemon osd.9 on smithi037 2024-09-11T23:14:10.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:09 smithi037 ceph-mon[30630]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-11T23:14:10.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:09 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-11T23:14:10.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:09 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:14:10.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:09 smithi037 ceph-mon[30630]: Deploying daemon osd.9 on smithi037 2024-09-11T23:14:10.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:09 smithi160 ceph-mon[35055]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-11T23:14:10.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:09 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-11T23:14:10.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:09 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:14:10.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:09 smithi160 ceph-mon[35055]: Deploying daemon osd.9 on smithi037 2024-09-11T23:14:11.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:11 smithi037 ceph-mon[30630]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-11T23:14:12.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:11 smithi123 ceph-mon[35438]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-11T23:14:12.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:11 smithi160 ceph-mon[35055]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-11T23:14:13.815 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:13 smithi037 ceph-mon[30630]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-11T23:14:14.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:13 smithi123 ceph-mon[35438]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-11T23:14:14.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:13 smithi160 ceph-mon[35055]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-11T23:14:16.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:15 smithi123 ceph-mon[35438]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-11T23:14:16.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:15 smithi037 ceph-mon[30630]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-11T23:14:16.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:15 smithi160 ceph-mon[35055]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-11T23:14:17.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:16 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:14:17.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:16 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:14:17.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:16 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:14:17.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:16 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:14:17.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:16 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:14:17.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:16 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:14:17.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:16 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:14:17.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:16 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:14:17.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:16 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:14:17.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:17 smithi037 ceph-mon[30630]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-11T23:14:18.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:17 smithi123 ceph-mon[35438]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-11T23:14:18.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:17 smithi160 ceph-mon[35055]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-11T23:14:20.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:19 smithi123 ceph-mon[35438]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-11T23:14:20.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:19 smithi037 ceph-mon[30630]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-11T23:14:20.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:19 smithi160 ceph-mon[35055]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-11T23:14:20.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:14:20.971+0000 7f9c93400640 1 -- 172.21.15.37:0/2472420131 <== mgr.14150 v2:172.21.15.37:6800/31543269 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f9c9c062630 con 0x7f9c800a2c30 2024-09-11T23:14:20.972 INFO:teuthology.orchestra.run.smithi037.stdout:Created osd(s) 9 on host 'smithi037' 2024-09-11T23:14:20.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:14:20.974+0000 7f9c9be00640 1 -- 172.21.15.37:0/2472420131 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f9c800a2c30 msgr2=0x7f9c800a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:14:20.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:14:20.974+0000 7f9c9be00640 1 --2- 172.21.15.37:0/2472420131 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f9c800a2c30 0x7f9c800a50f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9c8c000c00 tx=0x7f9c8c0046c0 comp rx=0 tx=0).stop 2024-09-11T23:14:20.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:14:20.974+0000 7f9c9be00640 1 -- 172.21.15.37:0/2472420131 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9c9c10e020 msgr2=0x7f9c9c1a5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:14:20.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:14:20.974+0000 7f9c9be00640 1 --2- 172.21.15.37:0/2472420131 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9c9c10e020 0x7f9c9c1a5880 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9c94009fd0 tx=0x7f9c9400ef10 comp rx=0 tx=0).stop 2024-09-11T23:14:20.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:14:20.974+0000 7f9c9be00640 1 -- 172.21.15.37:0/2472420131 shutdown_connections 2024-09-11T23:14:20.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:14:20.974+0000 7f9c9be00640 1 --2- 172.21.15.37:0/2472420131 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f9c800a2c30 0x7f9c800a50f0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:14:20.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:14:20.974+0000 7f9c9be00640 1 --2- 172.21.15.37:0/2472420131 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9c9c10e020 0x7f9c9c1a5880 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:14:20.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:14:20.974+0000 7f9c9be00640 1 --2- 172.21.15.37:0/2472420131 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c9c076220 0x7f9c9c19e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:14:20.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:14:20.974+0000 7f9c9be00640 1 --2- 172.21.15.37:0/2472420131 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9c9c074c50 0x7f9c9c19e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:14:20.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:14:20.974+0000 7f9c9be00640 1 -- 172.21.15.37:0/2472420131 >> 172.21.15.37:0/2472420131 conn(0x7f9c9c0fd1f0 msgr2=0x7f9c9c1012a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:14:20.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:14:20.974+0000 7f9c9be00640 1 -- 172.21.15.37:0/2472420131 shutdown_connections 2024-09-11T23:14:20.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:14:20.974+0000 7f9c9be00640 1 -- 172.21.15.37:0/2472420131 wait complete. 2024-09-11T23:14:21.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:20 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:14:21.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:20 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:14:21.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:20 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:14:21.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:20 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:14:21.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:20 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:14:21.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:20 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:14:21.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:20 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:14:21.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:20 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:14:21.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:20 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:14:21.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:20 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:14:21.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:20 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:14:21.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:20 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:14:21.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:20 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:14:21.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:20 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:14:21.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:20 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:14:21.842 DEBUG:teuthology.orchestra.run.smithi037:osd.9> sudo journalctl -f -n 0 -u ceph-8b03efce-7092-11ef-bcea-c7b262605968@osd.9.service 2024-09-11T23:14:21.846 INFO:tasks.cephadm:Deploying osd.10 on smithi123 with /dev/vg_nvme/lv_1... 2024-09-11T23:14:21.846 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-11T23:14:22.045 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:21 smithi037 ceph-mon[30630]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-11T23:14:22.045 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:21 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:14:22.045 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:21 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:14:22.046 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:21 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:14:22.100 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T23:14:22.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:21 smithi160 ceph-mon[35055]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-11T23:14:22.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:21 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:14:22.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:21 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:14:22.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:21 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:14:22.220 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:21 smithi123 ceph-mon[35438]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-11T23:14:22.220 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:21 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:14:22.220 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:21 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:14:22.220 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:21 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:14:23.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:22 smithi037 ceph-mon[30630]: from='osd.9 [v2:172.21.15.37:6826/692114850,v1:172.21.15.37:6827/692114850]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-11T23:14:23.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:22 smithi037 ceph-mon[30630]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-11T23:14:23.065 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:14:22 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:14:22.805+0000 7f2f1ac30640 -1 osd.9 0 log_to_monitors true 2024-09-11T23:14:23.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:22 smithi160 ceph-mon[35055]: from='osd.9 [v2:172.21.15.37:6826/692114850,v1:172.21.15.37:6827/692114850]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-11T23:14:23.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:22 smithi160 ceph-mon[35055]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-11T23:14:23.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:22 smithi123 ceph-mon[35438]: from='osd.9 [v2:172.21.15.37:6826/692114850,v1:172.21.15.37:6827/692114850]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-11T23:14:23.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:22 smithi123 ceph-mon[35438]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-11T23:14:24.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:23 smithi123 ceph-mon[35438]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-11T23:14:24.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:23 smithi123 ceph-mon[35438]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-11T23:14:24.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:23 smithi123 ceph-mon[35438]: osdmap e62: 10 total, 9 up, 10 in 2024-09-11T23:14:24.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:23 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T23:14:24.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:23 smithi123 ceph-mon[35438]: from='osd.9 [v2:172.21.15.37:6826/692114850,v1:172.21.15.37:6827/692114850]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]: dispatch 2024-09-11T23:14:24.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:23 smithi123 ceph-mon[35438]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]: dispatch 2024-09-11T23:14:24.065 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:14:23 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:14:23.904+0000 7f2f15400640 -1 osd.9 0 waiting for initial osdmap 2024-09-11T23:14:24.065 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:14:23 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:14:23.924+0000 7f2f10400640 -1 osd.9 63 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T23:14:24.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:23 smithi037 ceph-mon[30630]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-11T23:14:24.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:23 smithi037 ceph-mon[30630]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-11T23:14:24.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:23 smithi037 ceph-mon[30630]: osdmap e62: 10 total, 9 up, 10 in 2024-09-11T23:14:24.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:23 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T23:14:24.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:23 smithi037 ceph-mon[30630]: from='osd.9 [v2:172.21.15.37:6826/692114850,v1:172.21.15.37:6827/692114850]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]: dispatch 2024-09-11T23:14:24.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:23 smithi037 ceph-mon[30630]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]: dispatch 2024-09-11T23:14:24.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:23 smithi160 ceph-mon[35055]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-11T23:14:24.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:23 smithi160 ceph-mon[35055]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-11T23:14:24.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:23 smithi160 ceph-mon[35055]: osdmap e62: 10 total, 9 up, 10 in 2024-09-11T23:14:24.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:23 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T23:14:24.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:23 smithi160 ceph-mon[35055]: from='osd.9 [v2:172.21.15.37:6826/692114850,v1:172.21.15.37:6827/692114850]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]: dispatch 2024-09-11T23:14:24.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:23 smithi160 ceph-mon[35055]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]: dispatch 2024-09-11T23:14:24.841 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-11T23:14:24.866 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi123:vg_nvme/lv_1 2024-09-11T23:14:25.120 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T23:14:25.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:24 smithi160 ceph-mon[35055]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2024-09-11T23:14:25.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:24 smithi160 ceph-mon[35055]: osdmap e63: 10 total, 9 up, 10 in 2024-09-11T23:14:25.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:24 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T23:14:25.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:24 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T23:14:25.240 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:24 smithi123 ceph-mon[35438]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2024-09-11T23:14:25.240 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:24 smithi123 ceph-mon[35438]: osdmap e63: 10 total, 9 up, 10 in 2024-09-11T23:14:25.241 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:24 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T23:14:25.241 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:24 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T23:14:25.294 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:24 smithi037 ceph-mon[30630]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2024-09-11T23:14:25.294 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:24 smithi037 ceph-mon[30630]: osdmap e63: 10 total, 9 up, 10 in 2024-09-11T23:14:25.294 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:24 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T23:14:25.294 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:24 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T23:14:25.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:14:25.616+0000 7fb7068f4640 1 -- 172.21.15.123:0/3342703213 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb700101c00 msgr2=0x7fb700102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:14:25.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:14:25.616+0000 7fb7068f4640 1 --2- 172.21.15.123:0/3342703213 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb700101c00 0x7fb700102000 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb6f0009900 tx=0x7fb6f002a410 comp rx=0 tx=0).stop 2024-09-11T23:14:25.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:14:25.616+0000 7fb7068f4640 1 -- 172.21.15.123:0/3342703213 shutdown_connections 2024-09-11T23:14:25.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:14:25.616+0000 7fb7068f4640 1 --2- 172.21.15.123:0/3342703213 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7001037c0 0x7fb70010a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:14:25.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:14:25.616+0000 7fb7068f4640 1 --2- 172.21.15.123:0/3342703213 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb700102e00 0x7fb700103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:14:25.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:14:25.616+0000 7fb7068f4640 1 --2- 172.21.15.123:0/3342703213 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb700101c00 0x7fb700102000 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:14:25.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:14:25.616+0000 7fb7068f4640 1 -- 172.21.15.123:0/3342703213 >> 172.21.15.123:0/3342703213 conn(0x7fb7000fd390 msgr2=0x7fb7000ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:14:25.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:14:25.616+0000 7fb7068f4640 1 -- 172.21.15.123:0/3342703213 shutdown_connections 2024-09-11T23:14:25.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:14:25.616+0000 7fb7068f4640 1 -- 172.21.15.123:0/3342703213 wait complete. 2024-09-11T23:14:25.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:14:25.617+0000 7fb7068f4640 1 Processor -- start 2024-09-11T23:14:25.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:14:25.617+0000 7fb7068f4640 1 -- start start 2024-09-11T23:14:25.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:14:25.617+0000 7fb7068f4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb700101c00 0x7fb700075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:14:25.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:14:25.617+0000 7fb7068f4640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb700102e00 0x7fb7000745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:14:25.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:14:25.617+0000 7fb7068f4640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb7001037c0 0x7fb700074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:14:25.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:14:25.617+0000 7fb7068f4640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb70010d880 con 0x7fb700101c00 2024-09-11T23:14:25.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:14:25.617+0000 7fb7068f4640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fb70010d700 con 0x7fb700102e00 2024-09-11T23:14:25.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:14:25.617+0000 7fb7068f4640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fb70010da00 con 0x7fb7001037c0 2024-09-11T23:14:25.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:14:25.617+0000 7fb6ff7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb700102e00 0x7fb7000745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:14:25.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:14:25.617+0000 7fb6ff7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb700102e00 0x7fb7000745e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:43598/0 (socket says 172.21.15.123:43598) 2024-09-11T23:14:25.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:14:25.617+0000 7fb6ff7fe640 1 -- 172.21.15.123:0/2660338162 learned_addr learned my addr 172.21.15.123:0/2660338162 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-11T23:14:25.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:14:25.618+0000 7fb704e91640 1 --2- 172.21.15.123:0/2660338162 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb7001037c0 0x7fb700074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:14:25.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:14:25.618+0000 7fb6ff7fe640 1 -- 172.21.15.123:0/2660338162 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb7001037c0 msgr2=0x7fb700074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:14:25.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:14:25.618+0000 7fb6ff7fe640 1 --2- 172.21.15.123:0/2660338162 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb7001037c0 0x7fb700074b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:14:25.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:14:25.618+0000 7fb6ff7fe640 1 -- 172.21.15.123:0/2660338162 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb700101c00 msgr2=0x7fb700075f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:14:25.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:14:25.618+0000 7fb6ff7fe640 1 --2- 172.21.15.123:0/2660338162 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb700101c00 0x7fb700075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:14:25.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:14:25.618+0000 7fb6ff7fe640 1 -- 172.21.15.123:0/2660338162 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7000753e0 con 0x7fb700102e00 2024-09-11T23:14:25.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:14:25.618+0000 7fb704e91640 1 --2- 172.21.15.123:0/2660338162 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb7001037c0 0x7fb700074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:14:25.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:14:25.618+0000 7fb6ff7fe640 1 --2- 172.21.15.123:0/2660338162 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb700102e00 0x7fb7000745e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb6f400d770 tx=0x7fb6f400dc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:14:25.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:14:25.618+0000 7fb6fd7fa640 1 -- 172.21.15.123:0/2660338162 <== mon.2 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6f4017070 con 0x7fb700102e00 2024-09-11T23:14:25.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:14:25.618+0000 7fb7068f4640 1 -- 172.21.15.123:0/2660338162 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7001a20a0 con 0x7fb700102e00 2024-09-11T23:14:25.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:14:25.618+0000 7fb6fd7fa640 1 -- 172.21.15.123:0/2660338162 <== mon.2 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb6f4005500 con 0x7fb700102e00 2024-09-11T23:14:25.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:14:25.618+0000 7fb6fd7fa640 1 -- 172.21.15.123:0/2660338162 <== mon.2 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6f4004e00 con 0x7fb700102e00 2024-09-11T23:14:25.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:14:25.618+0000 7fb7068f4640 1 -- 172.21.15.123:0/2660338162 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7001a2560 con 0x7fb700102e00 2024-09-11T23:14:25.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:14:25.619+0000 7fb7068f4640 1 -- 172.21.15.123:0/2660338162 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb700108ff0 con 0x7fb700102e00 2024-09-11T23:14:25.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:14:25.620+0000 7fb6fd7fa640 1 -- 172.21.15.123:0/2660338162 <== mon.2 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fb6f4004fa0 con 0x7fb700102e00 2024-09-11T23:14:25.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:14:25.621+0000 7fb6fd7fa640 1 --2- 172.21.15.123:0/2660338162 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fb6e80a2b80 0x7fb6e80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:14:25.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:14:25.621+0000 7fb6fd7fa640 1 -- 172.21.15.123:0/2660338162 <== mon.2 v2:172.21.15.123:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6261+0+0 (secure 0 0 0) 0x7fb6f40ce6d0 con 0x7fb700102e00 2024-09-11T23:14:25.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:14:25.621+0000 7fb6fffff640 1 --2- 172.21.15.123:0/2660338162 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fb6e80a2b80 0x7fb6e80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:14:25.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:14:25.622+0000 7fb6fffff640 1 --2- 172.21.15.123:0/2660338162 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fb6e80a2b80 0x7fb6e80a5040 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb6f00096c0 tx=0x7fb6f0031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:14:25.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:14:25.624+0000 7fb6fd7fa640 1 -- 172.21.15.123:0/2660338162 <== mon.2 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb6f409be30 con 0x7fb700102e00 2024-09-11T23:14:25.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:14:25.801+0000 7fb7068f4640 1 -- 172.21.15.123:0/2660338162 --> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi123:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fb700062630 con 0x7fb6e80a2b80 2024-09-11T23:14:26.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:25 smithi037 ceph-mon[30630]: purged_snaps scrub starts 2024-09-11T23:14:26.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:25 smithi037 ceph-mon[30630]: purged_snaps scrub ok 2024-09-11T23:14:26.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:25 smithi037 ceph-mon[30630]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-11T23:14:26.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:25 smithi037 ceph-mon[30630]: osd.9 [v2:172.21.15.37:6826/692114850,v1:172.21.15.37:6827/692114850] boot 2024-09-11T23:14:26.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:25 smithi037 ceph-mon[30630]: osdmap e64: 10 total, 10 up, 10 in 2024-09-11T23:14:26.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:25 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T23:14:26.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:25 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:14:26.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:25 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:14:26.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:25 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:14:26.066 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:25 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:14:26.066 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:25 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:14:26.066 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:25 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:14:26.066 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:25 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:14:26.066 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:25 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:14:26.066 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:25 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:14:26.066 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:25 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:14:26.066 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:25 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:14:26.066 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:25 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:14:26.066 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:25 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:14:26.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:25 smithi160 ceph-mon[35055]: purged_snaps scrub starts 2024-09-11T23:14:26.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:25 smithi160 ceph-mon[35055]: purged_snaps scrub ok 2024-09-11T23:14:26.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:25 smithi160 ceph-mon[35055]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-11T23:14:26.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:25 smithi160 ceph-mon[35055]: osd.9 [v2:172.21.15.37:6826/692114850,v1:172.21.15.37:6827/692114850] boot 2024-09-11T23:14:26.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:25 smithi160 ceph-mon[35055]: osdmap e64: 10 total, 10 up, 10 in 2024-09-11T23:14:26.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:25 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T23:14:26.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:25 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:14:26.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:25 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:14:26.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:25 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:14:26.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:25 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:14:26.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:25 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:14:26.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:25 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:14:26.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:25 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:14:26.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:25 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:14:26.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:25 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:14:26.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:25 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:14:26.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:25 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:14:26.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:25 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:14:26.186 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:25 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:14:26.209 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:25 smithi123 ceph-mon[35438]: purged_snaps scrub starts 2024-09-11T23:14:26.209 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:25 smithi123 ceph-mon[35438]: purged_snaps scrub ok 2024-09-11T23:14:26.209 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:25 smithi123 ceph-mon[35438]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-11T23:14:26.209 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:25 smithi123 ceph-mon[35438]: osd.9 [v2:172.21.15.37:6826/692114850,v1:172.21.15.37:6827/692114850] boot 2024-09-11T23:14:26.209 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:25 smithi123 ceph-mon[35438]: osdmap e64: 10 total, 10 up, 10 in 2024-09-11T23:14:26.209 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:25 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T23:14:26.209 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:25 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:14:26.209 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:25 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:14:26.209 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:25 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:14:26.210 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:25 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:14:26.210 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:25 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:14:26.210 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:25 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:14:26.210 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:25 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:14:26.210 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:25 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:14:26.210 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:25 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:14:26.210 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:25 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:14:26.210 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:25 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:14:26.210 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:25 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:14:26.210 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:25 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:14:27.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:26 smithi160 ceph-mon[35055]: Detected new or changed devices on smithi037 2024-09-11T23:14:27.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:26 smithi160 ceph-mon[35055]: Adjusting osd_memory_target on smithi037 to 4273M 2024-09-11T23:14:27.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:26 smithi160 ceph-mon[35055]: from='client.24359 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi123:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:14:27.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:26 smithi123 ceph-mon[35438]: Detected new or changed devices on smithi037 2024-09-11T23:14:27.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:26 smithi123 ceph-mon[35438]: Adjusting osd_memory_target on smithi037 to 4273M 2024-09-11T23:14:27.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:26 smithi123 ceph-mon[35438]: from='client.24359 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi123:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:14:27.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:26 smithi037 ceph-mon[30630]: Detected new or changed devices on smithi037 2024-09-11T23:14:27.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:26 smithi037 ceph-mon[30630]: Adjusting osd_memory_target on smithi037 to 4273M 2024-09-11T23:14:27.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:26 smithi037 ceph-mon[30630]: from='client.24359 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi123:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:14:27.928 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:27 smithi123 ceph-mon[35438]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:14:27.929 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:27 smithi123 ceph-mon[35438]: osdmap e65: 10 total, 10 up, 10 in 2024-09-11T23:14:28.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:27 smithi160 ceph-mon[35055]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:14:28.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:27 smithi160 ceph-mon[35055]: osdmap e65: 10 total, 10 up, 10 in 2024-09-11T23:14:28.316 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:27 smithi037 ceph-mon[30630]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:14:28.317 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:27 smithi037 ceph-mon[30630]: osdmap e65: 10 total, 10 up, 10 in 2024-09-11T23:14:29.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:28 smithi160 ceph-mon[35055]: from='client.? 172.21.15.123:0/885397446' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9e956e6c-c28a-4a4c-b385-c458788858ed"}]: dispatch 2024-09-11T23:14:29.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:28 smithi160 ceph-mon[35055]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9e956e6c-c28a-4a4c-b385-c458788858ed"}]: dispatch 2024-09-11T23:14:29.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:28 smithi160 ceph-mon[35055]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9e956e6c-c28a-4a4c-b385-c458788858ed"}]': finished 2024-09-11T23:14:29.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:28 smithi160 ceph-mon[35055]: osdmap e66: 11 total, 10 up, 11 in 2024-09-11T23:14:29.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:28 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T23:14:29.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:28 smithi123 ceph-mon[35438]: from='client.? 172.21.15.123:0/885397446' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9e956e6c-c28a-4a4c-b385-c458788858ed"}]: dispatch 2024-09-11T23:14:29.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:28 smithi123 ceph-mon[35438]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9e956e6c-c28a-4a4c-b385-c458788858ed"}]: dispatch 2024-09-11T23:14:29.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:28 smithi123 ceph-mon[35438]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9e956e6c-c28a-4a4c-b385-c458788858ed"}]': finished 2024-09-11T23:14:29.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:28 smithi123 ceph-mon[35438]: osdmap e66: 11 total, 10 up, 11 in 2024-09-11T23:14:29.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:28 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T23:14:29.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:28 smithi037 ceph-mon[30630]: from='client.? 172.21.15.123:0/885397446' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9e956e6c-c28a-4a4c-b385-c458788858ed"}]: dispatch 2024-09-11T23:14:29.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:28 smithi037 ceph-mon[30630]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9e956e6c-c28a-4a4c-b385-c458788858ed"}]: dispatch 2024-09-11T23:14:29.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:28 smithi037 ceph-mon[30630]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9e956e6c-c28a-4a4c-b385-c458788858ed"}]': finished 2024-09-11T23:14:29.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:28 smithi037 ceph-mon[30630]: osdmap e66: 11 total, 10 up, 11 in 2024-09-11T23:14:29.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:28 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T23:14:30.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:29 smithi160 ceph-mon[35055]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:14:30.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:29 smithi160 ceph-mon[35055]: from='client.? 172.21.15.123:0/601582780' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:14:30.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:29 smithi123 ceph-mon[35438]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:14:30.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:29 smithi123 ceph-mon[35438]: from='client.? 172.21.15.123:0/601582780' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:14:30.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:29 smithi037 ceph-mon[30630]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:14:30.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:29 smithi037 ceph-mon[30630]: from='client.? 172.21.15.123:0/601582780' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:14:32.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:31 smithi160 ceph-mon[35055]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:14:32.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:31 smithi123 ceph-mon[35438]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:14:32.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:31 smithi037 ceph-mon[30630]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:14:34.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:33 smithi123 ceph-mon[35438]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:14:34.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:33 smithi037 ceph-mon[30630]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:14:34.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:33 smithi160 ceph-mon[35055]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:14:36.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:35 smithi123 ceph-mon[35438]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:14:36.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:35 smithi037 ceph-mon[30630]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:14:36.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:35 smithi160 ceph-mon[35055]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:14:37.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:36 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-11T23:14:37.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:36 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:14:37.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:36 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-11T23:14:37.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:36 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:14:37.334 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:36 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-11T23:14:37.334 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:36 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:14:38.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:37 smithi123 ceph-mon[35438]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:14:38.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:37 smithi123 ceph-mon[35438]: Deploying daemon osd.10 on smithi123 2024-09-11T23:14:38.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:37 smithi037 ceph-mon[30630]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:14:38.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:37 smithi037 ceph-mon[30630]: Deploying daemon osd.10 on smithi123 2024-09-11T23:14:38.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:37 smithi160 ceph-mon[35055]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:14:38.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:37 smithi160 ceph-mon[35055]: Deploying daemon osd.10 on smithi123 2024-09-11T23:14:40.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:39 smithi123 ceph-mon[35438]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:14:40.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:39 smithi037 ceph-mon[30630]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:14:40.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:39 smithi160 ceph-mon[35055]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:14:42.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:41 smithi037 ceph-mon[30630]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:14:42.101 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:41 smithi123 ceph-mon[35438]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:14:42.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:41 smithi160 ceph-mon[35055]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:14:43.215 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:42 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:14:43.215 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:42 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:14:43.215 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:42 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:14:43.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:42 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:14:43.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:42 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:14:43.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:42 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:14:43.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:42 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:14:43.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:42 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:14:43.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:42 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:14:44.238 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:43 smithi123 ceph-mon[35438]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:14:44.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:43 smithi037 ceph-mon[30630]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:14:44.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:43 smithi160 ceph-mon[35055]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:14:46.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:45 smithi123 ceph-mon[35438]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:14:46.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:45 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:14:46.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:45 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:14:46.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:45 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:14:46.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:45 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:14:46.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:45 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:14:46.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:45 smithi037 ceph-mon[30630]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:14:46.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:45 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:14:46.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:45 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:14:46.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:45 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:14:46.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:45 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:14:46.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:45 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:14:46.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:14:46.388+0000 7fb6fd7fa640 1 -- 172.21.15.123:0/2660338162 <== mgr.14150 v2:172.21.15.37:6800/31543269 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7fb700062630 con 0x7fb6e80a2b80 2024-09-11T23:14:46.389 INFO:teuthology.orchestra.run.smithi123.stdout:Created osd(s) 10 on host 'smithi123' 2024-09-11T23:14:46.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:14:46.390+0000 7fb7068f4640 1 -- 172.21.15.123:0/2660338162 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fb6e80a2b80 msgr2=0x7fb6e80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:14:46.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:14:46.390+0000 7fb7068f4640 1 --2- 172.21.15.123:0/2660338162 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fb6e80a2b80 0x7fb6e80a5040 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb6f00096c0 tx=0x7fb6f0031400 comp rx=0 tx=0).stop 2024-09-11T23:14:46.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:14:46.390+0000 7fb7068f4640 1 -- 172.21.15.123:0/2660338162 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb700102e00 msgr2=0x7fb7000745e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:14:46.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:14:46.390+0000 7fb7068f4640 1 --2- 172.21.15.123:0/2660338162 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb700102e00 0x7fb7000745e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb6f400d770 tx=0x7fb6f400dc30 comp rx=0 tx=0).stop 2024-09-11T23:14:46.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:14:46.390+0000 7fb7068f4640 1 -- 172.21.15.123:0/2660338162 shutdown_connections 2024-09-11T23:14:46.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:14:46.390+0000 7fb7068f4640 1 --2- 172.21.15.123:0/2660338162 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fb6e80a2b80 0x7fb6e80a5040 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:14:46.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:14:46.390+0000 7fb7068f4640 1 --2- 172.21.15.123:0/2660338162 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb700102e00 0x7fb7000745e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:14:46.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:14:46.390+0000 7fb7068f4640 1 --2- 172.21.15.123:0/2660338162 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb7001037c0 0x7fb700074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:14:46.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:14:46.390+0000 7fb7068f4640 1 --2- 172.21.15.123:0/2660338162 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb700101c00 0x7fb700075f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:14:46.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:14:46.390+0000 7fb7068f4640 1 -- 172.21.15.123:0/2660338162 >> 172.21.15.123:0/2660338162 conn(0x7fb7000fd390 msgr2=0x7fb7001061c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:14:46.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:14:46.390+0000 7fb7068f4640 1 -- 172.21.15.123:0/2660338162 shutdown_connections 2024-09-11T23:14:46.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-11T23:14:46.390+0000 7fb7068f4640 1 -- 172.21.15.123:0/2660338162 wait complete. 2024-09-11T23:14:46.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:45 smithi160 ceph-mon[35055]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:14:46.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:45 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:14:46.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:45 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:14:46.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:45 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:14:46.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:45 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:14:46.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:45 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:14:47.197 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:46 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:14:47.197 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:46 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:14:47.197 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:46 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:14:47.229 DEBUG:teuthology.orchestra.run.smithi123:osd.10> sudo journalctl -f -n 0 -u ceph-8b03efce-7092-11ef-bcea-c7b262605968@osd.10.service 2024-09-11T23:14:47.231 INFO:tasks.cephadm:Deploying osd.11 on smithi160 with /dev/vg_nvme/lv_1... 2024-09-11T23:14:47.232 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-11T23:14:47.261 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:46 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:14:47.261 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:46 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:14:47.261 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:46 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:14:47.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:46 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:14:47.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:46 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:14:47.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:46 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:14:47.489 INFO:teuthology.orchestra.run.smithi160.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T23:14:48.197 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:47 smithi160 ceph-mon[35055]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:14:48.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:47 smithi123 ceph-mon[35438]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:14:48.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:47 smithi037 ceph-mon[30630]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:14:48.715 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:14:48 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:14:48.492+0000 7ff04d3e4640 -1 osd.10 0 log_to_monitors true 2024-09-11T23:14:49.224 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:48 smithi160 ceph-mon[35055]: from='osd.10 [v2:172.21.15.123:6824/471058996,v1:172.21.15.123:6825/471058996]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-11T23:14:49.224 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:48 smithi160 ceph-mon[35055]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-11T23:14:49.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:48 smithi123 ceph-mon[35438]: from='osd.10 [v2:172.21.15.123:6824/471058996,v1:172.21.15.123:6825/471058996]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-11T23:14:49.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:48 smithi123 ceph-mon[35438]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-11T23:14:49.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:48 smithi037 ceph-mon[30630]: from='osd.10 [v2:172.21.15.123:6824/471058996,v1:172.21.15.123:6825/471058996]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-11T23:14:49.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:48 smithi037 ceph-mon[30630]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-11T23:14:50.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:49 smithi160 ceph-mon[35055]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:14:50.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:49 smithi160 ceph-mon[35055]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-11T23:14:50.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:49 smithi160 ceph-mon[35055]: from='osd.10 [v2:172.21.15.123:6824/471058996,v1:172.21.15.123:6825/471058996]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]: dispatch 2024-09-11T23:14:50.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:49 smithi160 ceph-mon[35055]: osdmap e67: 11 total, 10 up, 11 in 2024-09-11T23:14:50.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:49 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T23:14:50.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:49 smithi160 ceph-mon[35055]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]: dispatch 2024-09-11T23:14:50.197 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:49 smithi123 ceph-mon[35438]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:14:50.197 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:49 smithi123 ceph-mon[35438]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-11T23:14:50.197 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:49 smithi123 ceph-mon[35438]: from='osd.10 [v2:172.21.15.123:6824/471058996,v1:172.21.15.123:6825/471058996]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]: dispatch 2024-09-11T23:14:50.197 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:49 smithi123 ceph-mon[35438]: osdmap e67: 11 total, 10 up, 11 in 2024-09-11T23:14:50.197 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:49 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T23:14:50.198 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:49 smithi123 ceph-mon[35438]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]: dispatch 2024-09-11T23:14:50.198 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:14:49 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:14:49.988+0000 7ff049367640 -1 osd.10 0 waiting for initial osdmap 2024-09-11T23:14:50.198 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:14:50 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:14:50.002+0000 7ff04518f640 -1 osd.10 68 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T23:14:50.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:49 smithi037 ceph-mon[30630]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:14:50.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:49 smithi037 ceph-mon[30630]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-11T23:14:50.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:49 smithi037 ceph-mon[30630]: from='osd.10 [v2:172.21.15.123:6824/471058996,v1:172.21.15.123:6825/471058996]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]: dispatch 2024-09-11T23:14:50.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:49 smithi037 ceph-mon[30630]: osdmap e67: 11 total, 10 up, 11 in 2024-09-11T23:14:50.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:49 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T23:14:50.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:49 smithi037 ceph-mon[30630]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]: dispatch 2024-09-11T23:14:50.522 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-11T23:14:50.549 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi160:vg_nvme/lv_1 2024-09-11T23:14:50.847 INFO:teuthology.orchestra.run.smithi160.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T23:14:51.114 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:50 smithi160 ceph-mon[35055]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]': finished 2024-09-11T23:14:51.115 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:50 smithi160 ceph-mon[35055]: osdmap e68: 11 total, 10 up, 11 in 2024-09-11T23:14:51.115 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:50 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T23:14:51.115 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:50 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T23:14:51.115 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:50 smithi160 ceph-mon[35055]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:14:51.115 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:50 smithi160 ceph-mon[35055]: Detected new or changed devices on smithi123 2024-09-11T23:14:51.115 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:50 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:14:51.115 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:50 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:14:51.115 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:50 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:14:51.116 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:50 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:14:51.116 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:50 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:14:51.116 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:50 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:14:51.116 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:50 smithi160 ceph-mon[35055]: Adjusting osd_memory_target on smithi123 to 4272M 2024-09-11T23:14:51.116 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:50 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:14:51.116 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:50 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:14:51.116 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:50 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:14:51.116 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:50 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:14:51.116 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:50 smithi160 ceph-mon[35055]: osd.10 [v2:172.21.15.123:6824/471058996,v1:172.21.15.123:6825/471058996] boot 2024-09-11T23:14:51.116 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:50 smithi160 ceph-mon[35055]: osdmap e69: 11 total, 11 up, 11 in 2024-09-11T23:14:51.116 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:50 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T23:14:51.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:50 smithi123 ceph-mon[35438]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]': finished 2024-09-11T23:14:51.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:50 smithi123 ceph-mon[35438]: osdmap e68: 11 total, 10 up, 11 in 2024-09-11T23:14:51.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:50 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T23:14:51.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:50 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T23:14:51.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:50 smithi123 ceph-mon[35438]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:14:51.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:50 smithi123 ceph-mon[35438]: Detected new or changed devices on smithi123 2024-09-11T23:14:51.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:50 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:14:51.252 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:50 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:14:51.252 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:50 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:14:51.252 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:50 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:14:51.252 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:50 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:14:51.252 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:50 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:14:51.252 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:50 smithi123 ceph-mon[35438]: Adjusting osd_memory_target on smithi123 to 4272M 2024-09-11T23:14:51.252 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:50 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:14:51.252 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:50 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:14:51.252 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:50 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:14:51.252 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:50 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:14:51.252 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:50 smithi123 ceph-mon[35438]: osd.10 [v2:172.21.15.123:6824/471058996,v1:172.21.15.123:6825/471058996] boot 2024-09-11T23:14:51.252 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:50 smithi123 ceph-mon[35438]: osdmap e69: 11 total, 11 up, 11 in 2024-09-11T23:14:51.253 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:50 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T23:14:51.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:50 smithi037 ceph-mon[30630]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]': finished 2024-09-11T23:14:51.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:50 smithi037 ceph-mon[30630]: osdmap e68: 11 total, 10 up, 11 in 2024-09-11T23:14:51.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:50 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T23:14:51.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:50 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T23:14:51.316 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:50 smithi037 ceph-mon[30630]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:14:51.316 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:50 smithi037 ceph-mon[30630]: Detected new or changed devices on smithi123 2024-09-11T23:14:51.316 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:50 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:14:51.316 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:50 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:14:51.316 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:50 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:14:51.316 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:50 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:14:51.317 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:50 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:14:51.317 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:50 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:14:51.317 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:50 smithi037 ceph-mon[30630]: Adjusting osd_memory_target on smithi123 to 4272M 2024-09-11T23:14:51.317 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:50 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:14:51.317 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:50 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:14:51.317 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:50 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:14:51.318 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:50 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:14:51.318 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:50 smithi037 ceph-mon[30630]: osd.10 [v2:172.21.15.123:6824/471058996,v1:172.21.15.123:6825/471058996] boot 2024-09-11T23:14:51.318 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:50 smithi037 ceph-mon[30630]: osdmap e69: 11 total, 11 up, 11 in 2024-09-11T23:14:51.318 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:50 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T23:14:51.340 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:14:51.325+0000 7fd269ed5640 1 -- 172.21.15.160:0/1526604908 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd264102690 msgr2=0x7fd264108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:14:51.340 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:14:51.325+0000 7fd269ed5640 1 --2- 172.21.15.160:0/1526604908 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd264102690 0x7fd264108f20 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd25c009ca0 tx=0x7fd25c02a8c0 comp rx=0 tx=0).stop 2024-09-11T23:14:51.340 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:14:51.325+0000 7fd269ed5640 1 -- 172.21.15.160:0/1526604908 shutdown_connections 2024-09-11T23:14:51.340 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:14:51.325+0000 7fd269ed5640 1 --2- 172.21.15.160:0/1526604908 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd264101cd0 0x7fd264102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:14:51.340 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:14:51.325+0000 7fd269ed5640 1 --2- 172.21.15.160:0/1526604908 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd264102690 0x7fd264108f20 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:14:51.340 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:14:51.325+0000 7fd269ed5640 1 --2- 172.21.15.160:0/1526604908 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd264100ad0 0x7fd264100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:14:51.340 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:14:51.325+0000 7fd269ed5640 1 -- 172.21.15.160:0/1526604908 >> 172.21.15.160:0/1526604908 conn(0x7fd2640fc280 msgr2=0x7fd2640fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:14:51.340 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:14:51.325+0000 7fd269ed5640 1 -- 172.21.15.160:0/1526604908 shutdown_connections 2024-09-11T23:14:51.341 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:14:51.325+0000 7fd269ed5640 1 -- 172.21.15.160:0/1526604908 wait complete. 2024-09-11T23:14:51.341 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:14:51.326+0000 7fd269ed5640 1 Processor -- start 2024-09-11T23:14:51.341 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:14:51.326+0000 7fd269ed5640 1 -- start start 2024-09-11T23:14:51.341 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:14:51.326+0000 7fd269ed5640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd264100ad0 0x7fd26406aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:14:51.341 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:14:51.326+0000 7fd269ed5640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd264101cd0 0x7fd26419cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:14:51.342 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:14:51.326+0000 7fd269ed5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd264102690 0x7fd26419f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:14:51.342 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:14:51.326+0000 7fd269ed5640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd26410c800 con 0x7fd264102690 2024-09-11T23:14:51.342 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:14:51.326+0000 7fd269ed5640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fd26410c680 con 0x7fd264101cd0 2024-09-11T23:14:51.342 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:14:51.326+0000 7fd269ed5640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fd26410c980 con 0x7fd264100ad0 2024-09-11T23:14:51.342 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:14:51.326+0000 7fd2637fe640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd264100ad0 0x7fd26406aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:14:51.342 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:14:51.326+0000 7fd2637fe640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd264100ad0 0x7fd26406aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:56762/0 (socket says 172.21.15.160:56762) 2024-09-11T23:14:51.342 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:14:51.326+0000 7fd2637fe640 1 -- 172.21.15.160:0/2329207598 learned_addr learned my addr 172.21.15.160:0/2329207598 (peer_addr_for_me v2:172.21.15.160:0/0) 2024-09-11T23:14:51.342 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:14:51.326+0000 7fd262ffd640 1 --2- 172.21.15.160:0/2329207598 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd264101cd0 0x7fd26419cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:14:51.342 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:14:51.327+0000 7fd2637fe640 1 -- 172.21.15.160:0/2329207598 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd264101cd0 msgr2=0x7fd26419cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:14:51.343 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:14:51.327+0000 7fd2637fe640 1 --2- 172.21.15.160:0/2329207598 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd264101cd0 0x7fd26419cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:14:51.343 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:14:51.327+0000 7fd2637fe640 1 -- 172.21.15.160:0/2329207598 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd264102690 msgr2=0x7fd26419f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:14:51.343 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:14:51.327+0000 7fd2637fe640 1 --2- 172.21.15.160:0/2329207598 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd264102690 0x7fd26419f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:14:51.343 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:14:51.327+0000 7fd2637fe640 1 -- 172.21.15.160:0/2329207598 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd264196ad0 con 0x7fd264100ad0 2024-09-11T23:14:51.343 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:14:51.327+0000 7fd262ffd640 1 --2- 172.21.15.160:0/2329207598 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd264101cd0 0x7fd26419cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:14:51.343 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:14:51.327+0000 7fd2637fe640 1 --2- 172.21.15.160:0/2329207598 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd264100ad0 0x7fd26406aad0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd25400b450 tx=0x7fd25400b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:14:51.343 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:14:51.327+0000 7fd260ff9640 1 -- 172.21.15.160:0/2329207598 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd254015020 con 0x7fd264100ad0 2024-09-11T23:14:51.343 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:14:51.327+0000 7fd260ff9640 1 -- 172.21.15.160:0/2329207598 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd254011d70 con 0x7fd264100ad0 2024-09-11T23:14:51.343 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:14:51.327+0000 7fd269ed5640 1 -- 172.21.15.160:0/2329207598 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd264196d60 con 0x7fd264100ad0 2024-09-11T23:14:51.343 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:14:51.327+0000 7fd260ff9640 1 -- 172.21.15.160:0/2329207598 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd25400f340 con 0x7fd264100ad0 2024-09-11T23:14:51.344 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:14:51.327+0000 7fd269ed5640 1 -- 172.21.15.160:0/2329207598 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd264197320 con 0x7fd264100ad0 2024-09-11T23:14:51.344 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:14:51.328+0000 7fd269ed5640 1 -- 172.21.15.160:0/2329207598 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2641987c0 con 0x7fd264100ad0 2024-09-11T23:14:51.344 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:14:51.329+0000 7fd260ff9640 1 -- 172.21.15.160:0/2329207598 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fd254018020 con 0x7fd264100ad0 2024-09-11T23:14:51.344 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:14:51.330+0000 7fd260ff9640 1 --2- 172.21.15.160:0/2329207598 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fd24c0a2b80 0x7fd24c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:14:51.344 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:14:51.330+0000 7fd260ff9640 1 -- 172.21.15.160:0/2329207598 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 6727+0+0 (secure 0 0 0) 0x7fd2540ce600 con 0x7fd264100ad0 2024-09-11T23:14:51.344 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:14:51.330+0000 7fd262ffd640 1 --2- 172.21.15.160:0/2329207598 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fd24c0a2b80 0x7fd24c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:14:51.344 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:14:51.331+0000 7fd262ffd640 1 --2- 172.21.15.160:0/2329207598 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fd24c0a2b80 0x7fd24c0a5040 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd258005fd0 tx=0x7fd258005ea0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:14:51.344 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:14:51.334+0000 7fd260ff9640 1 -- 172.21.15.160:0/2329207598 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd25401f020 con 0x7fd264100ad0 2024-09-11T23:14:51.521 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:14:51.520+0000 7fd269ed5640 1 -- 172.21.15.160:0/2329207598 --> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi160:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fd264107e00 con 0x7fd24c0a2b80 2024-09-11T23:14:52.613 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:52 smithi160 ceph-mon[35055]: purged_snaps scrub starts 2024-09-11T23:14:52.613 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:52 smithi160 ceph-mon[35055]: purged_snaps scrub ok 2024-09-11T23:14:52.613 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:52 smithi160 ceph-mon[35055]: osdmap e70: 11 total, 11 up, 11 in 2024-09-11T23:14:52.613 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:52 smithi160 ceph-mon[35055]: from='client.24379 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi160:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:14:52.613 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:52 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:14:52.613 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:52 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:14:52.613 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:52 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:14:52.736 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:52 smithi037 ceph-mon[30630]: purged_snaps scrub starts 2024-09-11T23:14:52.736 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:52 smithi037 ceph-mon[30630]: purged_snaps scrub ok 2024-09-11T23:14:52.736 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:52 smithi037 ceph-mon[30630]: osdmap e70: 11 total, 11 up, 11 in 2024-09-11T23:14:52.737 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:52 smithi037 ceph-mon[30630]: from='client.24379 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi160:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:14:52.737 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:52 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:14:52.737 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:52 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:14:52.737 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:52 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:14:52.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:52 smithi123 ceph-mon[35438]: purged_snaps scrub starts 2024-09-11T23:14:52.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:52 smithi123 ceph-mon[35438]: purged_snaps scrub ok 2024-09-11T23:14:52.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:52 smithi123 ceph-mon[35438]: osdmap e70: 11 total, 11 up, 11 in 2024-09-11T23:14:52.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:52 smithi123 ceph-mon[35438]: from='client.24379 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi160:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:14:52.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:52 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:14:52.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:52 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:14:52.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:52 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:14:53.586 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:53 smithi160 ceph-mon[35055]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-11T23:14:53.586 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:53 smithi160 ceph-mon[35055]: osdmap e71: 11 total, 11 up, 11 in 2024-09-11T23:14:53.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:53 smithi123 ceph-mon[35438]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-11T23:14:53.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:53 smithi123 ceph-mon[35438]: osdmap e71: 11 total, 11 up, 11 in 2024-09-11T23:14:53.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:53 smithi037 ceph-mon[30630]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-11T23:14:53.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:53 smithi037 ceph-mon[30630]: osdmap e71: 11 total, 11 up, 11 in 2024-09-11T23:14:54.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:54 smithi160 ceph-mon[35055]: osdmap e72: 11 total, 11 up, 11 in 2024-09-11T23:14:54.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:54 smithi160 ceph-mon[35055]: from='client.? 172.21.15.160:0/3085316510' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0b5b3364-9a40-4cab-90d4-b7b1cba57bc8"}]: dispatch 2024-09-11T23:14:54.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:54 smithi160 ceph-mon[35055]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0b5b3364-9a40-4cab-90d4-b7b1cba57bc8"}]: dispatch 2024-09-11T23:14:54.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:54 smithi160 ceph-mon[35055]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0b5b3364-9a40-4cab-90d4-b7b1cba57bc8"}]': finished 2024-09-11T23:14:54.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:54 smithi160 ceph-mon[35055]: osdmap e73: 12 total, 11 up, 12 in 2024-09-11T23:14:54.685 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:54 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T23:14:54.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:54 smithi123 ceph-mon[35438]: osdmap e72: 11 total, 11 up, 11 in 2024-09-11T23:14:54.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:54 smithi123 ceph-mon[35438]: from='client.? 172.21.15.160:0/3085316510' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0b5b3364-9a40-4cab-90d4-b7b1cba57bc8"}]: dispatch 2024-09-11T23:14:54.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:54 smithi123 ceph-mon[35438]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0b5b3364-9a40-4cab-90d4-b7b1cba57bc8"}]: dispatch 2024-09-11T23:14:54.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:54 smithi123 ceph-mon[35438]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0b5b3364-9a40-4cab-90d4-b7b1cba57bc8"}]': finished 2024-09-11T23:14:54.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:54 smithi123 ceph-mon[35438]: osdmap e73: 12 total, 11 up, 12 in 2024-09-11T23:14:54.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:54 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T23:14:54.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:54 smithi037 ceph-mon[30630]: osdmap e72: 11 total, 11 up, 11 in 2024-09-11T23:14:54.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:54 smithi037 ceph-mon[30630]: from='client.? 172.21.15.160:0/3085316510' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0b5b3364-9a40-4cab-90d4-b7b1cba57bc8"}]: dispatch 2024-09-11T23:14:54.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:54 smithi037 ceph-mon[30630]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0b5b3364-9a40-4cab-90d4-b7b1cba57bc8"}]: dispatch 2024-09-11T23:14:54.815 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:54 smithi037 ceph-mon[30630]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0b5b3364-9a40-4cab-90d4-b7b1cba57bc8"}]': finished 2024-09-11T23:14:54.815 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:54 smithi037 ceph-mon[30630]: osdmap e73: 12 total, 11 up, 12 in 2024-09-11T23:14:54.815 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:54 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T23:14:55.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:55 smithi123 ceph-mon[35438]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-11T23:14:55.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:55 smithi123 ceph-mon[35438]: from='client.? 172.21.15.160:0/212968242' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:14:55.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:55 smithi037 ceph-mon[30630]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-11T23:14:55.815 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:55 smithi037 ceph-mon[30630]: from='client.? 172.21.15.160:0/212968242' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:14:55.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:55 smithi160 ceph-mon[35055]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-11T23:14:55.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:55 smithi160 ceph-mon[35055]: from='client.? 172.21.15.160:0/212968242' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:14:57.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:57 smithi123 ceph-mon[35438]: pgmap v245: 1 pgs: 1 peering; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 126 KiB/s, 0 objects/s recovering 2024-09-11T23:14:57.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:57 smithi037 ceph-mon[30630]: pgmap v245: 1 pgs: 1 peering; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 126 KiB/s, 0 objects/s recovering 2024-09-11T23:14:57.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:57 smithi160 ceph-mon[35055]: pgmap v245: 1 pgs: 1 peering; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 126 KiB/s, 0 objects/s recovering 2024-09-11T23:14:59.673 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:14:59 smithi160 ceph-mon[35055]: pgmap v246: 1 pgs: 1 peering; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-11T23:14:59.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:14:59 smithi123 ceph-mon[35438]: pgmap v246: 1 pgs: 1 peering; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-11T23:14:59.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:14:59 smithi037 ceph-mon[30630]: pgmap v246: 1 pgs: 1 peering; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-11T23:15:01.644 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:01 smithi160 ceph-mon[35055]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 76 KiB/s, 0 objects/s recovering 2024-09-11T23:15:01.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:01 smithi123 ceph-mon[35438]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 76 KiB/s, 0 objects/s recovering 2024-09-11T23:15:01.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:01 smithi037 ceph-mon[30630]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 76 KiB/s, 0 objects/s recovering 2024-09-11T23:15:03.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:03 smithi160 ceph-mon[35055]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-09-11T23:15:03.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:03 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-11T23:15:03.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:03 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:15:03.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:03 smithi160 ceph-mon[35055]: Deploying daemon osd.11 on smithi160 2024-09-11T23:15:03.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:03 smithi123 ceph-mon[35438]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-09-11T23:15:03.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:03 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-11T23:15:03.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:03 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:15:03.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:03 smithi123 ceph-mon[35438]: Deploying daemon osd.11 on smithi160 2024-09-11T23:15:03.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:03 smithi037 ceph-mon[30630]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-09-11T23:15:03.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:03 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-11T23:15:03.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:03 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:15:03.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:03 smithi037 ceph-mon[30630]: Deploying daemon osd.11 on smithi160 2024-09-11T23:15:05.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:05 smithi160 ceph-mon[35055]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-11T23:15:05.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:05 smithi123 ceph-mon[35438]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-11T23:15:05.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:05 smithi037 ceph-mon[30630]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-11T23:15:07.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:07 smithi123 ceph-mon[35438]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-09-11T23:15:07.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:07 smithi037 ceph-mon[30630]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-09-11T23:15:07.864 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:07 smithi160 ceph-mon[35055]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-09-11T23:15:09.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:09 smithi123 ceph-mon[35438]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-09-11T23:15:09.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:09 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:15:09.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:09 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:09.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:09 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:09.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:09 smithi037 ceph-mon[30630]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-09-11T23:15:09.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:09 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:15:09.815 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:09 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:09.815 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:09 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:09.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:09 smithi160 ceph-mon[35055]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-09-11T23:15:09.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:09 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:15:09.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:09 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:09.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:09 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:11.644 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:11 smithi160 ceph-mon[35055]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-09-11T23:15:11.644 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:11 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:11.644 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:11 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:11.645 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:11 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:15:11.645 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:11 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:15:11.645 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:11 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:11.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:11 smithi123 ceph-mon[35438]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-09-11T23:15:11.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:11 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:11.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:11 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:11.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:11 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:15:11.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:11 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:15:11.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:11 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:11.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:11 smithi037 ceph-mon[30630]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-09-11T23:15:11.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:11 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:11.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:11 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:11.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:11 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:15:11.815 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:11 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:15:11.815 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:11 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:11.969 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:15:11.969+0000 7fd260ff9640 1 -- 172.21.15.160:0/2329207598 <== mgr.14150 v2:172.21.15.37:6800/31543269 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7fd264107e00 con 0x7fd24c0a2b80 2024-09-11T23:15:11.970 INFO:teuthology.orchestra.run.smithi160.stdout:Created osd(s) 11 on host 'smithi160' 2024-09-11T23:15:11.972 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:15:11.971+0000 7fd269ed5640 1 -- 172.21.15.160:0/2329207598 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fd24c0a2b80 msgr2=0x7fd24c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:11.972 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:15:11.971+0000 7fd269ed5640 1 --2- 172.21.15.160:0/2329207598 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fd24c0a2b80 0x7fd24c0a5040 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd258005fd0 tx=0x7fd258005ea0 comp rx=0 tx=0).stop 2024-09-11T23:15:11.972 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:15:11.972+0000 7fd269ed5640 1 -- 172.21.15.160:0/2329207598 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd264100ad0 msgr2=0x7fd26406aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:11.972 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:15:11.972+0000 7fd269ed5640 1 --2- 172.21.15.160:0/2329207598 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd264100ad0 0x7fd26406aad0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd25400b450 tx=0x7fd25400b910 comp rx=0 tx=0).stop 2024-09-11T23:15:11.972 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:15:11.972+0000 7fd269ed5640 1 -- 172.21.15.160:0/2329207598 shutdown_connections 2024-09-11T23:15:11.972 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:15:11.972+0000 7fd269ed5640 1 --2- 172.21.15.160:0/2329207598 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fd24c0a2b80 0x7fd24c0a5040 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:11.972 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:15:11.972+0000 7fd269ed5640 1 --2- 172.21.15.160:0/2329207598 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd264101cd0 0x7fd26419cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:11.972 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:15:11.972+0000 7fd269ed5640 1 --2- 172.21.15.160:0/2329207598 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd264102690 0x7fd26419f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:11.973 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:15:11.972+0000 7fd269ed5640 1 --2- 172.21.15.160:0/2329207598 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd264100ad0 0x7fd26406aad0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:11.973 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:15:11.972+0000 7fd269ed5640 1 -- 172.21.15.160:0/2329207598 >> 172.21.15.160:0/2329207598 conn(0x7fd2640fc280 msgr2=0x7fd264105050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:11.973 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:15:11.972+0000 7fd269ed5640 1 -- 172.21.15.160:0/2329207598 shutdown_connections 2024-09-11T23:15:11.973 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:15:11.972+0000 7fd269ed5640 1 -- 172.21.15.160:0/2329207598 wait complete. 2024-09-11T23:15:12.643 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:12 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:15:12.643 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:12 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:12.644 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:12 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:12.671 DEBUG:teuthology.orchestra.run.smithi160:osd.11> sudo journalctl -f -n 0 -u ceph-8b03efce-7092-11ef-bcea-c7b262605968@osd.11.service 2024-09-11T23:15:12.673 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-09-11T23:15:12.674 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-11T23:15:12.729 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:12 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:15:12.729 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:12 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:12.729 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:12 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:12.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:12 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:15:12.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:12 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:12.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:12 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:13.057 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:15:13.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:13.602+0000 7f3935600640 1 -- 172.21.15.37:0/3675975634 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3930105920 msgr2=0x7f393010c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:13.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:13.602+0000 7f3935600640 1 --2- 172.21.15.37:0/3675975634 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3930105920 0x7f393010c240 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3928009ca0 tx=0x7f392802a8c0 comp rx=0 tx=0).stop 2024-09-11T23:15:13.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:13.602+0000 7f3935600640 1 -- 172.21.15.37:0/3675975634 shutdown_connections 2024-09-11T23:15:13.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:13.602+0000 7f3935600640 1 --2- 172.21.15.37:0/3675975634 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3930104f60 0x7f39301053e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:13.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:13.602+0000 7f3935600640 1 --2- 172.21.15.37:0/3675975634 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3930105920 0x7f393010c240 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:13.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:13.602+0000 7f3935600640 1 --2- 172.21.15.37:0/3675975634 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3930103e00 0x7f3930104200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:13.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:13.602+0000 7f3935600640 1 -- 172.21.15.37:0/3675975634 >> 172.21.15.37:0/3675975634 conn(0x7f39300ff5b0 msgr2=0x7f39301019d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:13.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:13.602+0000 7f3935600640 1 -- 172.21.15.37:0/3675975634 shutdown_connections 2024-09-11T23:15:13.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:13.602+0000 7f3935600640 1 -- 172.21.15.37:0/3675975634 wait complete. 2024-09-11T23:15:13.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:13.603+0000 7f3935600640 1 Processor -- start 2024-09-11T23:15:13.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:13.603+0000 7f3935600640 1 -- start start 2024-09-11T23:15:13.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:13.603+0000 7f3935600640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3930103e00 0x7f393019a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:13.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:13.603+0000 7f3935600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3930104f60 0x7f393019a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:13.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:13.603+0000 7f3935600640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3930105920 0x7f39301a1660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:13.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:13.603+0000 7f3935600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f393010fab0 con 0x7f3930104f60 2024-09-11T23:15:13.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:13.603+0000 7f3935600640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f393010f930 con 0x7f3930105920 2024-09-11T23:15:13.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:13.603+0000 7f3935600640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f393010fc30 con 0x7f3930103e00 2024-09-11T23:15:13.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:13.604+0000 7f3927e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3930104f60 0x7f393019a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:13.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:13.604+0000 7f392ea00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3930103e00 0x7f393019a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:13.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:13.604+0000 7f392ea00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3930103e00 0x7f393019a0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.37:51020/0 (socket says 172.21.15.37:51020) 2024-09-11T23:15:13.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:13.604+0000 7f3927e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3930104f60 0x7f393019a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56200/0 (socket says 172.21.15.37:56200) 2024-09-11T23:15:13.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:13.604+0000 7f392ea00640 1 -- 172.21.15.37:0/3698665978 learned_addr learned my addr 172.21.15.37:0/3698665978 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:15:13.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:13.604+0000 7f392f400640 1 --2- 172.21.15.37:0/3698665978 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3930105920 0x7f39301a1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:13.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:13.604+0000 7f392ea00640 1 -- 172.21.15.37:0/3698665978 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3930105920 msgr2=0x7f39301a1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:13.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:13.604+0000 7f392ea00640 1 --2- 172.21.15.37:0/3698665978 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3930105920 0x7f39301a1660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:13.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:13.604+0000 7f392ea00640 1 -- 172.21.15.37:0/3698665978 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3930104f60 msgr2=0x7f393019a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:13.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:13.604+0000 7f392ea00640 1 --2- 172.21.15.37:0/3698665978 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3930104f60 0x7f393019a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:13.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:13.604+0000 7f392ea00640 1 -- 172.21.15.37:0/3698665978 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39301a1cd0 con 0x7f3930103e00 2024-09-11T23:15:13.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:13.604+0000 7f3927e00640 1 --2- 172.21.15.37:0/3698665978 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3930104f60 0x7f393019a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:15:13.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:13.604+0000 7f392ea00640 1 --2- 172.21.15.37:0/3698665978 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3930103e00 0x7f393019a0a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f392000e9f0 tx=0x7f392000edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:13.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:13.605+0000 7f3927400640 1 -- 172.21.15.37:0/3698665978 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f392000cd80 con 0x7f3930103e00 2024-09-11T23:15:13.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:13.605+0000 7f3935600640 1 -- 172.21.15.37:0/3698665978 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39301a1fc0 con 0x7f3930103e00 2024-09-11T23:15:13.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:13.605+0000 7f3927400640 1 -- 172.21.15.37:0/3698665978 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3920005500 con 0x7f3930103e00 2024-09-11T23:15:13.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:13.605+0000 7f3927400640 1 -- 172.21.15.37:0/3698665978 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3920010690 con 0x7f3930103e00 2024-09-11T23:15:13.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:13.605+0000 7f3935600640 1 -- 172.21.15.37:0/3698665978 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39301a2410 con 0x7f3930103e00 2024-09-11T23:15:13.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:13.606+0000 7f3935600640 1 -- 172.21.15.37:0/3698665978 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f393010b1c0 con 0x7f3930103e00 2024-09-11T23:15:13.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:13.608+0000 7f3927400640 1 -- 172.21.15.37:0/3698665978 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f39200046c0 con 0x7f3930103e00 2024-09-11T23:15:13.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:13.609+0000 7f3927400640 1 --2- 172.21.15.37:0/3698665978 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f39140a2bb0 0x7f39140a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:13.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:13.609+0000 7f3927400640 1 -- 172.21.15.37:0/3698665978 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 6809+0+0 (secure 0 0 0) 0x7f39200cf0b0 con 0x7f3930103e00 2024-09-11T23:15:13.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:13.610+0000 7f3927e00640 1 --2- 172.21.15.37:0/3698665978 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f39140a2bb0 0x7f39140a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:13.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:13.610+0000 7f3927e00640 1 --2- 172.21.15.37:0/3698665978 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f39140a2bb0 0x7f39140a5070 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f393019b5c0 tx=0x7f391800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:13.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:13.615+0000 7f3927400640 1 -- 172.21.15.37:0/3698665978 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f39200541b0 con 0x7f3930103e00 2024-09-11T23:15:13.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:13.797+0000 7f3935600640 1 -- 172.21.15.37:0/3698665978 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f393002da30 con 0x7f3930103e00 2024-09-11T23:15:13.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:13.798+0000 7f3927400640 1 -- 172.21.15.37:0/3698665978 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v73) ==== 74+0+133 (secure 0 0 0) 0x7f392009c550 con 0x7f3930103e00 2024-09-11T23:15:13.799 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:15:13.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:13.800+0000 7f3935600640 1 -- 172.21.15.37:0/3698665978 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f39140a2bb0 msgr2=0x7f39140a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:13.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:13.800+0000 7f3935600640 1 --2- 172.21.15.37:0/3698665978 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f39140a2bb0 0x7f39140a5070 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f393019b5c0 tx=0x7f391800b410 comp rx=0 tx=0).stop 2024-09-11T23:15:13.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:13.800+0000 7f3935600640 1 -- 172.21.15.37:0/3698665978 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3930103e00 msgr2=0x7f393019a0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:13.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:13.800+0000 7f3935600640 1 --2- 172.21.15.37:0/3698665978 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3930103e00 0x7f393019a0a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f392000e9f0 tx=0x7f392000edf0 comp rx=0 tx=0).stop 2024-09-11T23:15:13.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:13.800+0000 7f3935600640 1 -- 172.21.15.37:0/3698665978 shutdown_connections 2024-09-11T23:15:13.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:13.800+0000 7f3935600640 1 --2- 172.21.15.37:0/3698665978 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f39140a2bb0 0x7f39140a5070 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:13.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:13.800+0000 7f3935600640 1 --2- 172.21.15.37:0/3698665978 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3930105920 0x7f39301a1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:13.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:13.800+0000 7f3935600640 1 --2- 172.21.15.37:0/3698665978 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3930104f60 0x7f393019a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:13.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:13.800+0000 7f3935600640 1 --2- 172.21.15.37:0/3698665978 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3930103e00 0x7f393019a0a0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:13.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:13.800+0000 7f3935600640 1 -- 172.21.15.37:0/3698665978 >> 172.21.15.37:0/3698665978 conn(0x7f39300ff5b0 msgr2=0x7f3930108390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:13.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:13.800+0000 7f3935600640 1 -- 172.21.15.37:0/3698665978 shutdown_connections 2024-09-11T23:15:13.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:13.800+0000 7f3935600640 1 -- 172.21.15.37:0/3698665978 wait complete. 2024-09-11T23:15:14.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:13 smithi037 ceph-mon[30630]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-09-11T23:15:14.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:13 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/3698665978' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-11T23:15:14.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:13 smithi160 ceph-mon[35055]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-09-11T23:15:14.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:13 smithi160 ceph-mon[35055]: from='client.? 172.21.15.37:0/3698665978' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-11T23:15:14.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:13 smithi123 ceph-mon[35438]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-09-11T23:15:14.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:13 smithi123 ceph-mon[35438]: from='client.? 172.21.15.37:0/3698665978' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-11T23:15:14.684 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:15:14 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:15:14.320+0000 7f2ceff95640 -1 osd.11 0 log_to_monitors true 2024-09-11T23:15:14.734 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":73,"num_osds":12,"num_up_osds":11,"osd_up_since":1726096490,"num_in_osds":12,"osd_in_since":1726096494,"num_remapped_pgs":0} 2024-09-11T23:15:15.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:14 smithi123 ceph-mon[35438]: from='osd.11 [v2:172.21.15.160:6824/3982315018,v1:172.21.15.160:6825/3982315018]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-11T23:15:15.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:14 smithi123 ceph-mon[35438]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-11T23:15:15.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:14 smithi037 ceph-mon[30630]: from='osd.11 [v2:172.21.15.160:6824/3982315018,v1:172.21.15.160:6825/3982315018]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-11T23:15:15.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:14 smithi037 ceph-mon[30630]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-11T23:15:15.348 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:14 smithi160 ceph-mon[35055]: from='osd.11 [v2:172.21.15.160:6824/3982315018,v1:172.21.15.160:6825/3982315018]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-11T23:15:15.348 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:14 smithi160 ceph-mon[35055]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-11T23:15:15.735 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-11T23:15:16.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:15 smithi037 ceph-mon[30630]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-09-11T23:15:16.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:15 smithi037 ceph-mon[30630]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-11T23:15:16.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:15 smithi037 ceph-mon[30630]: osdmap e74: 12 total, 11 up, 12 in 2024-09-11T23:15:16.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:15 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T23:15:16.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:15 smithi037 ceph-mon[30630]: from='osd.11 [v2:172.21.15.160:6824/3982315018,v1:172.21.15.160:6825/3982315018]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-09-11T23:15:16.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:15 smithi037 ceph-mon[30630]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-09-11T23:15:16.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:15 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:16.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:15 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:16.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:15 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:15:16.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:15 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:15:16.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:15 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:15:16.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:15 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:15:16.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:15 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:16.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:15 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:15:16.066 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:15 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:15:16.066 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:15 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:16.139 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:15:16.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:15 smithi123 ceph-mon[35438]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-09-11T23:15:16.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:15 smithi123 ceph-mon[35438]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-11T23:15:16.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:15 smithi123 ceph-mon[35438]: osdmap e74: 12 total, 11 up, 12 in 2024-09-11T23:15:16.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:15 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T23:15:16.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:15 smithi123 ceph-mon[35438]: from='osd.11 [v2:172.21.15.160:6824/3982315018,v1:172.21.15.160:6825/3982315018]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-09-11T23:15:16.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:15 smithi123 ceph-mon[35438]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-09-11T23:15:16.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:15 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:16.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:15 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:16.252 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:15 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:15:16.252 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:15 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:15:16.252 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:15 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:15:16.252 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:15 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:15:16.252 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:15 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:16.252 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:15 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:15:16.252 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:15 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:15:16.252 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:15 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:16.434 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:15:15 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:15:15.989+0000 7f2cebf18640 -1 osd.11 0 waiting for initial osdmap 2024-09-11T23:15:16.434 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:15:16 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:15:15.999+0000 7f2ce7d40640 -1 osd.11 75 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T23:15:16.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:15 smithi160 ceph-mon[35055]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-09-11T23:15:16.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:15 smithi160 ceph-mon[35055]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-11T23:15:16.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:15 smithi160 ceph-mon[35055]: osdmap e74: 12 total, 11 up, 12 in 2024-09-11T23:15:16.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:15 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T23:15:16.435 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:15 smithi160 ceph-mon[35055]: from='osd.11 [v2:172.21.15.160:6824/3982315018,v1:172.21.15.160:6825/3982315018]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-09-11T23:15:16.435 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:15 smithi160 ceph-mon[35055]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-09-11T23:15:16.435 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:15 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:16.435 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:15 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:16.435 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:15 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:15:16.435 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:15 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:15:16.435 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:15 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:15:16.435 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:15 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:15:16.435 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:15 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:16.435 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:15 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:15:16.435 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:15 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:15:16.435 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:15 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:16.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:16.730+0000 7f4127200640 1 -- 172.21.15.37:0/843698800 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4128101a40 msgr2=0x7f4128101e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:16.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:16.730+0000 7f4127200640 1 --2- 172.21.15.37:0/843698800 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4128101a40 0x7f4128101e40 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4118009900 tx=0x7f411802a3f0 comp rx=0 tx=0).stop 2024-09-11T23:15:16.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:16.730+0000 7f4127200640 1 -- 172.21.15.37:0/843698800 shutdown_connections 2024-09-11T23:15:16.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:16.730+0000 7f4127200640 1 --2- 172.21.15.37:0/843698800 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4128103600 0x7f4128109e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:16.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:16.730+0000 7f4127200640 1 --2- 172.21.15.37:0/843698800 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4128102c40 0x7f41281030c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:16.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:16.730+0000 7f4127200640 1 --2- 172.21.15.37:0/843698800 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4128101a40 0x7f4128101e40 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:16.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:16.730+0000 7f4127200640 1 -- 172.21.15.37:0/843698800 >> 172.21.15.37:0/843698800 conn(0x7f41280fd1f0 msgr2=0x7f41280ff610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:16.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:16.730+0000 7f4127200640 1 -- 172.21.15.37:0/843698800 shutdown_connections 2024-09-11T23:15:16.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:16.730+0000 7f4127200640 1 -- 172.21.15.37:0/843698800 wait complete. 2024-09-11T23:15:16.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:16.731+0000 7f4127200640 1 Processor -- start 2024-09-11T23:15:16.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:16.732+0000 7f4127200640 1 -- start start 2024-09-11T23:15:16.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:16.732+0000 7f4127200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4128101a40 0x7f4128197da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:16.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:16.732+0000 7f4127200640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4128102c40 0x7f41281982e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:16.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:16.732+0000 7f4127200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4128103600 0x7f412819f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:16.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:16.732+0000 7f4127200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f412810d6c0 con 0x7f4128103600 2024-09-11T23:15:16.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:16.732+0000 7f4127200640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f412810d540 con 0x7f4128101a40 2024-09-11T23:15:16.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:16.732+0000 7f4127200640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f412810d840 con 0x7f4128102c40 2024-09-11T23:15:16.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:16.732+0000 7f4125e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4128101a40 0x7f4128197da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:16.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:16.732+0000 7f4125e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4128101a40 0x7f4128197da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.37:40466/0 (socket says 172.21.15.37:40466) 2024-09-11T23:15:16.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:16.732+0000 7f4125e00640 1 -- 172.21.15.37:0/2214245456 learned_addr learned my addr 172.21.15.37:0/2214245456 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:15:16.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:16.733+0000 7f4125400640 1 --2- 172.21.15.37:0/2214245456 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4128102c40 0x7f41281982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:16.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:16.733+0000 7f4126800640 1 --2- 172.21.15.37:0/2214245456 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4128103600 0x7f412819f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:16.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:16.733+0000 7f4125e00640 1 -- 172.21.15.37:0/2214245456 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4128102c40 msgr2=0x7f41281982e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:16.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:16.733+0000 7f4125e00640 1 --2- 172.21.15.37:0/2214245456 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4128102c40 0x7f41281982e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:16.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:16.733+0000 7f4125e00640 1 -- 172.21.15.37:0/2214245456 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4128103600 msgr2=0x7f412819f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:16.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:16.733+0000 7f4125e00640 1 --2- 172.21.15.37:0/2214245456 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4128103600 0x7f412819f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:16.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:16.733+0000 7f4125e00640 1 -- 172.21.15.37:0/2214245456 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f412819f9d0 con 0x7f4128101a40 2024-09-11T23:15:16.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:16.733+0000 7f4125e00640 1 --2- 172.21.15.37:0/2214245456 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4128101a40 0x7f4128197da0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4118031610 tx=0x7f4118004270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:16.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:16.734+0000 7f411ea00640 1 -- 172.21.15.37:0/2214245456 <== mon.2 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f411803f030 con 0x7f4128101a40 2024-09-11T23:15:16.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:16.734+0000 7f411ea00640 1 -- 172.21.15.37:0/2214245456 <== mon.2 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4118003ad0 con 0x7f4128101a40 2024-09-11T23:15:16.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:16.734+0000 7f411ea00640 1 -- 172.21.15.37:0/2214245456 <== mon.2 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4118035070 con 0x7f4128101a40 2024-09-11T23:15:16.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:16.734+0000 7f4127200640 1 -- 172.21.15.37:0/2214245456 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f412819fc60 con 0x7f4128101a40 2024-09-11T23:15:16.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:16.734+0000 7f4127200640 1 -- 172.21.15.37:0/2214245456 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41281a0190 con 0x7f4128101a40 2024-09-11T23:15:16.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:16.735+0000 7f4127200640 1 -- 172.21.15.37:0/2214245456 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4128108ee0 con 0x7f4128101a40 2024-09-11T23:15:16.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:16.737+0000 7f411ea00640 1 -- 172.21.15.37:0/2214245456 <== mon.2 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f4118042030 con 0x7f4128101a40 2024-09-11T23:15:16.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:16.738+0000 7f411ea00640 1 --2- 172.21.15.37:0/2214245456 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f410c0a2c30 0x7f410c0a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:16.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:16.738+0000 7f411ea00640 1 -- 172.21.15.37:0/2214245456 <== mon.2 v2:172.21.15.123:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6847+0+0 (secure 0 0 0) 0x7f41180ef110 con 0x7f4128101a40 2024-09-11T23:15:16.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:16.738+0000 7f4125400640 1 --2- 172.21.15.37:0/2214245456 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f410c0a2c30 0x7f410c0a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:16.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:16.739+0000 7f4125400640 1 --2- 172.21.15.37:0/2214245456 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f410c0a2c30 0x7f410c0a50f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f41281992c0 tx=0x7f4114005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:16.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:16.740+0000 7f411ea00640 1 -- 172.21.15.37:0/2214245456 <== mon.2 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f41180bc590 con 0x7f4128101a40 2024-09-11T23:15:16.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:16.926+0000 7f4127200640 1 -- 172.21.15.37:0/2214245456 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f412802da10 con 0x7f4128101a40 2024-09-11T23:15:16.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:16.927+0000 7f411ea00640 1 -- 172.21.15.37:0/2214245456 <== mon.2 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v75) ==== 74+0+133 (secure 0 0 0) 0x7f41180bbe90 con 0x7f4128101a40 2024-09-11T23:15:16.929 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:15:16.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:16.930+0000 7f4127200640 1 -- 172.21.15.37:0/2214245456 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f410c0a2c30 msgr2=0x7f410c0a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:16.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:16.930+0000 7f4127200640 1 --2- 172.21.15.37:0/2214245456 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f410c0a2c30 0x7f410c0a50f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f41281992c0 tx=0x7f4114005f90 comp rx=0 tx=0).stop 2024-09-11T23:15:16.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:16.930+0000 7f4127200640 1 -- 172.21.15.37:0/2214245456 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4128101a40 msgr2=0x7f4128197da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:16.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:16.930+0000 7f4127200640 1 --2- 172.21.15.37:0/2214245456 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4128101a40 0x7f4128197da0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4118031610 tx=0x7f4118004270 comp rx=0 tx=0).stop 2024-09-11T23:15:16.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:16.930+0000 7f4127200640 1 -- 172.21.15.37:0/2214245456 shutdown_connections 2024-09-11T23:15:16.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:16.930+0000 7f4127200640 1 --2- 172.21.15.37:0/2214245456 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f410c0a2c30 0x7f410c0a50f0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:16.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:16.930+0000 7f4127200640 1 --2- 172.21.15.37:0/2214245456 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4128103600 0x7f412819f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:16.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:16.930+0000 7f4127200640 1 --2- 172.21.15.37:0/2214245456 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4128102c40 0x7f41281982e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:16.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:16.930+0000 7f4127200640 1 --2- 172.21.15.37:0/2214245456 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4128101a40 0x7f4128197da0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:16.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:16.930+0000 7f4127200640 1 -- 172.21.15.37:0/2214245456 >> 172.21.15.37:0/2214245456 conn(0x7f41280fd1f0 msgr2=0x7f41281060b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:16.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:16.930+0000 7f4127200640 1 -- 172.21.15.37:0/2214245456 shutdown_connections 2024-09-11T23:15:16.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:16.930+0000 7f4127200640 1 -- 172.21.15.37:0/2214245456 wait complete. 2024-09-11T23:15:17.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:16 smithi123 ceph-mon[35438]: Detected new or changed devices on smithi160 2024-09-11T23:15:17.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:16 smithi123 ceph-mon[35438]: Adjusting osd_memory_target on smithi160 to 4272M 2024-09-11T23:15:17.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:16 smithi123 ceph-mon[35438]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]': finished 2024-09-11T23:15:17.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:16 smithi123 ceph-mon[35438]: osdmap e75: 12 total, 11 up, 12 in 2024-09-11T23:15:17.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:16 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T23:15:17.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:16 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T23:15:17.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:16 smithi123 ceph-mon[35438]: from='client.? 172.21.15.37:0/2214245456' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-11T23:15:17.292 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:16 smithi037 ceph-mon[30630]: Detected new or changed devices on smithi160 2024-09-11T23:15:17.292 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:16 smithi037 ceph-mon[30630]: Adjusting osd_memory_target on smithi160 to 4272M 2024-09-11T23:15:17.292 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:16 smithi037 ceph-mon[30630]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]': finished 2024-09-11T23:15:17.292 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:16 smithi037 ceph-mon[30630]: osdmap e75: 12 total, 11 up, 12 in 2024-09-11T23:15:17.292 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:16 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T23:15:17.292 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:16 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T23:15:17.292 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:16 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/2214245456' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-11T23:15:17.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:16 smithi160 ceph-mon[35055]: Detected new or changed devices on smithi160 2024-09-11T23:15:17.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:16 smithi160 ceph-mon[35055]: Adjusting osd_memory_target on smithi160 to 4272M 2024-09-11T23:15:17.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:16 smithi160 ceph-mon[35055]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]': finished 2024-09-11T23:15:17.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:16 smithi160 ceph-mon[35055]: osdmap e75: 12 total, 11 up, 12 in 2024-09-11T23:15:17.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:16 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T23:15:17.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:16 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T23:15:17.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:16 smithi160 ceph-mon[35055]: from='client.? 172.21.15.37:0/2214245456' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-11T23:15:17.766 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":75,"num_osds":12,"num_up_osds":11,"osd_up_since":1726096490,"num_in_osds":12,"osd_in_since":1726096494,"num_remapped_pgs":0} 2024-09-11T23:15:18.252 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:17 smithi123 ceph-mon[35438]: purged_snaps scrub starts 2024-09-11T23:15:18.252 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:17 smithi123 ceph-mon[35438]: purged_snaps scrub ok 2024-09-11T23:15:18.252 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:17 smithi123 ceph-mon[35438]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-09-11T23:15:18.252 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:17 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T23:15:18.253 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:17 smithi123 ceph-mon[35438]: osd.11 [v2:172.21.15.160:6824/3982315018,v1:172.21.15.160:6825/3982315018] boot 2024-09-11T23:15:18.253 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:17 smithi123 ceph-mon[35438]: osdmap e76: 12 total, 12 up, 12 in 2024-09-11T23:15:18.253 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:17 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T23:15:18.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:17 smithi037 ceph-mon[30630]: purged_snaps scrub starts 2024-09-11T23:15:18.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:17 smithi037 ceph-mon[30630]: purged_snaps scrub ok 2024-09-11T23:15:18.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:17 smithi037 ceph-mon[30630]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-09-11T23:15:18.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:17 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T23:15:18.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:17 smithi037 ceph-mon[30630]: osd.11 [v2:172.21.15.160:6824/3982315018,v1:172.21.15.160:6825/3982315018] boot 2024-09-11T23:15:18.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:17 smithi037 ceph-mon[30630]: osdmap e76: 12 total, 12 up, 12 in 2024-09-11T23:15:18.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:17 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T23:15:18.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:17 smithi160 ceph-mon[35055]: purged_snaps scrub starts 2024-09-11T23:15:18.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:17 smithi160 ceph-mon[35055]: purged_snaps scrub ok 2024-09-11T23:15:18.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:17 smithi160 ceph-mon[35055]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-09-11T23:15:18.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:17 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T23:15:18.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:17 smithi160 ceph-mon[35055]: osd.11 [v2:172.21.15.160:6824/3982315018,v1:172.21.15.160:6825/3982315018] boot 2024-09-11T23:15:18.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:17 smithi160 ceph-mon[35055]: osdmap e76: 12 total, 12 up, 12 in 2024-09-11T23:15:18.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:17 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T23:15:18.767 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-11T23:15:19.158 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:15:19.297 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:19 smithi037 ceph-mon[30630]: osdmap e77: 12 total, 12 up, 12 in 2024-09-11T23:15:19.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:19 smithi160 ceph-mon[35055]: osdmap e77: 12 total, 12 up, 12 in 2024-09-11T23:15:19.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:19 smithi123 ceph-mon[35438]: osdmap e77: 12 total, 12 up, 12 in 2024-09-11T23:15:19.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:19.745+0000 7f2e7be00640 1 -- 172.21.15.37:0/710418136 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e7c103c50 msgr2=0x7f2e7c104050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:19.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:19.745+0000 7f2e7be00640 1 --2- 172.21.15.37:0/710418136 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e7c103c50 0x7f2e7c104050 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2e6c009900 tx=0x7f2e6c02a3f0 comp rx=0 tx=0).stop 2024-09-11T23:15:19.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:19.745+0000 7f2e7be00640 1 -- 172.21.15.37:0/710418136 shutdown_connections 2024-09-11T23:15:19.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:19.745+0000 7f2e7be00640 1 --2- 172.21.15.37:0/710418136 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e7c105810 0x7f2e7c10c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:19.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:19.745+0000 7f2e7be00640 1 --2- 172.21.15.37:0/710418136 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2e7c104e50 0x7f2e7c1052d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:19.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:19.745+0000 7f2e7be00640 1 --2- 172.21.15.37:0/710418136 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e7c103c50 0x7f2e7c104050 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:19.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:19.745+0000 7f2e7be00640 1 -- 172.21.15.37:0/710418136 >> 172.21.15.37:0/710418136 conn(0x7f2e7c0ff3e0 msgr2=0x7f2e7c101820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:19.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:19.745+0000 7f2e7be00640 1 -- 172.21.15.37:0/710418136 shutdown_connections 2024-09-11T23:15:19.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:19.745+0000 7f2e7be00640 1 -- 172.21.15.37:0/710418136 wait complete. 2024-09-11T23:15:19.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:19.746+0000 7f2e7be00640 1 Processor -- start 2024-09-11T23:15:19.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:19.746+0000 7f2e7be00640 1 -- start start 2024-09-11T23:15:19.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:19.746+0000 7f2e7be00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2e7c103c50 0x7f2e7c199f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:19.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:19.746+0000 7f2e7be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e7c104e50 0x7f2e7c19a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:19.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:19.746+0000 7f2e7be00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e7c105810 0x7f2e7c1a1500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:19.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:19.746+0000 7f2e7be00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2e7c10f8d0 con 0x7f2e7c104e50 2024-09-11T23:15:19.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:19.746+0000 7f2e7be00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f2e7c10f750 con 0x7f2e7c105810 2024-09-11T23:15:19.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:19.746+0000 7f2e7be00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f2e7c10fa50 con 0x7f2e7c103c50 2024-09-11T23:15:19.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:19.747+0000 7f2e73e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e7c104e50 0x7f2e7c19a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:19.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:19.747+0000 7f2e73e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e7c104e50 0x7f2e7c19a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51478/0 (socket says 172.21.15.37:51478) 2024-09-11T23:15:19.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:19.747+0000 7f2e73e00640 1 -- 172.21.15.37:0/1551784024 learned_addr learned my addr 172.21.15.37:0/1551784024 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:15:19.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:19.747+0000 7f2e7aa00640 1 --2- 172.21.15.37:0/1551784024 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2e7c103c50 0x7f2e7c199f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:19.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:19.747+0000 7f2e7b400640 1 --2- 172.21.15.37:0/1551784024 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e7c105810 0x7f2e7c1a1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:19.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:19.747+0000 7f2e73e00640 1 -- 172.21.15.37:0/1551784024 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2e7c103c50 msgr2=0x7f2e7c199f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:19.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:19.747+0000 7f2e73e00640 1 --2- 172.21.15.37:0/1551784024 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2e7c103c50 0x7f2e7c199f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:19.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:19.747+0000 7f2e73e00640 1 -- 172.21.15.37:0/1551784024 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e7c105810 msgr2=0x7f2e7c1a1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:19.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:19.747+0000 7f2e73e00640 1 --2- 172.21.15.37:0/1551784024 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e7c105810 0x7f2e7c1a1500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:19.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:19.747+0000 7f2e73e00640 1 -- 172.21.15.37:0/1551784024 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e7c1a1b70 con 0x7f2e7c104e50 2024-09-11T23:15:19.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:19.748+0000 7f2e73e00640 1 --2- 172.21.15.37:0/1551784024 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e7c104e50 0x7f2e7c19a480 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2e6400e9f0 tx=0x7f2e6400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:19.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:19.748+0000 7f2e73400640 1 -- 172.21.15.37:0/1551784024 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e6400cd80 con 0x7f2e7c104e50 2024-09-11T23:15:19.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:19.748+0000 7f2e73400640 1 -- 172.21.15.37:0/1551784024 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2e64005500 con 0x7f2e7c104e50 2024-09-11T23:15:19.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:19.748+0000 7f2e73400640 1 -- 172.21.15.37:0/1551784024 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e64010690 con 0x7f2e7c104e50 2024-09-11T23:15:19.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:19.748+0000 7f2e7be00640 1 -- 172.21.15.37:0/1551784024 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e7c1a1e60 con 0x7f2e7c104e50 2024-09-11T23:15:19.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:19.748+0000 7f2e7be00640 1 -- 172.21.15.37:0/1551784024 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e7c1a22c0 con 0x7f2e7c104e50 2024-09-11T23:15:19.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:19.749+0000 7f2e7be00640 1 -- 172.21.15.37:0/1551784024 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e7c10b050 con 0x7f2e7c104e50 2024-09-11T23:15:19.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:19.752+0000 7f2e73400640 1 -- 172.21.15.37:0/1551784024 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f2e640046c0 con 0x7f2e7c104e50 2024-09-11T23:15:19.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:19.753+0000 7f2e73400640 1 --2- 172.21.15.37:0/1551784024 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f2e600a2bb0 0x7f2e600a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:19.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:19.753+0000 7f2e73400640 1 -- 172.21.15.37:0/1551784024 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f2e640cf190 con 0x7f2e7c104e50 2024-09-11T23:15:19.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:19.753+0000 7f2e7aa00640 1 --2- 172.21.15.37:0/1551784024 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f2e600a2bb0 0x7f2e600a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:19.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:19.754+0000 7f2e7aa00640 1 --2- 172.21.15.37:0/1551784024 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f2e600a2bb0 0x7f2e600a5070 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2e6c005ab0 tx=0x7f2e6c000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:19.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:19.755+0000 7f2e73400640 1 -- 172.21.15.37:0/1551784024 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2e640541b0 con 0x7f2e7c104e50 2024-09-11T23:15:19.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:19.938+0000 7f2e7be00640 1 -- 172.21.15.37:0/1551784024 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f2e7c02da10 con 0x7f2e7c104e50 2024-09-11T23:15:19.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:19.938+0000 7f2e73400640 1 -- 172.21.15.37:0/1551784024 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v77) ==== 74+0+133 (secure 0 0 0) 0x7f2e6409c4f0 con 0x7f2e7c104e50 2024-09-11T23:15:19.940 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:15:19.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:19.940+0000 7f2e7be00640 1 -- 172.21.15.37:0/1551784024 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f2e600a2bb0 msgr2=0x7f2e600a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:19.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:19.940+0000 7f2e7be00640 1 --2- 172.21.15.37:0/1551784024 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f2e600a2bb0 0x7f2e600a5070 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2e6c005ab0 tx=0x7f2e6c000bc0 comp rx=0 tx=0).stop 2024-09-11T23:15:19.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:19.940+0000 7f2e7be00640 1 -- 172.21.15.37:0/1551784024 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e7c104e50 msgr2=0x7f2e7c19a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:19.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:19.940+0000 7f2e7be00640 1 --2- 172.21.15.37:0/1551784024 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e7c104e50 0x7f2e7c19a480 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2e6400e9f0 tx=0x7f2e6400edf0 comp rx=0 tx=0).stop 2024-09-11T23:15:19.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:19.941+0000 7f2e7be00640 1 -- 172.21.15.37:0/1551784024 shutdown_connections 2024-09-11T23:15:19.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:19.941+0000 7f2e7be00640 1 --2- 172.21.15.37:0/1551784024 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f2e600a2bb0 0x7f2e600a5070 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:19.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:19.941+0000 7f2e7be00640 1 --2- 172.21.15.37:0/1551784024 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e7c105810 0x7f2e7c1a1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:19.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:19.941+0000 7f2e7be00640 1 --2- 172.21.15.37:0/1551784024 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e7c104e50 0x7f2e7c19a480 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:19.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:19.941+0000 7f2e7be00640 1 --2- 172.21.15.37:0/1551784024 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2e7c103c50 0x7f2e7c199f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:19.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:19.941+0000 7f2e7be00640 1 -- 172.21.15.37:0/1551784024 >> 172.21.15.37:0/1551784024 conn(0x7f2e7c0ff3e0 msgr2=0x7f2e7c108220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:19.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:19.941+0000 7f2e7be00640 1 -- 172.21.15.37:0/1551784024 shutdown_connections 2024-09-11T23:15:19.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:19.941+0000 7f2e7be00640 1 -- 172.21.15.37:0/1551784024 wait complete. 2024-09-11T23:15:20.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:20 smithi037 ceph-mon[30630]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:15:20.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:20 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/1551784024' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-11T23:15:20.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:20 smithi160 ceph-mon[35055]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:15:20.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:20 smithi160 ceph-mon[35055]: from='client.? 172.21.15.37:0/1551784024' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-11T23:15:20.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:20 smithi123 ceph-mon[35438]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:15:20.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:20 smithi123 ceph-mon[35438]: from='client.? 172.21.15.37:0/1551784024' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-11T23:15:20.812 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":77,"num_osds":12,"num_up_osds":12,"osd_up_since":1726096516,"num_in_osds":12,"osd_in_since":1726096494,"num_remapped_pgs":0} 2024-09-11T23:15:20.813 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T23:15:21.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:21 smithi037 ceph-mon[30630]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:15:21.186 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:15:21.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:21 smithi160 ceph-mon[35055]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:15:21.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:21 smithi123 ceph-mon[35438]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:15:21.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:21.772+0000 7ff79b000640 1 -- 172.21.15.37:0/2818325891 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff794105f40 msgr2=0x7ff7941063d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:21.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:21.772+0000 7ff79b000640 1 --2- 172.21.15.37:0/2818325891 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff794105f40 0x7ff7941063d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff78c009ca0 tx=0x7ff78c02a940 comp rx=0 tx=0).stop 2024-09-11T23:15:21.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:21.772+0000 7ff79b000640 1 -- 172.21.15.37:0/2818325891 shutdown_connections 2024-09-11T23:15:21.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:21.772+0000 7ff79b000640 1 --2- 172.21.15.37:0/2818325891 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff794105f40 0x7ff7941063d0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:21.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:21.772+0000 7ff79b000640 1 --2- 172.21.15.37:0/2818325891 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff794101450 0x7ff794105920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:21.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:21.772+0000 7ff79b000640 1 --2- 172.21.15.37:0/2818325891 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff794100b30 0x7ff794100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:21.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:21.772+0000 7ff79b000640 1 -- 172.21.15.37:0/2818325891 >> 172.21.15.37:0/2818325891 conn(0x7ff7940fc7a0 msgr2=0x7ff7940febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:21.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:21.772+0000 7ff79b000640 1 -- 172.21.15.37:0/2818325891 shutdown_connections 2024-09-11T23:15:21.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:21.772+0000 7ff79b000640 1 -- 172.21.15.37:0/2818325891 wait complete. 2024-09-11T23:15:21.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:21.773+0000 7ff79b000640 1 Processor -- start 2024-09-11T23:15:21.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:21.773+0000 7ff79b000640 1 -- start start 2024-09-11T23:15:21.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:21.774+0000 7ff79b000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff794100b30 0x7ff7941a46c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:21.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:21.774+0000 7ff79b000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff794101450 0x7ff7941a4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:21.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:21.774+0000 7ff79b000640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff794105f40 0x7ff79419e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:21.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:21.774+0000 7ff79b000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff7941185d0 con 0x7ff794100b30 2024-09-11T23:15:21.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:21.774+0000 7ff79b000640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7ff794118450 con 0x7ff794101450 2024-09-11T23:15:21.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:21.774+0000 7ff79b000640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7ff794118750 con 0x7ff794105f40 2024-09-11T23:15:21.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:21.774+0000 7ff793e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff794100b30 0x7ff7941a46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:21.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:21.774+0000 7ff78be00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff794101450 0x7ff7941a4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:21.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:21.774+0000 7ff793e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff794100b30 0x7ff7941a46c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51494/0 (socket says 172.21.15.37:51494) 2024-09-11T23:15:21.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:21.774+0000 7ff793e00640 1 -- 172.21.15.37:0/3501304247 learned_addr learned my addr 172.21.15.37:0/3501304247 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:15:21.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:21.774+0000 7ff799000640 1 --2- 172.21.15.37:0/3501304247 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff794105f40 0x7ff79419e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:21.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:21.774+0000 7ff78be00640 1 -- 172.21.15.37:0/3501304247 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff794105f40 msgr2=0x7ff79419e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:21.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:21.774+0000 7ff78be00640 1 --2- 172.21.15.37:0/3501304247 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff794105f40 0x7ff79419e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:21.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:21.774+0000 7ff78be00640 1 -- 172.21.15.37:0/3501304247 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff794100b30 msgr2=0x7ff7941a46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:21.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:21.774+0000 7ff78be00640 1 --2- 172.21.15.37:0/3501304247 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff794100b30 0x7ff7941a46c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:21.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:21.774+0000 7ff78be00640 1 -- 172.21.15.37:0/3501304247 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff79419efe0 con 0x7ff794101450 2024-09-11T23:15:21.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:21.774+0000 7ff793e00640 1 --2- 172.21.15.37:0/3501304247 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff794100b30 0x7ff7941a46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:15:21.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:21.775+0000 7ff78be00640 1 --2- 172.21.15.37:0/3501304247 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff794101450 0x7ff7941a4c00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff77c00e7c0 tx=0x7ff77c00ec80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:21.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:21.775+0000 7ff791600640 1 -- 172.21.15.37:0/3501304247 <== mon.2 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff77c009530 con 0x7ff794101450 2024-09-11T23:15:21.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:21.775+0000 7ff791600640 1 -- 172.21.15.37:0/3501304247 <== mon.2 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff77c00ccc0 con 0x7ff794101450 2024-09-11T23:15:21.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:21.775+0000 7ff79b000640 1 -- 172.21.15.37:0/3501304247 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff79419f2d0 con 0x7ff794101450 2024-09-11T23:15:21.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:21.775+0000 7ff791600640 1 -- 172.21.15.37:0/3501304247 <== mon.2 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff77c004a00 con 0x7ff794101450 2024-09-11T23:15:21.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:21.775+0000 7ff79b000640 1 -- 172.21.15.37:0/3501304247 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7941ab520 con 0x7ff794101450 2024-09-11T23:15:21.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:21.776+0000 7ff79b000640 1 -- 172.21.15.37:0/3501304247 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff79406b070 con 0x7ff794101450 2024-09-11T23:15:21.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:21.779+0000 7ff791600640 1 -- 172.21.15.37:0/3501304247 <== mon.2 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7ff77c004ba0 con 0x7ff794101450 2024-09-11T23:15:21.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:21.779+0000 7ff791600640 1 --2- 172.21.15.37:0/3501304247 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7ff7780a2b80 0x7ff7780a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:21.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:21.780+0000 7ff791600640 1 -- 172.21.15.37:0/3501304247 <== mon.2 v2:172.21.15.123:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7ff77c0cea30 con 0x7ff794101450 2024-09-11T23:15:21.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:21.780+0000 7ff793e00640 1 --2- 172.21.15.37:0/3501304247 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7ff7780a2b80 0x7ff7780a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:21.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:21.780+0000 7ff793e00640 1 --2- 172.21.15.37:0/3501304247 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7ff7780a2b80 0x7ff7780a5040 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff784005fd0 tx=0x7ff78400b4a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:21.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:21.782+0000 7ff791600640 1 -- 172.21.15.37:0/3501304247 <== mon.2 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff77c09bd90 con 0x7ff794101450 2024-09-11T23:15:21.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:21.969+0000 7ff79b000640 1 -- 172.21.15.37:0/3501304247 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff7941ab750 con 0x7ff794101450 2024-09-11T23:15:21.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:21.971+0000 7ff791600640 1 -- 172.21.15.37:0/3501304247 <== mon.2 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) ==== 74+0+18457 (secure 0 0 0) 0x7ff77c09b690 con 0x7ff794101450 2024-09-11T23:15:21.972 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:15:21.972 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":77,"fsid":"8b03efce-7092-11ef-bcea-c7b262605968","created":"2024-09-11T23:07:59.386838+0000","modified":"2024-09-11T23:15:17.993429+0000","last_up_change":"2024-09-11T23:15:16.985748+0000","last_in_change":"2024-09-11T23:14:54.154116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:11:16.547642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f76ccb11-fe3b-4df1-9a71-e6ca50de80e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1678472768},{"type":"v1","addr":"172.21.15.37:6803","nonce":1678472768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1678472768},{"type":"v1","addr":"172.21.15.37:6805","nonce":1678472768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1678472768},{"type":"v1","addr":"172.21.15.37:6809","nonce":1678472768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1678472768},{"type":"v1","addr":"172.21.15.37:6807","nonce":1678472768}]},"public_addr":"172.21.15.37:6803/1678472768","cluster_addr":"172.21.15.37:6805/1678472768","heartbeat_back_addr":"172.21.15.37:6809/1678472768","heartbeat_front_addr":"172.21.15.37:6807/1678472768","state":["exists","up"]},{"osd":1,"uuid":"13d26eed-1160-4b15-b66b-66c89066c66f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":141504725},{"type":"v1","addr":"172.21.15.123:6801","nonce":141504725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":141504725},{"type":"v1","addr":"172.21.15.123:6803","nonce":141504725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":141504725},{"type":"v1","addr":"172.21.15.123:6807","nonce":141504725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":141504725},{"type":"v1","addr":"172.21.15.123:6805","nonce":141504725}]},"public_addr":"172.21.15.123:6801/141504725","cluster_addr":"172.21.15.123:6803/141504725","heartbeat_back_addr":"172.21.15.123:6807/141504725","heartbeat_front_addr":"172.21.15.123:6805/141504725","state":["exists","up"]},{"osd":2,"uuid":"53daf4d5-2a43-4a89-bae9-f32b89b517f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":1866489133},{"type":"v1","addr":"172.21.15.160:6801","nonce":1866489133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":1866489133},{"type":"v1","addr":"172.21.15.160:6803","nonce":1866489133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":1866489133},{"type":"v1","addr":"172.21.15.160:6807","nonce":1866489133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":1866489133},{"type":"v1","addr":"172.21.15.160:6805","nonce":1866489133}]},"public_addr":"172.21.15.160:6801/1866489133","cluster_addr":"172.21.15.160:6803/1866489133","heartbeat_back_addr":"172.21.15.160:6807/1866489133","heartbeat_front_addr":"172.21.15.160:6805/1866489133","state":["exists","up"]},{"osd":3,"uuid":"7c819225-964b-44f2-93e5-1d7585eb0b36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":412656036},{"type":"v1","addr":"172.21.15.37:6811","nonce":412656036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":412656036},{"type":"v1","addr":"172.21.15.37:6813","nonce":412656036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":412656036},{"type":"v1","addr":"172.21.15.37:6817","nonce":412656036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":412656036},{"type":"v1","addr":"172.21.15.37:6815","nonce":412656036}]},"public_addr":"172.21.15.37:6811/412656036","cluster_addr":"172.21.15.37:6813/412656036","heartbeat_back_addr":"172.21.15.37:6817/412656036","heartbeat_front_addr":"172.21.15.37:6815/412656036","state":["exists","up"]},{"osd":4,"uuid":"e5ab5638-8c7e-4433-8dd0-ba57e28f39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":3228822066},{"type":"v1","addr":"172.21.15.123:6809","nonce":3228822066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":3228822066},{"type":"v1","addr":"172.21.15.123:6811","nonce":3228822066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":3228822066},{"type":"v1","addr":"172.21.15.123:6815","nonce":3228822066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":3228822066},{"type":"v1","addr":"172.21.15.123:6813","nonce":3228822066}]},"public_addr":"172.21.15.123:6809/3228822066","cluster_addr":"172.21.15.123:6811/3228822066","heartbeat_back_addr":"172.21.15.123:6815/3228822066","heartbeat_front_addr":"172.21.15.123:6813/3228822066","state":["exists","up"]},{"osd":5,"uuid":"7f080d49-eec8-4cd9-b410-b2e84139292e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":1618319675},{"type":"v1","addr":"172.21.15.160:6809","nonce":1618319675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":1618319675},{"type":"v1","addr":"172.21.15.160:6811","nonce":1618319675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":1618319675},{"type":"v1","addr":"172.21.15.160:6815","nonce":1618319675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":1618319675},{"type":"v1","addr":"172.21.15.160:6813","nonce":1618319675}]},"public_addr":"172.21.15.160:6809/1618319675","cluster_addr":"172.21.15.160:6811/1618319675","heartbeat_back_addr":"172.21.15.160:6815/1618319675","heartbeat_front_addr":"172.21.15.160:6813/1618319675","state":["exists","up"]},{"osd":6,"uuid":"d0881c4e-bd8d-4575-8c81-94d21825c227","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3541251299},{"type":"v1","addr":"172.21.15.37:6819","nonce":3541251299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3541251299},{"type":"v1","addr":"172.21.15.37:6821","nonce":3541251299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":3541251299},{"type":"v1","addr":"172.21.15.37:6825","nonce":3541251299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3541251299},{"type":"v1","addr":"172.21.15.37:6823","nonce":3541251299}]},"public_addr":"172.21.15.37:6819/3541251299","cluster_addr":"172.21.15.37:6821/3541251299","heartbeat_back_addr":"172.21.15.37:6825/3541251299","heartbeat_front_addr":"172.21.15.37:6823/3541251299","state":["exists","up"]},{"osd":7,"uuid":"04fbec2e-91b5-4a89-a4a3-472398c45288","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":4279933341},{"type":"v1","addr":"172.21.15.123:6817","nonce":4279933341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":4279933341},{"type":"v1","addr":"172.21.15.123:6819","nonce":4279933341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":4279933341},{"type":"v1","addr":"172.21.15.123:6823","nonce":4279933341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":4279933341},{"type":"v1","addr":"172.21.15.123:6821","nonce":4279933341}]},"public_addr":"172.21.15.123:6817/4279933341","cluster_addr":"172.21.15.123:6819/4279933341","heartbeat_back_addr":"172.21.15.123:6823/4279933341","heartbeat_front_addr":"172.21.15.123:6821/4279933341","state":["exists","up"]},{"osd":8,"uuid":"c77090a7-308e-4c6d-a56e-ce6f8e050ae5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":740968584},{"type":"v1","addr":"172.21.15.160:6817","nonce":740968584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":740968584},{"type":"v1","addr":"172.21.15.160:6819","nonce":740968584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":740968584},{"type":"v1","addr":"172.21.15.160:6823","nonce":740968584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":740968584},{"type":"v1","addr":"172.21.15.160:6821","nonce":740968584}]},"public_addr":"172.21.15.160:6817/740968584","cluster_addr":"172.21.15.160:6819/740968584","heartbeat_back_addr":"172.21.15.160:6823/740968584","heartbeat_front_addr":"172.21.15.160:6821/740968584","state":["exists","up"]},{"osd":9,"uuid":"bcd19bd4-88bc-46f7-b48c-af9e3d17aa96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":692114850},{"type":"v1","addr":"172.21.15.37:6827","nonce":692114850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":692114850},{"type":"v1","addr":"172.21.15.37:6829","nonce":692114850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":692114850},{"type":"v1","addr":"172.21.15.37:6833","nonce":692114850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":692114850},{"type":"v1","addr":"172.21.15.37:6831","nonce":692114850}]},"public_addr":"172.21.15.37:6827/692114850","cluster_addr":"172.21.15.37:6829/692114850","heartbeat_back_addr":"172.21.15.37:6833/692114850","heartbeat_front_addr":"172.21.15.37:6831/692114850","state":["exists","up"]},{"osd":10,"uuid":"9e956e6c-c28a-4a4c-b385-c458788858ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":471058996},{"type":"v1","addr":"172.21.15.123:6825","nonce":471058996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":471058996},{"type":"v1","addr":"172.21.15.123:6827","nonce":471058996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":471058996},{"type":"v1","addr":"172.21.15.123:6831","nonce":471058996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":471058996},{"type":"v1","addr":"172.21.15.123:6829","nonce":471058996}]},"public_addr":"172.21.15.123:6825/471058996","cluster_addr":"172.21.15.123:6827/471058996","heartbeat_back_addr":"172.21.15.123:6831/471058996","heartbeat_front_addr":"172.21.15.123:6829/471058996","state":["exists","up"]},{"osd":11,"uuid":"0b5b3364-9a40-4cab-90d4-b7b1cba57bc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":3982315018},{"type":"v1","addr":"172.21.15.160:6825","nonce":3982315018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3982315018},{"type":"v1","addr":"172.21.15.160:6827","nonce":3982315018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3982315018},{"type":"v1","addr":"172.21.15.160:6831","nonce":3982315018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3982315018},{"type":"v1","addr":"172.21.15.160:6829","nonce":3982315018}]},"public_addr":"172.21.15.160:6825/3982315018","cluster_addr":"172.21.15.160:6827/3982315018","heartbeat_back_addr":"172.21.15.160:6831/3982315018","heartbeat_front_addr":"172.21.15.160:6829/3982315018","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:10:21.139833+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:10:47.004960+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:11:11.460263+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:11:40.849286+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:12:06.497448+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:12:32.043206+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:13:01.402019+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:13:27.993489+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:13:52.291643+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:23.840299+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:49.448254+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:15:15.310947+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:6801/2886800769":"2024-09-12T23:08:51.934167+0000","172.21.15.37:0/1811301224":"2024-09-12T23:08:51.934167+0000","172.21.15.37:0/513883980":"2024-09-12T23:08:51.934167+0000","172.21.15.37:0/3698260188":"2024-09-12T23:08:23.793913+0000","172.21.15.37:6800/2886800769":"2024-09-12T23:08:51.934167+0000","172.21.15.37:0/4134736061":"2024-09-12T23:08:23.793913+0000","172.21.15.37:0/3426758476":"2024-09-12T23:08:51.934167+0000","172.21.15.37:0/2545840561":"2024-09-12T23:08:23.793913+0000","172.21.15.37:6801/3447426643":"2024-09-12T23:08:23.793913+0000","172.21.15.37:6800/3447426643":"2024-09-12T23:08:23.793913+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:15:21.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:21.973+0000 7ff79b000640 1 -- 172.21.15.37:0/3501304247 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7ff7780a2b80 msgr2=0x7ff7780a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:21.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:21.973+0000 7ff79b000640 1 --2- 172.21.15.37:0/3501304247 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7ff7780a2b80 0x7ff7780a5040 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff784005fd0 tx=0x7ff78400b4a0 comp rx=0 tx=0).stop 2024-09-11T23:15:21.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:21.973+0000 7ff79b000640 1 -- 172.21.15.37:0/3501304247 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff794101450 msgr2=0x7ff7941a4c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:21.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:21.973+0000 7ff79b000640 1 --2- 172.21.15.37:0/3501304247 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff794101450 0x7ff7941a4c00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff77c00e7c0 tx=0x7ff77c00ec80 comp rx=0 tx=0).stop 2024-09-11T23:15:21.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:21.973+0000 7ff79b000640 1 -- 172.21.15.37:0/3501304247 shutdown_connections 2024-09-11T23:15:21.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:21.973+0000 7ff79b000640 1 --2- 172.21.15.37:0/3501304247 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7ff7780a2b80 0x7ff7780a5040 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:21.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:21.973+0000 7ff79b000640 1 --2- 172.21.15.37:0/3501304247 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff794101450 0x7ff7941a4c00 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:21.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:21.973+0000 7ff79b000640 1 --2- 172.21.15.37:0/3501304247 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff794105f40 0x7ff79419e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:21.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:21.973+0000 7ff79b000640 1 --2- 172.21.15.37:0/3501304247 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff794100b30 0x7ff7941a46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:21.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:21.973+0000 7ff79b000640 1 -- 172.21.15.37:0/3501304247 >> 172.21.15.37:0/3501304247 conn(0x7ff7940fc7a0 msgr2=0x7ff7941038c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:21.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:21.974+0000 7ff79b000640 1 -- 172.21.15.37:0/3501304247 shutdown_connections 2024-09-11T23:15:21.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:21.974+0000 7ff79b000640 1 -- 172.21.15.37:0/3501304247 wait complete. 2024-09-11T23:15:22.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:22 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/3501304247' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:15:22.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:22 smithi160 ceph-mon[35055]: from='client.? 172.21.15.37:0/3501304247' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:15:22.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:22 smithi123 ceph-mon[35438]: from='client.? 172.21.15.37:0/3501304247' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:15:22.814 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-11T23:11:16.547642+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-11T23:15:22.814 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-11T23:15:23.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:23 smithi037 ceph-mon[30630]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:15:23.188 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:15:23.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:23 smithi160 ceph-mon[35055]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:15:23.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:23 smithi123 ceph-mon[35438]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:15:23.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:23.743+0000 7f2801400640 1 -- 172.21.15.37:0/1852413749 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27fc1019c0 msgr2=0x7f27fc101e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:23.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:23.743+0000 7f2801400640 1 --2- 172.21.15.37:0/1852413749 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27fc1019c0 0x7f27fc101e20 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f27e4009930 tx=0x7f27e402a420 comp rx=0 tx=0).stop 2024-09-11T23:15:23.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:23.743+0000 7f2801400640 1 -- 172.21.15.37:0/1852413749 shutdown_connections 2024-09-11T23:15:23.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:23.743+0000 7f2801400640 1 --2- 172.21.15.37:0/1852413749 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f27fc102360 0x7f27fc10e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:23.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:23.743+0000 7f2801400640 1 --2- 172.21.15.37:0/1852413749 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27fc1019c0 0x7f27fc101e20 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:23.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:23.743+0000 7f2801400640 1 --2- 172.21.15.37:0/1852413749 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f27fc1079c0 0x7f27fc107da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:23.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:23.743+0000 7f2801400640 1 -- 172.21.15.37:0/1852413749 >> 172.21.15.37:0/1852413749 conn(0x7f27fc0fd740 msgr2=0x7f27fc0ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:23.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:23.743+0000 7f2801400640 1 -- 172.21.15.37:0/1852413749 shutdown_connections 2024-09-11T23:15:23.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:23.743+0000 7f2801400640 1 -- 172.21.15.37:0/1852413749 wait complete. 2024-09-11T23:15:23.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:23.744+0000 7f2801400640 1 Processor -- start 2024-09-11T23:15:23.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:23.744+0000 7f2801400640 1 -- start start 2024-09-11T23:15:23.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:23.745+0000 7f2801400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f27fc1019c0 0x7f27fc0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:23.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:23.745+0000 7f2801400640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f27fc102360 0x7f27fc074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:23.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:23.745+0000 7f2801400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27fc1079c0 0x7f27fc074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:23.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:23.745+0000 7f2801400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f27fc111e10 con 0x7f27fc1079c0 2024-09-11T23:15:23.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:23.745+0000 7f2801400640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f27fc111c90 con 0x7f27fc1019c0 2024-09-11T23:15:23.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:23.745+0000 7f2801400640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f27fc111f90 con 0x7f27fc102360 2024-09-11T23:15:23.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:23.745+0000 7f27f3400640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f27fc102360 0x7f27fc074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:23.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:23.745+0000 7f27f3400640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f27fc102360 0x7f27fc074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.37:43040/0 (socket says 172.21.15.37:43040) 2024-09-11T23:15:23.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:23.745+0000 7f27f3400640 1 -- 172.21.15.37:0/730135564 learned_addr learned my addr 172.21.15.37:0/730135564 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:15:23.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:23.745+0000 7f27fbe00640 1 --2- 172.21.15.37:0/730135564 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f27fc1019c0 0x7f27fc0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:23.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:23.745+0000 7f2800a00640 1 --2- 172.21.15.37:0/730135564 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27fc1079c0 0x7f27fc074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:23.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:23.745+0000 7f27f3400640 1 -- 172.21.15.37:0/730135564 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f27fc1019c0 msgr2=0x7f27fc0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:23.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:23.745+0000 7f27f3400640 1 --2- 172.21.15.37:0/730135564 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f27fc1019c0 0x7f27fc0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:23.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:23.745+0000 7f27f3400640 1 -- 172.21.15.37:0/730135564 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27fc1079c0 msgr2=0x7f27fc074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:23.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:23.745+0000 7f27f3400640 1 --2- 172.21.15.37:0/730135564 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27fc1079c0 0x7f27fc074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:23.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:23.745+0000 7f27f3400640 1 -- 172.21.15.37:0/730135564 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27fc1a6830 con 0x7f27fc102360 2024-09-11T23:15:23.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:23.746+0000 7f27f3400640 1 --2- 172.21.15.37:0/730135564 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f27fc102360 0x7f27fc074a30 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f27e402a940 tx=0x7f27e4003b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:23.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:23.746+0000 7f27f9600640 1 -- 172.21.15.37:0/730135564 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27e403f070 con 0x7f27fc102360 2024-09-11T23:15:23.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:23.746+0000 7f2801400640 1 -- 172.21.15.37:0/730135564 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27fc1a6ac0 con 0x7f27fc102360 2024-09-11T23:15:23.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:23.746+0000 7f27f9600640 1 -- 172.21.15.37:0/730135564 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f27e4031c90 con 0x7f27fc102360 2024-09-11T23:15:23.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:23.746+0000 7f2801400640 1 -- 172.21.15.37:0/730135564 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27fc1a6ff0 con 0x7f27fc102360 2024-09-11T23:15:23.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:23.746+0000 7f27f9600640 1 -- 172.21.15.37:0/730135564 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27e4049060 con 0x7f27fc102360 2024-09-11T23:15:23.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:23.747+0000 7f2801400640 1 -- 172.21.15.37:0/730135564 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27fc101e20 con 0x7f27fc102360 2024-09-11T23:15:23.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:23.749+0000 7f27f9600640 1 -- 172.21.15.37:0/730135564 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f27e4042070 con 0x7f27fc102360 2024-09-11T23:15:23.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:23.750+0000 7f27f9600640 1 --2- 172.21.15.37:0/730135564 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f27e00a2c00 0x7f27e00a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:23.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:23.751+0000 7f27f9600640 1 -- 172.21.15.37:0/730135564 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f27e40ef3d0 con 0x7f27fc102360 2024-09-11T23:15:23.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:23.751+0000 7f27fbe00640 1 --2- 172.21.15.37:0/730135564 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f27e00a2c00 0x7f27e00a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:23.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:23.751+0000 7f27fbe00640 1 --2- 172.21.15.37:0/730135564 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f27e00a2c00 0x7f27e00a50c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f27ec005fd0 tx=0x7f27ec00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:23.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:23.753+0000 7f27f9600640 1 -- 172.21.15.37:0/730135564 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f27e40bc0e0 con 0x7f27fc102360 2024-09-11T23:15:23.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:23.939+0000 7f2801400640 1 -- 172.21.15.37:0/730135564 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f27fc109f30 con 0x7f27fc102360 2024-09-11T23:15:23.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:23.940+0000 7f27f9600640 1 -- 172.21.15.37:0/730135564 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v77) ==== 93+0+10 (secure 0 0 0) 0x7f27e40c03e0 con 0x7f27fc102360 2024-09-11T23:15:23.940 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2024-09-11T23:15:23.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:23.942+0000 7f2801400640 1 -- 172.21.15.37:0/730135564 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f27e00a2c00 msgr2=0x7f27e00a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:23.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:23.942+0000 7f2801400640 1 --2- 172.21.15.37:0/730135564 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f27e00a2c00 0x7f27e00a50c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f27ec005fd0 tx=0x7f27ec00b390 comp rx=0 tx=0).stop 2024-09-11T23:15:23.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:23.942+0000 7f2801400640 1 -- 172.21.15.37:0/730135564 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f27fc102360 msgr2=0x7f27fc074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:23.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:23.942+0000 7f2801400640 1 --2- 172.21.15.37:0/730135564 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f27fc102360 0x7f27fc074a30 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f27e402a940 tx=0x7f27e4003b90 comp rx=0 tx=0).stop 2024-09-11T23:15:23.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:23.942+0000 7f2801400640 1 -- 172.21.15.37:0/730135564 shutdown_connections 2024-09-11T23:15:23.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:23.942+0000 7f2801400640 1 --2- 172.21.15.37:0/730135564 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f27e00a2c00 0x7f27e00a50c0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:23.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:23.942+0000 7f2801400640 1 --2- 172.21.15.37:0/730135564 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27fc1079c0 0x7f27fc074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:23.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:23.942+0000 7f2801400640 1 --2- 172.21.15.37:0/730135564 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f27fc102360 0x7f27fc074a30 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:23.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:23.942+0000 7f2801400640 1 --2- 172.21.15.37:0/730135564 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f27fc1019c0 0x7f27fc0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:23.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:23.942+0000 7f2801400640 1 -- 172.21.15.37:0/730135564 >> 172.21.15.37:0/730135564 conn(0x7f27fc0fd740 msgr2=0x7f27fc0fe050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:23.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:23.942+0000 7f2801400640 1 -- 172.21.15.37:0/730135564 shutdown_connections 2024-09-11T23:15:23.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:23.942+0000 7f2801400640 1 -- 172.21.15.37:0/730135564 wait complete. 2024-09-11T23:15:24.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:24 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/730135564' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-11T23:15:24.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:24 smithi160 ceph-mon[35055]: from='client.? 172.21.15.37:0/730135564' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-11T23:15:24.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:24 smithi123 ceph-mon[35438]: from='client.? 172.21.15.37:0/730135564' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-11T23:15:24.737 INFO:tasks.cephadm:Adding mds.a on smithi037 2024-09-11T23:15:24.737 INFO:tasks.cephadm:Adding mds.d on smithi037 2024-09-11T23:15:24.737 INFO:tasks.cephadm:Adding mds.g on smithi037 2024-09-11T23:15:24.737 INFO:tasks.cephadm:Adding mds.j on smithi037 2024-09-11T23:15:24.737 INFO:tasks.cephadm:Adding mds.b on smithi123 2024-09-11T23:15:24.737 INFO:tasks.cephadm:Adding mds.e on smithi123 2024-09-11T23:15:24.737 INFO:tasks.cephadm:Adding mds.h on smithi123 2024-09-11T23:15:24.738 INFO:tasks.cephadm:Adding mds.k on smithi123 2024-09-11T23:15:24.738 INFO:tasks.cephadm:Adding mds.c on smithi160 2024-09-11T23:15:24.738 INFO:tasks.cephadm:Adding mds.f on smithi160 2024-09-11T23:15:24.738 INFO:tasks.cephadm:Adding mds.i on smithi160 2024-09-11T23:15:24.738 INFO:tasks.cephadm:Adding mds.l on smithi160 2024-09-11T23:15:24.738 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph orch apply mds all '12;smithi037=a;smithi037=d;smithi037=g;smithi037=j;smithi123=b;smithi123=e;smithi123=h;smithi123=k;smithi160=c;smithi160=f;smithi160=i;smithi160=l' 2024-09-11T23:15:24.996 INFO:teuthology.orchestra.run.smithi160.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T23:15:25.280 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:25 smithi160 ceph-mon[35055]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:15:25.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:25 smithi037 ceph-mon[30630]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:15:25.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:25 smithi123 ceph-mon[35438]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:15:25.511 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:15:25.480+0000 7fabc8e7a640 1 -- 172.21.15.160:0/3648591300 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fabc4102690 msgr2=0x7fabc4108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:25.511 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:15:25.480+0000 7fabc8e7a640 1 --2- 172.21.15.160:0/3648591300 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fabc4102690 0x7fabc4108f20 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fabbc009ca0 tx=0x7fabbc02a8c0 comp rx=0 tx=0).stop 2024-09-11T23:15:25.511 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:15:25.480+0000 7fabc8e7a640 1 -- 172.21.15.160:0/3648591300 shutdown_connections 2024-09-11T23:15:25.511 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:15:25.480+0000 7fabc8e7a640 1 --2- 172.21.15.160:0/3648591300 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fabc4102690 0x7fabc4108f20 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:25.512 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:15:25.480+0000 7fabc8e7a640 1 --2- 172.21.15.160:0/3648591300 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabc4101cd0 0x7fabc4102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:25.512 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:15:25.480+0000 7fabc8e7a640 1 --2- 172.21.15.160:0/3648591300 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fabc4100ad0 0x7fabc4100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:25.512 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:15:25.480+0000 7fabc8e7a640 1 -- 172.21.15.160:0/3648591300 >> 172.21.15.160:0/3648591300 conn(0x7fabc40fc280 msgr2=0x7fabc40fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:25.512 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:15:25.480+0000 7fabc8e7a640 1 -- 172.21.15.160:0/3648591300 shutdown_connections 2024-09-11T23:15:25.512 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:15:25.480+0000 7fabc8e7a640 1 -- 172.21.15.160:0/3648591300 wait complete. 2024-09-11T23:15:25.512 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:15:25.480+0000 7fabc8e7a640 1 Processor -- start 2024-09-11T23:15:25.512 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:15:25.481+0000 7fabc8e7a640 1 -- start start 2024-09-11T23:15:25.512 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:15:25.481+0000 7fabc8e7a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fabc4100ad0 0x7fabc406ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:25.512 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:15:25.481+0000 7fabc8e7a640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fabc4101cd0 0x7fabc419cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:25.512 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:15:25.481+0000 7fabc8e7a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabc4102690 0x7fabc419f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:25.512 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:15:25.481+0000 7fabc8e7a640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fabc410c7d0 con 0x7fabc4102690 2024-09-11T23:15:25.512 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:15:25.481+0000 7fabc8e7a640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fabc410c650 con 0x7fabc4100ad0 2024-09-11T23:15:25.513 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:15:25.481+0000 7fabc8e7a640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fabc410c950 con 0x7fabc4101cd0 2024-09-11T23:15:25.513 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:15:25.481+0000 7fabc1d9b640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fabc4101cd0 0x7fabc419cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:25.513 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:15:25.481+0000 7fabc1d9b640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fabc4101cd0 0x7fabc419cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:56822/0 (socket says 172.21.15.160:56822) 2024-09-11T23:15:25.513 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:15:25.481+0000 7fabc1d9b640 1 -- 172.21.15.160:0/3661051565 learned_addr learned my addr 172.21.15.160:0/3661051565 (peer_addr_for_me v2:172.21.15.160:0/0) 2024-09-11T23:15:25.513 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:15:25.481+0000 7fabc259c640 1 --2- 172.21.15.160:0/3661051565 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fabc4100ad0 0x7fabc406ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:25.513 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:15:25.481+0000 7fabc1d9b640 1 -- 172.21.15.160:0/3661051565 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fabc4100ad0 msgr2=0x7fabc406ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:25.513 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:15:25.481+0000 7fabc1d9b640 1 --2- 172.21.15.160:0/3661051565 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fabc4100ad0 0x7fabc406ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:25.513 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:15:25.481+0000 7fabc1d9b640 1 -- 172.21.15.160:0/3661051565 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabc4102690 msgr2=0x7fabc419f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:25.513 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:15:25.481+0000 7fabc1d9b640 1 --2- 172.21.15.160:0/3661051565 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabc4102690 0x7fabc419f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:25.513 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:15:25.481+0000 7fabc1d9b640 1 -- 172.21.15.160:0/3661051565 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabc419fb50 con 0x7fabc4101cd0 2024-09-11T23:15:25.513 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:15:25.481+0000 7fabc1d9b640 1 --2- 172.21.15.160:0/3661051565 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fabc4101cd0 0x7fabc419cc40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fabb400b4a0 tx=0x7fabb400b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:25.513 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:15:25.482+0000 7fabb37fe640 1 -- 172.21.15.160:0/3661051565 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabb4014070 con 0x7fabc4101cd0 2024-09-11T23:15:25.514 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:15:25.482+0000 7fabb37fe640 1 -- 172.21.15.160:0/3661051565 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fabb4010af0 con 0x7fabc4101cd0 2024-09-11T23:15:25.514 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:15:25.482+0000 7fabc8e7a640 1 -- 172.21.15.160:0/3661051565 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabc419fe40 con 0x7fabc4101cd0 2024-09-11T23:15:25.514 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:15:25.482+0000 7fabb37fe640 1 -- 172.21.15.160:0/3661051565 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabb4017d10 con 0x7fabc4101cd0 2024-09-11T23:15:25.514 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:15:25.482+0000 7fabc8e7a640 1 -- 172.21.15.160:0/3661051565 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabc41a03c0 con 0x7fabc4101cd0 2024-09-11T23:15:25.514 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:15:25.483+0000 7fabc8e7a640 1 -- 172.21.15.160:0/3661051565 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabc4107ed0 con 0x7fabc4101cd0 2024-09-11T23:15:25.514 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:15:25.484+0000 7fabb37fe640 1 -- 172.21.15.160:0/3661051565 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fabb4017070 con 0x7fabc4101cd0 2024-09-11T23:15:25.514 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:15:25.485+0000 7fabb37fe640 1 --2- 172.21.15.160:0/3661051565 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fabac0a2c00 0x7fabac0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:25.514 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:15:25.485+0000 7fabb37fe640 1 -- 172.21.15.160:0/3661051565 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7fabb40cde90 con 0x7fabc4101cd0 2024-09-11T23:15:25.514 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:15:25.485+0000 7fabc259c640 1 --2- 172.21.15.160:0/3661051565 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fabac0a2c00 0x7fabac0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:25.514 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:15:25.486+0000 7fabc259c640 1 --2- 172.21.15.160:0/3661051565 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fabac0a2c00 0x7fabac0a50c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fabc406b050 tx=0x7fabb800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:25.514 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:15:25.488+0000 7fabb37fe640 1 -- 172.21.15.160:0/3661051565 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fabb409b270 con 0x7fabc4101cd0 2024-09-11T23:15:25.709 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:15:25.709+0000 7fabc8e7a640 1 -- 172.21.15.160:0/3661051565 --> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi037=a;smithi037=d;smithi037=g;smithi037=j;smithi123=b;smithi123=e;smithi123=h;smithi123=k;smithi160=c;smithi160=f;smithi160=i;smithi160=l", "target": ["mon-mgr", ""]}) -- 0x7fabc4062730 con 0x7fabac0a2c00 2024-09-11T23:15:25.717 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:15:25.717+0000 7fabb37fe640 1 -- 172.21.15.160:0/3661051565 <== mgr.14150 v2:172.21.15.37:6800/31543269 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7fabc4062730 con 0x7fabac0a2c00 2024-09-11T23:15:25.718 INFO:teuthology.orchestra.run.smithi160.stdout:Scheduled mds.all update... 2024-09-11T23:15:25.720 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:15:25.720+0000 7fabc8e7a640 1 -- 172.21.15.160:0/3661051565 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fabac0a2c00 msgr2=0x7fabac0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:25.720 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:15:25.720+0000 7fabc8e7a640 1 --2- 172.21.15.160:0/3661051565 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fabac0a2c00 0x7fabac0a50c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fabc406b050 tx=0x7fabb800b390 comp rx=0 tx=0).stop 2024-09-11T23:15:25.720 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:15:25.720+0000 7fabc8e7a640 1 -- 172.21.15.160:0/3661051565 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fabc4101cd0 msgr2=0x7fabc419cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:25.720 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:15:25.720+0000 7fabc8e7a640 1 --2- 172.21.15.160:0/3661051565 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fabc4101cd0 0x7fabc419cc40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fabb400b4a0 tx=0x7fabb400b960 comp rx=0 tx=0).stop 2024-09-11T23:15:25.720 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:15:25.720+0000 7fabc8e7a640 1 -- 172.21.15.160:0/3661051565 shutdown_connections 2024-09-11T23:15:25.720 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:15:25.720+0000 7fabc8e7a640 1 --2- 172.21.15.160:0/3661051565 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fabac0a2c00 0x7fabac0a50c0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:25.720 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:15:25.720+0000 7fabc8e7a640 1 --2- 172.21.15.160:0/3661051565 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabc4102690 0x7fabc419f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:25.720 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:15:25.720+0000 7fabc8e7a640 1 --2- 172.21.15.160:0/3661051565 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fabc4101cd0 0x7fabc419cc40 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:25.721 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:15:25.720+0000 7fabc8e7a640 1 --2- 172.21.15.160:0/3661051565 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fabc4100ad0 0x7fabc406ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:25.721 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:15:25.720+0000 7fabc8e7a640 1 -- 172.21.15.160:0/3661051565 >> 172.21.15.160:0/3661051565 conn(0x7fabc40fc280 msgr2=0x7fabc41050a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:25.721 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:15:25.720+0000 7fabc8e7a640 1 -- 172.21.15.160:0/3661051565 shutdown_connections 2024-09-11T23:15:25.721 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-11T23:15:25.720+0000 7fabc8e7a640 1 -- 172.21.15.160:0/3661051565 wait complete. 2024-09-11T23:15:26.445 DEBUG:teuthology.orchestra.run.smithi037:mds.a> sudo journalctl -f -n 0 -u ceph-8b03efce-7092-11ef-bcea-c7b262605968@mds.a.service 2024-09-11T23:15:26.450 DEBUG:teuthology.orchestra.run.smithi037:mds.d> sudo journalctl -f -n 0 -u ceph-8b03efce-7092-11ef-bcea-c7b262605968@mds.d.service 2024-09-11T23:15:26.494 DEBUG:teuthology.orchestra.run.smithi037:mds.g> sudo journalctl -f -n 0 -u ceph-8b03efce-7092-11ef-bcea-c7b262605968@mds.g.service 2024-09-11T23:15:26.539 DEBUG:teuthology.orchestra.run.smithi037:mds.j> sudo journalctl -f -n 0 -u ceph-8b03efce-7092-11ef-bcea-c7b262605968@mds.j.service 2024-09-11T23:15:26.584 DEBUG:teuthology.orchestra.run.smithi123:mds.b> sudo journalctl -f -n 0 -u ceph-8b03efce-7092-11ef-bcea-c7b262605968@mds.b.service 2024-09-11T23:15:26.587 DEBUG:teuthology.orchestra.run.smithi123:mds.e> sudo journalctl -f -n 0 -u ceph-8b03efce-7092-11ef-bcea-c7b262605968@mds.e.service 2024-09-11T23:15:26.630 DEBUG:teuthology.orchestra.run.smithi123:mds.h> sudo journalctl -f -n 0 -u ceph-8b03efce-7092-11ef-bcea-c7b262605968@mds.h.service 2024-09-11T23:15:26.674 DEBUG:teuthology.orchestra.run.smithi123:mds.k> sudo journalctl -f -n 0 -u ceph-8b03efce-7092-11ef-bcea-c7b262605968@mds.k.service 2024-09-11T23:15:26.717 DEBUG:teuthology.orchestra.run.smithi160:mds.c> sudo journalctl -f -n 0 -u ceph-8b03efce-7092-11ef-bcea-c7b262605968@mds.c.service 2024-09-11T23:15:26.719 DEBUG:teuthology.orchestra.run.smithi160:mds.f> sudo journalctl -f -n 0 -u ceph-8b03efce-7092-11ef-bcea-c7b262605968@mds.f.service 2024-09-11T23:15:26.757 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:26 smithi037 ceph-mon[30630]: from='client.24436 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi037=a;smithi037=d;smithi037=g;smithi037=j;smithi123=b;smithi123=e;smithi123=h;smithi123=k;smithi160=c;smithi160=f;smithi160=i;smithi160=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:15:26.757 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:26 smithi037 ceph-mon[30630]: Saving service mds.all spec with placement smithi037=a;smithi037=d;smithi037=g;smithi037=j;smithi123=b;smithi123=e;smithi123=h;smithi123=k;smithi160=c;smithi160=f;smithi160=i;smithi160=l;count:12 2024-09-11T23:15:26.757 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:26 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:26.757 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:26 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:15:26.757 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:26 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:15:26.757 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:26 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:15:26.757 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:26 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:26.757 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:26 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:15:26.757 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:26 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:15:26.758 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:26 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:15:26.763 DEBUG:teuthology.orchestra.run.smithi160:mds.i> sudo journalctl -f -n 0 -u ceph-8b03efce-7092-11ef-bcea-c7b262605968@mds.i.service 2024-09-11T23:15:26.806 DEBUG:teuthology.orchestra.run.smithi160:mds.l> sudo journalctl -f -n 0 -u ceph-8b03efce-7092-11ef-bcea-c7b262605968@mds.l.service 2024-09-11T23:15:26.849 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-09-11T23:15:26.849 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T23:15:27.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:26 smithi123 ceph-mon[35438]: from='client.24436 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi037=a;smithi037=d;smithi037=g;smithi037=j;smithi123=b;smithi123=e;smithi123=h;smithi123=k;smithi160=c;smithi160=f;smithi160=i;smithi160=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:15:27.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:26 smithi123 ceph-mon[35438]: Saving service mds.all spec with placement smithi037=a;smithi037=d;smithi037=g;smithi037=j;smithi123=b;smithi123=e;smithi123=h;smithi123=k;smithi160=c;smithi160=f;smithi160=i;smithi160=l;count:12 2024-09-11T23:15:27.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:26 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:27.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:26 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:15:27.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:26 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:15:27.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:26 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:15:27.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:26 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:27.002 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:26 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:15:27.002 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:26 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:15:27.002 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:26 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:15:27.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:26 smithi160 ceph-mon[35055]: from='client.24436 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi037=a;smithi037=d;smithi037=g;smithi037=j;smithi123=b;smithi123=e;smithi123=h;smithi123=k;smithi160=c;smithi160=f;smithi160=i;smithi160=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:15:27.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:26 smithi160 ceph-mon[35055]: Saving service mds.all spec with placement smithi037=a;smithi037=d;smithi037=g;smithi037=j;smithi123=b;smithi123=e;smithi123=h;smithi123=k;smithi160=c;smithi160=f;smithi160=i;smithi160=l;count:12 2024-09-11T23:15:27.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:26 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:27.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:26 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:15:27.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:26 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:15:27.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:26 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:15:27.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:26 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:27.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:26 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:15:27.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:26 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:15:27.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:26 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:15:27.220 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:15:27.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:27.774+0000 7f3c90000640 1 -- 172.21.15.37:0/3380885831 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3c88102d40 msgr2=0x7f3c88103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:27.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:27.774+0000 7f3c90000640 1 --2- 172.21.15.37:0/3380885831 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3c88102d40 0x7f3c88103120 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3c7c009900 tx=0x7f3c7c02a480 comp rx=0 tx=0).stop 2024-09-11T23:15:27.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:27.774+0000 7f3c90000640 1 -- 172.21.15.37:0/3380885831 shutdown_connections 2024-09-11T23:15:27.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:27.774+0000 7f3c90000640 1 --2- 172.21.15.37:0/3380885831 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c88103660 0x7f3c8810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:27.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:27.774+0000 7f3c90000640 1 --2- 172.21.15.37:0/3380885831 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c8810c170 0x7f3c8810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:27.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:27.774+0000 7f3c90000640 1 --2- 172.21.15.37:0/3380885831 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3c88102d40 0x7f3c88103120 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:27.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:27.774+0000 7f3c90000640 1 -- 172.21.15.37:0/3380885831 >> 172.21.15.37:0/3380885831 conn(0x7f3c880fc7a0 msgr2=0x7f3c880febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:27.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:27.774+0000 7f3c90000640 1 -- 172.21.15.37:0/3380885831 shutdown_connections 2024-09-11T23:15:27.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:27.774+0000 7f3c90000640 1 -- 172.21.15.37:0/3380885831 wait complete. 2024-09-11T23:15:27.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:27.775+0000 7f3c90000640 1 Processor -- start 2024-09-11T23:15:27.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:27.775+0000 7f3c90000640 1 -- start start 2024-09-11T23:15:27.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:27.776+0000 7f3c90000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c88102d40 0x7f3c88198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:27.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:27.776+0000 7f3c90000640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3c88103660 0x7f3c881989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:27.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:27.776+0000 7f3c90000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c8810c170 0x7f3c8819cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:27.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:27.776+0000 7f3c90000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3c88111fc0 con 0x7f3c88102d40 2024-09-11T23:15:27.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:27.776+0000 7f3c90000640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f3c88111e40 con 0x7f3c8810c170 2024-09-11T23:15:27.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:27.776+0000 7f3c90000640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f3c88112140 con 0x7f3c88103660 2024-09-11T23:15:27.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:27.776+0000 7f3c8cc00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3c88103660 0x7f3c881989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:27.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:27.776+0000 7f3c8d600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c88102d40 0x7f3c88198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:27.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:27.776+0000 7f3c8cc00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3c88103660 0x7f3c881989a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.37:43046/0 (socket says 172.21.15.37:43046) 2024-09-11T23:15:27.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:27.776+0000 7f3c8cc00640 1 -- 172.21.15.37:0/3419943047 learned_addr learned my addr 172.21.15.37:0/3419943047 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:15:27.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:27.776+0000 7f3c8e000640 1 --2- 172.21.15.37:0/3419943047 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c8810c170 0x7f3c8819cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:27.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:27.776+0000 7f3c8cc00640 1 -- 172.21.15.37:0/3419943047 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c8810c170 msgr2=0x7f3c8819cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:27.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:27.776+0000 7f3c8cc00640 1 --2- 172.21.15.37:0/3419943047 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c8810c170 0x7f3c8819cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:27.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:27.776+0000 7f3c8cc00640 1 -- 172.21.15.37:0/3419943047 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c88102d40 msgr2=0x7f3c88198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:27.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:27.776+0000 7f3c8cc00640 1 --2- 172.21.15.37:0/3419943047 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c88102d40 0x7f3c88198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:27.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:27.776+0000 7f3c8cc00640 1 -- 172.21.15.37:0/3419943047 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c8819d410 con 0x7f3c88103660 2024-09-11T23:15:27.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:27.776+0000 7f3c8d600640 1 --2- 172.21.15.37:0/3419943047 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c88102d40 0x7f3c88198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:15:27.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:27.777+0000 7f3c8cc00640 1 --2- 172.21.15.37:0/3419943047 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3c88103660 0x7f3c881989a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3c7400e9f0 tx=0x7f3c7400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:27.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:27.777+0000 7f3c86000640 1 -- 172.21.15.37:0/3419943047 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c7400ccc0 con 0x7f3c88103660 2024-09-11T23:15:27.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:27.777+0000 7f3c86000640 1 -- 172.21.15.37:0/3419943047 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3c7400ce60 con 0x7f3c88103660 2024-09-11T23:15:27.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:27.777+0000 7f3c90000640 1 -- 172.21.15.37:0/3419943047 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c8819d700 con 0x7f3c88103660 2024-09-11T23:15:27.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:27.777+0000 7f3c86000640 1 -- 172.21.15.37:0/3419943047 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c74010690 con 0x7f3c88103660 2024-09-11T23:15:27.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:27.777+0000 7f3c90000640 1 -- 172.21.15.37:0/3419943047 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c881008d0 con 0x7f3c88103660 2024-09-11T23:15:27.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:27.778+0000 7f3c90000640 1 -- 172.21.15.37:0/3419943047 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c8806b070 con 0x7f3c88103660 2024-09-11T23:15:27.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:27.780+0000 7f3c86000640 1 -- 172.21.15.37:0/3419943047 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f3c740046c0 con 0x7f3c88103660 2024-09-11T23:15:27.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:27.782+0000 7f3c86000640 1 --2- 172.21.15.37:0/3419943047 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f3c700a2b80 0x7f3c700a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:27.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:27.782+0000 7f3c86000640 1 -- 172.21.15.37:0/3419943047 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f3c740cefa0 con 0x7f3c88103660 2024-09-11T23:15:27.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:27.782+0000 7f3c8d600640 1 --2- 172.21.15.37:0/3419943047 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f3c700a2b80 0x7f3c700a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:27.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:27.783+0000 7f3c8d600640 1 --2- 172.21.15.37:0/3419943047 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f3c700a2b80 0x7f3c700a5040 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3c7c000c00 tx=0x7f3c7c031510 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:27.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:27.785+0000 7f3c86000640 1 -- 172.21.15.37:0/3419943047 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3c7409c300 con 0x7f3c88103660 2024-09-11T23:15:27.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:27 smithi160 ceph-mon[35055]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:15:27.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:27 smithi160 ceph-mon[35055]: Deploying daemon mds.l on smithi160 2024-09-11T23:15:28.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:27 smithi123 ceph-mon[35438]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:15:28.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:27 smithi123 ceph-mon[35438]: Deploying daemon mds.l on smithi160 2024-09-11T23:15:28.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:28.006+0000 7f3c90000640 1 -- 172.21.15.37:0/3419943047 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3c88103120 con 0x7f3c88103660 2024-09-11T23:15:28.006 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:27 smithi037 ceph-mon[30630]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:15:28.006 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:27 smithi037 ceph-mon[30630]: Deploying daemon mds.l on smithi160 2024-09-11T23:15:28.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:28.006+0000 7f3c86000640 1 -- 172.21.15.37:0/3419943047 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7f3c88103120 con 0x7f3c88103660 2024-09-11T23:15:28.007 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:15:28.007 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":1,"btime":"2024-09-11T23:07:59:386558+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-11T23:15:28.007 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 1 2024-09-11T23:15:28.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:28.008+0000 7f3c90000640 1 -- 172.21.15.37:0/3419943047 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f3c700a2b80 msgr2=0x7f3c700a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:28.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:28.008+0000 7f3c90000640 1 --2- 172.21.15.37:0/3419943047 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f3c700a2b80 0x7f3c700a5040 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3c7c000c00 tx=0x7f3c7c031510 comp rx=0 tx=0).stop 2024-09-11T23:15:28.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:28.008+0000 7f3c90000640 1 -- 172.21.15.37:0/3419943047 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3c88103660 msgr2=0x7f3c881989a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:28.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:28.008+0000 7f3c90000640 1 --2- 172.21.15.37:0/3419943047 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3c88103660 0x7f3c881989a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3c7400e9f0 tx=0x7f3c7400eeb0 comp rx=0 tx=0).stop 2024-09-11T23:15:28.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:28.009+0000 7f3c90000640 1 -- 172.21.15.37:0/3419943047 shutdown_connections 2024-09-11T23:15:28.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:28.009+0000 7f3c90000640 1 --2- 172.21.15.37:0/3419943047 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f3c700a2b80 0x7f3c700a5040 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:28.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:28.009+0000 7f3c90000640 1 --2- 172.21.15.37:0/3419943047 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c8810c170 0x7f3c8819cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:28.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:28.009+0000 7f3c90000640 1 --2- 172.21.15.37:0/3419943047 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3c88103660 0x7f3c881989a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:28.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:28.009+0000 7f3c90000640 1 --2- 172.21.15.37:0/3419943047 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c88102d40 0x7f3c88198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:28.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:28.009+0000 7f3c90000640 1 -- 172.21.15.37:0/3419943047 >> 172.21.15.37:0/3419943047 conn(0x7f3c880fc7a0 msgr2=0x7f3c880fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:28.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:28.009+0000 7f3c90000640 1 -- 172.21.15.37:0/3419943047 shutdown_connections 2024-09-11T23:15:28.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:28.009+0000 7f3c90000640 1 -- 172.21.15.37:0/3419943047 wait complete. 2024-09-11T23:15:28.184 INFO:journalctl@ceph.mds.l.smithi160.stdout:Sep 11 23:15:28 smithi160 systemd[1]: Starting Ceph mds.l for 8b03efce-7092-11ef-bcea-c7b262605968... 2024-09-11T23:15:28.554 INFO:journalctl@ceph.mds.l.smithi160.stdout:Sep 11 23:15:28 smithi160 podman[64216]: 2024-09-11 23:15:28.201827805 +0000 UTC m=+0.016033422 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T23:15:28.554 INFO:journalctl@ceph.mds.l.smithi160.stdout:Sep 11 23:15:28 smithi160 podman[64216]: 2024-09-11 23:15:28.309846421 +0000 UTC m=+0.124052017 container create 961c574cf3350c66b82af5239223774f36d93239ec1108033945af7d69de5bbe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-l, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-11T23:15:28.554 INFO:journalctl@ceph.mds.l.smithi160.stdout:Sep 11 23:15:28 smithi160 podman[64216]: 2024-09-11 23:15:28.554287662 +0000 UTC m=+0.368493258 container init 961c574cf3350c66b82af5239223774f36d93239ec1108033945af7d69de5bbe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-l, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-11T23:15:28.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:28 smithi160 ceph-mon[35055]: from='client.? 172.21.15.37:0/3419943047' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:15:28.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:28 smithi160 ceph-mon[35055]: mds.? [v2:172.21.15.160:6832/1918127245,v1:172.21.15.160:6833/1918127245] up:boot 2024-09-11T23:15:28.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:28 smithi160 ceph-mon[35055]: fsmap 1 up:standby 2024-09-11T23:15:28.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:28 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-11T23:15:28.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:28 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:28.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:28 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:28.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:28 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:28.935 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:28 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:15:28.935 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:28 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:15:28.935 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:28 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:15:28.935 INFO:journalctl@ceph.mds.l.smithi160.stdout:Sep 11 23:15:28 smithi160 podman[64216]: 2024-09-11 23:15:28.557212996 +0000 UTC m=+0.371418603 container start 961c574cf3350c66b82af5239223774f36d93239ec1108033945af7d69de5bbe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-l, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True) 2024-09-11T23:15:28.935 INFO:journalctl@ceph.mds.l.smithi160.stdout:Sep 11 23:15:28 smithi160 ceph-mds[64235]: -- 172.21.15.160:0/3798432623 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55d978878680 con 0x55d97884d000 2024-09-11T23:15:28.935 INFO:journalctl@ceph.mds.l.smithi160.stdout:Sep 11 23:15:28 smithi160 ceph-mds[64235]: -- 172.21.15.160:0/3798432623 <== mon.1 v2:172.21.15.160:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d97886f860 con 0x55d97884d000 2024-09-11T23:15:28.935 INFO:journalctl@ceph.mds.l.smithi160.stdout:Sep 11 23:15:28 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-l[64231]: starting mds.l at 2024-09-11T23:15:28.935 INFO:journalctl@ceph.mds.l.smithi160.stdout:Sep 11 23:15:28 smithi160 bash[64216]: 961c574cf3350c66b82af5239223774f36d93239ec1108033945af7d69de5bbe 2024-09-11T23:15:28.935 INFO:journalctl@ceph.mds.l.smithi160.stdout:Sep 11 23:15:28 smithi160 systemd[1]: Started Ceph mds.l for 8b03efce-7092-11ef-bcea-c7b262605968. 2024-09-11T23:15:29.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:28 smithi123 ceph-mon[35438]: from='client.? 172.21.15.37:0/3419943047' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:15:29.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:28 smithi123 ceph-mon[35438]: mds.? [v2:172.21.15.160:6832/1918127245,v1:172.21.15.160:6833/1918127245] up:boot 2024-09-11T23:15:29.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:28 smithi123 ceph-mon[35438]: fsmap 1 up:standby 2024-09-11T23:15:29.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:28 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-11T23:15:29.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:28 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:29.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:28 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:29.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:28 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:29.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:28 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:15:29.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:28 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:15:29.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:28 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:15:29.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:28 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/3419943047' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:15:29.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:28 smithi037 ceph-mon[30630]: mds.? [v2:172.21.15.160:6832/1918127245,v1:172.21.15.160:6833/1918127245] up:boot 2024-09-11T23:15:29.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:28 smithi037 ceph-mon[30630]: fsmap 1 up:standby 2024-09-11T23:15:29.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:28 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-11T23:15:29.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:28 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:29.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:28 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:29.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:28 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:29.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:28 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:15:29.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:28 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:15:29.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:28 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:15:30.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:29 smithi123 ceph-mon[35438]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:15:30.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:29 smithi123 ceph-mon[35438]: Deploying daemon mds.k on smithi123 2024-09-11T23:15:30.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:29 smithi037 ceph-mon[30630]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:15:30.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:29 smithi037 ceph-mon[30630]: Deploying daemon mds.k on smithi123 2024-09-11T23:15:30.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:29 smithi160 ceph-mon[35055]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:15:30.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:29 smithi160 ceph-mon[35055]: Deploying daemon mds.k on smithi123 2024-09-11T23:15:30.745 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T23:15:30.917 INFO:journalctl@ceph.mds.k.smithi123.stdout:Sep 11 23:15:30 smithi123 systemd[1]: Starting Ceph mds.k for 8b03efce-7092-11ef-bcea-c7b262605968... 2024-09-11T23:15:31.130 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:15:31.218 INFO:journalctl@ceph.mds.k.smithi123.stdout:Sep 11 23:15:30 smithi123 podman[64648]: 2024-09-11 23:15:30.819672712 +0000 UTC m=+0.015655628 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T23:15:31.218 INFO:journalctl@ceph.mds.k.smithi123.stdout:Sep 11 23:15:30 smithi123 podman[64648]: 2024-09-11 23:15:30.948540001 +0000 UTC m=+0.144522898 container create 1b47a29b3f6bac599a402d0dd4d4e56e41dfa925467ae21405ded10f048d06f8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-k, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.license=GPLv2) 2024-09-11T23:15:31.218 INFO:journalctl@ceph.mds.k.smithi123.stdout:Sep 11 23:15:31 smithi123 podman[64648]: 2024-09-11 23:15:31.218135395 +0000 UTC m=+0.414118303 container init 1b47a29b3f6bac599a402d0dd4d4e56e41dfa925467ae21405ded10f048d06f8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-k, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-11T23:15:31.501 INFO:journalctl@ceph.mds.k.smithi123.stdout:Sep 11 23:15:31 smithi123 podman[64648]: 2024-09-11 23:15:31.221209584 +0000 UTC m=+0.417192482 container start 1b47a29b3f6bac599a402d0dd4d4e56e41dfa925467ae21405ded10f048d06f8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-k, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3) 2024-09-11T23:15:31.501 INFO:journalctl@ceph.mds.k.smithi123.stdout:Sep 11 23:15:31 smithi123 ceph-mds[64667]: -- 172.21.15.123:0/11481068 <== mon.2 v2:172.21.15.123:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5555762ad860 con 0x55557628b400 2024-09-11T23:15:31.501 INFO:journalctl@ceph.mds.k.smithi123.stdout:Sep 11 23:15:31 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-k[64663]: starting mds.k at 2024-09-11T23:15:31.501 INFO:journalctl@ceph.mds.k.smithi123.stdout:Sep 11 23:15:31 smithi123 bash[64648]: 1b47a29b3f6bac599a402d0dd4d4e56e41dfa925467ae21405ded10f048d06f8 2024-09-11T23:15:31.501 INFO:journalctl@ceph.mds.k.smithi123.stdout:Sep 11 23:15:31 smithi123 systemd[1]: Started Ceph mds.k for 8b03efce-7092-11ef-bcea-c7b262605968. 2024-09-11T23:15:31.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:31.679+0000 7f2944000640 1 -- 172.21.15.37:0/3956030451 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f293c112a30 msgr2=0x7f293c114e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:31.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:31.679+0000 7f2944000640 1 --2- 172.21.15.37:0/3956030451 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f293c112a30 0x7f293c114e20 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2934009ca0 tx=0x7f293402a8c0 comp rx=0 tx=0).stop 2024-09-11T23:15:31.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:31.679+0000 7f2944000640 1 -- 172.21.15.37:0/3956030451 shutdown_connections 2024-09-11T23:15:31.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:31.679+0000 7f2944000640 1 --2- 172.21.15.37:0/3956030451 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f293c077040 0x7f293c1124f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:31.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:31.679+0000 7f2944000640 1 --2- 172.21.15.37:0/3956030451 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f293c112a30 0x7f293c114e20 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:31.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:31.679+0000 7f2944000640 1 --2- 172.21.15.37:0/3956030451 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f293c076720 0x7f293c076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:31.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:31.679+0000 7f2944000640 1 -- 172.21.15.37:0/3956030451 >> 172.21.15.37:0/3956030451 conn(0x7f293c0ffa90 msgr2=0x7f293c101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:31.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:31.679+0000 7f2944000640 1 -- 172.21.15.37:0/3956030451 shutdown_connections 2024-09-11T23:15:31.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:31.679+0000 7f2944000640 1 -- 172.21.15.37:0/3956030451 wait complete. 2024-09-11T23:15:31.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:31.680+0000 7f2944000640 1 Processor -- start 2024-09-11T23:15:31.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:31.680+0000 7f2944000640 1 -- start start 2024-09-11T23:15:31.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:31.680+0000 7f2944000640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f293c076720 0x7f293c1a46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:31.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:31.681+0000 7f2944000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f293c077040 0x7f293c1a4c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:31.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:31.681+0000 7f2944000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f293c112a30 0x7f293c19e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:31.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:31.681+0000 7f2944000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f293c1185d0 con 0x7f293c112a30 2024-09-11T23:15:31.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:31.681+0000 7f2944000640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f293c118450 con 0x7f293c077040 2024-09-11T23:15:31.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:31.681+0000 7f2944000640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f293c118750 con 0x7f293c076720 2024-09-11T23:15:31.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:31.681+0000 7f2941600640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f293c076720 0x7f293c1a46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:31.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:31.681+0000 7f2940c00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f293c077040 0x7f293c1a4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:31.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:31.681+0000 7f2941600640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f293c076720 0x7f293c1a46e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.37:59478/0 (socket says 172.21.15.37:59478) 2024-09-11T23:15:31.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:31.681+0000 7f2942000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f293c112a30 0x7f293c19e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:31.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:31.681+0000 7f2941600640 1 -- 172.21.15.37:0/2653323381 learned_addr learned my addr 172.21.15.37:0/2653323381 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:15:31.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:31.681+0000 7f2941600640 1 -- 172.21.15.37:0/2653323381 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f293c077040 msgr2=0x7f293c1a4c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:31.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:31.681+0000 7f2941600640 1 --2- 172.21.15.37:0/2653323381 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f293c077040 0x7f293c1a4c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:31.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:31.681+0000 7f2941600640 1 -- 172.21.15.37:0/2653323381 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f293c112a30 msgr2=0x7f293c19e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:31.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:31.681+0000 7f2941600640 1 --2- 172.21.15.37:0/2653323381 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f293c112a30 0x7f293c19e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:31.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:31.681+0000 7f2941600640 1 -- 172.21.15.37:0/2653323381 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f293c19efd0 con 0x7f293c076720 2024-09-11T23:15:31.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:31.682+0000 7f2941600640 1 --2- 172.21.15.37:0/2653323381 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f293c076720 0x7f293c1a46e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f293000e9f0 tx=0x7f293000edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:31.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:31.682+0000 7f293a000640 1 -- 172.21.15.37:0/2653323381 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f293000cd80 con 0x7f293c076720 2024-09-11T23:15:31.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:31.682+0000 7f293a000640 1 -- 172.21.15.37:0/2653323381 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2930005500 con 0x7f293c076720 2024-09-11T23:15:31.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:31.682+0000 7f2944000640 1 -- 172.21.15.37:0/2653323381 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f293c19f2c0 con 0x7f293c076720 2024-09-11T23:15:31.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:31.682+0000 7f293a000640 1 -- 172.21.15.37:0/2653323381 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2930010690 con 0x7f293c076720 2024-09-11T23:15:31.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:31.682+0000 7f2944000640 1 -- 172.21.15.37:0/2653323381 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f293c1ab5b0 con 0x7f293c076720 2024-09-11T23:15:31.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:31.683+0000 7f2944000640 1 -- 172.21.15.37:0/2653323381 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f293c076b00 con 0x7f293c076720 2024-09-11T23:15:31.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:31.685+0000 7f293a000640 1 -- 172.21.15.37:0/2653323381 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f29300046c0 con 0x7f293c076720 2024-09-11T23:15:31.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:31.686+0000 7f293a000640 1 --2- 172.21.15.37:0/2653323381 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f29240a2b80 0x7f29240a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:31.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:31.687+0000 7f293a000640 1 -- 172.21.15.37:0/2653323381 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f29300cefe0 con 0x7f293c076720 2024-09-11T23:15:31.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:31.687+0000 7f2940c00640 1 --2- 172.21.15.37:0/2653323381 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f29240a2b80 0x7f29240a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:31.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:31.688+0000 7f2940c00640 1 --2- 172.21.15.37:0/2653323381 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f29240a2b80 0x7f29240a5040 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f29280095f0 tx=0x7f2928005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:31.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:31.691+0000 7f293a000640 1 -- 172.21.15.37:0/2653323381 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f293009c380 con 0x7f293c076720 2024-09-11T23:15:31.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:31 smithi037 ceph-mon[30630]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:15:31.815 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:31 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:31.815 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:31 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:31.815 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:31 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:31.815 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:31 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:15:31.815 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:31 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:15:31.815 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:31 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:15:31.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:31.918+0000 7f2944000640 1 -- 172.21.15.37:0/2653323381 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f293c10dc20 con 0x7f293c076720 2024-09-11T23:15:31.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:31.919+0000 7f293a000640 1 -- 172.21.15.37:0/2653323381 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2266 (secure 0 0 0) 0x7f293009bc80 con 0x7f293c076720 2024-09-11T23:15:31.919 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:15:31.919 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":3,"btime":"2024-09-11T23:15:31:735212+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24440,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/3380294842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":3380294842},{"type":"v1","addr":"172.21.15.123:6833","nonce":3380294842}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/1918127245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":1918127245},{"type":"v1","addr":"172.21.15.160:6833","nonce":1918127245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-11T23:15:31.919 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 3 2024-09-11T23:15:31.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:31.921+0000 7f2944000640 1 -- 172.21.15.37:0/2653323381 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f29240a2b80 msgr2=0x7f29240a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:31.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:31.921+0000 7f2944000640 1 --2- 172.21.15.37:0/2653323381 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f29240a2b80 0x7f29240a5040 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f29280095f0 tx=0x7f2928005f90 comp rx=0 tx=0).stop 2024-09-11T23:15:31.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:31.921+0000 7f2944000640 1 -- 172.21.15.37:0/2653323381 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f293c076720 msgr2=0x7f293c1a46e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:31.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:31.921+0000 7f2944000640 1 --2- 172.21.15.37:0/2653323381 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f293c076720 0x7f293c1a46e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f293000e9f0 tx=0x7f293000edf0 comp rx=0 tx=0).stop 2024-09-11T23:15:31.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:31.921+0000 7f2944000640 1 -- 172.21.15.37:0/2653323381 shutdown_connections 2024-09-11T23:15:31.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:31.921+0000 7f2944000640 1 --2- 172.21.15.37:0/2653323381 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f29240a2b80 0x7f29240a5040 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:31.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:31.921+0000 7f2944000640 1 --2- 172.21.15.37:0/2653323381 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f293c077040 0x7f293c1a4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:31.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:31.921+0000 7f2944000640 1 --2- 172.21.15.37:0/2653323381 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f293c112a30 0x7f293c19e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:31.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:31.921+0000 7f2944000640 1 --2- 172.21.15.37:0/2653323381 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f293c076720 0x7f293c1a46e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:31.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:31.921+0000 7f2944000640 1 -- 172.21.15.37:0/2653323381 >> 172.21.15.37:0/2653323381 conn(0x7f293c0ffa90 msgr2=0x7f293c101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:31.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:31.921+0000 7f2944000640 1 -- 172.21.15.37:0/2653323381 shutdown_connections 2024-09-11T23:15:31.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:31.921+0000 7f2944000640 1 -- 172.21.15.37:0/2653323381 wait complete. 2024-09-11T23:15:32.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:31 smithi123 ceph-mon[35438]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:15:32.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:31 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:32.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:31 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:32.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:31 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:32.002 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:31 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:15:32.002 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:31 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:15:32.002 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:31 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:15:32.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:31 smithi160 ceph-mon[35055]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:15:32.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:31 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:32.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:31 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:32.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:31 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:32.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:31 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:15:32.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:31 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:15:32.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:31 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:15:32.757 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:32 smithi123 ceph-mon[35438]: Deploying daemon mds.j on smithi037 2024-09-11T23:15:32.757 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:32 smithi123 ceph-mon[35438]: mds.? [v2:172.21.15.123:6832/3380294842,v1:172.21.15.123:6833/3380294842] up:boot 2024-09-11T23:15:32.757 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:32 smithi123 ceph-mon[35438]: fsmap 2 up:standby 2024-09-11T23:15:32.757 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:32 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-11T23:15:32.757 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:32 smithi123 ceph-mon[35438]: from='client.? 172.21.15.37:0/2653323381' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:15:32.991 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:32 smithi037 ceph-mon[30630]: Deploying daemon mds.j on smithi037 2024-09-11T23:15:32.991 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:32 smithi037 ceph-mon[30630]: mds.? [v2:172.21.15.123:6832/3380294842,v1:172.21.15.123:6833/3380294842] up:boot 2024-09-11T23:15:32.991 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:32 smithi037 ceph-mon[30630]: fsmap 2 up:standby 2024-09-11T23:15:32.991 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:32 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-11T23:15:32.992 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:32 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/2653323381' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:15:33.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:32 smithi160 ceph-mon[35055]: Deploying daemon mds.j on smithi037 2024-09-11T23:15:33.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:32 smithi160 ceph-mon[35055]: mds.? [v2:172.21.15.123:6832/3380294842,v1:172.21.15.123:6833/3380294842] up:boot 2024-09-11T23:15:33.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:32 smithi160 ceph-mon[35055]: fsmap 2 up:standby 2024-09-11T23:15:33.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:32 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-11T23:15:33.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:32 smithi160 ceph-mon[35055]: from='client.? 172.21.15.37:0/2653323381' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:15:33.991 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:33 smithi037 ceph-mon[30630]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:15:34.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:33 smithi123 ceph-mon[35438]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:15:34.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:33 smithi160 ceph-mon[35055]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:15:34.679 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T23:15:35.255 INFO:journalctl@ceph.mds.j.smithi037.stdout:Sep 11 23:15:34 smithi037 podman[69982]: 2024-09-11 23:15:34.994074871 +0000 UTC m=+0.147186951 container create 9ead93e0f5a3f43501ddc78af177ed532602edbfdd5114b6f4ee8ab6ff1af610 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-j, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3) 2024-09-11T23:15:35.256 INFO:journalctl@ceph.mds.j.smithi037.stdout:Sep 11 23:15:35 smithi037 podman[69982]: 2024-09-11 23:15:35.255741196 +0000 UTC m=+0.408853278 container init 9ead93e0f5a3f43501ddc78af177ed532602edbfdd5114b6f4ee8ab6ff1af610 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-j, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-11T23:15:35.461 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:15:35.564 INFO:journalctl@ceph.mds.j.smithi037.stdout:Sep 11 23:15:35 smithi037 podman[69982]: 2024-09-11 23:15:35.262624635 +0000 UTC m=+0.415736716 container start 9ead93e0f5a3f43501ddc78af177ed532602edbfdd5114b6f4ee8ab6ff1af610 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-j, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-11T23:15:35.564 INFO:journalctl@ceph.mds.j.smithi037.stdout:Sep 11 23:15:35 smithi037 ceph-mds[70023]: -- 172.21.15.37:0/173500054 <== mon.0 v2:172.21.15.37:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55fad2131860 con 0x55fad210f000 2024-09-11T23:15:35.564 INFO:journalctl@ceph.mds.j.smithi037.stdout:Sep 11 23:15:35 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-j[70008]: starting mds.j at 2024-09-11T23:15:35.565 INFO:journalctl@ceph.mds.j.smithi037.stdout:Sep 11 23:15:35 smithi037 bash[69982]: 9ead93e0f5a3f43501ddc78af177ed532602edbfdd5114b6f4ee8ab6ff1af610 2024-09-11T23:15:35.565 INFO:journalctl@ceph.mds.j.smithi037.stdout:Sep 11 23:15:35 smithi037 systemd[1]: Started Ceph mds.j for 8b03efce-7092-11ef-bcea-c7b262605968. 2024-09-11T23:15:35.934 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:35 smithi037 ceph-mon[30630]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:15:35.934 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:35 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:35.935 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:35 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:35.935 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:35 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:35.935 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:35 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:15:35.935 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:35 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:15:35.935 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:35 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:15:36.048 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:35 smithi160 ceph-mon[35055]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:15:36.048 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:35 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:36.048 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:35 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:36.049 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:35 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:36.049 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:35 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:15:36.049 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:35 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:15:36.049 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:35 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:15:36.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:36.052+0000 7f5471a00640 1 -- 172.21.15.37:0/552408174 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f546c076720 msgr2=0x7f546c076b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:36.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:36.052+0000 7f5471a00640 1 --2- 172.21.15.37:0/552408174 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f546c076720 0x7f546c076b00 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f545c009900 tx=0x7f545c02a410 comp rx=0 tx=0).stop 2024-09-11T23:15:36.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:36.052+0000 7f5471a00640 1 -- 172.21.15.37:0/552408174 shutdown_connections 2024-09-11T23:15:36.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:36.052+0000 7f5471a00640 1 --2- 172.21.15.37:0/552408174 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f546c077040 0x7f546c112330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:36.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:36.052+0000 7f5471a00640 1 --2- 172.21.15.37:0/552408174 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f546c112870 0x7f546c114c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:36.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:36.052+0000 7f5471a00640 1 --2- 172.21.15.37:0/552408174 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f546c076720 0x7f546c076b00 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:36.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:36.052+0000 7f5471a00640 1 -- 172.21.15.37:0/552408174 >> 172.21.15.37:0/552408174 conn(0x7f546c0ff8d0 msgr2=0x7f546c101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:36.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:36.052+0000 7f5471a00640 1 -- 172.21.15.37:0/552408174 shutdown_connections 2024-09-11T23:15:36.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:36.052+0000 7f5471a00640 1 -- 172.21.15.37:0/552408174 wait complete. 2024-09-11T23:15:36.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:36.053+0000 7f5471a00640 1 Processor -- start 2024-09-11T23:15:36.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:36.054+0000 7f5471a00640 1 -- start start 2024-09-11T23:15:36.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:36.054+0000 7f5471a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f546c076720 0x7f546c1a4660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:36.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:36.054+0000 7f5471a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f546c077040 0x7f546c1a4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:36.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:36.054+0000 7f5471a00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f546c112870 0x7f546c19e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:36.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:36.054+0000 7f5471a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f546c118400 con 0x7f546c076720 2024-09-11T23:15:36.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:36.054+0000 7f5471a00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f546c118280 con 0x7f546c077040 2024-09-11T23:15:36.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:36.054+0000 7f5471a00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f546c118580 con 0x7f546c112870 2024-09-11T23:15:36.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:36.055+0000 7f546be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f546c076720 0x7f546c1a4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:36.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:36.055+0000 7f546be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f546c076720 0x7f546c1a4660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53852/0 (socket says 172.21.15.37:53852) 2024-09-11T23:15:36.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:36.055+0000 7f546be00640 1 -- 172.21.15.37:0/3741747075 learned_addr learned my addr 172.21.15.37:0/3741747075 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:15:36.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:36.055+0000 7f5463400640 1 --2- 172.21.15.37:0/3741747075 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f546c077040 0x7f546c1a4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:36.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:36.055+0000 7f546be00640 1 -- 172.21.15.37:0/3741747075 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f546c112870 msgr2=0x7f546c19e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:36.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:36.055+0000 7f546be00640 1 --2- 172.21.15.37:0/3741747075 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f546c112870 0x7f546c19e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:36.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:36.055+0000 7f546be00640 1 -- 172.21.15.37:0/3741747075 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f546c077040 msgr2=0x7f546c1a4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:36.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:36.055+0000 7f546be00640 1 --2- 172.21.15.37:0/3741747075 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f546c077040 0x7f546c1a4ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:36.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:36.055+0000 7f546be00640 1 -- 172.21.15.37:0/3741747075 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f546c19efa0 con 0x7f546c076720 2024-09-11T23:15:36.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:36.056+0000 7f546be00640 1 --2- 172.21.15.37:0/3741747075 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f546c076720 0x7f546c1a4660 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f545c006010 tx=0x7f545c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:36.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:36.056+0000 7f5469600640 1 -- 172.21.15.37:0/3741747075 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f545c03f030 con 0x7f546c076720 2024-09-11T23:15:36.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:36.056+0000 7f5471a00640 1 -- 172.21.15.37:0/3741747075 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f546c19f230 con 0x7f546c076720 2024-09-11T23:15:36.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:36.056+0000 7f5469600640 1 -- 172.21.15.37:0/3741747075 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f545c003ce0 con 0x7f546c076720 2024-09-11T23:15:36.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:36.056+0000 7f5469600640 1 -- 172.21.15.37:0/3741747075 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f545c035070 con 0x7f546c076720 2024-09-11T23:15:36.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:36.056+0000 7f5471a00640 1 -- 172.21.15.37:0/3741747075 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f546c1ab410 con 0x7f546c076720 2024-09-11T23:15:36.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:36.057+0000 7f5471a00640 1 -- 172.21.15.37:0/3741747075 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f546c077e60 con 0x7f546c076720 2024-09-11T23:15:36.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:36.060+0000 7f5469600640 1 -- 172.21.15.37:0/3741747075 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f545c042030 con 0x7f546c076720 2024-09-11T23:15:36.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:36.062+0000 7f5469600640 1 --2- 172.21.15.37:0/3741747075 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f54500a2c00 0x7f54500a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:36.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:36.062+0000 7f5469600640 1 -- 172.21.15.37:0/3741747075 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f545c0eed60 con 0x7f546c076720 2024-09-11T23:15:36.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:36.063+0000 7f5463400640 1 --2- 172.21.15.37:0/3741747075 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f54500a2c00 0x7f54500a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:36.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:36.064+0000 7f5463400640 1 --2- 172.21.15.37:0/3741747075 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f54500a2c00 0x7f54500a50c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f546c19ff80 tx=0x7f5454005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:36.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:36.067+0000 7f5469600640 1 -- 172.21.15.37:0/3741747075 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f545c0bc180 con 0x7f546c076720 2024-09-11T23:15:36.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:35 smithi123 ceph-mon[35438]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:15:36.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:35 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:36.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:35 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:36.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:35 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:36.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:35 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:15:36.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:35 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:15:36.252 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:35 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:15:36.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:36.300+0000 7f5471a00640 1 -- 172.21.15.37:0/3741747075 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f546c1ab610 con 0x7f546c076720 2024-09-11T23:15:36.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:36.301+0000 7f5469600640 1 -- 172.21.15.37:0/3741747075 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3088 (secure 0 0 0) 0x7f545c0bba80 con 0x7f546c076720 2024-09-11T23:15:36.301 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:15:36.301 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":4,"btime":"2024-09-11T23:15:35:748732+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14448,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/285120996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":285120996},{"type":"v1","addr":"172.21.15.37:6835","nonce":285120996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24440,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/3380294842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":3380294842},{"type":"v1","addr":"172.21.15.123:6833","nonce":3380294842}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/1918127245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":1918127245},{"type":"v1","addr":"172.21.15.160:6833","nonce":1918127245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-11T23:15:36.302 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 4 2024-09-11T23:15:36.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:36.303+0000 7f5471a00640 1 -- 172.21.15.37:0/3741747075 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f54500a2c00 msgr2=0x7f54500a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:36.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:36.303+0000 7f5471a00640 1 --2- 172.21.15.37:0/3741747075 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f54500a2c00 0x7f54500a50c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f546c19ff80 tx=0x7f5454005f90 comp rx=0 tx=0).stop 2024-09-11T23:15:36.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:36.303+0000 7f5471a00640 1 -- 172.21.15.37:0/3741747075 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f546c076720 msgr2=0x7f546c1a4660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:36.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:36.303+0000 7f5471a00640 1 --2- 172.21.15.37:0/3741747075 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f546c076720 0x7f546c1a4660 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f545c006010 tx=0x7f545c0042f0 comp rx=0 tx=0).stop 2024-09-11T23:15:36.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:36.303+0000 7f5471a00640 1 -- 172.21.15.37:0/3741747075 shutdown_connections 2024-09-11T23:15:36.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:36.303+0000 7f5471a00640 1 --2- 172.21.15.37:0/3741747075 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f54500a2c00 0x7f54500a50c0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:36.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:36.303+0000 7f5471a00640 1 --2- 172.21.15.37:0/3741747075 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f546c077040 0x7f546c1a4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:36.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:36.303+0000 7f5471a00640 1 --2- 172.21.15.37:0/3741747075 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f546c112870 0x7f546c19e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:36.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:36.303+0000 7f5471a00640 1 --2- 172.21.15.37:0/3741747075 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f546c076720 0x7f546c1a4660 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:36.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:36.303+0000 7f5471a00640 1 -- 172.21.15.37:0/3741747075 >> 172.21.15.37:0/3741747075 conn(0x7f546c0ff8d0 msgr2=0x7f546c101cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:36.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:36.303+0000 7f5471a00640 1 -- 172.21.15.37:0/3741747075 shutdown_connections 2024-09-11T23:15:36.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:36.303+0000 7f5471a00640 1 -- 172.21.15.37:0/3741747075 wait complete. 2024-09-11T23:15:36.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:36 smithi160 ceph-mon[35055]: Deploying daemon mds.d on smithi037 2024-09-11T23:15:36.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:36 smithi160 ceph-mon[35055]: mds.? [v2:172.21.15.37:6834/285120996,v1:172.21.15.37:6835/285120996] up:boot 2024-09-11T23:15:36.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:36 smithi160 ceph-mon[35055]: fsmap 3 up:standby 2024-09-11T23:15:36.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:36 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-11T23:15:36.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:36 smithi160 ceph-mon[35055]: from='client.? 172.21.15.37:0/3741747075' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:15:36.997 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:36 smithi037 ceph-mon[30630]: Deploying daemon mds.d on smithi037 2024-09-11T23:15:36.997 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:36 smithi037 ceph-mon[30630]: mds.? [v2:172.21.15.37:6834/285120996,v1:172.21.15.37:6835/285120996] up:boot 2024-09-11T23:15:36.997 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:36 smithi037 ceph-mon[30630]: fsmap 3 up:standby 2024-09-11T23:15:36.997 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:36 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-11T23:15:36.998 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:36 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/3741747075' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:15:37.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:36 smithi123 ceph-mon[35438]: Deploying daemon mds.d on smithi037 2024-09-11T23:15:37.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:36 smithi123 ceph-mon[35438]: mds.? [v2:172.21.15.37:6834/285120996,v1:172.21.15.37:6835/285120996] up:boot 2024-09-11T23:15:37.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:36 smithi123 ceph-mon[35438]: fsmap 3 up:standby 2024-09-11T23:15:37.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:36 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-11T23:15:37.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:36 smithi123 ceph-mon[35438]: from='client.? 172.21.15.37:0/3741747075' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:15:38.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:37 smithi037 ceph-mon[30630]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:15:38.105 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:37 smithi160 ceph-mon[35055]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:15:38.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:37 smithi123 ceph-mon[35438]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:15:39.122 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T23:15:39.146 INFO:journalctl@ceph.mds.d.smithi037.stdout:Sep 11 23:15:38 smithi037 systemd[1]: Starting Ceph mds.d for 8b03efce-7092-11ef-bcea-c7b262605968... 2024-09-11T23:15:39.402 INFO:journalctl@ceph.mds.d.smithi037.stdout:Sep 11 23:15:39 smithi037 podman[70375]: 2024-09-11 23:15:39.051000585 +0000 UTC m=+0.027555956 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T23:15:39.403 INFO:journalctl@ceph.mds.d.smithi037.stdout:Sep 11 23:15:39 smithi037 podman[70375]: 2024-09-11 23:15:39.166713471 +0000 UTC m=+0.143268832 container create a5ddc41a5961d4dd605ed0b7edcd5b4d3003c01b581314fed49a00106195eaca (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-d, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-11T23:15:39.403 INFO:journalctl@ceph.mds.d.smithi037.stdout:Sep 11 23:15:39 smithi037 podman[70375]: 2024-09-11 23:15:39.402940544 +0000 UTC m=+0.379495915 container init a5ddc41a5961d4dd605ed0b7edcd5b4d3003c01b581314fed49a00106195eaca (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-d, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T23:15:39.627 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:15:39.768 INFO:journalctl@ceph.mds.d.smithi037.stdout:Sep 11 23:15:39 smithi037 podman[70375]: 2024-09-11 23:15:39.411685411 +0000 UTC m=+0.388240785 container start a5ddc41a5961d4dd605ed0b7edcd5b4d3003c01b581314fed49a00106195eaca (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-d, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T23:15:39.768 INFO:journalctl@ceph.mds.d.smithi037.stdout:Sep 11 23:15:39 smithi037 ceph-mds[70424]: -- 172.21.15.37:0/3179198832 <== mon.0 v2:172.21.15.37:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a33ad51860 con 0x55a33ad2f400 2024-09-11T23:15:39.768 INFO:journalctl@ceph.mds.d.smithi037.stdout:Sep 11 23:15:39 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-d[70408]: starting mds.d at 2024-09-11T23:15:39.769 INFO:journalctl@ceph.mds.d.smithi037.stdout:Sep 11 23:15:39 smithi037 bash[70375]: a5ddc41a5961d4dd605ed0b7edcd5b4d3003c01b581314fed49a00106195eaca 2024-09-11T23:15:39.769 INFO:journalctl@ceph.mds.d.smithi037.stdout:Sep 11 23:15:39 smithi037 systemd[1]: Started Ceph mds.d for 8b03efce-7092-11ef-bcea-c7b262605968. 2024-09-11T23:15:40.051 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:39 smithi123 ceph-mon[35438]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:15:40.051 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:39 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:40.051 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:39 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:40.051 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:39 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:40.051 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:39 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:15:40.051 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:39 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:15:40.051 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:39 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:15:40.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:39 smithi037 ceph-mon[30630]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:15:40.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:39 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:40.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:39 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:40.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:39 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:40.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:39 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:15:40.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:39 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:15:40.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:39 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:15:40.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:39 smithi160 ceph-mon[35055]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:15:40.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:39 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:40.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:39 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:40.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:39 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:40.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:39 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:15:40.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:39 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:15:40.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:39 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:15:40.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:40.216+0000 7f0124a00640 1 -- 172.21.15.37:0/3304964171 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0120076720 msgr2=0x7f0120076b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:40.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:40.216+0000 7f0124a00640 1 --2- 172.21.15.37:0/3304964171 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0120076720 0x7f0120076b00 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f0110009900 tx=0x7f011002a410 comp rx=0 tx=0).stop 2024-09-11T23:15:40.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:40.216+0000 7f0124a00640 1 -- 172.21.15.37:0/3304964171 shutdown_connections 2024-09-11T23:15:40.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:40.216+0000 7f0124a00640 1 --2- 172.21.15.37:0/3304964171 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0120077040 0x7f01201124f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:40.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:40.216+0000 7f0124a00640 1 --2- 172.21.15.37:0/3304964171 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0120112a30 0x7f0120114e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:40.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:40.216+0000 7f0124a00640 1 --2- 172.21.15.37:0/3304964171 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0120076720 0x7f0120076b00 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:40.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:40.216+0000 7f0124a00640 1 -- 172.21.15.37:0/3304964171 >> 172.21.15.37:0/3304964171 conn(0x7f01200ffa90 msgr2=0x7f0120101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:40.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:40.216+0000 7f0124a00640 1 -- 172.21.15.37:0/3304964171 shutdown_connections 2024-09-11T23:15:40.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:40.216+0000 7f0124a00640 1 -- 172.21.15.37:0/3304964171 wait complete. 2024-09-11T23:15:40.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:40.217+0000 7f0124a00640 1 Processor -- start 2024-09-11T23:15:40.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:40.217+0000 7f0124a00640 1 -- start start 2024-09-11T23:15:40.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:40.218+0000 7f0124a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0120076720 0x7f01201a4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:40.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:40.218+0000 7f0124a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0120077040 0x7f01201a4c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:40.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:40.218+0000 7f0124a00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0120112a30 0x7f012019e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:40.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:40.218+0000 7f0124a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f01201185a0 con 0x7f0120077040 2024-09-11T23:15:40.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:40.218+0000 7f0124a00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f0120118420 con 0x7f0120076720 2024-09-11T23:15:40.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:40.218+0000 7f0124a00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f0120118720 con 0x7f0120112a30 2024-09-11T23:15:40.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:40.218+0000 7f011d400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0120077040 0x7f01201a4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:40.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:40.218+0000 7f011de00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0120076720 0x7f01201a4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:40.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:40.218+0000 7f011de00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0120076720 0x7f01201a4710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.37:36274/0 (socket says 172.21.15.37:36274) 2024-09-11T23:15:40.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:40.218+0000 7f011d400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0120077040 0x7f01201a4c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41504/0 (socket says 172.21.15.37:41504) 2024-09-11T23:15:40.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:40.218+0000 7f011de00640 1 -- 172.21.15.37:0/3780183795 learned_addr learned my addr 172.21.15.37:0/3780183795 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:15:40.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:40.218+0000 7f011e800640 1 --2- 172.21.15.37:0/3780183795 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0120112a30 0x7f012019e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:40.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:40.219+0000 7f011de00640 1 -- 172.21.15.37:0/3780183795 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0120112a30 msgr2=0x7f012019e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:40.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:40.219+0000 7f011de00640 1 --2- 172.21.15.37:0/3780183795 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0120112a30 0x7f012019e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:40.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:40.219+0000 7f011de00640 1 -- 172.21.15.37:0/3780183795 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0120077040 msgr2=0x7f01201a4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:40.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:40.219+0000 7f011de00640 1 --2- 172.21.15.37:0/3780183795 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0120077040 0x7f01201a4c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:40.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:40.219+0000 7f011de00640 1 -- 172.21.15.37:0/3780183795 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f012019f000 con 0x7f0120076720 2024-09-11T23:15:40.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:40.219+0000 7f011de00640 1 --2- 172.21.15.37:0/3780183795 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0120076720 0x7f01201a4710 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0110006010 tx=0x7f0110004040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:40.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:40.219+0000 7f0116a00640 1 -- 172.21.15.37:0/3780183795 <== mon.2 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f011003f030 con 0x7f0120076720 2024-09-11T23:15:40.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:40.219+0000 7f0116a00640 1 -- 172.21.15.37:0/3780183795 <== mon.2 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0110004440 con 0x7f0120076720 2024-09-11T23:15:40.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:40.219+0000 7f0124a00640 1 -- 172.21.15.37:0/3780183795 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f012019f290 con 0x7f0120076720 2024-09-11T23:15:40.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:40.219+0000 7f0116a00640 1 -- 172.21.15.37:0/3780183795 <== mon.2 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0110035070 con 0x7f0120076720 2024-09-11T23:15:40.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:40.219+0000 7f0124a00640 1 -- 172.21.15.37:0/3780183795 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01201ab5e0 con 0x7f0120076720 2024-09-11T23:15:40.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:40.220+0000 7f0124a00640 1 -- 172.21.15.37:0/3780183795 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0120076b00 con 0x7f0120076720 2024-09-11T23:15:40.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:40.222+0000 7f0116a00640 1 -- 172.21.15.37:0/3780183795 <== mon.2 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f0110042030 con 0x7f0120076720 2024-09-11T23:15:40.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:40.223+0000 7f0116a00640 1 --2- 172.21.15.37:0/3780183795 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f01040a2b80 0x7f01040a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:40.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:40.224+0000 7f0116a00640 1 -- 172.21.15.37:0/3780183795 <== mon.2 v2:172.21.15.123:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f01100eef90 con 0x7f0120076720 2024-09-11T23:15:40.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:40.224+0000 7f011d400640 1 --2- 172.21.15.37:0/3780183795 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f01040a2b80 0x7f01040a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:40.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:40.224+0000 7f011d400640 1 --2- 172.21.15.37:0/3780183795 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f01040a2b80 0x7f01040a5040 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0120079370 tx=0x7f010c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:40.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:40.228+0000 7f0116a00640 1 -- 172.21.15.37:0/3780183795 <== mon.2 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f01100bbca0 con 0x7f0120076720 2024-09-11T23:15:40.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:40.451+0000 7f0124a00640 1 -- 172.21.15.37:0/3780183795 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f012019fe00 con 0x7f0120076720 2024-09-11T23:15:40.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:40.452+0000 7f0116a00640 1 -- 172.21.15.37:0/3780183795 <== mon.2 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3913 (secure 0 0 0) 0x7f01100bffa0 con 0x7f0120076720 2024-09-11T23:15:40.452 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:15:40.453 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":5,"btime":"2024-09-11T23:15:39:777191+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14448,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/285120996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":285120996},{"type":"v1","addr":"172.21.15.37:6835","nonce":285120996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14460,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/3095283029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":3095283029},{"type":"v1","addr":"172.21.15.37:6837","nonce":3095283029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24440,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/3380294842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":3380294842},{"type":"v1","addr":"172.21.15.123:6833","nonce":3380294842}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/1918127245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":1918127245},{"type":"v1","addr":"172.21.15.160:6833","nonce":1918127245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-11T23:15:40.453 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 5 2024-09-11T23:15:40.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:40.455+0000 7f0124a00640 1 -- 172.21.15.37:0/3780183795 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f01040a2b80 msgr2=0x7f01040a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:40.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:40.455+0000 7f0124a00640 1 --2- 172.21.15.37:0/3780183795 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f01040a2b80 0x7f01040a5040 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0120079370 tx=0x7f010c005f90 comp rx=0 tx=0).stop 2024-09-11T23:15:40.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:40.455+0000 7f0124a00640 1 -- 172.21.15.37:0/3780183795 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0120076720 msgr2=0x7f01201a4710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:40.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:40.455+0000 7f0124a00640 1 --2- 172.21.15.37:0/3780183795 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0120076720 0x7f01201a4710 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0110006010 tx=0x7f0110004040 comp rx=0 tx=0).stop 2024-09-11T23:15:40.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:40.455+0000 7f0124a00640 1 -- 172.21.15.37:0/3780183795 shutdown_connections 2024-09-11T23:15:40.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:40.455+0000 7f0124a00640 1 --2- 172.21.15.37:0/3780183795 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f01040a2b80 0x7f01040a5040 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:40.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:40.455+0000 7f0124a00640 1 --2- 172.21.15.37:0/3780183795 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0120112a30 0x7f012019e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:40.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:40.455+0000 7f0124a00640 1 --2- 172.21.15.37:0/3780183795 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0120077040 0x7f01201a4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:40.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:40.455+0000 7f0124a00640 1 --2- 172.21.15.37:0/3780183795 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0120076720 0x7f01201a4710 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:40.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:40.455+0000 7f0124a00640 1 -- 172.21.15.37:0/3780183795 >> 172.21.15.37:0/3780183795 conn(0x7f01200ffa90 msgr2=0x7f0120101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:40.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:40.455+0000 7f0124a00640 1 -- 172.21.15.37:0/3780183795 shutdown_connections 2024-09-11T23:15:40.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:40.455+0000 7f0124a00640 1 -- 172.21.15.37:0/3780183795 wait complete. 2024-09-11T23:15:41.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:40 smithi037 ceph-mon[30630]: Deploying daemon mds.e on smithi123 2024-09-11T23:15:41.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:40 smithi037 ceph-mon[30630]: mds.? [v2:172.21.15.37:6836/3095283029,v1:172.21.15.37:6837/3095283029] up:boot 2024-09-11T23:15:41.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:40 smithi037 ceph-mon[30630]: fsmap 4 up:standby 2024-09-11T23:15:41.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:40 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-11T23:15:41.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:40 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/3780183795' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:15:41.079 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:40 smithi123 ceph-mon[35438]: Deploying daemon mds.e on smithi123 2024-09-11T23:15:41.079 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:40 smithi123 ceph-mon[35438]: mds.? [v2:172.21.15.37:6836/3095283029,v1:172.21.15.37:6837/3095283029] up:boot 2024-09-11T23:15:41.079 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:40 smithi123 ceph-mon[35438]: fsmap 4 up:standby 2024-09-11T23:15:41.079 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:40 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-11T23:15:41.079 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:40 smithi123 ceph-mon[35438]: from='client.? 172.21.15.37:0/3780183795' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:15:41.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:40 smithi160 ceph-mon[35055]: Deploying daemon mds.e on smithi123 2024-09-11T23:15:41.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:40 smithi160 ceph-mon[35055]: mds.? [v2:172.21.15.37:6836/3095283029,v1:172.21.15.37:6837/3095283029] up:boot 2024-09-11T23:15:41.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:40 smithi160 ceph-mon[35055]: fsmap 4 up:standby 2024-09-11T23:15:41.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:40 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-11T23:15:41.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:40 smithi160 ceph-mon[35055]: from='client.? 172.21.15.37:0/3780183795' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:15:41.751 INFO:journalctl@ceph.mds.e.smithi123.stdout:Sep 11 23:15:41 smithi123 systemd[1]: Starting Ceph mds.e for 8b03efce-7092-11ef-bcea-c7b262605968... 2024-09-11T23:15:42.047 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:41 smithi123 ceph-mon[35438]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:15:42.047 INFO:journalctl@ceph.mds.e.smithi123.stdout:Sep 11 23:15:41 smithi123 podman[64959]: 2024-09-11 23:15:41.801955435 +0000 UTC m=+0.016025986 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T23:15:42.047 INFO:journalctl@ceph.mds.e.smithi123.stdout:Sep 11 23:15:41 smithi123 podman[64959]: 2024-09-11 23:15:41.928946908 +0000 UTC m=+0.143017486 container create d4249ad555eb6ce572f388b371ab46d188fe533001fd660daf81fd8888f7eacf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-e, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-11T23:15:42.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:41 smithi037 ceph-mon[30630]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:15:42.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:41 smithi160 ceph-mon[35055]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:15:42.501 INFO:journalctl@ceph.mds.e.smithi123.stdout:Sep 11 23:15:42 smithi123 podman[64959]: 2024-09-11 23:15:42.173111481 +0000 UTC m=+0.387182017 container init d4249ad555eb6ce572f388b371ab46d188fe533001fd660daf81fd8888f7eacf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-e, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-11T23:15:42.501 INFO:journalctl@ceph.mds.e.smithi123.stdout:Sep 11 23:15:42 smithi123 podman[64959]: 2024-09-11 23:15:42.176300571 +0000 UTC m=+0.390371110 container start d4249ad555eb6ce572f388b371ab46d188fe533001fd660daf81fd8888f7eacf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-e, ceph=True, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T23:15:42.501 INFO:journalctl@ceph.mds.e.smithi123.stdout:Sep 11 23:15:42 smithi123 ceph-mds[64978]: -- 172.21.15.123:0/4256720492 <== mon.2 v2:172.21.15.123:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563d64279860 con 0x563d64257400 2024-09-11T23:15:42.501 INFO:journalctl@ceph.mds.e.smithi123.stdout:Sep 11 23:15:42 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-e[64974]: starting mds.e at 2024-09-11T23:15:42.501 INFO:journalctl@ceph.mds.e.smithi123.stdout:Sep 11 23:15:42 smithi123 bash[64959]: d4249ad555eb6ce572f388b371ab46d188fe533001fd660daf81fd8888f7eacf 2024-09-11T23:15:42.502 INFO:journalctl@ceph.mds.e.smithi123.stdout:Sep 11 23:15:42 smithi123 systemd[1]: Started Ceph mds.e for 8b03efce-7092-11ef-bcea-c7b262605968. 2024-09-11T23:15:43.174 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T23:15:43.557 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:15:43.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:43 smithi037 ceph-mon[30630]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:15:43.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:43 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:43.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:43 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:43.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:43 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:43.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:43 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:15:43.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:43 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:15:43.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:43 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:15:43.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:43 smithi037 ceph-mon[30630]: Deploying daemon mds.f on smithi160 2024-09-11T23:15:43.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:43 smithi037 ceph-mon[30630]: mds.? [v2:172.21.15.123:6834/3928690501,v1:172.21.15.123:6835/3928690501] up:boot 2024-09-11T23:15:43.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:43 smithi037 ceph-mon[30630]: fsmap 5 up:standby 2024-09-11T23:15:43.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:43 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-11T23:15:43.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:43 smithi160 ceph-mon[35055]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:15:43.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:43 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:43.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:43 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:43.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:43 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:43.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:43 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:15:43.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:43 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:15:43.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:43 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:15:43.685 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:43 smithi160 ceph-mon[35055]: Deploying daemon mds.f on smithi160 2024-09-11T23:15:43.685 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:43 smithi160 ceph-mon[35055]: mds.? [v2:172.21.15.123:6834/3928690501,v1:172.21.15.123:6835/3928690501] up:boot 2024-09-11T23:15:43.685 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:43 smithi160 ceph-mon[35055]: fsmap 5 up:standby 2024-09-11T23:15:43.685 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:43 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-11T23:15:43.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:43 smithi123 ceph-mon[35438]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:15:43.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:43 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:43.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:43 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:43.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:43 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:43.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:43 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:15:43.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:43 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:15:43.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:43 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:15:43.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:43 smithi123 ceph-mon[35438]: Deploying daemon mds.f on smithi160 2024-09-11T23:15:43.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:43 smithi123 ceph-mon[35438]: mds.? [v2:172.21.15.123:6834/3928690501,v1:172.21.15.123:6835/3928690501] up:boot 2024-09-11T23:15:43.752 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:43 smithi123 ceph-mon[35438]: fsmap 5 up:standby 2024-09-11T23:15:43.752 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:43 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-11T23:15:44.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:44.136+0000 7fcb1c200640 1 -- 172.21.15.37:0/1249929902 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcb14109120 msgr2=0x7fcb14110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:44.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:44.136+0000 7fcb1c200640 1 --2- 172.21.15.37:0/1249929902 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcb14109120 0x7fcb14110ca0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c009ca0 tx=0x7fcb0c02a8c0 comp rx=0 tx=0).stop 2024-09-11T23:15:44.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:44.136+0000 7fcb1c200640 1 -- 172.21.15.37:0/1249929902 shutdown_connections 2024-09-11T23:15:44.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:44.136+0000 7fcb1c200640 1 --2- 172.21.15.37:0/1249929902 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcb14109120 0x7fcb14110ca0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:44.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:44.136+0000 7fcb1c200640 1 --2- 172.21.15.37:0/1249929902 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb141049a0 0x7fcb141089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:44.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:44.136+0000 7fcb1c200640 1 --2- 172.21.15.37:0/1249929902 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb14103ff0 0x7fcb141043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:44.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:44.136+0000 7fcb1c200640 1 -- 172.21.15.37:0/1249929902 >> 172.21.15.37:0/1249929902 conn(0x7fcb140ffa90 msgr2=0x7fcb14101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:44.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:44.136+0000 7fcb1c200640 1 -- 172.21.15.37:0/1249929902 shutdown_connections 2024-09-11T23:15:44.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:44.137+0000 7fcb1c200640 1 -- 172.21.15.37:0/1249929902 wait complete. 2024-09-11T23:15:44.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:44.138+0000 7fcb1c200640 1 Processor -- start 2024-09-11T23:15:44.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:44.138+0000 7fcb1c200640 1 -- start start 2024-09-11T23:15:44.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:44.138+0000 7fcb1c200640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcb14103ff0 0x7fcb1419a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:44.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:44.138+0000 7fcb1c200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb141049a0 0x7fcb1419aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:44.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:44.138+0000 7fcb1c200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb14109120 0x7fcb1419ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:44.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:44.138+0000 7fcb1c200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fcb14114150 con 0x7fcb141049a0 2024-09-11T23:15:44.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:44.138+0000 7fcb1c200640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fcb14113fd0 con 0x7fcb14109120 2024-09-11T23:15:44.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:44.138+0000 7fcb1c200640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fcb141142d0 con 0x7fcb14103ff0 2024-09-11T23:15:44.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:44.138+0000 7fcb19800640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcb14103ff0 0x7fcb1419a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:44.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:44.138+0000 7fcb19800640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcb14103ff0 0x7fcb1419a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.37:58946/0 (socket says 172.21.15.37:58946) 2024-09-11T23:15:44.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:44.138+0000 7fcb19800640 1 -- 172.21.15.37:0/3792162103 learned_addr learned my addr 172.21.15.37:0/3792162103 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:15:44.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:44.138+0000 7fcb18e00640 1 --2- 172.21.15.37:0/3792162103 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb141049a0 0x7fcb1419aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:44.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:44.139+0000 7fcb1a200640 1 --2- 172.21.15.37:0/3792162103 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb14109120 0x7fcb1419ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:44.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:44.139+0000 7fcb19800640 1 -- 172.21.15.37:0/3792162103 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb14109120 msgr2=0x7fcb1419ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:44.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:44.139+0000 7fcb19800640 1 --2- 172.21.15.37:0/3792162103 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb14109120 0x7fcb1419ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:44.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:44.139+0000 7fcb19800640 1 -- 172.21.15.37:0/3792162103 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb141049a0 msgr2=0x7fcb1419aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:44.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:44.139+0000 7fcb19800640 1 --2- 172.21.15.37:0/3792162103 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb141049a0 0x7fcb1419aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:44.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:44.139+0000 7fcb19800640 1 -- 172.21.15.37:0/3792162103 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb1419f560 con 0x7fcb14103ff0 2024-09-11T23:15:44.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:44.139+0000 7fcb18e00640 1 --2- 172.21.15.37:0/3792162103 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb141049a0 0x7fcb1419aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:15:44.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:44.139+0000 7fcb19800640 1 --2- 172.21.15.37:0/3792162103 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcb14103ff0 0x7fcb1419a5b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fcb0800d770 tx=0x7fcb0800dc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:44.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:44.139+0000 7fcb12000640 1 -- 172.21.15.37:0/3792162103 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb08017070 con 0x7fcb14103ff0 2024-09-11T23:15:44.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:44.139+0000 7fcb12000640 1 -- 172.21.15.37:0/3792162103 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcb08005500 con 0x7fcb14103ff0 2024-09-11T23:15:44.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:44.139+0000 7fcb12000640 1 -- 172.21.15.37:0/3792162103 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb08004e00 con 0x7fcb14103ff0 2024-09-11T23:15:44.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:44.139+0000 7fcb1c200640 1 -- 172.21.15.37:0/3792162103 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb1419f850 con 0x7fcb14103ff0 2024-09-11T23:15:44.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:44.140+0000 7fcb1c200640 1 -- 172.21.15.37:0/3792162103 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb141a7130 con 0x7fcb14103ff0 2024-09-11T23:15:44.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:44.141+0000 7fcb1c200640 1 -- 172.21.15.37:0/3792162103 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb141043d0 con 0x7fcb14103ff0 2024-09-11T23:15:44.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:44.143+0000 7fcb12000640 1 -- 172.21.15.37:0/3792162103 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fcb08004fa0 con 0x7fcb14103ff0 2024-09-11T23:15:44.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:44.144+0000 7fcb12000640 1 --2- 172.21.15.37:0/3792162103 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fcafc0a2c00 0x7fcafc0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:44.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:44.144+0000 7fcb12000640 1 -- 172.21.15.37:0/3792162103 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7fcb080ce610 con 0x7fcb14103ff0 2024-09-11T23:15:44.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:44.144+0000 7fcb18e00640 1 --2- 172.21.15.37:0/3792162103 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fcafc0a2c00 0x7fcafc0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:44.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:44.145+0000 7fcb18e00640 1 --2- 172.21.15.37:0/3792162103 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fcafc0a2c00 0x7fcafc0a50c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fcb140ffeb0 tx=0x7fcb00005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:44.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:44.150+0000 7fcb12000640 1 -- 172.21.15.37:0/3792162103 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fcb0809b9f0 con 0x7fcb14103ff0 2024-09-11T23:15:44.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:44.375+0000 7fcb1c200640 1 -- 172.21.15.37:0/3792162103 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcb141a7300 con 0x7fcb14103ff0 2024-09-11T23:15:44.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:44.376+0000 7fcb12000640 1 -- 172.21.15.37:0/3792162103 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4741 (secure 0 0 0) 0x7fcb0809b2f0 con 0x7fcb14103ff0 2024-09-11T23:15:44.376 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:15:44.377 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":6,"btime":"2024-09-11T23:15:42:791241+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14448,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/285120996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":285120996},{"type":"v1","addr":"172.21.15.37:6835","nonce":285120996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14460,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/3095283029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":3095283029},{"type":"v1","addr":"172.21.15.37:6837","nonce":3095283029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24440,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/3380294842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":3380294842},{"type":"v1","addr":"172.21.15.123:6833","nonce":3380294842}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/1918127245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":1918127245},{"type":"v1","addr":"172.21.15.160:6833","nonce":1918127245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24476,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/3928690501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":3928690501},{"type":"v1","addr":"172.21.15.123:6835","nonce":3928690501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-09-11T23:15:44.377 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 6 2024-09-11T23:15:44.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:44.378+0000 7fcb1c200640 1 -- 172.21.15.37:0/3792162103 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fcafc0a2c00 msgr2=0x7fcafc0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:44.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:44.378+0000 7fcb1c200640 1 --2- 172.21.15.37:0/3792162103 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fcafc0a2c00 0x7fcafc0a50c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fcb140ffeb0 tx=0x7fcb00005f90 comp rx=0 tx=0).stop 2024-09-11T23:15:44.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:44.379+0000 7fcb1c200640 1 -- 172.21.15.37:0/3792162103 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcb14103ff0 msgr2=0x7fcb1419a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:44.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:44.379+0000 7fcb1c200640 1 --2- 172.21.15.37:0/3792162103 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcb14103ff0 0x7fcb1419a5b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fcb0800d770 tx=0x7fcb0800dc30 comp rx=0 tx=0).stop 2024-09-11T23:15:44.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:44.379+0000 7fcb1c200640 1 -- 172.21.15.37:0/3792162103 shutdown_connections 2024-09-11T23:15:44.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:44.379+0000 7fcb1c200640 1 --2- 172.21.15.37:0/3792162103 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fcafc0a2c00 0x7fcafc0a50c0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:44.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:44.379+0000 7fcb1c200640 1 --2- 172.21.15.37:0/3792162103 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb14109120 0x7fcb1419ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:44.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:44.379+0000 7fcb1c200640 1 --2- 172.21.15.37:0/3792162103 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb141049a0 0x7fcb1419aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:44.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:44.379+0000 7fcb1c200640 1 --2- 172.21.15.37:0/3792162103 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcb14103ff0 0x7fcb1419a5b0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:44.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:44.379+0000 7fcb1c200640 1 -- 172.21.15.37:0/3792162103 >> 172.21.15.37:0/3792162103 conn(0x7fcb140ffa90 msgr2=0x7fcb14101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:44.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:44.379+0000 7fcb1c200640 1 -- 172.21.15.37:0/3792162103 shutdown_connections 2024-09-11T23:15:44.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:44.379+0000 7fcb1c200640 1 -- 172.21.15.37:0/3792162103 wait complete. 2024-09-11T23:15:44.434 INFO:journalctl@ceph.mds.f.smithi160.stdout:Sep 11 23:15:44 smithi160 systemd[1]: Starting Ceph mds.f for 8b03efce-7092-11ef-bcea-c7b262605968... 2024-09-11T23:15:44.749 INFO:journalctl@ceph.mds.f.smithi160.stdout:Sep 11 23:15:44 smithi160 podman[64533]: 2024-09-11 23:15:44.38448489 +0000 UTC m=+0.016568601 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T23:15:44.750 INFO:journalctl@ceph.mds.f.smithi160.stdout:Sep 11 23:15:44 smithi160 podman[64533]: 2024-09-11 23:15:44.495869768 +0000 UTC m=+0.127953502 container create 85da6bde1dd5530e7eb40a199c925b04be300f0532293cda152df5a8bd367dec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-f, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-11T23:15:44.750 INFO:journalctl@ceph.mds.f.smithi160.stdout:Sep 11 23:15:44 smithi160 podman[64533]: 2024-09-11 23:15:44.723346394 +0000 UTC m=+0.355430092 container init 85da6bde1dd5530e7eb40a199c925b04be300f0532293cda152df5a8bd367dec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-f, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-11T23:15:44.750 INFO:journalctl@ceph.mds.f.smithi160.stdout:Sep 11 23:15:44 smithi160 podman[64533]: 2024-09-11 23:15:44.726045247 +0000 UTC m=+0.358128940 container start 85da6bde1dd5530e7eb40a199c925b04be300f0532293cda152df5a8bd367dec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-f, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-11T23:15:44.750 INFO:journalctl@ceph.mds.f.smithi160.stdout:Sep 11 23:15:44 smithi160 ceph-mds[64553]: -- 172.21.15.160:0/1132078575 <== mon.1 v2:172.21.15.160:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a08a2cb860 con 0x55a08a2a9000 2024-09-11T23:15:45.184 INFO:journalctl@ceph.mds.f.smithi160.stdout:Sep 11 23:15:44 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-f[64549]: starting mds.f at 2024-09-11T23:15:45.184 INFO:journalctl@ceph.mds.f.smithi160.stdout:Sep 11 23:15:44 smithi160 bash[64533]: 85da6bde1dd5530e7eb40a199c925b04be300f0532293cda152df5a8bd367dec 2024-09-11T23:15:45.184 INFO:journalctl@ceph.mds.f.smithi160.stdout:Sep 11 23:15:44 smithi160 systemd[1]: Started Ceph mds.f for 8b03efce-7092-11ef-bcea-c7b262605968. 2024-09-11T23:15:45.560 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:45 smithi160 ceph-mon[35055]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:15:45.561 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:45 smithi160 ceph-mon[35055]: from='client.? 172.21.15.37:0/3792162103' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:15:45.561 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:45 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:45.561 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:45 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:45.561 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:45 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:45.561 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:45 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:15:45.561 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:45 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:15:45.561 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:45 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:15:45.561 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:45 smithi160 ceph-mon[35055]: Deploying daemon mds.c on smithi160 2024-09-11T23:15:45.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:45 smithi123 ceph-mon[35438]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:15:45.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:45 smithi123 ceph-mon[35438]: from='client.? 172.21.15.37:0/3792162103' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:15:45.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:45 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:45.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:45 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:45.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:45 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:45.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:45 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:15:45.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:45 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:15:45.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:45 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:15:45.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:45 smithi123 ceph-mon[35438]: Deploying daemon mds.c on smithi160 2024-09-11T23:15:45.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:45 smithi037 ceph-mon[30630]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:15:45.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:45 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/3792162103' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:15:45.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:45 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:45.815 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:45 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:45.815 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:45 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:45.815 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:45 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:15:45.815 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:45 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:15:45.815 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:45 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:15:45.815 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:45 smithi037 ceph-mon[30630]: Deploying daemon mds.c on smithi160 2024-09-11T23:15:46.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:46 smithi037 ceph-mon[30630]: mds.? [v2:172.21.15.160:6834/2316897035,v1:172.21.15.160:6835/2316897035] up:boot 2024-09-11T23:15:46.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:46 smithi037 ceph-mon[30630]: fsmap 6 up:standby 2024-09-11T23:15:46.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:46 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-11T23:15:46.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:46 smithi160 ceph-mon[35055]: mds.? [v2:172.21.15.160:6834/2316897035,v1:172.21.15.160:6835/2316897035] up:boot 2024-09-11T23:15:46.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:46 smithi160 ceph-mon[35055]: fsmap 6 up:standby 2024-09-11T23:15:46.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:46 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-11T23:15:46.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:46 smithi123 ceph-mon[35438]: mds.? [v2:172.21.15.160:6834/2316897035,v1:172.21.15.160:6835/2316897035] up:boot 2024-09-11T23:15:46.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:46 smithi123 ceph-mon[35438]: fsmap 6 up:standby 2024-09-11T23:15:46.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:46 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-11T23:15:47.113 INFO:journalctl@ceph.mds.c.smithi160.stdout:Sep 11 23:15:46 smithi160 systemd[1]: Starting Ceph mds.c for 8b03efce-7092-11ef-bcea-c7b262605968... 2024-09-11T23:15:47.259 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T23:15:47.379 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:47 smithi160 ceph-mon[35055]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:15:47.379 INFO:journalctl@ceph.mds.c.smithi160.stdout:Sep 11 23:15:47 smithi160 podman[64834]: 2024-09-11 23:15:47.016277334 +0000 UTC m=+0.016141445 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T23:15:47.379 INFO:journalctl@ceph.mds.c.smithi160.stdout:Sep 11 23:15:47 smithi160 podman[64834]: 2024-09-11 23:15:47.117953064 +0000 UTC m=+0.117817237 container create f2e7795edd730b1374972d762bdef6725af83cf0fa0261afe20b127f3a3b066f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-c, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-11T23:15:47.379 INFO:journalctl@ceph.mds.c.smithi160.stdout:Sep 11 23:15:47 smithi160 podman[64834]: 2024-09-11 23:15:47.379590712 +0000 UTC m=+0.379454824 container init f2e7795edd730b1374972d762bdef6725af83cf0fa0261afe20b127f3a3b066f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-c, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-11T23:15:47.655 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:15:47.684 INFO:journalctl@ceph.mds.c.smithi160.stdout:Sep 11 23:15:47 smithi160 podman[64834]: 2024-09-11 23:15:47.382876256 +0000 UTC m=+0.382740376 container start f2e7795edd730b1374972d762bdef6725af83cf0fa0261afe20b127f3a3b066f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-c, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T23:15:47.684 INFO:journalctl@ceph.mds.c.smithi160.stdout:Sep 11 23:15:47 smithi160 ceph-mds[64853]: -- 172.21.15.160:0/3661278587 <== mon.1 v2:172.21.15.160:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559b8bdc3860 con 0x559b8bda1000 2024-09-11T23:15:47.684 INFO:journalctl@ceph.mds.c.smithi160.stdout:Sep 11 23:15:47 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-c[64849]: starting mds.c at 2024-09-11T23:15:47.684 INFO:journalctl@ceph.mds.c.smithi160.stdout:Sep 11 23:15:47 smithi160 bash[64834]: f2e7795edd730b1374972d762bdef6725af83cf0fa0261afe20b127f3a3b066f 2024-09-11T23:15:47.684 INFO:journalctl@ceph.mds.c.smithi160.stdout:Sep 11 23:15:47 smithi160 systemd[1]: Started Ceph mds.c for 8b03efce-7092-11ef-bcea-c7b262605968. 2024-09-11T23:15:47.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:47 smithi123 ceph-mon[35438]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:15:47.795 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:47 smithi037 ceph-mon[30630]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:15:48.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:48.279+0000 7fbd51600640 1 -- 172.21.15.37:0/1179396777 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd4c104010 msgr2=0x7fbd4c1043f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:48.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:48.279+0000 7fbd51600640 1 --2- 172.21.15.37:0/1179396777 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd4c104010 0x7fbd4c1043f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fbd3c009900 tx=0x7fbd3c02a410 comp rx=0 tx=0).stop 2024-09-11T23:15:48.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:48.279+0000 7fbd51600640 1 -- 172.21.15.37:0/1179396777 shutdown_connections 2024-09-11T23:15:48.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:48.279+0000 7fbd51600640 1 --2- 172.21.15.37:0/1179396777 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbd4c109140 0x7fbd4c110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:48.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:48.279+0000 7fbd51600640 1 --2- 172.21.15.37:0/1179396777 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbd4c1049c0 0x7fbd4c108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:48.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:48.279+0000 7fbd51600640 1 --2- 172.21.15.37:0/1179396777 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd4c104010 0x7fbd4c1043f0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:48.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:48.279+0000 7fbd51600640 1 -- 172.21.15.37:0/1179396777 >> 172.21.15.37:0/1179396777 conn(0x7fbd4c0ffa50 msgr2=0x7fbd4c101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:48.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:48.279+0000 7fbd51600640 1 -- 172.21.15.37:0/1179396777 shutdown_connections 2024-09-11T23:15:48.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:48.279+0000 7fbd51600640 1 -- 172.21.15.37:0/1179396777 wait complete. 2024-09-11T23:15:48.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:48.280+0000 7fbd51600640 1 Processor -- start 2024-09-11T23:15:48.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:48.280+0000 7fbd51600640 1 -- start start 2024-09-11T23:15:48.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:48.280+0000 7fbd51600640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbd4c104010 0x7fbd4c19a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:48.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:48.280+0000 7fbd51600640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbd4c1049c0 0x7fbd4c19ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:48.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:48.280+0000 7fbd51600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd4c109140 0x7fbd4c19ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:48.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:48.280+0000 7fbd51600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbd4c114160 con 0x7fbd4c109140 2024-09-11T23:15:48.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:48.280+0000 7fbd51600640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fbd4c113fe0 con 0x7fbd4c1049c0 2024-09-11T23:15:48.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:48.280+0000 7fbd51600640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fbd4c1142e0 con 0x7fbd4c104010 2024-09-11T23:15:48.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:48.281+0000 7fbd4b400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd4c109140 0x7fbd4c19ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:48.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:48.281+0000 7fbd4b400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd4c109140 0x7fbd4c19ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41536/0 (socket says 172.21.15.37:41536) 2024-09-11T23:15:48.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:48.281+0000 7fbd42000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbd4c1049c0 0x7fbd4c19ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:48.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:48.281+0000 7fbd4b400640 1 -- 172.21.15.37:0/575784857 learned_addr learned my addr 172.21.15.37:0/575784857 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:15:48.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:48.281+0000 7fbd4aa00640 1 --2- 172.21.15.37:0/575784857 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbd4c104010 0x7fbd4c19a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:48.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:48.281+0000 7fbd4b400640 1 -- 172.21.15.37:0/575784857 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbd4c104010 msgr2=0x7fbd4c19a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:48.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:48.281+0000 7fbd4b400640 1 --2- 172.21.15.37:0/575784857 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbd4c104010 0x7fbd4c19a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:48.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:48.281+0000 7fbd4b400640 1 -- 172.21.15.37:0/575784857 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbd4c1049c0 msgr2=0x7fbd4c19ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:48.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:48.281+0000 7fbd4b400640 1 --2- 172.21.15.37:0/575784857 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbd4c1049c0 0x7fbd4c19ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:48.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:48.281+0000 7fbd4b400640 1 -- 172.21.15.37:0/575784857 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd4c19f5f0 con 0x7fbd4c109140 2024-09-11T23:15:48.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:48.281+0000 7fbd42000640 1 --2- 172.21.15.37:0/575784857 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbd4c1049c0 0x7fbd4c19ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:15:48.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:48.282+0000 7fbd4b400640 1 --2- 172.21.15.37:0/575784857 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd4c109140 0x7fbd4c19ef10 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fbd4400eb10 tx=0x7fbd4400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:48.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:48.282+0000 7fbd43e00640 1 -- 172.21.15.37:0/575784857 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd44004b20 con 0x7fbd4c109140 2024-09-11T23:15:48.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:48.282+0000 7fbd43e00640 1 -- 172.21.15.37:0/575784857 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbd44004cc0 con 0x7fbd4c109140 2024-09-11T23:15:48.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:48.282+0000 7fbd43e00640 1 -- 172.21.15.37:0/575784857 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd44010760 con 0x7fbd4c109140 2024-09-11T23:15:48.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:48.282+0000 7fbd51600640 1 -- 172.21.15.37:0/575784857 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd4c19f8e0 con 0x7fbd4c109140 2024-09-11T23:15:48.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:48.282+0000 7fbd51600640 1 -- 172.21.15.37:0/575784857 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd4c1a71c0 con 0x7fbd4c109140 2024-09-11T23:15:48.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:48.283+0000 7fbd51600640 1 -- 172.21.15.37:0/575784857 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd4c1043f0 con 0x7fbd4c109140 2024-09-11T23:15:48.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:48.285+0000 7fbd43e00640 1 -- 172.21.15.37:0/575784857 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fbd44005020 con 0x7fbd4c109140 2024-09-11T23:15:48.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:48.286+0000 7fbd43e00640 1 --2- 172.21.15.37:0/575784857 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fbd300a2c00 0x7fbd300a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:48.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:48.286+0000 7fbd43e00640 1 -- 172.21.15.37:0/575784857 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7fbd440cf0d0 con 0x7fbd4c109140 2024-09-11T23:15:48.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:48.286+0000 7fbd4aa00640 1 --2- 172.21.15.37:0/575784857 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fbd300a2c00 0x7fbd300a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:48.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:48.287+0000 7fbd4aa00640 1 --2- 172.21.15.37:0/575784857 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fbd300a2c00 0x7fbd300a50c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fbd3c009230 tx=0x7fbd3c0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:48.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:48.291+0000 7fbd43e00640 1 -- 172.21.15.37:0/575784857 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbd4409c430 con 0x7fbd4c109140 2024-09-11T23:15:48.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:48.519+0000 7fbd51600640 1 -- 172.21.15.37:0/575784857 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbd4c02d7c0 con 0x7fbd4c109140 2024-09-11T23:15:48.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:48.519+0000 7fbd43e00640 1 -- 172.21.15.37:0/575784857 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6397 (secure 0 0 0) 0x7fbd4409bd30 con 0x7fbd4c109140 2024-09-11T23:15:48.520 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:15:48.520 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":8,"btime":"2024-09-11T23:15:48:337932+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14448,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/285120996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":285120996},{"type":"v1","addr":"172.21.15.37:6835","nonce":285120996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14460,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/3095283029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":3095283029},{"type":"v1","addr":"172.21.15.37:6837","nonce":3095283029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24440,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/3380294842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":3380294842},{"type":"v1","addr":"172.21.15.123:6833","nonce":3380294842}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/1918127245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":1918127245},{"type":"v1","addr":"172.21.15.160:6833","nonce":1918127245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24476,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/3928690501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":3928690501},{"type":"v1","addr":"172.21.15.123:6835","nonce":3928690501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24493,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/2316897035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":2316897035},{"type":"v1","addr":"172.21.15.160:6835","nonce":2316897035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24499,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6837/2906597021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":2906597021},{"type":"v1","addr":"172.21.15.160:6837","nonce":2906597021}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-09-11T23:15:48.520 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 8 2024-09-11T23:15:48.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:48.522+0000 7fbd51600640 1 -- 172.21.15.37:0/575784857 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fbd300a2c00 msgr2=0x7fbd300a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:48.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:48.522+0000 7fbd51600640 1 --2- 172.21.15.37:0/575784857 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fbd300a2c00 0x7fbd300a50c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fbd3c009230 tx=0x7fbd3c0058d0 comp rx=0 tx=0).stop 2024-09-11T23:15:48.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:48.522+0000 7fbd51600640 1 -- 172.21.15.37:0/575784857 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd4c109140 msgr2=0x7fbd4c19ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:48.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:48.522+0000 7fbd51600640 1 --2- 172.21.15.37:0/575784857 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd4c109140 0x7fbd4c19ef10 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fbd4400eb10 tx=0x7fbd4400c2d0 comp rx=0 tx=0).stop 2024-09-11T23:15:48.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:48.522+0000 7fbd51600640 1 -- 172.21.15.37:0/575784857 shutdown_connections 2024-09-11T23:15:48.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:48.522+0000 7fbd51600640 1 --2- 172.21.15.37:0/575784857 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fbd300a2c00 0x7fbd300a50c0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:48.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:48.522+0000 7fbd51600640 1 --2- 172.21.15.37:0/575784857 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbd4c1049c0 0x7fbd4c19ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:48.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:48.522+0000 7fbd51600640 1 --2- 172.21.15.37:0/575784857 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd4c109140 0x7fbd4c19ef10 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:48.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:48.522+0000 7fbd51600640 1 --2- 172.21.15.37:0/575784857 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbd4c104010 0x7fbd4c19a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:48.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:48.522+0000 7fbd51600640 1 -- 172.21.15.37:0/575784857 >> 172.21.15.37:0/575784857 conn(0x7fbd4c0ffa50 msgr2=0x7fbd4c100dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:48.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:48.522+0000 7fbd51600640 1 -- 172.21.15.37:0/575784857 shutdown_connections 2024-09-11T23:15:48.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:48.522+0000 7fbd51600640 1 -- 172.21.15.37:0/575784857 wait complete. 2024-09-11T23:15:48.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:48 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:48.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:48 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:48.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:48 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:48.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:48 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:15:48.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:48 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:15:48.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:48 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:15:48.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:48 smithi037 ceph-mon[30630]: Deploying daemon mds.h on smithi123 2024-09-11T23:15:48.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:48 smithi037 ceph-mon[30630]: mds.? [v2:172.21.15.160:6836/2906597021,v1:172.21.15.160:6837/2906597021] up:boot 2024-09-11T23:15:48.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:48 smithi037 ceph-mon[30630]: fsmap 7 up:standby 2024-09-11T23:15:48.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:48 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-11T23:15:48.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:48 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/575784857' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:15:48.706 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:48 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:48.706 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:48 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:48.706 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:48 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:48.706 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:48 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:15:48.706 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:48 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:15:48.706 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:48 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:15:48.706 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:48 smithi123 ceph-mon[35438]: Deploying daemon mds.h on smithi123 2024-09-11T23:15:48.706 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:48 smithi123 ceph-mon[35438]: mds.? [v2:172.21.15.160:6836/2906597021,v1:172.21.15.160:6837/2906597021] up:boot 2024-09-11T23:15:48.706 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:48 smithi123 ceph-mon[35438]: fsmap 7 up:standby 2024-09-11T23:15:48.706 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:48 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-11T23:15:48.707 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:48 smithi123 ceph-mon[35438]: from='client.? 172.21.15.37:0/575784857' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:15:48.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:48 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:48.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:48 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:48.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:48 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:48.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:48 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:15:48.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:48 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:15:48.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:48 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:15:48.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:48 smithi160 ceph-mon[35055]: Deploying daemon mds.h on smithi123 2024-09-11T23:15:48.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:48 smithi160 ceph-mon[35055]: mds.? [v2:172.21.15.160:6836/2906597021,v1:172.21.15.160:6837/2906597021] up:boot 2024-09-11T23:15:48.935 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:48 smithi160 ceph-mon[35055]: fsmap 7 up:standby 2024-09-11T23:15:48.935 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:48 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-11T23:15:48.935 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:48 smithi160 ceph-mon[35055]: from='client.? 172.21.15.37:0/575784857' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:15:49.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:49 smithi123 ceph-mon[35438]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:15:49.751 INFO:journalctl@ceph.mds.h.smithi123.stdout:Sep 11 23:15:49 smithi123 systemd[1]: Starting Ceph mds.h for 8b03efce-7092-11ef-bcea-c7b262605968... 2024-09-11T23:15:49.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:49 smithi160 ceph-mon[35055]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:15:50.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:49 smithi037 ceph-mon[30630]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:15:50.086 INFO:journalctl@ceph.mds.h.smithi123.stdout:Sep 11 23:15:49 smithi123 podman[65264]: 2024-09-11 23:15:49.728544421 +0000 UTC m=+0.015835614 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T23:15:50.087 INFO:journalctl@ceph.mds.h.smithi123.stdout:Sep 11 23:15:49 smithi123 podman[65264]: 2024-09-11 23:15:49.851386351 +0000 UTC m=+0.138677535 container create 256404eb79bd94413c5dcb8db077e70a0074ae358a760380875aaf1219b58eef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-h, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T23:15:50.087 INFO:journalctl@ceph.mds.h.smithi123.stdout:Sep 11 23:15:50 smithi123 podman[65264]: 2024-09-11 23:15:50.087305365 +0000 UTC m=+0.374596555 container init 256404eb79bd94413c5dcb8db077e70a0074ae358a760380875aaf1219b58eef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-h, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3) 2024-09-11T23:15:50.501 INFO:journalctl@ceph.mds.h.smithi123.stdout:Sep 11 23:15:50 smithi123 podman[65264]: 2024-09-11 23:15:50.090180302 +0000 UTC m=+0.377471489 container start 256404eb79bd94413c5dcb8db077e70a0074ae358a760380875aaf1219b58eef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-h, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T23:15:50.501 INFO:journalctl@ceph.mds.h.smithi123.stdout:Sep 11 23:15:50 smithi123 ceph-mds[65283]: -- 172.21.15.123:0/1398106790 <== mon.2 v2:172.21.15.123:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ab97517860 con 0x55ab974f5400 2024-09-11T23:15:50.501 INFO:journalctl@ceph.mds.h.smithi123.stdout:Sep 11 23:15:50 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-h[65279]: starting mds.h at 2024-09-11T23:15:50.501 INFO:journalctl@ceph.mds.h.smithi123.stdout:Sep 11 23:15:50 smithi123 bash[65264]: 256404eb79bd94413c5dcb8db077e70a0074ae358a760380875aaf1219b58eef 2024-09-11T23:15:50.501 INFO:journalctl@ceph.mds.h.smithi123.stdout:Sep 11 23:15:50 smithi123 systemd[1]: Started Ceph mds.h for 8b03efce-7092-11ef-bcea-c7b262605968. 2024-09-11T23:15:51.301 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T23:15:51.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:51 smithi160 ceph-mon[35055]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:15:51.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:51 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:51.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:51 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:51.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:51 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:51.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:51 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:15:51.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:51 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:15:51.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:51 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:15:51.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:51 smithi160 ceph-mon[35055]: Deploying daemon mds.i on smithi160 2024-09-11T23:15:51.435 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:51 smithi160 ceph-mon[35055]: mds.? [v2:172.21.15.123:6836/2168535476,v1:172.21.15.123:6837/2168535476] up:boot 2024-09-11T23:15:51.435 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:51 smithi160 ceph-mon[35055]: fsmap 8 up:standby 2024-09-11T23:15:51.435 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:51 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-11T23:15:51.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:51 smithi123 ceph-mon[35438]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:15:51.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:51 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:51.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:51 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:51.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:51 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:51.502 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:51 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:15:51.502 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:51 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:15:51.502 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:51 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:15:51.502 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:51 smithi123 ceph-mon[35438]: Deploying daemon mds.i on smithi160 2024-09-11T23:15:51.502 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:51 smithi123 ceph-mon[35438]: mds.? [v2:172.21.15.123:6836/2168535476,v1:172.21.15.123:6837/2168535476] up:boot 2024-09-11T23:15:51.502 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:51 smithi123 ceph-mon[35438]: fsmap 8 up:standby 2024-09-11T23:15:51.502 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:51 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-11T23:15:51.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:51 smithi037 ceph-mon[30630]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:15:51.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:51 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:51.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:51 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:51.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:51 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:51.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:51 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:15:51.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:51 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:15:51.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:51 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:15:51.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:51 smithi037 ceph-mon[30630]: Deploying daemon mds.i on smithi160 2024-09-11T23:15:51.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:51 smithi037 ceph-mon[30630]: mds.? [v2:172.21.15.123:6836/2168535476,v1:172.21.15.123:6837/2168535476] up:boot 2024-09-11T23:15:51.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:51 smithi037 ceph-mon[30630]: fsmap 8 up:standby 2024-09-11T23:15:51.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:51 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-11T23:15:51.691 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:15:52.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:52.245+0000 7f1e3f200640 1 -- 172.21.15.37:0/3248200044 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e400745c0 msgr2=0x7f1e400749a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:52.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:52.245+0000 7f1e3f200640 1 --2- 172.21.15.37:0/3248200044 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e400745c0 0x7f1e400749a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f1e30009900 tx=0x7f1e3002a480 comp rx=0 tx=0).stop 2024-09-11T23:15:52.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:52.245+0000 7f1e3f200640 1 -- 172.21.15.37:0/3248200044 shutdown_connections 2024-09-11T23:15:52.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:52.245+0000 7f1e3f200640 1 --2- 172.21.15.37:0/3248200044 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1e4010e260 0x7f1e40110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:52.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:52.245+0000 7f1e3f200640 1 --2- 172.21.15.37:0/3248200044 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1e40074ee0 0x7f1e4010dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:52.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:52.245+0000 7f1e3f200640 1 --2- 172.21.15.37:0/3248200044 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e400745c0 0x7f1e400749a0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:52.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:52.245+0000 7f1e3f200640 1 -- 172.21.15.37:0/3248200044 >> 172.21.15.37:0/3248200044 conn(0x7f1e400fd740 msgr2=0x7f1e400ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:52.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:52.245+0000 7f1e3f200640 1 -- 172.21.15.37:0/3248200044 shutdown_connections 2024-09-11T23:15:52.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:52.245+0000 7f1e3f200640 1 -- 172.21.15.37:0/3248200044 wait complete. 2024-09-11T23:15:52.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:52.246+0000 7f1e3f200640 1 Processor -- start 2024-09-11T23:15:52.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:52.246+0000 7f1e3f200640 1 -- start start 2024-09-11T23:15:52.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:52.246+0000 7f1e3f200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e400745c0 0x7f1e4019a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:52.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:52.246+0000 7f1e3f200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1e40074ee0 0x7f1e4019a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:52.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:52.246+0000 7f1e3f200640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1e4010e260 0x7f1e4019ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:52.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:52.246+0000 7f1e3f200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1e40113fb0 con 0x7f1e400745c0 2024-09-11T23:15:52.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:52.246+0000 7f1e3f200640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f1e40113e30 con 0x7f1e40074ee0 2024-09-11T23:15:52.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:52.246+0000 7f1e3f200640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f1e40114130 con 0x7f1e4010e260 2024-09-11T23:15:52.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:52.247+0000 7f1e3de00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e400745c0 0x7f1e4019a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:52.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:52.247+0000 7f1e3e800640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1e4010e260 0x7f1e4019ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:52.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:52.247+0000 7f1e3e800640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1e4010e260 0x7f1e4019ed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.37:35474/0 (socket says 172.21.15.37:35474) 2024-09-11T23:15:52.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:52.247+0000 7f1e3e800640 1 -- 172.21.15.37:0/525033744 learned_addr learned my addr 172.21.15.37:0/525033744 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:15:52.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:52.247+0000 7f1e3d400640 1 --2- 172.21.15.37:0/525033744 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1e40074ee0 0x7f1e4019a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:52.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:52.247+0000 7f1e3e800640 1 -- 172.21.15.37:0/525033744 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1e40074ee0 msgr2=0x7f1e4019a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:52.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:52.247+0000 7f1e3e800640 1 --2- 172.21.15.37:0/525033744 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1e40074ee0 0x7f1e4019a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:52.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:52.247+0000 7f1e3e800640 1 -- 172.21.15.37:0/525033744 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e400745c0 msgr2=0x7f1e4019a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:52.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:52.247+0000 7f1e3e800640 1 --2- 172.21.15.37:0/525033744 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e400745c0 0x7f1e4019a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:52.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:52.247+0000 7f1e3e800640 1 -- 172.21.15.37:0/525033744 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e4019f450 con 0x7f1e4010e260 2024-09-11T23:15:52.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:52.248+0000 7f1e3e800640 1 --2- 172.21.15.37:0/525033744 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1e4010e260 0x7f1e4019ed70 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1e3800e9d0 tx=0x7f1e3800ee90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:52.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:52.250+0000 7f1e36a00640 1 -- 172.21.15.37:0/525033744 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e3800cd80 con 0x7f1e4010e260 2024-09-11T23:15:52.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:52.250+0000 7f1e36a00640 1 -- 172.21.15.37:0/525033744 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e38005020 con 0x7f1e4010e260 2024-09-11T23:15:52.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:52.250+0000 7f1e3f200640 1 -- 172.21.15.37:0/525033744 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e4019f740 con 0x7f1e4010e260 2024-09-11T23:15:52.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:52.250+0000 7f1e36a00640 1 -- 172.21.15.37:0/525033744 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e380116d0 con 0x7f1e4010e260 2024-09-11T23:15:52.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:52.250+0000 7f1e3f200640 1 -- 172.21.15.37:0/525033744 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e401a7020 con 0x7f1e4010e260 2024-09-11T23:15:52.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:52.251+0000 7f1e3f200640 1 -- 172.21.15.37:0/525033744 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e400749a0 con 0x7f1e4010e260 2024-09-11T23:15:52.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:52.252+0000 7f1e36a00640 1 -- 172.21.15.37:0/525033744 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f1e380051d0 con 0x7f1e4010e260 2024-09-11T23:15:52.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:52.254+0000 7f1e36a00640 1 --2- 172.21.15.37:0/525033744 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f1e240a2c00 0x7f1e240a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:52.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:52.254+0000 7f1e36a00640 1 -- 172.21.15.37:0/525033744 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f1e380cf060 con 0x7f1e4010e260 2024-09-11T23:15:52.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:52.254+0000 7f1e3de00640 1 --2- 172.21.15.37:0/525033744 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f1e240a2c00 0x7f1e240a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:52.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:52.255+0000 7f1e3de00640 1 --2- 172.21.15.37:0/525033744 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f1e240a2c00 0x7f1e240a50c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1e30009230 tx=0x7f1e300058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:52.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:52.258+0000 7f1e36a00640 1 -- 172.21.15.37:0/525033744 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1e38016030 con 0x7f1e4010e260 2024-09-11T23:15:52.434 INFO:journalctl@ceph.mds.i.smithi160.stdout:Sep 11 23:15:52 smithi160 systemd[1]: Starting Ceph mds.i for 8b03efce-7092-11ef-bcea-c7b262605968... 2024-09-11T23:15:52.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:52.476+0000 7f1e3f200640 1 -- 172.21.15.37:0/525033744 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1e40109440 con 0x7f1e4010e260 2024-09-11T23:15:52.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:52.477+0000 7f1e36a00640 1 -- 172.21.15.37:0/525033744 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7225 (secure 0 0 0) 0x7f1e3809bd70 con 0x7f1e4010e260 2024-09-11T23:15:52.478 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:15:52.478 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":9,"btime":"2024-09-11T23:15:50:567586+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14448,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/285120996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":285120996},{"type":"v1","addr":"172.21.15.37:6835","nonce":285120996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14460,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/3095283029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":3095283029},{"type":"v1","addr":"172.21.15.37:6837","nonce":3095283029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24440,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/3380294842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":3380294842},{"type":"v1","addr":"172.21.15.123:6833","nonce":3380294842}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/1918127245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":1918127245},{"type":"v1","addr":"172.21.15.160:6833","nonce":1918127245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24476,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/3928690501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":3928690501},{"type":"v1","addr":"172.21.15.123:6835","nonce":3928690501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24493,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/2316897035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":2316897035},{"type":"v1","addr":"172.21.15.160:6835","nonce":2316897035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24497,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/2168535476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":2168535476},{"type":"v1","addr":"172.21.15.123:6837","nonce":2168535476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24499,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6837/2906597021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":2906597021},{"type":"v1","addr":"172.21.15.160:6837","nonce":2906597021}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-09-11T23:15:52.478 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 9 2024-09-11T23:15:52.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:52.480+0000 7f1e3f200640 1 -- 172.21.15.37:0/525033744 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f1e240a2c00 msgr2=0x7f1e240a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:52.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:52.480+0000 7f1e3f200640 1 --2- 172.21.15.37:0/525033744 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f1e240a2c00 0x7f1e240a50c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1e30009230 tx=0x7f1e300058d0 comp rx=0 tx=0).stop 2024-09-11T23:15:52.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:52.480+0000 7f1e3f200640 1 -- 172.21.15.37:0/525033744 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1e4010e260 msgr2=0x7f1e4019ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:52.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:52.480+0000 7f1e3f200640 1 --2- 172.21.15.37:0/525033744 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1e4010e260 0x7f1e4019ed70 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1e3800e9d0 tx=0x7f1e3800ee90 comp rx=0 tx=0).stop 2024-09-11T23:15:52.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:52.480+0000 7f1e3f200640 1 -- 172.21.15.37:0/525033744 shutdown_connections 2024-09-11T23:15:52.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:52.480+0000 7f1e3f200640 1 --2- 172.21.15.37:0/525033744 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f1e240a2c00 0x7f1e240a50c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:52.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:52.480+0000 7f1e3f200640 1 --2- 172.21.15.37:0/525033744 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1e40074ee0 0x7f1e4019a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:52.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:52.480+0000 7f1e3f200640 1 --2- 172.21.15.37:0/525033744 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1e4010e260 0x7f1e4019ed70 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:52.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:52.480+0000 7f1e3f200640 1 --2- 172.21.15.37:0/525033744 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e400745c0 0x7f1e4019a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:52.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:52.480+0000 7f1e3f200640 1 -- 172.21.15.37:0/525033744 >> 172.21.15.37:0/525033744 conn(0x7f1e400fd740 msgr2=0x7f1e400fef40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:52.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:52.480+0000 7f1e3f200640 1 -- 172.21.15.37:0/525033744 shutdown_connections 2024-09-11T23:15:52.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:52.480+0000 7f1e3f200640 1 -- 172.21.15.37:0/525033744 wait complete. 2024-09-11T23:15:52.776 INFO:journalctl@ceph.mds.i.smithi160.stdout:Sep 11 23:15:52 smithi160 podman[65134]: 2024-09-11 23:15:52.402110049 +0000 UTC m=+0.015646932 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T23:15:52.777 INFO:journalctl@ceph.mds.i.smithi160.stdout:Sep 11 23:15:52 smithi160 podman[65134]: 2024-09-11 23:15:52.524288208 +0000 UTC m=+0.137825124 container create cf017f203c3f19eb21842b04ff4ee19698cd460587ce69869b767eae2389d6bd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-i, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-11T23:15:52.777 INFO:journalctl@ceph.mds.i.smithi160.stdout:Sep 11 23:15:52 smithi160 podman[65134]: 2024-09-11 23:15:52.777118982 +0000 UTC m=+0.390655865 container init cf017f203c3f19eb21842b04ff4ee19698cd460587ce69869b767eae2389d6bd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-i, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3) 2024-09-11T23:15:53.184 INFO:journalctl@ceph.mds.i.smithi160.stdout:Sep 11 23:15:52 smithi160 podman[65134]: 2024-09-11 23:15:52.780074697 +0000 UTC m=+0.393611568 container start cf017f203c3f19eb21842b04ff4ee19698cd460587ce69869b767eae2389d6bd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-i, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T23:15:53.184 INFO:journalctl@ceph.mds.i.smithi160.stdout:Sep 11 23:15:52 smithi160 ceph-mds[65153]: -- 172.21.15.160:0/2894336383 <== mon.1 v2:172.21.15.160:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56340ee57860 con 0x56340ee35400 2024-09-11T23:15:53.184 INFO:journalctl@ceph.mds.i.smithi160.stdout:Sep 11 23:15:52 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-i[65149]: starting mds.i at 2024-09-11T23:15:53.184 INFO:journalctl@ceph.mds.i.smithi160.stdout:Sep 11 23:15:52 smithi160 bash[65134]: cf017f203c3f19eb21842b04ff4ee19698cd460587ce69869b767eae2389d6bd 2024-09-11T23:15:53.184 INFO:journalctl@ceph.mds.i.smithi160.stdout:Sep 11 23:15:52 smithi160 systemd[1]: Started Ceph mds.i for 8b03efce-7092-11ef-bcea-c7b262605968. 2024-09-11T23:15:53.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:53 smithi037 ceph-mon[30630]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:15:53.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:53 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/525033744' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:15:53.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:53 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:53.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:53 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:53.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:53 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:53.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:53 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:15:53.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:53 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:15:53.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:53 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:15:53.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:53 smithi037 ceph-mon[30630]: Deploying daemon mds.g on smithi037 2024-09-11T23:15:53.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:53 smithi160 ceph-mon[35055]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:15:53.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:53 smithi160 ceph-mon[35055]: from='client.? 172.21.15.37:0/525033744' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:15:53.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:53 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:53.685 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:53 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:53.685 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:53 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:53.685 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:53 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:15:53.685 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:53 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:15:53.685 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:53 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:15:53.685 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:53 smithi160 ceph-mon[35055]: Deploying daemon mds.g on smithi037 2024-09-11T23:15:53.755 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:53 smithi123 ceph-mon[35438]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:15:53.755 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:53 smithi123 ceph-mon[35438]: from='client.? 172.21.15.37:0/525033744' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:15:53.755 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:53 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:53.756 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:53 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:53.756 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:53 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:53.756 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:53 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:15:53.756 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:53 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:15:53.756 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:53 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:15:53.756 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:53 smithi123 ceph-mon[35438]: Deploying daemon mds.g on smithi037 2024-09-11T23:15:54.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:54 smithi037 ceph-mon[30630]: mds.? [v2:172.21.15.160:6838/2041625862,v1:172.21.15.160:6839/2041625862] up:boot 2024-09-11T23:15:54.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:54 smithi037 ceph-mon[30630]: fsmap 9 up:standby 2024-09-11T23:15:54.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:54 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-11T23:15:54.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:54 smithi160 ceph-mon[35055]: mds.? [v2:172.21.15.160:6838/2041625862,v1:172.21.15.160:6839/2041625862] up:boot 2024-09-11T23:15:54.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:54 smithi160 ceph-mon[35055]: fsmap 9 up:standby 2024-09-11T23:15:54.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:54 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-11T23:15:54.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:54 smithi123 ceph-mon[35438]: mds.? [v2:172.21.15.160:6838/2041625862,v1:172.21.15.160:6839/2041625862] up:boot 2024-09-11T23:15:54.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:54 smithi123 ceph-mon[35438]: fsmap 9 up:standby 2024-09-11T23:15:54.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:54 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-11T23:15:55.330 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T23:15:55.358 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:55 smithi037 ceph-mon[30630]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:15:55.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:55 smithi160 ceph-mon[35055]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:15:55.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:55 smithi123 ceph-mon[35438]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:15:56.001 INFO:journalctl@ceph.mds.g.smithi037.stdout:Sep 11 23:15:55 smithi037 podman[71154]: 2024-09-11 23:15:55.714974053 +0000 UTC m=+0.151020438 container create 22f2d21f19d98096c9ae3454bcc07db987367b86ad84277e5fb3fba4c88e2ebf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-g, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD) 2024-09-11T23:15:56.001 INFO:journalctl@ceph.mds.g.smithi037.stdout:Sep 11 23:15:56 smithi037 podman[71154]: 2024-09-11 23:15:56.001501769 +0000 UTC m=+0.437548155 container init 22f2d21f19d98096c9ae3454bcc07db987367b86ad84277e5fb3fba4c88e2ebf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-g, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True) 2024-09-11T23:15:56.267 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:15:56.315 INFO:journalctl@ceph.mds.g.smithi037.stdout:Sep 11 23:15:56 smithi037 podman[71154]: 2024-09-11 23:15:56.008310492 +0000 UTC m=+0.444356878 container start 22f2d21f19d98096c9ae3454bcc07db987367b86ad84277e5fb3fba4c88e2ebf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-g, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T23:15:56.315 INFO:journalctl@ceph.mds.g.smithi037.stdout:Sep 11 23:15:56 smithi037 ceph-mds[71196]: -- 172.21.15.37:0/3026018384 <== mon.0 v2:172.21.15.37:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563ae1087860 con 0x563ae1064800 2024-09-11T23:15:56.315 INFO:journalctl@ceph.mds.g.smithi037.stdout:Sep 11 23:15:56 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-g[71187]: starting mds.g at 2024-09-11T23:15:56.315 INFO:journalctl@ceph.mds.g.smithi037.stdout:Sep 11 23:15:56 smithi037 bash[71154]: 22f2d21f19d98096c9ae3454bcc07db987367b86ad84277e5fb3fba4c88e2ebf 2024-09-11T23:15:56.315 INFO:journalctl@ceph.mds.g.smithi037.stdout:Sep 11 23:15:56 smithi037 systemd[1]: Started Ceph mds.g for 8b03efce-7092-11ef-bcea-c7b262605968. 2024-09-11T23:15:56.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:56.852+0000 7f34f5600640 1 -- 172.21.15.37:0/3861769350 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34f010e3c0 msgr2=0x7f34f0110810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:56.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:56.852+0000 7f34f5600640 1 --2- 172.21.15.37:0/3861769350 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34f010e3c0 0x7f34f0110810 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f34e8009ca0 tx=0x7f34e802a950 comp rx=0 tx=0).stop 2024-09-11T23:15:56.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:56.853+0000 7f34f5600640 1 -- 172.21.15.37:0/3861769350 shutdown_connections 2024-09-11T23:15:56.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:56.853+0000 7f34f5600640 1 --2- 172.21.15.37:0/3861769350 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34f010e3c0 0x7f34f0110810 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:56.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:56.853+0000 7f34f5600640 1 --2- 172.21.15.37:0/3861769350 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f34f0074f40 0x7f34f010de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:56.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:56.853+0000 7f34f5600640 1 --2- 172.21.15.37:0/3861769350 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34f0074620 0x7f34f0074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:56.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:56.853+0000 7f34f5600640 1 -- 172.21.15.37:0/3861769350 >> 172.21.15.37:0/3861769350 conn(0x7f34f00fd8c0 msgr2=0x7f34f00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:56.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:56.853+0000 7f34f5600640 1 -- 172.21.15.37:0/3861769350 shutdown_connections 2024-09-11T23:15:56.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:56.853+0000 7f34f5600640 1 -- 172.21.15.37:0/3861769350 wait complete. 2024-09-11T23:15:56.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:56.854+0000 7f34f5600640 1 Processor -- start 2024-09-11T23:15:56.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:56.854+0000 7f34f5600640 1 -- start start 2024-09-11T23:15:56.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:56.854+0000 7f34f5600640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34f0074620 0x7f34f019a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:56.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:56.854+0000 7f34f5600640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f34f0074f40 0x7f34f019abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:56.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:56.854+0000 7f34f5600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34f010e3c0 0x7f34f019ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:56.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:56.854+0000 7f34f5600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f34f0114150 con 0x7f34f010e3c0 2024-09-11T23:15:56.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:56.854+0000 7f34f5600640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f34f0113fd0 con 0x7f34f0074620 2024-09-11T23:15:56.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:56.854+0000 7f34f5600640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f34f01142d0 con 0x7f34f0074f40 2024-09-11T23:15:56.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:56.854+0000 7f34ef400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34f010e3c0 0x7f34f019ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:56.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:56.854+0000 7f34e7e00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f34f0074f40 0x7f34f019abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:56.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:56.854+0000 7f34e7e00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f34f0074f40 0x7f34f019abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.37:35502/0 (socket says 172.21.15.37:35502) 2024-09-11T23:15:56.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:56.854+0000 7f34e7e00640 1 -- 172.21.15.37:0/3613867257 learned_addr learned my addr 172.21.15.37:0/3613867257 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:15:56.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:56.854+0000 7f34eea00640 1 --2- 172.21.15.37:0/3613867257 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34f0074620 0x7f34f019a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:56.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:56.855+0000 7f34eea00640 1 -- 172.21.15.37:0/3613867257 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f34f0074f40 msgr2=0x7f34f019abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:56.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:56.855+0000 7f34eea00640 1 --2- 172.21.15.37:0/3613867257 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f34f0074f40 0x7f34f019abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:56.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:56.855+0000 7f34eea00640 1 -- 172.21.15.37:0/3613867257 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34f010e3c0 msgr2=0x7f34f019ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:56.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:56.855+0000 7f34eea00640 1 --2- 172.21.15.37:0/3613867257 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34f010e3c0 0x7f34f019ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:56.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:56.855+0000 7f34eea00640 1 -- 172.21.15.37:0/3613867257 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34f019f640 con 0x7f34f0074620 2024-09-11T23:15:56.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:56.855+0000 7f34e7e00640 1 --2- 172.21.15.37:0/3613867257 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f34f0074f40 0x7f34f019abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:15:56.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:56.855+0000 7f34ef400640 1 --2- 172.21.15.37:0/3613867257 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34f010e3c0 0x7f34f019ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:15:56.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:56.855+0000 7f34eea00640 1 --2- 172.21.15.37:0/3613867257 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34f0074620 0x7f34f019a690 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f34e000d6d0 tx=0x7f34e000db90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:56.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:56.855+0000 7f34e7400640 1 -- 172.21.15.37:0/3613867257 <== mon.2 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34e0017070 con 0x7f34f0074620 2024-09-11T23:15:56.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:56.855+0000 7f34e7400640 1 -- 172.21.15.37:0/3613867257 <== mon.2 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f34e0009820 con 0x7f34f0074620 2024-09-11T23:15:56.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:56.855+0000 7f34e7400640 1 -- 172.21.15.37:0/3613867257 <== mon.2 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34e0004d00 con 0x7f34f0074620 2024-09-11T23:15:56.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:56.855+0000 7f34f5600640 1 -- 172.21.15.37:0/3613867257 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34f019f930 con 0x7f34f0074620 2024-09-11T23:15:56.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:56.856+0000 7f34f5600640 1 -- 172.21.15.37:0/3613867257 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34f01a7210 con 0x7f34f0074620 2024-09-11T23:15:56.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:56.857+0000 7f34f5600640 1 -- 172.21.15.37:0/3613867257 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34f0074a00 con 0x7f34f0074620 2024-09-11T23:15:56.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:56.859+0000 7f34e7400640 1 -- 172.21.15.37:0/3613867257 <== mon.2 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f34e00099d0 con 0x7f34f0074620 2024-09-11T23:15:56.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:56.860+0000 7f34e7400640 1 --2- 172.21.15.37:0/3613867257 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f34d40a2c00 0x7f34d40a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:15:56.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:56.860+0000 7f34e7400640 1 -- 172.21.15.37:0/3613867257 <== mon.2 v2:172.21.15.123:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f34e00ce680 con 0x7f34f0074620 2024-09-11T23:15:56.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:56.860+0000 7f34e7e00640 1 --2- 172.21.15.37:0/3613867257 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f34d40a2c00 0x7f34d40a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:15:56.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:56.861+0000 7f34e7e00640 1 --2- 172.21.15.37:0/3613867257 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f34d40a2c00 0x7f34d40a50c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f34f010f770 tx=0x7f34d800b480 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:15:56.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:56.862+0000 7f34e7400640 1 -- 172.21.15.37:0/3613867257 <== mon.2 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f34e009b410 con 0x7f34f0074620 2024-09-11T23:15:57.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:57.121+0000 7f34f5600640 1 -- 172.21.15.37:0/3613867257 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f34f019b9f0 con 0x7f34f0074620 2024-09-11T23:15:57.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:57.122+0000 7f34e7400640 1 -- 172.21.15.37:0/3613867257 <== mon.2 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8881 (secure 0 0 0) 0x7f34f019b9f0 con 0x7f34f0074620 2024-09-11T23:15:57.123 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:15:57.123 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":11,"btime":"2024-09-11T23:15:56:262169+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14448,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/285120996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":285120996},{"type":"v1","addr":"172.21.15.37:6835","nonce":285120996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14460,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/3095283029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":3095283029},{"type":"v1","addr":"172.21.15.37:6837","nonce":3095283029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/1072030582","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":1072030582},{"type":"v1","addr":"172.21.15.37:6839","nonce":1072030582}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24440,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/3380294842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":3380294842},{"type":"v1","addr":"172.21.15.123:6833","nonce":3380294842}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/1918127245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":1918127245},{"type":"v1","addr":"172.21.15.160:6833","nonce":1918127245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24476,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/3928690501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":3928690501},{"type":"v1","addr":"172.21.15.123:6835","nonce":3928690501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24493,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/2316897035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":2316897035},{"type":"v1","addr":"172.21.15.160:6835","nonce":2316897035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24497,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/2168535476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":2168535476},{"type":"v1","addr":"172.21.15.123:6837","nonce":2168535476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24499,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6837/2906597021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":2906597021},{"type":"v1","addr":"172.21.15.160:6837","nonce":2906597021}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24520,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6839/2041625862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":2041625862},{"type":"v1","addr":"172.21.15.160:6839","nonce":2041625862}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-11T23:15:57.123 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 11 2024-09-11T23:15:57.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:57.125+0000 7f34f5600640 1 -- 172.21.15.37:0/3613867257 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f34d40a2c00 msgr2=0x7f34d40a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:57.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:57.125+0000 7f34f5600640 1 --2- 172.21.15.37:0/3613867257 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f34d40a2c00 0x7f34d40a50c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f34f010f770 tx=0x7f34d800b480 comp rx=0 tx=0).stop 2024-09-11T23:15:57.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:57.125+0000 7f34f5600640 1 -- 172.21.15.37:0/3613867257 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34f0074620 msgr2=0x7f34f019a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:15:57.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:57.125+0000 7f34f5600640 1 --2- 172.21.15.37:0/3613867257 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34f0074620 0x7f34f019a690 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f34e000d6d0 tx=0x7f34e000db90 comp rx=0 tx=0).stop 2024-09-11T23:15:57.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:57.125+0000 7f34f5600640 1 -- 172.21.15.37:0/3613867257 shutdown_connections 2024-09-11T23:15:57.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:57.125+0000 7f34f5600640 1 --2- 172.21.15.37:0/3613867257 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f34d40a2c00 0x7f34d40a50c0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:57.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:57.125+0000 7f34f5600640 1 --2- 172.21.15.37:0/3613867257 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34f010e3c0 0x7f34f019ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:57.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:57.125+0000 7f34f5600640 1 --2- 172.21.15.37:0/3613867257 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f34f0074f40 0x7f34f019abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:57.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:57.125+0000 7f34f5600640 1 --2- 172.21.15.37:0/3613867257 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34f0074620 0x7f34f019a690 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:15:57.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:57.125+0000 7f34f5600640 1 -- 172.21.15.37:0/3613867257 >> 172.21.15.37:0/3613867257 conn(0x7f34f00fd8c0 msgr2=0x7f34f00fe560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:15:57.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:57.125+0000 7f34f5600640 1 -- 172.21.15.37:0/3613867257 shutdown_connections 2024-09-11T23:15:57.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:15:57.125+0000 7f34f5600640 1 -- 172.21.15.37:0/3613867257 wait complete. 2024-09-11T23:15:57.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:57 smithi123 ceph-mon[35438]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:15:57.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:57 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:57.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:57 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:57.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:57 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:57.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:57 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:15:57.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:57 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:15:57.502 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:57 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:15:57.502 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:57 smithi123 ceph-mon[35438]: Deploying daemon mds.a on smithi037 2024-09-11T23:15:57.502 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:57 smithi123 ceph-mon[35438]: mds.? [v2:172.21.15.37:6838/1072030582,v1:172.21.15.37:6839/1072030582] up:boot 2024-09-11T23:15:57.502 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:57 smithi123 ceph-mon[35438]: fsmap 10 up:standby 2024-09-11T23:15:57.502 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:57 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-11T23:15:57.502 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:57 smithi123 ceph-mon[35438]: from='client.? 172.21.15.37:0/3613867257' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:15:57.553 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:57 smithi037 ceph-mon[30630]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:15:57.553 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:57 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:57.553 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:57 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:57.553 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:57 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:57.553 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:57 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:15:57.553 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:57 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:15:57.553 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:57 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:15:57.553 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:57 smithi037 ceph-mon[30630]: Deploying daemon mds.a on smithi037 2024-09-11T23:15:57.553 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:57 smithi037 ceph-mon[30630]: mds.? [v2:172.21.15.37:6838/1072030582,v1:172.21.15.37:6839/1072030582] up:boot 2024-09-11T23:15:57.553 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:57 smithi037 ceph-mon[30630]: fsmap 10 up:standby 2024-09-11T23:15:57.553 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:57 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-11T23:15:57.554 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:57 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/3613867257' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:15:57.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:57 smithi160 ceph-mon[35055]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:15:57.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:57 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:57.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:57 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:57.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:57 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:15:57.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:57 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:15:57.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:57 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:15:57.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:57 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:15:57.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:57 smithi160 ceph-mon[35055]: Deploying daemon mds.a on smithi037 2024-09-11T23:15:57.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:57 smithi160 ceph-mon[35055]: mds.? [v2:172.21.15.37:6838/1072030582,v1:172.21.15.37:6839/1072030582] up:boot 2024-09-11T23:15:57.685 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:57 smithi160 ceph-mon[35055]: fsmap 10 up:standby 2024-09-11T23:15:57.685 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:57 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-11T23:15:57.685 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:57 smithi160 ceph-mon[35055]: from='client.? 172.21.15.37:0/3613867257' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:15:59.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:15:59 smithi037 ceph-mon[30630]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:15:59.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:15:59 smithi123 ceph-mon[35438]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:15:59.673 INFO:journalctl@ceph.mds.a.smithi037.stdout:Sep 11 23:15:59 smithi037 podman[71544]: 2024-09-11 23:15:59.421085245 +0000 UTC m=+0.142377915 container create 11b888c7cda125ec5d8b173195ea276ea8e6c3e2c9c80a984e7ca770c9ea084c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-a, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=) 2024-09-11T23:15:59.673 INFO:journalctl@ceph.mds.a.smithi037.stdout:Sep 11 23:15:59 smithi037 podman[71544]: 2024-09-11 23:15:59.673946495 +0000 UTC m=+0.395239166 container init 11b888c7cda125ec5d8b173195ea276ea8e6c3e2c9c80a984e7ca770c9ea084c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-a, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-11T23:15:59.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:15:59 smithi160 ceph-mon[35055]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:16:00.064 INFO:journalctl@ceph.mds.a.smithi037.stdout:Sep 11 23:15:59 smithi037 podman[71544]: 2024-09-11 23:15:59.680423633 +0000 UTC m=+0.401716303 container start 11b888c7cda125ec5d8b173195ea276ea8e6c3e2c9c80a984e7ca770c9ea084c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-a, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-11T23:16:00.065 INFO:journalctl@ceph.mds.a.smithi037.stdout:Sep 11 23:15:59 smithi037 ceph-mds[71563]: -- 172.21.15.37:0/1016820123 <== mon.0 v2:172.21.15.37:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x565094653c20 con 0x565094630800 2024-09-11T23:16:00.065 INFO:journalctl@ceph.mds.a.smithi037.stdout:Sep 11 23:15:59 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-a[71559]: starting mds.a at 2024-09-11T23:16:00.065 INFO:journalctl@ceph.mds.a.smithi037.stdout:Sep 11 23:15:59 smithi037 bash[71544]: 11b888c7cda125ec5d8b173195ea276ea8e6c3e2c9c80a984e7ca770c9ea084c 2024-09-11T23:16:00.065 INFO:journalctl@ceph.mds.a.smithi037.stdout:Sep 11 23:15:59 smithi037 systemd[1]: Started Ceph mds.a for 8b03efce-7092-11ef-bcea-c7b262605968. 2024-09-11T23:16:01.001 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T23:16:01.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:00 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:16:01.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:00 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:16:01.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:00 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:16:01.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:00 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:16:01.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:00 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:16:01.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:00 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:16:01.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:00 smithi160 ceph-mon[35055]: Deploying daemon mds.b on smithi123 2024-09-11T23:16:01.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:00 smithi160 ceph-mon[35055]: mds.? [v2:172.21.15.37:6840/209927476,v1:172.21.15.37:6841/209927476] up:boot 2024-09-11T23:16:01.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:00 smithi160 ceph-mon[35055]: fsmap 11 up:standby 2024-09-11T23:16:01.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:00 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-11T23:16:01.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:00 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:16:01.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:00 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:16:01.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:00 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:16:01.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:00 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:16:01.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:00 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:16:01.252 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:00 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:16:01.252 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:00 smithi123 ceph-mon[35438]: Deploying daemon mds.b on smithi123 2024-09-11T23:16:01.252 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:00 smithi123 ceph-mon[35438]: mds.? [v2:172.21.15.37:6840/209927476,v1:172.21.15.37:6841/209927476] up:boot 2024-09-11T23:16:01.252 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:00 smithi123 ceph-mon[35438]: fsmap 11 up:standby 2024-09-11T23:16:01.252 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:00 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-11T23:16:01.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:00 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:16:01.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:00 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:16:01.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:00 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:16:01.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:00 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:16:01.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:00 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:16:01.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:00 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:16:01.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:00 smithi037 ceph-mon[30630]: Deploying daemon mds.b on smithi123 2024-09-11T23:16:01.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:00 smithi037 ceph-mon[30630]: mds.? [v2:172.21.15.37:6840/209927476,v1:172.21.15.37:6841/209927476] up:boot 2024-09-11T23:16:01.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:00 smithi037 ceph-mon[30630]: fsmap 11 up:standby 2024-09-11T23:16:01.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:00 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-11T23:16:01.399 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:16:01.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:01.983+0000 7f183aa00640 1 -- 172.21.15.37:0/4132906672 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1834109140 msgr2=0x7f1834110cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:01.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:01.983+0000 7f183aa00640 1 --2- 172.21.15.37:0/4132906672 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1834109140 0x7f1834110cc0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f182c009ca0 tx=0x7f182c02a8c0 comp rx=0 tx=0).stop 2024-09-11T23:16:01.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:01.983+0000 7f183aa00640 1 -- 172.21.15.37:0/4132906672 shutdown_connections 2024-09-11T23:16:01.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:01.983+0000 7f183aa00640 1 --2- 172.21.15.37:0/4132906672 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1834109140 0x7f1834110cc0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:01.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:01.983+0000 7f183aa00640 1 --2- 172.21.15.37:0/4132906672 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f18341049c0 0x7f1834108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:01.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:01.983+0000 7f183aa00640 1 --2- 172.21.15.37:0/4132906672 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1834104010 0x7f18341043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:01.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:01.983+0000 7f183aa00640 1 -- 172.21.15.37:0/4132906672 >> 172.21.15.37:0/4132906672 conn(0x7f18340ffa50 msgr2=0x7f1834101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:01.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:01.983+0000 7f183aa00640 1 -- 172.21.15.37:0/4132906672 shutdown_connections 2024-09-11T23:16:01.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:01.983+0000 7f183aa00640 1 -- 172.21.15.37:0/4132906672 wait complete. 2024-09-11T23:16:01.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:01.984+0000 7f183aa00640 1 Processor -- start 2024-09-11T23:16:01.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:01.984+0000 7f183aa00640 1 -- start start 2024-09-11T23:16:01.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:01.985+0000 7f183aa00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1834104010 0x7f183419a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:01.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:01.985+0000 7f183aa00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f18341049c0 0x7f183419ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:01.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:01.985+0000 7f183aa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1834109140 0x7f183419ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:01.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:01.985+0000 7f183aa00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f18341141c0 con 0x7f1834109140 2024-09-11T23:16:01.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:01.985+0000 7f183aa00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f1834114040 con 0x7f18341049c0 2024-09-11T23:16:01.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:01.985+0000 7f183aa00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f1834114340 con 0x7f1834104010 2024-09-11T23:16:01.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:01.985+0000 7f1833e00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1834104010 0x7f183419a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:01.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:01.985+0000 7f1833e00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1834104010 0x7f183419a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.37:51972/0 (socket says 172.21.15.37:51972) 2024-09-11T23:16:01.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:01.985+0000 7f1833e00640 1 -- 172.21.15.37:0/3121839789 learned_addr learned my addr 172.21.15.37:0/3121839789 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:16:01.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:01.985+0000 7f182b400640 1 --2- 172.21.15.37:0/3121839789 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f18341049c0 0x7f183419ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:01.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:01.985+0000 7f1838a00640 1 --2- 172.21.15.37:0/3121839789 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1834109140 0x7f183419ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:01.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:01.986+0000 7f1833e00640 1 -- 172.21.15.37:0/3121839789 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f18341049c0 msgr2=0x7f183419ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:01.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:01.986+0000 7f1833e00640 1 --2- 172.21.15.37:0/3121839789 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f18341049c0 0x7f183419ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:01.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:01.986+0000 7f1833e00640 1 -- 172.21.15.37:0/3121839789 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1834109140 msgr2=0x7f183419ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:01.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:01.986+0000 7f1833e00640 1 --2- 172.21.15.37:0/3121839789 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1834109140 0x7f183419ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:01.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:01.986+0000 7f1833e00640 1 -- 172.21.15.37:0/3121839789 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f183419f670 con 0x7f1834104010 2024-09-11T23:16:01.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:01.986+0000 7f1838a00640 1 --2- 172.21.15.37:0/3121839789 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1834109140 0x7f183419ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:16:01.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:01.986+0000 7f1833e00640 1 --2- 172.21.15.37:0/3121839789 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1834104010 0x7f183419a6c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f182400e9f0 tx=0x7f182400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:01.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:01.986+0000 7f1831600640 1 -- 172.21.15.37:0/3121839789 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f182400cd80 con 0x7f1834104010 2024-09-11T23:16:01.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:01.986+0000 7f1831600640 1 -- 172.21.15.37:0/3121839789 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1824010910 con 0x7f1834104010 2024-09-11T23:16:01.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:01.986+0000 7f183aa00640 1 -- 172.21.15.37:0/3121839789 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f183419f960 con 0x7f1834104010 2024-09-11T23:16:01.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:01.986+0000 7f1831600640 1 -- 172.21.15.37:0/3121839789 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1824018990 con 0x7f1834104010 2024-09-11T23:16:01.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:01.986+0000 7f183aa00640 1 -- 172.21.15.37:0/3121839789 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18341a7240 con 0x7f1834104010 2024-09-11T23:16:01.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:01.987+0000 7f183aa00640 1 -- 172.21.15.37:0/3121839789 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18341043f0 con 0x7f1834104010 2024-09-11T23:16:01.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:01.989+0000 7f1831600640 1 -- 172.21.15.37:0/3121839789 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f1824010ac0 con 0x7f1834104010 2024-09-11T23:16:01.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:01.990+0000 7f1831600640 1 --2- 172.21.15.37:0/3121839789 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f18180a2b80 0x7f18180a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:01.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:01.991+0000 7f1831600640 1 -- 172.21.15.37:0/3121839789 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f18240cf000 con 0x7f1834104010 2024-09-11T23:16:01.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:01.991+0000 7f182b400640 1 --2- 172.21.15.37:0/3121839789 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f18180a2b80 0x7f18180a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:01.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:01.991+0000 7f182b400640 1 --2- 172.21.15.37:0/3121839789 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f18180a2b80 0x7f18180a5040 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f18340ffe70 tx=0x7f181c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:01.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:01.995+0000 7f1831600640 1 -- 172.21.15.37:0/3121839789 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f182409c360 con 0x7f1834104010 2024-09-11T23:16:02.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:01 smithi123 ceph-mon[35438]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:16:02.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:01 smithi160 ceph-mon[35055]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:16:02.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:02.215+0000 7f183aa00640 1 -- 172.21.15.37:0/3121839789 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f183419ba20 con 0x7f1834104010 2024-09-11T23:16:02.215 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:01 smithi037 ceph-mon[30630]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:16:02.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:02.216+0000 7f1831600640 1 -- 172.21.15.37:0/3121839789 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9704 (secure 0 0 0) 0x7f182409bc60 con 0x7f1834104010 2024-09-11T23:16:02.217 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:16:02.217 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":12,"btime":"2024-09-11T23:16:00:193346+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14448,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/285120996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":285120996},{"type":"v1","addr":"172.21.15.37:6835","nonce":285120996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14460,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/3095283029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":3095283029},{"type":"v1","addr":"172.21.15.37:6837","nonce":3095283029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/1072030582","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":1072030582},{"type":"v1","addr":"172.21.15.37:6839","nonce":1072030582}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6841/209927476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":209927476},{"type":"v1","addr":"172.21.15.37:6841","nonce":209927476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24440,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/3380294842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":3380294842},{"type":"v1","addr":"172.21.15.123:6833","nonce":3380294842}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/1918127245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":1918127245},{"type":"v1","addr":"172.21.15.160:6833","nonce":1918127245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24476,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/3928690501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":3928690501},{"type":"v1","addr":"172.21.15.123:6835","nonce":3928690501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24493,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/2316897035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":2316897035},{"type":"v1","addr":"172.21.15.160:6835","nonce":2316897035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24497,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/2168535476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":2168535476},{"type":"v1","addr":"172.21.15.123:6837","nonce":2168535476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24499,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6837/2906597021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":2906597021},{"type":"v1","addr":"172.21.15.160:6837","nonce":2906597021}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24520,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6839/2041625862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":2041625862},{"type":"v1","addr":"172.21.15.160:6839","nonce":2041625862}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-11T23:16:02.217 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 12 2024-09-11T23:16:02.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:02.219+0000 7f183aa00640 1 -- 172.21.15.37:0/3121839789 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f18180a2b80 msgr2=0x7f18180a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:02.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:02.219+0000 7f183aa00640 1 --2- 172.21.15.37:0/3121839789 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f18180a2b80 0x7f18180a5040 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f18340ffe70 tx=0x7f181c005f90 comp rx=0 tx=0).stop 2024-09-11T23:16:02.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:02.219+0000 7f183aa00640 1 -- 172.21.15.37:0/3121839789 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1834104010 msgr2=0x7f183419a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:02.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:02.219+0000 7f183aa00640 1 --2- 172.21.15.37:0/3121839789 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1834104010 0x7f183419a6c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f182400e9f0 tx=0x7f182400eeb0 comp rx=0 tx=0).stop 2024-09-11T23:16:02.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:02.219+0000 7f183aa00640 1 -- 172.21.15.37:0/3121839789 shutdown_connections 2024-09-11T23:16:02.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:02.219+0000 7f183aa00640 1 --2- 172.21.15.37:0/3121839789 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f18180a2b80 0x7f18180a5040 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:02.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:02.219+0000 7f183aa00640 1 --2- 172.21.15.37:0/3121839789 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f18341049c0 0x7f183419ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:02.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:02.219+0000 7f183aa00640 1 --2- 172.21.15.37:0/3121839789 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1834109140 0x7f183419ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:02.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:02.219+0000 7f183aa00640 1 --2- 172.21.15.37:0/3121839789 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1834104010 0x7f183419a6c0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:02.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:02.219+0000 7f183aa00640 1 -- 172.21.15.37:0/3121839789 >> 172.21.15.37:0/3121839789 conn(0x7f18340ffa50 msgr2=0x7f1834100d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:02.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:02.219+0000 7f183aa00640 1 -- 172.21.15.37:0/3121839789 shutdown_connections 2024-09-11T23:16:02.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:02.219+0000 7f183aa00640 1 -- 172.21.15.37:0/3121839789 wait complete. 2024-09-11T23:16:02.750 INFO:journalctl@ceph.mds.b.smithi123.stdout:Sep 11 23:16:02 smithi123 systemd[1]: Started Ceph mds.b for 8b03efce-7092-11ef-bcea-c7b262605968. 2024-09-11T23:16:03.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:02 smithi160 ceph-mon[35055]: from='client.? 172.21.15.37:0/3121839789' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:16:03.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:02 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:16:03.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:02 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:16:03.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:02 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:16:03.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:02 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:16:03.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:02 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:16:03.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:02 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:16:03.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:02 smithi123 ceph-mon[35438]: from='client.? 172.21.15.37:0/3121839789' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:16:03.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:02 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:16:03.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:02 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:16:03.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:02 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:16:03.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:02 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:16:03.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:02 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:16:03.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:02 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:16:03.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:02 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/3121839789' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:16:03.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:02 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:16:03.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:02 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:16:03.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:02 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:16:03.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:02 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:16:03.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:02 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:16:03.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:02 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:16:04.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:03 smithi123 ceph-mon[35438]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:16:04.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:03 smithi123 ceph-mon[35438]: mds.? [v2:172.21.15.123:6838/3077076065,v1:172.21.15.123:6839/3077076065] up:boot 2024-09-11T23:16:04.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:03 smithi123 ceph-mon[35438]: fsmap 12 up:standby 2024-09-11T23:16:04.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:03 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-11T23:16:04.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:03 smithi160 ceph-mon[35055]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:16:04.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:03 smithi160 ceph-mon[35055]: mds.? [v2:172.21.15.123:6838/3077076065,v1:172.21.15.123:6839/3077076065] up:boot 2024-09-11T23:16:04.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:03 smithi160 ceph-mon[35055]: fsmap 12 up:standby 2024-09-11T23:16:04.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:03 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-11T23:16:04.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:03 smithi037 ceph-mon[30630]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:16:04.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:03 smithi037 ceph-mon[30630]: mds.? [v2:172.21.15.123:6838/3077076065,v1:172.21.15.123:6839/3077076065] up:boot 2024-09-11T23:16:04.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:03 smithi037 ceph-mon[30630]: fsmap 12 up:standby 2024-09-11T23:16:04.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:03 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-11T23:16:04.997 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T23:16:05.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:05 smithi123 ceph-mon[35438]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:16:05.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:05 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:16:05.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:05 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:16:05.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:05 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:16:05.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:05 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:16:05.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:05 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:16:05.252 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:05 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:16:05.252 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:05 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:16:05.252 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:05 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:16:05.252 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:05 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:16:05.252 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:05 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:16:05.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:05 smithi037 ceph-mon[30630]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:16:05.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:05 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:16:05.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:05 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:16:05.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:05 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:16:05.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:05 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:16:05.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:05 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:16:05.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:05 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:16:05.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:05 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:16:05.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:05 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:16:05.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:05 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:16:05.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:05 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:16:05.400 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:16:05.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:05 smithi160 ceph-mon[35055]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:16:05.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:05 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:16:05.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:05 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:16:05.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:05 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:16:05.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:05 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:16:05.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:05 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:16:05.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:05 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:16:05.435 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:05 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:16:05.435 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:05 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:16:05.435 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:05 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:16:05.435 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:05 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:16:06.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:06.071+0000 7fb896600640 1 -- 172.21.15.37:0/3639169183 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb8901019c0 msgr2=0x7fb890101e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:06.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:06.071+0000 7fb896600640 1 --2- 172.21.15.37:0/3639169183 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb8901019c0 0x7fb890101e20 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb87c009930 tx=0x7fb87c02a420 comp rx=0 tx=0).stop 2024-09-11T23:16:06.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:06.071+0000 7fb896600640 1 -- 172.21.15.37:0/3639169183 shutdown_connections 2024-09-11T23:16:06.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:06.071+0000 7fb896600640 1 --2- 172.21.15.37:0/3639169183 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb890102360 0x7fb89010e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:06.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:06.071+0000 7fb896600640 1 --2- 172.21.15.37:0/3639169183 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb8901019c0 0x7fb890101e20 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:06.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:06.071+0000 7fb896600640 1 --2- 172.21.15.37:0/3639169183 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8901079c0 0x7fb890107da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:06.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:06.071+0000 7fb896600640 1 -- 172.21.15.37:0/3639169183 >> 172.21.15.37:0/3639169183 conn(0x7fb8900fd740 msgr2=0x7fb8900ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:06.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:06.071+0000 7fb896600640 1 -- 172.21.15.37:0/3639169183 shutdown_connections 2024-09-11T23:16:06.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:06.071+0000 7fb896600640 1 -- 172.21.15.37:0/3639169183 wait complete. 2024-09-11T23:16:06.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:06.072+0000 7fb896600640 1 Processor -- start 2024-09-11T23:16:06.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:06.072+0000 7fb896600640 1 -- start start 2024-09-11T23:16:06.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:06.073+0000 7fb896600640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb8901019c0 0x7fb8900744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:06.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:06.073+0000 7fb896600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb890102360 0x7fb890074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:06.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:06.073+0000 7fb896600640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb8901079c0 0x7fb890074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:06.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:06.073+0000 7fb896600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb890111e10 con 0x7fb890102360 2024-09-11T23:16:06.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:06.073+0000 7fb896600640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fb890111c90 con 0x7fb8901079c0 2024-09-11T23:16:06.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:06.073+0000 7fb896600640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fb890111f90 con 0x7fb8901019c0 2024-09-11T23:16:06.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:06.073+0000 7fb895200640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb8901019c0 0x7fb8900744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:06.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:06.073+0000 7fb895200640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb8901019c0 0x7fb8900744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.37:51998/0 (socket says 172.21.15.37:51998) 2024-09-11T23:16:06.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:06.073+0000 7fb895200640 1 -- 172.21.15.37:0/4233424606 learned_addr learned my addr 172.21.15.37:0/4233424606 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:16:06.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:06.073+0000 7fb895c00640 1 --2- 172.21.15.37:0/4233424606 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb8901079c0 0x7fb890074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:06.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:06.073+0000 7fb88fe00640 1 --2- 172.21.15.37:0/4233424606 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb890102360 0x7fb890074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:06.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:06.073+0000 7fb895200640 1 -- 172.21.15.37:0/4233424606 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb8901079c0 msgr2=0x7fb890074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:06.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:06.073+0000 7fb895200640 1 --2- 172.21.15.37:0/4233424606 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb8901079c0 0x7fb890074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:06.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:06.073+0000 7fb895200640 1 -- 172.21.15.37:0/4233424606 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb890102360 msgr2=0x7fb890074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:06.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:06.073+0000 7fb895200640 1 --2- 172.21.15.37:0/4233424606 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb890102360 0x7fb890074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:06.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:06.073+0000 7fb895200640 1 -- 172.21.15.37:0/4233424606 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8901a6770 con 0x7fb8901019c0 2024-09-11T23:16:06.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:06.073+0000 7fb88fe00640 1 --2- 172.21.15.37:0/4233424606 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb890102360 0x7fb890074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:16:06.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:06.074+0000 7fb895200640 1 --2- 172.21.15.37:0/4233424606 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb8901019c0 0x7fb8900744f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb88400ea60 tx=0x7fb88400ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:06.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:06.074+0000 7fb88d600640 1 -- 172.21.15.37:0/4233424606 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb88400cde0 con 0x7fb8901019c0 2024-09-11T23:16:06.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:06.074+0000 7fb88d600640 1 -- 172.21.15.37:0/4233424606 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb8840035f0 con 0x7fb8901019c0 2024-09-11T23:16:06.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:06.074+0000 7fb88d600640 1 -- 172.21.15.37:0/4233424606 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb884010670 con 0x7fb8901019c0 2024-09-11T23:16:06.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:06.074+0000 7fb896600640 1 -- 172.21.15.37:0/4233424606 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8901a6a60 con 0x7fb8901019c0 2024-09-11T23:16:06.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:06.074+0000 7fb896600640 1 -- 172.21.15.37:0/4233424606 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8901a6fc0 con 0x7fb8901019c0 2024-09-11T23:16:06.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:06.075+0000 7fb896600640 1 -- 172.21.15.37:0/4233424606 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb890101e20 con 0x7fb8901019c0 2024-09-11T23:16:06.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:06.077+0000 7fb88d600640 1 -- 172.21.15.37:0/4233424606 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fb8840037a0 con 0x7fb8901019c0 2024-09-11T23:16:06.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:06.078+0000 7fb88d600640 1 --2- 172.21.15.37:0/4233424606 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fb8780a2c00 0x7fb8780a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:06.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:06.079+0000 7fb88d600640 1 -- 172.21.15.37:0/4233424606 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7fb8840cef20 con 0x7fb8901019c0 2024-09-11T23:16:06.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:06.079+0000 7fb88fe00640 1 --2- 172.21.15.37:0/4233424606 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fb8780a2c00 0x7fb8780a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:06.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:06.079+0000 7fb88fe00640 1 --2- 172.21.15.37:0/4233424606 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fb8780a2c00 0x7fb8780a50c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb87c006010 tx=0x7fb87c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:06.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:06.082+0000 7fb88d600640 1 -- 172.21.15.37:0/4233424606 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb88409c280 con 0x7fb8901019c0 2024-09-11T23:16:06.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:06.309+0000 7fb896600640 1 -- 172.21.15.37:0/4233424606 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb8901099c0 con 0x7fb8901019c0 2024-09-11T23:16:06.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:06.310+0000 7fb88d600640 1 -- 172.21.15.37:0/4233424606 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10533 (secure 0 0 0) 0x7fb88409bb80 con 0x7fb8901019c0 2024-09-11T23:16:06.310 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:16:06.310 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":13,"btime":"2024-09-11T23:16:02:892136+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14448,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/285120996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":285120996},{"type":"v1","addr":"172.21.15.37:6835","nonce":285120996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14460,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/3095283029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":3095283029},{"type":"v1","addr":"172.21.15.37:6837","nonce":3095283029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/1072030582","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":1072030582},{"type":"v1","addr":"172.21.15.37:6839","nonce":1072030582}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6841/209927476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":209927476},{"type":"v1","addr":"172.21.15.37:6841","nonce":209927476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24440,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/3380294842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":3380294842},{"type":"v1","addr":"172.21.15.123:6833","nonce":3380294842}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/1918127245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":1918127245},{"type":"v1","addr":"172.21.15.160:6833","nonce":1918127245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24476,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/3928690501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":3928690501},{"type":"v1","addr":"172.21.15.123:6835","nonce":3928690501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24493,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/2316897035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":2316897035},{"type":"v1","addr":"172.21.15.160:6835","nonce":2316897035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24497,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/2168535476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":2168535476},{"type":"v1","addr":"172.21.15.123:6837","nonce":2168535476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24499,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6837/2906597021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":2906597021},{"type":"v1","addr":"172.21.15.160:6837","nonce":2906597021}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24520,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6839/2041625862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":2041625862},{"type":"v1","addr":"172.21.15.160:6839","nonce":2041625862}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24533,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6839/3077076065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6838","nonce":3077076065},{"type":"v1","addr":"172.21.15.123:6839","nonce":3077076065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-09-11T23:16:06.310 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 13 2024-09-11T23:16:06.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:06.313+0000 7fb896600640 1 -- 172.21.15.37:0/4233424606 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fb8780a2c00 msgr2=0x7fb8780a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:06.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:06.313+0000 7fb896600640 1 --2- 172.21.15.37:0/4233424606 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fb8780a2c00 0x7fb8780a50c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb87c006010 tx=0x7fb87c005a20 comp rx=0 tx=0).stop 2024-09-11T23:16:06.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:06.313+0000 7fb896600640 1 -- 172.21.15.37:0/4233424606 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb8901019c0 msgr2=0x7fb8900744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:06.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:06.313+0000 7fb896600640 1 --2- 172.21.15.37:0/4233424606 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb8901019c0 0x7fb8900744f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb88400ea60 tx=0x7fb88400ef20 comp rx=0 tx=0).stop 2024-09-11T23:16:06.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:06.313+0000 7fb896600640 1 -- 172.21.15.37:0/4233424606 shutdown_connections 2024-09-11T23:16:06.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:06.313+0000 7fb896600640 1 --2- 172.21.15.37:0/4233424606 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fb8780a2c00 0x7fb8780a50c0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:06.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:06.313+0000 7fb896600640 1 --2- 172.21.15.37:0/4233424606 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb8901079c0 0x7fb890074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:06.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:06.313+0000 7fb896600640 1 --2- 172.21.15.37:0/4233424606 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb890102360 0x7fb890074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:06.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:06.313+0000 7fb896600640 1 --2- 172.21.15.37:0/4233424606 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb8901019c0 0x7fb8900744f0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:06.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:06.313+0000 7fb896600640 1 -- 172.21.15.37:0/4233424606 >> 172.21.15.37:0/4233424606 conn(0x7fb8900fd740 msgr2=0x7fb8900fdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:06.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:06.313+0000 7fb896600640 1 -- 172.21.15.37:0/4233424606 shutdown_connections 2024-09-11T23:16:06.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:06.313+0000 7fb896600640 1 -- 172.21.15.37:0/4233424606 wait complete. 2024-09-11T23:16:07.502 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-09-11T23:16:07.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:07 smithi037 ceph-mon[30630]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:16:07.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:07 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:16:07.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:07 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/4233424606' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:16:07.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:07 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:16:07.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:07 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:16:07.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:07 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:16:07.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:07 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:16:07.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:07 smithi160 ceph-mon[35055]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:16:07.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:07 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:16:07.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:07 smithi160 ceph-mon[35055]: from='client.? 172.21.15.37:0/4233424606' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:16:07.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:07 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:16:07.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:07 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:16:07.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:07 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:16:07.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:07 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:16:07.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:07 smithi123 ceph-mon[35438]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:16:07.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:07 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:16:07.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:07 smithi123 ceph-mon[35438]: from='client.? 172.21.15.37:0/4233424606' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:16:07.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:07 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:16:07.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:07 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:16:07.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:07 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:16:07.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:07 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:16:07.904 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:16:08.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:08.491+0000 7f5d0f200640 1 -- 172.21.15.37:0/1799960928 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5d081049c0 msgr2=0x7f5d08108a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:08.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:08.491+0000 7f5d0f200640 1 --2- 172.21.15.37:0/1799960928 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5d081049c0 0x7f5d08108a10 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5cf0009900 tx=0x7f5cf002a410 comp rx=0 tx=0).stop 2024-09-11T23:16:08.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:08.491+0000 7f5d0f200640 1 -- 172.21.15.37:0/1799960928 shutdown_connections 2024-09-11T23:16:08.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:08.491+0000 7f5d0f200640 1 --2- 172.21.15.37:0/1799960928 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5d08109140 0x7f5d08110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:08.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:08.491+0000 7f5d0f200640 1 --2- 172.21.15.37:0/1799960928 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5d081049c0 0x7f5d08108a10 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:08.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:08.491+0000 7f5d0f200640 1 --2- 172.21.15.37:0/1799960928 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5d08104010 0x7f5d081043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:08.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:08.491+0000 7f5d0f200640 1 -- 172.21.15.37:0/1799960928 >> 172.21.15.37:0/1799960928 conn(0x7f5d080ffa50 msgr2=0x7f5d08101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:08.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:08.491+0000 7f5d0f200640 1 -- 172.21.15.37:0/1799960928 shutdown_connections 2024-09-11T23:16:08.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:08.491+0000 7f5d0f200640 1 -- 172.21.15.37:0/1799960928 wait complete. 2024-09-11T23:16:08.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:08.492+0000 7f5d0f200640 1 Processor -- start 2024-09-11T23:16:08.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:08.492+0000 7f5d0f200640 1 -- start start 2024-09-11T23:16:08.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:08.492+0000 7f5d0f200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5d08104010 0x7f5d0819a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:08.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:08.492+0000 7f5d0f200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5d081049c0 0x7f5d0819ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:08.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:08.492+0000 7f5d0f200640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5d08109140 0x7f5d0819efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:08.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:08.492+0000 7f5d0f200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5d081141b0 con 0x7f5d08104010 2024-09-11T23:16:08.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:08.492+0000 7f5d0f200640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f5d08114030 con 0x7f5d081049c0 2024-09-11T23:16:08.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:08.492+0000 7f5d0f200640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f5d08114330 con 0x7f5d08109140 2024-09-11T23:16:08.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:08.492+0000 7f5d07e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5d08104010 0x7f5d0819a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:08.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:08.493+0000 7f5cffe00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5d081049c0 0x7f5d0819ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:08.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:08.493+0000 7f5d07e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5d08104010 0x7f5d0819a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60842/0 (socket says 172.21.15.37:60842) 2024-09-11T23:16:08.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:08.493+0000 7f5d07e00640 1 -- 172.21.15.37:0/1573530120 learned_addr learned my addr 172.21.15.37:0/1573530120 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:16:08.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:08.493+0000 7f5d0d200640 1 --2- 172.21.15.37:0/1573530120 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5d08109140 0x7f5d0819efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:08.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:08.493+0000 7f5cffe00640 1 -- 172.21.15.37:0/1573530120 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5d08109140 msgr2=0x7f5d0819efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:08.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:08.493+0000 7f5cffe00640 1 --2- 172.21.15.37:0/1573530120 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5d08109140 0x7f5d0819efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:08.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:08.493+0000 7f5cffe00640 1 -- 172.21.15.37:0/1573530120 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5d08104010 msgr2=0x7f5d0819a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:08.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:08.493+0000 7f5cffe00640 1 --2- 172.21.15.37:0/1573530120 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5d08104010 0x7f5d0819a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:08.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:08.493+0000 7f5cffe00640 1 -- 172.21.15.37:0/1573530120 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d0819f6a0 con 0x7f5d081049c0 2024-09-11T23:16:08.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:08.493+0000 7f5d07e00640 1 --2- 172.21.15.37:0/1573530120 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5d08104010 0x7f5d0819a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:16:08.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:08.493+0000 7f5cffe00640 1 --2- 172.21.15.37:0/1573530120 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5d081049c0 0x7f5d0819ac30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5cf002a930 tx=0x7f5cf0003b20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:08.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:08.494+0000 7f5d05600640 1 -- 172.21.15.37:0/1573530120 <== mon.2 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cf003f070 con 0x7f5d081049c0 2024-09-11T23:16:08.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:08.494+0000 7f5d05600640 1 -- 172.21.15.37:0/1573530120 <== mon.2 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5cf0031c90 con 0x7f5d081049c0 2024-09-11T23:16:08.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:08.494+0000 7f5d05600640 1 -- 172.21.15.37:0/1573530120 <== mon.2 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cf0035030 con 0x7f5d081049c0 2024-09-11T23:16:08.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:08.494+0000 7f5d0f200640 1 -- 172.21.15.37:0/1573530120 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d0819f930 con 0x7f5d081049c0 2024-09-11T23:16:08.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:08.494+0000 7f5d0f200640 1 -- 172.21.15.37:0/1573530120 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d0819fdc0 con 0x7f5d081049c0 2024-09-11T23:16:08.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:08.495+0000 7f5d0f200640 1 -- 172.21.15.37:0/1573530120 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d081043f0 con 0x7f5d081049c0 2024-09-11T23:16:08.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:08.496+0000 7f5d05600640 1 -- 172.21.15.37:0/1573530120 <== mon.2 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f5cf0042070 con 0x7f5d081049c0 2024-09-11T23:16:08.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:08.498+0000 7f5d05600640 1 --2- 172.21.15.37:0/1573530120 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f5cec0a2b80 0x7f5cec0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:08.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:08.498+0000 7f5d05600640 1 -- 172.21.15.37:0/1573530120 <== mon.2 v2:172.21.15.123:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f5cf00ef5f0 con 0x7f5d081049c0 2024-09-11T23:16:08.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:08.498+0000 7f5d07e00640 1 --2- 172.21.15.37:0/1573530120 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f5cec0a2b80 0x7f5cec0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:08.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:08.499+0000 7f5d07e00640 1 --2- 172.21.15.37:0/1573530120 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f5cec0a2b80 0x7f5cec0a5040 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5cf8011550 tx=0x7f5cf8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:08.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:08.502+0000 7f5d05600640 1 -- 172.21.15.37:0/1573530120 <== mon.2 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5cf00bc950 con 0x7f5d081049c0 2024-09-11T23:16:08.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:08.701+0000 7f5d0f200640 1 -- 172.21.15.37:0/1573530120 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f5d0810bdf0 con 0x7f5d081049c0 2024-09-11T23:16:08.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:08.701+0000 7f5d05600640 1 -- 172.21.15.37:0/1573530120 <== mon.2 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v77) ==== 84+0+65 (secure 0 0 0) 0x7f5cf00bc250 con 0x7f5d081049c0 2024-09-11T23:16:08.702 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:16:08.702 INFO:teuthology.orchestra.run.smithi037.stdout:[ 2024-09-11T23:16:08.702 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:16:08.702 INFO:teuthology.orchestra.run.smithi037.stdout: "poolnum": 1, 2024-09-11T23:16:08.702 INFO:teuthology.orchestra.run.smithi037.stdout: "poolname": ".mgr" 2024-09-11T23:16:08.702 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:16:08.702 INFO:teuthology.orchestra.run.smithi037.stdout:] 2024-09-11T23:16:08.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:08.704+0000 7f5d0f200640 1 -- 172.21.15.37:0/1573530120 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f5cec0a2b80 msgr2=0x7f5cec0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:08.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:08.704+0000 7f5d0f200640 1 --2- 172.21.15.37:0/1573530120 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f5cec0a2b80 0x7f5cec0a5040 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5cf8011550 tx=0x7f5cf8005f90 comp rx=0 tx=0).stop 2024-09-11T23:16:08.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:08.704+0000 7f5d0f200640 1 -- 172.21.15.37:0/1573530120 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5d081049c0 msgr2=0x7f5d0819ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:08.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:08.704+0000 7f5d0f200640 1 --2- 172.21.15.37:0/1573530120 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5d081049c0 0x7f5d0819ac30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5cf002a930 tx=0x7f5cf0003b20 comp rx=0 tx=0).stop 2024-09-11T23:16:08.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:08.705+0000 7f5d0f200640 1 -- 172.21.15.37:0/1573530120 shutdown_connections 2024-09-11T23:16:08.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:08.705+0000 7f5d0f200640 1 --2- 172.21.15.37:0/1573530120 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f5cec0a2b80 0x7f5cec0a5040 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:08.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:08.705+0000 7f5d0f200640 1 --2- 172.21.15.37:0/1573530120 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5d081049c0 0x7f5d0819ac30 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:08.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:08.705+0000 7f5d0f200640 1 --2- 172.21.15.37:0/1573530120 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5d08109140 0x7f5d0819efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:08.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:08.705+0000 7f5d0f200640 1 --2- 172.21.15.37:0/1573530120 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5d08104010 0x7f5d0819a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:08.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:08.705+0000 7f5d0f200640 1 -- 172.21.15.37:0/1573530120 >> 172.21.15.37:0/1573530120 conn(0x7f5d080ffa50 msgr2=0x7f5d08100d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:08.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:08.705+0000 7f5d0f200640 1 -- 172.21.15.37:0/1573530120 shutdown_connections 2024-09-11T23:16:08.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:08.705+0000 7f5d0f200640 1 -- 172.21.15.37:0/1573530120 wait complete. 2024-09-11T23:16:09.383 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:09 smithi037 ceph-mon[30630]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:16:09.383 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:09 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/1573530120' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-11T23:16:09.383 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:09 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:16:09.383 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:09 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:16:09.383 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:09 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:16:09.383 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:09 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:16:09.383 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:09 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:16:09.419 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-11T23:16:09.420 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-11T23:16:09.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:09 smithi160 ceph-mon[35055]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:16:09.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:09 smithi160 ceph-mon[35055]: from='client.? 172.21.15.37:0/1573530120' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-11T23:16:09.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:09 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:16:09.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:09 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:16:09.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:09 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:16:09.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:09 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:16:09.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:09 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:16:09.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:09 smithi123 ceph-mon[35438]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:16:09.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:09 smithi123 ceph-mon[35438]: from='client.? 172.21.15.37:0/1573530120' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-11T23:16:09.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:09 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:16:09.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:09 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:16:09.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:09 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:16:09.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:09 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:16:09.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:09 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:16:09.797 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:16:10.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:10.345+0000 7f6779e00640 1 -- 172.21.15.37:0/4112091960 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6774103ff0 msgr2=0x7f67741043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:10.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:10.345+0000 7f6779e00640 1 --2- 172.21.15.37:0/4112091960 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6774103ff0 0x7f67741043d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6764009900 tx=0x7f676402a410 comp rx=0 tx=0).stop 2024-09-11T23:16:10.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:10.346+0000 7f6779e00640 1 -- 172.21.15.37:0/4112091960 shutdown_connections 2024-09-11T23:16:10.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:10.346+0000 7f6779e00640 1 --2- 172.21.15.37:0/4112091960 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6774109120 0x7f6774110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:10.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:10.346+0000 7f6779e00640 1 --2- 172.21.15.37:0/4112091960 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f67741049a0 0x7f67741089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:10.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:10.346+0000 7f6779e00640 1 --2- 172.21.15.37:0/4112091960 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6774103ff0 0x7f67741043d0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:10.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:10.346+0000 7f6779e00640 1 -- 172.21.15.37:0/4112091960 >> 172.21.15.37:0/4112091960 conn(0x7f67740ffa90 msgr2=0x7f6774101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:10.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:10.346+0000 7f6779e00640 1 -- 172.21.15.37:0/4112091960 shutdown_connections 2024-09-11T23:16:10.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:10.346+0000 7f6779e00640 1 -- 172.21.15.37:0/4112091960 wait complete. 2024-09-11T23:16:10.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:10.347+0000 7f6779e00640 1 Processor -- start 2024-09-11T23:16:10.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:10.347+0000 7f6779e00640 1 -- start start 2024-09-11T23:16:10.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:10.347+0000 7f6779e00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6774103ff0 0x7f677419a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:10.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:10.348+0000 7f6779e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67741049a0 0x7f677419ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:10.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:10.348+0000 7f6779e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6774109120 0x7f677419eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:10.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:10.348+0000 7f6779e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6774114190 con 0x7f6774109120 2024-09-11T23:16:10.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:10.348+0000 7f6779e00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f6774114010 con 0x7f67741049a0 2024-09-11T23:16:10.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:10.348+0000 7f6779e00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f6774114310 con 0x7f6774103ff0 2024-09-11T23:16:10.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:10.348+0000 7f6772a00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6774103ff0 0x7f677419a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:10.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:10.348+0000 7f6772a00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6774103ff0 0x7f677419a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.37:50612/0 (socket says 172.21.15.37:50612) 2024-09-11T23:16:10.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:10.348+0000 7f6772a00640 1 -- 172.21.15.37:0/2762873237 learned_addr learned my addr 172.21.15.37:0/2762873237 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:16:10.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:10.348+0000 7f6773400640 1 --2- 172.21.15.37:0/2762873237 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6774109120 0x7f677419eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:10.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:10.348+0000 7f676be00640 1 --2- 172.21.15.37:0/2762873237 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67741049a0 0x7f677419ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:10.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:10.348+0000 7f6772a00640 1 -- 172.21.15.37:0/2762873237 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67741049a0 msgr2=0x7f677419ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:10.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:10.348+0000 7f6772a00640 1 --2- 172.21.15.37:0/2762873237 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67741049a0 0x7f677419ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:10.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:10.348+0000 7f6772a00640 1 -- 172.21.15.37:0/2762873237 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6774109120 msgr2=0x7f677419eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:10.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:10.348+0000 7f6772a00640 1 --2- 172.21.15.37:0/2762873237 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6774109120 0x7f677419eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:10.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:10.348+0000 7f6772a00640 1 -- 172.21.15.37:0/2762873237 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f677419f5c0 con 0x7f6774103ff0 2024-09-11T23:16:10.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:10.349+0000 7f6772a00640 1 --2- 172.21.15.37:0/2762873237 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6774103ff0 0x7f677419a610 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6764004770 tx=0x7f6764003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:10.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:10.349+0000 7f6778a00640 1 -- 172.21.15.37:0/2762873237 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f676403f070 con 0x7f6774103ff0 2024-09-11T23:16:10.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:10.349+0000 7f6779e00640 1 -- 172.21.15.37:0/2762873237 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f677419f850 con 0x7f6774103ff0 2024-09-11T23:16:10.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:10.349+0000 7f6778a00640 1 -- 172.21.15.37:0/2762873237 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6764031ca0 con 0x7f6774103ff0 2024-09-11T23:16:10.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:10.349+0000 7f6778a00640 1 -- 172.21.15.37:0/2762873237 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6764035030 con 0x7f6774103ff0 2024-09-11T23:16:10.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:10.349+0000 7f6779e00640 1 -- 172.21.15.37:0/2762873237 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67741a7190 con 0x7f6774103ff0 2024-09-11T23:16:10.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:10.350+0000 7f6779e00640 1 -- 172.21.15.37:0/2762873237 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67741043d0 con 0x7f6774103ff0 2024-09-11T23:16:10.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:10.352+0000 7f6778a00640 1 -- 172.21.15.37:0/2762873237 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f6764042070 con 0x7f6774103ff0 2024-09-11T23:16:10.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:10.353+0000 7f6778a00640 1 --2- 172.21.15.37:0/2762873237 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f67580a2c00 0x7f67580a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:10.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:10.354+0000 7f6778a00640 1 -- 172.21.15.37:0/2762873237 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f67640ef240 con 0x7f6774103ff0 2024-09-11T23:16:10.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:10.354+0000 7f676be00640 1 --2- 172.21.15.37:0/2762873237 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f67580a2c00 0x7f67580a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:10.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:10.354+0000 7f676be00640 1 --2- 172.21.15.37:0/2762873237 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f67580a2c00 0x7f67580a50c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f67740fff20 tx=0x7f675c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:10.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:10.357+0000 7f6778a00640 1 -- 172.21.15.37:0/2762873237 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f67640bbf50 con 0x7f6774103ff0 2024-09-11T23:16:10.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:10.547+0000 7f6779e00640 1 -- 172.21.15.37:0/2762873237 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f677410c300 con 0x7f6774103ff0 2024-09-11T23:16:11.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:11.449+0000 7f6778a00640 1 -- 172.21.15.37:0/2762873237 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v78) ==== 138+0+0 (secure 0 0 0) 0x7f67640c0250 con 0x7f6774103ff0 2024-09-11T23:16:11.450 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' created 2024-09-11T23:16:11.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:11.452+0000 7f6779e00640 1 -- 172.21.15.37:0/2762873237 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f67580a2c00 msgr2=0x7f67580a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:11.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:11.452+0000 7f6779e00640 1 --2- 172.21.15.37:0/2762873237 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f67580a2c00 0x7f67580a50c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f67740fff20 tx=0x7f675c005f90 comp rx=0 tx=0).stop 2024-09-11T23:16:11.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:11.452+0000 7f6779e00640 1 -- 172.21.15.37:0/2762873237 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6774103ff0 msgr2=0x7f677419a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:11.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:11.452+0000 7f6779e00640 1 --2- 172.21.15.37:0/2762873237 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6774103ff0 0x7f677419a610 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6764004770 tx=0x7f6764003c10 comp rx=0 tx=0).stop 2024-09-11T23:16:11.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:11.452+0000 7f6779e00640 1 -- 172.21.15.37:0/2762873237 shutdown_connections 2024-09-11T23:16:11.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:11.452+0000 7f6779e00640 1 --2- 172.21.15.37:0/2762873237 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f67580a2c00 0x7f67580a50c0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:11.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:11.452+0000 7f6779e00640 1 --2- 172.21.15.37:0/2762873237 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67741049a0 0x7f677419ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:11.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:11.452+0000 7f6779e00640 1 --2- 172.21.15.37:0/2762873237 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6774109120 0x7f677419eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:11.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:11.452+0000 7f6779e00640 1 --2- 172.21.15.37:0/2762873237 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6774103ff0 0x7f677419a610 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:11.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:11.452+0000 7f6779e00640 1 -- 172.21.15.37:0/2762873237 >> 172.21.15.37:0/2762873237 conn(0x7f67740ffa90 msgr2=0x7f6774100d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:11.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:11.452+0000 7f6779e00640 1 -- 172.21.15.37:0/2762873237 shutdown_connections 2024-09-11T23:16:11.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:11.452+0000 7f6779e00640 1 -- 172.21.15.37:0/2762873237 wait complete. 2024-09-11T23:16:11.715 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:11 smithi037 ceph-mon[30630]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:16:11.716 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:11 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/2762873237' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-11T23:16:11.716 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:11 smithi037 ceph-mon[30630]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-11T23:16:11.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:11 smithi123 ceph-mon[35438]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:16:11.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:11 smithi123 ceph-mon[35438]: from='client.? 172.21.15.37:0/2762873237' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-11T23:16:11.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:11 smithi123 ceph-mon[35438]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-11T23:16:11.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:11 smithi160 ceph-mon[35055]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:16:11.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:11 smithi160 ceph-mon[35055]: from='client.? 172.21.15.37:0/2762873237' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-11T23:16:11.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:11 smithi160 ceph-mon[35055]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-11T23:16:12.309 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-09-11T23:16:12.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:12 smithi037 ceph-mon[30630]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-11T23:16:12.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:12 smithi037 ceph-mon[30630]: osdmap e78: 12 total, 12 up, 12 in 2024-09-11T23:16:12.704 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:16:12.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:12 smithi123 ceph-mon[35438]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-11T23:16:12.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:12 smithi123 ceph-mon[35438]: osdmap e78: 12 total, 12 up, 12 in 2024-09-11T23:16:12.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:12 smithi160 ceph-mon[35055]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-11T23:16:12.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:12 smithi160 ceph-mon[35055]: osdmap e78: 12 total, 12 up, 12 in 2024-09-11T23:16:13.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:13.292+0000 7ffbaaa00640 1 -- 172.21.15.37:0/3161908254 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffba4077040 msgr2=0x7ffba41124f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:13.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:13.292+0000 7ffbaaa00640 1 --2- 172.21.15.37:0/3161908254 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffba4077040 0x7ffba41124f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ffb90009900 tx=0x7ffb9002a3f0 comp rx=0 tx=0).stop 2024-09-11T23:16:13.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:13.293+0000 7ffbaaa00640 1 -- 172.21.15.37:0/3161908254 shutdown_connections 2024-09-11T23:16:13.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:13.293+0000 7ffbaaa00640 1 --2- 172.21.15.37:0/3161908254 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffba4112a30 0x7ffba4114e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:13.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:13.293+0000 7ffbaaa00640 1 --2- 172.21.15.37:0/3161908254 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffba4077040 0x7ffba41124f0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:13.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:13.293+0000 7ffbaaa00640 1 --2- 172.21.15.37:0/3161908254 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffba4076720 0x7ffba4076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:13.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:13.293+0000 7ffbaaa00640 1 -- 172.21.15.37:0/3161908254 >> 172.21.15.37:0/3161908254 conn(0x7ffba40ffa90 msgr2=0x7ffba4101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:13.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:13.293+0000 7ffbaaa00640 1 -- 172.21.15.37:0/3161908254 shutdown_connections 2024-09-11T23:16:13.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:13.293+0000 7ffbaaa00640 1 -- 172.21.15.37:0/3161908254 wait complete. 2024-09-11T23:16:13.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:13.294+0000 7ffbaaa00640 1 Processor -- start 2024-09-11T23:16:13.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:13.294+0000 7ffbaaa00640 1 -- start start 2024-09-11T23:16:13.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:13.294+0000 7ffbaaa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffba4076720 0x7ffba41a4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:13.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:13.294+0000 7ffbaaa00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffba4077040 0x7ffba41a4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:13.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:13.294+0000 7ffbaaa00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffba4112a30 0x7ffba419e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:13.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:13.294+0000 7ffbaaa00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ffba41185b0 con 0x7ffba4076720 2024-09-11T23:16:13.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:13.294+0000 7ffbaaa00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7ffba4118430 con 0x7ffba4077040 2024-09-11T23:16:13.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:13.294+0000 7ffbaaa00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7ffba4118730 con 0x7ffba4112a30 2024-09-11T23:16:13.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:13.295+0000 7ffba3400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffba4077040 0x7ffba41a4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:13.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:13.295+0000 7ffba3400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffba4077040 0x7ffba41a4ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.37:33774/0 (socket says 172.21.15.37:33774) 2024-09-11T23:16:13.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:13.295+0000 7ffba3400640 1 -- 172.21.15.37:0/2095029511 learned_addr learned my addr 172.21.15.37:0/2095029511 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:16:13.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:13.295+0000 7ffba8a00640 1 --2- 172.21.15.37:0/2095029511 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffba4112a30 0x7ffba419e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:13.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:13.295+0000 7ffba3e00640 1 --2- 172.21.15.37:0/2095029511 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffba4076720 0x7ffba41a4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:13.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:13.295+0000 7ffba3400640 1 -- 172.21.15.37:0/2095029511 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffba4112a30 msgr2=0x7ffba419e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:13.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:13.295+0000 7ffba3400640 1 --2- 172.21.15.37:0/2095029511 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffba4112a30 0x7ffba419e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:13.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:13.295+0000 7ffba3400640 1 -- 172.21.15.37:0/2095029511 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffba4076720 msgr2=0x7ffba41a4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:13.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:13.295+0000 7ffba3400640 1 --2- 172.21.15.37:0/2095029511 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffba4076720 0x7ffba41a4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:13.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:13.295+0000 7ffba3400640 1 -- 172.21.15.37:0/2095029511 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffba419f050 con 0x7ffba4077040 2024-09-11T23:16:13.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:13.296+0000 7ffba3400640 1 --2- 172.21.15.37:0/2095029511 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffba4077040 0x7ffba41a4ca0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ffb90006010 tx=0x7ffb90004040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:13.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:13.296+0000 7ffba0c00640 1 -- 172.21.15.37:0/2095029511 <== mon.2 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb9003f030 con 0x7ffba4077040 2024-09-11T23:16:13.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:13.296+0000 7ffbaaa00640 1 -- 172.21.15.37:0/2095029511 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffba419f2e0 con 0x7ffba4077040 2024-09-11T23:16:13.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:13.296+0000 7ffba0c00640 1 -- 172.21.15.37:0/2095029511 <== mon.2 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffb90004440 con 0x7ffba4077040 2024-09-11T23:16:13.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:13.296+0000 7ffba0c00640 1 -- 172.21.15.37:0/2095029511 <== mon.2 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb90035070 con 0x7ffba4077040 2024-09-11T23:16:13.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:13.296+0000 7ffbaaa00640 1 -- 172.21.15.37:0/2095029511 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffba41ab630 con 0x7ffba4077040 2024-09-11T23:16:13.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:13.297+0000 7ffbaaa00640 1 -- 172.21.15.37:0/2095029511 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffba4076b00 con 0x7ffba4077040 2024-09-11T23:16:13.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:13.300+0000 7ffba0c00640 1 -- 172.21.15.37:0/2095029511 <== mon.2 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7ffb90042030 con 0x7ffba4077040 2024-09-11T23:16:13.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:13.302+0000 7ffba0c00640 1 --2- 172.21.15.37:0/2095029511 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7ffb880a2b80 0x7ffb880a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:13.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:13.302+0000 7ffba0c00640 1 -- 172.21.15.37:0/2095029511 <== mon.2 v2:172.21.15.123:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7497+0+0 (secure 0 0 0) 0x7ffb900ef330 con 0x7ffba4077040 2024-09-11T23:16:13.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:13.302+0000 7ffba3e00640 1 --2- 172.21.15.37:0/2095029511 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7ffb880a2b80 0x7ffb880a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:13.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:13.303+0000 7ffba0c00640 1 -- 172.21.15.37:0/2095029511 <== mon.2 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ffb900bbed0 con 0x7ffba4077040 2024-09-11T23:16:13.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:13.303+0000 7ffba3e00640 1 --2- 172.21.15.37:0/2095029511 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7ffb880a2b80 0x7ffb880a5040 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ffba419fa60 tx=0x7ffb94005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:13.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:13.492+0000 7ffbaaa00640 1 -- 172.21.15.37:0/2095029511 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7ffba410dbc0 con 0x7ffba4077040 2024-09-11T23:16:13.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:13 smithi123 ceph-mon[35438]: pgmap v288: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:16:13.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:13 smithi123 ceph-mon[35438]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T23:16:13.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:13 smithi123 ceph-mon[35438]: osdmap e79: 12 total, 12 up, 12 in 2024-09-11T23:16:13.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:13 smithi037 ceph-mon[30630]: pgmap v288: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:16:13.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:13 smithi037 ceph-mon[30630]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T23:16:13.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:13 smithi037 ceph-mon[30630]: osdmap e79: 12 total, 12 up, 12 in 2024-09-11T23:16:13.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:13 smithi160 ceph-mon[35055]: pgmap v288: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:16:13.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:13 smithi160 ceph-mon[35055]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T23:16:13.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:13 smithi160 ceph-mon[35055]: osdmap e79: 12 total, 12 up, 12 in 2024-09-11T23:16:14.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:14.470+0000 7ffba0c00640 1 -- 172.21.15.37:0/2095029511 <== mon.2 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v81) ==== 171+0+0 (secure 0 0 0) 0x7ffb900c01d0 con 0x7ffba4077040 2024-09-11T23:16:14.472 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' created 2024-09-11T23:16:14.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:14.474+0000 7ffbaaa00640 1 -- 172.21.15.37:0/2095029511 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7ffb880a2b80 msgr2=0x7ffb880a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:14.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:14.474+0000 7ffbaaa00640 1 --2- 172.21.15.37:0/2095029511 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7ffb880a2b80 0x7ffb880a5040 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ffba419fa60 tx=0x7ffb94005f90 comp rx=0 tx=0).stop 2024-09-11T23:16:14.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:14.474+0000 7ffbaaa00640 1 -- 172.21.15.37:0/2095029511 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffba4077040 msgr2=0x7ffba41a4ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:14.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:14.474+0000 7ffbaaa00640 1 --2- 172.21.15.37:0/2095029511 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffba4077040 0x7ffba41a4ca0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ffb90006010 tx=0x7ffb90004040 comp rx=0 tx=0).stop 2024-09-11T23:16:14.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:14.474+0000 7ffbaaa00640 1 -- 172.21.15.37:0/2095029511 shutdown_connections 2024-09-11T23:16:14.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:14.474+0000 7ffbaaa00640 1 --2- 172.21.15.37:0/2095029511 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7ffb880a2b80 0x7ffb880a5040 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:14.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:14.474+0000 7ffbaaa00640 1 --2- 172.21.15.37:0/2095029511 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffba4077040 0x7ffba41a4ca0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:14.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:14.474+0000 7ffbaaa00640 1 --2- 172.21.15.37:0/2095029511 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffba4112a30 0x7ffba419e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:14.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:14.474+0000 7ffbaaa00640 1 --2- 172.21.15.37:0/2095029511 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffba4076720 0x7ffba41a4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:14.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:14.474+0000 7ffbaaa00640 1 -- 172.21.15.37:0/2095029511 >> 172.21.15.37:0/2095029511 conn(0x7ffba40ffa90 msgr2=0x7ffba4101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:14.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:14.475+0000 7ffbaaa00640 1 -- 172.21.15.37:0/2095029511 shutdown_connections 2024-09-11T23:16:14.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:14.475+0000 7ffbaaa00640 1 -- 172.21.15.37:0/2095029511 wait complete. 2024-09-11T23:16:14.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:14 smithi123 ceph-mon[35438]: osdmap e80: 12 total, 12 up, 12 in 2024-09-11T23:16:14.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:14 smithi123 ceph-mon[35438]: from='client.? 172.21.15.37:0/2095029511' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-09-11T23:16:14.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:14 smithi123 ceph-mon[35438]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-09-11T23:16:14.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:14 smithi037 ceph-mon[30630]: osdmap e80: 12 total, 12 up, 12 in 2024-09-11T23:16:14.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:14 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/2095029511' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-09-11T23:16:14.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:14 smithi037 ceph-mon[30630]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-09-11T23:16:14.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:14 smithi160 ceph-mon[35055]: osdmap e80: 12 total, 12 up, 12 in 2024-09-11T23:16:14.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:14 smithi160 ceph-mon[35055]: from='client.? 172.21.15.37:0/2095029511' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-09-11T23:16:14.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:14 smithi160 ceph-mon[35055]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-09-11T23:16:15.407 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-11T23:16:15.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:15 smithi123 ceph-mon[35438]: pgmap v291: 33 pgs: 22 unknown, 11 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:16:15.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:15 smithi123 ceph-mon[35438]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-11T23:16:15.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:15 smithi123 ceph-mon[35438]: osdmap e81: 12 total, 12 up, 12 in 2024-09-11T23:16:15.804 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:16:15.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:15 smithi037 ceph-mon[30630]: pgmap v291: 33 pgs: 22 unknown, 11 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:16:15.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:15 smithi037 ceph-mon[30630]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-11T23:16:15.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:15 smithi037 ceph-mon[30630]: osdmap e81: 12 total, 12 up, 12 in 2024-09-11T23:16:15.933 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:15 smithi160 ceph-mon[35055]: pgmap v291: 33 pgs: 22 unknown, 11 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:16:15.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:15 smithi160 ceph-mon[35055]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-11T23:16:15.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:15 smithi160 ceph-mon[35055]: osdmap e81: 12 total, 12 up, 12 in 2024-09-11T23:16:16.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:16.404+0000 7f89b4600640 1 -- 172.21.15.37:0/1641004118 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89ac074f40 msgr2=0x7f89ac10de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:16.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:16.404+0000 7f89b4600640 1 --2- 172.21.15.37:0/1641004118 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89ac074f40 0x7f89ac10de80 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8998009900 tx=0x7f899802a480 comp rx=0 tx=0).stop 2024-09-11T23:16:16.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:16.404+0000 7f89b4600640 1 -- 172.21.15.37:0/1641004118 shutdown_connections 2024-09-11T23:16:16.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:16.404+0000 7f89b4600640 1 --2- 172.21.15.37:0/1641004118 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f89ac10e3c0 0x7f89ac110810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:16.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:16.404+0000 7f89b4600640 1 --2- 172.21.15.37:0/1641004118 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89ac074f40 0x7f89ac10de80 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:16.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:16.404+0000 7f89b4600640 1 --2- 172.21.15.37:0/1641004118 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f89ac074620 0x7f89ac074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:16.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:16.405+0000 7f89b4600640 1 -- 172.21.15.37:0/1641004118 >> 172.21.15.37:0/1641004118 conn(0x7f89ac0fd8c0 msgr2=0x7f89ac0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:16.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:16.405+0000 7f89b4600640 1 -- 172.21.15.37:0/1641004118 shutdown_connections 2024-09-11T23:16:16.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:16.405+0000 7f89b4600640 1 -- 172.21.15.37:0/1641004118 wait complete. 2024-09-11T23:16:16.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:16.405+0000 7f89b4600640 1 Processor -- start 2024-09-11T23:16:16.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:16.406+0000 7f89b4600640 1 -- start start 2024-09-11T23:16:16.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:16.406+0000 7f89b4600640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f89ac074620 0x7f89ac19a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:16.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:16.406+0000 7f89b4600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89ac074f40 0x7f89ac19abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:16.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:16.406+0000 7f89b4600640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f89ac10e3c0 0x7f89ac19ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:16.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:16.406+0000 7f89b4600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f89ac114140 con 0x7f89ac074f40 2024-09-11T23:16:16.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:16.406+0000 7f89b4600640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f89ac113fc0 con 0x7f89ac10e3c0 2024-09-11T23:16:16.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:16.406+0000 7f89b4600640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f89ac1142c0 con 0x7f89ac074620 2024-09-11T23:16:16.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:16.406+0000 7f89b1200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89ac074f40 0x7f89ac19abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:16.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:16.406+0000 7f89b1200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89ac074f40 0x7f89ac19abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58176/0 (socket says 172.21.15.37:58176) 2024-09-11T23:16:16.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:16.406+0000 7f89b1200640 1 -- 172.21.15.37:0/1607849156 learned_addr learned my addr 172.21.15.37:0/1607849156 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:16:16.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:16.406+0000 7f89b1c00640 1 --2- 172.21.15.37:0/1607849156 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f89ac074620 0x7f89ac19a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:16.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:16.406+0000 7f89b2600640 1 --2- 172.21.15.37:0/1607849156 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f89ac10e3c0 0x7f89ac19ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:16.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:16.407+0000 7f89b1200640 1 -- 172.21.15.37:0/1607849156 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f89ac074620 msgr2=0x7f89ac19a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:16.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:16.407+0000 7f89b1200640 1 --2- 172.21.15.37:0/1607849156 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f89ac074620 0x7f89ac19a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:16.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:16.407+0000 7f89b1200640 1 -- 172.21.15.37:0/1607849156 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f89ac10e3c0 msgr2=0x7f89ac19ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:16.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:16.407+0000 7f89b1200640 1 --2- 172.21.15.37:0/1607849156 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f89ac10e3c0 0x7f89ac19ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:16.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:16.407+0000 7f89b1200640 1 -- 172.21.15.37:0/1607849156 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89ac19f630 con 0x7f89ac074f40 2024-09-11T23:16:16.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:16.407+0000 7f89b2600640 1 --2- 172.21.15.37:0/1607849156 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f89ac10e3c0 0x7f89ac19ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:16:16.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:16.407+0000 7f89b1200640 1 --2- 172.21.15.37:0/1607849156 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89ac074f40 0x7f89ac19abc0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8998006010 tx=0x7f8998004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:16.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:16.408+0000 7f89aa000640 1 -- 172.21.15.37:0/1607849156 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f899803f030 con 0x7f89ac074f40 2024-09-11T23:16:16.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:16.408+0000 7f89b4600640 1 -- 172.21.15.37:0/1607849156 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89ac19f8c0 con 0x7f89ac074f40 2024-09-11T23:16:16.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:16.408+0000 7f89aa000640 1 -- 172.21.15.37:0/1607849156 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8998004440 con 0x7f89ac074f40 2024-09-11T23:16:16.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:16.408+0000 7f89b4600640 1 -- 172.21.15.37:0/1607849156 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89ac1a7200 con 0x7f89ac074f40 2024-09-11T23:16:16.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:16.408+0000 7f89aa000640 1 -- 172.21.15.37:0/1607849156 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8998049060 con 0x7f89ac074f40 2024-09-11T23:16:16.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:16.409+0000 7f89b4600640 1 -- 172.21.15.37:0/1607849156 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89ac074a00 con 0x7f89ac074f40 2024-09-11T23:16:16.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:16.411+0000 7f89aa000640 1 -- 172.21.15.37:0/1607849156 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f8998042030 con 0x7f89ac074f40 2024-09-11T23:16:16.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:16.413+0000 7f89aa000640 1 --2- 172.21.15.37:0/1607849156 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f89940a2b80 0x7f89940a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:16.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:16.413+0000 7f89aa000640 1 -- 172.21.15.37:0/1607849156 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7879+0+0 (secure 0 0 0) 0x7f89980ef820 con 0x7f89ac074f40 2024-09-11T23:16:16.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:16.413+0000 7f89b1c00640 1 --2- 172.21.15.37:0/1607849156 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f89940a2b80 0x7f89940a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:16.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:16.414+0000 7f89b1c00640 1 --2- 172.21.15.37:0/1607849156 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f89940a2b80 0x7f89940a5040 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f89a0009bd0 tx=0x7f89a0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:16.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:16.415+0000 7f89aa000640 1 -- 172.21.15.37:0/1607849156 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f89980bc240 con 0x7f89ac074f40 2024-09-11T23:16:16.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:16 smithi037 ceph-mon[30630]: osdmap e82: 12 total, 12 up, 12 in 2024-09-11T23:16:16.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:16.640+0000 7f89b4600640 1 -- 172.21.15.37:0/1607849156 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f89ac19b9e0 con 0x7f89ac074f40 2024-09-11T23:16:16.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:16 smithi123 ceph-mon[35438]: osdmap e82: 12 total, 12 up, 12 in 2024-09-11T23:16:16.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:16 smithi160 ceph-mon[35055]: osdmap e82: 12 total, 12 up, 12 in 2024-09-11T23:16:17.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:17.473+0000 7f89aa000640 1 -- 172.21.15.37:0/1607849156 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f89ac19b9e0 con 0x7f89ac074f40 2024-09-11T23:16:17.474 INFO:teuthology.orchestra.run.smithi037.stderr:new fs with metadata pool 2 and data pool 3 2024-09-11T23:16:17.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:17.476+0000 7f89b4600640 1 -- 172.21.15.37:0/1607849156 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f89940a2b80 msgr2=0x7f89940a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:17.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:17.477+0000 7f89b4600640 1 --2- 172.21.15.37:0/1607849156 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f89940a2b80 0x7f89940a5040 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f89a0009bd0 tx=0x7f89a0005f90 comp rx=0 tx=0).stop 2024-09-11T23:16:17.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:17.477+0000 7f89b4600640 1 -- 172.21.15.37:0/1607849156 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89ac074f40 msgr2=0x7f89ac19abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:17.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:17.477+0000 7f89b4600640 1 --2- 172.21.15.37:0/1607849156 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89ac074f40 0x7f89ac19abc0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8998006010 tx=0x7f8998004040 comp rx=0 tx=0).stop 2024-09-11T23:16:17.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:17.477+0000 7f89b4600640 1 -- 172.21.15.37:0/1607849156 shutdown_connections 2024-09-11T23:16:17.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:17.477+0000 7f89b4600640 1 --2- 172.21.15.37:0/1607849156 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f89940a2b80 0x7f89940a5040 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:17.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:17.477+0000 7f89b4600640 1 --2- 172.21.15.37:0/1607849156 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f89ac10e3c0 0x7f89ac19ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:17.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:17.477+0000 7f89b4600640 1 --2- 172.21.15.37:0/1607849156 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89ac074f40 0x7f89ac19abc0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:17.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:17.477+0000 7f89b4600640 1 --2- 172.21.15.37:0/1607849156 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f89ac074620 0x7f89ac19a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:17.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:17.477+0000 7f89b4600640 1 -- 172.21.15.37:0/1607849156 >> 172.21.15.37:0/1607849156 conn(0x7f89ac0fd8c0 msgr2=0x7f89ac0fe5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:17.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:17.477+0000 7f89b4600640 1 -- 172.21.15.37:0/1607849156 shutdown_connections 2024-09-11T23:16:17.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:17.477+0000 7f89b4600640 1 -- 172.21.15.37:0/1607849156 wait complete. 2024-09-11T23:16:17.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:17 smithi123 ceph-mon[35438]: pgmap v294: 97 pgs: 10 creating+peering, 48 unknown, 39 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:16:17.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:17 smithi123 ceph-mon[35438]: osdmap e83: 12 total, 12 up, 12 in 2024-09-11T23:16:17.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:17 smithi123 ceph-mon[35438]: from='client.? 172.21.15.37:0/1607849156' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-11T23:16:17.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:17 smithi123 ceph-mon[35438]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-11T23:16:17.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:17 smithi037 ceph-mon[30630]: pgmap v294: 97 pgs: 10 creating+peering, 48 unknown, 39 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:16:17.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:17 smithi037 ceph-mon[30630]: osdmap e83: 12 total, 12 up, 12 in 2024-09-11T23:16:17.815 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:17 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/1607849156' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-11T23:16:17.815 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:17 smithi037 ceph-mon[30630]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-11T23:16:17.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:17 smithi160 ceph-mon[35055]: pgmap v294: 97 pgs: 10 creating+peering, 48 unknown, 39 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:16:17.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:17 smithi160 ceph-mon[35055]: osdmap e83: 12 total, 12 up, 12 in 2024-09-11T23:16:17.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:17 smithi160 ceph-mon[35055]: from='client.? 172.21.15.37:0/1607849156' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-11T23:16:17.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:17 smithi160 ceph-mon[35055]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-11T23:16:18.320 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-09-11T23:16:18.320 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-09-11T23:16:18.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:18 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/1607849156' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-11T23:16:18.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:18 smithi037 ceph-mon[30630]: osdmap e84: 12 total, 12 up, 12 in 2024-09-11T23:16:18.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:18 smithi037 ceph-mon[30630]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-11T23:16:18.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:18 smithi037 ceph-mon[30630]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-11T23:16:18.705 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:16:18.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:18 smithi123 ceph-mon[35438]: from='client.? 172.21.15.37:0/1607849156' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-11T23:16:18.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:18 smithi123 ceph-mon[35438]: osdmap e84: 12 total, 12 up, 12 in 2024-09-11T23:16:18.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:18 smithi123 ceph-mon[35438]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-11T23:16:18.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:18 smithi123 ceph-mon[35438]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-11T23:16:18.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:18 smithi160 ceph-mon[35055]: from='client.? 172.21.15.37:0/1607849156' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-11T23:16:18.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:18 smithi160 ceph-mon[35055]: osdmap e84: 12 total, 12 up, 12 in 2024-09-11T23:16:18.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:18 smithi160 ceph-mon[35055]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-11T23:16:18.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:18 smithi160 ceph-mon[35055]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-11T23:16:19.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:19.281+0000 7fbf24e00640 1 -- 172.21.15.37:0/2128391672 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf20076720 msgr2=0x7fbf20076b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:19.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:19.281+0000 7fbf24e00640 1 --2- 172.21.15.37:0/2128391672 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf20076720 0x7fbf20076b00 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fbf10009900 tx=0x7fbf1002a3f0 comp rx=0 tx=0).stop 2024-09-11T23:16:19.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:19.281+0000 7fbf24e00640 1 -- 172.21.15.37:0/2128391672 shutdown_connections 2024-09-11T23:16:19.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:19.281+0000 7fbf24e00640 1 --2- 172.21.15.37:0/2128391672 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbf20112a30 0x7fbf20114e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:19.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:19.281+0000 7fbf24e00640 1 --2- 172.21.15.37:0/2128391672 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbf20077040 0x7fbf201124f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:19.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:19.282+0000 7fbf24e00640 1 --2- 172.21.15.37:0/2128391672 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf20076720 0x7fbf20076b00 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:19.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:19.282+0000 7fbf24e00640 1 -- 172.21.15.37:0/2128391672 >> 172.21.15.37:0/2128391672 conn(0x7fbf200ffa90 msgr2=0x7fbf20101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:19.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:19.282+0000 7fbf24e00640 1 -- 172.21.15.37:0/2128391672 shutdown_connections 2024-09-11T23:16:19.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:19.282+0000 7fbf24e00640 1 -- 172.21.15.37:0/2128391672 wait complete. 2024-09-11T23:16:19.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:19.283+0000 7fbf24e00640 1 Processor -- start 2024-09-11T23:16:19.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:19.283+0000 7fbf24e00640 1 -- start start 2024-09-11T23:16:19.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:19.283+0000 7fbf24e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf20076720 0x7fbf201a4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:19.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:19.283+0000 7fbf24e00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbf20077040 0x7fbf201a4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:19.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:19.283+0000 7fbf24e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbf20112a30 0x7fbf2019e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:19.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:19.283+0000 7fbf24e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbf201185f0 con 0x7fbf20076720 2024-09-11T23:16:19.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:19.283+0000 7fbf24e00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fbf20118470 con 0x7fbf20112a30 2024-09-11T23:16:19.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:19.283+0000 7fbf24e00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fbf20118770 con 0x7fbf20077040 2024-09-11T23:16:19.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:19.283+0000 7fbf1de00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf20076720 0x7fbf201a4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:19.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:19.283+0000 7fbf1d400640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbf20077040 0x7fbf201a4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:19.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:19.283+0000 7fbf1d400640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbf20077040 0x7fbf201a4c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.37:49538/0 (socket says 172.21.15.37:49538) 2024-09-11T23:16:19.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:19.283+0000 7fbf1d400640 1 -- 172.21.15.37:0/3366341337 learned_addr learned my addr 172.21.15.37:0/3366341337 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:16:19.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:19.283+0000 7fbf1e800640 1 --2- 172.21.15.37:0/3366341337 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbf20112a30 0x7fbf2019e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:19.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:19.284+0000 7fbf1de00640 1 -- 172.21.15.37:0/3366341337 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbf20077040 msgr2=0x7fbf201a4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:19.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:19.284+0000 7fbf1de00640 1 --2- 172.21.15.37:0/3366341337 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbf20077040 0x7fbf201a4c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:19.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:19.284+0000 7fbf1de00640 1 -- 172.21.15.37:0/3366341337 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbf20112a30 msgr2=0x7fbf2019e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:19.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:19.284+0000 7fbf1de00640 1 --2- 172.21.15.37:0/3366341337 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbf20112a30 0x7fbf2019e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:19.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:19.284+0000 7fbf1de00640 1 -- 172.21.15.37:0/3366341337 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf2019eff0 con 0x7fbf20076720 2024-09-11T23:16:19.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:19.284+0000 7fbf1d400640 1 --2- 172.21.15.37:0/3366341337 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbf20077040 0x7fbf201a4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:16:19.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:19.284+0000 7fbf1e800640 1 --2- 172.21.15.37:0/3366341337 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbf20112a30 0x7fbf2019e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:16:19.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:19.284+0000 7fbf1de00640 1 --2- 172.21.15.37:0/3366341337 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf20076720 0x7fbf201a4700 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fbf1002a910 tx=0x7fbf10003b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:19.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:19.284+0000 7fbf16a00640 1 -- 172.21.15.37:0/3366341337 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf1003f070 con 0x7fbf20076720 2024-09-11T23:16:19.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:19.285+0000 7fbf16a00640 1 -- 172.21.15.37:0/3366341337 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbf10031c90 con 0x7fbf20076720 2024-09-11T23:16:19.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:19.285+0000 7fbf24e00640 1 -- 172.21.15.37:0/3366341337 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf2019f280 con 0x7fbf20076720 2024-09-11T23:16:19.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:19.285+0000 7fbf16a00640 1 -- 172.21.15.37:0/3366341337 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf10035030 con 0x7fbf20076720 2024-09-11T23:16:19.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:19.285+0000 7fbf24e00640 1 -- 172.21.15.37:0/3366341337 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf201ab5d0 con 0x7fbf20076720 2024-09-11T23:16:19.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:19.286+0000 7fbf24e00640 1 -- 172.21.15.37:0/3366341337 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf20076b00 con 0x7fbf20076720 2024-09-11T23:16:19.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:19.288+0000 7fbf16a00640 1 -- 172.21.15.37:0/3366341337 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fbf10042070 con 0x7fbf20076720 2024-09-11T23:16:19.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:19.290+0000 7fbf16a00640 1 --2- 172.21.15.37:0/3366341337 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fbf040a2c00 0x7fbf040a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:19.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:19.290+0000 7fbf16a00640 1 -- 172.21.15.37:0/3366341337 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 7979+0+0 (secure 0 0 0) 0x7fbf100ef4c0 con 0x7fbf20076720 2024-09-11T23:16:19.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:19.290+0000 7fbf1d400640 1 --2- 172.21.15.37:0/3366341337 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fbf040a2c00 0x7fbf040a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:19.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:19.291+0000 7fbf1d400640 1 --2- 172.21.15.37:0/3366341337 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fbf040a2c00 0x7fbf040a50c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fbf20079300 tx=0x7fbf0c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:19.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:19.294+0000 7fbf16a00640 1 -- 172.21.15.37:0/3366341337 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbf100bbe80 con 0x7fbf20076720 2024-09-11T23:16:19.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:19.488+0000 7fbf24e00640 1 -- 172.21.15.37:0/3366341337 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7fbf2010dbc0 con 0x7fbf20076720 2024-09-11T23:16:19.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:19.503+0000 7fbf16a00640 1 -- 172.21.15.37:0/3366341337 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v85) ==== 157+0+0 (secure 0 0 0) 0x7fbf100c0180 con 0x7fbf20076720 2024-09-11T23:16:19.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:19.505+0000 7fbf24e00640 1 -- 172.21.15.37:0/3366341337 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fbf040a2c00 msgr2=0x7fbf040a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:19.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:19.505+0000 7fbf24e00640 1 --2- 172.21.15.37:0/3366341337 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fbf040a2c00 0x7fbf040a50c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fbf20079300 tx=0x7fbf0c005f90 comp rx=0 tx=0).stop 2024-09-11T23:16:19.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:19.505+0000 7fbf24e00640 1 -- 172.21.15.37:0/3366341337 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf20076720 msgr2=0x7fbf201a4700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:19.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:19.505+0000 7fbf24e00640 1 --2- 172.21.15.37:0/3366341337 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf20076720 0x7fbf201a4700 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fbf1002a910 tx=0x7fbf10003b20 comp rx=0 tx=0).stop 2024-09-11T23:16:19.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:19.506+0000 7fbf24e00640 1 -- 172.21.15.37:0/3366341337 shutdown_connections 2024-09-11T23:16:19.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:19.506+0000 7fbf24e00640 1 --2- 172.21.15.37:0/3366341337 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fbf040a2c00 0x7fbf040a50c0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:19.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:19.506+0000 7fbf24e00640 1 --2- 172.21.15.37:0/3366341337 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbf20112a30 0x7fbf2019e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:19.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:19.506+0000 7fbf24e00640 1 --2- 172.21.15.37:0/3366341337 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbf20077040 0x7fbf201a4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:19.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:19.506+0000 7fbf24e00640 1 --2- 172.21.15.37:0/3366341337 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf20076720 0x7fbf201a4700 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:19.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:19.506+0000 7fbf24e00640 1 -- 172.21.15.37:0/3366341337 >> 172.21.15.37:0/3366341337 conn(0x7fbf200ffa90 msgr2=0x7fbf20101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:19.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:19.506+0000 7fbf24e00640 1 -- 172.21.15.37:0/3366341337 shutdown_connections 2024-09-11T23:16:19.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:19.506+0000 7fbf24e00640 1 -- 172.21.15.37:0/3366341337 wait complete. 2024-09-11T23:16:19.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:19 smithi123 ceph-mon[35438]: pgmap v297: 97 pgs: 10 creating+peering, 33 unknown, 54 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:16:19.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:19 smithi123 ceph-mon[35438]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-11T23:16:19.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:19 smithi123 ceph-mon[35438]: Cluster is now healthy 2024-09-11T23:16:19.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:19 smithi123 ceph-mon[35438]: mds.? [v2:172.21.15.123:6838/3077076065,v1:172.21.15.123:6839/3077076065] up:active 2024-09-11T23:16:19.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:19 smithi123 ceph-mon[35438]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-11T23:16:19.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:19 smithi123 ceph-mon[35438]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-11T23:16:19.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:19 smithi123 ceph-mon[35438]: from='client.? 172.21.15.37:0/3366341337' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T23:16:19.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:19 smithi037 ceph-mon[30630]: pgmap v297: 97 pgs: 10 creating+peering, 33 unknown, 54 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:16:19.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:19 smithi037 ceph-mon[30630]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-11T23:16:19.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:19 smithi037 ceph-mon[30630]: Cluster is now healthy 2024-09-11T23:16:19.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:19 smithi037 ceph-mon[30630]: mds.? [v2:172.21.15.123:6838/3077076065,v1:172.21.15.123:6839/3077076065] up:active 2024-09-11T23:16:19.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:19 smithi037 ceph-mon[30630]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-11T23:16:19.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:19 smithi037 ceph-mon[30630]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-11T23:16:19.815 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:19 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/3366341337' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T23:16:19.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:19 smithi160 ceph-mon[35055]: pgmap v297: 97 pgs: 10 creating+peering, 33 unknown, 54 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:16:19.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:19 smithi160 ceph-mon[35055]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-11T23:16:19.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:19 smithi160 ceph-mon[35055]: Cluster is now healthy 2024-09-11T23:16:19.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:19 smithi160 ceph-mon[35055]: mds.? [v2:172.21.15.123:6838/3077076065,v1:172.21.15.123:6839/3077076065] up:active 2024-09-11T23:16:19.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:19 smithi160 ceph-mon[35055]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-11T23:16:19.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:19 smithi160 ceph-mon[35055]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-11T23:16:19.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:19 smithi160 ceph-mon[35055]: from='client.? 172.21.15.37:0/3366341337' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T23:16:20.266 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-09-11T23:16:20.651 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:16:20.790 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:20 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/3366341337' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-11T23:16:20.790 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:20 smithi037 ceph-mon[30630]: osdmap e85: 12 total, 12 up, 12 in 2024-09-11T23:16:20.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:20 smithi160 ceph-mon[35055]: from='client.? 172.21.15.37:0/3366341337' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-11T23:16:20.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:20 smithi160 ceph-mon[35055]: osdmap e85: 12 total, 12 up, 12 in 2024-09-11T23:16:21.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:20 smithi123 ceph-mon[35438]: from='client.? 172.21.15.37:0/3366341337' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-11T23:16:21.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:20 smithi123 ceph-mon[35438]: osdmap e85: 12 total, 12 up, 12 in 2024-09-11T23:16:21.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:21.227+0000 7fac3ec00640 1 -- 172.21.15.37:0/322523535 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac38104010 msgr2=0x7fac381043f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:21.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:21.227+0000 7fac3ec00640 1 --2- 172.21.15.37:0/322523535 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac38104010 0x7fac381043f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fac28009900 tx=0x7fac2802a410 comp rx=0 tx=0).stop 2024-09-11T23:16:21.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:21.227+0000 7fac3ec00640 1 -- 172.21.15.37:0/322523535 shutdown_connections 2024-09-11T23:16:21.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:21.227+0000 7fac3ec00640 1 --2- 172.21.15.37:0/322523535 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac38109140 0x7fac38110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:21.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:21.227+0000 7fac3ec00640 1 --2- 172.21.15.37:0/322523535 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fac381049c0 0x7fac38108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:21.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:21.227+0000 7fac3ec00640 1 --2- 172.21.15.37:0/322523535 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac38104010 0x7fac381043f0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:21.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:21.227+0000 7fac3ec00640 1 -- 172.21.15.37:0/322523535 >> 172.21.15.37:0/322523535 conn(0x7fac380ffa50 msgr2=0x7fac38101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:21.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:21.227+0000 7fac3ec00640 1 -- 172.21.15.37:0/322523535 shutdown_connections 2024-09-11T23:16:21.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:21.227+0000 7fac3ec00640 1 -- 172.21.15.37:0/322523535 wait complete. 2024-09-11T23:16:21.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:21.228+0000 7fac3ec00640 1 Processor -- start 2024-09-11T23:16:21.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:21.228+0000 7fac3ec00640 1 -- start start 2024-09-11T23:16:21.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:21.229+0000 7fac3ec00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fac38104010 0x7fac3819a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:21.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:21.229+0000 7fac3ec00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac381049c0 0x7fac3819ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:21.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:21.229+0000 7fac3ec00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac38109140 0x7fac3819eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:21.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:21.229+0000 7fac3ec00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fac38114190 con 0x7fac381049c0 2024-09-11T23:16:21.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:21.229+0000 7fac3ec00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fac38114010 con 0x7fac38109140 2024-09-11T23:16:21.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:21.229+0000 7fac3ec00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fac38114310 con 0x7fac38104010 2024-09-11T23:16:21.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:21.229+0000 7fac37e00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fac38104010 0x7fac3819a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:21.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:21.229+0000 7fac37400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac381049c0 0x7fac3819ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:21.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:21.229+0000 7fac37400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac381049c0 0x7fac3819ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35880/0 (socket says 172.21.15.37:35880) 2024-09-11T23:16:21.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:21.229+0000 7fac37e00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fac38104010 0x7fac3819a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.37:49562/0 (socket says 172.21.15.37:49562) 2024-09-11T23:16:21.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:21.229+0000 7fac37400640 1 -- 172.21.15.37:0/4031191385 learned_addr learned my addr 172.21.15.37:0/4031191385 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:16:21.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:21.229+0000 7fac3cc00640 1 --2- 172.21.15.37:0/4031191385 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac38109140 0x7fac3819eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:21.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:21.230+0000 7fac37400640 1 -- 172.21.15.37:0/4031191385 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fac38104010 msgr2=0x7fac3819a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:21.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:21.230+0000 7fac37400640 1 --2- 172.21.15.37:0/4031191385 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fac38104010 0x7fac3819a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:21.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:21.230+0000 7fac37400640 1 -- 172.21.15.37:0/4031191385 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac38109140 msgr2=0x7fac3819eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:21.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:21.230+0000 7fac37400640 1 --2- 172.21.15.37:0/4031191385 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac38109140 0x7fac3819eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:21.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:21.230+0000 7fac37400640 1 -- 172.21.15.37:0/4031191385 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac3819f5b0 con 0x7fac381049c0 2024-09-11T23:16:21.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:21.230+0000 7fac37400640 1 --2- 172.21.15.37:0/4031191385 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac381049c0 0x7fac3819ab40 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fac2400e9f0 tx=0x7fac2400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:21.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:21.230+0000 7fac34c00640 1 -- 172.21.15.37:0/4031191385 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac2400cd80 con 0x7fac381049c0 2024-09-11T23:16:21.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:21.230+0000 7fac34c00640 1 -- 172.21.15.37:0/4031191385 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fac24010910 con 0x7fac381049c0 2024-09-11T23:16:21.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:21.230+0000 7fac3ec00640 1 -- 172.21.15.37:0/4031191385 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac3819f8a0 con 0x7fac381049c0 2024-09-11T23:16:21.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:21.230+0000 7fac34c00640 1 -- 172.21.15.37:0/4031191385 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac24018990 con 0x7fac381049c0 2024-09-11T23:16:21.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:21.230+0000 7fac3ec00640 1 -- 172.21.15.37:0/4031191385 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac381a7180 con 0x7fac381049c0 2024-09-11T23:16:21.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:21.232+0000 7fac3ec00640 1 -- 172.21.15.37:0/4031191385 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac381043f0 con 0x7fac381049c0 2024-09-11T23:16:21.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:21.233+0000 7fac34c00640 1 -- 172.21.15.37:0/4031191385 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fac24010ac0 con 0x7fac381049c0 2024-09-11T23:16:21.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:21.235+0000 7fac34c00640 1 --2- 172.21.15.37:0/4031191385 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fac1c0a2c00 0x7fac1c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:21.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:21.235+0000 7fac34c00640 1 -- 172.21.15.37:0/4031191385 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8277+0+0 (secure 0 0 0) 0x7fac240cf340 con 0x7fac381049c0 2024-09-11T23:16:21.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:21.235+0000 7fac37e00640 1 --2- 172.21.15.37:0/4031191385 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fac1c0a2c00 0x7fac1c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:21.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:21.236+0000 7fac37e00640 1 --2- 172.21.15.37:0/4031191385 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fac1c0a2c00 0x7fac1c0a50c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fac28000c00 tx=0x7fac28005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:21.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:21.239+0000 7fac34c00640 1 -- 172.21.15.37:0/4031191385 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fac2409bbc0 con 0x7fac381049c0 2024-09-11T23:16:21.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:21.425+0000 7fac3ec00640 1 -- 172.21.15.37:0/4031191385 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fac3802d7c0 con 0x7fac381049c0 2024-09-11T23:16:22.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:22 smithi037 ceph-mon[30630]: pgmap v299: 97 pgs: 97 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 7 op/s 2024-09-11T23:16:22.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:22 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/4031191385' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-11T23:16:22.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:22 smithi160 ceph-mon[35055]: pgmap v299: 97 pgs: 97 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 7 op/s 2024-09-11T23:16:22.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:22 smithi160 ceph-mon[35055]: from='client.? 172.21.15.37:0/4031191385' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-11T23:16:22.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:22 smithi123 ceph-mon[35438]: pgmap v299: 97 pgs: 97 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 7 op/s 2024-09-11T23:16:22.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:22 smithi123 ceph-mon[35438]: from='client.? 172.21.15.37:0/4031191385' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-11T23:16:22.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:22.519+0000 7fac34c00640 1 -- 172.21.15.37:0/4031191385 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v87) ==== 228+0+0 (secure 0 0 0) 0x7fac2409fec0 con 0x7fac381049c0 2024-09-11T23:16:22.520 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data_ec' created 2024-09-11T23:16:22.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:22.521+0000 7fac3ec00640 1 -- 172.21.15.37:0/4031191385 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fac1c0a2c00 msgr2=0x7fac1c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:22.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:22.521+0000 7fac3ec00640 1 --2- 172.21.15.37:0/4031191385 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fac1c0a2c00 0x7fac1c0a50c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fac28000c00 tx=0x7fac28005b50 comp rx=0 tx=0).stop 2024-09-11T23:16:22.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:22.521+0000 7fac3ec00640 1 -- 172.21.15.37:0/4031191385 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac381049c0 msgr2=0x7fac3819ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:22.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:22.521+0000 7fac3ec00640 1 --2- 172.21.15.37:0/4031191385 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac381049c0 0x7fac3819ab40 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fac2400e9f0 tx=0x7fac2400eeb0 comp rx=0 tx=0).stop 2024-09-11T23:16:22.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:22.522+0000 7fac3ec00640 1 -- 172.21.15.37:0/4031191385 shutdown_connections 2024-09-11T23:16:22.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:22.522+0000 7fac3ec00640 1 --2- 172.21.15.37:0/4031191385 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fac1c0a2c00 0x7fac1c0a50c0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:22.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:22.522+0000 7fac3ec00640 1 --2- 172.21.15.37:0/4031191385 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac38109140 0x7fac3819eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:22.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:22.522+0000 7fac3ec00640 1 --2- 172.21.15.37:0/4031191385 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac381049c0 0x7fac3819ab40 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:22.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:22.522+0000 7fac3ec00640 1 --2- 172.21.15.37:0/4031191385 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fac38104010 0x7fac3819a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:22.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:22.522+0000 7fac3ec00640 1 -- 172.21.15.37:0/4031191385 >> 172.21.15.37:0/4031191385 conn(0x7fac380ffa50 msgr2=0x7fac38100d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:22.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:22.522+0000 7fac3ec00640 1 -- 172.21.15.37:0/4031191385 shutdown_connections 2024-09-11T23:16:22.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:22.523+0000 7fac3ec00640 1 -- 172.21.15.37:0/4031191385 wait complete. 2024-09-11T23:16:23.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:23 smithi123 ceph-mon[35438]: pgmap v301: 97 pgs: 97 active+clean; 579 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s wr, 8 op/s 2024-09-11T23:16:23.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:23 smithi123 ceph-mon[35438]: osdmap e86: 12 total, 12 up, 12 in 2024-09-11T23:16:23.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:23 smithi123 ceph-mon[35438]: from='client.? 172.21.15.37:0/4031191385' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-11T23:16:23.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:23 smithi123 ceph-mon[35438]: osdmap e87: 12 total, 12 up, 12 in 2024-09-11T23:16:23.251 INFO:journalctl@ceph.mds.b.smithi123.stdout:Sep 11 23:16:22 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-b[65584]: 2024-09-11T23:16:22.906+0000 7f7b560ff640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-11T23:16:23.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:23 smithi037 ceph-mon[30630]: pgmap v301: 97 pgs: 97 active+clean; 579 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s wr, 8 op/s 2024-09-11T23:16:23.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:23 smithi037 ceph-mon[30630]: osdmap e86: 12 total, 12 up, 12 in 2024-09-11T23:16:23.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:23 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/4031191385' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-11T23:16:23.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:23 smithi037 ceph-mon[30630]: osdmap e87: 12 total, 12 up, 12 in 2024-09-11T23:16:23.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:23 smithi160 ceph-mon[35055]: pgmap v301: 97 pgs: 97 active+clean; 579 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s wr, 8 op/s 2024-09-11T23:16:23.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:23 smithi160 ceph-mon[35055]: osdmap e86: 12 total, 12 up, 12 in 2024-09-11T23:16:23.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:23 smithi160 ceph-mon[35055]: from='client.? 172.21.15.37:0/4031191385' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-11T23:16:23.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:23 smithi160 ceph-mon[35055]: osdmap e87: 12 total, 12 up, 12 in 2024-09-11T23:16:23.440 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-09-11T23:16:23.841 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:16:24.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:24.399+0000 7fbafb800640 1 -- 172.21.15.37:0/3115742175 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbaf41049c0 msgr2=0x7fbaf4108a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:24.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:24.399+0000 7fbafb800640 1 --2- 172.21.15.37:0/3115742175 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbaf41049c0 0x7fbaf4108a10 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fbadc009900 tx=0x7fbadc02a3f0 comp rx=0 tx=0).stop 2024-09-11T23:16:24.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:24.399+0000 7fbafb800640 1 -- 172.21.15.37:0/3115742175 shutdown_connections 2024-09-11T23:16:24.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:24.399+0000 7fbafb800640 1 --2- 172.21.15.37:0/3115742175 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbaf4109140 0x7fbaf4110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:24.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:24.399+0000 7fbafb800640 1 --2- 172.21.15.37:0/3115742175 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbaf41049c0 0x7fbaf4108a10 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:24.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:24.399+0000 7fbafb800640 1 --2- 172.21.15.37:0/3115742175 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbaf4104010 0x7fbaf41043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:24.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:24.399+0000 7fbafb800640 1 -- 172.21.15.37:0/3115742175 >> 172.21.15.37:0/3115742175 conn(0x7fbaf40ffa50 msgr2=0x7fbaf4101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:24.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:24.399+0000 7fbafb800640 1 -- 172.21.15.37:0/3115742175 shutdown_connections 2024-09-11T23:16:24.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:24.399+0000 7fbafb800640 1 -- 172.21.15.37:0/3115742175 wait complete. 2024-09-11T23:16:24.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:24.400+0000 7fbafb800640 1 Processor -- start 2024-09-11T23:16:24.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:24.400+0000 7fbafb800640 1 -- start start 2024-09-11T23:16:24.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:24.401+0000 7fbafb800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbaf4104010 0x7fbaf419a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:24.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:24.401+0000 7fbafb800640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbaf41049c0 0x7fbaf419aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:24.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:24.401+0000 7fbafb800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbaf4109140 0x7fbaf419ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:24.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:24.401+0000 7fbafb800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbaf4114160 con 0x7fbaf4109140 2024-09-11T23:16:24.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:24.401+0000 7fbafb800640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fbaf4113fe0 con 0x7fbaf4104010 2024-09-11T23:16:24.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:24.401+0000 7fbafb800640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fbaf41142e0 con 0x7fbaf41049c0 2024-09-11T23:16:24.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:24.401+0000 7fbaf9800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbaf4109140 0x7fbaf419ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:24.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:24.401+0000 7fbaf8e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbaf4104010 0x7fbaf419a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:24.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:24.401+0000 7fbaebe00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbaf41049c0 0x7fbaf419aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:24.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:24.401+0000 7fbaf8e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbaf4104010 0x7fbaf419a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.37:33666/0 (socket says 172.21.15.37:33666) 2024-09-11T23:16:24.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:24.401+0000 7fbaebe00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbaf41049c0 0x7fbaf419aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.37:49578/0 (socket says 172.21.15.37:49578) 2024-09-11T23:16:24.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:24.401+0000 7fbaf8e00640 1 -- 172.21.15.37:0/1467695056 learned_addr learned my addr 172.21.15.37:0/1467695056 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:16:24.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:24.401+0000 7fbaebe00640 1 -- 172.21.15.37:0/1467695056 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbaf4104010 msgr2=0x7fbaf419a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:24.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:24.401+0000 7fbaebe00640 1 --2- 172.21.15.37:0/1467695056 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbaf4104010 0x7fbaf419a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:24.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:24.401+0000 7fbaebe00640 1 -- 172.21.15.37:0/1467695056 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbaf4109140 msgr2=0x7fbaf419ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:24.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:24.401+0000 7fbaebe00640 1 --2- 172.21.15.37:0/1467695056 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbaf4109140 0x7fbaf419ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:24.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:24.401+0000 7fbaebe00640 1 -- 172.21.15.37:0/1467695056 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaf419f610 con 0x7fbaf41049c0 2024-09-11T23:16:24.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:24.402+0000 7fbaebe00640 1 --2- 172.21.15.37:0/1467695056 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbaf41049c0 0x7fbaf419aba0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbadc005940 tx=0x7fbadc004270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:24.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:24.402+0000 7fbaf2000640 1 -- 172.21.15.37:0/1467695056 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbadc03f030 con 0x7fbaf41049c0 2024-09-11T23:16:24.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:24.402+0000 7fbafb800640 1 -- 172.21.15.37:0/1467695056 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbaf419f8a0 con 0x7fbaf41049c0 2024-09-11T23:16:24.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:24.402+0000 7fbaf2000640 1 -- 172.21.15.37:0/1467695056 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbadc003ad0 con 0x7fbaf41049c0 2024-09-11T23:16:24.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:24.402+0000 7fbaf2000640 1 -- 172.21.15.37:0/1467695056 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbadc035070 con 0x7fbaf41049c0 2024-09-11T23:16:24.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:24.402+0000 7fbafb800640 1 -- 172.21.15.37:0/1467695056 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbaf41a71e0 con 0x7fbaf41049c0 2024-09-11T23:16:24.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:24.403+0000 7fbafb800640 1 -- 172.21.15.37:0/1467695056 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbaf41043f0 con 0x7fbaf41049c0 2024-09-11T23:16:24.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:24.405+0000 7fbaf2000640 1 -- 172.21.15.37:0/1467695056 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fbadc042030 con 0x7fbaf41049c0 2024-09-11T23:16:24.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:24.407+0000 7fbaf2000640 1 --2- 172.21.15.37:0/1467695056 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fbad80a2b80 0x7fbad80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:24.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:24.407+0000 7fbaf2000640 1 -- 172.21.15.37:0/1467695056 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8770+0+0 (secure 0 0 0) 0x7fbadc0efb00 con 0x7fbaf41049c0 2024-09-11T23:16:24.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:24.407+0000 7fbaf8e00640 1 --2- 172.21.15.37:0/1467695056 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fbad80a2b80 0x7fbad80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:24.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:24.407+0000 7fbaf8e00640 1 --2- 172.21.15.37:0/1467695056 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fbad80a2b80 0x7fbad80a5040 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fbae4005fd0 tx=0x7fbae400b4a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:24.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:24.409+0000 7fbaf2000640 1 -- 172.21.15.37:0/1467695056 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbadc0bc190 con 0x7fbaf41049c0 2024-09-11T23:16:24.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:24 smithi037 ceph-mon[30630]: osdmap e88: 12 total, 12 up, 12 in 2024-09-11T23:16:24.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:24.597+0000 7fbafb800640 1 -- 172.21.15.37:0/1467695056 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7fbaf419b9c0 con 0x7fbaf41049c0 2024-09-11T23:16:24.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:24 smithi160 ceph-mon[35055]: osdmap e88: 12 total, 12 up, 12 in 2024-09-11T23:16:25.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:24 smithi123 ceph-mon[35438]: osdmap e88: 12 total, 12 up, 12 in 2024-09-11T23:16:25.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:25.539+0000 7fbaf2000640 1 -- 172.21.15.37:0/1467695056 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v90) ==== 169+0+0 (secure 0 0 0) 0x7fbadc0c0490 con 0x7fbaf41049c0 2024-09-11T23:16:25.540 INFO:teuthology.orchestra.run.smithi037.stderr:set pool 4 allow_ec_overwrites to true 2024-09-11T23:16:25.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:25.542+0000 7fbafb800640 1 -- 172.21.15.37:0/1467695056 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fbad80a2b80 msgr2=0x7fbad80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:25.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:25.542+0000 7fbafb800640 1 --2- 172.21.15.37:0/1467695056 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fbad80a2b80 0x7fbad80a5040 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fbae4005fd0 tx=0x7fbae400b4a0 comp rx=0 tx=0).stop 2024-09-11T23:16:25.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:25.542+0000 7fbafb800640 1 -- 172.21.15.37:0/1467695056 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbaf41049c0 msgr2=0x7fbaf419aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:25.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:25.542+0000 7fbafb800640 1 --2- 172.21.15.37:0/1467695056 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbaf41049c0 0x7fbaf419aba0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbadc005940 tx=0x7fbadc004270 comp rx=0 tx=0).stop 2024-09-11T23:16:25.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:25.542+0000 7fbafb800640 1 -- 172.21.15.37:0/1467695056 shutdown_connections 2024-09-11T23:16:25.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:25.542+0000 7fbafb800640 1 --2- 172.21.15.37:0/1467695056 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fbad80a2b80 0x7fbad80a5040 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:25.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:25.542+0000 7fbafb800640 1 --2- 172.21.15.37:0/1467695056 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbaf4109140 0x7fbaf419ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:25.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:25.542+0000 7fbafb800640 1 --2- 172.21.15.37:0/1467695056 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbaf41049c0 0x7fbaf419aba0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:25.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:25.542+0000 7fbafb800640 1 --2- 172.21.15.37:0/1467695056 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbaf4104010 0x7fbaf419a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:25.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:25.542+0000 7fbafb800640 1 -- 172.21.15.37:0/1467695056 >> 172.21.15.37:0/1467695056 conn(0x7fbaf40ffa50 msgr2=0x7fbaf4100d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:25.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:25.543+0000 7fbafb800640 1 -- 172.21.15.37:0/1467695056 shutdown_connections 2024-09-11T23:16:25.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:25.543+0000 7fbafb800640 1 -- 172.21.15.37:0/1467695056 wait complete. 2024-09-11T23:16:25.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:25 smithi037 ceph-mon[30630]: pgmap v304: 129 pgs: 5 creating+peering, 16 unknown, 108 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s wr, 6 op/s 2024-09-11T23:16:25.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:25 smithi037 ceph-mon[30630]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T23:16:25.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:25 smithi037 ceph-mon[30630]: osdmap e89: 12 total, 12 up, 12 in 2024-09-11T23:16:25.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:25 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/1467695056' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-09-11T23:16:25.815 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:25 smithi037 ceph-mon[30630]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-09-11T23:16:25.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:25 smithi160 ceph-mon[35055]: pgmap v304: 129 pgs: 5 creating+peering, 16 unknown, 108 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s wr, 6 op/s 2024-09-11T23:16:25.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:25 smithi160 ceph-mon[35055]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T23:16:25.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:25 smithi160 ceph-mon[35055]: osdmap e89: 12 total, 12 up, 12 in 2024-09-11T23:16:25.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:25 smithi160 ceph-mon[35055]: from='client.? 172.21.15.37:0/1467695056' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-09-11T23:16:25.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:25 smithi160 ceph-mon[35055]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-09-11T23:16:26.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:25 smithi123 ceph-mon[35438]: pgmap v304: 129 pgs: 5 creating+peering, 16 unknown, 108 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s wr, 6 op/s 2024-09-11T23:16:26.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:25 smithi123 ceph-mon[35438]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T23:16:26.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:25 smithi123 ceph-mon[35438]: osdmap e89: 12 total, 12 up, 12 in 2024-09-11T23:16:26.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:25 smithi123 ceph-mon[35438]: from='client.? 172.21.15.37:0/1467695056' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-09-11T23:16:26.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:25 smithi123 ceph-mon[35438]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-09-11T23:16:26.560 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph fs add_data_pool cephfs cephfs_data_ec 2024-09-11T23:16:26.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:26 smithi037 ceph-mon[30630]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-11T23:16:26.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:26 smithi037 ceph-mon[30630]: osdmap e90: 12 total, 12 up, 12 in 2024-09-11T23:16:26.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:26 smithi160 ceph-mon[35055]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-11T23:16:26.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:26 smithi160 ceph-mon[35055]: osdmap e90: 12 total, 12 up, 12 in 2024-09-11T23:16:26.942 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:16:27.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:26 smithi123 ceph-mon[35438]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-11T23:16:27.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:26 smithi123 ceph-mon[35438]: osdmap e90: 12 total, 12 up, 12 in 2024-09-11T23:16:27.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:27.497+0000 7f35e3200640 1 -- 172.21.15.37:0/2184385704 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35e41019c0 msgr2=0x7f35e4101e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:27.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:27.497+0000 7f35e3200640 1 --2- 172.21.15.37:0/2184385704 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35e41019c0 0x7f35e4101e20 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f35cc009930 tx=0x7f35cc02a420 comp rx=0 tx=0).stop 2024-09-11T23:16:27.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:27.497+0000 7f35e3200640 1 -- 172.21.15.37:0/2184385704 shutdown_connections 2024-09-11T23:16:27.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:27.497+0000 7f35e3200640 1 --2- 172.21.15.37:0/2184385704 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f35e4102360 0x7f35e410e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:27.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:27.497+0000 7f35e3200640 1 --2- 172.21.15.37:0/2184385704 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35e41019c0 0x7f35e4101e20 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:27.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:27.497+0000 7f35e3200640 1 --2- 172.21.15.37:0/2184385704 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f35e41079c0 0x7f35e4107da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:27.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:27.497+0000 7f35e3200640 1 -- 172.21.15.37:0/2184385704 >> 172.21.15.37:0/2184385704 conn(0x7f35e40fd740 msgr2=0x7f35e40ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:27.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:27.497+0000 7f35e3200640 1 -- 172.21.15.37:0/2184385704 shutdown_connections 2024-09-11T23:16:27.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:27.497+0000 7f35e3200640 1 -- 172.21.15.37:0/2184385704 wait complete. 2024-09-11T23:16:27.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:27.498+0000 7f35e3200640 1 Processor -- start 2024-09-11T23:16:27.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:27.499+0000 7f35e3200640 1 -- start start 2024-09-11T23:16:27.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:27.499+0000 7f35e3200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35e41019c0 0x7f35e419a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:27.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:27.499+0000 7f35e3200640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f35e4102360 0x7f35e419aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:27.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:27.499+0000 7f35e3200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f35e41079c0 0x7f35e419ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:27.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:27.499+0000 7f35e3200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f35e4111e10 con 0x7f35e41019c0 2024-09-11T23:16:27.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:27.499+0000 7f35e3200640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f35e4111c90 con 0x7f35e41079c0 2024-09-11T23:16:27.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:27.499+0000 7f35e3200640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f35e4111f90 con 0x7f35e4102360 2024-09-11T23:16:27.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:27.499+0000 7f35e1e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35e41019c0 0x7f35e419a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:27.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:27.499+0000 7f35e1e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35e41019c0 0x7f35e419a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35930/0 (socket says 172.21.15.37:35930) 2024-09-11T23:16:27.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:27.499+0000 7f35e1e00640 1 -- 172.21.15.37:0/2438494635 learned_addr learned my addr 172.21.15.37:0/2438494635 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:16:27.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:27.499+0000 7f35dbe00640 1 --2- 172.21.15.37:0/2438494635 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f35e4102360 0x7f35e419aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:27.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:27.499+0000 7f35e2800640 1 --2- 172.21.15.37:0/2438494635 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f35e41079c0 0x7f35e419ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:27.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:27.500+0000 7f35e1e00640 1 -- 172.21.15.37:0/2438494635 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f35e4102360 msgr2=0x7f35e419aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:27.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:27.500+0000 7f35e1e00640 1 --2- 172.21.15.37:0/2438494635 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f35e4102360 0x7f35e419aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:27.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:27.500+0000 7f35e1e00640 1 -- 172.21.15.37:0/2438494635 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f35e41079c0 msgr2=0x7f35e419ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:27.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:27.500+0000 7f35e1e00640 1 --2- 172.21.15.37:0/2438494635 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f35e41079c0 0x7f35e419ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:27.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:27.500+0000 7f35e1e00640 1 -- 172.21.15.37:0/2438494635 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35e419f520 con 0x7f35e41019c0 2024-09-11T23:16:27.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:27.500+0000 7f35e1e00640 1 --2- 172.21.15.37:0/2438494635 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35e41019c0 0x7f35e419a570 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f35d400e9f0 tx=0x7f35d400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:27.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:27.500+0000 7f35daa00640 1 -- 172.21.15.37:0/2438494635 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35d400cd80 con 0x7f35e41019c0 2024-09-11T23:16:27.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:27.500+0000 7f35daa00640 1 -- 172.21.15.37:0/2438494635 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f35d4010910 con 0x7f35e41019c0 2024-09-11T23:16:27.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:27.500+0000 7f35daa00640 1 -- 172.21.15.37:0/2438494635 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35d4018990 con 0x7f35e41019c0 2024-09-11T23:16:27.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:27.500+0000 7f35e3200640 1 -- 172.21.15.37:0/2438494635 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35e419f810 con 0x7f35e41019c0 2024-09-11T23:16:27.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:27.501+0000 7f35e3200640 1 -- 172.21.15.37:0/2438494635 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35e41a70f0 con 0x7f35e41019c0 2024-09-11T23:16:27.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:27.502+0000 7f35e3200640 1 -- 172.21.15.37:0/2438494635 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35e4101e20 con 0x7f35e41019c0 2024-09-11T23:16:27.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:27.505+0000 7f35daa00640 1 -- 172.21.15.37:0/2438494635 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f35d4010ac0 con 0x7f35e41019c0 2024-09-11T23:16:27.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:27.506+0000 7f35daa00640 1 --2- 172.21.15.37:0/2438494635 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f35c80a2c00 0x7f35c80a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:27.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:27.507+0000 7f35daa00640 1 -- 172.21.15.37:0/2438494635 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8770+0+0 (secure 0 0 0) 0x7f35d40cf900 con 0x7f35e41019c0 2024-09-11T23:16:27.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:27.507+0000 7f35dbe00640 1 --2- 172.21.15.37:0/2438494635 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f35c80a2c00 0x7f35c80a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:27.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:27.507+0000 7f35dbe00640 1 --2- 172.21.15.37:0/2438494635 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f35c80a2c00 0x7f35c80a50c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f35cc006010 tx=0x7f35cc000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:27.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:27.509+0000 7f35daa00640 1 -- 172.21.15.37:0/2438494635 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f35d409bf90 con 0x7f35e41019c0 2024-09-11T23:16:27.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:27.735+0000 7f35e3200640 1 -- 172.21.15.37:0/2438494635 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7f35e41a7360 con 0x7f35e41019c0 2024-09-11T23:16:27.736 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:27 smithi037 ceph-mon[30630]: pgmap v307: 129 pgs: 5 creating+peering, 124 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:16:27.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:27 smithi160 ceph-mon[35055]: pgmap v307: 129 pgs: 5 creating+peering, 124 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:16:28.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:27 smithi123 ceph-mon[35438]: pgmap v307: 129 pgs: 5 creating+peering, 124 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:16:28.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:28.551+0000 7f35daa00640 1 -- 172.21.15.37:0/2438494635 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v17) ==== 137+0+0 (secure 0 0 0) 0x7f35d40a0290 con 0x7f35e41019c0 2024-09-11T23:16:28.552 INFO:teuthology.orchestra.run.smithi037.stderr:added data pool 4 to fsmap 2024-09-11T23:16:28.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:28.554+0000 7f35e3200640 1 -- 172.21.15.37:0/2438494635 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f35c80a2c00 msgr2=0x7f35c80a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:28.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:28.554+0000 7f35e3200640 1 --2- 172.21.15.37:0/2438494635 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f35c80a2c00 0x7f35c80a50c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f35cc006010 tx=0x7f35cc000bc0 comp rx=0 tx=0).stop 2024-09-11T23:16:28.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:28.554+0000 7f35e3200640 1 -- 172.21.15.37:0/2438494635 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35e41019c0 msgr2=0x7f35e419a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:28.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:28.554+0000 7f35e3200640 1 --2- 172.21.15.37:0/2438494635 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35e41019c0 0x7f35e419a570 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f35d400e9f0 tx=0x7f35d400eeb0 comp rx=0 tx=0).stop 2024-09-11T23:16:28.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:28.554+0000 7f35e3200640 1 -- 172.21.15.37:0/2438494635 shutdown_connections 2024-09-11T23:16:28.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:28.554+0000 7f35e3200640 1 --2- 172.21.15.37:0/2438494635 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f35c80a2c00 0x7f35c80a50c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:28.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:28.554+0000 7f35e3200640 1 --2- 172.21.15.37:0/2438494635 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f35e41079c0 0x7f35e419ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:28.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:28.554+0000 7f35e3200640 1 --2- 172.21.15.37:0/2438494635 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f35e4102360 0x7f35e419aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:28.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:28.554+0000 7f35e3200640 1 --2- 172.21.15.37:0/2438494635 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35e41019c0 0x7f35e419a570 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:28.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:28.554+0000 7f35e3200640 1 -- 172.21.15.37:0/2438494635 >> 172.21.15.37:0/2438494635 conn(0x7f35e40fd740 msgr2=0x7f35e410d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:28.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:28.554+0000 7f35e3200640 1 -- 172.21.15.37:0/2438494635 shutdown_connections 2024-09-11T23:16:28.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:28.554+0000 7f35e3200640 1 -- 172.21.15.37:0/2438494635 wait complete. 2024-09-11T23:16:28.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:28 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/2438494635' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-09-11T23:16:28.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:28 smithi160 ceph-mon[35055]: from='client.? 172.21.15.37:0/2438494635' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-09-11T23:16:29.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:28 smithi123 ceph-mon[35438]: from='client.? 172.21.15.37:0/2438494635' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-09-11T23:16:29.486 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T23:16:29.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:29 smithi037 ceph-mon[30630]: pgmap v308: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:16:29.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:29 smithi037 ceph-mon[30630]: osdmap e91: 12 total, 12 up, 12 in 2024-09-11T23:16:29.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:29 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/2438494635' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-11T23:16:29.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:29 smithi037 ceph-mon[30630]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-11T23:16:29.868 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:16:29.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:29 smithi160 ceph-mon[35055]: pgmap v308: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:16:29.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:29 smithi160 ceph-mon[35055]: osdmap e91: 12 total, 12 up, 12 in 2024-09-11T23:16:29.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:29 smithi160 ceph-mon[35055]: from='client.? 172.21.15.37:0/2438494635' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-11T23:16:29.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:29 smithi160 ceph-mon[35055]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-11T23:16:30.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:29 smithi123 ceph-mon[35438]: pgmap v308: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:16:30.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:29 smithi123 ceph-mon[35438]: osdmap e91: 12 total, 12 up, 12 in 2024-09-11T23:16:30.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:29 smithi123 ceph-mon[35438]: from='client.? 172.21.15.37:0/2438494635' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-11T23:16:30.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:29 smithi123 ceph-mon[35438]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-11T23:16:30.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:30.422+0000 7f4befc00640 1 -- 172.21.15.37:0/2852143173 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4be8076720 msgr2=0x7f4be8076b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:30.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:30.422+0000 7f4befc00640 1 --2- 172.21.15.37:0/2852143173 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4be8076720 0x7f4be8076b00 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc009900 tx=0x7f4bdc02a3f0 comp rx=0 tx=0).stop 2024-09-11T23:16:30.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:30.422+0000 7f4befc00640 1 -- 172.21.15.37:0/2852143173 shutdown_connections 2024-09-11T23:16:30.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:30.422+0000 7f4befc00640 1 --2- 172.21.15.37:0/2852143173 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4be8077040 0x7f4be81124f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:30.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:30.422+0000 7f4befc00640 1 --2- 172.21.15.37:0/2852143173 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4be8112a30 0x7f4be8114e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:30.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:30.422+0000 7f4befc00640 1 --2- 172.21.15.37:0/2852143173 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4be8076720 0x7f4be8076b00 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:30.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:30.422+0000 7f4befc00640 1 -- 172.21.15.37:0/2852143173 >> 172.21.15.37:0/2852143173 conn(0x7f4be80ffa90 msgr2=0x7f4be8101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:30.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:30.422+0000 7f4befc00640 1 -- 172.21.15.37:0/2852143173 shutdown_connections 2024-09-11T23:16:30.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:30.422+0000 7f4befc00640 1 -- 172.21.15.37:0/2852143173 wait complete. 2024-09-11T23:16:30.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:30.423+0000 7f4befc00640 1 Processor -- start 2024-09-11T23:16:30.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:30.423+0000 7f4befc00640 1 -- start start 2024-09-11T23:16:30.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:30.424+0000 7f4befc00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4be8076720 0x7f4be81a46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:30.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:30.424+0000 7f4befc00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4be8077040 0x7f4be81a4c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:30.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:30.424+0000 7f4befc00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4be8112a30 0x7f4be819e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:30.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:30.424+0000 7f4befc00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4be81185f0 con 0x7f4be8076720 2024-09-11T23:16:30.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:30.424+0000 7f4befc00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f4be8118470 con 0x7f4be8077040 2024-09-11T23:16:30.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:30.424+0000 7f4befc00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f4be8118770 con 0x7f4be8112a30 2024-09-11T23:16:30.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:30.424+0000 7f4bedc00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4be8112a30 0x7f4be819e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:30.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:30.424+0000 7f4bed200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4be8076720 0x7f4be81a46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:30.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:30.424+0000 7f4bed200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4be8076720 0x7f4be81a46e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34188/0 (socket says 172.21.15.37:34188) 2024-09-11T23:16:30.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:30.424+0000 7f4bed200640 1 -- 172.21.15.37:0/2974022018 learned_addr learned my addr 172.21.15.37:0/2974022018 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:16:30.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:30.424+0000 7f4be7e00640 1 --2- 172.21.15.37:0/2974022018 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4be8077040 0x7f4be81a4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:30.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:30.425+0000 7f4bed200640 1 -- 172.21.15.37:0/2974022018 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4be8112a30 msgr2=0x7f4be819e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:30.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:30.425+0000 7f4bed200640 1 --2- 172.21.15.37:0/2974022018 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4be8112a30 0x7f4be819e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:30.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:30.425+0000 7f4bed200640 1 -- 172.21.15.37:0/2974022018 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4be8077040 msgr2=0x7f4be81a4c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:30.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:30.425+0000 7f4bed200640 1 --2- 172.21.15.37:0/2974022018 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4be8077040 0x7f4be81a4c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:30.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:30.425+0000 7f4bed200640 1 -- 172.21.15.37:0/2974022018 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4be819efd0 con 0x7f4be8076720 2024-09-11T23:16:30.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:30.425+0000 7f4bedc00640 1 --2- 172.21.15.37:0/2974022018 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4be8112a30 0x7f4be819e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:16:30.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:30.425+0000 7f4bed200640 1 --2- 172.21.15.37:0/2974022018 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4be8076720 0x7f4be81a46e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc004770 tx=0x7f4bdc003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:30.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:30.425+0000 7f4be5600640 1 -- 172.21.15.37:0/2974022018 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bdc03f070 con 0x7f4be8076720 2024-09-11T23:16:30.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:30.425+0000 7f4befc00640 1 -- 172.21.15.37:0/2974022018 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4be819f260 con 0x7f4be8076720 2024-09-11T23:16:30.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:30.425+0000 7f4be5600640 1 -- 172.21.15.37:0/2974022018 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4bdc031ca0 con 0x7f4be8076720 2024-09-11T23:16:30.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:30.425+0000 7f4be5600640 1 -- 172.21.15.37:0/2974022018 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bdc035030 con 0x7f4be8076720 2024-09-11T23:16:30.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:30.425+0000 7f4befc00640 1 -- 172.21.15.37:0/2974022018 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4be81ab5b0 con 0x7f4be8076720 2024-09-11T23:16:30.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:30.427+0000 7f4befc00640 1 -- 172.21.15.37:0/2974022018 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4be8076b00 con 0x7f4be8076720 2024-09-11T23:16:30.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:30.428+0000 7f4be5600640 1 -- 172.21.15.37:0/2974022018 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f4bdc042070 con 0x7f4be8076720 2024-09-11T23:16:30.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:30.430+0000 7f4be5600640 1 --2- 172.21.15.37:0/2974022018 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f4bd00a2b80 0x7f4bd00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:30.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:30.430+0000 7f4be5600640 1 -- 172.21.15.37:0/2974022018 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8802+0+0 (secure 0 0 0) 0x7f4bdc0ef8c0 con 0x7f4be8076720 2024-09-11T23:16:30.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:30.430+0000 7f4be7e00640 1 --2- 172.21.15.37:0/2974022018 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f4bd00a2b80 0x7f4bd00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:30.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:30.431+0000 7f4be7e00640 1 --2- 172.21.15.37:0/2974022018 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f4bd00a2b80 0x7f4bd00a5040 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f4be8079290 tx=0x7f4bd4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:30.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:30.434+0000 7f4be5600640 1 -- 172.21.15.37:0/2974022018 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4bdc0bbff0 con 0x7f4be8076720 2024-09-11T23:16:30.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:30.660+0000 7f4befc00640 1 -- 172.21.15.37:0/2974022018 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4be81ab780 con 0x7f4be8076720 2024-09-11T23:16:30.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:30.661+0000 7f4be5600640 1 -- 172.21.15.37:0/2974022018 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+11851 (secure 0 0 0) 0x7f4bdc0c02f0 con 0x7f4be8076720 2024-09-11T23:16:30.662 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:16:30.662 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":17,"btime":"2024-09-11T23:16:28:545124+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14448,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/285120996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":285120996},{"type":"v1","addr":"172.21.15.37:6835","nonce":285120996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14460,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/3095283029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":3095283029},{"type":"v1","addr":"172.21.15.37:6837","nonce":3095283029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/1072030582","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":1072030582},{"type":"v1","addr":"172.21.15.37:6839","nonce":1072030582}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6841/209927476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":209927476},{"type":"v1","addr":"172.21.15.37:6841","nonce":209927476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24440,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/3380294842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":3380294842},{"type":"v1","addr":"172.21.15.123:6833","nonce":3380294842}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/1918127245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":1918127245},{"type":"v1","addr":"172.21.15.160:6833","nonce":1918127245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24476,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/3928690501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":3928690501},{"type":"v1","addr":"172.21.15.123:6835","nonce":3928690501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24493,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/2316897035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":2316897035},{"type":"v1","addr":"172.21.15.160:6835","nonce":2316897035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24497,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/2168535476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":2168535476},{"type":"v1","addr":"172.21.15.123:6837","nonce":2168535476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24499,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6837/2906597021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":2906597021},{"type":"v1","addr":"172.21.15.160:6837","nonce":2906597021}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24520,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6839/2041625862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":2041625862},{"type":"v1","addr":"172.21.15.160:6839","nonce":2041625862}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:16:16.642956+0000","modified":"2024-09-11T23:16:27.737708+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24533},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24533":{"gid":24533,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.123:6839/3077076065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6838","nonce":3077076065},{"type":"v1","addr":"172.21.15.123:6839","nonce":3077076065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24533,"qdb_cluster":[24533]},"id":1}]} 2024-09-11T23:16:30.663 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 17 2024-09-11T23:16:30.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:30.663+0000 7f4befc00640 1 -- 172.21.15.37:0/2974022018 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f4bd00a2b80 msgr2=0x7f4bd00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:30.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:30.663+0000 7f4befc00640 1 --2- 172.21.15.37:0/2974022018 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f4bd00a2b80 0x7f4bd00a5040 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f4be8079290 tx=0x7f4bd4005f90 comp rx=0 tx=0).stop 2024-09-11T23:16:30.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:30.663+0000 7f4befc00640 1 -- 172.21.15.37:0/2974022018 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4be8076720 msgr2=0x7f4be81a46e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:30.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:30.663+0000 7f4befc00640 1 --2- 172.21.15.37:0/2974022018 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4be8076720 0x7f4be81a46e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc004770 tx=0x7f4bdc003c10 comp rx=0 tx=0).stop 2024-09-11T23:16:30.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:30.663+0000 7f4befc00640 1 -- 172.21.15.37:0/2974022018 shutdown_connections 2024-09-11T23:16:30.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:30.663+0000 7f4befc00640 1 --2- 172.21.15.37:0/2974022018 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f4bd00a2b80 0x7f4bd00a5040 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:30.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:30.663+0000 7f4befc00640 1 --2- 172.21.15.37:0/2974022018 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4be8077040 0x7f4be81a4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:30.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:30.663+0000 7f4befc00640 1 --2- 172.21.15.37:0/2974022018 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4be8112a30 0x7f4be819e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:30.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:30.663+0000 7f4befc00640 1 --2- 172.21.15.37:0/2974022018 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4be8076720 0x7f4be81a46e0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:30.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:30.663+0000 7f4befc00640 1 -- 172.21.15.37:0/2974022018 >> 172.21.15.37:0/2974022018 conn(0x7f4be80ffa90 msgr2=0x7f4be8101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:30.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:30.663+0000 7f4befc00640 1 -- 172.21.15.37:0/2974022018 shutdown_connections 2024-09-11T23:16:30.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:30.663+0000 7f4befc00640 1 -- 172.21.15.37:0/2974022018 wait complete. 2024-09-11T23:16:30.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:30 smithi160 ceph-mon[35055]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-11T23:16:30.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:30 smithi160 ceph-mon[35055]: Cluster is now healthy 2024-09-11T23:16:31.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:30 smithi123 ceph-mon[35438]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-11T23:16:31.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:30 smithi123 ceph-mon[35438]: Cluster is now healthy 2024-09-11T23:16:31.028 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:30 smithi037 ceph-mon[30630]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-11T23:16:31.028 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:30 smithi037 ceph-mon[30630]: Cluster is now healthy 2024-09-11T23:16:31.412 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T23:16:31.798 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:16:31.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:31 smithi037 ceph-mon[30630]: pgmap v310: 129 pgs: 129 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:16:31.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:31 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/2974022018' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:16:31.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:31 smithi160 ceph-mon[35055]: pgmap v310: 129 pgs: 129 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:16:31.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:31 smithi160 ceph-mon[35055]: from='client.? 172.21.15.37:0/2974022018' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:16:32.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:31 smithi123 ceph-mon[35438]: pgmap v310: 129 pgs: 129 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:16:32.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:31 smithi123 ceph-mon[35438]: from='client.? 172.21.15.37:0/2974022018' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:16:32.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:32.337+0000 7f2b29600640 1 -- 172.21.15.37:0/2775389499 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b24100610 msgr2=0x7f2b24109ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:32.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:32.337+0000 7f2b29600640 1 --2- 172.21.15.37:0/2775389499 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b24100610 0x7f2b24109ae0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2b0c009930 tx=0x7f2b0c02a4d0 comp rx=0 tx=0).stop 2024-09-11T23:16:32.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:32.338+0000 7f2b29600640 1 -- 172.21.15.37:0/2775389499 shutdown_connections 2024-09-11T23:16:32.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:32.338+0000 7f2b29600640 1 --2- 172.21.15.37:0/2775389499 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b2410a1c0 0x7f2b24110b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:32.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:32.338+0000 7f2b29600640 1 --2- 172.21.15.37:0/2775389499 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b24100610 0x7f2b24109ae0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:32.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:32.338+0000 7f2b29600640 1 --2- 172.21.15.37:0/2775389499 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2b240ffcf0 0x7f2b241000d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:32.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:32.338+0000 7f2b29600640 1 -- 172.21.15.37:0/2775389499 >> 172.21.15.37:0/2775389499 conn(0x7f2b240fb920 msgr2=0x7f2b240fdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:32.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:32.338+0000 7f2b29600640 1 -- 172.21.15.37:0/2775389499 shutdown_connections 2024-09-11T23:16:32.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:32.338+0000 7f2b29600640 1 -- 172.21.15.37:0/2775389499 wait complete. 2024-09-11T23:16:32.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:32.339+0000 7f2b29600640 1 Processor -- start 2024-09-11T23:16:32.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:32.339+0000 7f2b29600640 1 -- start start 2024-09-11T23:16:32.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:32.339+0000 7f2b29600640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b240ffcf0 0x7f2b2419a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:32.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:32.339+0000 7f2b29600640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2b24100610 0x7f2b2419aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:32.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:32.339+0000 7f2b29600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b2410a1c0 0x7f2b2419ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:32.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:32.339+0000 7f2b29600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2b24114040 con 0x7f2b2410a1c0 2024-09-11T23:16:32.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:32.339+0000 7f2b29600640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f2b24113ec0 con 0x7f2b240ffcf0 2024-09-11T23:16:32.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:32.339+0000 7f2b29600640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f2b241141c0 con 0x7f2b24100610 2024-09-11T23:16:32.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:32.339+0000 7f2b28c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b2410a1c0 0x7f2b2419ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:32.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:32.339+0000 7f2b28c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b2410a1c0 0x7f2b2419ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34202/0 (socket says 172.21.15.37:34202) 2024-09-11T23:16:32.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:32.339+0000 7f2b23e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b240ffcf0 0x7f2b2419a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:32.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:32.339+0000 7f2b28c00640 1 -- 172.21.15.37:0/1712193050 learned_addr learned my addr 172.21.15.37:0/1712193050 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:16:32.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:32.339+0000 7f2b1be00640 1 --2- 172.21.15.37:0/1712193050 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2b24100610 0x7f2b2419aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:32.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:32.340+0000 7f2b23e00640 1 -- 172.21.15.37:0/1712193050 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2b24100610 msgr2=0x7f2b2419aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:32.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:32.340+0000 7f2b23e00640 1 --2- 172.21.15.37:0/1712193050 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2b24100610 0x7f2b2419aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:32.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:32.340+0000 7f2b23e00640 1 -- 172.21.15.37:0/1712193050 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b2410a1c0 msgr2=0x7f2b2419ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:32.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:32.340+0000 7f2b23e00640 1 --2- 172.21.15.37:0/1712193050 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b2410a1c0 0x7f2b2419ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:32.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:32.340+0000 7f2b23e00640 1 -- 172.21.15.37:0/1712193050 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b2419f4f0 con 0x7f2b240ffcf0 2024-09-11T23:16:32.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:32.340+0000 7f2b28c00640 1 --2- 172.21.15.37:0/1712193050 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b2410a1c0 0x7f2b2419ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:16:32.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:32.340+0000 7f2b23e00640 1 --2- 172.21.15.37:0/1712193050 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b240ffcf0 0x7f2b2419a540 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2b1400e9f0 tx=0x7f2b1400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:32.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:32.340+0000 7f2b21600640 1 -- 172.21.15.37:0/1712193050 <== mon.2 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b1400cd80 con 0x7f2b240ffcf0 2024-09-11T23:16:32.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:32.340+0000 7f2b29600640 1 -- 172.21.15.37:0/1712193050 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b2419f7e0 con 0x7f2b240ffcf0 2024-09-11T23:16:32.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:32.340+0000 7f2b21600640 1 -- 172.21.15.37:0/1712193050 <== mon.2 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2b140035f0 con 0x7f2b240ffcf0 2024-09-11T23:16:32.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:32.340+0000 7f2b21600640 1 -- 172.21.15.37:0/1712193050 <== mon.2 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b14010670 con 0x7f2b240ffcf0 2024-09-11T23:16:32.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:32.340+0000 7f2b29600640 1 -- 172.21.15.37:0/1712193050 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b241a70c0 con 0x7f2b240ffcf0 2024-09-11T23:16:32.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:32.341+0000 7f2b29600640 1 -- 172.21.15.37:0/1712193050 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b241000d0 con 0x7f2b240ffcf0 2024-09-11T23:16:32.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:32.344+0000 7f2b21600640 1 -- 172.21.15.37:0/1712193050 <== mon.2 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f2b140037a0 con 0x7f2b240ffcf0 2024-09-11T23:16:32.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:32.345+0000 7f2b21600640 1 --2- 172.21.15.37:0/1712193050 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f2b080a2b80 0x7f2b080a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:32.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:32.345+0000 7f2b21600640 1 -- 172.21.15.37:0/1712193050 <== mon.2 v2:172.21.15.123:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8802+0+0 (secure 0 0 0) 0x7f2b140cf650 con 0x7f2b240ffcf0 2024-09-11T23:16:32.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:32.345+0000 7f2b1be00640 1 --2- 172.21.15.37:0/1712193050 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f2b080a2b80 0x7f2b080a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:32.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:32.346+0000 7f2b1be00640 1 --2- 172.21.15.37:0/1712193050 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f2b080a2b80 0x7f2b080a5040 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f2b0c009900 tx=0x7f2b0c000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:32.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:32.347+0000 7f2b21600640 1 -- 172.21.15.37:0/1712193050 <== mon.2 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2b1409c3a0 con 0x7f2b240ffcf0 2024-09-11T23:16:32.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:32.535+0000 7f2b29600640 1 -- 172.21.15.37:0/1712193050 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2b2419b8a0 con 0x7f2b240ffcf0 2024-09-11T23:16:32.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:32.537+0000 7f2b21600640 1 -- 172.21.15.37:0/1712193050 <== mon.2 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+24201 (secure 0 0 0) 0x7f2b1409bca0 con 0x7f2b240ffcf0 2024-09-11T23:16:32.538 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:16:32.538 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":91,"fsid":"8b03efce-7092-11ef-bcea-c7b262605968","created":"2024-09-11T23:07:59.386838+0000","modified":"2024-09-11T23:16:27.737531+0000","last_up_change":"2024-09-11T23:15:16.985748+0000","last_in_change":"2024-09-11T23:14:54.154116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:11:16.547642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:16:11.075859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T23:16:14.019910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-11T23:16:22.041463+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f76ccb11-fe3b-4df1-9a71-e6ca50de80e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1678472768},{"type":"v1","addr":"172.21.15.37:6803","nonce":1678472768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1678472768},{"type":"v1","addr":"172.21.15.37:6805","nonce":1678472768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1678472768},{"type":"v1","addr":"172.21.15.37:6809","nonce":1678472768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1678472768},{"type":"v1","addr":"172.21.15.37:6807","nonce":1678472768}]},"public_addr":"172.21.15.37:6803/1678472768","cluster_addr":"172.21.15.37:6805/1678472768","heartbeat_back_addr":"172.21.15.37:6809/1678472768","heartbeat_front_addr":"172.21.15.37:6807/1678472768","state":["exists","up"]},{"osd":1,"uuid":"13d26eed-1160-4b15-b66b-66c89066c66f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":141504725},{"type":"v1","addr":"172.21.15.123:6801","nonce":141504725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":141504725},{"type":"v1","addr":"172.21.15.123:6803","nonce":141504725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":141504725},{"type":"v1","addr":"172.21.15.123:6807","nonce":141504725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":141504725},{"type":"v1","addr":"172.21.15.123:6805","nonce":141504725}]},"public_addr":"172.21.15.123:6801/141504725","cluster_addr":"172.21.15.123:6803/141504725","heartbeat_back_addr":"172.21.15.123:6807/141504725","heartbeat_front_addr":"172.21.15.123:6805/141504725","state":["exists","up"]},{"osd":2,"uuid":"53daf4d5-2a43-4a89-bae9-f32b89b517f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":1866489133},{"type":"v1","addr":"172.21.15.160:6801","nonce":1866489133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":1866489133},{"type":"v1","addr":"172.21.15.160:6803","nonce":1866489133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":1866489133},{"type":"v1","addr":"172.21.15.160:6807","nonce":1866489133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":1866489133},{"type":"v1","addr":"172.21.15.160:6805","nonce":1866489133}]},"public_addr":"172.21.15.160:6801/1866489133","cluster_addr":"172.21.15.160:6803/1866489133","heartbeat_back_addr":"172.21.15.160:6807/1866489133","heartbeat_front_addr":"172.21.15.160:6805/1866489133","state":["exists","up"]},{"osd":3,"uuid":"7c819225-964b-44f2-93e5-1d7585eb0b36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":412656036},{"type":"v1","addr":"172.21.15.37:6811","nonce":412656036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":412656036},{"type":"v1","addr":"172.21.15.37:6813","nonce":412656036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":412656036},{"type":"v1","addr":"172.21.15.37:6817","nonce":412656036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":412656036},{"type":"v1","addr":"172.21.15.37:6815","nonce":412656036}]},"public_addr":"172.21.15.37:6811/412656036","cluster_addr":"172.21.15.37:6813/412656036","heartbeat_back_addr":"172.21.15.37:6817/412656036","heartbeat_front_addr":"172.21.15.37:6815/412656036","state":["exists","up"]},{"osd":4,"uuid":"e5ab5638-8c7e-4433-8dd0-ba57e28f39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":3228822066},{"type":"v1","addr":"172.21.15.123:6809","nonce":3228822066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":3228822066},{"type":"v1","addr":"172.21.15.123:6811","nonce":3228822066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":3228822066},{"type":"v1","addr":"172.21.15.123:6815","nonce":3228822066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":3228822066},{"type":"v1","addr":"172.21.15.123:6813","nonce":3228822066}]},"public_addr":"172.21.15.123:6809/3228822066","cluster_addr":"172.21.15.123:6811/3228822066","heartbeat_back_addr":"172.21.15.123:6815/3228822066","heartbeat_front_addr":"172.21.15.123:6813/3228822066","state":["exists","up"]},{"osd":5,"uuid":"7f080d49-eec8-4cd9-b410-b2e84139292e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":1618319675},{"type":"v1","addr":"172.21.15.160:6809","nonce":1618319675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":1618319675},{"type":"v1","addr":"172.21.15.160:6811","nonce":1618319675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":1618319675},{"type":"v1","addr":"172.21.15.160:6815","nonce":1618319675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":1618319675},{"type":"v1","addr":"172.21.15.160:6813","nonce":1618319675}]},"public_addr":"172.21.15.160:6809/1618319675","cluster_addr":"172.21.15.160:6811/1618319675","heartbeat_back_addr":"172.21.15.160:6815/1618319675","heartbeat_front_addr":"172.21.15.160:6813/1618319675","state":["exists","up"]},{"osd":6,"uuid":"d0881c4e-bd8d-4575-8c81-94d21825c227","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3541251299},{"type":"v1","addr":"172.21.15.37:6819","nonce":3541251299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3541251299},{"type":"v1","addr":"172.21.15.37:6821","nonce":3541251299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":3541251299},{"type":"v1","addr":"172.21.15.37:6825","nonce":3541251299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3541251299},{"type":"v1","addr":"172.21.15.37:6823","nonce":3541251299}]},"public_addr":"172.21.15.37:6819/3541251299","cluster_addr":"172.21.15.37:6821/3541251299","heartbeat_back_addr":"172.21.15.37:6825/3541251299","heartbeat_front_addr":"172.21.15.37:6823/3541251299","state":["exists","up"]},{"osd":7,"uuid":"04fbec2e-91b5-4a89-a4a3-472398c45288","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":4279933341},{"type":"v1","addr":"172.21.15.123:6817","nonce":4279933341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":4279933341},{"type":"v1","addr":"172.21.15.123:6819","nonce":4279933341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":4279933341},{"type":"v1","addr":"172.21.15.123:6823","nonce":4279933341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":4279933341},{"type":"v1","addr":"172.21.15.123:6821","nonce":4279933341}]},"public_addr":"172.21.15.123:6817/4279933341","cluster_addr":"172.21.15.123:6819/4279933341","heartbeat_back_addr":"172.21.15.123:6823/4279933341","heartbeat_front_addr":"172.21.15.123:6821/4279933341","state":["exists","up"]},{"osd":8,"uuid":"c77090a7-308e-4c6d-a56e-ce6f8e050ae5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":740968584},{"type":"v1","addr":"172.21.15.160:6817","nonce":740968584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":740968584},{"type":"v1","addr":"172.21.15.160:6819","nonce":740968584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":740968584},{"type":"v1","addr":"172.21.15.160:6823","nonce":740968584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":740968584},{"type":"v1","addr":"172.21.15.160:6821","nonce":740968584}]},"public_addr":"172.21.15.160:6817/740968584","cluster_addr":"172.21.15.160:6819/740968584","heartbeat_back_addr":"172.21.15.160:6823/740968584","heartbeat_front_addr":"172.21.15.160:6821/740968584","state":["exists","up"]},{"osd":9,"uuid":"bcd19bd4-88bc-46f7-b48c-af9e3d17aa96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":692114850},{"type":"v1","addr":"172.21.15.37:6827","nonce":692114850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":692114850},{"type":"v1","addr":"172.21.15.37:6829","nonce":692114850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":692114850},{"type":"v1","addr":"172.21.15.37:6833","nonce":692114850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":692114850},{"type":"v1","addr":"172.21.15.37:6831","nonce":692114850}]},"public_addr":"172.21.15.37:6827/692114850","cluster_addr":"172.21.15.37:6829/692114850","heartbeat_back_addr":"172.21.15.37:6833/692114850","heartbeat_front_addr":"172.21.15.37:6831/692114850","state":["exists","up"]},{"osd":10,"uuid":"9e956e6c-c28a-4a4c-b385-c458788858ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":471058996},{"type":"v1","addr":"172.21.15.123:6825","nonce":471058996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":471058996},{"type":"v1","addr":"172.21.15.123:6827","nonce":471058996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":471058996},{"type":"v1","addr":"172.21.15.123:6831","nonce":471058996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":471058996},{"type":"v1","addr":"172.21.15.123:6829","nonce":471058996}]},"public_addr":"172.21.15.123:6825/471058996","cluster_addr":"172.21.15.123:6827/471058996","heartbeat_back_addr":"172.21.15.123:6831/471058996","heartbeat_front_addr":"172.21.15.123:6829/471058996","state":["exists","up"]},{"osd":11,"uuid":"0b5b3364-9a40-4cab-90d4-b7b1cba57bc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":3982315018},{"type":"v1","addr":"172.21.15.160:6825","nonce":3982315018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3982315018},{"type":"v1","addr":"172.21.15.160:6827","nonce":3982315018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3982315018},{"type":"v1","addr":"172.21.15.160:6831","nonce":3982315018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3982315018},{"type":"v1","addr":"172.21.15.160:6829","nonce":3982315018}]},"public_addr":"172.21.15.160:6825/3982315018","cluster_addr":"172.21.15.160:6827/3982315018","heartbeat_back_addr":"172.21.15.160:6831/3982315018","heartbeat_front_addr":"172.21.15.160:6829/3982315018","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:10:21.139833+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:10:47.004960+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:11:11.460263+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:11:40.849286+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:12:06.497448+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:12:32.043206+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:13:01.402019+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:13:27.993489+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:13:52.291643+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:23.840299+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:49.448254+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:15:15.310947+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:6801/2886800769":"2024-09-12T23:08:51.934167+0000","172.21.15.37:0/1811301224":"2024-09-12T23:08:51.934167+0000","172.21.15.37:0/513883980":"2024-09-12T23:08:51.934167+0000","172.21.15.37:0/3698260188":"2024-09-12T23:08:23.793913+0000","172.21.15.37:6800/2886800769":"2024-09-12T23:08:51.934167+0000","172.21.15.37:0/4134736061":"2024-09-12T23:08:23.793913+0000","172.21.15.37:0/3426758476":"2024-09-12T23:08:51.934167+0000","172.21.15.37:0/2545840561":"2024-09-12T23:08:23.793913+0000","172.21.15.37:6801/3447426643":"2024-09-12T23:08:23.793913+0000","172.21.15.37:6800/3447426643":"2024-09-12T23:08:23.793913+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:16:32.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:32.539+0000 7f2b29600640 1 -- 172.21.15.37:0/1712193050 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f2b080a2b80 msgr2=0x7f2b080a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:32.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:32.539+0000 7f2b29600640 1 --2- 172.21.15.37:0/1712193050 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f2b080a2b80 0x7f2b080a5040 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f2b0c009900 tx=0x7f2b0c000bc0 comp rx=0 tx=0).stop 2024-09-11T23:16:32.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:32.539+0000 7f2b29600640 1 -- 172.21.15.37:0/1712193050 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b240ffcf0 msgr2=0x7f2b2419a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:32.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:32.539+0000 7f2b29600640 1 --2- 172.21.15.37:0/1712193050 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b240ffcf0 0x7f2b2419a540 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2b1400e9f0 tx=0x7f2b1400eeb0 comp rx=0 tx=0).stop 2024-09-11T23:16:32.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:32.540+0000 7f2b29600640 1 -- 172.21.15.37:0/1712193050 shutdown_connections 2024-09-11T23:16:32.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:32.540+0000 7f2b29600640 1 --2- 172.21.15.37:0/1712193050 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f2b080a2b80 0x7f2b080a5040 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:32.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:32.540+0000 7f2b29600640 1 --2- 172.21.15.37:0/1712193050 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b2410a1c0 0x7f2b2419ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:32.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:32.540+0000 7f2b29600640 1 --2- 172.21.15.37:0/1712193050 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2b24100610 0x7f2b2419aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:32.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:32.540+0000 7f2b29600640 1 --2- 172.21.15.37:0/1712193050 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b240ffcf0 0x7f2b2419a540 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:32.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:32.540+0000 7f2b29600640 1 -- 172.21.15.37:0/1712193050 >> 172.21.15.37:0/1712193050 conn(0x7f2b240fb920 msgr2=0x7f2b241094a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:32.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:32.540+0000 7f2b29600640 1 -- 172.21.15.37:0/1712193050 shutdown_connections 2024-09-11T23:16:32.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:32.540+0000 7f2b29600640 1 -- 172.21.15.37:0/1712193050 wait complete. 2024-09-11T23:16:32.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:32 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/1712193050' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:16:32.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:32 smithi160 ceph-mon[35055]: from='client.? 172.21.15.37:0/1712193050' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:16:33.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:32 smithi123 ceph-mon[35438]: from='client.? 172.21.15.37:0/1712193050' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:16:33.383 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T23:16:33.765 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:16:33.905 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:33 smithi037 ceph-mon[30630]: pgmap v311: 129 pgs: 129 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:16:33.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:33 smithi160 ceph-mon[35055]: pgmap v311: 129 pgs: 129 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:16:34.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:33 smithi123 ceph-mon[35438]: pgmap v311: 129 pgs: 129 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:16:34.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:34.280+0000 7fc54d200640 1 -- 172.21.15.37:0/913578866 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc548103ff0 msgr2=0x7fc5481043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:34.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:34.280+0000 7fc54d200640 1 --2- 172.21.15.37:0/913578866 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc548103ff0 0x7fc5481043d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc538009900 tx=0x7fc53802a3f0 comp rx=0 tx=0).stop 2024-09-11T23:16:34.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:34.280+0000 7fc54d200640 1 -- 172.21.15.37:0/913578866 shutdown_connections 2024-09-11T23:16:34.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:34.280+0000 7fc54d200640 1 --2- 172.21.15.37:0/913578866 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5481049a0 0x7fc5481089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:34.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:34.280+0000 7fc54d200640 1 --2- 172.21.15.37:0/913578866 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc548109120 0x7fc548110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:34.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:34.280+0000 7fc54d200640 1 --2- 172.21.15.37:0/913578866 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc548103ff0 0x7fc5481043d0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:34.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:34.280+0000 7fc54d200640 1 -- 172.21.15.37:0/913578866 >> 172.21.15.37:0/913578866 conn(0x7fc5480ffa90 msgr2=0x7fc548101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:34.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:34.280+0000 7fc54d200640 1 -- 172.21.15.37:0/913578866 shutdown_connections 2024-09-11T23:16:34.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:34.280+0000 7fc54d200640 1 -- 172.21.15.37:0/913578866 wait complete. 2024-09-11T23:16:34.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:34.281+0000 7fc54d200640 1 Processor -- start 2024-09-11T23:16:34.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:34.281+0000 7fc54d200640 1 -- start start 2024-09-11T23:16:34.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:34.281+0000 7fc54d200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc548103ff0 0x7fc54819a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:34.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:34.281+0000 7fc54d200640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc5481049a0 0x7fc54819ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:34.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:34.281+0000 7fc54d200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc548109120 0x7fc54819eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:34.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:34.281+0000 7fc54d200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc548114150 con 0x7fc548103ff0 2024-09-11T23:16:34.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:34.281+0000 7fc54d200640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc548113fd0 con 0x7fc548109120 2024-09-11T23:16:34.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:34.281+0000 7fc54d200640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fc5481142d0 con 0x7fc5481049a0 2024-09-11T23:16:34.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:34.282+0000 7fc545e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc548103ff0 0x7fc54819a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:34.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:34.282+0000 7fc545e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc548103ff0 0x7fc54819a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34216/0 (socket says 172.21.15.37:34216) 2024-09-11T23:16:34.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:34.282+0000 7fc545e00640 1 -- 172.21.15.37:0/3948041022 learned_addr learned my addr 172.21.15.37:0/3948041022 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:16:34.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:34.282+0000 7fc546800640 1 --2- 172.21.15.37:0/3948041022 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc548109120 0x7fc54819eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:34.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:34.282+0000 7fc545400640 1 --2- 172.21.15.37:0/3948041022 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc5481049a0 0x7fc54819ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:34.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:34.282+0000 7fc545e00640 1 -- 172.21.15.37:0/3948041022 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc5481049a0 msgr2=0x7fc54819ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:34.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:34.282+0000 7fc545e00640 1 --2- 172.21.15.37:0/3948041022 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc5481049a0 0x7fc54819ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:34.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:34.282+0000 7fc545e00640 1 -- 172.21.15.37:0/3948041022 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc548109120 msgr2=0x7fc54819eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:34.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:34.282+0000 7fc545e00640 1 --2- 172.21.15.37:0/3948041022 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc548109120 0x7fc54819eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:34.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:34.282+0000 7fc545e00640 1 -- 172.21.15.37:0/3948041022 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc54819f5a0 con 0x7fc548103ff0 2024-09-11T23:16:34.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:34.282+0000 7fc545400640 1 --2- 172.21.15.37:0/3948041022 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc5481049a0 0x7fc54819ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:16:34.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:34.283+0000 7fc545e00640 1 --2- 172.21.15.37:0/3948041022 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc548103ff0 0x7fc54819a5f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc538006010 tx=0x7fc538004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:34.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:34.283+0000 7fc53ea00640 1 -- 172.21.15.37:0/3948041022 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc53803f030 con 0x7fc548103ff0 2024-09-11T23:16:34.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:34.283+0000 7fc53ea00640 1 -- 172.21.15.37:0/3948041022 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc538004440 con 0x7fc548103ff0 2024-09-11T23:16:34.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:34.283+0000 7fc54d200640 1 -- 172.21.15.37:0/3948041022 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc54819f830 con 0x7fc548103ff0 2024-09-11T23:16:34.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:34.283+0000 7fc54d200640 1 -- 172.21.15.37:0/3948041022 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5481a7170 con 0x7fc548103ff0 2024-09-11T23:16:34.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:34.283+0000 7fc53ea00640 1 -- 172.21.15.37:0/3948041022 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc538035070 con 0x7fc548103ff0 2024-09-11T23:16:34.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:34.284+0000 7fc54d200640 1 -- 172.21.15.37:0/3948041022 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5481043d0 con 0x7fc548103ff0 2024-09-11T23:16:34.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:34.286+0000 7fc53ea00640 1 -- 172.21.15.37:0/3948041022 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fc538042030 con 0x7fc548103ff0 2024-09-11T23:16:34.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:34.287+0000 7fc53ea00640 1 --2- 172.21.15.37:0/3948041022 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fc52c0a2b80 0x7fc52c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:34.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:34.288+0000 7fc53ea00640 1 -- 172.21.15.37:0/3948041022 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8802+0+0 (secure 0 0 0) 0x7fc5380ef6e0 con 0x7fc548103ff0 2024-09-11T23:16:34.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:34.288+0000 7fc545400640 1 --2- 172.21.15.37:0/3948041022 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fc52c0a2b80 0x7fc52c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:34.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:34.288+0000 7fc545400640 1 --2- 172.21.15.37:0/3948041022 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fc52c0a2b80 0x7fc52c0a5040 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc5480ffeb0 tx=0x7fc534005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:34.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:34.292+0000 7fc53ea00640 1 -- 172.21.15.37:0/3948041022 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc5380bc3a0 con 0x7fc548103ff0 2024-09-11T23:16:34.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:34.476+0000 7fc54d200640 1 -- 172.21.15.37:0/3948041022 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc54810c300 con 0x7fc548103ff0 2024-09-11T23:16:34.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:34.478+0000 7fc53ea00640 1 -- 172.21.15.37:0/3948041022 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+24201 (secure 0 0 0) 0x7fc5380bbca0 con 0x7fc548103ff0 2024-09-11T23:16:34.480 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:16:34.480 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":91,"fsid":"8b03efce-7092-11ef-bcea-c7b262605968","created":"2024-09-11T23:07:59.386838+0000","modified":"2024-09-11T23:16:27.737531+0000","last_up_change":"2024-09-11T23:15:16.985748+0000","last_in_change":"2024-09-11T23:14:54.154116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:11:16.547642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:16:11.075859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T23:16:14.019910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-11T23:16:22.041463+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f76ccb11-fe3b-4df1-9a71-e6ca50de80e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1678472768},{"type":"v1","addr":"172.21.15.37:6803","nonce":1678472768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1678472768},{"type":"v1","addr":"172.21.15.37:6805","nonce":1678472768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1678472768},{"type":"v1","addr":"172.21.15.37:6809","nonce":1678472768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1678472768},{"type":"v1","addr":"172.21.15.37:6807","nonce":1678472768}]},"public_addr":"172.21.15.37:6803/1678472768","cluster_addr":"172.21.15.37:6805/1678472768","heartbeat_back_addr":"172.21.15.37:6809/1678472768","heartbeat_front_addr":"172.21.15.37:6807/1678472768","state":["exists","up"]},{"osd":1,"uuid":"13d26eed-1160-4b15-b66b-66c89066c66f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":141504725},{"type":"v1","addr":"172.21.15.123:6801","nonce":141504725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":141504725},{"type":"v1","addr":"172.21.15.123:6803","nonce":141504725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":141504725},{"type":"v1","addr":"172.21.15.123:6807","nonce":141504725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":141504725},{"type":"v1","addr":"172.21.15.123:6805","nonce":141504725}]},"public_addr":"172.21.15.123:6801/141504725","cluster_addr":"172.21.15.123:6803/141504725","heartbeat_back_addr":"172.21.15.123:6807/141504725","heartbeat_front_addr":"172.21.15.123:6805/141504725","state":["exists","up"]},{"osd":2,"uuid":"53daf4d5-2a43-4a89-bae9-f32b89b517f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":1866489133},{"type":"v1","addr":"172.21.15.160:6801","nonce":1866489133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":1866489133},{"type":"v1","addr":"172.21.15.160:6803","nonce":1866489133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":1866489133},{"type":"v1","addr":"172.21.15.160:6807","nonce":1866489133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":1866489133},{"type":"v1","addr":"172.21.15.160:6805","nonce":1866489133}]},"public_addr":"172.21.15.160:6801/1866489133","cluster_addr":"172.21.15.160:6803/1866489133","heartbeat_back_addr":"172.21.15.160:6807/1866489133","heartbeat_front_addr":"172.21.15.160:6805/1866489133","state":["exists","up"]},{"osd":3,"uuid":"7c819225-964b-44f2-93e5-1d7585eb0b36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":412656036},{"type":"v1","addr":"172.21.15.37:6811","nonce":412656036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":412656036},{"type":"v1","addr":"172.21.15.37:6813","nonce":412656036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":412656036},{"type":"v1","addr":"172.21.15.37:6817","nonce":412656036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":412656036},{"type":"v1","addr":"172.21.15.37:6815","nonce":412656036}]},"public_addr":"172.21.15.37:6811/412656036","cluster_addr":"172.21.15.37:6813/412656036","heartbeat_back_addr":"172.21.15.37:6817/412656036","heartbeat_front_addr":"172.21.15.37:6815/412656036","state":["exists","up"]},{"osd":4,"uuid":"e5ab5638-8c7e-4433-8dd0-ba57e28f39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":3228822066},{"type":"v1","addr":"172.21.15.123:6809","nonce":3228822066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":3228822066},{"type":"v1","addr":"172.21.15.123:6811","nonce":3228822066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":3228822066},{"type":"v1","addr":"172.21.15.123:6815","nonce":3228822066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":3228822066},{"type":"v1","addr":"172.21.15.123:6813","nonce":3228822066}]},"public_addr":"172.21.15.123:6809/3228822066","cluster_addr":"172.21.15.123:6811/3228822066","heartbeat_back_addr":"172.21.15.123:6815/3228822066","heartbeat_front_addr":"172.21.15.123:6813/3228822066","state":["exists","up"]},{"osd":5,"uuid":"7f080d49-eec8-4cd9-b410-b2e84139292e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":1618319675},{"type":"v1","addr":"172.21.15.160:6809","nonce":1618319675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":1618319675},{"type":"v1","addr":"172.21.15.160:6811","nonce":1618319675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":1618319675},{"type":"v1","addr":"172.21.15.160:6815","nonce":1618319675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":1618319675},{"type":"v1","addr":"172.21.15.160:6813","nonce":1618319675}]},"public_addr":"172.21.15.160:6809/1618319675","cluster_addr":"172.21.15.160:6811/1618319675","heartbeat_back_addr":"172.21.15.160:6815/1618319675","heartbeat_front_addr":"172.21.15.160:6813/1618319675","state":["exists","up"]},{"osd":6,"uuid":"d0881c4e-bd8d-4575-8c81-94d21825c227","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3541251299},{"type":"v1","addr":"172.21.15.37:6819","nonce":3541251299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3541251299},{"type":"v1","addr":"172.21.15.37:6821","nonce":3541251299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":3541251299},{"type":"v1","addr":"172.21.15.37:6825","nonce":3541251299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3541251299},{"type":"v1","addr":"172.21.15.37:6823","nonce":3541251299}]},"public_addr":"172.21.15.37:6819/3541251299","cluster_addr":"172.21.15.37:6821/3541251299","heartbeat_back_addr":"172.21.15.37:6825/3541251299","heartbeat_front_addr":"172.21.15.37:6823/3541251299","state":["exists","up"]},{"osd":7,"uuid":"04fbec2e-91b5-4a89-a4a3-472398c45288","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":4279933341},{"type":"v1","addr":"172.21.15.123:6817","nonce":4279933341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":4279933341},{"type":"v1","addr":"172.21.15.123:6819","nonce":4279933341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":4279933341},{"type":"v1","addr":"172.21.15.123:6823","nonce":4279933341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":4279933341},{"type":"v1","addr":"172.21.15.123:6821","nonce":4279933341}]},"public_addr":"172.21.15.123:6817/4279933341","cluster_addr":"172.21.15.123:6819/4279933341","heartbeat_back_addr":"172.21.15.123:6823/4279933341","heartbeat_front_addr":"172.21.15.123:6821/4279933341","state":["exists","up"]},{"osd":8,"uuid":"c77090a7-308e-4c6d-a56e-ce6f8e050ae5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":740968584},{"type":"v1","addr":"172.21.15.160:6817","nonce":740968584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":740968584},{"type":"v1","addr":"172.21.15.160:6819","nonce":740968584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":740968584},{"type":"v1","addr":"172.21.15.160:6823","nonce":740968584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":740968584},{"type":"v1","addr":"172.21.15.160:6821","nonce":740968584}]},"public_addr":"172.21.15.160:6817/740968584","cluster_addr":"172.21.15.160:6819/740968584","heartbeat_back_addr":"172.21.15.160:6823/740968584","heartbeat_front_addr":"172.21.15.160:6821/740968584","state":["exists","up"]},{"osd":9,"uuid":"bcd19bd4-88bc-46f7-b48c-af9e3d17aa96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":692114850},{"type":"v1","addr":"172.21.15.37:6827","nonce":692114850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":692114850},{"type":"v1","addr":"172.21.15.37:6829","nonce":692114850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":692114850},{"type":"v1","addr":"172.21.15.37:6833","nonce":692114850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":692114850},{"type":"v1","addr":"172.21.15.37:6831","nonce":692114850}]},"public_addr":"172.21.15.37:6827/692114850","cluster_addr":"172.21.15.37:6829/692114850","heartbeat_back_addr":"172.21.15.37:6833/692114850","heartbeat_front_addr":"172.21.15.37:6831/692114850","state":["exists","up"]},{"osd":10,"uuid":"9e956e6c-c28a-4a4c-b385-c458788858ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":471058996},{"type":"v1","addr":"172.21.15.123:6825","nonce":471058996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":471058996},{"type":"v1","addr":"172.21.15.123:6827","nonce":471058996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":471058996},{"type":"v1","addr":"172.21.15.123:6831","nonce":471058996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":471058996},{"type":"v1","addr":"172.21.15.123:6829","nonce":471058996}]},"public_addr":"172.21.15.123:6825/471058996","cluster_addr":"172.21.15.123:6827/471058996","heartbeat_back_addr":"172.21.15.123:6831/471058996","heartbeat_front_addr":"172.21.15.123:6829/471058996","state":["exists","up"]},{"osd":11,"uuid":"0b5b3364-9a40-4cab-90d4-b7b1cba57bc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":3982315018},{"type":"v1","addr":"172.21.15.160:6825","nonce":3982315018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3982315018},{"type":"v1","addr":"172.21.15.160:6827","nonce":3982315018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3982315018},{"type":"v1","addr":"172.21.15.160:6831","nonce":3982315018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3982315018},{"type":"v1","addr":"172.21.15.160:6829","nonce":3982315018}]},"public_addr":"172.21.15.160:6825/3982315018","cluster_addr":"172.21.15.160:6827/3982315018","heartbeat_back_addr":"172.21.15.160:6831/3982315018","heartbeat_front_addr":"172.21.15.160:6829/3982315018","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:10:21.139833+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:10:47.004960+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:11:11.460263+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:11:40.849286+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:12:06.497448+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:12:32.043206+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:13:01.402019+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:13:27.993489+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:13:52.291643+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:23.840299+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:49.448254+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:15:15.310947+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:6801/2886800769":"2024-09-12T23:08:51.934167+0000","172.21.15.37:0/1811301224":"2024-09-12T23:08:51.934167+0000","172.21.15.37:0/513883980":"2024-09-12T23:08:51.934167+0000","172.21.15.37:0/3698260188":"2024-09-12T23:08:23.793913+0000","172.21.15.37:6800/2886800769":"2024-09-12T23:08:51.934167+0000","172.21.15.37:0/4134736061":"2024-09-12T23:08:23.793913+0000","172.21.15.37:0/3426758476":"2024-09-12T23:08:51.934167+0000","172.21.15.37:0/2545840561":"2024-09-12T23:08:23.793913+0000","172.21.15.37:6801/3447426643":"2024-09-12T23:08:23.793913+0000","172.21.15.37:6800/3447426643":"2024-09-12T23:08:23.793913+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:16:34.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:34.482+0000 7fc54d200640 1 -- 172.21.15.37:0/3948041022 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fc52c0a2b80 msgr2=0x7fc52c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:34.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:34.482+0000 7fc54d200640 1 --2- 172.21.15.37:0/3948041022 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fc52c0a2b80 0x7fc52c0a5040 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc5480ffeb0 tx=0x7fc534005f90 comp rx=0 tx=0).stop 2024-09-11T23:16:34.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:34.482+0000 7fc54d200640 1 -- 172.21.15.37:0/3948041022 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc548103ff0 msgr2=0x7fc54819a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:34.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:34.482+0000 7fc54d200640 1 --2- 172.21.15.37:0/3948041022 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc548103ff0 0x7fc54819a5f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc538006010 tx=0x7fc538004040 comp rx=0 tx=0).stop 2024-09-11T23:16:34.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:34.482+0000 7fc54d200640 1 -- 172.21.15.37:0/3948041022 shutdown_connections 2024-09-11T23:16:34.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:34.482+0000 7fc54d200640 1 --2- 172.21.15.37:0/3948041022 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fc52c0a2b80 0x7fc52c0a5040 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:34.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:34.482+0000 7fc54d200640 1 --2- 172.21.15.37:0/3948041022 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc548109120 0x7fc54819eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:34.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:34.482+0000 7fc54d200640 1 --2- 172.21.15.37:0/3948041022 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc5481049a0 0x7fc54819ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:34.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:34.482+0000 7fc54d200640 1 --2- 172.21.15.37:0/3948041022 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc548103ff0 0x7fc54819a5f0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:34.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:34.482+0000 7fc54d200640 1 -- 172.21.15.37:0/3948041022 >> 172.21.15.37:0/3948041022 conn(0x7fc5480ffa90 msgr2=0x7fc548100e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:34.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:34.482+0000 7fc54d200640 1 -- 172.21.15.37:0/3948041022 shutdown_connections 2024-09-11T23:16:34.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:34.482+0000 7fc54d200640 1 -- 172.21.15.37:0/3948041022 wait complete. 2024-09-11T23:16:34.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:34 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/3948041022' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:16:34.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:34 smithi160 ceph-mon[35055]: from='client.? 172.21.15.37:0/3948041022' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:16:35.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:34 smithi123 ceph-mon[35438]: from='client.? 172.21.15.37:0/3948041022' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:16:35.336 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T23:16:35.717 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:16:35.876 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:35 smithi037 ceph-mon[30630]: pgmap v312: 129 pgs: 129 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:16:35.902 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:35 smithi123 ceph-mon[35438]: pgmap v312: 129 pgs: 129 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:16:35.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:35 smithi160 ceph-mon[35055]: pgmap v312: 129 pgs: 129 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:16:36.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:36.239+0000 7fe736c00640 1 -- 172.21.15.37:0/4192982631 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe730101de0 msgr2=0x7fe7301021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:36.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:36.239+0000 7fe736c00640 1 --2- 172.21.15.37:0/4192982631 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe730101de0 0x7fe7301021c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe720009900 tx=0x7fe72002a410 comp rx=0 tx=0).stop 2024-09-11T23:16:36.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:36.239+0000 7fe736c00640 1 -- 172.21.15.37:0/4192982631 shutdown_connections 2024-09-11T23:16:36.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:36.239+0000 7fe736c00640 1 --2- 172.21.15.37:0/4192982631 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe730106f10 0x7fe73010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:36.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:36.239+0000 7fe736c00640 1 --2- 172.21.15.37:0/4192982631 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe730102790 0x7fe7301067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:36.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:36.239+0000 7fe736c00640 1 --2- 172.21.15.37:0/4192982631 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe730101de0 0x7fe7301021c0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:36.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:36.239+0000 7fe736c00640 1 -- 172.21.15.37:0/4192982631 >> 172.21.15.37:0/4192982631 conn(0x7fe7300fd8c0 msgr2=0x7fe7300ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:36.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:36.239+0000 7fe736c00640 1 -- 172.21.15.37:0/4192982631 shutdown_connections 2024-09-11T23:16:36.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:36.239+0000 7fe736c00640 1 -- 172.21.15.37:0/4192982631 wait complete. 2024-09-11T23:16:36.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:36.240+0000 7fe736c00640 1 Processor -- start 2024-09-11T23:16:36.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:36.240+0000 7fe736c00640 1 -- start start 2024-09-11T23:16:36.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:36.241+0000 7fe736c00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe730101de0 0x7fe730198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:36.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:36.241+0000 7fe736c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe730102790 0x7fe7301988c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:36.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:36.241+0000 7fe736c00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe730106f10 0x7fe73019cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:36.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:36.241+0000 7fe736c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe730111f80 con 0x7fe730102790 2024-09-11T23:16:36.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:36.241+0000 7fe736c00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe730111e00 con 0x7fe730106f10 2024-09-11T23:16:36.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:36.241+0000 7fe736c00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fe730112100 con 0x7fe730101de0 2024-09-11T23:16:36.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:36.241+0000 7fe72fe00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe730101de0 0x7fe730198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:36.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:36.241+0000 7fe727e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe730102790 0x7fe7301988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:36.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:36.241+0000 7fe72fe00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe730101de0 0x7fe730198380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.37:47362/0 (socket says 172.21.15.37:47362) 2024-09-11T23:16:36.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:36.241+0000 7fe72fe00640 1 -- 172.21.15.37:0/2574736555 learned_addr learned my addr 172.21.15.37:0/2574736555 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:16:36.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:36.241+0000 7fe734c00640 1 --2- 172.21.15.37:0/2574736555 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe730106f10 0x7fe73019cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:36.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:36.242+0000 7fe727e00640 1 -- 172.21.15.37:0/2574736555 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe730101de0 msgr2=0x7fe730198380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:36.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:36.242+0000 7fe727e00640 1 --2- 172.21.15.37:0/2574736555 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe730101de0 0x7fe730198380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:36.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:36.242+0000 7fe727e00640 1 -- 172.21.15.37:0/2574736555 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe730106f10 msgr2=0x7fe73019cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:36.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:36.242+0000 7fe727e00640 1 --2- 172.21.15.37:0/2574736555 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe730106f10 0x7fe73019cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:36.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:36.242+0000 7fe727e00640 1 -- 172.21.15.37:0/2574736555 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe73019d330 con 0x7fe730102790 2024-09-11T23:16:36.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:36.242+0000 7fe72fe00640 1 --2- 172.21.15.37:0/2574736555 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe730101de0 0x7fe730198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:16:36.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:36.242+0000 7fe734c00640 1 --2- 172.21.15.37:0/2574736555 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe730106f10 0x7fe73019cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:16:36.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:36.242+0000 7fe727e00640 1 --2- 172.21.15.37:0/2574736555 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe730102790 0x7fe7301988c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe71800d6d0 tx=0x7fe71800db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:36.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:36.242+0000 7fe72d600640 1 -- 172.21.15.37:0/2574736555 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe718017070 con 0x7fe730102790 2024-09-11T23:16:36.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:36.242+0000 7fe72d600640 1 -- 172.21.15.37:0/2574736555 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe718009820 con 0x7fe730102790 2024-09-11T23:16:36.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:36.242+0000 7fe736c00640 1 -- 172.21.15.37:0/2574736555 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe73019d620 con 0x7fe730102790 2024-09-11T23:16:36.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:36.242+0000 7fe72d600640 1 -- 172.21.15.37:0/2574736555 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe718004d00 con 0x7fe730102790 2024-09-11T23:16:36.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:36.242+0000 7fe736c00640 1 -- 172.21.15.37:0/2574736555 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe730074420 con 0x7fe730102790 2024-09-11T23:16:36.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:36.244+0000 7fe736c00640 1 -- 172.21.15.37:0/2574736555 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7301021c0 con 0x7fe730102790 2024-09-11T23:16:36.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:36.246+0000 7fe72d600640 1 -- 172.21.15.37:0/2574736555 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fe7180099d0 con 0x7fe730102790 2024-09-11T23:16:36.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:36.247+0000 7fe72d600640 1 --2- 172.21.15.37:0/2574736555 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fe7140a2bc0 0x7fe7140a5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:36.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:36.247+0000 7fe72d600640 1 -- 172.21.15.37:0/2574736555 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8802+0+0 (secure 0 0 0) 0x7fe7180ceeb0 con 0x7fe730102790 2024-09-11T23:16:36.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:36.247+0000 7fe72fe00640 1 --2- 172.21.15.37:0/2574736555 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fe7140a2bc0 0x7fe7140a5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:36.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:36.248+0000 7fe72fe00640 1 --2- 172.21.15.37:0/2574736555 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fe7140a2bc0 0x7fe7140a5080 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe720031550 tx=0x7fe7200046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:36.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:36.251+0000 7fe72d600640 1 -- 172.21.15.37:0/2574736555 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe71809bb70 con 0x7fe730102790 2024-09-11T23:16:36.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:36.474+0000 7fe736c00640 1 -- 172.21.15.37:0/2574736555 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe73010a120 con 0x7fe730102790 2024-09-11T23:16:36.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:36.475+0000 7fe72d600640 1 -- 172.21.15.37:0/2574736555 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+11851 (secure 0 0 0) 0x7fe71809b470 con 0x7fe730102790 2024-09-11T23:16:36.476 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:16:36.477 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":17,"btime":"2024-09-11T23:16:28:545124+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14448,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/285120996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":285120996},{"type":"v1","addr":"172.21.15.37:6835","nonce":285120996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14460,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/3095283029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":3095283029},{"type":"v1","addr":"172.21.15.37:6837","nonce":3095283029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/1072030582","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":1072030582},{"type":"v1","addr":"172.21.15.37:6839","nonce":1072030582}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6841/209927476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":209927476},{"type":"v1","addr":"172.21.15.37:6841","nonce":209927476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24440,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/3380294842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":3380294842},{"type":"v1","addr":"172.21.15.123:6833","nonce":3380294842}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/1918127245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":1918127245},{"type":"v1","addr":"172.21.15.160:6833","nonce":1918127245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24476,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/3928690501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":3928690501},{"type":"v1","addr":"172.21.15.123:6835","nonce":3928690501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24493,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/2316897035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":2316897035},{"type":"v1","addr":"172.21.15.160:6835","nonce":2316897035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24497,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/2168535476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":2168535476},{"type":"v1","addr":"172.21.15.123:6837","nonce":2168535476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24499,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6837/2906597021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":2906597021},{"type":"v1","addr":"172.21.15.160:6837","nonce":2906597021}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24520,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6839/2041625862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":2041625862},{"type":"v1","addr":"172.21.15.160:6839","nonce":2041625862}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:16:16.642956+0000","modified":"2024-09-11T23:16:27.737708+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24533},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24533":{"gid":24533,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.123:6839/3077076065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6838","nonce":3077076065},{"type":"v1","addr":"172.21.15.123:6839","nonce":3077076065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24533,"qdb_cluster":[24533]},"id":1}]} 2024-09-11T23:16:36.477 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 17 2024-09-11T23:16:36.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:36.477+0000 7fe736c00640 1 -- 172.21.15.37:0/2574736555 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fe7140a2bc0 msgr2=0x7fe7140a5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:36.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:36.477+0000 7fe736c00640 1 --2- 172.21.15.37:0/2574736555 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fe7140a2bc0 0x7fe7140a5080 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe720031550 tx=0x7fe7200046c0 comp rx=0 tx=0).stop 2024-09-11T23:16:36.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:36.477+0000 7fe736c00640 1 -- 172.21.15.37:0/2574736555 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe730102790 msgr2=0x7fe7301988c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:36.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:36.477+0000 7fe736c00640 1 --2- 172.21.15.37:0/2574736555 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe730102790 0x7fe7301988c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe71800d6d0 tx=0x7fe71800db90 comp rx=0 tx=0).stop 2024-09-11T23:16:36.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:36.478+0000 7fe736c00640 1 -- 172.21.15.37:0/2574736555 shutdown_connections 2024-09-11T23:16:36.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:36.478+0000 7fe736c00640 1 --2- 172.21.15.37:0/2574736555 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fe7140a2bc0 0x7fe7140a5080 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:36.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:36.478+0000 7fe736c00640 1 --2- 172.21.15.37:0/2574736555 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe730106f10 0x7fe73019cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:36.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:36.478+0000 7fe736c00640 1 --2- 172.21.15.37:0/2574736555 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe730102790 0x7fe7301988c0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:36.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:36.478+0000 7fe736c00640 1 --2- 172.21.15.37:0/2574736555 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe730101de0 0x7fe730198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:36.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:36.478+0000 7fe736c00640 1 -- 172.21.15.37:0/2574736555 >> 172.21.15.37:0/2574736555 conn(0x7fe7300fd8c0 msgr2=0x7fe7300feca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:36.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:36.478+0000 7fe736c00640 1 -- 172.21.15.37:0/2574736555 shutdown_connections 2024-09-11T23:16:36.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:36.478+0000 7fe736c00640 1 -- 172.21.15.37:0/2574736555 wait complete. 2024-09-11T23:16:36.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:36 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/2574736555' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:16:36.920 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:36 smithi123 ceph-mon[35438]: from='client.? 172.21.15.37:0/2574736555' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:16:36.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:36 smithi160 ceph-mon[35055]: from='client.? 172.21.15.37:0/2574736555' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:16:37.492 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T23:16:37.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:37 smithi037 ceph-mon[30630]: pgmap v313: 129 pgs: 129 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:16:37.871 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:16:37.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:37 smithi160 ceph-mon[35055]: pgmap v313: 129 pgs: 129 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:16:38.000 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:37 smithi123 ceph-mon[35438]: pgmap v313: 129 pgs: 129 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:16:38.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:38.466+0000 7fdb72400640 1 -- 172.21.15.37:0/1359124274 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb6c101de0 msgr2=0x7fdb6c1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:38.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:38.466+0000 7fdb72400640 1 --2- 172.21.15.37:0/1359124274 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb6c101de0 0x7fdb6c1021c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c009900 tx=0x7fdb5c02a410 comp rx=0 tx=0).stop 2024-09-11T23:16:38.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:38.466+0000 7fdb72400640 1 -- 172.21.15.37:0/1359124274 shutdown_connections 2024-09-11T23:16:38.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:38.466+0000 7fdb72400640 1 --2- 172.21.15.37:0/1359124274 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdb6c106f10 0x7fdb6c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:38.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:38.466+0000 7fdb72400640 1 --2- 172.21.15.37:0/1359124274 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdb6c102790 0x7fdb6c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:38.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:38.466+0000 7fdb72400640 1 --2- 172.21.15.37:0/1359124274 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb6c101de0 0x7fdb6c1021c0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:38.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:38.466+0000 7fdb72400640 1 -- 172.21.15.37:0/1359124274 >> 172.21.15.37:0/1359124274 conn(0x7fdb6c0fd8c0 msgr2=0x7fdb6c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:38.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:38.466+0000 7fdb72400640 1 -- 172.21.15.37:0/1359124274 shutdown_connections 2024-09-11T23:16:38.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:38.466+0000 7fdb72400640 1 -- 172.21.15.37:0/1359124274 wait complete. 2024-09-11T23:16:38.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:38.468+0000 7fdb72400640 1 Processor -- start 2024-09-11T23:16:38.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:38.468+0000 7fdb72400640 1 -- start start 2024-09-11T23:16:38.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:38.468+0000 7fdb72400640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdb6c101de0 0x7fdb6c198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:38.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:38.468+0000 7fdb72400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdb6c102790 0x7fdb6c198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:38.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:38.468+0000 7fdb72400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb6c106f10 0x7fdb6c19cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:38.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:38.468+0000 7fdb72400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fdb6c111fc0 con 0x7fdb6c106f10 2024-09-11T23:16:38.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:38.468+0000 7fdb72400640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fdb6c111e40 con 0x7fdb6c102790 2024-09-11T23:16:38.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:38.468+0000 7fdb72400640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fdb6c112140 con 0x7fdb6c101de0 2024-09-11T23:16:38.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:38.469+0000 7fdb6be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb6c106f10 0x7fdb6c19cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:38.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:38.469+0000 7fdb6be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb6c106f10 0x7fdb6c19cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34238/0 (socket says 172.21.15.37:34238) 2024-09-11T23:16:38.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:38.469+0000 7fdb6be00640 1 -- 172.21.15.37:0/436487441 learned_addr learned my addr 172.21.15.37:0/436487441 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:16:38.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:38.469+0000 7fdb62a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdb6c102790 0x7fdb6c198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:38.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:38.469+0000 7fdb6b400640 1 --2- 172.21.15.37:0/436487441 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdb6c101de0 0x7fdb6c198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:38.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:38.469+0000 7fdb62a00640 1 -- 172.21.15.37:0/436487441 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdb6c101de0 msgr2=0x7fdb6c198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:38.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:38.469+0000 7fdb62a00640 1 --2- 172.21.15.37:0/436487441 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdb6c101de0 0x7fdb6c198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:38.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:38.469+0000 7fdb62a00640 1 -- 172.21.15.37:0/436487441 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb6c106f10 msgr2=0x7fdb6c19cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:38.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:38.469+0000 7fdb62a00640 1 --2- 172.21.15.37:0/436487441 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb6c106f10 0x7fdb6c19cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:38.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:38.469+0000 7fdb62a00640 1 -- 172.21.15.37:0/436487441 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb6c19d3f0 con 0x7fdb6c102790 2024-09-11T23:16:38.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:38.469+0000 7fdb62a00640 1 --2- 172.21.15.37:0/436487441 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdb6c102790 0x7fdb6c198980 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fdb5400d720 tx=0x7fdb5400dbe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:38.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:38.470+0000 7fdb68c00640 1 -- 172.21.15.37:0/436487441 <== mon.2 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb54017070 con 0x7fdb6c102790 2024-09-11T23:16:38.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:38.470+0000 7fdb72400640 1 -- 172.21.15.37:0/436487441 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb6c19d6e0 con 0x7fdb6c102790 2024-09-11T23:16:38.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:38.470+0000 7fdb68c00640 1 -- 172.21.15.37:0/436487441 <== mon.2 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdb5400de30 con 0x7fdb6c102790 2024-09-11T23:16:38.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:38.470+0000 7fdb68c00640 1 -- 172.21.15.37:0/436487441 <== mon.2 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb540047a0 con 0x7fdb6c102790 2024-09-11T23:16:38.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:38.470+0000 7fdb72400640 1 -- 172.21.15.37:0/436487441 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb6c074420 con 0x7fdb6c102790 2024-09-11T23:16:38.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:38.471+0000 7fdb72400640 1 -- 172.21.15.37:0/436487441 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb6c1032c0 con 0x7fdb6c102790 2024-09-11T23:16:38.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:38.473+0000 7fdb68c00640 1 -- 172.21.15.37:0/436487441 <== mon.2 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fdb540099d0 con 0x7fdb6c102790 2024-09-11T23:16:38.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:38.475+0000 7fdb68c00640 1 --2- 172.21.15.37:0/436487441 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fdb500a2b80 0x7fdb500a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:38.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:38.475+0000 7fdb68c00640 1 -- 172.21.15.37:0/436487441 <== mon.2 v2:172.21.15.123:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8802+0+0 (secure 0 0 0) 0x7fdb540ceec0 con 0x7fdb6c102790 2024-09-11T23:16:38.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:38.475+0000 7fdb6b400640 1 --2- 172.21.15.37:0/436487441 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fdb500a2b80 0x7fdb500a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:38.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:38.476+0000 7fdb6b400640 1 --2- 172.21.15.37:0/436487441 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fdb500a2b80 0x7fdb500a5040 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c000c00 tx=0x7fdb5c005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:38.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:38.479+0000 7fdb68c00640 1 -- 172.21.15.37:0/436487441 <== mon.2 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdb54020020 con 0x7fdb6c102790 2024-09-11T23:16:38.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:38.664+0000 7fdb72400640 1 -- 172.21.15.37:0/436487441 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdb6c10a0f0 con 0x7fdb6c102790 2024-09-11T23:16:38.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:38.665+0000 7fdb68c00640 1 -- 172.21.15.37:0/436487441 <== mon.2 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+24201 (secure 0 0 0) 0x7fdb5409bb80 con 0x7fdb6c102790 2024-09-11T23:16:38.667 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:16:38.667 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":91,"fsid":"8b03efce-7092-11ef-bcea-c7b262605968","created":"2024-09-11T23:07:59.386838+0000","modified":"2024-09-11T23:16:27.737531+0000","last_up_change":"2024-09-11T23:15:16.985748+0000","last_in_change":"2024-09-11T23:14:54.154116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:11:16.547642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:16:11.075859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T23:16:14.019910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-11T23:16:22.041463+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f76ccb11-fe3b-4df1-9a71-e6ca50de80e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1678472768},{"type":"v1","addr":"172.21.15.37:6803","nonce":1678472768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1678472768},{"type":"v1","addr":"172.21.15.37:6805","nonce":1678472768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1678472768},{"type":"v1","addr":"172.21.15.37:6809","nonce":1678472768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1678472768},{"type":"v1","addr":"172.21.15.37:6807","nonce":1678472768}]},"public_addr":"172.21.15.37:6803/1678472768","cluster_addr":"172.21.15.37:6805/1678472768","heartbeat_back_addr":"172.21.15.37:6809/1678472768","heartbeat_front_addr":"172.21.15.37:6807/1678472768","state":["exists","up"]},{"osd":1,"uuid":"13d26eed-1160-4b15-b66b-66c89066c66f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":141504725},{"type":"v1","addr":"172.21.15.123:6801","nonce":141504725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":141504725},{"type":"v1","addr":"172.21.15.123:6803","nonce":141504725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":141504725},{"type":"v1","addr":"172.21.15.123:6807","nonce":141504725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":141504725},{"type":"v1","addr":"172.21.15.123:6805","nonce":141504725}]},"public_addr":"172.21.15.123:6801/141504725","cluster_addr":"172.21.15.123:6803/141504725","heartbeat_back_addr":"172.21.15.123:6807/141504725","heartbeat_front_addr":"172.21.15.123:6805/141504725","state":["exists","up"]},{"osd":2,"uuid":"53daf4d5-2a43-4a89-bae9-f32b89b517f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":1866489133},{"type":"v1","addr":"172.21.15.160:6801","nonce":1866489133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":1866489133},{"type":"v1","addr":"172.21.15.160:6803","nonce":1866489133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":1866489133},{"type":"v1","addr":"172.21.15.160:6807","nonce":1866489133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":1866489133},{"type":"v1","addr":"172.21.15.160:6805","nonce":1866489133}]},"public_addr":"172.21.15.160:6801/1866489133","cluster_addr":"172.21.15.160:6803/1866489133","heartbeat_back_addr":"172.21.15.160:6807/1866489133","heartbeat_front_addr":"172.21.15.160:6805/1866489133","state":["exists","up"]},{"osd":3,"uuid":"7c819225-964b-44f2-93e5-1d7585eb0b36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":412656036},{"type":"v1","addr":"172.21.15.37:6811","nonce":412656036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":412656036},{"type":"v1","addr":"172.21.15.37:6813","nonce":412656036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":412656036},{"type":"v1","addr":"172.21.15.37:6817","nonce":412656036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":412656036},{"type":"v1","addr":"172.21.15.37:6815","nonce":412656036}]},"public_addr":"172.21.15.37:6811/412656036","cluster_addr":"172.21.15.37:6813/412656036","heartbeat_back_addr":"172.21.15.37:6817/412656036","heartbeat_front_addr":"172.21.15.37:6815/412656036","state":["exists","up"]},{"osd":4,"uuid":"e5ab5638-8c7e-4433-8dd0-ba57e28f39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":3228822066},{"type":"v1","addr":"172.21.15.123:6809","nonce":3228822066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":3228822066},{"type":"v1","addr":"172.21.15.123:6811","nonce":3228822066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":3228822066},{"type":"v1","addr":"172.21.15.123:6815","nonce":3228822066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":3228822066},{"type":"v1","addr":"172.21.15.123:6813","nonce":3228822066}]},"public_addr":"172.21.15.123:6809/3228822066","cluster_addr":"172.21.15.123:6811/3228822066","heartbeat_back_addr":"172.21.15.123:6815/3228822066","heartbeat_front_addr":"172.21.15.123:6813/3228822066","state":["exists","up"]},{"osd":5,"uuid":"7f080d49-eec8-4cd9-b410-b2e84139292e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":1618319675},{"type":"v1","addr":"172.21.15.160:6809","nonce":1618319675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":1618319675},{"type":"v1","addr":"172.21.15.160:6811","nonce":1618319675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":1618319675},{"type":"v1","addr":"172.21.15.160:6815","nonce":1618319675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":1618319675},{"type":"v1","addr":"172.21.15.160:6813","nonce":1618319675}]},"public_addr":"172.21.15.160:6809/1618319675","cluster_addr":"172.21.15.160:6811/1618319675","heartbeat_back_addr":"172.21.15.160:6815/1618319675","heartbeat_front_addr":"172.21.15.160:6813/1618319675","state":["exists","up"]},{"osd":6,"uuid":"d0881c4e-bd8d-4575-8c81-94d21825c227","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3541251299},{"type":"v1","addr":"172.21.15.37:6819","nonce":3541251299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3541251299},{"type":"v1","addr":"172.21.15.37:6821","nonce":3541251299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":3541251299},{"type":"v1","addr":"172.21.15.37:6825","nonce":3541251299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3541251299},{"type":"v1","addr":"172.21.15.37:6823","nonce":3541251299}]},"public_addr":"172.21.15.37:6819/3541251299","cluster_addr":"172.21.15.37:6821/3541251299","heartbeat_back_addr":"172.21.15.37:6825/3541251299","heartbeat_front_addr":"172.21.15.37:6823/3541251299","state":["exists","up"]},{"osd":7,"uuid":"04fbec2e-91b5-4a89-a4a3-472398c45288","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":4279933341},{"type":"v1","addr":"172.21.15.123:6817","nonce":4279933341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":4279933341},{"type":"v1","addr":"172.21.15.123:6819","nonce":4279933341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":4279933341},{"type":"v1","addr":"172.21.15.123:6823","nonce":4279933341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":4279933341},{"type":"v1","addr":"172.21.15.123:6821","nonce":4279933341}]},"public_addr":"172.21.15.123:6817/4279933341","cluster_addr":"172.21.15.123:6819/4279933341","heartbeat_back_addr":"172.21.15.123:6823/4279933341","heartbeat_front_addr":"172.21.15.123:6821/4279933341","state":["exists","up"]},{"osd":8,"uuid":"c77090a7-308e-4c6d-a56e-ce6f8e050ae5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":740968584},{"type":"v1","addr":"172.21.15.160:6817","nonce":740968584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":740968584},{"type":"v1","addr":"172.21.15.160:6819","nonce":740968584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":740968584},{"type":"v1","addr":"172.21.15.160:6823","nonce":740968584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":740968584},{"type":"v1","addr":"172.21.15.160:6821","nonce":740968584}]},"public_addr":"172.21.15.160:6817/740968584","cluster_addr":"172.21.15.160:6819/740968584","heartbeat_back_addr":"172.21.15.160:6823/740968584","heartbeat_front_addr":"172.21.15.160:6821/740968584","state":["exists","up"]},{"osd":9,"uuid":"bcd19bd4-88bc-46f7-b48c-af9e3d17aa96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":692114850},{"type":"v1","addr":"172.21.15.37:6827","nonce":692114850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":692114850},{"type":"v1","addr":"172.21.15.37:6829","nonce":692114850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":692114850},{"type":"v1","addr":"172.21.15.37:6833","nonce":692114850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":692114850},{"type":"v1","addr":"172.21.15.37:6831","nonce":692114850}]},"public_addr":"172.21.15.37:6827/692114850","cluster_addr":"172.21.15.37:6829/692114850","heartbeat_back_addr":"172.21.15.37:6833/692114850","heartbeat_front_addr":"172.21.15.37:6831/692114850","state":["exists","up"]},{"osd":10,"uuid":"9e956e6c-c28a-4a4c-b385-c458788858ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":471058996},{"type":"v1","addr":"172.21.15.123:6825","nonce":471058996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":471058996},{"type":"v1","addr":"172.21.15.123:6827","nonce":471058996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":471058996},{"type":"v1","addr":"172.21.15.123:6831","nonce":471058996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":471058996},{"type":"v1","addr":"172.21.15.123:6829","nonce":471058996}]},"public_addr":"172.21.15.123:6825/471058996","cluster_addr":"172.21.15.123:6827/471058996","heartbeat_back_addr":"172.21.15.123:6831/471058996","heartbeat_front_addr":"172.21.15.123:6829/471058996","state":["exists","up"]},{"osd":11,"uuid":"0b5b3364-9a40-4cab-90d4-b7b1cba57bc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":3982315018},{"type":"v1","addr":"172.21.15.160:6825","nonce":3982315018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3982315018},{"type":"v1","addr":"172.21.15.160:6827","nonce":3982315018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3982315018},{"type":"v1","addr":"172.21.15.160:6831","nonce":3982315018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3982315018},{"type":"v1","addr":"172.21.15.160:6829","nonce":3982315018}]},"public_addr":"172.21.15.160:6825/3982315018","cluster_addr":"172.21.15.160:6827/3982315018","heartbeat_back_addr":"172.21.15.160:6831/3982315018","heartbeat_front_addr":"172.21.15.160:6829/3982315018","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:10:21.139833+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:10:47.004960+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:11:11.460263+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:11:40.849286+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:12:06.497448+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:12:32.043206+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:13:01.402019+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:13:27.993489+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:13:52.291643+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:23.840299+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:49.448254+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:15:15.310947+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:6801/2886800769":"2024-09-12T23:08:51.934167+0000","172.21.15.37:0/1811301224":"2024-09-12T23:08:51.934167+0000","172.21.15.37:0/513883980":"2024-09-12T23:08:51.934167+0000","172.21.15.37:0/3698260188":"2024-09-12T23:08:23.793913+0000","172.21.15.37:6800/2886800769":"2024-09-12T23:08:51.934167+0000","172.21.15.37:0/4134736061":"2024-09-12T23:08:23.793913+0000","172.21.15.37:0/3426758476":"2024-09-12T23:08:51.934167+0000","172.21.15.37:0/2545840561":"2024-09-12T23:08:23.793913+0000","172.21.15.37:6801/3447426643":"2024-09-12T23:08:23.793913+0000","172.21.15.37:6800/3447426643":"2024-09-12T23:08:23.793913+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:16:38.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:38.668+0000 7fdb72400640 1 -- 172.21.15.37:0/436487441 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fdb500a2b80 msgr2=0x7fdb500a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:38.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:38.668+0000 7fdb72400640 1 --2- 172.21.15.37:0/436487441 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fdb500a2b80 0x7fdb500a5040 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c000c00 tx=0x7fdb5c005b50 comp rx=0 tx=0).stop 2024-09-11T23:16:38.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:38.668+0000 7fdb72400640 1 -- 172.21.15.37:0/436487441 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdb6c102790 msgr2=0x7fdb6c198980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:38.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:38.668+0000 7fdb72400640 1 --2- 172.21.15.37:0/436487441 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdb6c102790 0x7fdb6c198980 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fdb5400d720 tx=0x7fdb5400dbe0 comp rx=0 tx=0).stop 2024-09-11T23:16:38.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:38.668+0000 7fdb72400640 1 -- 172.21.15.37:0/436487441 shutdown_connections 2024-09-11T23:16:38.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:38.668+0000 7fdb72400640 1 --2- 172.21.15.37:0/436487441 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fdb500a2b80 0x7fdb500a5040 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:38.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:38.668+0000 7fdb72400640 1 --2- 172.21.15.37:0/436487441 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdb6c102790 0x7fdb6c198980 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:38.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:38.668+0000 7fdb72400640 1 --2- 172.21.15.37:0/436487441 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb6c106f10 0x7fdb6c19cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:38.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:38.668+0000 7fdb72400640 1 --2- 172.21.15.37:0/436487441 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdb6c101de0 0x7fdb6c198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:38.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:38.668+0000 7fdb72400640 1 -- 172.21.15.37:0/436487441 >> 172.21.15.37:0/436487441 conn(0x7fdb6c0fd8c0 msgr2=0x7fdb6c0febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:38.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:38.668+0000 7fdb72400640 1 -- 172.21.15.37:0/436487441 shutdown_connections 2024-09-11T23:16:38.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:38.668+0000 7fdb72400640 1 -- 172.21.15.37:0/436487441 wait complete. 2024-09-11T23:16:39.535 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-11T23:16:16.642956+0000', 'modified': '2024-09-11T23:16:27.737708+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24533}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24533': {'gid': 24533, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.123:6839/3077076065', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.123:6838', 'nonce': 3077076065}, {'type': 'v1', 'addr': '172.21.15.123:6839', 'nonce': 3077076065}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 24533, 'qdb_cluster': [24533]} 2024-09-11T23:16:39.535 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-11T23:16:39.535 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph tell mds.b status 2024-09-11T23:16:39.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:39 smithi037 ceph-mon[30630]: pgmap v314: 129 pgs: 129 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:16:39.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:39 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/436487441' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:16:39.915 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:16:39.936 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:39 smithi160 ceph-mon[35055]: pgmap v314: 129 pgs: 129 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:16:39.937 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:39 smithi160 ceph-mon[35055]: from='client.? 172.21.15.37:0/436487441' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:16:40.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:39 smithi123 ceph-mon[35438]: pgmap v314: 129 pgs: 129 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:16:40.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:39 smithi123 ceph-mon[35438]: from='client.? 172.21.15.37:0/436487441' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:16:40.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.484+0000 7f65b9a00640 1 -- 172.21.15.37:0/2684872151 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65b4076720 msgr2=0x7f65b4076b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:40.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.484+0000 7f65b9a00640 1 --2- 172.21.15.37:0/2684872151 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65b4076720 0x7f65b4076b00 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f65a4009900 tx=0x7f65a402a410 comp rx=0 tx=0).stop 2024-09-11T23:16:40.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.484+0000 7f65b9a00640 1 -- 172.21.15.37:0/2684872151 shutdown_connections 2024-09-11T23:16:40.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.484+0000 7f65b9a00640 1 --2- 172.21.15.37:0/2684872151 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f65b4077040 0x7f65b41124f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:40.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.484+0000 7f65b9a00640 1 --2- 172.21.15.37:0/2684872151 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f65b4112a30 0x7f65b4114e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:40.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.484+0000 7f65b9a00640 1 --2- 172.21.15.37:0/2684872151 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65b4076720 0x7f65b4076b00 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:40.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.484+0000 7f65b9a00640 1 -- 172.21.15.37:0/2684872151 >> 172.21.15.37:0/2684872151 conn(0x7f65b40ffa90 msgr2=0x7f65b4101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:40.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.484+0000 7f65b9a00640 1 -- 172.21.15.37:0/2684872151 shutdown_connections 2024-09-11T23:16:40.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.484+0000 7f65b9a00640 1 -- 172.21.15.37:0/2684872151 wait complete. 2024-09-11T23:16:40.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.485+0000 7f65b9a00640 1 Processor -- start 2024-09-11T23:16:40.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.486+0000 7f65b9a00640 1 -- start start 2024-09-11T23:16:40.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.486+0000 7f65b9a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f65b4076720 0x7f65b41a4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:40.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.486+0000 7f65b9a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65b4077040 0x7f65b41a4c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:40.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.486+0000 7f65b9a00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f65b4112a30 0x7f65b419e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:40.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.486+0000 7f65b9a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f65b4118610 con 0x7f65b4077040 2024-09-11T23:16:40.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.486+0000 7f65b9a00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f65b4118490 con 0x7f65b4076720 2024-09-11T23:16:40.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.486+0000 7f65b9a00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f65b4118790 con 0x7f65b4112a30 2024-09-11T23:16:40.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.486+0000 7f65b2000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65b4077040 0x7f65b41a4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:40.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.486+0000 7f65b2a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f65b4076720 0x7f65b41a4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:40.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.486+0000 7f65b3400640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f65b4112a30 0x7f65b419e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:40.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.487+0000 7f65b2a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f65b4076720 0x7f65b41a4720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.37:41318/0 (socket says 172.21.15.37:41318) 2024-09-11T23:16:40.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.487+0000 7f65b2000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65b4077040 0x7f65b41a4c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46476/0 (socket says 172.21.15.37:46476) 2024-09-11T23:16:40.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.487+0000 7f65b2a00640 1 -- 172.21.15.37:0/2427413282 learned_addr learned my addr 172.21.15.37:0/2427413282 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:16:40.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.487+0000 7f65b3400640 1 -- 172.21.15.37:0/2427413282 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f65b4076720 msgr2=0x7f65b41a4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:40.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.487+0000 7f65b3400640 1 --2- 172.21.15.37:0/2427413282 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f65b4076720 0x7f65b41a4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:40.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.487+0000 7f65b3400640 1 -- 172.21.15.37:0/2427413282 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65b4077040 msgr2=0x7f65b41a4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:40.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.487+0000 7f65b3400640 1 --2- 172.21.15.37:0/2427413282 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65b4077040 0x7f65b41a4c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:40.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.487+0000 7f65b3400640 1 -- 172.21.15.37:0/2427413282 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65b419f010 con 0x7f65b4112a30 2024-09-11T23:16:40.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.487+0000 7f65b3400640 1 --2- 172.21.15.37:0/2427413282 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f65b4112a30 0x7f65b419e8e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f65b407aa10 tx=0x7f65ac00ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:40.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.488+0000 7f65ab400640 1 -- 172.21.15.37:0/2427413282 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65ac00cdf0 con 0x7f65b4112a30 2024-09-11T23:16:40.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.488+0000 7f65b9a00640 1 -- 172.21.15.37:0/2427413282 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65b419f300 con 0x7f65b4112a30 2024-09-11T23:16:40.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.488+0000 7f65ab400640 1 -- 172.21.15.37:0/2427413282 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f65ac005020 con 0x7f65b4112a30 2024-09-11T23:16:40.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.488+0000 7f65ab400640 1 -- 172.21.15.37:0/2427413282 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65ac010690 con 0x7f65b4112a30 2024-09-11T23:16:40.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.488+0000 7f65b9a00640 1 -- 172.21.15.37:0/2427413282 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65b41ab5f0 con 0x7f65b4112a30 2024-09-11T23:16:40.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.491+0000 7f65bc46e740 1 Processor -- start 2024-09-11T23:16:40.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.491+0000 7f65ab400640 1 -- 172.21.15.37:0/2427413282 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f65ac0054d0 con 0x7f65b4112a30 2024-09-11T23:16:40.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.491+0000 7f65bc46e740 1 -- start start 2024-09-11T23:16:40.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.491+0000 7f65bc46e740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ebd8151330 0x55ebd8151710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:40.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.492+0000 7f65bc46e740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ebd8151c50 0x55ebd815bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:40.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.492+0000 7f65bc46e740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ebd815c510 0x55ebd815e900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:40.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.492+0000 7f65bc46e740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ebd80b70b0 con 0x55ebd8151330 2024-09-11T23:16:40.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.492+0000 7f65bc46e740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55ebd805eab0 con 0x55ebd8151c50 2024-09-11T23:16:40.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.492+0000 7f65bc46e740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55ebd80b3070 con 0x55ebd815c510 2024-09-11T23:16:40.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.492+0000 7f65b2000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ebd8151330 0x55ebd8151710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:40.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.492+0000 7f65b2000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ebd8151330 0x55ebd8151710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46482/0 (socket says 172.21.15.37:46482) 2024-09-11T23:16:40.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.492+0000 7f65b2000640 1 -- 172.21.15.37:0/1743105051 learned_addr learned my addr 172.21.15.37:0/1743105051 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:16:40.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.492+0000 7f65b2a00640 1 --2- 172.21.15.37:0/1743105051 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ebd8151c50 0x55ebd815bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:40.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.492+0000 7f65b2000640 1 --2- 172.21.15.37:0/1743105051 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ebd815c510 0x55ebd815e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:40.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.492+0000 7f65b2000640 1 -- 172.21.15.37:0/1743105051 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ebd815c510 msgr2=0x55ebd815e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:40.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.492+0000 7f65b2000640 1 --2- 172.21.15.37:0/1743105051 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ebd815c510 0x55ebd815e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:40.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.492+0000 7f65b2000640 1 -- 172.21.15.37:0/1743105051 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ebd8151c50 msgr2=0x55ebd815bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:40.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.492+0000 7f65b2000640 1 --2- 172.21.15.37:0/1743105051 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ebd8151c50 0x55ebd815bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:40.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.492+0000 7f65b2000640 1 -- 172.21.15.37:0/1743105051 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ebd806b4a0 con 0x55ebd8151330 2024-09-11T23:16:40.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.493+0000 7f65b2000640 1 --2- 172.21.15.37:0/1743105051 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ebd8151330 0x55ebd8151710 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f65a00058a0 tx=0x7f65a000b770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92209cc6eda987f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:40.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.493+0000 7f65ab400640 1 --2- 172.21.15.37:0/2427413282 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f65980a2b80 0x7f65980a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:40.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.493+0000 7f65ab400640 1 -- 172.21.15.37:0/2427413282 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8802+0+0 (secure 0 0 0) 0x7f65ac0cf8f0 con 0x7f65b4112a30 2024-09-11T23:16:40.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.493+0000 7f659fe00640 1 -- 172.21.15.37:0/1743105051 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65a0012ca0 con 0x55ebd8151330 2024-09-11T23:16:40.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.493+0000 7f65b2a00640 1 --2- 172.21.15.37:0/2427413282 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f65980a2b80 0x7f65980a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:40.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.493+0000 7f659fe00640 1 -- 172.21.15.37:0/1743105051 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f65a0012e40 con 0x55ebd8151330 2024-09-11T23:16:40.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.493+0000 7f659fe00640 1 -- 172.21.15.37:0/1743105051 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65a0003850 con 0x55ebd8151330 2024-09-11T23:16:40.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.494+0000 7f65bc46e740 1 -- 172.21.15.37:0/1743105051 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ebd8151330 msgr2=0x55ebd8151710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:40.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.494+0000 7f65b2a00640 1 --2- 172.21.15.37:0/2427413282 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f65980a2b80 0x7f65980a5040 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x55ebd814e720 tx=0x7f65a40046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:40.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.494+0000 7f65bc46e740 1 --2- 172.21.15.37:0/1743105051 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ebd8151330 0x55ebd8151710 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f65a00058a0 tx=0x7f65a000b770 comp rx=0 tx=0).stop 2024-09-11T23:16:40.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.494+0000 7f65bc46e740 1 -- 172.21.15.37:0/1743105051 shutdown_connections 2024-09-11T23:16:40.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.494+0000 7f65bc46e740 1 --2- 172.21.15.37:0/1743105051 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ebd8151c50 0x55ebd815bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:40.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.494+0000 7f65bc46e740 1 --2- 172.21.15.37:0/1743105051 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ebd815c510 0x55ebd815e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:40.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.494+0000 7f65bc46e740 1 --2- 172.21.15.37:0/1743105051 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ebd8151330 0x55ebd8151710 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:40.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.494+0000 7f65bc46e740 1 -- 172.21.15.37:0/1743105051 >> 172.21.15.37:0/1743105051 conn(0x55ebd814d8c0 msgr2=0x55ebd814dca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:40.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.494+0000 7f65bc46e740 1 -- 172.21.15.37:0/1743105051 shutdown_connections 2024-09-11T23:16:40.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.494+0000 7f65bc46e740 1 -- 172.21.15.37:0/1743105051 wait complete. 2024-09-11T23:16:40.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.495+0000 7f65bc46e740 1 -- start start 2024-09-11T23:16:40.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.495+0000 7f65bc46e740 1 Processor -- start 2024-09-11T23:16:40.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.495+0000 7f65bc46e740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ebd8151330 0x55ebd8159590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:40.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.495+0000 7f65bc46e740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ebd8151c50 0x55ebd8159ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:40.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.495+0000 7f65bc46e740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ebd815c510 0x55ebd815a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:40.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.495+0000 7f65bc46e740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ebd815f060 con 0x55ebd8151330 2024-09-11T23:16:40.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.495+0000 7f65bc46e740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55ebd803f920 con 0x55ebd8151c50 2024-09-11T23:16:40.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.495+0000 7f65bc46e740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55ebd815f1e0 con 0x55ebd815c510 2024-09-11T23:16:40.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.496+0000 7f65bc46e740 10 client.0 _ll_register_callbacks cb 0x55ebd80638a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:16:40.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.496+0000 7f65b2a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ebd8151330 0x55ebd8159590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:40.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.496+0000 7f65b2a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ebd8151330 0x55ebd8159590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46484/0 (socket says 172.21.15.37:46484) 2024-09-11T23:16:40.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.496+0000 7f65b2a00640 1 -- 172.21.15.37:0/267558436 learned_addr learned my addr 172.21.15.37:0/267558436 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:16:40.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.496+0000 7f65b3400640 1 --2- 172.21.15.37:0/267558436 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ebd815c510 0x55ebd815a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:40.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.496+0000 7f65b2000640 1 --2- 172.21.15.37:0/267558436 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ebd8151c50 0x55ebd8159ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:40.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.496+0000 7f65b2a00640 1 -- 172.21.15.37:0/267558436 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ebd815c510 msgr2=0x55ebd815a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:40.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.496+0000 7f65b2a00640 1 --2- 172.21.15.37:0/267558436 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ebd815c510 0x55ebd815a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:40.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.496+0000 7f65b2a00640 1 -- 172.21.15.37:0/267558436 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ebd8151c50 msgr2=0x55ebd8159ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:40.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.496+0000 7f65b2a00640 1 --2- 172.21.15.37:0/267558436 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ebd8151c50 0x55ebd8159ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:40.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.496+0000 7f65b2a00640 1 -- 172.21.15.37:0/267558436 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ebd7e282b0 con 0x55ebd8151330 2024-09-11T23:16:40.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.496+0000 7f65b3400640 1 --2- 172.21.15.37:0/267558436 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ebd815c510 0x55ebd815a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:16:40.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.496+0000 7f65b2000640 1 --2- 172.21.15.37:0/267558436 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ebd8151c50 0x55ebd8159ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:16:40.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.497+0000 7f65b2a00640 1 --2- 172.21.15.37:0/267558436 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ebd8151330 0x55ebd8159590 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f65a4005ec0 tx=0x7f65a4009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=673d501a37b9f34 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:40.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.497+0000 7f659cc00640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-11T23:16:40.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.497+0000 7f659cc00640 1 -- 172.21.15.37:0/267558436 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65a404e070 con 0x55ebd8151330 2024-09-11T23:16:40.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.497+0000 7f659cc00640 1 -- 172.21.15.37:0/267558436 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8802+0+0 (secure 0 0 0) 0x7f65a4031e00 con 0x55ebd8151330 2024-09-11T23:16:40.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.497+0000 7f65bc46e740 1 -- 172.21.15.37:0/267558436 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ebd80c4620 con 0x55ebd8151330 2024-09-11T23:16:40.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.497+0000 7f659cc00640 1 -- 172.21.15.37:0/267558436 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f65a405a050 con 0x55ebd8151330 2024-09-11T23:16:40.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.497+0000 7f65bc46e740 10 client.14616 fetch_fsmap learned FSMap version 17 2024-09-11T23:16:40.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.497+0000 7f65bc46e740 1 -- 172.21.15.37:0/267558436 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) -- 0x55ebd816ae10 con 0x55ebd8151330 2024-09-11T23:16:40.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.497+0000 7f659cc00640 1 -- 172.21.15.37:0/267558436 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55ebd80c4620 con 0x55ebd8151330 2024-09-11T23:16:40.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.498+0000 7f659cc00640 1 -- 172.21.15.37:0/267558436 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 17) ==== 8350+0+0 (secure 0 0 0) 0x7f65a404a890 con 0x55ebd8151330 2024-09-11T23:16:40.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.498+0000 7f65bc46e740 10 client.14616 fetch_fsmap finished waiting for FSMap version 17 2024-09-11T23:16:40.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.498+0000 7f65bc46e740 10 client.14616 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-11T23:16:40.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.498+0000 7f65bc46e740 20 client.14616 populate_metadata read hostname 'smithi037' 2024-09-11T23:16:40.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.498+0000 7f65bc46e740 1 --2- 172.21.15.37:0/267558436 >> [v2:172.21.15.123:6838/3077076065,v1:172.21.15.123:6839/3077076065] conn(0x55ebd816d400 0x55ebd816e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:40.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.498+0000 7f65bc46e740 4 client.14616 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T23:16:40.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.498+0000 7f65bc46e740 1 -- 172.21.15.37:0/267558436 --> [v2:172.21.15.123:6838/3077076065,v1:172.21.15.123:6839/3077076065] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ebd80beb30 con 0x55ebd816d400 2024-09-11T23:16:40.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.498+0000 7f65b2000640 1 --2- 172.21.15.37:0/267558436 >> [v2:172.21.15.123:6838/3077076065,v1:172.21.15.123:6839/3077076065] conn(0x55ebd816d400 0x55ebd816e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:40.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.499+0000 7f65b2000640 1 --2- 172.21.15.37:0/267558436 >> [v2:172.21.15.123:6838/3077076065,v1:172.21.15.123:6839/3077076065] conn(0x55ebd816d400 0x55ebd816e870 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a1bce4c6e9ae67f8 server_cookie=1d8f462e5c5474ea in_seq=0 out_seq=0 2024-09-11T23:16:40.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.499+0000 7f659cc00640 10 client.14616 ms_handle_connect on v2:172.21.15.123:6838/3077076065 2024-09-11T23:16:40.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.500+0000 7f659cc00640 1 -- 172.21.15.37:0/267558436 <== mds.0 v2:172.21.15.123:6838/3077076065 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ebd80beb30 con 0x55ebd816d400 2024-09-11T23:16:40.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.500+0000 7f659cc00640 10 client.14616 handle_command_reply: tid=0 2024-09-11T23:16:40.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.500+0000 7f65bc46e740 1 client.14616 shutdown 2024-09-11T23:16:40.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.500+0000 7f65bc46e740 1 -- 172.21.15.37:0/267558436 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ebd8151330 msgr2=0x55ebd8159590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:40.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.500+0000 7f65bc46e740 1 --2- 172.21.15.37:0/267558436 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ebd8151330 0x55ebd8159590 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f65a4005ec0 tx=0x7f65a4009260 comp rx=0 tx=0).stop 2024-09-11T23:16:40.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.500+0000 7f65bc46e740 1 -- 172.21.15.37:0/267558436 shutdown_connections 2024-09-11T23:16:40.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.500+0000 7f65bc46e740 1 --2- 172.21.15.37:0/267558436 >> [v2:172.21.15.123:6838/3077076065,v1:172.21.15.123:6839/3077076065] conn(0x55ebd816d400 0x55ebd816e870 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:40.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.500+0000 7f65bc46e740 1 --2- 172.21.15.37:0/267558436 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ebd8151c50 0x55ebd8159ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:40.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.500+0000 7f65bc46e740 1 --2- 172.21.15.37:0/267558436 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ebd815c510 0x55ebd815a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:40.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.500+0000 7f65bc46e740 1 --2- 172.21.15.37:0/267558436 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ebd8151330 0x55ebd8159590 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:40.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.500+0000 7f65bc46e740 1 -- 172.21.15.37:0/267558436 >> 172.21.15.37:0/267558436 conn(0x55ebd814d8c0 msgr2=0x55ebd81535f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:40.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.500+0000 7f659cc00640 0 client.14616 ms_handle_reset on v2:172.21.15.123:6838/3077076065 2024-09-11T23:16:40.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.500+0000 7f65bc46e740 1 -- 172.21.15.37:0/267558436 shutdown_connections 2024-09-11T23:16:40.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.500+0000 7f65bc46e740 1 -- 172.21.15.37:0/267558436 wait complete. 2024-09-11T23:16:40.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.501+0000 7f65bc46e740 20 client.14616 trim_cache size 0 max 16384 2024-09-11T23:16:40.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.519+0000 7f65bc46e740 1 Processor -- start 2024-09-11T23:16:40.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.519+0000 7f65bc46e740 1 -- start start 2024-09-11T23:16:40.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.520+0000 7f65bc46e740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ebd8151330 0x55ebd8153d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:40.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.520+0000 7f65bc46e740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ebd8151c50 0x55ebd8159b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:40.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.520+0000 7f65bc46e740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ebd815c510 0x55ebd815a040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:40.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.520+0000 7f65bc46e740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ebd816cbb0 con 0x55ebd8151c50 2024-09-11T23:16:40.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.520+0000 7f65bc46e740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55ebd816d280 con 0x55ebd8151330 2024-09-11T23:16:40.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.520+0000 7f65bc46e740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55ebd816d950 con 0x55ebd815c510 2024-09-11T23:16:40.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.520+0000 7f65b2000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ebd8151c50 0x55ebd8159b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:40.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.520+0000 7f65b2000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ebd8151c50 0x55ebd8159b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46492/0 (socket says 172.21.15.37:46492) 2024-09-11T23:16:40.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.520+0000 7f65b2000640 1 -- 172.21.15.37:0/991606099 learned_addr learned my addr 172.21.15.37:0/991606099 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:16:40.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.520+0000 7f65b3400640 1 --2- 172.21.15.37:0/991606099 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ebd815c510 0x55ebd815a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:40.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.520+0000 7f65b2a00640 1 --2- 172.21.15.37:0/991606099 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ebd8151330 0x55ebd8153d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:40.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.521+0000 7f65b2000640 1 -- 172.21.15.37:0/991606099 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ebd815c510 msgr2=0x55ebd815a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:40.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.521+0000 7f65b2000640 1 --2- 172.21.15.37:0/991606099 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ebd815c510 0x55ebd815a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:40.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.521+0000 7f65b2000640 1 -- 172.21.15.37:0/991606099 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ebd8151330 msgr2=0x55ebd8153d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:40.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.521+0000 7f65b2000640 1 --2- 172.21.15.37:0/991606099 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ebd8151330 0x55ebd8153d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:40.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.521+0000 7f65b2000640 1 -- 172.21.15.37:0/991606099 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ebd814ea50 con 0x55ebd8151c50 2024-09-11T23:16:40.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.521+0000 7f65b3400640 1 --2- 172.21.15.37:0/991606099 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ebd815c510 0x55ebd815a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:16:40.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.521+0000 7f65b2000640 1 --2- 172.21.15.37:0/991606099 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ebd8151c50 0x55ebd8159b00 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f65a00058a0 tx=0x7f65a0021040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c902a8b0772d2b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:40.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.521+0000 7f659f400640 1 -- 172.21.15.37:0/991606099 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65a002d070 con 0x55ebd8151c50 2024-09-11T23:16:40.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.521+0000 7f659f400640 1 -- 172.21.15.37:0/991606099 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f65a0005590 con 0x55ebd8151c50 2024-09-11T23:16:40.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.521+0000 7f659f400640 1 -- 172.21.15.37:0/991606099 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65a00039f0 con 0x55ebd8151c50 2024-09-11T23:16:40.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.522+0000 7f65bc46e740 1 -- 172.21.15.37:0/991606099 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ebd8151c50 msgr2=0x55ebd8159b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:40.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.522+0000 7f65bc46e740 1 --2- 172.21.15.37:0/991606099 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ebd8151c50 0x55ebd8159b00 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f65a00058a0 tx=0x7f65a0021040 comp rx=0 tx=0).stop 2024-09-11T23:16:40.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.522+0000 7f65bc46e740 1 -- 172.21.15.37:0/991606099 shutdown_connections 2024-09-11T23:16:40.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.522+0000 7f65bc46e740 1 --2- 172.21.15.37:0/991606099 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ebd815c510 0x55ebd815a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:40.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.522+0000 7f65bc46e740 1 --2- 172.21.15.37:0/991606099 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ebd8151c50 0x55ebd8159b00 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:40.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.522+0000 7f65bc46e740 1 --2- 172.21.15.37:0/991606099 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ebd8151330 0x55ebd8153d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:40.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.522+0000 7f65bc46e740 1 -- 172.21.15.37:0/991606099 >> 172.21.15.37:0/991606099 conn(0x55ebd814d8c0 msgr2=0x55ebd8157e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:40.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.522+0000 7f65bc46e740 1 -- 172.21.15.37:0/991606099 shutdown_connections 2024-09-11T23:16:40.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.522+0000 7f65bc46e740 1 -- 172.21.15.37:0/991606099 wait complete. 2024-09-11T23:16:40.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.522+0000 7f65bc46e740 1 -- start start 2024-09-11T23:16:40.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.523+0000 7f65bc46e740 1 Processor -- start 2024-09-11T23:16:40.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.523+0000 7f65bc46e740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ebd8151330 0x55ebd8155fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:40.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.523+0000 7f65bc46e740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ebd8151c50 0x55ebd8156500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:40.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.523+0000 7f65bc46e740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ebd815c510 0x55ebd8175b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:40.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.523+0000 7f65bc46e740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ebd816e6f0 con 0x55ebd815c510 2024-09-11T23:16:40.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.523+0000 7f65bc46e740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55ebd816e020 con 0x55ebd8151330 2024-09-11T23:16:40.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.523+0000 7f65bc46e740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55ebd816edc0 con 0x55ebd8151c50 2024-09-11T23:16:40.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.523+0000 7f65bc46e740 10 client.0 _ll_register_callbacks cb 0x7f65a4004490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:16:40.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.523+0000 7f65b3400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ebd815c510 0x55ebd8175b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:40.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.524+0000 7f65b2a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ebd8151330 0x55ebd8155fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:40.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.524+0000 7f65b2a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ebd8151330 0x55ebd8155fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.37:41366/0 (socket says 172.21.15.37:41366) 2024-09-11T23:16:40.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.524+0000 7f65b2000640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ebd8151c50 0x55ebd8156500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:40.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.524+0000 7f65b2a00640 1 -- 172.21.15.37:0/745134966 learned_addr learned my addr 172.21.15.37:0/745134966 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:16:40.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.524+0000 7f65b3400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ebd815c510 0x55ebd8175b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46508/0 (socket says 172.21.15.37:46508) 2024-09-11T23:16:40.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.524+0000 7f65b2a00640 1 -- 172.21.15.37:0/745134966 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ebd8151c50 msgr2=0x55ebd8156500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:40.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.524+0000 7f65b2a00640 1 --2- 172.21.15.37:0/745134966 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ebd8151c50 0x55ebd8156500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:40.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.524+0000 7f65b2a00640 1 -- 172.21.15.37:0/745134966 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ebd815c510 msgr2=0x55ebd8175b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:16:40.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.524+0000 7f65b2a00640 1 --2- 172.21.15.37:0/745134966 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ebd815c510 0x55ebd8175b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:40.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.524+0000 7f65b2a00640 1 -- 172.21.15.37:0/745134966 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ebd8176070 con 0x55ebd8151330 2024-09-11T23:16:40.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.524+0000 7f65b2000640 1 --2- 172.21.15.37:0/745134966 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ebd8151c50 0x55ebd8156500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:16:40.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.524+0000 7f65b2a00640 1 --2- 172.21.15.37:0/745134966 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ebd8151330 0x55ebd8155fc0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f65a402aa00 tx=0x7f65a4009680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cde5244e45d3cc3b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:40.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.524+0000 7f659cc00640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-11T23:16:40.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.525+0000 7f659cc00640 1 -- 172.21.15.37:0/745134966 <== mon.2 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65a4062070 con 0x55ebd8151330 2024-09-11T23:16:40.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.525+0000 7f659cc00640 1 -- 172.21.15.37:0/745134966 <== mon.2 v2:172.21.15.123:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8802+0+0 (secure 0 0 0) 0x7f65a404a8e0 con 0x55ebd8151330 2024-09-11T23:16:40.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.525+0000 7f65bc46e740 1 -- 172.21.15.37:0/745134966 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f65a0005590 con 0x55ebd8151330 2024-09-11T23:16:40.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.525+0000 7f659cc00640 1 -- 172.21.15.37:0/745134966 <== mon.2 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f65a406e050 con 0x55ebd8151330 2024-09-11T23:16:40.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.525+0000 7f65bc46e740 10 client.24635 fetch_fsmap learned FSMap version 17 2024-09-11T23:16:40.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.525+0000 7f65bc46e740 1 -- 172.21.15.37:0/745134966 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) -- 0x55ebd81772d0 con 0x55ebd8151330 2024-09-11T23:16:40.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.525+0000 7f659cc00640 1 -- 172.21.15.37:0/745134966 <== mon.2 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f65a0005590 con 0x55ebd8151330 2024-09-11T23:16:40.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.525+0000 7f659cc00640 1 -- 172.21.15.37:0/745134966 <== mon.2 v2:172.21.15.123:3300/0 5 ==== fsmap(e 17) ==== 8350+0+0 (secure 0 0 0) 0x7f65a4053520 con 0x55ebd8151330 2024-09-11T23:16:40.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.525+0000 7f65bc46e740 10 client.24635 fetch_fsmap finished waiting for FSMap version 17 2024-09-11T23:16:40.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.526+0000 7f65bc46e740 10 client.24635 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-11T23:16:40.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.526+0000 7f65bc46e740 20 client.24635 populate_metadata read hostname 'smithi037' 2024-09-11T23:16:40.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.526+0000 7f65bc46e740 1 --2- 172.21.15.37:0/745134966 >> [v2:172.21.15.123:6838/3077076065,v1:172.21.15.123:6839/3077076065] conn(0x55ebd81dc040 0x55ebd81dad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:40.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.526+0000 7f65bc46e740 4 client.24635 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T23:16:40.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.526+0000 7f65bc46e740 1 -- 172.21.15.37:0/745134966 --> [v2:172.21.15.123:6838/3077076065,v1:172.21.15.123:6839/3077076065] -- command(tid 0: {"prefix": "status"}) -- 0x55ebd803af80 con 0x55ebd81dc040 2024-09-11T23:16:40.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.526+0000 7f65b2000640 1 --2- 172.21.15.37:0/745134966 >> [v2:172.21.15.123:6838/3077076065,v1:172.21.15.123:6839/3077076065] conn(0x55ebd81dc040 0x55ebd81dad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:40.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.526+0000 7f65b2000640 1 --2- 172.21.15.37:0/745134966 >> [v2:172.21.15.123:6838/3077076065,v1:172.21.15.123:6839/3077076065] conn(0x55ebd81dc040 0x55ebd81dad50 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fbdfa3c3bf767727 server_cookie=f388f133f90720f9 in_seq=0 out_seq=0 2024-09-11T23:16:40.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.526+0000 7f659cc00640 10 client.24635 ms_handle_connect on v2:172.21.15.123:6838/3077076065 2024-09-11T23:16:40.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.527+0000 7f659cc00640 1 -- 172.21.15.37:0/745134966 <== mds.0 v2:172.21.15.123:6838/3077076065 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55ebd803af80 con 0x55ebd81dc040 2024-09-11T23:16:40.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.527+0000 7f659cc00640 10 client.24635 handle_command_reply: tid=0 2024-09-11T23:16:40.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.527+0000 7f65bc46e740 1 client.24635 shutdown 2024-09-11T23:16:40.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.527+0000 7f65bc46e740 1 -- 172.21.15.37:0/745134966 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ebd8151330 msgr2=0x55ebd8155fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:40.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.527+0000 7f65bc46e740 1 --2- 172.21.15.37:0/745134966 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ebd8151330 0x55ebd8155fc0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f65a402aa00 tx=0x7f65a4009680 comp rx=0 tx=0).stop 2024-09-11T23:16:40.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.527+0000 7f65bc46e740 1 -- 172.21.15.37:0/745134966 shutdown_connections 2024-09-11T23:16:40.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.527+0000 7f65bc46e740 1 --2- 172.21.15.37:0/745134966 >> [v2:172.21.15.123:6838/3077076065,v1:172.21.15.123:6839/3077076065] conn(0x55ebd81dc040 0x55ebd81dad50 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:40.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.527+0000 7f65bc46e740 1 --2- 172.21.15.37:0/745134966 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ebd815c510 0x55ebd8175b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:40.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.527+0000 7f65bc46e740 1 --2- 172.21.15.37:0/745134966 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ebd8151c50 0x55ebd8156500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:40.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.527+0000 7f65bc46e740 1 --2- 172.21.15.37:0/745134966 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ebd8151330 0x55ebd8155fc0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:40.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.527+0000 7f659cc00640 0 client.24635 ms_handle_reset on v2:172.21.15.123:6838/3077076065 2024-09-11T23:16:40.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.527+0000 7f65bc46e740 1 -- 172.21.15.37:0/745134966 >> 172.21.15.37:0/745134966 conn(0x55ebd814d8c0 msgr2=0x55ebd8167c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:40.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.527+0000 7f65bc46e740 1 -- 172.21.15.37:0/745134966 shutdown_connections 2024-09-11T23:16:40.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.527+0000 7f65bc46e740 1 -- 172.21.15.37:0/745134966 wait complete. 2024-09-11T23:16:40.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.527+0000 7f65bc46e740 20 client.24635 trim_cache size 0 max 16384 2024-09-11T23:16:40.532 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-11T23:16:40.532 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "8b03efce-7092-11ef-bcea-c7b262605968", 2024-09-11T23:16:40.532 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 0, 2024-09-11T23:16:40.532 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 24533, 2024-09-11T23:16:40.533 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2024-09-11T23:16:40.533 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2024-09-11T23:16:40.533 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2024-09-11T23:16:40.533 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 23.051764950999999, 2024-09-11T23:16:40.533 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 17, 2024-09-11T23:16:40.533 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 91, 2024-09-11T23:16:40.533 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 91, 2024-09-11T23:16:40.533 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 38.133897867999998 2024-09-11T23:16:40.533 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-11T23:16:40.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.528+0000 7f65b9a00640 1 -- 172.21.15.37:0/2427413282 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f65980a2b80 msgr2=0x7f65980a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:40.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.528+0000 7f65b9a00640 1 --2- 172.21.15.37:0/2427413282 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f65980a2b80 0x7f65980a5040 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x55ebd814e720 tx=0x7f65a40046c0 comp rx=0 tx=0).stop 2024-09-11T23:16:40.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.528+0000 7f65b9a00640 1 -- 172.21.15.37:0/2427413282 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f65b4112a30 msgr2=0x7f65b419e8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:40.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.528+0000 7f65b9a00640 1 --2- 172.21.15.37:0/2427413282 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f65b4112a30 0x7f65b419e8e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f65b407aa10 tx=0x7f65ac00ef10 comp rx=0 tx=0).stop 2024-09-11T23:16:40.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.528+0000 7f65b9a00640 1 -- 172.21.15.37:0/2427413282 shutdown_connections 2024-09-11T23:16:40.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.528+0000 7f65b9a00640 1 --2- 172.21.15.37:0/2427413282 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f65980a2b80 0x7f65980a5040 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:40.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.528+0000 7f65b9a00640 1 --2- 172.21.15.37:0/2427413282 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f65b4112a30 0x7f65b419e8e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:40.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.528+0000 7f65b9a00640 1 --2- 172.21.15.37:0/2427413282 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65b4077040 0x7f65b41a4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:40.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.528+0000 7f65b9a00640 1 --2- 172.21.15.37:0/2427413282 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f65b4076720 0x7f65b41a4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:40.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.528+0000 7f65b9a00640 1 -- 172.21.15.37:0/2427413282 >> 172.21.15.37:0/2427413282 conn(0x7f65b40ffa90 msgr2=0x7f65b4101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:40.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.528+0000 7f65b9a00640 1 -- 172.21.15.37:0/2427413282 shutdown_connections 2024-09-11T23:16:40.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:40.528+0000 7f65b9a00640 1 -- 172.21.15.37:0/2427413282 wait complete. 2024-09-11T23:16:41.456 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-11T23:16:41.457 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-11T23:16:41.457 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph fs ls 2024-09-11T23:16:41.838 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:16:41.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:41 smithi160 ceph-mon[35055]: pgmap v315: 129 pgs: 129 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:16:41.977 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:41 smithi037 ceph-mon[30630]: pgmap v315: 129 pgs: 129 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:16:42.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:41 smithi123 ceph-mon[35438]: pgmap v315: 129 pgs: 129 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:16:42.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:42.375+0000 7fd7d8600640 1 -- 172.21.15.37:0/3920567388 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd7d0109120 msgr2=0x7fd7d0110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:42.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:42.375+0000 7fd7d8600640 1 --2- 172.21.15.37:0/3920567388 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd7d0109120 0x7fd7d0110ca0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd7c8009ca0 tx=0x7fd7c802a8c0 comp rx=0 tx=0).stop 2024-09-11T23:16:42.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:42.375+0000 7fd7d8600640 1 -- 172.21.15.37:0/3920567388 shutdown_connections 2024-09-11T23:16:42.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:42.375+0000 7fd7d8600640 1 --2- 172.21.15.37:0/3920567388 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd7d0109120 0x7fd7d0110ca0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:42.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:42.375+0000 7fd7d8600640 1 --2- 172.21.15.37:0/3920567388 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7d01049a0 0x7fd7d01089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:42.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:42.375+0000 7fd7d8600640 1 --2- 172.21.15.37:0/3920567388 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd7d0103ff0 0x7fd7d01043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:42.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:42.375+0000 7fd7d8600640 1 -- 172.21.15.37:0/3920567388 >> 172.21.15.37:0/3920567388 conn(0x7fd7d00ffa90 msgr2=0x7fd7d0101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:42.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:42.375+0000 7fd7d8600640 1 -- 172.21.15.37:0/3920567388 shutdown_connections 2024-09-11T23:16:42.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:42.375+0000 7fd7d8600640 1 -- 172.21.15.37:0/3920567388 wait complete. 2024-09-11T23:16:42.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:42.376+0000 7fd7d8600640 1 Processor -- start 2024-09-11T23:16:42.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:42.376+0000 7fd7d8600640 1 -- start start 2024-09-11T23:16:42.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:42.377+0000 7fd7d8600640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd7d0103ff0 0x7fd7d019a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:42.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:42.377+0000 7fd7d8600640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd7d01049a0 0x7fd7d019aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:42.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:42.377+0000 7fd7d8600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7d0109120 0x7fd7d019ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:42.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:42.377+0000 7fd7d8600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd7d0114130 con 0x7fd7d0109120 2024-09-11T23:16:42.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:42.377+0000 7fd7d8600640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fd7d0113fb0 con 0x7fd7d0103ff0 2024-09-11T23:16:42.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:42.377+0000 7fd7d8600640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fd7d01142b0 con 0x7fd7d01049a0 2024-09-11T23:16:42.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:42.377+0000 7fd7d5200640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd7d01049a0 0x7fd7d019aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:42.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:42.377+0000 7fd7d5c00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd7d0103ff0 0x7fd7d019a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:42.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:42.377+0000 7fd7d6600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7d0109120 0x7fd7d019ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:42.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:42.377+0000 7fd7d5200640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd7d01049a0 0x7fd7d019aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.37:60110/0 (socket says 172.21.15.37:60110) 2024-09-11T23:16:42.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:42.377+0000 7fd7d5200640 1 -- 172.21.15.37:0/2282775148 learned_addr learned my addr 172.21.15.37:0/2282775148 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:16:42.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:42.378+0000 7fd7d5c00640 1 -- 172.21.15.37:0/2282775148 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd7d01049a0 msgr2=0x7fd7d019aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:42.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:42.378+0000 7fd7d5c00640 1 --2- 172.21.15.37:0/2282775148 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd7d01049a0 0x7fd7d019aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:42.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:42.378+0000 7fd7d5c00640 1 -- 172.21.15.37:0/2282775148 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7d0109120 msgr2=0x7fd7d019ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:42.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:42.378+0000 7fd7d5c00640 1 --2- 172.21.15.37:0/2282775148 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7d0109120 0x7fd7d019ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:42.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:42.378+0000 7fd7d5c00640 1 -- 172.21.15.37:0/2282775148 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7d019f540 con 0x7fd7d0103ff0 2024-09-11T23:16:42.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:42.378+0000 7fd7d5c00640 1 --2- 172.21.15.37:0/2282775148 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd7d0103ff0 0x7fd7d019a590 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd7c400e9f0 tx=0x7fd7c400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:42.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:42.378+0000 7fd7ce000640 1 -- 172.21.15.37:0/2282775148 <== mon.2 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7c400ccc0 con 0x7fd7d0103ff0 2024-09-11T23:16:42.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:42.378+0000 7fd7ce000640 1 -- 172.21.15.37:0/2282775148 <== mon.2 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd7c4010910 con 0x7fd7d0103ff0 2024-09-11T23:16:42.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:42.378+0000 7fd7d8600640 1 -- 172.21.15.37:0/2282775148 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7d019f830 con 0x7fd7d0103ff0 2024-09-11T23:16:42.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:42.378+0000 7fd7ce000640 1 -- 172.21.15.37:0/2282775148 <== mon.2 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7c4018960 con 0x7fd7d0103ff0 2024-09-11T23:16:42.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:42.379+0000 7fd7d8600640 1 -- 172.21.15.37:0/2282775148 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7d01a7110 con 0x7fd7d0103ff0 2024-09-11T23:16:42.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:42.380+0000 7fd7d8600640 1 -- 172.21.15.37:0/2282775148 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7d01043d0 con 0x7fd7d0103ff0 2024-09-11T23:16:42.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:42.381+0000 7fd7ce000640 1 -- 172.21.15.37:0/2282775148 <== mon.2 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fd7c4010ac0 con 0x7fd7d0103ff0 2024-09-11T23:16:42.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:42.383+0000 7fd7ce000640 1 --2- 172.21.15.37:0/2282775148 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fd7b80a2c00 0x7fd7b80a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:42.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:42.383+0000 7fd7ce000640 1 -- 172.21.15.37:0/2282775148 <== mon.2 v2:172.21.15.123:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8802+0+0 (secure 0 0 0) 0x7fd7c40cf9a0 con 0x7fd7d0103ff0 2024-09-11T23:16:42.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:42.383+0000 7fd7d5200640 1 --2- 172.21.15.37:0/2282775148 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fd7b80a2c00 0x7fd7b80a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:42.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:42.384+0000 7fd7d5200640 1 --2- 172.21.15.37:0/2282775148 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fd7b80a2c00 0x7fd7b80a50c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc0095f0 tx=0x7fd7bc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:42.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:42.385+0000 7fd7ce000640 1 -- 172.21.15.37:0/2282775148 <== mon.2 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd7c409c010 con 0x7fd7d0103ff0 2024-09-11T23:16:42.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:42.605+0000 7fd7d8600640 1 -- 172.21.15.37:0/2282775148 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fd7d01a7380 con 0x7fd7d0103ff0 2024-09-11T23:16:42.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:42.606+0000 7fd7ce000640 1 -- 172.21.15.37:0/2282775148 <== mon.2 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) ==== 53+0+88 (secure 0 0 0) 0x7fd7c40a0310 con 0x7fd7d0103ff0 2024-09-11T23:16:42.606 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-11T23:16:42.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:42.608+0000 7fd7d8600640 1 -- 172.21.15.37:0/2282775148 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fd7b80a2c00 msgr2=0x7fd7b80a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:42.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:42.608+0000 7fd7d8600640 1 --2- 172.21.15.37:0/2282775148 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fd7b80a2c00 0x7fd7b80a50c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc0095f0 tx=0x7fd7bc005f90 comp rx=0 tx=0).stop 2024-09-11T23:16:42.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:42.608+0000 7fd7d8600640 1 -- 172.21.15.37:0/2282775148 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd7d0103ff0 msgr2=0x7fd7d019a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:42.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:42.608+0000 7fd7d8600640 1 --2- 172.21.15.37:0/2282775148 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd7d0103ff0 0x7fd7d019a590 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd7c400e9f0 tx=0x7fd7c400eeb0 comp rx=0 tx=0).stop 2024-09-11T23:16:42.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:42.608+0000 7fd7d8600640 1 -- 172.21.15.37:0/2282775148 shutdown_connections 2024-09-11T23:16:42.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:42.608+0000 7fd7d8600640 1 --2- 172.21.15.37:0/2282775148 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fd7b80a2c00 0x7fd7b80a50c0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:42.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:42.608+0000 7fd7d8600640 1 --2- 172.21.15.37:0/2282775148 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7d0109120 0x7fd7d019ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:42.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:42.608+0000 7fd7d8600640 1 --2- 172.21.15.37:0/2282775148 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd7d01049a0 0x7fd7d019aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:42.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:42.608+0000 7fd7d8600640 1 --2- 172.21.15.37:0/2282775148 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd7d0103ff0 0x7fd7d019a590 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:42.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:42.608+0000 7fd7d8600640 1 -- 172.21.15.37:0/2282775148 >> 172.21.15.37:0/2282775148 conn(0x7fd7d00ffa90 msgr2=0x7fd7d0101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:42.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:42.609+0000 7fd7d8600640 1 -- 172.21.15.37:0/2282775148 shutdown_connections 2024-09-11T23:16:42.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:42.609+0000 7fd7d8600640 1 -- 172.21.15.37:0/2282775148 wait complete. 2024-09-11T23:16:42.933 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:42 smithi160 ceph-mon[35055]: from='client.? 172.21.15.37:0/2282775148' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-11T23:16:42.978 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:42 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/2282775148' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-11T23:16:43.000 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:42 smithi123 ceph-mon[35438]: from='client.? 172.21.15.37:0/2282775148' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-11T23:16:43.480 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-11T23:16:43.480 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-11T23:16:43.480 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi037.front.sepia.ceph.com 2024-09-11T23:16:43.480 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-09-11T23:16:43.480 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-11T23:16:43.480 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-11T23:16:43.481 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-11T23:16:43.481 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-11T23:16:43.481 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-09-11T23:16:43.481 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:16:43.481 DEBUG:teuthology.orchestra.run.smithi037:> ip addr 2024-09-11T23:16:43.520 INFO:teuthology.orchestra.run.smithi037.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T23:16:43.520 INFO:teuthology.orchestra.run.smithi037.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T23:16:43.520 INFO:teuthology.orchestra.run.smithi037.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T23:16:43.520 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:16:43.520 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 ::1/128 scope host 2024-09-11T23:16:43.520 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:16:43.521 INFO:teuthology.orchestra.run.smithi037.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T23:16:43.521 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:18 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:16:43.521 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f0 2024-09-11T23:16:43.521 INFO:teuthology.orchestra.run.smithi037.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T23:16:43.521 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:19 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:16:43.521 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f1 2024-09-11T23:16:43.521 INFO:teuthology.orchestra.run.smithi037.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-11T23:16:43.521 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:94 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:16:43.521 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f0 2024-09-11T23:16:43.521 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.21.15.37/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-11T23:16:43.521 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft 42173sec preferred_lft 42173sec 2024-09-11T23:16:43.521 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::ec4:7aff:fe88:7794/64 scope link 2024-09-11T23:16:43.521 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:16:43.522 INFO:teuthology.orchestra.run.smithi037.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T23:16:43.522 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:95 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:16:43.522 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f1 2024-09-11T23:16:43.522 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-11T23:16:43.523 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:16:43.523 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2024-09-11T23:16:43.523 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link add name ceph-brx type bridge 2024-09-11T23:16:43.523 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip addr flush dev ceph-brx 2024-09-11T23:16:43.523 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set ceph-brx up 2024-09-11T23:16:43.523 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-11T23:16:43.523 DEBUG:teuthology.orchestra.run.smithi037:> ') 2024-09-11T23:16:43.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:16:43.694 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:43 smithi037 ceph-mon[30630]: pgmap v316: 129 pgs: 129 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:16:43.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:43 smithi160 ceph-mon[35055]: pgmap v316: 129 pgs: 129 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:16:43.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:16:43.949 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:16:43.949 DEBUG:teuthology.orchestra.run.smithi037:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-11T23:16:44.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:43 smithi123 ceph-mon[35438]: pgmap v316: 129 pgs: 129 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:16:44.005 INFO:teuthology.orchestra.run.smithi037.stdout:1 2024-09-11T23:16:44.008 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:16:44.008 DEBUG:teuthology.orchestra.run.smithi037:> route 2024-09-11T23:16:44.103 INFO:teuthology.orchestra.run.smithi037.stdout:Kernel IP routing table 2024-09-11T23:16:44.104 INFO:teuthology.orchestra.run.smithi037.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-11T23:16:44.104 INFO:teuthology.orchestra.run.smithi037.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-11T23:16:44.104 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-11T23:16:44.104 INFO:teuthology.orchestra.run.smithi037.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-11T23:16:44.105 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:16:44.105 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2024-09-11T23:16:44.105 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-11T23:16:44.105 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-11T23:16:44.105 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-11T23:16:44.105 DEBUG:teuthology.orchestra.run.smithi037:> ') 2024-09-11T23:16:44.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:16:44.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:16:44.708 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:16:44.708 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2024-09-11T23:16:44.745 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:16:44.745 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list-id 2024-09-11T23:16:44.821 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:16:44.821 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2024-09-11T23:16:44.821 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-11T23:16:44.821 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-09-11T23:16:44.821 DEBUG:teuthology.orchestra.run.smithi037:> ') 2024-09-11T23:16:44.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:16:44.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:16:45.107 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-09-11T23:16:45.108 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:16:45.108 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2024-09-11T23:16:45.108 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-09-11T23:16:45.108 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-11T23:16:45.108 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-09-11T23:16:45.108 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-09-11T23:16:45.108 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-09-11T23:16:45.108 DEBUG:teuthology.orchestra.run.smithi037:> ') 2024-09-11T23:16:45.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:16:45.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:16:45.360 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:16:45.360 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2024-09-11T23:16:45.360 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set brx.0 up 2024-09-11T23:16:45.361 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set dev brx.0 master ceph-brx 2024-09-11T23:16:45.361 DEBUG:teuthology.orchestra.run.smithi037:> ') 2024-09-11T23:16:45.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:16:45.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:16:45.529 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-09-11T23:16:45.529 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:16:45.529 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-09-11T23:16:45.565 INFO:teuthology.orchestra.run.smithi037.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-09-11T23:16:45.565 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:16:45.565 DEBUG:teuthology.orchestra.run.smithi037:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-09-11T23:16:45.641 DEBUG:teuthology.orchestra.run.smithi037:> sudo modprobe fuse 2024-09-11T23:16:45.739 DEBUG:teuthology.orchestra.run.smithi037:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T23:16:45.776 INFO:teuthology.orchestra.run.smithi037.stdout:/proc 2024-09-11T23:16:45.776 INFO:teuthology.orchestra.run.smithi037.stdout:/sys 2024-09-11T23:16:45.776 INFO:teuthology.orchestra.run.smithi037.stdout:/dev 2024-09-11T23:16:45.776 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/kernel/security 2024-09-11T23:16:45.776 INFO:teuthology.orchestra.run.smithi037.stdout:/dev/shm 2024-09-11T23:16:45.776 INFO:teuthology.orchestra.run.smithi037.stdout:/dev/pts 2024-09-11T23:16:45.777 INFO:teuthology.orchestra.run.smithi037.stdout:/run 2024-09-11T23:16:45.777 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/fs/cgroup 2024-09-11T23:16:45.777 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/fs/pstore 2024-09-11T23:16:45.777 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/fs/bpf 2024-09-11T23:16:45.777 INFO:teuthology.orchestra.run.smithi037.stdout:/ 2024-09-11T23:16:45.777 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/fs/selinux 2024-09-11T23:16:45.777 INFO:teuthology.orchestra.run.smithi037.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T23:16:45.777 INFO:teuthology.orchestra.run.smithi037.stdout:/dev/hugepages 2024-09-11T23:16:45.777 INFO:teuthology.orchestra.run.smithi037.stdout:/dev/mqueue 2024-09-11T23:16:45.777 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/kernel/debug 2024-09-11T23:16:45.777 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/kernel/tracing 2024-09-11T23:16:45.777 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/fs/fuse/connections 2024-09-11T23:16:45.778 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/kernel/config 2024-09-11T23:16:45.778 INFO:teuthology.orchestra.run.smithi037.stdout:/run/credentials/systemd-sysctl.service 2024-09-11T23:16:45.778 INFO:teuthology.orchestra.run.smithi037.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-11T23:16:45.778 INFO:teuthology.orchestra.run.smithi037.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-11T23:16:45.778 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/nfs/rpc_pipefs 2024-09-11T23:16:45.778 INFO:teuthology.orchestra.run.smithi037.stdout:/run/user/1000 2024-09-11T23:16:45.778 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/ceph 2024-09-11T23:16:45.778 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay 2024-09-11T23:16:45.778 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/b8f0f6df36d3c20b8c18f847b41e91b4a61f209649d9b0b95c69af4304c673cf/merged 2024-09-11T23:16:45.778 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/fce2d15fc840a49b7d99831ee754c9abf530a2d1100d974615aab34637a4990c/merged 2024-09-11T23:16:45.778 INFO:teuthology.orchestra.run.smithi037.stdout:/run/user/0 2024-09-11T23:16:45.778 INFO:teuthology.orchestra.run.smithi037.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T23:16:45.778 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/2b0a0d305a753f4cd81127f5da707aac4a2682b3d1b8b09babc65ed7b7b8e54e/merged 2024-09-11T23:16:45.779 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/d2bf014fa9b55699030f676c5a4258180c1ec52b2f24dfac2da18d048eb7ad2d/merged 2024-09-11T23:16:45.779 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/870b896be6955637963da39c6a19b5c0a19f892f08f3dd277e6e24f5b2c87a00/merged 2024-09-11T23:16:45.779 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/1e0ed437a3358bf6de3cb711b0616f7454978bd053f7f39e33889a0b068ff530/merged 2024-09-11T23:16:45.779 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/1ebeb1d9a660e656c992df3232235df5f8ffd07c16e5003e70b84278e200c06d/merged 2024-09-11T23:16:45.779 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/5c4c245f7a144d0cbc20ae8979bde7eef39c2cbfabbbe58f33aecb12323f64ac/merged 2024-09-11T23:16:45.779 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/9ccd970c3aae07c618c7906bac5cab69ec4273cde331a59f1df9d87c2d0ede92/merged 2024-09-11T23:16:45.779 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/f3c71694a24ec627c0a90d159d326fad91934236695ad3aa89ea17b130ca5eb9/merged 2024-09-11T23:16:45.779 INFO:teuthology.orchestra.run.smithi037.stdout:/run/netns 2024-09-11T23:16:45.779 INFO:teuthology.orchestra.run.smithi037.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-11T23:16:45.779 INFO:teuthology.orchestra.run.smithi037.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-11T23:16:45.780 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:16:45.780 DEBUG:teuthology.orchestra.run.smithi037:> ls /sys/fs/fuse/connections 2024-09-11T23:16:45.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:45 smithi037 ceph-mon[30630]: pgmap v317: 129 pgs: 129 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:16:45.849 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-11T23:16:45.850 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-09-11T23:16:45.894 DEBUG:teuthology.orchestra.run.smithi037:> sudo modprobe fuse 2024-09-11T23:16:45.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:45 smithi160 ceph-mon[35055]: pgmap v317: 129 pgs: 129 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:16:45.951 DEBUG:teuthology.orchestra.run.smithi037:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T23:16:45.990 INFO:teuthology.orchestra.run.smithi037.stdout:/proc 2024-09-11T23:16:45.990 INFO:teuthology.orchestra.run.smithi037.stdout:/sys 2024-09-11T23:16:45.990 INFO:teuthology.orchestra.run.smithi037.stdout:/dev 2024-09-11T23:16:45.990 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/kernel/security 2024-09-11T23:16:45.990 INFO:teuthology.orchestra.run.smithi037.stdout:/dev/shm 2024-09-11T23:16:45.990 INFO:teuthology.orchestra.run.smithi037.stdout:/dev/pts 2024-09-11T23:16:45.990 INFO:teuthology.orchestra.run.smithi037.stdout:/run 2024-09-11T23:16:45.991 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/fs/cgroup 2024-09-11T23:16:45.991 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/fs/pstore 2024-09-11T23:16:45.991 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/fs/bpf 2024-09-11T23:16:45.991 INFO:teuthology.orchestra.run.smithi037.stdout:/ 2024-09-11T23:16:45.991 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/fs/selinux 2024-09-11T23:16:45.991 INFO:teuthology.orchestra.run.smithi037.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T23:16:45.991 INFO:teuthology.orchestra.run.smithi037.stdout:/dev/hugepages 2024-09-11T23:16:45.991 INFO:teuthology.orchestra.run.smithi037.stdout:/dev/mqueue 2024-09-11T23:16:45.991 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/kernel/debug 2024-09-11T23:16:45.991 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/kernel/tracing 2024-09-11T23:16:45.991 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/fs/fuse/connections 2024-09-11T23:16:45.991 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/kernel/config 2024-09-11T23:16:45.992 INFO:teuthology.orchestra.run.smithi037.stdout:/run/credentials/systemd-sysctl.service 2024-09-11T23:16:45.992 INFO:teuthology.orchestra.run.smithi037.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-11T23:16:45.992 INFO:teuthology.orchestra.run.smithi037.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-11T23:16:45.992 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/nfs/rpc_pipefs 2024-09-11T23:16:45.992 INFO:teuthology.orchestra.run.smithi037.stdout:/run/user/1000 2024-09-11T23:16:45.992 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/ceph 2024-09-11T23:16:45.992 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay 2024-09-11T23:16:45.992 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/b8f0f6df36d3c20b8c18f847b41e91b4a61f209649d9b0b95c69af4304c673cf/merged 2024-09-11T23:16:45.992 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/fce2d15fc840a49b7d99831ee754c9abf530a2d1100d974615aab34637a4990c/merged 2024-09-11T23:16:45.992 INFO:teuthology.orchestra.run.smithi037.stdout:/run/user/0 2024-09-11T23:16:45.992 INFO:teuthology.orchestra.run.smithi037.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T23:16:45.992 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/2b0a0d305a753f4cd81127f5da707aac4a2682b3d1b8b09babc65ed7b7b8e54e/merged 2024-09-11T23:16:45.992 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/d2bf014fa9b55699030f676c5a4258180c1ec52b2f24dfac2da18d048eb7ad2d/merged 2024-09-11T23:16:45.993 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/870b896be6955637963da39c6a19b5c0a19f892f08f3dd277e6e24f5b2c87a00/merged 2024-09-11T23:16:45.993 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/1e0ed437a3358bf6de3cb711b0616f7454978bd053f7f39e33889a0b068ff530/merged 2024-09-11T23:16:45.993 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/1ebeb1d9a660e656c992df3232235df5f8ffd07c16e5003e70b84278e200c06d/merged 2024-09-11T23:16:45.993 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/5c4c245f7a144d0cbc20ae8979bde7eef39c2cbfabbbe58f33aecb12323f64ac/merged 2024-09-11T23:16:45.993 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/9ccd970c3aae07c618c7906bac5cab69ec4273cde331a59f1df9d87c2d0ede92/merged 2024-09-11T23:16:45.993 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/f3c71694a24ec627c0a90d159d326fad91934236695ad3aa89ea17b130ca5eb9/merged 2024-09-11T23:16:45.993 INFO:teuthology.orchestra.run.smithi037.stdout:/run/netns 2024-09-11T23:16:45.993 INFO:teuthology.orchestra.run.smithi037.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-11T23:16:45.993 INFO:teuthology.orchestra.run.smithi037.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-11T23:16:45.994 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:16:45.994 DEBUG:teuthology.orchestra.run.smithi037:> ls /sys/fs/fuse/connections 2024-09-11T23:16:46.000 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:45 smithi123 ceph-mon[35438]: pgmap v317: 129 pgs: 129 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:16:46.081 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi037.stderr:2024-09-11T23:16:46.081+0000 7f2376aeb480 -1 init, newargv = 0x55fe6116e400 newargc=15 2024-09-11T23:16:46.082 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi037.stderr:ceph-fuse[74724]: starting ceph client 2024-09-11T23:16:46.091 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi037.stderr:ceph-fuse[74724]: starting fuse 2024-09-11T23:16:47.172 DEBUG:teuthology.orchestra.run.smithi037:> sudo modprobe fuse 2024-09-11T23:16:47.237 DEBUG:teuthology.orchestra.run.smithi037:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T23:16:47.276 INFO:teuthology.orchestra.run.smithi037.stdout:/proc 2024-09-11T23:16:47.276 INFO:teuthology.orchestra.run.smithi037.stdout:/sys 2024-09-11T23:16:47.276 INFO:teuthology.orchestra.run.smithi037.stdout:/dev 2024-09-11T23:16:47.276 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/kernel/security 2024-09-11T23:16:47.276 INFO:teuthology.orchestra.run.smithi037.stdout:/dev/shm 2024-09-11T23:16:47.276 INFO:teuthology.orchestra.run.smithi037.stdout:/dev/pts 2024-09-11T23:16:47.276 INFO:teuthology.orchestra.run.smithi037.stdout:/run 2024-09-11T23:16:47.276 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/fs/cgroup 2024-09-11T23:16:47.276 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/fs/pstore 2024-09-11T23:16:47.276 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/fs/bpf 2024-09-11T23:16:47.276 INFO:teuthology.orchestra.run.smithi037.stdout:/ 2024-09-11T23:16:47.277 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/fs/selinux 2024-09-11T23:16:47.277 INFO:teuthology.orchestra.run.smithi037.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T23:16:47.277 INFO:teuthology.orchestra.run.smithi037.stdout:/dev/hugepages 2024-09-11T23:16:47.277 INFO:teuthology.orchestra.run.smithi037.stdout:/dev/mqueue 2024-09-11T23:16:47.277 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/kernel/debug 2024-09-11T23:16:47.277 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/kernel/tracing 2024-09-11T23:16:47.277 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/fs/fuse/connections 2024-09-11T23:16:47.277 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/kernel/config 2024-09-11T23:16:47.277 INFO:teuthology.orchestra.run.smithi037.stdout:/run/credentials/systemd-sysctl.service 2024-09-11T23:16:47.277 INFO:teuthology.orchestra.run.smithi037.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-11T23:16:47.277 INFO:teuthology.orchestra.run.smithi037.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-11T23:16:47.277 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/nfs/rpc_pipefs 2024-09-11T23:16:47.277 INFO:teuthology.orchestra.run.smithi037.stdout:/run/user/1000 2024-09-11T23:16:47.278 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/ceph 2024-09-11T23:16:47.278 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay 2024-09-11T23:16:47.278 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/b8f0f6df36d3c20b8c18f847b41e91b4a61f209649d9b0b95c69af4304c673cf/merged 2024-09-11T23:16:47.278 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/fce2d15fc840a49b7d99831ee754c9abf530a2d1100d974615aab34637a4990c/merged 2024-09-11T23:16:47.278 INFO:teuthology.orchestra.run.smithi037.stdout:/run/user/0 2024-09-11T23:16:47.278 INFO:teuthology.orchestra.run.smithi037.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T23:16:47.278 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/2b0a0d305a753f4cd81127f5da707aac4a2682b3d1b8b09babc65ed7b7b8e54e/merged 2024-09-11T23:16:47.278 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/d2bf014fa9b55699030f676c5a4258180c1ec52b2f24dfac2da18d048eb7ad2d/merged 2024-09-11T23:16:47.278 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/870b896be6955637963da39c6a19b5c0a19f892f08f3dd277e6e24f5b2c87a00/merged 2024-09-11T23:16:47.278 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/1e0ed437a3358bf6de3cb711b0616f7454978bd053f7f39e33889a0b068ff530/merged 2024-09-11T23:16:47.278 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/1ebeb1d9a660e656c992df3232235df5f8ffd07c16e5003e70b84278e200c06d/merged 2024-09-11T23:16:47.278 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/5c4c245f7a144d0cbc20ae8979bde7eef39c2cbfabbbe58f33aecb12323f64ac/merged 2024-09-11T23:16:47.278 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/9ccd970c3aae07c618c7906bac5cab69ec4273cde331a59f1df9d87c2d0ede92/merged 2024-09-11T23:16:47.279 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/f3c71694a24ec627c0a90d159d326fad91934236695ad3aa89ea17b130ca5eb9/merged 2024-09-11T23:16:47.279 INFO:teuthology.orchestra.run.smithi037.stdout:/run/netns 2024-09-11T23:16:47.279 INFO:teuthology.orchestra.run.smithi037.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-11T23:16:47.279 INFO:teuthology.orchestra.run.smithi037.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-11T23:16:47.279 INFO:teuthology.orchestra.run.smithi037.stdout:/home/ubuntu/cephtest/mnt.admin 2024-09-11T23:16:47.280 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:16:47.280 DEBUG:teuthology.orchestra.run.smithi037:> ls /sys/fs/fuse/connections 2024-09-11T23:16:47.357 INFO:teuthology.orchestra.run.smithi037.stdout:120 2024-09-11T23:16:47.357 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [120] 2024-09-11T23:16:47.358 DEBUG:teuthology.orchestra.run.smithi037:> sudo stdin-killer -- python3 -c ' 2024-09-11T23:16:47.358 DEBUG:teuthology.orchestra.run.smithi037:> import glob 2024-09-11T23:16:47.358 DEBUG:teuthology.orchestra.run.smithi037:> import re 2024-09-11T23:16:47.358 DEBUG:teuthology.orchestra.run.smithi037:> import os 2024-09-11T23:16:47.358 DEBUG:teuthology.orchestra.run.smithi037:> import subprocess 2024-09-11T23:16:47.358 DEBUG:teuthology.orchestra.run.smithi037:> 2024-09-11T23:16:47.358 DEBUG:teuthology.orchestra.run.smithi037:> def _find_admin_socket(client_name): 2024-09-11T23:16:47.358 DEBUG:teuthology.orchestra.run.smithi037:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-09-11T23:16:47.358 DEBUG:teuthology.orchestra.run.smithi037:> files = glob.glob(asok_path) 2024-09-11T23:16:47.358 DEBUG:teuthology.orchestra.run.smithi037:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-09-11T23:16:47.358 DEBUG:teuthology.orchestra.run.smithi037:> 2024-09-11T23:16:47.358 DEBUG:teuthology.orchestra.run.smithi037:> # Given a non-glob path, it better be there 2024-09-11T23:16:47.358 DEBUG:teuthology.orchestra.run.smithi037:> if "*" not in asok_path: 2024-09-11T23:16:47.359 DEBUG:teuthology.orchestra.run.smithi037:> assert(len(files) == 1) 2024-09-11T23:16:47.359 DEBUG:teuthology.orchestra.run.smithi037:> return files[0] 2024-09-11T23:16:47.359 DEBUG:teuthology.orchestra.run.smithi037:> 2024-09-11T23:16:47.359 DEBUG:teuthology.orchestra.run.smithi037:> for f in files: 2024-09-11T23:16:47.359 DEBUG:teuthology.orchestra.run.smithi037:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-11T23:16:47.359 DEBUG:teuthology.orchestra.run.smithi037:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-11T23:16:47.359 DEBUG:teuthology.orchestra.run.smithi037:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-11T23:16:47.359 DEBUG:teuthology.orchestra.run.smithi037:> contents = proc_f.read() 2024-09-11T23:16:47.359 DEBUG:teuthology.orchestra.run.smithi037:> if mountpoint in contents: 2024-09-11T23:16:47.359 DEBUG:teuthology.orchestra.run.smithi037:> return f 2024-09-11T23:16:47.359 DEBUG:teuthology.orchestra.run.smithi037:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-11T23:16:47.359 DEBUG:teuthology.orchestra.run.smithi037:> 2024-09-11T23:16:47.359 DEBUG:teuthology.orchestra.run.smithi037:> print(_find_admin_socket("client.admin")) 2024-09-11T23:16:47.359 DEBUG:teuthology.orchestra.run.smithi037:> ' 2024-09-11T23:16:47.528 INFO:teuthology.orchestra.run.smithi037.stdout:/var/run/ceph/ceph-client.admin.74724.asok 2024-09-11T23:16:47.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:16:47.543 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.74724.asok 2024-09-11T23:16:47.544 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:16:47.544 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.74724.asok status 2024-09-11T23:16:47.730 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-11T23:16:47.731 INFO:teuthology.orchestra.run.smithi037.stdout: "metadata": { 2024-09-11T23:16:47.731 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_sha1": "b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc", 2024-09-11T23:16:47.731 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-11T23:16:47.731 INFO:teuthology.orchestra.run.smithi037.stdout: "entity_id": "admin", 2024-09-11T23:16:47.731 INFO:teuthology.orchestra.run.smithi037.stdout: "hostname": "smithi037", 2024-09-11T23:16:47.731 INFO:teuthology.orchestra.run.smithi037.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-09-11T23:16:47.731 INFO:teuthology.orchestra.run.smithi037.stdout: "pid": "74724", 2024-09-11T23:16:47.731 INFO:teuthology.orchestra.run.smithi037.stdout: "root": "/" 2024-09-11T23:16:47.731 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:16:47.731 INFO:teuthology.orchestra.run.smithi037.stdout: "dentry_count": 0, 2024-09-11T23:16:47.731 INFO:teuthology.orchestra.run.smithi037.stdout: "dentry_pinned_count": 0, 2024-09-11T23:16:47.731 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 24647, 2024-09-11T23:16:47.732 INFO:teuthology.orchestra.run.smithi037.stdout: "inst": { 2024-09-11T23:16:47.732 INFO:teuthology.orchestra.run.smithi037.stdout: "name": { 2024-09-11T23:16:47.732 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "client", 2024-09-11T23:16:47.732 INFO:teuthology.orchestra.run.smithi037.stdout: "num": 24647 2024-09-11T23:16:47.732 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:16:47.732 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": { 2024-09-11T23:16:47.732 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2024-09-11T23:16:47.732 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.37:0", 2024-09-11T23:16:47.732 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 533826860 2024-09-11T23:16:47.732 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:16:47.732 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:16:47.732 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": { 2024-09-11T23:16:47.732 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2024-09-11T23:16:47.732 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.37:0", 2024-09-11T23:16:47.733 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 533826860 2024-09-11T23:16:47.733 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:16:47.733 INFO:teuthology.orchestra.run.smithi037.stdout: "inst_str": "client.24647 172.21.15.37:0/533826860", 2024-09-11T23:16:47.733 INFO:teuthology.orchestra.run.smithi037.stdout: "addr_str": "172.21.15.37:0/533826860", 2024-09-11T23:16:47.733 INFO:teuthology.orchestra.run.smithi037.stdout: "inode_count": 1, 2024-09-11T23:16:47.733 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_epoch": 17, 2024-09-11T23:16:47.733 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_epoch": 91, 2024-09-11T23:16:47.733 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_epoch_barrier": 0, 2024-09-11T23:16:47.733 INFO:teuthology.orchestra.run.smithi037.stdout: "blocklisted": false, 2024-09-11T23:16:47.733 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs" 2024-09-11T23:16:47.733 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-11T23:16:47.743 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:16:47.743 DEBUG:teuthology.orchestra.run.smithi037:> stat --file-system '--printf=%T 2024-09-11T23:16:47.743 DEBUG:teuthology.orchestra.run.smithi037:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-09-11T23:16:47.779 INFO:teuthology.orchestra.run.smithi037.stdout:fuseblk 2024-09-11T23:16:47.780 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-09-11T23:16:47.780 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:16:47.780 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-09-11T23:16:47.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:47 smithi037 ceph-mon[30630]: pgmap v318: 129 pgs: 129 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:16:47.871 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-09-11T23:16:47.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:47 smithi160 ceph-mon[35055]: pgmap v318: 129 pgs: 129 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:16:47.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:47 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T23:16:47.981 INFO:teuthology.orchestra.run.smithi037.stdout:# file: . 2024-09-11T23:16:47.981 INFO:teuthology.orchestra.run.smithi037.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-09-11T23:16:47.981 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:16:47.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:16:47.989 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-11T23:16:47.989 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:16:48.000 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:47 smithi123 ceph-mon[35438]: pgmap v318: 129 pgs: 129 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:16:48.026 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph osd blocklist ls 2024-09-11T23:16:48.444 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:16:49.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:49.025+0000 7f1952000640 1 -- 172.21.15.37:0/3482182989 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f194c106f10 msgr2=0x7f194c10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:49.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:49.025+0000 7f1952000640 1 --2- 172.21.15.37:0/3482182989 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f194c106f10 0x7f194c10ea90 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1944009ca0 tx=0x7f194402a8c0 comp rx=0 tx=0).stop 2024-09-11T23:16:49.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:49.026+0000 7f1952000640 1 -- 172.21.15.37:0/3482182989 shutdown_connections 2024-09-11T23:16:49.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:49.026+0000 7f1952000640 1 --2- 172.21.15.37:0/3482182989 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f194c106f10 0x7f194c10ea90 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:49.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:49.026+0000 7f1952000640 1 --2- 172.21.15.37:0/3482182989 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f194c102790 0x7f194c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:49.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:49.026+0000 7f1952000640 1 --2- 172.21.15.37:0/3482182989 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f194c101de0 0x7f194c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:49.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:49.026+0000 7f1952000640 1 -- 172.21.15.37:0/3482182989 >> 172.21.15.37:0/3482182989 conn(0x7f194c0fd8c0 msgr2=0x7f194c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:49.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:49.026+0000 7f1952000640 1 -- 172.21.15.37:0/3482182989 shutdown_connections 2024-09-11T23:16:49.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:49.026+0000 7f1952000640 1 -- 172.21.15.37:0/3482182989 wait complete. 2024-09-11T23:16:49.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:49.027+0000 7f1952000640 1 Processor -- start 2024-09-11T23:16:49.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:49.027+0000 7f1952000640 1 -- start start 2024-09-11T23:16:49.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:49.027+0000 7f1952000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f194c101de0 0x7f194c19a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:49.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:49.027+0000 7f1952000640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f194c102790 0x7f194c19ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:49.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:49.027+0000 7f1952000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f194c106f10 0x7f194c19ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:49.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:49.027+0000 7f1952000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f194c111f70 con 0x7f194c106f10 2024-09-11T23:16:49.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:49.027+0000 7f1952000640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f194c111df0 con 0x7f194c101de0 2024-09-11T23:16:49.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:49.027+0000 7f1952000640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f194c1120f0 con 0x7f194c102790 2024-09-11T23:16:49.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:49.028+0000 7f194be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f194c106f10 0x7f194c19ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:49.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:49.028+0000 7f194be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f194c106f10 0x7f194c19ef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57362/0 (socket says 172.21.15.37:57362) 2024-09-11T23:16:49.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:49.028+0000 7f194b400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f194c101de0 0x7f194c19a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:49.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:49.028+0000 7f194be00640 1 -- 172.21.15.37:0/3436935750 learned_addr learned my addr 172.21.15.37:0/3436935750 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:16:49.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:49.028+0000 7f1942a00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f194c102790 0x7f194c19ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:49.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:49.028+0000 7f1942a00640 1 -- 172.21.15.37:0/3436935750 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f194c101de0 msgr2=0x7f194c19a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:49.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:49.028+0000 7f1942a00640 1 --2- 172.21.15.37:0/3436935750 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f194c101de0 0x7f194c19a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:49.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:49.028+0000 7f1942a00640 1 -- 172.21.15.37:0/3436935750 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f194c106f10 msgr2=0x7f194c19ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:49.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:49.028+0000 7f1942a00640 1 --2- 172.21.15.37:0/3436935750 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f194c106f10 0x7f194c19ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:49.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:49.028+0000 7f1942a00640 1 -- 172.21.15.37:0/3436935750 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f194c19f600 con 0x7f194c102790 2024-09-11T23:16:49.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:49.029+0000 7f1942a00640 1 --2- 172.21.15.37:0/3436935750 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f194c102790 0x7f194c19ab90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f193400e9f0 tx=0x7f193400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:49.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:49.029+0000 7f1948c00640 1 -- 172.21.15.37:0/3436935750 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f193400ccc0 con 0x7f194c102790 2024-09-11T23:16:49.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:49.029+0000 7f1952000640 1 -- 172.21.15.37:0/3436935750 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f194c19f8f0 con 0x7f194c102790 2024-09-11T23:16:49.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:49.029+0000 7f1948c00640 1 -- 172.21.15.37:0/3436935750 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1934005020 con 0x7f194c102790 2024-09-11T23:16:49.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:49.029+0000 7f1948c00640 1 -- 172.21.15.37:0/3436935750 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19340049e0 con 0x7f194c102790 2024-09-11T23:16:49.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:49.029+0000 7f1952000640 1 -- 172.21.15.37:0/3436935750 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f194c1a71d0 con 0x7f194c102790 2024-09-11T23:16:49.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:49.030+0000 7f1952000640 1 -- 172.21.15.37:0/3436935750 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f194c1021c0 con 0x7f194c102790 2024-09-11T23:16:49.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:49.032+0000 7f1948c00640 1 -- 172.21.15.37:0/3436935750 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f1934005560 con 0x7f194c102790 2024-09-11T23:16:49.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:49.033+0000 7f1948c00640 1 --2- 172.21.15.37:0/3436935750 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f19300a2c00 0x7f19300a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:49.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:49.034+0000 7f1948c00640 1 -- 172.21.15.37:0/3436935750 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8802+0+0 (secure 0 0 0) 0x7f19340cf150 con 0x7f194c102790 2024-09-11T23:16:49.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:49.034+0000 7f194b400640 1 --2- 172.21.15.37:0/3436935750 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f19300a2c00 0x7f19300a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:49.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:49.034+0000 7f194b400640 1 --2- 172.21.15.37:0/3436935750 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f19300a2c00 0x7f19300a50c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f193c009bd0 tx=0x7f193c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:49.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:49.038+0000 7f1948c00640 1 -- 172.21.15.37:0/3436935750 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f19340051d0 con 0x7f194c102790 2024-09-11T23:16:49.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:49.236+0000 7f1952000640 1 -- 172.21.15.37:0/3436935750 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f194c1a7430 con 0x7f194c102790 2024-09-11T23:16:49.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:49.236+0000 7f1948c00640 1 -- 172.21.15.37:0/3436935750 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v91) ==== 81+0+591 (secure 0 0 0) 0x7f193409be10 con 0x7f194c102790 2024-09-11T23:16:49.237 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:6801/2886800769 2024-09-12T23:08:51.934167+0000 2024-09-11T23:16:49.237 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/1811301224 2024-09-12T23:08:51.934167+0000 2024-09-11T23:16:49.237 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/513883980 2024-09-12T23:08:51.934167+0000 2024-09-11T23:16:49.237 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/3698260188 2024-09-12T23:08:23.793913+0000 2024-09-11T23:16:49.237 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:6800/2886800769 2024-09-12T23:08:51.934167+0000 2024-09-11T23:16:49.237 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/4134736061 2024-09-12T23:08:23.793913+0000 2024-09-11T23:16:49.237 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/3426758476 2024-09-12T23:08:51.934167+0000 2024-09-11T23:16:49.237 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/2545840561 2024-09-12T23:08:23.793913+0000 2024-09-11T23:16:49.237 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:6801/3447426643 2024-09-12T23:08:23.793913+0000 2024-09-11T23:16:49.237 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:6800/3447426643 2024-09-12T23:08:23.793913+0000 2024-09-11T23:16:49.238 INFO:teuthology.orchestra.run.smithi037.stderr:listed 10 entries 2024-09-11T23:16:49.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:49.238+0000 7f1952000640 1 -- 172.21.15.37:0/3436935750 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f19300a2c00 msgr2=0x7f19300a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:49.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:49.238+0000 7f1952000640 1 --2- 172.21.15.37:0/3436935750 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f19300a2c00 0x7f19300a50c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f193c009bd0 tx=0x7f193c005f90 comp rx=0 tx=0).stop 2024-09-11T23:16:49.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:49.238+0000 7f1952000640 1 -- 172.21.15.37:0/3436935750 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f194c102790 msgr2=0x7f194c19ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:49.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:49.238+0000 7f1952000640 1 --2- 172.21.15.37:0/3436935750 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f194c102790 0x7f194c19ab90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f193400e9f0 tx=0x7f193400eeb0 comp rx=0 tx=0).stop 2024-09-11T23:16:49.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:49.239+0000 7f1952000640 1 -- 172.21.15.37:0/3436935750 shutdown_connections 2024-09-11T23:16:49.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:49.239+0000 7f1952000640 1 --2- 172.21.15.37:0/3436935750 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f19300a2c00 0x7f19300a50c0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:49.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:49.239+0000 7f1952000640 1 --2- 172.21.15.37:0/3436935750 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f194c106f10 0x7f194c19ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:49.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:49.239+0000 7f1952000640 1 --2- 172.21.15.37:0/3436935750 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f194c102790 0x7f194c19ab90 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:49.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:49.239+0000 7f1952000640 1 --2- 172.21.15.37:0/3436935750 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f194c101de0 0x7f194c19a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:49.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:49.239+0000 7f1952000640 1 -- 172.21.15.37:0/3436935750 >> 172.21.15.37:0/3436935750 conn(0x7f194c0fd8c0 msgr2=0x7f194c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:49.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:49.239+0000 7f1952000640 1 -- 172.21.15.37:0/3436935750 shutdown_connections 2024-09-11T23:16:49.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:49.239+0000 7f1952000640 1 -- 172.21.15.37:0/3436935750 wait complete. 2024-09-11T23:16:49.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:49 smithi160 ceph-mon[35055]: pgmap v319: 129 pgs: 129 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:16:49.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:49 smithi160 ceph-mon[35055]: from='client.? 172.21.15.37:0/3436935750' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-11T23:16:49.978 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:49 smithi037 ceph-mon[30630]: pgmap v319: 129 pgs: 129 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:16:49.978 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:49 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/3436935750' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-11T23:16:50.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:49 smithi123 ceph-mon[35438]: pgmap v319: 129 pgs: 129 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:16:50.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:49 smithi123 ceph-mon[35438]: from='client.? 172.21.15.37:0/3436935750' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-11T23:16:50.016 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-11T23:16:50.016 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:16:50.053 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph osd blocklist ls 2024-09-11T23:16:50.471 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:16:51.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:51.102+0000 7f503e800640 1 -- 172.21.15.37:0/3146368297 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5038103ff0 msgr2=0x7f50381043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:51.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:51.102+0000 7f503e800640 1 --2- 172.21.15.37:0/3146368297 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5038103ff0 0x7f50381043d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f5028009900 tx=0x7f502802a410 comp rx=0 tx=0).stop 2024-09-11T23:16:51.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:51.102+0000 7f503e800640 1 -- 172.21.15.37:0/3146368297 shutdown_connections 2024-09-11T23:16:51.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:51.102+0000 7f503e800640 1 --2- 172.21.15.37:0/3146368297 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5038109120 0x7f5038110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:51.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:51.102+0000 7f503e800640 1 --2- 172.21.15.37:0/3146368297 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f50381049a0 0x7f50381089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:51.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:51.102+0000 7f503e800640 1 --2- 172.21.15.37:0/3146368297 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5038103ff0 0x7f50381043d0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:51.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:51.102+0000 7f503e800640 1 -- 172.21.15.37:0/3146368297 >> 172.21.15.37:0/3146368297 conn(0x7f50380ffa90 msgr2=0x7f5038101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:51.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:51.102+0000 7f503e800640 1 -- 172.21.15.37:0/3146368297 shutdown_connections 2024-09-11T23:16:51.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:51.102+0000 7f503e800640 1 -- 172.21.15.37:0/3146368297 wait complete. 2024-09-11T23:16:51.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:51.103+0000 7f503e800640 1 Processor -- start 2024-09-11T23:16:51.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:51.103+0000 7f503e800640 1 -- start start 2024-09-11T23:16:51.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:51.104+0000 7f503e800640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5038103ff0 0x7f503819a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:51.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:51.104+0000 7f503e800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50381049a0 0x7f503819ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:51.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:51.104+0000 7f503e800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5038109120 0x7f503819ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:51.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:51.104+0000 7f503e800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5038114170 con 0x7f50381049a0 2024-09-11T23:16:51.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:51.104+0000 7f503e800640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f5038113ff0 con 0x7f5038109120 2024-09-11T23:16:51.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:51.104+0000 7f503e800640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f50381142f0 con 0x7f5038103ff0 2024-09-11T23:16:51.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:51.104+0000 7f502fe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50381049a0 0x7f503819ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:51.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:51.104+0000 7f502fe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50381049a0 0x7f503819ab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57372/0 (socket says 172.21.15.37:57372) 2024-09-11T23:16:51.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:51.104+0000 7f5037400640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5038103ff0 0x7f503819a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:51.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:51.104+0000 7f502fe00640 1 -- 172.21.15.37:0/521558879 learned_addr learned my addr 172.21.15.37:0/521558879 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:16:51.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:51.104+0000 7f5037e00640 1 --2- 172.21.15.37:0/521558879 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5038109120 0x7f503819ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:51.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:51.105+0000 7f502fe00640 1 -- 172.21.15.37:0/521558879 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5038103ff0 msgr2=0x7f503819a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:51.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:51.105+0000 7f502fe00640 1 --2- 172.21.15.37:0/521558879 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5038103ff0 0x7f503819a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:51.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:51.105+0000 7f502fe00640 1 -- 172.21.15.37:0/521558879 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5038109120 msgr2=0x7f503819ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:51.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:51.105+0000 7f502fe00640 1 --2- 172.21.15.37:0/521558879 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5038109120 0x7f503819ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:51.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:51.105+0000 7f502fe00640 1 -- 172.21.15.37:0/521558879 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f503819f5e0 con 0x7f50381049a0 2024-09-11T23:16:51.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:51.105+0000 7f502fe00640 1 --2- 172.21.15.37:0/521558879 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50381049a0 0x7f503819ab70 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f502000d950 tx=0x7f502000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:51.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:51.105+0000 7f5034c00640 1 -- 172.21.15.37:0/521558879 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5020017030 con 0x7f50381049a0 2024-09-11T23:16:51.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:51.105+0000 7f5034c00640 1 -- 172.21.15.37:0/521558879 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5020004020 con 0x7f50381049a0 2024-09-11T23:16:51.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:51.105+0000 7f5034c00640 1 -- 172.21.15.37:0/521558879 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50200047a0 con 0x7f50381049a0 2024-09-11T23:16:51.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:51.105+0000 7f503e800640 1 -- 172.21.15.37:0/521558879 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f503819f8d0 con 0x7f50381049a0 2024-09-11T23:16:51.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:51.105+0000 7f503e800640 1 -- 172.21.15.37:0/521558879 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50381a71b0 con 0x7f50381049a0 2024-09-11T23:16:51.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:51.106+0000 7f503e800640 1 -- 172.21.15.37:0/521558879 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50381043d0 con 0x7f50381049a0 2024-09-11T23:16:51.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:51.108+0000 7f5034c00640 1 -- 172.21.15.37:0/521558879 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f50200041d0 con 0x7f50381049a0 2024-09-11T23:16:51.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:51.109+0000 7f5034c00640 1 --2- 172.21.15.37:0/521558879 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f501c0a2c00 0x7f501c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:51.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:51.110+0000 7f5034c00640 1 -- 172.21.15.37:0/521558879 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8802+0+0 (secure 0 0 0) 0x7f50200ceba0 con 0x7f50381049a0 2024-09-11T23:16:51.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:51.110+0000 7f5037400640 1 --2- 172.21.15.37:0/521558879 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f501c0a2c00 0x7f501c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:51.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:51.110+0000 7f5037400640 1 --2- 172.21.15.37:0/521558879 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f501c0a2c00 0x7f501c0a50c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5028000c00 tx=0x7f5028005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:51.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:51.114+0000 7f5034c00640 1 -- 172.21.15.37:0/521558879 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f502009b860 con 0x7f50381049a0 2024-09-11T23:16:51.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:51.313+0000 7f503e800640 1 -- 172.21.15.37:0/521558879 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f503802d7c0 con 0x7f50381049a0 2024-09-11T23:16:51.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:51.313+0000 7f5034c00640 1 -- 172.21.15.37:0/521558879 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v91) ==== 81+0+591 (secure 0 0 0) 0x7f502009b160 con 0x7f50381049a0 2024-09-11T23:16:51.314 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:6801/2886800769 2024-09-12T23:08:51.934167+0000 2024-09-11T23:16:51.314 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/1811301224 2024-09-12T23:08:51.934167+0000 2024-09-11T23:16:51.314 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/513883980 2024-09-12T23:08:51.934167+0000 2024-09-11T23:16:51.314 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/3698260188 2024-09-12T23:08:23.793913+0000 2024-09-11T23:16:51.314 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:6800/2886800769 2024-09-12T23:08:51.934167+0000 2024-09-11T23:16:51.314 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/4134736061 2024-09-12T23:08:23.793913+0000 2024-09-11T23:16:51.314 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/3426758476 2024-09-12T23:08:51.934167+0000 2024-09-11T23:16:51.314 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/2545840561 2024-09-12T23:08:23.793913+0000 2024-09-11T23:16:51.314 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:6801/3447426643 2024-09-12T23:08:23.793913+0000 2024-09-11T23:16:51.314 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:6800/3447426643 2024-09-12T23:08:23.793913+0000 2024-09-11T23:16:51.315 INFO:teuthology.orchestra.run.smithi037.stderr:listed 10 entries 2024-09-11T23:16:51.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:51.316+0000 7f503e800640 1 -- 172.21.15.37:0/521558879 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f501c0a2c00 msgr2=0x7f501c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:51.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:51.316+0000 7f503e800640 1 --2- 172.21.15.37:0/521558879 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f501c0a2c00 0x7f501c0a50c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5028000c00 tx=0x7f5028005b50 comp rx=0 tx=0).stop 2024-09-11T23:16:51.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:51.316+0000 7f503e800640 1 -- 172.21.15.37:0/521558879 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50381049a0 msgr2=0x7f503819ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:51.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:51.316+0000 7f503e800640 1 --2- 172.21.15.37:0/521558879 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50381049a0 0x7f503819ab70 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f502000d950 tx=0x7f502000de10 comp rx=0 tx=0).stop 2024-09-11T23:16:51.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:51.316+0000 7f503e800640 1 -- 172.21.15.37:0/521558879 shutdown_connections 2024-09-11T23:16:51.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:51.316+0000 7f503e800640 1 --2- 172.21.15.37:0/521558879 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f501c0a2c00 0x7f501c0a50c0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:51.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:51.316+0000 7f503e800640 1 --2- 172.21.15.37:0/521558879 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5038109120 0x7f503819ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:51.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:51.316+0000 7f503e800640 1 --2- 172.21.15.37:0/521558879 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50381049a0 0x7f503819ab70 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:51.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:51.316+0000 7f503e800640 1 --2- 172.21.15.37:0/521558879 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5038103ff0 0x7f503819a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:51.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:51.316+0000 7f503e800640 1 -- 172.21.15.37:0/521558879 >> 172.21.15.37:0/521558879 conn(0x7f50380ffa90 msgr2=0x7f5038100d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:51.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:51.316+0000 7f503e800640 1 -- 172.21.15.37:0/521558879 shutdown_connections 2024-09-11T23:16:51.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:51.316+0000 7f503e800640 1 -- 172.21.15.37:0/521558879 wait complete. 2024-09-11T23:16:51.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:51 smithi160 ceph-mon[35055]: pgmap v320: 129 pgs: 129 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:16:51.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:51 smithi160 ceph-mon[35055]: from='client.? 172.21.15.37:0/521558879' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-11T23:16:52.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:51 smithi123 ceph-mon[35438]: pgmap v320: 129 pgs: 129 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:16:52.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:51 smithi123 ceph-mon[35438]: from='client.? 172.21.15.37:0/521558879' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-11T23:16:52.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:51 smithi037 ceph-mon[30630]: pgmap v320: 129 pgs: 129 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:16:52.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:51 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/521558879' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-11T23:16:52.110 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi037.front.sepia.ceph.com... 2024-09-11T23:16:52.111 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:16:52.111 DEBUG:teuthology.orchestra.run.smithi037:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-09-11T23:16:52.167 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi037.stderr:ceph-fuse[74724]: fuse finished with error 0 and tester_r 0 2024-09-11T23:16:52.170 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:16:52.245 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi037.front.sepia.ceph.com 2024-09-11T23:16:52.246 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:16:52.246 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-09-11T23:16:52.292 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T23:16:52.677 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:16:52.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:52 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]: dispatch 2024-09-11T23:16:52.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:52 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]}]: dispatch 2024-09-11T23:16:52.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:52 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]: dispatch 2024-09-11T23:16:52.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:52 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]: dispatch 2024-09-11T23:16:52.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:52 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]: dispatch 2024-09-11T23:16:52.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:52 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 7]}]: dispatch 2024-09-11T23:16:52.935 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:52 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 7]}]: dispatch 2024-09-11T23:16:52.935 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:52 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 6]}]: dispatch 2024-09-11T23:16:52.935 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:52 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.30", "id": [1, 9]}]: dispatch 2024-09-11T23:16:52.935 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:52 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [5, 8]}]: dispatch 2024-09-11T23:16:52.991 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:52 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]: dispatch 2024-09-11T23:16:52.992 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:52 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]}]: dispatch 2024-09-11T23:16:52.992 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:52 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]: dispatch 2024-09-11T23:16:52.992 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:52 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]: dispatch 2024-09-11T23:16:52.992 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:52 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]: dispatch 2024-09-11T23:16:52.992 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:52 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 7]}]: dispatch 2024-09-11T23:16:52.992 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:52 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 7]}]: dispatch 2024-09-11T23:16:52.992 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:52 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 6]}]: dispatch 2024-09-11T23:16:52.992 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:52 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.30", "id": [1, 9]}]: dispatch 2024-09-11T23:16:52.992 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:52 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [5, 8]}]: dispatch 2024-09-11T23:16:53.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:52 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]: dispatch 2024-09-11T23:16:53.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:52 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]}]: dispatch 2024-09-11T23:16:53.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:52 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]: dispatch 2024-09-11T23:16:53.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:52 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]: dispatch 2024-09-11T23:16:53.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:52 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]: dispatch 2024-09-11T23:16:53.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:52 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 7]}]: dispatch 2024-09-11T23:16:53.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:52 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 7]}]: dispatch 2024-09-11T23:16:53.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:52 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 6]}]: dispatch 2024-09-11T23:16:53.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:52 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.30", "id": [1, 9]}]: dispatch 2024-09-11T23:16:53.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:52 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [5, 8]}]: dispatch 2024-09-11T23:16:53.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:53.240+0000 7f8356200640 1 -- 172.21.15.37:0/739018273 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8350074ee0 msgr2=0x7f835010dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:53.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:53.240+0000 7f8356200640 1 --2- 172.21.15.37:0/739018273 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8350074ee0 0x7f835010dd20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f833c009900 tx=0x7f833c02a480 comp rx=0 tx=0).stop 2024-09-11T23:16:53.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:53.240+0000 7f8356200640 1 -- 172.21.15.37:0/739018273 shutdown_connections 2024-09-11T23:16:53.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:53.240+0000 7f8356200640 1 --2- 172.21.15.37:0/739018273 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f835010e260 0x7f8350110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:53.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:53.240+0000 7f8356200640 1 --2- 172.21.15.37:0/739018273 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8350074ee0 0x7f835010dd20 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:53.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:53.240+0000 7f8356200640 1 --2- 172.21.15.37:0/739018273 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f83500745c0 0x7f83500749a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:53.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:53.240+0000 7f8356200640 1 -- 172.21.15.37:0/739018273 >> 172.21.15.37:0/739018273 conn(0x7f83500fd740 msgr2=0x7f83500ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:53.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:53.240+0000 7f8356200640 1 -- 172.21.15.37:0/739018273 shutdown_connections 2024-09-11T23:16:53.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:53.240+0000 7f8356200640 1 -- 172.21.15.37:0/739018273 wait complete. 2024-09-11T23:16:53.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:53.241+0000 7f8356200640 1 Processor -- start 2024-09-11T23:16:53.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:53.242+0000 7f8356200640 1 -- start start 2024-09-11T23:16:53.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:53.242+0000 7f8356200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83500745c0 0x7f835019a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:53.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:53.242+0000 7f8356200640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8350074ee0 0x7f835019aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:53.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:53.242+0000 7f8356200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f835010e260 0x7f835019ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:53.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:53.242+0000 7f8356200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8350113fb0 con 0x7f835010e260 2024-09-11T23:16:53.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:53.242+0000 7f8356200640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f8350113e30 con 0x7f83500745c0 2024-09-11T23:16:53.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:53.242+0000 7f8356200640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f8350114130 con 0x7f8350074ee0 2024-09-11T23:16:53.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:53.242+0000 7f8354e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83500745c0 0x7f835019a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:53.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:53.242+0000 7f8354e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83500745c0 0x7f835019a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.37:60386/0 (socket says 172.21.15.37:60386) 2024-09-11T23:16:53.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:53.242+0000 7f834fe00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8350074ee0 0x7f835019aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:53.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:53.242+0000 7f8355800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f835010e260 0x7f835019ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:53.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:53.242+0000 7f8354e00640 1 -- 172.21.15.37:0/3794542156 learned_addr learned my addr 172.21.15.37:0/3794542156 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:16:53.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:53.243+0000 7f8354e00640 1 -- 172.21.15.37:0/3794542156 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8350074ee0 msgr2=0x7f835019aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:53.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:53.243+0000 7f8354e00640 1 --2- 172.21.15.37:0/3794542156 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8350074ee0 0x7f835019aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:53.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:53.243+0000 7f8354e00640 1 -- 172.21.15.37:0/3794542156 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f835010e260 msgr2=0x7f835019ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:53.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:53.243+0000 7f8354e00640 1 --2- 172.21.15.37:0/3794542156 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f835010e260 0x7f835019ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:53.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:53.243+0000 7f8354e00640 1 -- 172.21.15.37:0/3794542156 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f835019f4e0 con 0x7f83500745c0 2024-09-11T23:16:53.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:53.243+0000 7f8354e00640 1 --2- 172.21.15.37:0/3794542156 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83500745c0 0x7f835019a530 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f834400e9f0 tx=0x7f834400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:53.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:53.244+0000 7f834d600640 1 -- 172.21.15.37:0/3794542156 <== mon.2 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f834400cd80 con 0x7f83500745c0 2024-09-11T23:16:53.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:53.244+0000 7f8356200640 1 -- 172.21.15.37:0/3794542156 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f835019f7d0 con 0x7f83500745c0 2024-09-11T23:16:53.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:53.244+0000 7f834d600640 1 -- 172.21.15.37:0/3794542156 <== mon.2 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8344010910 con 0x7f83500745c0 2024-09-11T23:16:53.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:53.244+0000 7f834d600640 1 -- 172.21.15.37:0/3794542156 <== mon.2 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8344018980 con 0x7f83500745c0 2024-09-11T23:16:53.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:53.244+0000 7f8356200640 1 -- 172.21.15.37:0/3794542156 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83501a70b0 con 0x7f83500745c0 2024-09-11T23:16:53.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:53.245+0000 7f8356200640 1 -- 172.21.15.37:0/3794542156 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83500749a0 con 0x7f83500745c0 2024-09-11T23:16:53.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:53.247+0000 7f834d600640 1 -- 172.21.15.37:0/3794542156 <== mon.2 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f8344010ac0 con 0x7f83500745c0 2024-09-11T23:16:53.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:53.248+0000 7f834d600640 1 --2- 172.21.15.37:0/3794542156 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f83380a2b80 0x7f83380a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:53.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:53.248+0000 7f834d600640 1 -- 172.21.15.37:0/3794542156 <== mon.2 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f83440cfcc0 con 0x7f83500745c0 2024-09-11T23:16:53.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:53.249+0000 7f834fe00640 1 --2- 172.21.15.37:0/3794542156 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f83380a2b80 0x7f83380a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:53.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:53.249+0000 7f834fe00640 1 --2- 172.21.15.37:0/3794542156 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f83380a2b80 0x7f83380a5040 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f833c009230 tx=0x7f833c0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:53.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:53.250+0000 7f834d600640 1 -- 172.21.15.37:0/3794542156 <== mon.2 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f834409c210 con 0x7f83500745c0 2024-09-11T23:16:53.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:53.438+0000 7f8356200640 1 -- 172.21.15.37:0/3794542156 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f835019b890 con 0x7f83500745c0 2024-09-11T23:16:53.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:53.440+0000 7f834d600640 1 -- 172.21.15.37:0/3794542156 <== mon.2 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) ==== 74+0+24669 (secure 0 0 0) 0x7f83440a0510 con 0x7f83500745c0 2024-09-11T23:16:53.441 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:16:53.441 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":92,"fsid":"8b03efce-7092-11ef-bcea-c7b262605968","created":"2024-09-11T23:07:59.386838+0000","modified":"2024-09-11T23:16:52.653362+0000","last_up_change":"2024-09-11T23:15:16.985748+0000","last_in_change":"2024-09-11T23:14:54.154116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:11:16.547642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:16:11.075859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T23:16:14.019910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-11T23:16:22.041463+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f76ccb11-fe3b-4df1-9a71-e6ca50de80e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1678472768},{"type":"v1","addr":"172.21.15.37:6803","nonce":1678472768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1678472768},{"type":"v1","addr":"172.21.15.37:6805","nonce":1678472768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1678472768},{"type":"v1","addr":"172.21.15.37:6809","nonce":1678472768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1678472768},{"type":"v1","addr":"172.21.15.37:6807","nonce":1678472768}]},"public_addr":"172.21.15.37:6803/1678472768","cluster_addr":"172.21.15.37:6805/1678472768","heartbeat_back_addr":"172.21.15.37:6809/1678472768","heartbeat_front_addr":"172.21.15.37:6807/1678472768","state":["exists","up"]},{"osd":1,"uuid":"13d26eed-1160-4b15-b66b-66c89066c66f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":141504725},{"type":"v1","addr":"172.21.15.123:6801","nonce":141504725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":141504725},{"type":"v1","addr":"172.21.15.123:6803","nonce":141504725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":141504725},{"type":"v1","addr":"172.21.15.123:6807","nonce":141504725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":141504725},{"type":"v1","addr":"172.21.15.123:6805","nonce":141504725}]},"public_addr":"172.21.15.123:6801/141504725","cluster_addr":"172.21.15.123:6803/141504725","heartbeat_back_addr":"172.21.15.123:6807/141504725","heartbeat_front_addr":"172.21.15.123:6805/141504725","state":["exists","up"]},{"osd":2,"uuid":"53daf4d5-2a43-4a89-bae9-f32b89b517f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":1866489133},{"type":"v1","addr":"172.21.15.160:6801","nonce":1866489133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":1866489133},{"type":"v1","addr":"172.21.15.160:6803","nonce":1866489133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":1866489133},{"type":"v1","addr":"172.21.15.160:6807","nonce":1866489133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":1866489133},{"type":"v1","addr":"172.21.15.160:6805","nonce":1866489133}]},"public_addr":"172.21.15.160:6801/1866489133","cluster_addr":"172.21.15.160:6803/1866489133","heartbeat_back_addr":"172.21.15.160:6807/1866489133","heartbeat_front_addr":"172.21.15.160:6805/1866489133","state":["exists","up"]},{"osd":3,"uuid":"7c819225-964b-44f2-93e5-1d7585eb0b36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":412656036},{"type":"v1","addr":"172.21.15.37:6811","nonce":412656036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":412656036},{"type":"v1","addr":"172.21.15.37:6813","nonce":412656036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":412656036},{"type":"v1","addr":"172.21.15.37:6817","nonce":412656036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":412656036},{"type":"v1","addr":"172.21.15.37:6815","nonce":412656036}]},"public_addr":"172.21.15.37:6811/412656036","cluster_addr":"172.21.15.37:6813/412656036","heartbeat_back_addr":"172.21.15.37:6817/412656036","heartbeat_front_addr":"172.21.15.37:6815/412656036","state":["exists","up"]},{"osd":4,"uuid":"e5ab5638-8c7e-4433-8dd0-ba57e28f39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":3228822066},{"type":"v1","addr":"172.21.15.123:6809","nonce":3228822066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":3228822066},{"type":"v1","addr":"172.21.15.123:6811","nonce":3228822066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":3228822066},{"type":"v1","addr":"172.21.15.123:6815","nonce":3228822066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":3228822066},{"type":"v1","addr":"172.21.15.123:6813","nonce":3228822066}]},"public_addr":"172.21.15.123:6809/3228822066","cluster_addr":"172.21.15.123:6811/3228822066","heartbeat_back_addr":"172.21.15.123:6815/3228822066","heartbeat_front_addr":"172.21.15.123:6813/3228822066","state":["exists","up"]},{"osd":5,"uuid":"7f080d49-eec8-4cd9-b410-b2e84139292e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":1618319675},{"type":"v1","addr":"172.21.15.160:6809","nonce":1618319675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":1618319675},{"type":"v1","addr":"172.21.15.160:6811","nonce":1618319675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":1618319675},{"type":"v1","addr":"172.21.15.160:6815","nonce":1618319675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":1618319675},{"type":"v1","addr":"172.21.15.160:6813","nonce":1618319675}]},"public_addr":"172.21.15.160:6809/1618319675","cluster_addr":"172.21.15.160:6811/1618319675","heartbeat_back_addr":"172.21.15.160:6815/1618319675","heartbeat_front_addr":"172.21.15.160:6813/1618319675","state":["exists","up"]},{"osd":6,"uuid":"d0881c4e-bd8d-4575-8c81-94d21825c227","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3541251299},{"type":"v1","addr":"172.21.15.37:6819","nonce":3541251299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3541251299},{"type":"v1","addr":"172.21.15.37:6821","nonce":3541251299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":3541251299},{"type":"v1","addr":"172.21.15.37:6825","nonce":3541251299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3541251299},{"type":"v1","addr":"172.21.15.37:6823","nonce":3541251299}]},"public_addr":"172.21.15.37:6819/3541251299","cluster_addr":"172.21.15.37:6821/3541251299","heartbeat_back_addr":"172.21.15.37:6825/3541251299","heartbeat_front_addr":"172.21.15.37:6823/3541251299","state":["exists","up"]},{"osd":7,"uuid":"04fbec2e-91b5-4a89-a4a3-472398c45288","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":4279933341},{"type":"v1","addr":"172.21.15.123:6817","nonce":4279933341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":4279933341},{"type":"v1","addr":"172.21.15.123:6819","nonce":4279933341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":4279933341},{"type":"v1","addr":"172.21.15.123:6823","nonce":4279933341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":4279933341},{"type":"v1","addr":"172.21.15.123:6821","nonce":4279933341}]},"public_addr":"172.21.15.123:6817/4279933341","cluster_addr":"172.21.15.123:6819/4279933341","heartbeat_back_addr":"172.21.15.123:6823/4279933341","heartbeat_front_addr":"172.21.15.123:6821/4279933341","state":["exists","up"]},{"osd":8,"uuid":"c77090a7-308e-4c6d-a56e-ce6f8e050ae5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":740968584},{"type":"v1","addr":"172.21.15.160:6817","nonce":740968584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":740968584},{"type":"v1","addr":"172.21.15.160:6819","nonce":740968584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":740968584},{"type":"v1","addr":"172.21.15.160:6823","nonce":740968584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":740968584},{"type":"v1","addr":"172.21.15.160:6821","nonce":740968584}]},"public_addr":"172.21.15.160:6817/740968584","cluster_addr":"172.21.15.160:6819/740968584","heartbeat_back_addr":"172.21.15.160:6823/740968584","heartbeat_front_addr":"172.21.15.160:6821/740968584","state":["exists","up"]},{"osd":9,"uuid":"bcd19bd4-88bc-46f7-b48c-af9e3d17aa96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":692114850},{"type":"v1","addr":"172.21.15.37:6827","nonce":692114850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":692114850},{"type":"v1","addr":"172.21.15.37:6829","nonce":692114850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":692114850},{"type":"v1","addr":"172.21.15.37:6833","nonce":692114850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":692114850},{"type":"v1","addr":"172.21.15.37:6831","nonce":692114850}]},"public_addr":"172.21.15.37:6827/692114850","cluster_addr":"172.21.15.37:6829/692114850","heartbeat_back_addr":"172.21.15.37:6833/692114850","heartbeat_front_addr":"172.21.15.37:6831/692114850","state":["exists","up"]},{"osd":10,"uuid":"9e956e6c-c28a-4a4c-b385-c458788858ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":471058996},{"type":"v1","addr":"172.21.15.123:6825","nonce":471058996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":471058996},{"type":"v1","addr":"172.21.15.123:6827","nonce":471058996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":471058996},{"type":"v1","addr":"172.21.15.123:6831","nonce":471058996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":471058996},{"type":"v1","addr":"172.21.15.123:6829","nonce":471058996}]},"public_addr":"172.21.15.123:6825/471058996","cluster_addr":"172.21.15.123:6827/471058996","heartbeat_back_addr":"172.21.15.123:6831/471058996","heartbeat_front_addr":"172.21.15.123:6829/471058996","state":["exists","up"]},{"osd":11,"uuid":"0b5b3364-9a40-4cab-90d4-b7b1cba57bc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":3982315018},{"type":"v1","addr":"172.21.15.160:6825","nonce":3982315018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3982315018},{"type":"v1","addr":"172.21.15.160:6827","nonce":3982315018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3982315018},{"type":"v1","addr":"172.21.15.160:6831","nonce":3982315018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3982315018},{"type":"v1","addr":"172.21.15.160:6829","nonce":3982315018}]},"public_addr":"172.21.15.160:6825/3982315018","cluster_addr":"172.21.15.160:6827/3982315018","heartbeat_back_addr":"172.21.15.160:6831/3982315018","heartbeat_front_addr":"172.21.15.160:6829/3982315018","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:10:21.139833+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:10:47.004960+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:11:11.460263+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:11:40.849286+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:12:06.497448+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:12:32.043206+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:13:01.402019+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:13:27.993489+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:13:52.291643+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:23.840299+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:49.448254+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:15:15.310947+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":7}]},{"pgid":"3.17","mappings":[{"from":4,"to":7}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.30","mappings":[{"from":1,"to":9}]},{"pgid":"3.38","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:6801/2886800769":"2024-09-12T23:08:51.934167+0000","172.21.15.37:0/1811301224":"2024-09-12T23:08:51.934167+0000","172.21.15.37:0/513883980":"2024-09-12T23:08:51.934167+0000","172.21.15.37:0/3698260188":"2024-09-12T23:08:23.793913+0000","172.21.15.37:6800/2886800769":"2024-09-12T23:08:51.934167+0000","172.21.15.37:0/4134736061":"2024-09-12T23:08:23.793913+0000","172.21.15.37:0/3426758476":"2024-09-12T23:08:51.934167+0000","172.21.15.37:0/2545840561":"2024-09-12T23:08:23.793913+0000","172.21.15.37:6801/3447426643":"2024-09-12T23:08:23.793913+0000","172.21.15.37:6800/3447426643":"2024-09-12T23:08:23.793913+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:16:53.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:53.442+0000 7f8356200640 1 -- 172.21.15.37:0/3794542156 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f83380a2b80 msgr2=0x7f83380a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:53.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:53.442+0000 7f8356200640 1 --2- 172.21.15.37:0/3794542156 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f83380a2b80 0x7f83380a5040 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f833c009230 tx=0x7f833c0058d0 comp rx=0 tx=0).stop 2024-09-11T23:16:53.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:53.442+0000 7f8356200640 1 -- 172.21.15.37:0/3794542156 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83500745c0 msgr2=0x7f835019a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:53.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:53.442+0000 7f8356200640 1 --2- 172.21.15.37:0/3794542156 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83500745c0 0x7f835019a530 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f834400e9f0 tx=0x7f834400eeb0 comp rx=0 tx=0).stop 2024-09-11T23:16:53.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:53.442+0000 7f8356200640 1 -- 172.21.15.37:0/3794542156 shutdown_connections 2024-09-11T23:16:53.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:53.442+0000 7f8356200640 1 --2- 172.21.15.37:0/3794542156 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f83380a2b80 0x7f83380a5040 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:53.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:53.442+0000 7f8356200640 1 --2- 172.21.15.37:0/3794542156 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f835010e260 0x7f835019ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:53.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:53.442+0000 7f8356200640 1 --2- 172.21.15.37:0/3794542156 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8350074ee0 0x7f835019aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:53.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:53.442+0000 7f8356200640 1 --2- 172.21.15.37:0/3794542156 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83500745c0 0x7f835019a530 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:53.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:53.442+0000 7f8356200640 1 -- 172.21.15.37:0/3794542156 >> 172.21.15.37:0/3794542156 conn(0x7f83500fd740 msgr2=0x7f83500fe440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:53.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:53.442+0000 7f8356200640 1 -- 172.21.15.37:0/3794542156 shutdown_connections 2024-09-11T23:16:53.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:53.442+0000 7f8356200640 1 -- 172.21.15.37:0/3794542156 wait complete. 2024-09-11T23:16:53.821 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:53 smithi037 ceph-mon[30630]: pgmap v321: 129 pgs: 129 active+clean; 581 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-11T23:16:53.821 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:53 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]': finished 2024-09-11T23:16:53.821 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:53 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]}]': finished 2024-09-11T23:16:53.821 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:53 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]': finished 2024-09-11T23:16:53.821 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:53 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]': finished 2024-09-11T23:16:53.821 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:53 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]': finished 2024-09-11T23:16:53.821 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:53 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 7]}]': finished 2024-09-11T23:16:53.822 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:53 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 7]}]': finished 2024-09-11T23:16:53.822 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:53 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 6]}]': finished 2024-09-11T23:16:53.822 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:53 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.30", "id": [1, 9]}]': finished 2024-09-11T23:16:53.822 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:53 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [5, 8]}]': finished 2024-09-11T23:16:53.822 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:53 smithi037 ceph-mon[30630]: osdmap e92: 12 total, 12 up, 12 in 2024-09-11T23:16:53.822 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:53 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/3794542156' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:16:53.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:53 smithi160 ceph-mon[35055]: pgmap v321: 129 pgs: 129 active+clean; 581 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-11T23:16:53.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:53 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]': finished 2024-09-11T23:16:53.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:53 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]}]': finished 2024-09-11T23:16:53.935 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:53 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]': finished 2024-09-11T23:16:53.935 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:53 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]': finished 2024-09-11T23:16:53.935 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:53 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]': finished 2024-09-11T23:16:53.935 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:53 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 7]}]': finished 2024-09-11T23:16:53.935 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:53 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 7]}]': finished 2024-09-11T23:16:53.936 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:53 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 6]}]': finished 2024-09-11T23:16:53.936 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:53 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.30", "id": [1, 9]}]': finished 2024-09-11T23:16:53.936 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:53 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [5, 8]}]': finished 2024-09-11T23:16:53.936 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:53 smithi160 ceph-mon[35055]: osdmap e92: 12 total, 12 up, 12 in 2024-09-11T23:16:53.936 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:53 smithi160 ceph-mon[35055]: from='client.? 172.21.15.37:0/3794542156' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:16:54.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:53 smithi123 ceph-mon[35438]: pgmap v321: 129 pgs: 129 active+clean; 581 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-11T23:16:54.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:53 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]': finished 2024-09-11T23:16:54.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:53 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]}]': finished 2024-09-11T23:16:54.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:53 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]': finished 2024-09-11T23:16:54.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:53 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]': finished 2024-09-11T23:16:54.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:53 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]': finished 2024-09-11T23:16:54.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:53 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 7]}]': finished 2024-09-11T23:16:54.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:53 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 7]}]': finished 2024-09-11T23:16:54.002 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:53 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 6]}]': finished 2024-09-11T23:16:54.002 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:53 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.30", "id": [1, 9]}]': finished 2024-09-11T23:16:54.002 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:53 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [5, 8]}]': finished 2024-09-11T23:16:54.002 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:53 smithi123 ceph-mon[35438]: osdmap e92: 12 total, 12 up, 12 in 2024-09-11T23:16:54.002 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:53 smithi123 ceph-mon[35438]: from='client.? 172.21.15.37:0/3794542156' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:16:54.204 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T23:16:54.580 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:16:54.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:54 smithi160 ceph-mon[35055]: osdmap e93: 12 total, 12 up, 12 in 2024-09-11T23:16:55.000 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:54 smithi123 ceph-mon[35438]: osdmap e93: 12 total, 12 up, 12 in 2024-09-11T23:16:55.053 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:54 smithi037 ceph-mon[30630]: osdmap e93: 12 total, 12 up, 12 in 2024-09-11T23:16:55.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:55.167+0000 7fb426e00640 1 -- 172.21.15.37:0/3969149016 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb420074f40 msgr2=0x7fb42010de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:55.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:55.167+0000 7fb426e00640 1 --2- 172.21.15.37:0/3969149016 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb420074f40 0x7fb42010de80 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fb408009900 tx=0x7fb40802a480 comp rx=0 tx=0).stop 2024-09-11T23:16:55.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:55.168+0000 7fb426e00640 1 -- 172.21.15.37:0/3969149016 shutdown_connections 2024-09-11T23:16:55.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:55.168+0000 7fb426e00640 1 --2- 172.21.15.37:0/3969149016 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb42010e3c0 0x7fb420110810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:55.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:55.168+0000 7fb426e00640 1 --2- 172.21.15.37:0/3969149016 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb420074f40 0x7fb42010de80 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:55.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:55.168+0000 7fb426e00640 1 --2- 172.21.15.37:0/3969149016 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb420074620 0x7fb420074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:55.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:55.168+0000 7fb426e00640 1 -- 172.21.15.37:0/3969149016 >> 172.21.15.37:0/3969149016 conn(0x7fb4200fd8c0 msgr2=0x7fb4200ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:55.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:55.168+0000 7fb426e00640 1 -- 172.21.15.37:0/3969149016 shutdown_connections 2024-09-11T23:16:55.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:55.168+0000 7fb426e00640 1 -- 172.21.15.37:0/3969149016 wait complete. 2024-09-11T23:16:55.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:55.169+0000 7fb426e00640 1 Processor -- start 2024-09-11T23:16:55.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:55.169+0000 7fb426e00640 1 -- start start 2024-09-11T23:16:55.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:55.169+0000 7fb426e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb420074620 0x7fb42019a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:55.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:55.169+0000 7fb426e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb420074f40 0x7fb42019abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:55.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:55.169+0000 7fb426e00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb42010e3c0 0x7fb42019ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:55.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:55.169+0000 7fb426e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb420114140 con 0x7fb420074620 2024-09-11T23:16:55.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:55.169+0000 7fb426e00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fb420113fc0 con 0x7fb420074f40 2024-09-11T23:16:55.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:55.169+0000 7fb426e00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fb4201142c0 con 0x7fb42010e3c0 2024-09-11T23:16:55.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:55.169+0000 7fb41fe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb420074620 0x7fb42019a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:55.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:55.170+0000 7fb41fe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb420074620 0x7fb42019a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57414/0 (socket says 172.21.15.37:57414) 2024-09-11T23:16:55.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:55.170+0000 7fb41fe00640 1 -- 172.21.15.37:0/3592328954 learned_addr learned my addr 172.21.15.37:0/3592328954 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:16:55.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:55.170+0000 7fb417400640 1 --2- 172.21.15.37:0/3592328954 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb420074f40 0x7fb42019abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:55.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:55.170+0000 7fb424e00640 1 --2- 172.21.15.37:0/3592328954 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb42010e3c0 0x7fb42019ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:55.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:55.170+0000 7fb41fe00640 1 -- 172.21.15.37:0/3592328954 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb42010e3c0 msgr2=0x7fb42019ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:55.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:55.170+0000 7fb41fe00640 1 --2- 172.21.15.37:0/3592328954 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb42010e3c0 0x7fb42019ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:55.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:55.170+0000 7fb41fe00640 1 -- 172.21.15.37:0/3592328954 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb420074f40 msgr2=0x7fb42019abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:55.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:55.170+0000 7fb41fe00640 1 --2- 172.21.15.37:0/3592328954 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb420074f40 0x7fb42019abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:55.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:55.170+0000 7fb41fe00640 1 -- 172.21.15.37:0/3592328954 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb42019f630 con 0x7fb420074620 2024-09-11T23:16:55.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:55.170+0000 7fb41fe00640 1 --2- 172.21.15.37:0/3592328954 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb420074620 0x7fb42019a680 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb41000e9f0 tx=0x7fb41000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:55.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:55.171+0000 7fb41d600640 1 -- 172.21.15.37:0/3592328954 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb41000cd80 con 0x7fb420074620 2024-09-11T23:16:55.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:55.171+0000 7fb41d600640 1 -- 172.21.15.37:0/3592328954 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb410010910 con 0x7fb420074620 2024-09-11T23:16:55.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:55.171+0000 7fb41d600640 1 -- 172.21.15.37:0/3592328954 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb410018990 con 0x7fb420074620 2024-09-11T23:16:55.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:55.171+0000 7fb426e00640 1 -- 172.21.15.37:0/3592328954 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb42019f920 con 0x7fb420074620 2024-09-11T23:16:55.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:55.171+0000 7fb426e00640 1 -- 172.21.15.37:0/3592328954 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4201a7200 con 0x7fb420074620 2024-09-11T23:16:55.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:55.172+0000 7fb426e00640 1 -- 172.21.15.37:0/3592328954 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb420074a00 con 0x7fb420074620 2024-09-11T23:16:55.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:55.174+0000 7fb41d600640 1 -- 172.21.15.37:0/3592328954 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fb410010ac0 con 0x7fb420074620 2024-09-11T23:16:55.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:55.175+0000 7fb41d600640 1 --2- 172.21.15.37:0/3592328954 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fb4040a2c00 0x7fb4040a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:55.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:55.175+0000 7fb41d600640 1 -- 172.21.15.37:0/3592328954 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9092+0+0 (secure 0 0 0) 0x7fb4100cfa90 con 0x7fb420074620 2024-09-11T23:16:55.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:55.176+0000 7fb417400640 1 --2- 172.21.15.37:0/3592328954 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fb4040a2c00 0x7fb4040a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:55.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:55.176+0000 7fb417400640 1 --2- 172.21.15.37:0/3592328954 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fb4040a2c00 0x7fb4040a50c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb408009230 tx=0x7fb4080058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:55.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:55.178+0000 7fb41d600640 1 -- 172.21.15.37:0/3592328954 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb41009bfe0 con 0x7fb420074620 2024-09-11T23:16:55.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:55.366+0000 7fb426e00640 1 -- 172.21.15.37:0/3592328954 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb4201095a0 con 0x7fb420074620 2024-09-11T23:16:55.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:55.368+0000 7fb41d600640 1 -- 172.21.15.37:0/3592328954 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) ==== 74+0+24669 (secure 0 0 0) 0x7fb4100a02e0 con 0x7fb420074620 2024-09-11T23:16:55.368 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:16:55.369 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":93,"fsid":"8b03efce-7092-11ef-bcea-c7b262605968","created":"2024-09-11T23:07:59.386838+0000","modified":"2024-09-11T23:16:53.660246+0000","last_up_change":"2024-09-11T23:15:16.985748+0000","last_in_change":"2024-09-11T23:14:54.154116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:11:16.547642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:16:11.075859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T23:16:14.019910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-11T23:16:22.041463+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f76ccb11-fe3b-4df1-9a71-e6ca50de80e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1678472768},{"type":"v1","addr":"172.21.15.37:6803","nonce":1678472768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1678472768},{"type":"v1","addr":"172.21.15.37:6805","nonce":1678472768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1678472768},{"type":"v1","addr":"172.21.15.37:6809","nonce":1678472768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1678472768},{"type":"v1","addr":"172.21.15.37:6807","nonce":1678472768}]},"public_addr":"172.21.15.37:6803/1678472768","cluster_addr":"172.21.15.37:6805/1678472768","heartbeat_back_addr":"172.21.15.37:6809/1678472768","heartbeat_front_addr":"172.21.15.37:6807/1678472768","state":["exists","up"]},{"osd":1,"uuid":"13d26eed-1160-4b15-b66b-66c89066c66f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":141504725},{"type":"v1","addr":"172.21.15.123:6801","nonce":141504725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":141504725},{"type":"v1","addr":"172.21.15.123:6803","nonce":141504725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":141504725},{"type":"v1","addr":"172.21.15.123:6807","nonce":141504725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":141504725},{"type":"v1","addr":"172.21.15.123:6805","nonce":141504725}]},"public_addr":"172.21.15.123:6801/141504725","cluster_addr":"172.21.15.123:6803/141504725","heartbeat_back_addr":"172.21.15.123:6807/141504725","heartbeat_front_addr":"172.21.15.123:6805/141504725","state":["exists","up"]},{"osd":2,"uuid":"53daf4d5-2a43-4a89-bae9-f32b89b517f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":1866489133},{"type":"v1","addr":"172.21.15.160:6801","nonce":1866489133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":1866489133},{"type":"v1","addr":"172.21.15.160:6803","nonce":1866489133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":1866489133},{"type":"v1","addr":"172.21.15.160:6807","nonce":1866489133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":1866489133},{"type":"v1","addr":"172.21.15.160:6805","nonce":1866489133}]},"public_addr":"172.21.15.160:6801/1866489133","cluster_addr":"172.21.15.160:6803/1866489133","heartbeat_back_addr":"172.21.15.160:6807/1866489133","heartbeat_front_addr":"172.21.15.160:6805/1866489133","state":["exists","up"]},{"osd":3,"uuid":"7c819225-964b-44f2-93e5-1d7585eb0b36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":412656036},{"type":"v1","addr":"172.21.15.37:6811","nonce":412656036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":412656036},{"type":"v1","addr":"172.21.15.37:6813","nonce":412656036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":412656036},{"type":"v1","addr":"172.21.15.37:6817","nonce":412656036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":412656036},{"type":"v1","addr":"172.21.15.37:6815","nonce":412656036}]},"public_addr":"172.21.15.37:6811/412656036","cluster_addr":"172.21.15.37:6813/412656036","heartbeat_back_addr":"172.21.15.37:6817/412656036","heartbeat_front_addr":"172.21.15.37:6815/412656036","state":["exists","up"]},{"osd":4,"uuid":"e5ab5638-8c7e-4433-8dd0-ba57e28f39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":3228822066},{"type":"v1","addr":"172.21.15.123:6809","nonce":3228822066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":3228822066},{"type":"v1","addr":"172.21.15.123:6811","nonce":3228822066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":3228822066},{"type":"v1","addr":"172.21.15.123:6815","nonce":3228822066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":3228822066},{"type":"v1","addr":"172.21.15.123:6813","nonce":3228822066}]},"public_addr":"172.21.15.123:6809/3228822066","cluster_addr":"172.21.15.123:6811/3228822066","heartbeat_back_addr":"172.21.15.123:6815/3228822066","heartbeat_front_addr":"172.21.15.123:6813/3228822066","state":["exists","up"]},{"osd":5,"uuid":"7f080d49-eec8-4cd9-b410-b2e84139292e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":1618319675},{"type":"v1","addr":"172.21.15.160:6809","nonce":1618319675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":1618319675},{"type":"v1","addr":"172.21.15.160:6811","nonce":1618319675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":1618319675},{"type":"v1","addr":"172.21.15.160:6815","nonce":1618319675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":1618319675},{"type":"v1","addr":"172.21.15.160:6813","nonce":1618319675}]},"public_addr":"172.21.15.160:6809/1618319675","cluster_addr":"172.21.15.160:6811/1618319675","heartbeat_back_addr":"172.21.15.160:6815/1618319675","heartbeat_front_addr":"172.21.15.160:6813/1618319675","state":["exists","up"]},{"osd":6,"uuid":"d0881c4e-bd8d-4575-8c81-94d21825c227","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3541251299},{"type":"v1","addr":"172.21.15.37:6819","nonce":3541251299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3541251299},{"type":"v1","addr":"172.21.15.37:6821","nonce":3541251299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":3541251299},{"type":"v1","addr":"172.21.15.37:6825","nonce":3541251299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3541251299},{"type":"v1","addr":"172.21.15.37:6823","nonce":3541251299}]},"public_addr":"172.21.15.37:6819/3541251299","cluster_addr":"172.21.15.37:6821/3541251299","heartbeat_back_addr":"172.21.15.37:6825/3541251299","heartbeat_front_addr":"172.21.15.37:6823/3541251299","state":["exists","up"]},{"osd":7,"uuid":"04fbec2e-91b5-4a89-a4a3-472398c45288","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":4279933341},{"type":"v1","addr":"172.21.15.123:6817","nonce":4279933341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":4279933341},{"type":"v1","addr":"172.21.15.123:6819","nonce":4279933341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":4279933341},{"type":"v1","addr":"172.21.15.123:6823","nonce":4279933341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":4279933341},{"type":"v1","addr":"172.21.15.123:6821","nonce":4279933341}]},"public_addr":"172.21.15.123:6817/4279933341","cluster_addr":"172.21.15.123:6819/4279933341","heartbeat_back_addr":"172.21.15.123:6823/4279933341","heartbeat_front_addr":"172.21.15.123:6821/4279933341","state":["exists","up"]},{"osd":8,"uuid":"c77090a7-308e-4c6d-a56e-ce6f8e050ae5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":740968584},{"type":"v1","addr":"172.21.15.160:6817","nonce":740968584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":740968584},{"type":"v1","addr":"172.21.15.160:6819","nonce":740968584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":740968584},{"type":"v1","addr":"172.21.15.160:6823","nonce":740968584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":740968584},{"type":"v1","addr":"172.21.15.160:6821","nonce":740968584}]},"public_addr":"172.21.15.160:6817/740968584","cluster_addr":"172.21.15.160:6819/740968584","heartbeat_back_addr":"172.21.15.160:6823/740968584","heartbeat_front_addr":"172.21.15.160:6821/740968584","state":["exists","up"]},{"osd":9,"uuid":"bcd19bd4-88bc-46f7-b48c-af9e3d17aa96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":692114850},{"type":"v1","addr":"172.21.15.37:6827","nonce":692114850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":692114850},{"type":"v1","addr":"172.21.15.37:6829","nonce":692114850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":692114850},{"type":"v1","addr":"172.21.15.37:6833","nonce":692114850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":692114850},{"type":"v1","addr":"172.21.15.37:6831","nonce":692114850}]},"public_addr":"172.21.15.37:6827/692114850","cluster_addr":"172.21.15.37:6829/692114850","heartbeat_back_addr":"172.21.15.37:6833/692114850","heartbeat_front_addr":"172.21.15.37:6831/692114850","state":["exists","up"]},{"osd":10,"uuid":"9e956e6c-c28a-4a4c-b385-c458788858ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":471058996},{"type":"v1","addr":"172.21.15.123:6825","nonce":471058996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":471058996},{"type":"v1","addr":"172.21.15.123:6827","nonce":471058996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":471058996},{"type":"v1","addr":"172.21.15.123:6831","nonce":471058996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":471058996},{"type":"v1","addr":"172.21.15.123:6829","nonce":471058996}]},"public_addr":"172.21.15.123:6825/471058996","cluster_addr":"172.21.15.123:6827/471058996","heartbeat_back_addr":"172.21.15.123:6831/471058996","heartbeat_front_addr":"172.21.15.123:6829/471058996","state":["exists","up"]},{"osd":11,"uuid":"0b5b3364-9a40-4cab-90d4-b7b1cba57bc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":3982315018},{"type":"v1","addr":"172.21.15.160:6825","nonce":3982315018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3982315018},{"type":"v1","addr":"172.21.15.160:6827","nonce":3982315018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3982315018},{"type":"v1","addr":"172.21.15.160:6831","nonce":3982315018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3982315018},{"type":"v1","addr":"172.21.15.160:6829","nonce":3982315018}]},"public_addr":"172.21.15.160:6825/3982315018","cluster_addr":"172.21.15.160:6827/3982315018","heartbeat_back_addr":"172.21.15.160:6831/3982315018","heartbeat_front_addr":"172.21.15.160:6829/3982315018","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:10:21.139833+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:10:47.004960+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:11:11.460263+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:11:40.849286+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:12:06.497448+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:12:32.043206+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:13:01.402019+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:13:27.993489+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:13:52.291643+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:23.840299+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:49.448254+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:15:15.310947+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":7}]},{"pgid":"3.17","mappings":[{"from":4,"to":7}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.30","mappings":[{"from":1,"to":9}]},{"pgid":"3.38","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:6801/2886800769":"2024-09-12T23:08:51.934167+0000","172.21.15.37:0/1811301224":"2024-09-12T23:08:51.934167+0000","172.21.15.37:0/513883980":"2024-09-12T23:08:51.934167+0000","172.21.15.37:0/3698260188":"2024-09-12T23:08:23.793913+0000","172.21.15.37:6800/2886800769":"2024-09-12T23:08:51.934167+0000","172.21.15.37:0/4134736061":"2024-09-12T23:08:23.793913+0000","172.21.15.37:0/3426758476":"2024-09-12T23:08:51.934167+0000","172.21.15.37:0/2545840561":"2024-09-12T23:08:23.793913+0000","172.21.15.37:6801/3447426643":"2024-09-12T23:08:23.793913+0000","172.21.15.37:6800/3447426643":"2024-09-12T23:08:23.793913+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:16:55.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:55.370+0000 7fb426e00640 1 -- 172.21.15.37:0/3592328954 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fb4040a2c00 msgr2=0x7fb4040a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:55.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:55.370+0000 7fb426e00640 1 --2- 172.21.15.37:0/3592328954 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fb4040a2c00 0x7fb4040a50c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb408009230 tx=0x7fb4080058d0 comp rx=0 tx=0).stop 2024-09-11T23:16:55.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:55.370+0000 7fb426e00640 1 -- 172.21.15.37:0/3592328954 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb420074620 msgr2=0x7fb42019a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:55.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:55.370+0000 7fb426e00640 1 --2- 172.21.15.37:0/3592328954 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb420074620 0x7fb42019a680 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb41000e9f0 tx=0x7fb41000eeb0 comp rx=0 tx=0).stop 2024-09-11T23:16:55.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:55.370+0000 7fb426e00640 1 -- 172.21.15.37:0/3592328954 shutdown_connections 2024-09-11T23:16:55.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:55.370+0000 7fb426e00640 1 --2- 172.21.15.37:0/3592328954 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fb4040a2c00 0x7fb4040a50c0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:55.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:55.370+0000 7fb426e00640 1 --2- 172.21.15.37:0/3592328954 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb420074f40 0x7fb42019abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:55.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:55.370+0000 7fb426e00640 1 --2- 172.21.15.37:0/3592328954 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb42010e3c0 0x7fb42019ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:55.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:55.370+0000 7fb426e00640 1 --2- 172.21.15.37:0/3592328954 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb420074620 0x7fb42019a680 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:55.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:55.370+0000 7fb426e00640 1 -- 172.21.15.37:0/3592328954 >> 172.21.15.37:0/3592328954 conn(0x7fb4200fd8c0 msgr2=0x7fb4200fe5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:55.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:55.370+0000 7fb426e00640 1 -- 172.21.15.37:0/3592328954 shutdown_connections 2024-09-11T23:16:55.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:55.370+0000 7fb426e00640 1 -- 172.21.15.37:0/3592328954 wait complete. 2024-09-11T23:16:55.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:55 smithi160 ceph-mon[35055]: pgmap v324: 129 pgs: 1 peering, 128 active+clean; 581 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 0 op/s 2024-09-11T23:16:55.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:55 smithi160 ceph-mon[35055]: from='client.? 172.21.15.37:0/3592328954' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:16:56.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:55 smithi123 ceph-mon[35438]: pgmap v324: 129 pgs: 1 peering, 128 active+clean; 581 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 0 op/s 2024-09-11T23:16:56.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:55 smithi123 ceph-mon[35438]: from='client.? 172.21.15.37:0/3592328954' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:16:56.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:55 smithi037 ceph-mon[30630]: pgmap v324: 129 pgs: 1 peering, 128 active+clean; 581 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 0 op/s 2024-09-11T23:16:56.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:55 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/3592328954' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:16:56.107 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-09-11T23:16:56.484 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:16:57.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:57.088+0000 7f5b67e00640 1 -- 172.21.15.37:0/1319350613 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b68103e30 msgr2=0x7f5b68104210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:57.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:57.088+0000 7f5b67e00640 1 --2- 172.21.15.37:0/1319350613 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b68103e30 0x7f5b68104210 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5b58009900 tx=0x7f5b5802a3f0 comp rx=0 tx=0).stop 2024-09-11T23:16:57.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:57.088+0000 7f5b67e00640 1 -- 172.21.15.37:0/1319350613 shutdown_connections 2024-09-11T23:16:57.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:57.088+0000 7f5b67e00640 1 --2- 172.21.15.37:0/1319350613 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5b681047e0 0x7f5b68108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:57.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:57.088+0000 7f5b67e00640 1 --2- 172.21.15.37:0/1319350613 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5b68108f60 0x7f5b68110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:57.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:57.088+0000 7f5b67e00640 1 --2- 172.21.15.37:0/1319350613 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b68103e30 0x7f5b68104210 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:57.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:57.088+0000 7f5b67e00640 1 -- 172.21.15.37:0/1319350613 >> 172.21.15.37:0/1319350613 conn(0x7f5b680ff910 msgr2=0x7f5b68101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:57.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:57.088+0000 7f5b67e00640 1 -- 172.21.15.37:0/1319350613 shutdown_connections 2024-09-11T23:16:57.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:57.088+0000 7f5b67e00640 1 -- 172.21.15.37:0/1319350613 wait complete. 2024-09-11T23:16:57.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:57.089+0000 7f5b67e00640 1 Processor -- start 2024-09-11T23:16:57.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:57.090+0000 7f5b67e00640 1 -- start start 2024-09-11T23:16:57.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:57.090+0000 7f5b67e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5b68103e30 0x7f5b6819a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:57.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:57.090+0000 7f5b67e00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5b681047e0 0x7f5b6819a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:57.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:57.090+0000 7f5b67e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b68108f60 0x7f5b6819ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:57.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:57.090+0000 7f5b67e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5b68113fd0 con 0x7f5b68108f60 2024-09-11T23:16:57.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:57.090+0000 7f5b67e00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f5b68113e50 con 0x7f5b68103e30 2024-09-11T23:16:57.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:57.090+0000 7f5b67e00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f5b68114150 con 0x7f5b681047e0 2024-09-11T23:16:57.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:57.090+0000 7f5b66000640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5b681047e0 0x7f5b6819a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:57.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:57.090+0000 7f5b67400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b68108f60 0x7f5b6819ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:57.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:57.090+0000 7f5b66000640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5b681047e0 0x7f5b6819a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.37:59222/0 (socket says 172.21.15.37:59222) 2024-09-11T23:16:57.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:57.090+0000 7f5b66a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5b68103e30 0x7f5b6819a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:57.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:57.090+0000 7f5b66000640 1 -- 172.21.15.37:0/2724027765 learned_addr learned my addr 172.21.15.37:0/2724027765 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:16:57.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:57.091+0000 7f5b66000640 1 -- 172.21.15.37:0/2724027765 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5b68103e30 msgr2=0x7f5b6819a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:57.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:57.091+0000 7f5b66000640 1 --2- 172.21.15.37:0/2724027765 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5b68103e30 0x7f5b6819a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:57.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:57.091+0000 7f5b66000640 1 -- 172.21.15.37:0/2724027765 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b68108f60 msgr2=0x7f5b6819ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:57.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:57.091+0000 7f5b66000640 1 --2- 172.21.15.37:0/2724027765 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b68108f60 0x7f5b6819ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:57.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:57.091+0000 7f5b66000640 1 -- 172.21.15.37:0/2724027765 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b6819f420 con 0x7f5b681047e0 2024-09-11T23:16:57.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:57.091+0000 7f5b67400640 1 --2- 172.21.15.37:0/2724027765 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b68108f60 0x7f5b6819ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:16:57.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:57.091+0000 7f5b66000640 1 --2- 172.21.15.37:0/2724027765 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5b681047e0 0x7f5b6819a9b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5b5400e9f0 tx=0x7f5b5400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:57.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:57.091+0000 7f5b5f400640 1 -- 172.21.15.37:0/2724027765 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b5400cd80 con 0x7f5b681047e0 2024-09-11T23:16:57.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:57.092+0000 7f5b67e00640 1 -- 172.21.15.37:0/2724027765 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b6819f710 con 0x7f5b681047e0 2024-09-11T23:16:57.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:57.092+0000 7f5b5f400640 1 -- 172.21.15.37:0/2724027765 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5b54010910 con 0x7f5b681047e0 2024-09-11T23:16:57.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:57.092+0000 7f5b5f400640 1 -- 172.21.15.37:0/2724027765 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b540188f0 con 0x7f5b681047e0 2024-09-11T23:16:57.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:57.092+0000 7f5b67e00640 1 -- 172.21.15.37:0/2724027765 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b681a6ff0 con 0x7f5b681047e0 2024-09-11T23:16:57.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:57.093+0000 7f5b67e00640 1 -- 172.21.15.37:0/2724027765 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b68105310 con 0x7f5b681047e0 2024-09-11T23:16:57.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:57.096+0000 7f5b5f400640 1 -- 172.21.15.37:0/2724027765 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f5b54010ac0 con 0x7f5b681047e0 2024-09-11T23:16:57.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:57.097+0000 7f5b5f400640 1 --2- 172.21.15.37:0/2724027765 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f5b4c0a2b80 0x7f5b4c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:57.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:57.097+0000 7f5b5f400640 1 -- 172.21.15.37:0/2724027765 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9092+0+0 (secure 0 0 0) 0x7f5b540cfb90 con 0x7f5b681047e0 2024-09-11T23:16:57.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:57.097+0000 7f5b66a00640 1 --2- 172.21.15.37:0/2724027765 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f5b4c0a2b80 0x7f5b4c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:57.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:57.098+0000 7f5b66a00640 1 --2- 172.21.15.37:0/2724027765 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f5b4c0a2b80 0x7f5b4c0a5040 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5b58000c00 tx=0x7f5b58005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:57.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:57.098+0000 7f5b5f400640 1 -- 172.21.15.37:0/2724027765 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5b5409c0e0 con 0x7f5b681047e0 2024-09-11T23:16:57.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:57.320+0000 7f5b67e00640 1 -- 172.21.15.37:0/2724027765 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f5b68104210 con 0x7f5b681047e0 2024-09-11T23:16:57.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:57.691+0000 7f5b5f400640 1 -- 172.21.15.37:0/2724027765 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v18) ==== 118+0+0 (secure 0 0 0) 0x7f5b68104210 con 0x7f5b681047e0 2024-09-11T23:16:57.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:57.694+0000 7f5b67e00640 1 -- 172.21.15.37:0/2724027765 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f5b4c0a2b80 msgr2=0x7f5b4c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:57.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:57.694+0000 7f5b67e00640 1 --2- 172.21.15.37:0/2724027765 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f5b4c0a2b80 0x7f5b4c0a5040 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5b58000c00 tx=0x7f5b58005b50 comp rx=0 tx=0).stop 2024-09-11T23:16:57.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:57.694+0000 7f5b67e00640 1 -- 172.21.15.37:0/2724027765 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5b681047e0 msgr2=0x7f5b6819a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:57.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:57.694+0000 7f5b67e00640 1 --2- 172.21.15.37:0/2724027765 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5b681047e0 0x7f5b6819a9b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5b5400e9f0 tx=0x7f5b5400eeb0 comp rx=0 tx=0).stop 2024-09-11T23:16:57.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:57.694+0000 7f5b67e00640 1 -- 172.21.15.37:0/2724027765 shutdown_connections 2024-09-11T23:16:57.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:57.694+0000 7f5b67e00640 1 --2- 172.21.15.37:0/2724027765 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f5b4c0a2b80 0x7f5b4c0a5040 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:57.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:57.694+0000 7f5b67e00640 1 --2- 172.21.15.37:0/2724027765 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b68108f60 0x7f5b6819ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:57.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:57.694+0000 7f5b67e00640 1 --2- 172.21.15.37:0/2724027765 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5b681047e0 0x7f5b6819a9b0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:57.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:57.694+0000 7f5b67e00640 1 --2- 172.21.15.37:0/2724027765 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5b68103e30 0x7f5b6819a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:57.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:57.694+0000 7f5b67e00640 1 -- 172.21.15.37:0/2724027765 >> 172.21.15.37:0/2724027765 conn(0x7f5b680ff910 msgr2=0x7f5b68100c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:57.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:57.694+0000 7f5b67e00640 1 -- 172.21.15.37:0/2724027765 shutdown_connections 2024-09-11T23:16:57.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:57.694+0000 7f5b67e00640 1 -- 172.21.15.37:0/2724027765 wait complete. 2024-09-11T23:16:57.994 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:57 smithi037 ceph-mon[30630]: pgmap v325: 129 pgs: 1 peering, 128 active+clean; 581 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s wr, 0 op/s 2024-09-11T23:16:57.994 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:57 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/2724027765' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-11T23:16:57.994 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:57 smithi037 ceph-mon[30630]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-11T23:16:58.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:57 smithi123 ceph-mon[35438]: pgmap v325: 129 pgs: 1 peering, 128 active+clean; 581 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s wr, 0 op/s 2024-09-11T23:16:58.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:57 smithi123 ceph-mon[35438]: from='client.? 172.21.15.37:0/2724027765' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-11T23:16:58.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:57 smithi123 ceph-mon[35438]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-11T23:16:58.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:57 smithi160 ceph-mon[35055]: pgmap v325: 129 pgs: 1 peering, 128 active+clean; 581 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s wr, 0 op/s 2024-09-11T23:16:58.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:57 smithi160 ceph-mon[35055]: from='client.? 172.21.15.37:0/2724027765' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-11T23:16:58.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:57 smithi160 ceph-mon[35055]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-11T23:16:58.381 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2}} 2024-09-11T23:16:58.381 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph fs set cephfs max_mds 5 2024-09-11T23:16:58.759 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:16:59.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:58 smithi123 ceph-mon[35438]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-11T23:16:59.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:58 smithi123 ceph-mon[35438]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-11T23:16:59.034 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:58 smithi037 ceph-mon[30630]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-11T23:16:59.034 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:58 smithi037 ceph-mon[30630]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-11T23:16:59.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:58 smithi160 ceph-mon[35055]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-11T23:16:59.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:58 smithi160 ceph-mon[35055]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-11T23:16:59.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:59.305+0000 7f7c06a00640 1 -- 172.21.15.37:0/3113802464 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c000745c0 msgr2=0x7f7c000749a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:59.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:59.305+0000 7f7c06a00640 1 --2- 172.21.15.37:0/3113802464 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c000745c0 0x7f7c000749a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7bf0009900 tx=0x7f7bf002a480 comp rx=0 tx=0).stop 2024-09-11T23:16:59.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:59.306+0000 7f7c06a00640 1 -- 172.21.15.37:0/3113802464 shutdown_connections 2024-09-11T23:16:59.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:59.306+0000 7f7c06a00640 1 --2- 172.21.15.37:0/3113802464 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7c0010e420 0x7f7c00110810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:59.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:59.306+0000 7f7c06a00640 1 --2- 172.21.15.37:0/3113802464 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7c00074ee0 0x7f7c0010dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:59.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:59.306+0000 7f7c06a00640 1 --2- 172.21.15.37:0/3113802464 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c000745c0 0x7f7c000749a0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:59.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:59.306+0000 7f7c06a00640 1 -- 172.21.15.37:0/3113802464 >> 172.21.15.37:0/3113802464 conn(0x7f7c000fd8c0 msgr2=0x7f7c000ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:59.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:59.306+0000 7f7c06a00640 1 -- 172.21.15.37:0/3113802464 shutdown_connections 2024-09-11T23:16:59.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:59.306+0000 7f7c06a00640 1 -- 172.21.15.37:0/3113802464 wait complete. 2024-09-11T23:16:59.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:59.307+0000 7f7c06a00640 1 Processor -- start 2024-09-11T23:16:59.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:59.307+0000 7f7c06a00640 1 -- start start 2024-09-11T23:16:59.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:59.307+0000 7f7c06a00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7c000745c0 0x7f7c0019a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:59.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:59.307+0000 7f7c06a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7c00074ee0 0x7f7c0019abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:59.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:59.307+0000 7f7c06a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c0010e420 0x7f7c0019ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:59.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:59.307+0000 7f7c06a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7c00114170 con 0x7f7c0010e420 2024-09-11T23:16:59.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:59.307+0000 7f7c06a00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f7c00113ff0 con 0x7f7c00074ee0 2024-09-11T23:16:59.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:59.307+0000 7f7c06a00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f7c001142f0 con 0x7f7c000745c0 2024-09-11T23:16:59.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:59.307+0000 7f7c04a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c0010e420 0x7f7c0019ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:59.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:59.308+0000 7f7bffe00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7c000745c0 0x7f7c0019a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:59.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:59.308+0000 7f7c04a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c0010e420 0x7f7c0019ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34770/0 (socket says 172.21.15.37:34770) 2024-09-11T23:16:59.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:59.308+0000 7f7c04a00640 1 -- 172.21.15.37:0/2137056518 learned_addr learned my addr 172.21.15.37:0/2137056518 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:16:59.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:59.308+0000 7f7bf7e00640 1 --2- 172.21.15.37:0/2137056518 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7c00074ee0 0x7f7c0019abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:59.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:59.308+0000 7f7c04a00640 1 -- 172.21.15.37:0/2137056518 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7c000745c0 msgr2=0x7f7c0019a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:59.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:59.308+0000 7f7c04a00640 1 --2- 172.21.15.37:0/2137056518 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7c000745c0 0x7f7c0019a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:59.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:59.308+0000 7f7c04a00640 1 -- 172.21.15.37:0/2137056518 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7c00074ee0 msgr2=0x7f7c0019abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:59.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:59.308+0000 7f7c04a00640 1 --2- 172.21.15.37:0/2137056518 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7c00074ee0 0x7f7c0019abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:59.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:59.308+0000 7f7c04a00640 1 -- 172.21.15.37:0/2137056518 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c0019f620 con 0x7f7c0010e420 2024-09-11T23:16:59.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:59.308+0000 7f7c04a00640 1 --2- 172.21.15.37:0/2137056518 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c0010e420 0x7f7c0019ef40 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f7bf800e9d0 tx=0x7f7bf800ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:59.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:59.309+0000 7f7bfd600640 1 -- 172.21.15.37:0/2137056518 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bf800cd80 con 0x7f7c0010e420 2024-09-11T23:16:59.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:59.309+0000 7f7bfd600640 1 -- 172.21.15.37:0/2137056518 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7bf8005020 con 0x7f7c0010e420 2024-09-11T23:16:59.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:59.309+0000 7f7c06a00640 1 -- 172.21.15.37:0/2137056518 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c0019f910 con 0x7f7c0010e420 2024-09-11T23:16:59.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:59.309+0000 7f7bfd600640 1 -- 172.21.15.37:0/2137056518 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bf80116d0 con 0x7f7c0010e420 2024-09-11T23:16:59.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:59.309+0000 7f7c06a00640 1 -- 172.21.15.37:0/2137056518 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c001a71f0 con 0x7f7c0010e420 2024-09-11T23:16:59.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:59.310+0000 7f7c06a00640 1 -- 172.21.15.37:0/2137056518 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c000749a0 con 0x7f7c0010e420 2024-09-11T23:16:59.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:59.312+0000 7f7bfd600640 1 -- 172.21.15.37:0/2137056518 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f7bf80051d0 con 0x7f7c0010e420 2024-09-11T23:16:59.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:59.313+0000 7f7bfd600640 1 --2- 172.21.15.37:0/2137056518 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f7be40a2c00 0x7f7be40a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:16:59.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:59.314+0000 7f7bfd600640 1 -- 172.21.15.37:0/2137056518 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9092+0+0 (secure 0 0 0) 0x7f7bf80cf800 con 0x7f7c0010e420 2024-09-11T23:16:59.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:59.314+0000 7f7bffe00640 1 --2- 172.21.15.37:0/2137056518 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f7be40a2c00 0x7f7be40a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:16:59.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:59.315+0000 7f7bffe00640 1 --2- 172.21.15.37:0/2137056518 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f7be40a2c00 0x7f7be40a50c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f7bf0009230 tx=0x7f7bf00058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:16:59.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:59.316+0000 7f7bfd600640 1 -- 172.21.15.37:0/2137056518 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7bf8016030 con 0x7f7c0010e420 2024-09-11T23:16:59.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:59.539+0000 7f7c06a00640 1 -- 172.21.15.37:0/2137056518 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) -- 0x7f7c0002d7c0 con 0x7f7c0010e420 2024-09-11T23:16:59.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:59.700+0000 7f7bfd600640 1 -- 172.21.15.37:0/2137056518 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v19) ==== 105+0+0 (secure 0 0 0) 0x7f7bf809bdd0 con 0x7f7c0010e420 2024-09-11T23:16:59.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:59.703+0000 7f7c06a00640 1 -- 172.21.15.37:0/2137056518 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f7be40a2c00 msgr2=0x7f7be40a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:59.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:59.703+0000 7f7c06a00640 1 --2- 172.21.15.37:0/2137056518 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f7be40a2c00 0x7f7be40a50c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f7bf0009230 tx=0x7f7bf00058d0 comp rx=0 tx=0).stop 2024-09-11T23:16:59.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:59.703+0000 7f7c06a00640 1 -- 172.21.15.37:0/2137056518 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c0010e420 msgr2=0x7f7c0019ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:16:59.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:59.703+0000 7f7c06a00640 1 --2- 172.21.15.37:0/2137056518 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c0010e420 0x7f7c0019ef40 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f7bf800e9d0 tx=0x7f7bf800ee90 comp rx=0 tx=0).stop 2024-09-11T23:16:59.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:59.703+0000 7f7c06a00640 1 -- 172.21.15.37:0/2137056518 shutdown_connections 2024-09-11T23:16:59.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:59.703+0000 7f7c06a00640 1 --2- 172.21.15.37:0/2137056518 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f7be40a2c00 0x7f7be40a50c0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:59.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:59.703+0000 7f7c06a00640 1 --2- 172.21.15.37:0/2137056518 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7c00074ee0 0x7f7c0019abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:59.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:59.703+0000 7f7c06a00640 1 --2- 172.21.15.37:0/2137056518 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c0010e420 0x7f7c0019ef40 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:59.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:59.703+0000 7f7c06a00640 1 --2- 172.21.15.37:0/2137056518 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7c000745c0 0x7f7c0019a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:16:59.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:59.703+0000 7f7c06a00640 1 -- 172.21.15.37:0/2137056518 >> 172.21.15.37:0/2137056518 conn(0x7f7c000fd8c0 msgr2=0x7f7c000fe560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:16:59.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:59.703+0000 7f7c06a00640 1 -- 172.21.15.37:0/2137056518 shutdown_connections 2024-09-11T23:16:59.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:16:59.703+0000 7f7c06a00640 1 -- 172.21.15.37:0/2137056518 wait complete. 2024-09-11T23:17:00.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:59 smithi123 ceph-mon[35438]: pgmap v326: 129 pgs: 129 active+clean; 581 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s wr, 0 op/s 2024-09-11T23:17:00.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:16:59 smithi123 ceph-mon[35438]: from='client.? 172.21.15.37:0/2137056518' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-09-11T23:17:00.024 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:59 smithi037 ceph-mon[30630]: pgmap v326: 129 pgs: 129 active+clean; 581 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s wr, 0 op/s 2024-09-11T23:17:00.024 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:16:59 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/2137056518' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-09-11T23:17:00.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:59 smithi160 ceph-mon[35055]: pgmap v326: 129 pgs: 129 active+clean; 581 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s wr, 0 op/s 2024-09-11T23:17:00.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:16:59 smithi160 ceph-mon[35055]: from='client.? 172.21.15.37:0/2137056518' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-09-11T23:17:00.398 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-09-11T23:17:00.785 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:17:01.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:00 smithi123 ceph-mon[35438]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-11T23:17:01.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:00 smithi123 ceph-mon[35438]: from='client.? 172.21.15.37:0/2137056518' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-11T23:17:01.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:00 smithi123 ceph-mon[35438]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-11T23:17:01.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:00 smithi123 ceph-mon[35438]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-11T23:17:01.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:00 smithi123 ceph-mon[35438]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-11T23:17:01.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:00 smithi123 ceph-mon[35438]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-11T23:17:01.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:00 smithi037 ceph-mon[30630]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-11T23:17:01.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:00 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/2137056518' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-11T23:17:01.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:00 smithi037 ceph-mon[30630]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-11T23:17:01.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:00 smithi037 ceph-mon[30630]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-11T23:17:01.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:00 smithi037 ceph-mon[30630]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-11T23:17:01.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:00 smithi037 ceph-mon[30630]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-11T23:17:01.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:00 smithi160 ceph-mon[35055]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-11T23:17:01.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:00 smithi160 ceph-mon[35055]: from='client.? 172.21.15.37:0/2137056518' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-11T23:17:01.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:00 smithi160 ceph-mon[35055]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-11T23:17:01.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:00 smithi160 ceph-mon[35055]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-11T23:17:01.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:00 smithi160 ceph-mon[35055]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-11T23:17:01.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:00 smithi160 ceph-mon[35055]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-11T23:17:01.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:01.331+0000 7f38c4c00640 1 -- 172.21.15.37:0/1898425372 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38c0103ff0 msgr2=0x7f38c01043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:01.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:01.331+0000 7f38c4c00640 1 --2- 172.21.15.37:0/1898425372 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38c0103ff0 0x7f38c01043d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f38b0009900 tx=0x7f38b002a3f0 comp rx=0 tx=0).stop 2024-09-11T23:17:01.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:01.331+0000 7f38c4c00640 1 -- 172.21.15.37:0/1898425372 shutdown_connections 2024-09-11T23:17:01.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:01.331+0000 7f38c4c00640 1 --2- 172.21.15.37:0/1898425372 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f38c0109120 0x7f38c0110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:01.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:01.331+0000 7f38c4c00640 1 --2- 172.21.15.37:0/1898425372 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f38c01049a0 0x7f38c01089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:01.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:01.331+0000 7f38c4c00640 1 --2- 172.21.15.37:0/1898425372 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38c0103ff0 0x7f38c01043d0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:01.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:01.331+0000 7f38c4c00640 1 -- 172.21.15.37:0/1898425372 >> 172.21.15.37:0/1898425372 conn(0x7f38c00ffa90 msgr2=0x7f38c0101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:01.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:01.331+0000 7f38c4c00640 1 -- 172.21.15.37:0/1898425372 shutdown_connections 2024-09-11T23:17:01.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:01.331+0000 7f38c4c00640 1 -- 172.21.15.37:0/1898425372 wait complete. 2024-09-11T23:17:01.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:01.332+0000 7f38c4c00640 1 Processor -- start 2024-09-11T23:17:01.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:01.332+0000 7f38c4c00640 1 -- start start 2024-09-11T23:17:01.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:01.333+0000 7f38c4c00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f38c0103ff0 0x7f38c019a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:01.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:01.333+0000 7f38c4c00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f38c01049a0 0x7f38c019ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:01.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:01.333+0000 7f38c4c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38c0109120 0x7f38c019eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:01.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:01.333+0000 7f38c4c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f38c0114120 con 0x7f38c0109120 2024-09-11T23:17:01.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:01.333+0000 7f38c4c00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f38c0113fa0 con 0x7f38c0103ff0 2024-09-11T23:17:01.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:01.333+0000 7f38c4c00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f38c01142a0 con 0x7f38c01049a0 2024-09-11T23:17:01.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:01.333+0000 7f38b5400640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f38c01049a0 0x7f38c019ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:01.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:01.333+0000 7f38bde00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f38c0103ff0 0x7f38c019a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:01.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:01.333+0000 7f38b5400640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f38c01049a0 0x7f38c019ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.37:60832/0 (socket says 172.21.15.37:60832) 2024-09-11T23:17:01.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:01.333+0000 7f38b5400640 1 -- 172.21.15.37:0/1206085377 learned_addr learned my addr 172.21.15.37:0/1206085377 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:17:01.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:01.333+0000 7f38be800640 1 --2- 172.21.15.37:0/1206085377 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38c0109120 0x7f38c019eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:01.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:01.333+0000 7f38b5400640 1 -- 172.21.15.37:0/1206085377 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f38c0103ff0 msgr2=0x7f38c019a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:01.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:01.333+0000 7f38b5400640 1 --2- 172.21.15.37:0/1206085377 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f38c0103ff0 0x7f38c019a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:01.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:01.333+0000 7f38b5400640 1 -- 172.21.15.37:0/1206085377 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38c0109120 msgr2=0x7f38c019eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:01.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:01.334+0000 7f38b5400640 1 --2- 172.21.15.37:0/1206085377 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38c0109120 0x7f38c019eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:01.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:01.334+0000 7f38b5400640 1 -- 172.21.15.37:0/1206085377 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38c019f590 con 0x7f38c01049a0 2024-09-11T23:17:01.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:01.334+0000 7f38b5400640 1 --2- 172.21.15.37:0/1206085377 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f38c01049a0 0x7f38c019ab20 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f38a800e9f0 tx=0x7f38a800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:01.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:01.334+0000 7f38b7400640 1 -- 172.21.15.37:0/1206085377 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38a800cd80 con 0x7f38c01049a0 2024-09-11T23:17:01.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:01.334+0000 7f38c4c00640 1 -- 172.21.15.37:0/1206085377 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38c019f880 con 0x7f38c01049a0 2024-09-11T23:17:01.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:01.334+0000 7f38b7400640 1 -- 172.21.15.37:0/1206085377 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f38a8010910 con 0x7f38c01049a0 2024-09-11T23:17:01.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:01.334+0000 7f38b7400640 1 -- 172.21.15.37:0/1206085377 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38a80188f0 con 0x7f38c01049a0 2024-09-11T23:17:01.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:01.334+0000 7f38c4c00640 1 -- 172.21.15.37:0/1206085377 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38c01a7160 con 0x7f38c01049a0 2024-09-11T23:17:01.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:01.335+0000 7f38c4c00640 1 -- 172.21.15.37:0/1206085377 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38c01043d0 con 0x7f38c01049a0 2024-09-11T23:17:01.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:01.338+0000 7f38b7400640 1 -- 172.21.15.37:0/1206085377 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f38a8010ac0 con 0x7f38c01049a0 2024-09-11T23:17:01.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:01.339+0000 7f38b7400640 1 --2- 172.21.15.37:0/1206085377 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f38a40a2b80 0x7f38a40a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:01.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:01.339+0000 7f38b7400640 1 -- 172.21.15.37:0/1206085377 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9092+0+0 (secure 0 0 0) 0x7f38a80cfbb0 con 0x7f38c01049a0 2024-09-11T23:17:01.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:01.339+0000 7f38bde00640 1 --2- 172.21.15.37:0/1206085377 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f38a40a2b80 0x7f38a40a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:01.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:01.340+0000 7f38bde00640 1 --2- 172.21.15.37:0/1206085377 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f38a40a2b80 0x7f38a40a5040 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f38b0009230 tx=0x7f38b00058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:01.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:01.341+0000 7f38b7400640 1 -- 172.21.15.37:0/1206085377 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f38a809c100 con 0x7f38c01049a0 2024-09-11T23:17:01.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:01.563+0000 7f38c4c00640 1 -- 172.21.15.37:0/1206085377 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f38c002d7c0 con 0x7f38c01049a0 2024-09-11T23:17:01.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:01.725+0000 7f38b7400640 1 -- 172.21.15.37:0/1206085377 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v23) ==== 121+0+0 (secure 0 0 0) 0x7f38a80bc110 con 0x7f38c01049a0 2024-09-11T23:17:01.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:01.727+0000 7f38c4c00640 1 -- 172.21.15.37:0/1206085377 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f38a40a2b80 msgr2=0x7f38a40a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:01.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:01.727+0000 7f38c4c00640 1 --2- 172.21.15.37:0/1206085377 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f38a40a2b80 0x7f38a40a5040 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f38b0009230 tx=0x7f38b00058d0 comp rx=0 tx=0).stop 2024-09-11T23:17:01.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:01.727+0000 7f38c4c00640 1 -- 172.21.15.37:0/1206085377 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f38c01049a0 msgr2=0x7f38c019ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:01.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:01.727+0000 7f38c4c00640 1 --2- 172.21.15.37:0/1206085377 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f38c01049a0 0x7f38c019ab20 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f38a800e9f0 tx=0x7f38a800eeb0 comp rx=0 tx=0).stop 2024-09-11T23:17:01.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:01.727+0000 7f38c4c00640 1 -- 172.21.15.37:0/1206085377 shutdown_connections 2024-09-11T23:17:01.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:01.727+0000 7f38c4c00640 1 --2- 172.21.15.37:0/1206085377 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f38a40a2b80 0x7f38a40a5040 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:01.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:01.727+0000 7f38c4c00640 1 --2- 172.21.15.37:0/1206085377 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38c0109120 0x7f38c019eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:01.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:01.727+0000 7f38c4c00640 1 --2- 172.21.15.37:0/1206085377 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f38c01049a0 0x7f38c019ab20 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:01.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:01.727+0000 7f38c4c00640 1 --2- 172.21.15.37:0/1206085377 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f38c0103ff0 0x7f38c019a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:01.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:01.727+0000 7f38c4c00640 1 -- 172.21.15.37:0/1206085377 >> 172.21.15.37:0/1206085377 conn(0x7f38c00ffa90 msgr2=0x7f38c0100e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:01.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:01.727+0000 7f38c4c00640 1 -- 172.21.15.37:0/1206085377 shutdown_connections 2024-09-11T23:17:01.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:01.727+0000 7f38c4c00640 1 -- 172.21.15.37:0/1206085377 wait complete. 2024-09-11T23:17:02.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:01 smithi123 ceph-mon[35438]: pgmap v327: 129 pgs: 129 active+clean; 581 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 127 B/s wr, 0 op/s 2024-09-11T23:17:02.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:01 smithi123 ceph-mon[35438]: mds.? [v2:172.21.15.160:6838/2041625862,v1:172.21.15.160:6839/2041625862] up:active 2024-09-11T23:17:02.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:01 smithi123 ceph-mon[35438]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-11T23:17:02.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:01 smithi123 ceph-mon[35438]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-11T23:17:02.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:01 smithi123 ceph-mon[35438]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:creating} 9 up:standby 2024-09-11T23:17:02.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:01 smithi123 ceph-mon[35438]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-09-11T23:17:02.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:01 smithi123 ceph-mon[35438]: from='client.? 172.21.15.37:0/1206085377' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-11T23:17:02.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:01 smithi123 ceph-mon[35438]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-11T23:17:02.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:01 smithi037 ceph-mon[30630]: pgmap v327: 129 pgs: 129 active+clean; 581 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 127 B/s wr, 0 op/s 2024-09-11T23:17:02.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:01 smithi037 ceph-mon[30630]: mds.? [v2:172.21.15.160:6838/2041625862,v1:172.21.15.160:6839/2041625862] up:active 2024-09-11T23:17:02.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:01 smithi037 ceph-mon[30630]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-11T23:17:02.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:01 smithi037 ceph-mon[30630]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-11T23:17:02.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:01 smithi037 ceph-mon[30630]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:creating} 9 up:standby 2024-09-11T23:17:02.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:01 smithi037 ceph-mon[30630]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-09-11T23:17:02.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:01 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/1206085377' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-11T23:17:02.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:01 smithi037 ceph-mon[30630]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-11T23:17:02.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:01 smithi160 ceph-mon[35055]: pgmap v327: 129 pgs: 129 active+clean; 581 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 127 B/s wr, 0 op/s 2024-09-11T23:17:02.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:01 smithi160 ceph-mon[35055]: mds.? [v2:172.21.15.160:6838/2041625862,v1:172.21.15.160:6839/2041625862] up:active 2024-09-11T23:17:02.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:01 smithi160 ceph-mon[35055]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-11T23:17:02.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:01 smithi160 ceph-mon[35055]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-11T23:17:02.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:01 smithi160 ceph-mon[35055]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:creating} 9 up:standby 2024-09-11T23:17:02.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:01 smithi160 ceph-mon[35055]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-09-11T23:17:02.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:01 smithi160 ceph-mon[35055]: from='client.? 172.21.15.37:0/1206085377' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-11T23:17:02.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:01 smithi160 ceph-mon[35055]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-11T23:17:02.482 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-09-11T23:17:02.865 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:17:03.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:02 smithi123 ceph-mon[35438]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-11T23:17:03.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:02 smithi123 ceph-mon[35438]: mds.? [v2:172.21.15.160:6836/2906597021,v1:172.21.15.160:6837/2906597021] up:active 2024-09-11T23:17:03.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:02 smithi123 ceph-mon[35438]: daemon mds.h assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-11T23:17:03.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:02 smithi123 ceph-mon[35438]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 9 up:standby 2024-09-11T23:17:03.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:02 smithi123 ceph-mon[35438]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=c=up:active,3=h=up:creating} 8 up:standby 2024-09-11T23:17:03.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:02 smithi123 ceph-mon[35438]: daemon mds.h is now active in filesystem cephfs as rank 3 2024-09-11T23:17:03.001 INFO:journalctl@ceph.mds.b.smithi123.stdout:Sep 11 23:17:02 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-b[65584]: 2024-09-11T23:17:02.909+0000 7f7b560ff640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-09-11T23:17:03.001 INFO:journalctl@ceph.mds.b.smithi123.stdout:Sep 11 23:17:02 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-b[65584]: 2024-09-11T23:17:02.909+0000 7f7b560ff640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-09-11T23:17:03.002 INFO:journalctl@ceph.mds.b.smithi123.stdout:Sep 11 23:17:02 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-b[65584]: 2024-09-11T23:17:02.909+0000 7f7b560ff640 -1 mds.pinger is_rank_lagging: rank=3 was never sent ping request. 2024-09-11T23:17:03.004 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:02 smithi037 ceph-mon[30630]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-11T23:17:03.004 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:02 smithi037 ceph-mon[30630]: mds.? [v2:172.21.15.160:6836/2906597021,v1:172.21.15.160:6837/2906597021] up:active 2024-09-11T23:17:03.004 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:02 smithi037 ceph-mon[30630]: daemon mds.h assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-11T23:17:03.004 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:02 smithi037 ceph-mon[30630]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 9 up:standby 2024-09-11T23:17:03.004 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:02 smithi037 ceph-mon[30630]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=c=up:active,3=h=up:creating} 8 up:standby 2024-09-11T23:17:03.004 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:02 smithi037 ceph-mon[30630]: daemon mds.h is now active in filesystem cephfs as rank 3 2024-09-11T23:17:03.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:02 smithi160 ceph-mon[35055]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-11T23:17:03.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:02 smithi160 ceph-mon[35055]: mds.? [v2:172.21.15.160:6836/2906597021,v1:172.21.15.160:6837/2906597021] up:active 2024-09-11T23:17:03.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:02 smithi160 ceph-mon[35055]: daemon mds.h assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-11T23:17:03.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:02 smithi160 ceph-mon[35055]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 9 up:standby 2024-09-11T23:17:03.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:02 smithi160 ceph-mon[35055]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=c=up:active,3=h=up:creating} 8 up:standby 2024-09-11T23:17:03.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:02 smithi160 ceph-mon[35055]: daemon mds.h is now active in filesystem cephfs as rank 3 2024-09-11T23:17:03.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:03.495+0000 7fa162400640 1 -- 172.21.15.37:0/3360878166 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa15c074e30 msgr2=0x7fa15c10dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:03.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:03.495+0000 7fa162400640 1 --2- 172.21.15.37:0/3360878166 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa15c074e30 0x7fa15c10dd40 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa148009900 tx=0x7fa14802a480 comp rx=0 tx=0).stop 2024-09-11T23:17:03.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:03.495+0000 7fa162400640 1 -- 172.21.15.37:0/3360878166 shutdown_connections 2024-09-11T23:17:03.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:03.495+0000 7fa162400640 1 --2- 172.21.15.37:0/3360878166 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa15c10e280 0x7fa15c110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:03.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:03.495+0000 7fa162400640 1 --2- 172.21.15.37:0/3360878166 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa15c074e30 0x7fa15c10dd40 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:03.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:03.495+0000 7fa162400640 1 --2- 172.21.15.37:0/3360878166 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa15c074510 0x7fa15c0748f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:03.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:03.495+0000 7fa162400640 1 -- 172.21.15.37:0/3360878166 >> 172.21.15.37:0/3360878166 conn(0x7fa15c0fd740 msgr2=0x7fa15c0ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:03.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:03.495+0000 7fa162400640 1 -- 172.21.15.37:0/3360878166 shutdown_connections 2024-09-11T23:17:03.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:03.495+0000 7fa162400640 1 -- 172.21.15.37:0/3360878166 wait complete. 2024-09-11T23:17:03.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:03.496+0000 7fa162400640 1 Processor -- start 2024-09-11T23:17:03.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:03.497+0000 7fa162400640 1 -- start start 2024-09-11T23:17:03.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:03.497+0000 7fa162400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa15c074510 0x7fa15c19a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:03.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:03.497+0000 7fa162400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa15c074e30 0x7fa15c19aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:03.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:03.497+0000 7fa162400640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa15c10e280 0x7fa15c19edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:03.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:03.497+0000 7fa162400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa15c113fc0 con 0x7fa15c074e30 2024-09-11T23:17:03.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:03.497+0000 7fa162400640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fa15c113e40 con 0x7fa15c074510 2024-09-11T23:17:03.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:03.497+0000 7fa162400640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fa15c114140 con 0x7fa15c10e280 2024-09-11T23:17:03.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:03.497+0000 7fa161000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa15c074510 0x7fa15c19a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:03.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:03.497+0000 7fa161000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa15c074510 0x7fa15c19a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.37:32950/0 (socket says 172.21.15.37:32950) 2024-09-11T23:17:03.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:03.497+0000 7fa161000640 1 -- 172.21.15.37:0/3030998163 learned_addr learned my addr 172.21.15.37:0/3030998163 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:17:03.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:03.498+0000 7fa15be00640 1 --2- 172.21.15.37:0/3030998163 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa15c074e30 0x7fa15c19aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:03.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:03.498+0000 7fa161a00640 1 --2- 172.21.15.37:0/3030998163 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa15c10e280 0x7fa15c19edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:03.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:03.498+0000 7fa161000640 1 -- 172.21.15.37:0/3030998163 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa15c10e280 msgr2=0x7fa15c19edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:03.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:03.498+0000 7fa161000640 1 --2- 172.21.15.37:0/3030998163 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa15c10e280 0x7fa15c19edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:03.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:03.498+0000 7fa161000640 1 -- 172.21.15.37:0/3030998163 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa15c074e30 msgr2=0x7fa15c19aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:03.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:03.498+0000 7fa161000640 1 --2- 172.21.15.37:0/3030998163 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa15c074e30 0x7fa15c19aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:03.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:03.498+0000 7fa161000640 1 -- 172.21.15.37:0/3030998163 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa15c19f4a0 con 0x7fa15c074510 2024-09-11T23:17:03.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:03.498+0000 7fa161a00640 1 --2- 172.21.15.37:0/3030998163 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa15c10e280 0x7fa15c19edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:17:03.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:03.498+0000 7fa161000640 1 --2- 172.21.15.37:0/3030998163 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa15c074510 0x7fa15c19a4f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa15000e9f0 tx=0x7fa15000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:03.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:03.499+0000 7fa159600640 1 -- 172.21.15.37:0/3030998163 <== mon.2 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa15000cd80 con 0x7fa15c074510 2024-09-11T23:17:03.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:03.499+0000 7fa162400640 1 -- 172.21.15.37:0/3030998163 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa15c19f790 con 0x7fa15c074510 2024-09-11T23:17:03.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:03.499+0000 7fa159600640 1 -- 172.21.15.37:0/3030998163 <== mon.2 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa150010910 con 0x7fa15c074510 2024-09-11T23:17:03.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:03.499+0000 7fa159600640 1 -- 172.21.15.37:0/3030998163 <== mon.2 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1500188f0 con 0x7fa15c074510 2024-09-11T23:17:03.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:03.499+0000 7fa162400640 1 -- 172.21.15.37:0/3030998163 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa15c1a7070 con 0x7fa15c074510 2024-09-11T23:17:03.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:03.500+0000 7fa162400640 1 -- 172.21.15.37:0/3030998163 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa15c0748f0 con 0x7fa15c074510 2024-09-11T23:17:03.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:03.502+0000 7fa159600640 1 -- 172.21.15.37:0/3030998163 <== mon.2 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fa150010ac0 con 0x7fa15c074510 2024-09-11T23:17:03.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:03.503+0000 7fa159600640 1 --2- 172.21.15.37:0/3030998163 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fa1440a2b80 0x7fa1440a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:03.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:03.504+0000 7fa159600640 1 -- 172.21.15.37:0/3030998163 <== mon.2 v2:172.21.15.123:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9092+0+0 (secure 0 0 0) 0x7fa1500cfda0 con 0x7fa15c074510 2024-09-11T23:17:03.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:03.504+0000 7fa15be00640 1 --2- 172.21.15.37:0/3030998163 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fa1440a2b80 0x7fa1440a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:03.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:03.504+0000 7fa15be00640 1 --2- 172.21.15.37:0/3030998163 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fa1440a2b80 0x7fa1440a5040 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa148000c00 tx=0x7fa148005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:03.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:03.506+0000 7fa159600640 1 -- 172.21.15.37:0/3030998163 <== mon.2 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa15009c940 con 0x7fa15c074510 2024-09-11T23:17:03.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:03.733+0000 7fa162400640 1 -- 172.21.15.37:0/3030998163 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7fa15c109460 con 0x7fa15c074510 2024-09-11T23:17:03.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:03.746+0000 7fa159600640 1 -- 172.21.15.37:0/3030998163 <== mon.2 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v28) ==== 115+0+0 (secure 0 0 0) 0x7fa15009c240 con 0x7fa15c074510 2024-09-11T23:17:03.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:03.749+0000 7fa162400640 1 -- 172.21.15.37:0/3030998163 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fa1440a2b80 msgr2=0x7fa1440a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:03.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:03.749+0000 7fa162400640 1 --2- 172.21.15.37:0/3030998163 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fa1440a2b80 0x7fa1440a5040 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa148000c00 tx=0x7fa148005b50 comp rx=0 tx=0).stop 2024-09-11T23:17:03.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:03.749+0000 7fa162400640 1 -- 172.21.15.37:0/3030998163 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa15c074510 msgr2=0x7fa15c19a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:03.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:03.749+0000 7fa162400640 1 --2- 172.21.15.37:0/3030998163 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa15c074510 0x7fa15c19a4f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa15000e9f0 tx=0x7fa15000eeb0 comp rx=0 tx=0).stop 2024-09-11T23:17:03.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:03.749+0000 7fa162400640 1 -- 172.21.15.37:0/3030998163 shutdown_connections 2024-09-11T23:17:03.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:03.749+0000 7fa162400640 1 --2- 172.21.15.37:0/3030998163 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fa1440a2b80 0x7fa1440a5040 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:03.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:03.749+0000 7fa162400640 1 --2- 172.21.15.37:0/3030998163 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa15c10e280 0x7fa15c19edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:03.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:03.749+0000 7fa162400640 1 --2- 172.21.15.37:0/3030998163 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa15c074e30 0x7fa15c19aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:03.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:03.749+0000 7fa162400640 1 --2- 172.21.15.37:0/3030998163 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa15c074510 0x7fa15c19a4f0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:03.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:03.749+0000 7fa162400640 1 -- 172.21.15.37:0/3030998163 >> 172.21.15.37:0/3030998163 conn(0x7fa15c0fd740 msgr2=0x7fa15c0fe480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:03.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:03.749+0000 7fa162400640 1 -- 172.21.15.37:0/3030998163 shutdown_connections 2024-09-11T23:17:03.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:03.750+0000 7fa162400640 1 -- 172.21.15.37:0/3030998163 wait complete. 2024-09-11T23:17:04.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:03 smithi123 ceph-mon[35438]: pgmap v328: 129 pgs: 129 active+clean; 581 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 218 B/s wr, 2 op/s 2024-09-11T23:17:04.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:03 smithi123 ceph-mon[35438]: mds.? [v2:172.21.15.123:6836/2168535476,v1:172.21.15.123:6837/2168535476] up:active 2024-09-11T23:17:04.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:03 smithi123 ceph-mon[35438]: daemon mds.f assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-11T23:17:04.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:03 smithi123 ceph-mon[35438]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-11T23:17:04.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:03 smithi123 ceph-mon[35438]: Cluster is now healthy 2024-09-11T23:17:04.002 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:03 smithi123 ceph-mon[35438]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=c=up:active,3=h=up:active} 8 up:standby 2024-09-11T23:17:04.002 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:03 smithi123 ceph-mon[35438]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-09-11T23:17:04.002 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:03 smithi123 ceph-mon[35438]: daemon mds.f is now active in filesystem cephfs as rank 4 2024-09-11T23:17:04.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:03 smithi037 ceph-mon[30630]: pgmap v328: 129 pgs: 129 active+clean; 581 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 218 B/s wr, 2 op/s 2024-09-11T23:17:04.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:03 smithi037 ceph-mon[30630]: mds.? [v2:172.21.15.123:6836/2168535476,v1:172.21.15.123:6837/2168535476] up:active 2024-09-11T23:17:04.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:03 smithi037 ceph-mon[30630]: daemon mds.f assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-11T23:17:04.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:03 smithi037 ceph-mon[30630]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-11T23:17:04.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:03 smithi037 ceph-mon[30630]: Cluster is now healthy 2024-09-11T23:17:04.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:03 smithi037 ceph-mon[30630]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=c=up:active,3=h=up:active} 8 up:standby 2024-09-11T23:17:04.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:03 smithi037 ceph-mon[30630]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-09-11T23:17:04.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:03 smithi037 ceph-mon[30630]: daemon mds.f is now active in filesystem cephfs as rank 4 2024-09-11T23:17:04.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:03 smithi160 ceph-mon[35055]: pgmap v328: 129 pgs: 129 active+clean; 581 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 218 B/s wr, 2 op/s 2024-09-11T23:17:04.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:03 smithi160 ceph-mon[35055]: mds.? [v2:172.21.15.123:6836/2168535476,v1:172.21.15.123:6837/2168535476] up:active 2024-09-11T23:17:04.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:03 smithi160 ceph-mon[35055]: daemon mds.f assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-11T23:17:04.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:03 smithi160 ceph-mon[35055]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-11T23:17:04.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:03 smithi160 ceph-mon[35055]: Cluster is now healthy 2024-09-11T23:17:04.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:03 smithi160 ceph-mon[35055]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=c=up:active,3=h=up:active} 8 up:standby 2024-09-11T23:17:04.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:03 smithi160 ceph-mon[35055]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-09-11T23:17:04.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:03 smithi160 ceph-mon[35055]: daemon mds.f is now active in filesystem cephfs as rank 4 2024-09-11T23:17:04.517 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2} subvols for filesystem 'cephfs' 2024-09-11T23:17:04.517 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-09-11T23:17:04.896 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:17:05.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:04 smithi123 ceph-mon[35438]: from='client.? 172.21.15.37:0/3030998163' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-11T23:17:05.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:04 smithi123 ceph-mon[35438]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-11T23:17:05.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:04 smithi123 ceph-mon[35438]: mds.? [v2:172.21.15.160:6834/2316897035,v1:172.21.15.160:6835/2316897035] up:active 2024-09-11T23:17:05.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:04 smithi123 ceph-mon[35438]: fsmap cephfs:5 7 up:standby 5 up:active 2024-09-11T23:17:05.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:04 smithi123 ceph-mon[35438]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-11T23:17:05.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:04 smithi123 ceph-mon[35438]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-11T23:17:05.035 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:04 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/3030998163' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-11T23:17:05.035 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:04 smithi037 ceph-mon[30630]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-11T23:17:05.035 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:04 smithi037 ceph-mon[30630]: mds.? [v2:172.21.15.160:6834/2316897035,v1:172.21.15.160:6835/2316897035] up:active 2024-09-11T23:17:05.035 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:04 smithi037 ceph-mon[30630]: fsmap cephfs:5 7 up:standby 5 up:active 2024-09-11T23:17:05.035 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:04 smithi037 ceph-mon[30630]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-11T23:17:05.035 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:04 smithi037 ceph-mon[30630]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-11T23:17:05.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:04 smithi160 ceph-mon[35055]: from='client.? 172.21.15.37:0/3030998163' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-11T23:17:05.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:04 smithi160 ceph-mon[35055]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-11T23:17:05.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:04 smithi160 ceph-mon[35055]: mds.? [v2:172.21.15.160:6834/2316897035,v1:172.21.15.160:6835/2316897035] up:active 2024-09-11T23:17:05.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:04 smithi160 ceph-mon[35055]: fsmap cephfs:5 7 up:standby 5 up:active 2024-09-11T23:17:05.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:04 smithi160 ceph-mon[35055]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-11T23:17:05.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:04 smithi160 ceph-mon[35055]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-11T23:17:05.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:05.501+0000 7fe6f1800640 1 -- 172.21.15.37:0/2489431177 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6ec1079c0 msgr2=0x7fe6ec107da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:05.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:05.501+0000 7fe6f1800640 1 --2- 172.21.15.37:0/2489431177 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6ec1079c0 0x7fe6ec107da0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc009900 tx=0x7fe6dc02a3f0 comp rx=0 tx=0).stop 2024-09-11T23:17:05.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:05.501+0000 7fe6f1800640 1 -- 172.21.15.37:0/2489431177 shutdown_connections 2024-09-11T23:17:05.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:05.501+0000 7fe6f1800640 1 --2- 172.21.15.37:0/2489431177 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6ec102360 0x7fe6ec10e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:05.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:05.501+0000 7fe6f1800640 1 --2- 172.21.15.37:0/2489431177 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe6ec1019c0 0x7fe6ec101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:05.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:05.501+0000 7fe6f1800640 1 --2- 172.21.15.37:0/2489431177 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6ec1079c0 0x7fe6ec107da0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:05.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:05.501+0000 7fe6f1800640 1 -- 172.21.15.37:0/2489431177 >> 172.21.15.37:0/2489431177 conn(0x7fe6ec0fd740 msgr2=0x7fe6ec0ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:05.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:05.501+0000 7fe6f1800640 1 -- 172.21.15.37:0/2489431177 shutdown_connections 2024-09-11T23:17:05.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:05.502+0000 7fe6f1800640 1 -- 172.21.15.37:0/2489431177 wait complete. 2024-09-11T23:17:05.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:05.503+0000 7fe6f1800640 1 Processor -- start 2024-09-11T23:17:05.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:05.503+0000 7fe6f1800640 1 -- start start 2024-09-11T23:17:05.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:05.503+0000 7fe6f1800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6ec1019c0 0x7fe6ec1982c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:05.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:05.503+0000 7fe6f1800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6ec102360 0x7fe6ec198800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:05.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:05.504+0000 7fe6f1800640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe6ec1079c0 0x7fe6ec19cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:05.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:05.504+0000 7fe6f1800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe6ec111e10 con 0x7fe6ec1019c0 2024-09-11T23:17:05.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:05.504+0000 7fe6f1800640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe6ec111c90 con 0x7fe6ec102360 2024-09-11T23:17:05.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:05.504+0000 7fe6f1800640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fe6ec111f90 con 0x7fe6ec1079c0 2024-09-11T23:17:05.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:05.504+0000 7fe6ebe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6ec1019c0 0x7fe6ec1982c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:05.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:05.504+0000 7fe6e3e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6ec102360 0x7fe6ec198800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:05.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:05.504+0000 7fe6ebe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6ec1019c0 0x7fe6ec1982c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34834/0 (socket says 172.21.15.37:34834) 2024-09-11T23:17:05.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:05.504+0000 7fe6ebe00640 1 -- 172.21.15.37:0/50235163 learned_addr learned my addr 172.21.15.37:0/50235163 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:17:05.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:05.504+0000 7fe6e3e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6ec102360 0x7fe6ec198800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.37:32964/0 (socket says 172.21.15.37:32964) 2024-09-11T23:17:05.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:05.504+0000 7fe6f0e00640 1 --2- 172.21.15.37:0/50235163 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe6ec1079c0 0x7fe6ec19cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:05.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:05.504+0000 7fe6e3e00640 1 -- 172.21.15.37:0/50235163 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe6ec1079c0 msgr2=0x7fe6ec19cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:05.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:05.504+0000 7fe6e3e00640 1 --2- 172.21.15.37:0/50235163 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe6ec1079c0 0x7fe6ec19cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:05.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:05.504+0000 7fe6e3e00640 1 -- 172.21.15.37:0/50235163 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6ec1019c0 msgr2=0x7fe6ec1982c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:05.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:05.504+0000 7fe6e3e00640 1 --2- 172.21.15.37:0/50235163 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6ec1019c0 0x7fe6ec1982c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:05.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:05.504+0000 7fe6e3e00640 1 -- 172.21.15.37:0/50235163 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6ec19d270 con 0x7fe6ec102360 2024-09-11T23:17:05.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:05.505+0000 7fe6e3e00640 1 --2- 172.21.15.37:0/50235163 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6ec102360 0x7fe6ec198800 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe6d400d720 tx=0x7fe6d400dbe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:05.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:05.505+0000 7fe6e9600640 1 -- 172.21.15.37:0/50235163 <== mon.2 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6d4017070 con 0x7fe6ec102360 2024-09-11T23:17:05.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:05.505+0000 7fe6e9600640 1 -- 172.21.15.37:0/50235163 <== mon.2 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe6d400de30 con 0x7fe6ec102360 2024-09-11T23:17:05.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:05.505+0000 7fe6f1800640 1 -- 172.21.15.37:0/50235163 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6ec19d560 con 0x7fe6ec102360 2024-09-11T23:17:05.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:05.505+0000 7fe6e9600640 1 -- 172.21.15.37:0/50235163 <== mon.2 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6d40047a0 con 0x7fe6ec102360 2024-09-11T23:17:05.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:05.505+0000 7fe6f1800640 1 -- 172.21.15.37:0/50235163 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6ec1a4e40 con 0x7fe6ec102360 2024-09-11T23:17:05.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:05.506+0000 7fe6f1800640 1 -- 172.21.15.37:0/50235163 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6ec101e20 con 0x7fe6ec102360 2024-09-11T23:17:05.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:05.508+0000 7fe6e9600640 1 -- 172.21.15.37:0/50235163 <== mon.2 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fe6d40099d0 con 0x7fe6ec102360 2024-09-11T23:17:05.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:05.510+0000 7fe6e9600640 1 --2- 172.21.15.37:0/50235163 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fe6d00a2c00 0x7fe6d00a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:05.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:05.510+0000 7fe6e9600640 1 -- 172.21.15.37:0/50235163 <== mon.2 v2:172.21.15.123:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9092+0+0 (secure 0 0 0) 0x7fe6d40cf3b0 con 0x7fe6ec102360 2024-09-11T23:17:05.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:05.510+0000 7fe6ebe00640 1 --2- 172.21.15.37:0/50235163 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fe6d00a2c00 0x7fe6d00a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:05.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:05.511+0000 7fe6ebe00640 1 --2- 172.21.15.37:0/50235163 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fe6d00a2c00 0x7fe6d00a50c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc000c00 tx=0x7fe6dc0046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:05.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:05.511+0000 7fe6e9600640 1 -- 172.21.15.37:0/50235163 <== mon.2 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe6d4020020 con 0x7fe6ec102360 2024-09-11T23:17:05.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:05.722+0000 7fe6f1800640 1 -- 172.21.15.37:0/50235163 --> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fe6ec109f90 con 0x7fe6d00a2c00 2024-09-11T23:17:05.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:05.756+0000 7fe6e9600640 1 -- 172.21.15.37:0/50235163 <== mgr.14150 v2:172.21.15.37:6800/31543269 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fe6ec109f90 con 0x7fe6d00a2c00 2024-09-11T23:17:05.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:05.758+0000 7fe6f1800640 1 -- 172.21.15.37:0/50235163 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fe6d00a2c00 msgr2=0x7fe6d00a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:05.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:05.758+0000 7fe6f1800640 1 --2- 172.21.15.37:0/50235163 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fe6d00a2c00 0x7fe6d00a50c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc000c00 tx=0x7fe6dc0046c0 comp rx=0 tx=0).stop 2024-09-11T23:17:05.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:05.758+0000 7fe6f1800640 1 -- 172.21.15.37:0/50235163 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6ec102360 msgr2=0x7fe6ec198800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:05.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:05.758+0000 7fe6f1800640 1 --2- 172.21.15.37:0/50235163 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6ec102360 0x7fe6ec198800 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe6d400d720 tx=0x7fe6d400dbe0 comp rx=0 tx=0).stop 2024-09-11T23:17:05.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:05.759+0000 7fe6f1800640 1 -- 172.21.15.37:0/50235163 shutdown_connections 2024-09-11T23:17:05.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:05.759+0000 7fe6f1800640 1 --2- 172.21.15.37:0/50235163 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fe6d00a2c00 0x7fe6d00a50c0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:05.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:05.759+0000 7fe6f1800640 1 --2- 172.21.15.37:0/50235163 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6ec102360 0x7fe6ec198800 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:05.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:05.759+0000 7fe6f1800640 1 --2- 172.21.15.37:0/50235163 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe6ec1079c0 0x7fe6ec19cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:05.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:05.759+0000 7fe6f1800640 1 --2- 172.21.15.37:0/50235163 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6ec1019c0 0x7fe6ec1982c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:05.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:05.759+0000 7fe6f1800640 1 -- 172.21.15.37:0/50235163 >> 172.21.15.37:0/50235163 conn(0x7fe6ec0fd740 msgr2=0x7fe6ec0fdf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:05.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:05.759+0000 7fe6f1800640 1 -- 172.21.15.37:0/50235163 shutdown_connections 2024-09-11T23:17:05.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:05.759+0000 7fe6f1800640 1 -- 172.21.15.37:0/50235163 wait complete. 2024-09-11T23:17:06.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:05 smithi123 ceph-mon[35438]: pgmap v329: 129 pgs: 129 active+clean; 584 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2.3 KiB/s wr, 7 op/s 2024-09-11T23:17:06.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:05 smithi037 ceph-mon[30630]: pgmap v329: 129 pgs: 129 active+clean; 584 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2.3 KiB/s wr, 7 op/s 2024-09-11T23:17:06.064 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:17:05 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: 2024-09-11T23:17:05.729+0000 7f5636200640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:17:06.065 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:17:05 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: 2024-09-11T23:17:05.729+0000 7f5636200640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:17:06.065 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:17:05 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: 2024-09-11T23:17:05.729+0000 7f5636200640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:17:06.065 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:17:05 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: 2024-09-11T23:17:05.729+0000 7f5636200640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:17:06.065 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:17:05 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: 2024-09-11T23:17:05.729+0000 7f5636200640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:17:06.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:05 smithi160 ceph-mon[35055]: pgmap v329: 129 pgs: 129 active+clean; 584 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2.3 KiB/s wr, 7 op/s 2024-09-11T23:17:06.673 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-09-11T23:17:07.060 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:17:07.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:06 smithi037 ceph-mon[30630]: from='client.24701 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:17:07.085 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:06 smithi160 ceph-mon[35055]: from='client.24701 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:17:07.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:06 smithi123 ceph-mon[35438]: from='client.24701 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:17:07.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:07.634+0000 7f8f92800640 1 -- 172.21.15.37:0/2234992956 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f8c1049a0 msgr2=0x7f8f8c1089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:07.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:07.634+0000 7f8f92800640 1 --2- 172.21.15.37:0/2234992956 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f8c1049a0 0x7f8f8c1089f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f8f74009900 tx=0x7f8f7402a410 comp rx=0 tx=0).stop 2024-09-11T23:17:07.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:07.634+0000 7f8f92800640 1 -- 172.21.15.37:0/2234992956 shutdown_connections 2024-09-11T23:17:07.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:07.634+0000 7f8f92800640 1 --2- 172.21.15.37:0/2234992956 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8f8c109120 0x7f8f8c110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:07.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:07.634+0000 7f8f92800640 1 --2- 172.21.15.37:0/2234992956 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f8c1049a0 0x7f8f8c1089f0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:07.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:07.634+0000 7f8f92800640 1 --2- 172.21.15.37:0/2234992956 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8f8c103ff0 0x7f8f8c1043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:07.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:07.634+0000 7f8f92800640 1 -- 172.21.15.37:0/2234992956 >> 172.21.15.37:0/2234992956 conn(0x7f8f8c0ffa90 msgr2=0x7f8f8c101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:07.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:07.634+0000 7f8f92800640 1 -- 172.21.15.37:0/2234992956 shutdown_connections 2024-09-11T23:17:07.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:07.634+0000 7f8f92800640 1 -- 172.21.15.37:0/2234992956 wait complete. 2024-09-11T23:17:07.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:07.635+0000 7f8f92800640 1 Processor -- start 2024-09-11T23:17:07.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:07.635+0000 7f8f92800640 1 -- start start 2024-09-11T23:17:07.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:07.635+0000 7f8f92800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f8c103ff0 0x7f8f8c19a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:07.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:07.636+0000 7f8f92800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8f8c1049a0 0x7f8f8c19ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:07.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:07.636+0000 7f8f92800640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8f8c109120 0x7f8f8c19eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:07.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:07.636+0000 7f8f92800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8f8c114190 con 0x7f8f8c103ff0 2024-09-11T23:17:07.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:07.636+0000 7f8f92800640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f8f8c114010 con 0x7f8f8c1049a0 2024-09-11T23:17:07.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:07.636+0000 7f8f92800640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f8f8c114310 con 0x7f8f8c109120 2024-09-11T23:17:07.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:07.636+0000 7f8f8b400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f8c103ff0 0x7f8f8c19a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:07.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:07.636+0000 7f8f8b400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f8c103ff0 0x7f8f8c19a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34858/0 (socket says 172.21.15.37:34858) 2024-09-11T23:17:07.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:07.636+0000 7f8f83e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8f8c1049a0 0x7f8f8c19ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:07.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:07.636+0000 7f8f8b400640 1 -- 172.21.15.37:0/141640505 learned_addr learned my addr 172.21.15.37:0/141640505 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:17:07.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:07.636+0000 7f8f8be00640 1 --2- 172.21.15.37:0/141640505 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8f8c109120 0x7f8f8c19eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:07.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:07.636+0000 7f8f8b400640 1 -- 172.21.15.37:0/141640505 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8f8c109120 msgr2=0x7f8f8c19eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:07.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:07.636+0000 7f8f8b400640 1 --2- 172.21.15.37:0/141640505 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8f8c109120 0x7f8f8c19eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:07.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:07.636+0000 7f8f8b400640 1 -- 172.21.15.37:0/141640505 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8f8c1049a0 msgr2=0x7f8f8c19ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:07.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:07.636+0000 7f8f8b400640 1 --2- 172.21.15.37:0/141640505 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8f8c1049a0 0x7f8f8c19ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:07.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:07.636+0000 7f8f8b400640 1 -- 172.21.15.37:0/141640505 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f8c19f5c0 con 0x7f8f8c103ff0 2024-09-11T23:17:07.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:07.636+0000 7f8f83e00640 1 --2- 172.21.15.37:0/141640505 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8f8c1049a0 0x7f8f8c19ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:17:07.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:07.637+0000 7f8f8b400640 1 --2- 172.21.15.37:0/141640505 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f8c103ff0 0x7f8f8c19a610 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8f7c00e9f0 tx=0x7f8f7c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:07.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:07.637+0000 7f8f88c00640 1 -- 172.21.15.37:0/141640505 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f7c00cd80 con 0x7f8f8c103ff0 2024-09-11T23:17:07.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:07.637+0000 7f8f88c00640 1 -- 172.21.15.37:0/141640505 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8f7c005500 con 0x7f8f8c103ff0 2024-09-11T23:17:07.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:07.637+0000 7f8f92800640 1 -- 172.21.15.37:0/141640505 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f8c19f8b0 con 0x7f8f8c103ff0 2024-09-11T23:17:07.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:07.637+0000 7f8f88c00640 1 -- 172.21.15.37:0/141640505 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f7c010690 con 0x7f8f8c103ff0 2024-09-11T23:17:07.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:07.637+0000 7f8f92800640 1 -- 172.21.15.37:0/141640505 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f8c1a7190 con 0x7f8f8c103ff0 2024-09-11T23:17:07.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:07.638+0000 7f8f92800640 1 -- 172.21.15.37:0/141640505 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f8c1043d0 con 0x7f8f8c103ff0 2024-09-11T23:17:07.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:07.640+0000 7f8f88c00640 1 -- 172.21.15.37:0/141640505 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f8f7c0046c0 con 0x7f8f8c103ff0 2024-09-11T23:17:07.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:07.641+0000 7f8f88c00640 1 --2- 172.21.15.37:0/141640505 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f8f700a2c10 0x7f8f700a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:07.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:07.642+0000 7f8f88c00640 1 -- 172.21.15.37:0/141640505 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9092+0+0 (secure 0 0 0) 0x7f8f7c0cfa20 con 0x7f8f8c103ff0 2024-09-11T23:17:07.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:07.642+0000 7f8f83e00640 1 --2- 172.21.15.37:0/141640505 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f8f700a2c10 0x7f8f700a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:07.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:07.643+0000 7f8f83e00640 1 --2- 172.21.15.37:0/141640505 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f8f700a2c10 0x7f8f700a50d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8f74000c00 tx=0x7f8f74031510 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:07.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:07.646+0000 7f8f88c00640 1 -- 172.21.15.37:0/141640505 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8f7c09c460 con 0x7f8f8c103ff0 2024-09-11T23:17:07.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:07 smithi037 ceph-mon[30630]: pgmap v330: 129 pgs: 129 active+clean; 593 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 4.8 KiB/s wr, 18 op/s 2024-09-11T23:17:07.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:07 smithi037 ceph-mon[30630]: mgrmap e17: x(active, since 8m), standbys: z, y 2024-09-11T23:17:07.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:07.861+0000 7f8f92800640 1 -- 172.21.15.37:0/141640505 --> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f8f8c10c3d0 con 0x7f8f700a2c10 2024-09-11T23:17:07.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:07.887+0000 7f8f88c00640 1 -- 172.21.15.37:0/141640505 <== mgr.14150 v2:172.21.15.37:6800/31543269 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f8f74005020 con 0x7f8f700a2c10 2024-09-11T23:17:07.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:07.890+0000 7f8f92800640 1 -- 172.21.15.37:0/141640505 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f8f700a2c10 msgr2=0x7f8f700a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:07.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:07.890+0000 7f8f92800640 1 --2- 172.21.15.37:0/141640505 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f8f700a2c10 0x7f8f700a50d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8f74000c00 tx=0x7f8f74031510 comp rx=0 tx=0).stop 2024-09-11T23:17:07.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:07.890+0000 7f8f92800640 1 -- 172.21.15.37:0/141640505 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f8c103ff0 msgr2=0x7f8f8c19a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:07.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:07.890+0000 7f8f92800640 1 --2- 172.21.15.37:0/141640505 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f8c103ff0 0x7f8f8c19a610 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8f7c00e9f0 tx=0x7f8f7c00edf0 comp rx=0 tx=0).stop 2024-09-11T23:17:07.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:07.890+0000 7f8f92800640 1 -- 172.21.15.37:0/141640505 shutdown_connections 2024-09-11T23:17:07.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:07.890+0000 7f8f92800640 1 --2- 172.21.15.37:0/141640505 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f8f700a2c10 0x7f8f700a50d0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:07.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:07.890+0000 7f8f92800640 1 --2- 172.21.15.37:0/141640505 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8f8c1049a0 0x7f8f8c19ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:07.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:07.890+0000 7f8f92800640 1 --2- 172.21.15.37:0/141640505 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8f8c109120 0x7f8f8c19eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:07.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:07.890+0000 7f8f92800640 1 --2- 172.21.15.37:0/141640505 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f8c103ff0 0x7f8f8c19a610 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:07.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:07.890+0000 7f8f92800640 1 -- 172.21.15.37:0/141640505 >> 172.21.15.37:0/141640505 conn(0x7f8f8c0ffa90 msgr2=0x7f8f8c100d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:07.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:07.890+0000 7f8f92800640 1 -- 172.21.15.37:0/141640505 shutdown_connections 2024-09-11T23:17:07.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:07.890+0000 7f8f92800640 1 -- 172.21.15.37:0/141640505 wait complete. 2024-09-11T23:17:08.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:07 smithi160 ceph-mon[35055]: pgmap v330: 129 pgs: 129 active+clean; 593 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 4.8 KiB/s wr, 18 op/s 2024-09-11T23:17:08.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:07 smithi160 ceph-mon[35055]: mgrmap e17: x(active, since 8m), standbys: z, y 2024-09-11T23:17:08.251 INFO:journalctl@ceph.mds.b.smithi123.stdout:Sep 11 23:17:07 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-b[65584]: 2024-09-11T23:17:07.909+0000 7f7b560ff640 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2024-09-11T23:17:08.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:07 smithi123 ceph-mon[35438]: pgmap v330: 129 pgs: 129 active+clean; 593 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 4.8 KiB/s wr, 18 op/s 2024-09-11T23:17:08.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:07 smithi123 ceph-mon[35438]: mgrmap e17: x(active, since 8m), standbys: z, y 2024-09-11T23:17:08.659 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-09-11T23:17:09.042 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:17:09.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:08 smithi037 ceph-mon[30630]: from='client.14700 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:17:09.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:08 smithi160 ceph-mon[35055]: from='client.14700 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:17:09.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:08 smithi123 ceph-mon[35438]: from='client.14700 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:17:09.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:09.675+0000 7f9803200640 1 -- 172.21.15.37:0/45111736 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f97fc109120 msgr2=0x7f97fc110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:09.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:09.675+0000 7f9803200640 1 --2- 172.21.15.37:0/45111736 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f97fc109120 0x7f97fc110ca0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f97f4009ca0 tx=0x7f97f402a8c0 comp rx=0 tx=0).stop 2024-09-11T23:17:09.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:09.675+0000 7f9803200640 1 -- 172.21.15.37:0/45111736 shutdown_connections 2024-09-11T23:17:09.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:09.675+0000 7f9803200640 1 --2- 172.21.15.37:0/45111736 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f97fc109120 0x7f97fc110ca0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:09.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:09.675+0000 7f9803200640 1 --2- 172.21.15.37:0/45111736 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97fc1049a0 0x7f97fc1089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:09.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:09.675+0000 7f9803200640 1 --2- 172.21.15.37:0/45111736 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f97fc103ff0 0x7f97fc1043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:09.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:09.675+0000 7f9803200640 1 -- 172.21.15.37:0/45111736 >> 172.21.15.37:0/45111736 conn(0x7f97fc0ffa90 msgr2=0x7f97fc101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:09.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:09.675+0000 7f9803200640 1 -- 172.21.15.37:0/45111736 shutdown_connections 2024-09-11T23:17:09.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:09.675+0000 7f9803200640 1 -- 172.21.15.37:0/45111736 wait complete. 2024-09-11T23:17:09.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:09.677+0000 7f9803200640 1 Processor -- start 2024-09-11T23:17:09.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:09.677+0000 7f9803200640 1 -- start start 2024-09-11T23:17:09.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:09.677+0000 7f9803200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97fc103ff0 0x7f97fc19a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:09.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:09.677+0000 7f9803200640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f97fc1049a0 0x7f97fc19ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:09.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:09.677+0000 7f9803200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f97fc109120 0x7f97fc19ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:09.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:09.677+0000 7f9803200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f97fc1141a0 con 0x7f97fc103ff0 2024-09-11T23:17:09.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:09.677+0000 7f9803200640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f97fc114020 con 0x7f97fc109120 2024-09-11T23:17:09.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:09.677+0000 7f9803200640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f97fc114320 con 0x7f97fc1049a0 2024-09-11T23:17:09.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:09.678+0000 7f97fbe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97fc103ff0 0x7f97fc19a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:09.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:09.678+0000 7f97f3e00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f97fc1049a0 0x7f97fc19ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:09.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:09.678+0000 7f9801200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f97fc109120 0x7f97fc19ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:09.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:09.678+0000 7f97f3e00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f97fc1049a0 0x7f97fc19ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.37:43922/0 (socket says 172.21.15.37:43922) 2024-09-11T23:17:09.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:09.678+0000 7f97fbe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97fc103ff0 0x7f97fc19a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35426/0 (socket says 172.21.15.37:35426) 2024-09-11T23:17:09.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:09.678+0000 7f97f3e00640 1 -- 172.21.15.37:0/4076036983 learned_addr learned my addr 172.21.15.37:0/4076036983 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:17:09.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:09.678+0000 7f97f3e00640 1 -- 172.21.15.37:0/4076036983 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f97fc109120 msgr2=0x7f97fc19ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:09.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:09.678+0000 7f97f3e00640 1 --2- 172.21.15.37:0/4076036983 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f97fc109120 0x7f97fc19ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:09.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:09.678+0000 7f97f3e00640 1 -- 172.21.15.37:0/4076036983 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97fc103ff0 msgr2=0x7f97fc19a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:09.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:09.678+0000 7f97f3e00640 1 --2- 172.21.15.37:0/4076036983 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97fc103ff0 0x7f97fc19a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:09.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:09.678+0000 7f97f3e00640 1 -- 172.21.15.37:0/4076036983 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97fc19f5f0 con 0x7f97fc1049a0 2024-09-11T23:17:09.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:09.678+0000 7f9801200640 1 --2- 172.21.15.37:0/4076036983 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f97fc109120 0x7f97fc19ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:17:09.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:09.678+0000 7f97f3e00640 1 --2- 172.21.15.37:0/4076036983 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f97fc1049a0 0x7f97fc19ab80 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f97e400e9f0 tx=0x7f97e400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:09.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:09.679+0000 7f97f9600640 1 -- 172.21.15.37:0/4076036983 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97e400cd80 con 0x7f97fc1049a0 2024-09-11T23:17:09.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:09.679+0000 7f97f9600640 1 -- 172.21.15.37:0/4076036983 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f97e4010910 con 0x7f97fc1049a0 2024-09-11T23:17:09.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:09.679+0000 7f97f9600640 1 -- 172.21.15.37:0/4076036983 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97e4018990 con 0x7f97fc1049a0 2024-09-11T23:17:09.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:09.679+0000 7f9803200640 1 -- 172.21.15.37:0/4076036983 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97fc19f8e0 con 0x7f97fc1049a0 2024-09-11T23:17:09.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:09.679+0000 7f9803200640 1 -- 172.21.15.37:0/4076036983 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97fc1a71c0 con 0x7f97fc1049a0 2024-09-11T23:17:09.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:09.680+0000 7f9803200640 1 -- 172.21.15.37:0/4076036983 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97fc1043d0 con 0x7f97fc1049a0 2024-09-11T23:17:09.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:09.682+0000 7f97f9600640 1 -- 172.21.15.37:0/4076036983 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f97e4010ac0 con 0x7f97fc1049a0 2024-09-11T23:17:09.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:09.683+0000 7f97f9600640 1 --2- 172.21.15.37:0/4076036983 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f97e00a2c90 0x7f97e00a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:09.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:09.684+0000 7f97f9600640 1 -- 172.21.15.37:0/4076036983 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9092+0+0 (secure 0 0 0) 0x7f97e40cfc00 con 0x7f97fc1049a0 2024-09-11T23:17:09.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:09.684+0000 7f97fbe00640 1 --2- 172.21.15.37:0/4076036983 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f97e00a2c90 0x7f97e00a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:09.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:09.684+0000 7f97fbe00640 1 --2- 172.21.15.37:0/4076036983 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f97e00a2c90 0x7f97e00a5150 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f97ec009bd0 tx=0x7f97ec005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:09.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:09.685+0000 7f97f9600640 1 -- 172.21.15.37:0/4076036983 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f97e409bff0 con 0x7f97fc1049a0 2024-09-11T23:17:09.792 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:09 smithi123 ceph-mon[35438]: pgmap v331: 129 pgs: 129 active+clean; 593 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 4.7 KiB/s wr, 17 op/s 2024-09-11T23:17:09.792 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:09 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:17:09.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:09 smithi037 ceph-mon[30630]: pgmap v331: 129 pgs: 129 active+clean; 593 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 4.7 KiB/s wr, 17 op/s 2024-09-11T23:17:09.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:09 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:17:09.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:09.957+0000 7f9803200640 1 -- 172.21.15.37:0/4076036983 --> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7f97fc100c50 con 0x7f97e00a2c90 2024-09-11T23:17:09.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:09.962+0000 7f97f9600640 1 -- 172.21.15.37:0/4076036983 <== mgr.14150 v2:172.21.15.37:6800/31543269 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f97fc100c50 con 0x7f97e00a2c90 2024-09-11T23:17:09.962 INFO:teuthology.orchestra.run.smithi037.stdout:/volumes/qa/sv_0/3a969eef-4d61-4b61-9d1a-00eb8aa85af6 2024-09-11T23:17:09.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:09.964+0000 7f9803200640 1 -- 172.21.15.37:0/4076036983 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f97e00a2c90 msgr2=0x7f97e00a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:09.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:09.964+0000 7f9803200640 1 --2- 172.21.15.37:0/4076036983 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f97e00a2c90 0x7f97e00a5150 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f97ec009bd0 tx=0x7f97ec005f90 comp rx=0 tx=0).stop 2024-09-11T23:17:09.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:09.964+0000 7f9803200640 1 -- 172.21.15.37:0/4076036983 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f97fc1049a0 msgr2=0x7f97fc19ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:09.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:09.964+0000 7f9803200640 1 --2- 172.21.15.37:0/4076036983 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f97fc1049a0 0x7f97fc19ab80 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f97e400e9f0 tx=0x7f97e400eeb0 comp rx=0 tx=0).stop 2024-09-11T23:17:09.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:09.964+0000 7f9803200640 1 -- 172.21.15.37:0/4076036983 shutdown_connections 2024-09-11T23:17:09.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:09.964+0000 7f9803200640 1 --2- 172.21.15.37:0/4076036983 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f97e00a2c90 0x7f97e00a5150 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:09.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:09.964+0000 7f9803200640 1 --2- 172.21.15.37:0/4076036983 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f97fc109120 0x7f97fc19ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:09.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:09.964+0000 7f9803200640 1 --2- 172.21.15.37:0/4076036983 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f97fc1049a0 0x7f97fc19ab80 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:09.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:09.964+0000 7f9803200640 1 --2- 172.21.15.37:0/4076036983 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97fc103ff0 0x7f97fc19a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:09.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:09.964+0000 7f9803200640 1 -- 172.21.15.37:0/4076036983 >> 172.21.15.37:0/4076036983 conn(0x7f97fc0ffa90 msgr2=0x7f97fc100540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:09.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:09.964+0000 7f9803200640 1 -- 172.21.15.37:0/4076036983 shutdown_connections 2024-09-11T23:17:09.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:09.965+0000 7f9803200640 1 -- 172.21.15.37:0/4076036983 wait complete. 2024-09-11T23:17:10.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:09 smithi160 ceph-mon[35055]: pgmap v331: 129 pgs: 129 active+clean; 593 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 4.7 KiB/s wr, 17 op/s 2024-09-11T23:17:10.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:09 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:17:10.933 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:10 smithi037 ceph-mon[30630]: from='client.24727 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:17:10.934 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:10 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:17:10.934 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:10 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:17:10.934 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:10 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:17:10.934 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:10 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:17:10.969 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-09-11T23:17:11.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:10 smithi160 ceph-mon[35055]: from='client.24727 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:17:11.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:10 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:17:11.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:10 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:17:11.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:10 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:17:11.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:10 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:17:11.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:10 smithi123 ceph-mon[35438]: from='client.24727 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:17:11.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:10 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:17:11.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:10 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:17:11.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:10 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:17:11.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:10 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:17:11.413 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:17:11.831 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:11 smithi037 ceph-mon[30630]: pgmap v332: 129 pgs: 129 active+clean; 594 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 5.1 KiB/s wr, 20 op/s 2024-09-11T23:17:11.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:11.953+0000 7f7346800640 1 -- 172.21.15.37:0/3984773320 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73401079c0 msgr2=0x7f7340107da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:11.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:11.953+0000 7f7346800640 1 --2- 172.21.15.37:0/3984773320 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73401079c0 0x7f7340107da0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f7334009930 tx=0x7f733402a420 comp rx=0 tx=0).stop 2024-09-11T23:17:11.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:11.953+0000 7f7346800640 1 -- 172.21.15.37:0/3984773320 shutdown_connections 2024-09-11T23:17:11.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:11.953+0000 7f7346800640 1 --2- 172.21.15.37:0/3984773320 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f73401019c0 0x7f7340101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:11.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:11.953+0000 7f7346800640 1 --2- 172.21.15.37:0/3984773320 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7340102360 0x7f734010e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:11.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:11.953+0000 7f7346800640 1 --2- 172.21.15.37:0/3984773320 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73401079c0 0x7f7340107da0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:11.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:11.953+0000 7f7346800640 1 -- 172.21.15.37:0/3984773320 >> 172.21.15.37:0/3984773320 conn(0x7f73400fd740 msgr2=0x7f73400ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:11.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:11.953+0000 7f7346800640 1 -- 172.21.15.37:0/3984773320 shutdown_connections 2024-09-11T23:17:11.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:11.954+0000 7f7346800640 1 -- 172.21.15.37:0/3984773320 wait complete. 2024-09-11T23:17:11.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:11.954+0000 7f7346800640 1 Processor -- start 2024-09-11T23:17:11.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:11.955+0000 7f7346800640 1 -- start start 2024-09-11T23:17:11.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:11.955+0000 7f7346800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f73401019c0 0x7f734019a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:11.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:11.955+0000 7f7346800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7340102360 0x7f734019a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:11.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:11.955+0000 7f7346800640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f73401079c0 0x7f734019ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:11.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:11.955+0000 7f7346800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7340111d90 con 0x7f7340102360 2024-09-11T23:17:11.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:11.955+0000 7f7346800640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f7340111c10 con 0x7f73401019c0 2024-09-11T23:17:11.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:11.955+0000 7f7346800640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f7340111f10 con 0x7f73401079c0 2024-09-11T23:17:11.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:11.956+0000 7f7344a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7340102360 0x7f734019a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:11.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:11.956+0000 7f7345400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f73401019c0 0x7f734019a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:11.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:11.956+0000 7f7344a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7340102360 0x7f734019a9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35438/0 (socket says 172.21.15.37:35438) 2024-09-11T23:17:11.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:11.956+0000 7f7345400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f73401019c0 0x7f734019a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.37:53574/0 (socket says 172.21.15.37:53574) 2024-09-11T23:17:11.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:11.956+0000 7f7344a00640 1 -- 172.21.15.37:0/2144675615 learned_addr learned my addr 172.21.15.37:0/2144675615 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:17:11.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:11.956+0000 7f7345e00640 1 --2- 172.21.15.37:0/2144675615 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f73401079c0 0x7f734019ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:11.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:11.956+0000 7f7345400640 1 -- 172.21.15.37:0/2144675615 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f73401079c0 msgr2=0x7f734019ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:11.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:11.956+0000 7f7345400640 1 --2- 172.21.15.37:0/2144675615 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f73401079c0 0x7f734019ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:11.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:11.956+0000 7f7345400640 1 -- 172.21.15.37:0/2144675615 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7340102360 msgr2=0x7f734019a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:11.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:11.956+0000 7f7345400640 1 --2- 172.21.15.37:0/2144675615 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7340102360 0x7f734019a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:11.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:11.956+0000 7f7345400640 1 -- 172.21.15.37:0/2144675615 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f734019f460 con 0x7f73401019c0 2024-09-11T23:17:11.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:11.956+0000 7f7345400640 1 --2- 172.21.15.37:0/2144675615 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f73401019c0 0x7f734019a4b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7334005940 tx=0x7f7334031b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:11.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:11.957+0000 7f733e000640 1 -- 172.21.15.37:0/2144675615 <== mon.2 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f733403f070 con 0x7f73401019c0 2024-09-11T23:17:11.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:11.957+0000 7f733e000640 1 -- 172.21.15.37:0/2144675615 <== mon.2 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7334003ad0 con 0x7f73401019c0 2024-09-11T23:17:11.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:11.957+0000 7f733e000640 1 -- 172.21.15.37:0/2144675615 <== mon.2 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7334035070 con 0x7f73401019c0 2024-09-11T23:17:11.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:11.957+0000 7f7346800640 1 -- 172.21.15.37:0/2144675615 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f734019f6f0 con 0x7f73401019c0 2024-09-11T23:17:11.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:11.957+0000 7f7346800640 1 -- 172.21.15.37:0/2144675615 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f734019fb80 con 0x7f73401019c0 2024-09-11T23:17:11.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:11.958+0000 7f7346800640 1 -- 172.21.15.37:0/2144675615 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7340101e20 con 0x7f73401019c0 2024-09-11T23:17:11.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:11.960+0000 7f733e000640 1 -- 172.21.15.37:0/2144675615 <== mon.2 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f73340035f0 con 0x7f73401019c0 2024-09-11T23:17:11.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:11.961+0000 7f733e000640 1 --2- 172.21.15.37:0/2144675615 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f73280a2c10 0x7f73280a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:11.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:11.961+0000 7f733e000640 1 -- 172.21.15.37:0/2144675615 <== mon.2 v2:172.21.15.123:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9092+0+0 (secure 0 0 0) 0x7f73340ef9b0 con 0x7f73401019c0 2024-09-11T23:17:11.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:11.961+0000 7f7344a00640 1 --2- 172.21.15.37:0/2144675615 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f73280a2c10 0x7f73280a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:11.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:11.962+0000 7f7344a00640 1 --2- 172.21.15.37:0/2144675615 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f73280a2c10 0x7f73280a50d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f734010ec90 tx=0x7f732c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:11.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:11.965+0000 7f733e000640 1 -- 172.21.15.37:0/2144675615 <== mon.2 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f73340bbda0 con 0x7f73401019c0 2024-09-11T23:17:12.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:11 smithi160 ceph-mon[35055]: pgmap v332: 129 pgs: 129 active+clean; 594 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 5.1 KiB/s wr, 20 op/s 2024-09-11T23:17:12.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:12.201+0000 7f7346800640 1 -- 172.21.15.37:0/2144675615 --> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f73400fe500 con 0x7f73280a2c10 2024-09-11T23:17:12.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:12.227+0000 7f733e000640 1 -- 172.21.15.37:0/2144675615 <== mgr.14150 v2:172.21.15.37:6800/31543269 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f73400fe500 con 0x7f73280a2c10 2024-09-11T23:17:12.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:12.229+0000 7f7346800640 1 -- 172.21.15.37:0/2144675615 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f73280a2c10 msgr2=0x7f73280a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:12.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:12.229+0000 7f7346800640 1 --2- 172.21.15.37:0/2144675615 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f73280a2c10 0x7f73280a50d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f734010ec90 tx=0x7f732c005f90 comp rx=0 tx=0).stop 2024-09-11T23:17:12.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:12.229+0000 7f7346800640 1 -- 172.21.15.37:0/2144675615 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f73401019c0 msgr2=0x7f734019a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:12.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:12.229+0000 7f7346800640 1 --2- 172.21.15.37:0/2144675615 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f73401019c0 0x7f734019a4b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7334005940 tx=0x7f7334031b50 comp rx=0 tx=0).stop 2024-09-11T23:17:12.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:12.229+0000 7f7346800640 1 -- 172.21.15.37:0/2144675615 shutdown_connections 2024-09-11T23:17:12.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:12.229+0000 7f7346800640 1 --2- 172.21.15.37:0/2144675615 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f73280a2c10 0x7f73280a50d0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:12.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:12.229+0000 7f7346800640 1 --2- 172.21.15.37:0/2144675615 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f73401079c0 0x7f734019ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:12.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:12.229+0000 7f7346800640 1 --2- 172.21.15.37:0/2144675615 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7340102360 0x7f734019a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:12.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:12.229+0000 7f7346800640 1 --2- 172.21.15.37:0/2144675615 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f73401019c0 0x7f734019a4b0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:12.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:12.229+0000 7f7346800640 1 -- 172.21.15.37:0/2144675615 >> 172.21.15.37:0/2144675615 conn(0x7f73400fd740 msgr2=0x7f73400fddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:12.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:12.230+0000 7f7346800640 1 -- 172.21.15.37:0/2144675615 shutdown_connections 2024-09-11T23:17:12.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:12.230+0000 7f7346800640 1 -- 172.21.15.37:0/2144675615 wait complete. 2024-09-11T23:17:12.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:11 smithi123 ceph-mon[35438]: pgmap v332: 129 pgs: 129 active+clean; 594 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 5.1 KiB/s wr, 20 op/s 2024-09-11T23:17:13.023 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-09-11T23:17:13.425 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:17:13.883 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:13 smithi037 ceph-mon[30630]: pgmap v333: 129 pgs: 129 active+clean; 608 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 6.5 KiB/s wr, 23 op/s 2024-09-11T23:17:13.883 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:13 smithi037 ceph-mon[30630]: from='client.24725 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:17:13.884 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:13 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:17:13.884 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:13 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:17:14.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:14.021+0000 7f5b7ea00640 1 -- 172.21.15.37:0/1385730477 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b78103ff0 msgr2=0x7f5b781043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:14.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:14.021+0000 7f5b7ea00640 1 --2- 172.21.15.37:0/1385730477 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b78103ff0 0x7f5b781043d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5b68009900 tx=0x7f5b6802a410 comp rx=0 tx=0).stop 2024-09-11T23:17:14.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:14.021+0000 7f5b7ea00640 1 -- 172.21.15.37:0/1385730477 shutdown_connections 2024-09-11T23:17:14.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:14.021+0000 7f5b7ea00640 1 --2- 172.21.15.37:0/1385730477 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5b781049a0 0x7f5b781089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:14.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:14.021+0000 7f5b7ea00640 1 --2- 172.21.15.37:0/1385730477 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5b78109120 0x7f5b78110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:14.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:14.021+0000 7f5b7ea00640 1 --2- 172.21.15.37:0/1385730477 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b78103ff0 0x7f5b781043d0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:14.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:14.021+0000 7f5b7ea00640 1 -- 172.21.15.37:0/1385730477 >> 172.21.15.37:0/1385730477 conn(0x7f5b780ffa90 msgr2=0x7f5b78101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:14.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:14.021+0000 7f5b7ea00640 1 -- 172.21.15.37:0/1385730477 shutdown_connections 2024-09-11T23:17:14.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:14.021+0000 7f5b7ea00640 1 -- 172.21.15.37:0/1385730477 wait complete. 2024-09-11T23:17:14.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:14.022+0000 7f5b7ea00640 1 Processor -- start 2024-09-11T23:17:14.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:14.022+0000 7f5b7ea00640 1 -- start start 2024-09-11T23:17:14.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:14.022+0000 7f5b7ea00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5b78103ff0 0x7f5b7819a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:14.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:14.022+0000 7f5b7ea00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5b781049a0 0x7f5b7819ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:14.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:14.022+0000 7f5b7ea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b78109120 0x7f5b7819eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:14.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:14.022+0000 7f5b7ea00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5b78114150 con 0x7f5b78109120 2024-09-11T23:17:14.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:14.023+0000 7f5b7ea00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f5b78113fd0 con 0x7f5b781049a0 2024-09-11T23:17:14.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:14.023+0000 7f5b7ea00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f5b781142d0 con 0x7f5b78103ff0 2024-09-11T23:17:14.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:14.023+0000 7f5b77400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5b781049a0 0x7f5b7819ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:14.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:14.023+0000 7f5b7ca00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b78109120 0x7f5b7819eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:14.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:14.023+0000 7f5b77e00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5b78103ff0 0x7f5b7819a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:14.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:14.023+0000 7f5b77400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5b781049a0 0x7f5b7819ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.37:53594/0 (socket says 172.21.15.37:53594) 2024-09-11T23:17:14.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:14.023+0000 7f5b7ca00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b78109120 0x7f5b7819eec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35442/0 (socket says 172.21.15.37:35442) 2024-09-11T23:17:14.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:14.023+0000 7f5b77400640 1 -- 172.21.15.37:0/2705453222 learned_addr learned my addr 172.21.15.37:0/2705453222 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:17:14.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:14.023+0000 7f5b77400640 1 -- 172.21.15.37:0/2705453222 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5b78103ff0 msgr2=0x7f5b7819a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:14.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:14.023+0000 7f5b77400640 1 --2- 172.21.15.37:0/2705453222 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5b78103ff0 0x7f5b7819a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:14.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:14.023+0000 7f5b77400640 1 -- 172.21.15.37:0/2705453222 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b78109120 msgr2=0x7f5b7819eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:14.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:14.023+0000 7f5b77400640 1 --2- 172.21.15.37:0/2705453222 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b78109120 0x7f5b7819eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:14.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:14.023+0000 7f5b77400640 1 -- 172.21.15.37:0/2705453222 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b7819f5a0 con 0x7f5b781049a0 2024-09-11T23:17:14.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:14.024+0000 7f5b77400640 1 --2- 172.21.15.37:0/2705453222 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5b781049a0 0x7f5b7819ab30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5b6400e9f0 tx=0x7f5b6400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:14.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:14.024+0000 7f5b74c00640 1 -- 172.21.15.37:0/2705453222 <== mon.2 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b6400cd80 con 0x7f5b781049a0 2024-09-11T23:17:14.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:14.024+0000 7f5b7ea00640 1 -- 172.21.15.37:0/2705453222 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b7819f890 con 0x7f5b781049a0 2024-09-11T23:17:14.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:14.024+0000 7f5b7ea00640 1 -- 172.21.15.37:0/2705453222 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b781a7170 con 0x7f5b781049a0 2024-09-11T23:17:14.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:14.024+0000 7f5b74c00640 1 -- 172.21.15.37:0/2705453222 <== mon.2 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5b64010910 con 0x7f5b781049a0 2024-09-11T23:17:14.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:14.024+0000 7f5b74c00640 1 -- 172.21.15.37:0/2705453222 <== mon.2 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b640188f0 con 0x7f5b781049a0 2024-09-11T23:17:14.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:14.025+0000 7f5b7ea00640 1 -- 172.21.15.37:0/2705453222 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b781043d0 con 0x7f5b781049a0 2024-09-11T23:17:14.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:14.028+0000 7f5b74c00640 1 -- 172.21.15.37:0/2705453222 <== mon.2 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f5b64010ac0 con 0x7f5b781049a0 2024-09-11T23:17:14.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:14.029+0000 7f5b74c00640 1 --2- 172.21.15.37:0/2705453222 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f5b5c0a2c90 0x7f5b5c0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:14.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:14.029+0000 7f5b74c00640 1 -- 172.21.15.37:0/2705453222 <== mon.2 v2:172.21.15.123:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9092+0+0 (secure 0 0 0) 0x7f5b640cf8d0 con 0x7f5b781049a0 2024-09-11T23:17:14.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:14.029+0000 7f5b77e00640 1 --2- 172.21.15.37:0/2705453222 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f5b5c0a2c90 0x7f5b5c0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:14.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:14.030+0000 7f5b77e00640 1 --2- 172.21.15.37:0/2705453222 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f5b5c0a2c90 0x7f5b5c0a5150 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f5b68009230 tx=0x7f5b680058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:14.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:14.033+0000 7f5b74c00640 1 -- 172.21.15.37:0/2705453222 <== mon.2 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5b6409bcc0 con 0x7f5b781049a0 2024-09-11T23:17:14.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:13 smithi160 ceph-mon[35055]: pgmap v333: 129 pgs: 129 active+clean; 608 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 6.5 KiB/s wr, 23 op/s 2024-09-11T23:17:14.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:13 smithi160 ceph-mon[35055]: from='client.24725 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:17:14.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:13 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:17:14.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:13 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:17:14.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:13 smithi123 ceph-mon[35438]: pgmap v333: 129 pgs: 129 active+clean; 608 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 6.5 KiB/s wr, 23 op/s 2024-09-11T23:17:14.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:13 smithi123 ceph-mon[35438]: from='client.24725 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:17:14.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:13 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:17:14.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:13 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:17:14.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:14.251+0000 7f5b7ea00640 1 -- 172.21.15.37:0/2705453222 --> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7f5b78062630 con 0x7f5b5c0a2c90 2024-09-11T23:17:14.257 INFO:teuthology.orchestra.run.smithi037.stdout:/volumes/qa/sv_1/b1f76a95-28df-47ca-a4c2-c74e28a5ad7d 2024-09-11T23:17:14.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:14.257+0000 7f5b74c00640 1 -- 172.21.15.37:0/2705453222 <== mgr.14150 v2:172.21.15.37:6800/31543269 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f5b78062630 con 0x7f5b5c0a2c90 2024-09-11T23:17:14.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:14.259+0000 7f5b7ea00640 1 -- 172.21.15.37:0/2705453222 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f5b5c0a2c90 msgr2=0x7f5b5c0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:14.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:14.259+0000 7f5b7ea00640 1 --2- 172.21.15.37:0/2705453222 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f5b5c0a2c90 0x7f5b5c0a5150 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f5b68009230 tx=0x7f5b680058d0 comp rx=0 tx=0).stop 2024-09-11T23:17:14.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:14.259+0000 7f5b7ea00640 1 -- 172.21.15.37:0/2705453222 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5b781049a0 msgr2=0x7f5b7819ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:14.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:14.259+0000 7f5b7ea00640 1 --2- 172.21.15.37:0/2705453222 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5b781049a0 0x7f5b7819ab30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5b6400e9f0 tx=0x7f5b6400eeb0 comp rx=0 tx=0).stop 2024-09-11T23:17:14.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:14.259+0000 7f5b7ea00640 1 -- 172.21.15.37:0/2705453222 shutdown_connections 2024-09-11T23:17:14.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:14.259+0000 7f5b7ea00640 1 --2- 172.21.15.37:0/2705453222 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f5b5c0a2c90 0x7f5b5c0a5150 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:14.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:14.259+0000 7f5b7ea00640 1 --2- 172.21.15.37:0/2705453222 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5b781049a0 0x7f5b7819ab30 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:14.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:14.259+0000 7f5b7ea00640 1 --2- 172.21.15.37:0/2705453222 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b78109120 0x7f5b7819eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:14.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:14.259+0000 7f5b7ea00640 1 --2- 172.21.15.37:0/2705453222 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5b78103ff0 0x7f5b7819a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:14.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:14.259+0000 7f5b7ea00640 1 -- 172.21.15.37:0/2705453222 >> 172.21.15.37:0/2705453222 conn(0x7f5b780ffa90 msgr2=0x7f5b78100e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:14.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:14.259+0000 7f5b7ea00640 1 -- 172.21.15.37:0/2705453222 shutdown_connections 2024-09-11T23:17:14.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:14.259+0000 7f5b7ea00640 1 -- 172.21.15.37:0/2705453222 wait complete. 2024-09-11T23:17:14.970 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:14 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:17:14.971 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:14 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:17:14.971 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:14 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:17:15.011 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T23:17:15.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:14 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:17:15.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:14 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:17:15.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:14 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:17:15.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:14 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:17:15.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:14 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:17:15.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:14 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:17:15.390 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:17:15.791 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:15 smithi037 ceph-mon[30630]: pgmap v334: 129 pgs: 129 active+clean; 608 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 6.5 KiB/s wr, 22 op/s 2024-09-11T23:17:15.791 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:15 smithi037 ceph-mon[30630]: from='client.24731 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:17:15.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:15.904+0000 7fa351800640 1 -- 172.21.15.37:0/639308621 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa34c074620 msgr2=0x7fa34c074a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:15.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:15.904+0000 7fa351800640 1 --2- 172.21.15.37:0/639308621 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa34c074620 0x7fa34c074a00 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa33c009900 tx=0x7fa33c02a480 comp rx=0 tx=0).stop 2024-09-11T23:17:15.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:15.904+0000 7fa351800640 1 -- 172.21.15.37:0/639308621 shutdown_connections 2024-09-11T23:17:15.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:15.904+0000 7fa351800640 1 --2- 172.21.15.37:0/639308621 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa34c10e3c0 0x7fa34c110810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:15.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:15.904+0000 7fa351800640 1 --2- 172.21.15.37:0/639308621 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa34c074f40 0x7fa34c10de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:15.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:15.904+0000 7fa351800640 1 --2- 172.21.15.37:0/639308621 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa34c074620 0x7fa34c074a00 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:15.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:15.904+0000 7fa351800640 1 -- 172.21.15.37:0/639308621 >> 172.21.15.37:0/639308621 conn(0x7fa34c0fd8c0 msgr2=0x7fa34c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:15.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:15.904+0000 7fa351800640 1 -- 172.21.15.37:0/639308621 shutdown_connections 2024-09-11T23:17:15.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:15.904+0000 7fa351800640 1 -- 172.21.15.37:0/639308621 wait complete. 2024-09-11T23:17:15.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:15.905+0000 7fa351800640 1 Processor -- start 2024-09-11T23:17:15.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:15.906+0000 7fa351800640 1 -- start start 2024-09-11T23:17:15.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:15.906+0000 7fa351800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa34c074620 0x7fa34c19a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:15.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:15.906+0000 7fa351800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa34c074f40 0x7fa34c19aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:15.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:15.906+0000 7fa351800640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa34c10e3c0 0x7fa34c19ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:15.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:15.906+0000 7fa351800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa34c1141c0 con 0x7fa34c074f40 2024-09-11T23:17:15.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:15.906+0000 7fa351800640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fa34c114040 con 0x7fa34c074620 2024-09-11T23:17:15.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:15.906+0000 7fa351800640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fa34c114340 con 0x7fa34c10e3c0 2024-09-11T23:17:15.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:15.906+0000 7fa342000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa34c074f40 0x7fa34c19aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:15.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:15.906+0000 7fa342000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa34c074f40 0x7fa34c19aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35448/0 (socket says 172.21.15.37:35448) 2024-09-11T23:17:15.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:15.906+0000 7fa342000640 1 -- 172.21.15.37:0/2375068294 learned_addr learned my addr 172.21.15.37:0/2375068294 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:17:15.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:15.906+0000 7fa34aa00640 1 --2- 172.21.15.37:0/2375068294 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa34c074620 0x7fa34c19a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:15.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:15.907+0000 7fa34b400640 1 --2- 172.21.15.37:0/2375068294 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa34c10e3c0 0x7fa34c19ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:15.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:15.907+0000 7fa342000640 1 -- 172.21.15.37:0/2375068294 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa34c10e3c0 msgr2=0x7fa34c19ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:15.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:15.907+0000 7fa342000640 1 --2- 172.21.15.37:0/2375068294 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa34c10e3c0 0x7fa34c19ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:15.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:15.907+0000 7fa342000640 1 -- 172.21.15.37:0/2375068294 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa34c074620 msgr2=0x7fa34c19a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:15.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:15.907+0000 7fa342000640 1 --2- 172.21.15.37:0/2375068294 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa34c074620 0x7fa34c19a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:15.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:15.907+0000 7fa342000640 1 -- 172.21.15.37:0/2375068294 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa34c19f610 con 0x7fa34c074f40 2024-09-11T23:17:15.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:15.907+0000 7fa34b400640 1 --2- 172.21.15.37:0/2375068294 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa34c10e3c0 0x7fa34c19ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:17:15.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:15.907+0000 7fa342000640 1 --2- 172.21.15.37:0/2375068294 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa34c074f40 0x7fa34c19aba0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa33400e9f0 tx=0x7fa33400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:15.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:15.907+0000 7fa343e00640 1 -- 172.21.15.37:0/2375068294 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa33400cd80 con 0x7fa34c074f40 2024-09-11T23:17:15.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:15.907+0000 7fa343e00640 1 -- 172.21.15.37:0/2375068294 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa334005500 con 0x7fa34c074f40 2024-09-11T23:17:15.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:15.907+0000 7fa343e00640 1 -- 172.21.15.37:0/2375068294 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa334010690 con 0x7fa34c074f40 2024-09-11T23:17:15.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:15.907+0000 7fa351800640 1 -- 172.21.15.37:0/2375068294 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa34c19f900 con 0x7fa34c074f40 2024-09-11T23:17:15.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:15.908+0000 7fa351800640 1 -- 172.21.15.37:0/2375068294 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa34c1a71e0 con 0x7fa34c074f40 2024-09-11T23:17:15.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:15.909+0000 7fa351800640 1 -- 172.21.15.37:0/2375068294 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa34c074a00 con 0x7fa34c074f40 2024-09-11T23:17:15.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:15.911+0000 7fa343e00640 1 -- 172.21.15.37:0/2375068294 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fa3340046c0 con 0x7fa34c074f40 2024-09-11T23:17:15.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:15.913+0000 7fa343e00640 1 --2- 172.21.15.37:0/2375068294 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fa3300a2c90 0x7fa3300a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:15.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:15.914+0000 7fa343e00640 1 -- 172.21.15.37:0/2375068294 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9092+0+0 (secure 0 0 0) 0x7fa3340cf9c0 con 0x7fa34c074f40 2024-09-11T23:17:15.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:15.914+0000 7fa34aa00640 1 --2- 172.21.15.37:0/2375068294 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fa3300a2c90 0x7fa3300a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:15.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:15.914+0000 7fa34aa00640 1 --2- 172.21.15.37:0/2375068294 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fa3300a2c90 0x7fa3300a5150 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa33c000c00 tx=0x7fa33c005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:15.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:15.918+0000 7fa343e00640 1 -- 172.21.15.37:0/2375068294 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa33409c400 con 0x7fa34c074f40 2024-09-11T23:17:16.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:16.143+0000 7fa351800640 1 -- 172.21.15.37:0/2375068294 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa34c02d7c0 con 0x7fa34c074f40 2024-09-11T23:17:16.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:16.144+0000 7fa343e00640 1 -- 172.21.15.37:0/2375068294 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11986 (secure 0 0 0) 0x7fa33409bd00 con 0x7fa34c074f40 2024-09-11T23:17:16.144 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:17:16.144 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":28,"btime":"2024-09-11T23:17:03:741210+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14448,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/285120996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":285120996},{"type":"v1","addr":"172.21.15.37:6835","nonce":285120996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14460,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/3095283029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":3095283029},{"type":"v1","addr":"172.21.15.37:6837","nonce":3095283029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T23:16:16.642956+0000","modified":"2024-09-11T23:17:03.741190+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24533,"mds_1":24520,"mds_2":24499,"mds_3":24497,"mds_4":24493},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14499":{"gid":14499,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6839/1072030582","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":1072030582},{"type":"v1","addr":"172.21.15.37:6839","nonce":1072030582}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14511":{"gid":14511,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6841/209927476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":209927476},{"type":"v1","addr":"172.21.15.37:6841","nonce":209927476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24440":{"gid":24440,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.123:6833/3380294842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":3380294842},{"type":"v1","addr":"172.21.15.123:6833","nonce":3380294842}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6833/1918127245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":1918127245},{"type":"v1","addr":"172.21.15.160:6833","nonce":1918127245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.123:6835/3928690501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":3928690501},{"type":"v1","addr":"172.21.15.123:6835","nonce":3928690501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":21,"addr":"172.21.15.160:6835/2316897035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":2316897035},{"type":"v1","addr":"172.21.15.160:6835","nonce":2316897035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"h","rank":3,"incarnation":24,"state":"up:active","state_seq":19,"addr":"172.21.15.123:6837/2168535476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":2168535476},{"type":"v1","addr":"172.21.15.123:6837","nonce":2168535476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":20,"addr":"172.21.15.160:6837/2906597021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":2906597021},{"type":"v1","addr":"172.21.15.160:6837","nonce":2906597021}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24520":{"gid":24520,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":18,"addr":"172.21.15.160:6839/2041625862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":2041625862},{"type":"v1","addr":"172.21.15.160:6839","nonce":2041625862}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24533":{"gid":24533,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.123:6839/3077076065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6838","nonce":3077076065},{"type":"v1","addr":"172.21.15.123:6839","nonce":3077076065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24533,"qdb_cluster":[24533,24520,24499,24497,24493]},"id":1}]} 2024-09-11T23:17:16.145 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 28 2024-09-11T23:17:16.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:16.146+0000 7fa351800640 1 -- 172.21.15.37:0/2375068294 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fa3300a2c90 msgr2=0x7fa3300a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:16.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:16.146+0000 7fa351800640 1 --2- 172.21.15.37:0/2375068294 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fa3300a2c90 0x7fa3300a5150 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa33c000c00 tx=0x7fa33c005b50 comp rx=0 tx=0).stop 2024-09-11T23:17:16.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:16.146+0000 7fa351800640 1 -- 172.21.15.37:0/2375068294 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa34c074f40 msgr2=0x7fa34c19aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:16.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:16.146+0000 7fa351800640 1 --2- 172.21.15.37:0/2375068294 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa34c074f40 0x7fa34c19aba0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa33400e9f0 tx=0x7fa33400edf0 comp rx=0 tx=0).stop 2024-09-11T23:17:16.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:16.147+0000 7fa351800640 1 -- 172.21.15.37:0/2375068294 shutdown_connections 2024-09-11T23:17:16.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:16.147+0000 7fa351800640 1 --2- 172.21.15.37:0/2375068294 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fa3300a2c90 0x7fa3300a5150 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:16.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:16.147+0000 7fa351800640 1 --2- 172.21.15.37:0/2375068294 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa34c10e3c0 0x7fa34c19ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:16.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:16.147+0000 7fa351800640 1 --2- 172.21.15.37:0/2375068294 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa34c074f40 0x7fa34c19aba0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:16.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:16.147+0000 7fa351800640 1 --2- 172.21.15.37:0/2375068294 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa34c074620 0x7fa34c19a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:16.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:16.147+0000 7fa351800640 1 -- 172.21.15.37:0/2375068294 >> 172.21.15.37:0/2375068294 conn(0x7fa34c0fd8c0 msgr2=0x7fa34c0fe560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:16.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:16.147+0000 7fa351800640 1 -- 172.21.15.37:0/2375068294 shutdown_connections 2024-09-11T23:17:16.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:16.147+0000 7fa351800640 1 -- 172.21.15.37:0/2375068294 wait complete. 2024-09-11T23:17:16.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:15 smithi160 ceph-mon[35055]: pgmap v334: 129 pgs: 129 active+clean; 608 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 6.5 KiB/s wr, 22 op/s 2024-09-11T23:17:16.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:15 smithi160 ceph-mon[35055]: from='client.24731 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:17:16.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:15 smithi123 ceph-mon[35438]: pgmap v334: 129 pgs: 129 active+clean; 608 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 6.5 KiB/s wr, 22 op/s 2024-09-11T23:17:16.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:15 smithi123 ceph-mon[35438]: from='client.24731 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:17:16.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:16 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/2375068294' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:17:16.968 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T23:17:17.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:16 smithi160 ceph-mon[35055]: from='client.? 172.21.15.37:0/2375068294' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:17:17.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:16 smithi123 ceph-mon[35438]: from='client.? 172.21.15.37:0/2375068294' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:17:17.348 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:17:17.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:17.963+0000 7f1f67600640 1 -- 172.21.15.37:0/1861043628 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f60103ff0 msgr2=0x7f1f601043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:17.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:17.963+0000 7f1f67600640 1 --2- 172.21.15.37:0/1861043628 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f60103ff0 0x7f1f601043d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f1f54009ca0 tx=0x7f1f5402a8c0 comp rx=0 tx=0).stop 2024-09-11T23:17:17.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:17.963+0000 7f1f67600640 1 -- 172.21.15.37:0/1861043628 shutdown_connections 2024-09-11T23:17:17.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:17.963+0000 7f1f67600640 1 --2- 172.21.15.37:0/1861043628 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f601049a0 0x7f1f601089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:17.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:17.963+0000 7f1f67600640 1 --2- 172.21.15.37:0/1861043628 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1f60109120 0x7f1f60110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:17.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:17.963+0000 7f1f67600640 1 --2- 172.21.15.37:0/1861043628 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f60103ff0 0x7f1f601043d0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:17.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:17.963+0000 7f1f67600640 1 -- 172.21.15.37:0/1861043628 >> 172.21.15.37:0/1861043628 conn(0x7f1f600ffa90 msgr2=0x7f1f60101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:17.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:17.963+0000 7f1f67600640 1 -- 172.21.15.37:0/1861043628 shutdown_connections 2024-09-11T23:17:17.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:17.963+0000 7f1f67600640 1 -- 172.21.15.37:0/1861043628 wait complete. 2024-09-11T23:17:17.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:17.964+0000 7f1f67600640 1 Processor -- start 2024-09-11T23:17:17.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:17.964+0000 7f1f67600640 1 -- start start 2024-09-11T23:17:17.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:17.964+0000 7f1f67600640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1f60103ff0 0x7f1f6019a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:17.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:17.964+0000 7f1f67600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f601049a0 0x7f1f6019ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:17.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:17.964+0000 7f1f67600640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f60109120 0x7f1f6019eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:17.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:17.964+0000 7f1f67600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1f601141a0 con 0x7f1f601049a0 2024-09-11T23:17:17.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:17.964+0000 7f1f67600640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f1f60114020 con 0x7f1f60109120 2024-09-11T23:17:17.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:17.964+0000 7f1f67600640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f1f60114320 con 0x7f1f60103ff0 2024-09-11T23:17:17.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:17.965+0000 7f1f5fe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f601049a0 0x7f1f6019ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:17.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:17.965+0000 7f1f5fe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f601049a0 0x7f1f6019ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35470/0 (socket says 172.21.15.37:35470) 2024-09-11T23:17:17.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:17.965+0000 7f1f5fe00640 1 -- 172.21.15.37:0/4004447779 learned_addr learned my addr 172.21.15.37:0/4004447779 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:17:17.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:17.965+0000 7f1f64c00640 1 --2- 172.21.15.37:0/4004447779 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1f60103ff0 0x7f1f6019a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:17.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:17.965+0000 7f1f65600640 1 --2- 172.21.15.37:0/4004447779 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f60109120 0x7f1f6019eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:17.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:17.965+0000 7f1f5fe00640 1 -- 172.21.15.37:0/4004447779 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1f60103ff0 msgr2=0x7f1f6019a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:17.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:17.965+0000 7f1f5fe00640 1 --2- 172.21.15.37:0/4004447779 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1f60103ff0 0x7f1f6019a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:17.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:17.965+0000 7f1f5fe00640 1 -- 172.21.15.37:0/4004447779 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f60109120 msgr2=0x7f1f6019eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:17.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:17.965+0000 7f1f5fe00640 1 --2- 172.21.15.37:0/4004447779 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f60109120 0x7f1f6019eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:17.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:17.965+0000 7f1f5fe00640 1 -- 172.21.15.37:0/4004447779 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f6019f5d0 con 0x7f1f601049a0 2024-09-11T23:17:17.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:17.966+0000 7f1f5fe00640 1 --2- 172.21.15.37:0/4004447779 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f601049a0 0x7f1f6019ab60 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c00ea60 tx=0x7f1f4c00ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:17.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:17.966+0000 7f1f5d600640 1 -- 172.21.15.37:0/4004447779 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f4c00cde0 con 0x7f1f601049a0 2024-09-11T23:17:17.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:17.966+0000 7f1f5d600640 1 -- 172.21.15.37:0/4004447779 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1f4c0035f0 con 0x7f1f601049a0 2024-09-11T23:17:17.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:17.966+0000 7f1f5d600640 1 -- 172.21.15.37:0/4004447779 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f4c010670 con 0x7f1f601049a0 2024-09-11T23:17:17.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:17.966+0000 7f1f67600640 1 -- 172.21.15.37:0/4004447779 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f6019f8c0 con 0x7f1f601049a0 2024-09-11T23:17:17.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:17.966+0000 7f1f67600640 1 -- 172.21.15.37:0/4004447779 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f601a71a0 con 0x7f1f601049a0 2024-09-11T23:17:17.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:17.967+0000 7f1f67600640 1 -- 172.21.15.37:0/4004447779 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f601043d0 con 0x7f1f601049a0 2024-09-11T23:17:17.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:17.970+0000 7f1f5d600640 1 -- 172.21.15.37:0/4004447779 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f1f4c0037a0 con 0x7f1f601049a0 2024-09-11T23:17:17.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:17.971+0000 7f1f5d600640 1 --2- 172.21.15.37:0/4004447779 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f1f480a2c90 0x7f1f480a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:17.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:17.971+0000 7f1f5d600640 1 -- 172.21.15.37:0/4004447779 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9092+0+0 (secure 0 0 0) 0x7f1f4c0cf800 con 0x7f1f601049a0 2024-09-11T23:17:17.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:17.971+0000 7f1f64c00640 1 --2- 172.21.15.37:0/4004447779 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f1f480a2c90 0x7f1f480a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:17.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:17.972+0000 7f1f64c00640 1 --2- 172.21.15.37:0/4004447779 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f1f480a2c90 0x7f1f480a5150 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f1f54006010 tx=0x7f1f54009820 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:17.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:17.975+0000 7f1f5d600640 1 -- 172.21.15.37:0/4004447779 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1f4c09c240 con 0x7f1f601049a0 2024-09-11T23:17:18.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:17 smithi037 ceph-mon[30630]: pgmap v335: 129 pgs: 129 active+clean; 632 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.0 KiB/s wr, 22 op/s 2024-09-11T23:17:18.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:18.164+0000 7f1f67600640 1 -- 172.21.15.37:0/4004447779 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1f6002d7c0 con 0x7f1f601049a0 2024-09-11T23:17:18.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:18.166+0000 7f1f5d600640 1 -- 172.21.15.37:0/4004447779 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) ==== 74+0+24669 (secure 0 0 0) 0x7f1f4c09bb40 con 0x7f1f601049a0 2024-09-11T23:17:18.166 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:17:18.167 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":93,"fsid":"8b03efce-7092-11ef-bcea-c7b262605968","created":"2024-09-11T23:07:59.386838+0000","modified":"2024-09-11T23:16:53.660246+0000","last_up_change":"2024-09-11T23:15:16.985748+0000","last_in_change":"2024-09-11T23:14:54.154116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:11:16.547642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:16:11.075859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T23:16:14.019910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-11T23:16:22.041463+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f76ccb11-fe3b-4df1-9a71-e6ca50de80e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1678472768},{"type":"v1","addr":"172.21.15.37:6803","nonce":1678472768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1678472768},{"type":"v1","addr":"172.21.15.37:6805","nonce":1678472768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1678472768},{"type":"v1","addr":"172.21.15.37:6809","nonce":1678472768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1678472768},{"type":"v1","addr":"172.21.15.37:6807","nonce":1678472768}]},"public_addr":"172.21.15.37:6803/1678472768","cluster_addr":"172.21.15.37:6805/1678472768","heartbeat_back_addr":"172.21.15.37:6809/1678472768","heartbeat_front_addr":"172.21.15.37:6807/1678472768","state":["exists","up"]},{"osd":1,"uuid":"13d26eed-1160-4b15-b66b-66c89066c66f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":141504725},{"type":"v1","addr":"172.21.15.123:6801","nonce":141504725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":141504725},{"type":"v1","addr":"172.21.15.123:6803","nonce":141504725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":141504725},{"type":"v1","addr":"172.21.15.123:6807","nonce":141504725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":141504725},{"type":"v1","addr":"172.21.15.123:6805","nonce":141504725}]},"public_addr":"172.21.15.123:6801/141504725","cluster_addr":"172.21.15.123:6803/141504725","heartbeat_back_addr":"172.21.15.123:6807/141504725","heartbeat_front_addr":"172.21.15.123:6805/141504725","state":["exists","up"]},{"osd":2,"uuid":"53daf4d5-2a43-4a89-bae9-f32b89b517f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":1866489133},{"type":"v1","addr":"172.21.15.160:6801","nonce":1866489133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":1866489133},{"type":"v1","addr":"172.21.15.160:6803","nonce":1866489133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":1866489133},{"type":"v1","addr":"172.21.15.160:6807","nonce":1866489133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":1866489133},{"type":"v1","addr":"172.21.15.160:6805","nonce":1866489133}]},"public_addr":"172.21.15.160:6801/1866489133","cluster_addr":"172.21.15.160:6803/1866489133","heartbeat_back_addr":"172.21.15.160:6807/1866489133","heartbeat_front_addr":"172.21.15.160:6805/1866489133","state":["exists","up"]},{"osd":3,"uuid":"7c819225-964b-44f2-93e5-1d7585eb0b36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":412656036},{"type":"v1","addr":"172.21.15.37:6811","nonce":412656036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":412656036},{"type":"v1","addr":"172.21.15.37:6813","nonce":412656036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":412656036},{"type":"v1","addr":"172.21.15.37:6817","nonce":412656036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":412656036},{"type":"v1","addr":"172.21.15.37:6815","nonce":412656036}]},"public_addr":"172.21.15.37:6811/412656036","cluster_addr":"172.21.15.37:6813/412656036","heartbeat_back_addr":"172.21.15.37:6817/412656036","heartbeat_front_addr":"172.21.15.37:6815/412656036","state":["exists","up"]},{"osd":4,"uuid":"e5ab5638-8c7e-4433-8dd0-ba57e28f39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":3228822066},{"type":"v1","addr":"172.21.15.123:6809","nonce":3228822066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":3228822066},{"type":"v1","addr":"172.21.15.123:6811","nonce":3228822066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":3228822066},{"type":"v1","addr":"172.21.15.123:6815","nonce":3228822066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":3228822066},{"type":"v1","addr":"172.21.15.123:6813","nonce":3228822066}]},"public_addr":"172.21.15.123:6809/3228822066","cluster_addr":"172.21.15.123:6811/3228822066","heartbeat_back_addr":"172.21.15.123:6815/3228822066","heartbeat_front_addr":"172.21.15.123:6813/3228822066","state":["exists","up"]},{"osd":5,"uuid":"7f080d49-eec8-4cd9-b410-b2e84139292e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":1618319675},{"type":"v1","addr":"172.21.15.160:6809","nonce":1618319675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":1618319675},{"type":"v1","addr":"172.21.15.160:6811","nonce":1618319675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":1618319675},{"type":"v1","addr":"172.21.15.160:6815","nonce":1618319675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":1618319675},{"type":"v1","addr":"172.21.15.160:6813","nonce":1618319675}]},"public_addr":"172.21.15.160:6809/1618319675","cluster_addr":"172.21.15.160:6811/1618319675","heartbeat_back_addr":"172.21.15.160:6815/1618319675","heartbeat_front_addr":"172.21.15.160:6813/1618319675","state":["exists","up"]},{"osd":6,"uuid":"d0881c4e-bd8d-4575-8c81-94d21825c227","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3541251299},{"type":"v1","addr":"172.21.15.37:6819","nonce":3541251299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3541251299},{"type":"v1","addr":"172.21.15.37:6821","nonce":3541251299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":3541251299},{"type":"v1","addr":"172.21.15.37:6825","nonce":3541251299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3541251299},{"type":"v1","addr":"172.21.15.37:6823","nonce":3541251299}]},"public_addr":"172.21.15.37:6819/3541251299","cluster_addr":"172.21.15.37:6821/3541251299","heartbeat_back_addr":"172.21.15.37:6825/3541251299","heartbeat_front_addr":"172.21.15.37:6823/3541251299","state":["exists","up"]},{"osd":7,"uuid":"04fbec2e-91b5-4a89-a4a3-472398c45288","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":4279933341},{"type":"v1","addr":"172.21.15.123:6817","nonce":4279933341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":4279933341},{"type":"v1","addr":"172.21.15.123:6819","nonce":4279933341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":4279933341},{"type":"v1","addr":"172.21.15.123:6823","nonce":4279933341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":4279933341},{"type":"v1","addr":"172.21.15.123:6821","nonce":4279933341}]},"public_addr":"172.21.15.123:6817/4279933341","cluster_addr":"172.21.15.123:6819/4279933341","heartbeat_back_addr":"172.21.15.123:6823/4279933341","heartbeat_front_addr":"172.21.15.123:6821/4279933341","state":["exists","up"]},{"osd":8,"uuid":"c77090a7-308e-4c6d-a56e-ce6f8e050ae5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":740968584},{"type":"v1","addr":"172.21.15.160:6817","nonce":740968584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":740968584},{"type":"v1","addr":"172.21.15.160:6819","nonce":740968584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":740968584},{"type":"v1","addr":"172.21.15.160:6823","nonce":740968584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":740968584},{"type":"v1","addr":"172.21.15.160:6821","nonce":740968584}]},"public_addr":"172.21.15.160:6817/740968584","cluster_addr":"172.21.15.160:6819/740968584","heartbeat_back_addr":"172.21.15.160:6823/740968584","heartbeat_front_addr":"172.21.15.160:6821/740968584","state":["exists","up"]},{"osd":9,"uuid":"bcd19bd4-88bc-46f7-b48c-af9e3d17aa96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":692114850},{"type":"v1","addr":"172.21.15.37:6827","nonce":692114850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":692114850},{"type":"v1","addr":"172.21.15.37:6829","nonce":692114850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":692114850},{"type":"v1","addr":"172.21.15.37:6833","nonce":692114850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":692114850},{"type":"v1","addr":"172.21.15.37:6831","nonce":692114850}]},"public_addr":"172.21.15.37:6827/692114850","cluster_addr":"172.21.15.37:6829/692114850","heartbeat_back_addr":"172.21.15.37:6833/692114850","heartbeat_front_addr":"172.21.15.37:6831/692114850","state":["exists","up"]},{"osd":10,"uuid":"9e956e6c-c28a-4a4c-b385-c458788858ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":471058996},{"type":"v1","addr":"172.21.15.123:6825","nonce":471058996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":471058996},{"type":"v1","addr":"172.21.15.123:6827","nonce":471058996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":471058996},{"type":"v1","addr":"172.21.15.123:6831","nonce":471058996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":471058996},{"type":"v1","addr":"172.21.15.123:6829","nonce":471058996}]},"public_addr":"172.21.15.123:6825/471058996","cluster_addr":"172.21.15.123:6827/471058996","heartbeat_back_addr":"172.21.15.123:6831/471058996","heartbeat_front_addr":"172.21.15.123:6829/471058996","state":["exists","up"]},{"osd":11,"uuid":"0b5b3364-9a40-4cab-90d4-b7b1cba57bc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":3982315018},{"type":"v1","addr":"172.21.15.160:6825","nonce":3982315018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3982315018},{"type":"v1","addr":"172.21.15.160:6827","nonce":3982315018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3982315018},{"type":"v1","addr":"172.21.15.160:6831","nonce":3982315018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3982315018},{"type":"v1","addr":"172.21.15.160:6829","nonce":3982315018}]},"public_addr":"172.21.15.160:6825/3982315018","cluster_addr":"172.21.15.160:6827/3982315018","heartbeat_back_addr":"172.21.15.160:6831/3982315018","heartbeat_front_addr":"172.21.15.160:6829/3982315018","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:10:21.139833+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:10:47.004960+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:11:11.460263+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:11:40.849286+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:12:06.497448+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:12:32.043206+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:13:01.402019+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:13:27.993489+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:13:52.291643+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:23.840299+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:49.448254+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:15:15.310947+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":7}]},{"pgid":"3.17","mappings":[{"from":4,"to":7}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.30","mappings":[{"from":1,"to":9}]},{"pgid":"3.38","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:6801/2886800769":"2024-09-12T23:08:51.934167+0000","172.21.15.37:0/1811301224":"2024-09-12T23:08:51.934167+0000","172.21.15.37:0/513883980":"2024-09-12T23:08:51.934167+0000","172.21.15.37:0/3698260188":"2024-09-12T23:08:23.793913+0000","172.21.15.37:6800/2886800769":"2024-09-12T23:08:51.934167+0000","172.21.15.37:0/4134736061":"2024-09-12T23:08:23.793913+0000","172.21.15.37:0/3426758476":"2024-09-12T23:08:51.934167+0000","172.21.15.37:0/2545840561":"2024-09-12T23:08:23.793913+0000","172.21.15.37:6801/3447426643":"2024-09-12T23:08:23.793913+0000","172.21.15.37:6800/3447426643":"2024-09-12T23:08:23.793913+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:17:18.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:18.168+0000 7f1f67600640 1 -- 172.21.15.37:0/4004447779 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f1f480a2c90 msgr2=0x7f1f480a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:18.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:18.168+0000 7f1f67600640 1 --2- 172.21.15.37:0/4004447779 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f1f480a2c90 0x7f1f480a5150 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f1f54006010 tx=0x7f1f54009820 comp rx=0 tx=0).stop 2024-09-11T23:17:18.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:18.168+0000 7f1f67600640 1 -- 172.21.15.37:0/4004447779 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f601049a0 msgr2=0x7f1f6019ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:18.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:18.168+0000 7f1f67600640 1 --2- 172.21.15.37:0/4004447779 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f601049a0 0x7f1f6019ab60 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c00ea60 tx=0x7f1f4c00ef20 comp rx=0 tx=0).stop 2024-09-11T23:17:18.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:18.168+0000 7f1f67600640 1 -- 172.21.15.37:0/4004447779 shutdown_connections 2024-09-11T23:17:18.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:18.168+0000 7f1f67600640 1 --2- 172.21.15.37:0/4004447779 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f1f480a2c90 0x7f1f480a5150 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:18.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:18.168+0000 7f1f67600640 1 --2- 172.21.15.37:0/4004447779 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f60109120 0x7f1f6019eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:18.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:18.168+0000 7f1f67600640 1 --2- 172.21.15.37:0/4004447779 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f601049a0 0x7f1f6019ab60 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:18.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:18.168+0000 7f1f67600640 1 --2- 172.21.15.37:0/4004447779 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1f60103ff0 0x7f1f6019a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:18.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:18.168+0000 7f1f67600640 1 -- 172.21.15.37:0/4004447779 >> 172.21.15.37:0/4004447779 conn(0x7f1f600ffa90 msgr2=0x7f1f60100d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:18.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:18.168+0000 7f1f67600640 1 -- 172.21.15.37:0/4004447779 shutdown_connections 2024-09-11T23:17:18.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:18.169+0000 7f1f67600640 1 -- 172.21.15.37:0/4004447779 wait complete. 2024-09-11T23:17:18.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:17 smithi160 ceph-mon[35055]: pgmap v335: 129 pgs: 129 active+clean; 632 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.0 KiB/s wr, 22 op/s 2024-09-11T23:17:18.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:17 smithi123 ceph-mon[35438]: pgmap v335: 129 pgs: 129 active+clean; 632 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.0 KiB/s wr, 22 op/s 2024-09-11T23:17:18.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:18 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/4004447779' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:17:18.953 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-11T23:17:18.953 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-11T23:17:19.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:18 smithi160 ceph-mon[35055]: from='client.? 172.21.15.37:0/4004447779' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:17:19.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:18 smithi123 ceph-mon[35438]: from='client.? 172.21.15.37:0/4004447779' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:17:19.333 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:17:19.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:19.940+0000 7fb5d5400640 1 -- 172.21.15.37:0/3036071350 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5d0112a50 msgr2=0x7fb5d0114e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:19.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:19.940+0000 7fb5d5400640 1 --2- 172.21.15.37:0/3036071350 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5d0112a50 0x7fb5d0114e40 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb5c8009ca0 tx=0x7fb5c802a8c0 comp rx=0 tx=0).stop 2024-09-11T23:17:19.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:19.941+0000 7fb5d5400640 1 -- 172.21.15.37:0/3036071350 shutdown_connections 2024-09-11T23:17:19.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:19.941+0000 7fb5d5400640 1 --2- 172.21.15.37:0/3036071350 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb5d0077040 0x7fb5d0112510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:19.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:19.941+0000 7fb5d5400640 1 --2- 172.21.15.37:0/3036071350 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5d0112a50 0x7fb5d0114e40 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:19.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:19.941+0000 7fb5d5400640 1 --2- 172.21.15.37:0/3036071350 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb5d0076720 0x7fb5d0076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:19.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:19.941+0000 7fb5d5400640 1 -- 172.21.15.37:0/3036071350 >> 172.21.15.37:0/3036071350 conn(0x7fb5d00ffa50 msgr2=0x7fb5d0101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:19.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:19.941+0000 7fb5d5400640 1 -- 172.21.15.37:0/3036071350 shutdown_connections 2024-09-11T23:17:19.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:19.941+0000 7fb5d5400640 1 -- 172.21.15.37:0/3036071350 wait complete. 2024-09-11T23:17:19.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:19.942+0000 7fb5d5400640 1 Processor -- start 2024-09-11T23:17:19.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:19.942+0000 7fb5d5400640 1 -- start start 2024-09-11T23:17:19.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:19.942+0000 7fb5d5400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb5d0076720 0x7fb5d019eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:19.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:19.942+0000 7fb5d5400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5d0077040 0x7fb5d019f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:19.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:19.942+0000 7fb5d5400640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb5d0112a50 0x7fb5d01a3490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:19.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:19.942+0000 7fb5d5400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb5d01185f0 con 0x7fb5d0077040 2024-09-11T23:17:19.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:19.942+0000 7fb5d5400640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fb5d0118470 con 0x7fb5d0076720 2024-09-11T23:17:19.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:19.942+0000 7fb5d5400640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fb5d0118770 con 0x7fb5d0112a50 2024-09-11T23:17:19.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:19.942+0000 7fb5c7e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5d0077040 0x7fb5d019f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:19.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:19.942+0000 7fb5c7e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5d0077040 0x7fb5d019f0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42068/0 (socket says 172.21.15.37:42068) 2024-09-11T23:17:19.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:19.942+0000 7fb5c7e00640 1 -- 172.21.15.37:0/3424519512 learned_addr learned my addr 172.21.15.37:0/3424519512 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:17:19.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:19.942+0000 7fb5ce800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb5d0076720 0x7fb5d019eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:19.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:19.943+0000 7fb5cf200640 1 --2- 172.21.15.37:0/3424519512 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb5d0112a50 0x7fb5d01a3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:19.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:19.943+0000 7fb5c7e00640 1 -- 172.21.15.37:0/3424519512 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb5d0112a50 msgr2=0x7fb5d01a3490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:19.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:19.943+0000 7fb5c7e00640 1 --2- 172.21.15.37:0/3424519512 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb5d0112a50 0x7fb5d01a3490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:19.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:19.943+0000 7fb5c7e00640 1 -- 172.21.15.37:0/3424519512 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb5d0076720 msgr2=0x7fb5d019eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:19.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:19.943+0000 7fb5c7e00640 1 --2- 172.21.15.37:0/3424519512 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb5d0076720 0x7fb5d019eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:19.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:19.943+0000 7fb5c7e00640 1 -- 172.21.15.37:0/3424519512 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5d01a3bc0 con 0x7fb5d0077040 2024-09-11T23:17:19.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:19.943+0000 7fb5c7e00640 1 --2- 172.21.15.37:0/3424519512 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5d0077040 0x7fb5d019f0d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb5b800e9f0 tx=0x7fb5b800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:19.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:19.943+0000 7fb5c7400640 1 -- 172.21.15.37:0/3424519512 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5b800cd80 con 0x7fb5d0077040 2024-09-11T23:17:19.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:19.944+0000 7fb5c7400640 1 -- 172.21.15.37:0/3424519512 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb5b8010910 con 0x7fb5d0077040 2024-09-11T23:17:19.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:19.944+0000 7fb5c7400640 1 -- 172.21.15.37:0/3424519512 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5b8018990 con 0x7fb5d0077040 2024-09-11T23:17:19.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:19.944+0000 7fb5d5400640 1 -- 172.21.15.37:0/3424519512 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5d01a3eb0 con 0x7fb5d0077040 2024-09-11T23:17:19.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:19.944+0000 7fb5d5400640 1 -- 172.21.15.37:0/3424519512 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5d01ab740 con 0x7fb5d0077040 2024-09-11T23:17:19.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:19.945+0000 7fb5d5400640 1 -- 172.21.15.37:0/3424519512 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5d0076b00 con 0x7fb5d0077040 2024-09-11T23:17:19.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:19.947+0000 7fb5c7400640 1 -- 172.21.15.37:0/3424519512 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fb5b8010ac0 con 0x7fb5d0077040 2024-09-11T23:17:19.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:19.949+0000 7fb5c7400640 1 --2- 172.21.15.37:0/3424519512 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fb5b40a2c90 0x7fb5b40a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:19.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:19.949+0000 7fb5c7400640 1 -- 172.21.15.37:0/3424519512 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9092+0+0 (secure 0 0 0) 0x7fb5b80cf760 con 0x7fb5d0077040 2024-09-11T23:17:19.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:19.949+0000 7fb5ce800640 1 --2- 172.21.15.37:0/3424519512 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fb5b40a2c90 0x7fb5b40a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:19.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:19.950+0000 7fb5ce800640 1 --2- 172.21.15.37:0/3424519512 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fb5b40a2c90 0x7fb5b40a5150 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb5c0009bd0 tx=0x7fb5c0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:19.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:19.953+0000 7fb5c7400640 1 -- 172.21.15.37:0/3424519512 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb5b809bb50 con 0x7fb5d0077040 2024-09-11T23:17:20.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:19 smithi037 ceph-mon[30630]: pgmap v336: 129 pgs: 129 active+clean; 632 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 4.2 KiB/s wr, 10 op/s 2024-09-11T23:17:20.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:20.136+0000 7fb5d5400640 1 -- 172.21.15.37:0/3424519512 --> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb5d0062630 con 0x7fb5b40a2c90 2024-09-11T23:17:20.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:20.146+0000 7fb5c7400640 1 -- 172.21.15.37:0/3424519512 <== mgr.14150 v2:172.21.15.37:6800/31543269 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340389 (secure 0 0 0) 0x7fb5d0062630 con 0x7fb5b40a2c90 2024-09-11T23:17:20.151 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:17:20.152 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-11T23:17:20.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:20.151+0000 7fb5d5400640 1 -- 172.21.15.37:0/3424519512 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fb5b40a2c90 msgr2=0x7fb5b40a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:20.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:20.151+0000 7fb5d5400640 1 --2- 172.21.15.37:0/3424519512 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fb5b40a2c90 0x7fb5b40a5150 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb5c0009bd0 tx=0x7fb5c0005f90 comp rx=0 tx=0).stop 2024-09-11T23:17:20.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:20.151+0000 7fb5d5400640 1 -- 172.21.15.37:0/3424519512 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5d0077040 msgr2=0x7fb5d019f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:20.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:20.151+0000 7fb5d5400640 1 --2- 172.21.15.37:0/3424519512 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5d0077040 0x7fb5d019f0d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb5b800e9f0 tx=0x7fb5b800eeb0 comp rx=0 tx=0).stop 2024-09-11T23:17:20.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:20.151+0000 7fb5d5400640 1 -- 172.21.15.37:0/3424519512 shutdown_connections 2024-09-11T23:17:20.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:20.151+0000 7fb5d5400640 1 --2- 172.21.15.37:0/3424519512 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fb5b40a2c90 0x7fb5b40a5150 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:20.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:20.151+0000 7fb5d5400640 1 --2- 172.21.15.37:0/3424519512 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb5d0112a50 0x7fb5d01a3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:20.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:20.151+0000 7fb5d5400640 1 --2- 172.21.15.37:0/3424519512 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5d0077040 0x7fb5d019f0d0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:20.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:20.151+0000 7fb5d5400640 1 --2- 172.21.15.37:0/3424519512 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb5d0076720 0x7fb5d019eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:20.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:20.151+0000 7fb5d5400640 1 -- 172.21.15.37:0/3424519512 >> 172.21.15.37:0/3424519512 conn(0x7fb5d00ffa50 msgr2=0x7fb5d0101e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:20.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:20.151+0000 7fb5d5400640 1 -- 172.21.15.37:0/3424519512 shutdown_connections 2024-09-11T23:17:20.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:20.151+0000 7fb5d5400640 1 -- 172.21.15.37:0/3424519512 wait complete. 2024-09-11T23:17:20.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:19 smithi160 ceph-mon[35055]: pgmap v336: 129 pgs: 129 active+clean; 632 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 4.2 KiB/s wr, 10 op/s 2024-09-11T23:17:20.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:19 smithi123 ceph-mon[35438]: pgmap v336: 129 pgs: 129 active+clean; 632 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 4.2 KiB/s wr, 10 op/s 2024-09-11T23:17:20.886 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":337,"stamp":"2024-09-11T23:17:20.041327+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":647301,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":309,"num_read_kb":260,"num_write":417,"num_write_kb":3064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":343,"ondisk_log_size":343,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":376376,"kb_used_data":14648,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124565448,"statfs":{"total":1151940427776,"available":1151555018752,"internally_reserved":0,"allocated":14999552,"data_stored":8295129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":370193721},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":40065,"num_objects":3,"num_object_clones":0,"num_object_copies":11,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":130,"num_read_kb":96,"num_write":24,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003085"},"pg_stats":[{"pgid":"2.1f","version":"93'13","reported_seq":66,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:17:14.768824+0000","last_change":"2024-09-11T23:16:12.460818+0000","last_active":"2024-09-11T23:17:14.768824+0000","last_peered":"2024-09-11T23:17:14.768824+0000","last_clean":"2024-09-11T23:17:14.768824+0000","last_became_active":"2024-09-11T23:16:12.460422+0000","last_became_peered":"2024-09-11T23:16:12.460422+0000","last_unstale":"2024-09-11T23:17:14.768824+0000","last_undegraded":"2024-09-11T23:17:14.768824+0000","last_fullsized":"2024-09-11T23:17:14.768824+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:56:55.785615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.667109+0000","last_change":"2024-09-11T23:16:15.493946+0000","last_active":"2024-09-11T23:16:53.667109+0000","last_peered":"2024-09-11T23:16:53.667109+0000","last_clean":"2024-09-11T23:16:53.667109+0000","last_became_active":"2024-09-11T23:16:15.493433+0000","last_became_peered":"2024-09-11T23:16:15.493433+0000","last_unstale":"2024-09-11T23:16:53.667109+0000","last_undegraded":"2024-09-11T23:16:53.667109+0000","last_fullsized":"2024-09-11T23:16:53.667109+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:47.700354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.764019+0000","last_change":"2024-09-11T23:16:23.550528+0000","last_active":"2024-09-11T23:16:53.764019+0000","last_peered":"2024-09-11T23:16:53.764019+0000","last_clean":"2024-09-11T23:16:53.764019+0000","last_became_active":"2024-09-11T23:16:23.550205+0000","last_became_peered":"2024-09-11T23:16:23.550205+0000","last_unstale":"2024-09-11T23:16:53.764019+0000","last_undegraded":"2024-09-11T23:16:53.764019+0000","last_fullsized":"2024-09-11T23:16:53.764019+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:28.318748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"93'2","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.667394+0000","last_change":"2024-09-11T23:16:12.633362+0000","last_active":"2024-09-11T23:16:53.667394+0000","last_peered":"2024-09-11T23:16:53.667394+0000","last_clean":"2024-09-11T23:16:53.667394+0000","last_became_active":"2024-09-11T23:16:12.632909+0000","last_became_peered":"2024-09-11T23:16:12.632909+0000","last_unstale":"2024-09-11T23:16:53.667394+0000","last_undegraded":"2024-09-11T23:16:53.667394+0000","last_fullsized":"2024-09-11T23:16:53.667394+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:08.533740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.672998+0000","last_change":"2024-09-11T23:16:15.499394+0000","last_active":"2024-09-11T23:16:53.672998+0000","last_peered":"2024-09-11T23:16:53.672998+0000","last_clean":"2024-09-11T23:16:53.672998+0000","last_became_active":"2024-09-11T23:16:15.499058+0000","last_became_peered":"2024-09-11T23:16:15.499058+0000","last_unstale":"2024-09-11T23:16:53.672998+0000","last_undegraded":"2024-09-11T23:16:53.672998+0000","last_fullsized":"2024-09-11T23:16:53.672998+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:05.361857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.927518+0000","last_change":"2024-09-11T23:16:23.543358+0000","last_active":"2024-09-11T23:16:53.927518+0000","last_peered":"2024-09-11T23:16:53.927518+0000","last_clean":"2024-09-11T23:16:53.927518+0000","last_became_active":"2024-09-11T23:16:23.542928+0000","last_became_peered":"2024-09-11T23:16:23.542928+0000","last_unstale":"2024-09-11T23:16:53.927518+0000","last_undegraded":"2024-09-11T23:16:53.927518+0000","last_fullsized":"2024-09-11T23:16:53.927518+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:36:36.570865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"93'12","reported_seq":52,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:17:03.748675+0000","last_change":"2024-09-11T23:16:12.461679+0000","last_active":"2024-09-11T23:17:03.748675+0000","last_peered":"2024-09-11T23:17:03.748675+0000","last_clean":"2024-09-11T23:17:03.748675+0000","last_became_active":"2024-09-11T23:16:12.461314+0000","last_became_peered":"2024-09-11T23:16:12.461314+0000","last_unstale":"2024-09-11T23:17:03.748675+0000","last_undegraded":"2024-09-11T23:17:03.748675+0000","last_fullsized":"2024-09-11T23:17:03.748675+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:01:13.352218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.671012+0000","last_change":"2024-09-11T23:16:15.488625+0000","last_active":"2024-09-11T23:16:53.671012+0000","last_peered":"2024-09-11T23:16:53.671012+0000","last_clean":"2024-09-11T23:16:53.671012+0000","last_became_active":"2024-09-11T23:16:15.487540+0000","last_became_peered":"2024-09-11T23:16:15.487540+0000","last_unstale":"2024-09-11T23:16:53.671012+0000","last_undegraded":"2024-09-11T23:16:53.671012+0000","last_fullsized":"2024-09-11T23:16:53.671012+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:54.962317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.928113+0000","last_change":"2024-09-11T23:16:23.544321+0000","last_active":"2024-09-11T23:16:53.928113+0000","last_peered":"2024-09-11T23:16:53.928113+0000","last_clean":"2024-09-11T23:16:53.928113+0000","last_became_active":"2024-09-11T23:16:23.543958+0000","last_became_peered":"2024-09-11T23:16:23.543958+0000","last_unstale":"2024-09-11T23:16:53.928113+0000","last_undegraded":"2024-09-11T23:16:53.928113+0000","last_fullsized":"2024-09-11T23:16:53.928113+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:40:46.510481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"93'5","reported_seq":45,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:17:02.745276+0000","last_change":"2024-09-11T23:16:12.462863+0000","last_active":"2024-09-11T23:17:02.745276+0000","last_peered":"2024-09-11T23:17:02.745276+0000","last_clean":"2024-09-11T23:17:02.745276+0000","last_became_active":"2024-09-11T23:16:12.462484+0000","last_became_peered":"2024-09-11T23:16:12.462484+0000","last_unstale":"2024-09-11T23:17:02.745276+0000","last_undegraded":"2024-09-11T23:17:02.745276+0000","last_fullsized":"2024-09-11T23:17:02.745276+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:13:22.170427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.665366+0000","last_change":"2024-09-11T23:16:15.487956+0000","last_active":"2024-09-11T23:16:53.665366+0000","last_peered":"2024-09-11T23:16:53.665366+0000","last_clean":"2024-09-11T23:16:53.665366+0000","last_became_active":"2024-09-11T23:16:15.487364+0000","last_became_peered":"2024-09-11T23:16:15.487364+0000","last_unstale":"2024-09-11T23:16:53.665366+0000","last_undegraded":"2024-09-11T23:16:53.665366+0000","last_fullsized":"2024-09-11T23:16:53.665366+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:47:10.488221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.927949+0000","last_change":"2024-09-11T23:16:23.541655+0000","last_active":"2024-09-11T23:16:53.927949+0000","last_peered":"2024-09-11T23:16:53.927949+0000","last_clean":"2024-09-11T23:16:53.927949+0000","last_became_active":"2024-09-11T23:16:23.541266+0000","last_became_peered":"2024-09-11T23:16:23.541266+0000","last_unstale":"2024-09-11T23:16:53.927949+0000","last_undegraded":"2024-09-11T23:16:53.927949+0000","last_fullsized":"2024-09-11T23:16:53.927949+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:09.497594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.668062+0000","last_change":"2024-09-11T23:16:15.489507+0000","last_active":"2024-09-11T23:16:53.668062+0000","last_peered":"2024-09-11T23:16:53.668062+0000","last_clean":"2024-09-11T23:16:53.668062+0000","last_became_active":"2024-09-11T23:16:15.489188+0000","last_became_peered":"2024-09-11T23:16:15.489188+0000","last_unstale":"2024-09-11T23:16:53.668062+0000","last_undegraded":"2024-09-11T23:16:53.668062+0000","last_fullsized":"2024-09-11T23:16:53.668062+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:07.530192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"93'4","reported_seq":44,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:59.720003+0000","last_change":"2024-09-11T23:16:12.465473+0000","last_active":"2024-09-11T23:16:59.720003+0000","last_peered":"2024-09-11T23:16:59.720003+0000","last_clean":"2024-09-11T23:16:59.720003+0000","last_became_active":"2024-09-11T23:16:12.465096+0000","last_became_peered":"2024-09-11T23:16:12.465096+0000","last_unstale":"2024-09-11T23:16:59.720003+0000","last_undegraded":"2024-09-11T23:16:59.720003+0000","last_fullsized":"2024-09-11T23:16:59.720003+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:27:22.739927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.928226+0000","last_change":"2024-09-11T23:16:23.555649+0000","last_active":"2024-09-11T23:16:53.928226+0000","last_peered":"2024-09-11T23:16:53.928226+0000","last_clean":"2024-09-11T23:16:53.928226+0000","last_became_active":"2024-09-11T23:16:23.555243+0000","last_became_peered":"2024-09-11T23:16:23.555243+0000","last_unstale":"2024-09-11T23:16:53.928226+0000","last_undegraded":"2024-09-11T23:16:53.928226+0000","last_fullsized":"2024-09-11T23:16:53.928226+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:07.514479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.666622+0000","last_change":"2024-09-11T23:16:15.490203+0000","last_active":"2024-09-11T23:16:53.666622+0000","last_peered":"2024-09-11T23:16:53.666622+0000","last_clean":"2024-09-11T23:16:53.666622+0000","last_became_active":"2024-09-11T23:16:15.489904+0000","last_became_peered":"2024-09-11T23:16:15.489904+0000","last_unstale":"2024-09-11T23:16:53.666622+0000","last_undegraded":"2024-09-11T23:16:53.666622+0000","last_fullsized":"2024-09-11T23:16:53.666622+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:20.291284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"93'3","reported_seq":41,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.735570+0000","last_change":"2024-09-11T23:16:12.465147+0000","last_active":"2024-09-11T23:17:01.735570+0000","last_peered":"2024-09-11T23:17:01.735570+0000","last_clean":"2024-09-11T23:17:01.735570+0000","last_became_active":"2024-09-11T23:16:12.464392+0000","last_became_peered":"2024-09-11T23:16:12.464392+0000","last_unstale":"2024-09-11T23:17:01.735570+0000","last_undegraded":"2024-09-11T23:17:01.735570+0000","last_fullsized":"2024-09-11T23:17:01.735570+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:21.515546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"93'1","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.928302+0000","last_change":"2024-09-11T23:16:23.535965+0000","last_active":"2024-09-11T23:16:53.928302+0000","last_peered":"2024-09-11T23:16:53.928302+0000","last_clean":"2024-09-11T23:16:53.928302+0000","last_became_active":"2024-09-11T23:16:23.535518+0000","last_became_peered":"2024-09-11T23:16:23.535518+0000","last_unstale":"2024-09-11T23:16:53.928302+0000","last_undegraded":"2024-09-11T23:16:53.928302+0000","last_fullsized":"2024-09-11T23:16:53.928302+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:37.406312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.927252+0000","last_change":"2024-09-11T23:16:15.489499+0000","last_active":"2024-09-11T23:16:53.927252+0000","last_peered":"2024-09-11T23:16:53.927252+0000","last_clean":"2024-09-11T23:16:53.927252+0000","last_became_active":"2024-09-11T23:16:15.489190+0000","last_became_peered":"2024-09-11T23:16:15.489190+0000","last_unstale":"2024-09-11T23:16:53.927252+0000","last_undegraded":"2024-09-11T23:16:53.927252+0000","last_fullsized":"2024-09-11T23:16:53.927252+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:01.845410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"93'7","reported_seq":45,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:17:02.745587+0000","last_change":"2024-09-11T23:16:12.461054+0000","last_active":"2024-09-11T23:17:02.745587+0000","last_peered":"2024-09-11T23:17:02.745587+0000","last_clean":"2024-09-11T23:17:02.745587+0000","last_became_active":"2024-09-11T23:16:12.460748+0000","last_became_peered":"2024-09-11T23:16:12.460748+0000","last_unstale":"2024-09-11T23:17:02.745587+0000","last_undegraded":"2024-09-11T23:17:02.745587+0000","last_fullsized":"2024-09-11T23:17:02.745587+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:35.710437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.671421+0000","last_change":"2024-09-11T23:16:23.543637+0000","last_active":"2024-09-11T23:16:53.671421+0000","last_peered":"2024-09-11T23:16:53.671421+0000","last_clean":"2024-09-11T23:16:53.671421+0000","last_became_active":"2024-09-11T23:16:23.542807+0000","last_became_peered":"2024-09-11T23:16:23.542807+0000","last_unstale":"2024-09-11T23:16:53.671421+0000","last_undegraded":"2024-09-11T23:16:53.671421+0000","last_fullsized":"2024-09-11T23:16:53.671421+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:08.559858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.667900+0000","last_change":"2024-09-11T23:16:15.485660+0000","last_active":"2024-09-11T23:16:53.667900+0000","last_peered":"2024-09-11T23:16:53.667900+0000","last_clean":"2024-09-11T23:16:53.667900+0000","last_became_active":"2024-09-11T23:16:15.485283+0000","last_became_peered":"2024-09-11T23:16:15.485283+0000","last_unstale":"2024-09-11T23:16:53.667900+0000","last_undegraded":"2024-09-11T23:16:53.667900+0000","last_fullsized":"2024-09-11T23:16:53.667900+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:20.105534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"93'2","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:59.720113+0000","last_change":"2024-09-11T23:16:12.633115+0000","last_active":"2024-09-11T23:16:59.720113+0000","last_peered":"2024-09-11T23:16:59.720113+0000","last_clean":"2024-09-11T23:16:59.720113+0000","last_became_active":"2024-09-11T23:16:12.632850+0000","last_became_peered":"2024-09-11T23:16:12.632850+0000","last_unstale":"2024-09-11T23:16:59.720113+0000","last_undegraded":"2024-09-11T23:16:59.720113+0000","last_fullsized":"2024-09-11T23:16:59.720113+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:16.709154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.928206+0000","last_change":"2024-09-11T23:16:23.556054+0000","last_active":"2024-09-11T23:16:53.928206+0000","last_peered":"2024-09-11T23:16:53.928206+0000","last_clean":"2024-09-11T23:16:53.928206+0000","last_became_active":"2024-09-11T23:16:23.555640+0000","last_became_peered":"2024-09-11T23:16:23.555640+0000","last_unstale":"2024-09-11T23:16:53.928206+0000","last_undegraded":"2024-09-11T23:16:53.928206+0000","last_fullsized":"2024-09-11T23:16:53.928206+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:23:32.360435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.677327+0000","last_change":"2024-09-11T23:16:53.677327+0000","last_active":"2024-09-11T23:16:53.677327+0000","last_peered":"2024-09-11T23:16:53.677327+0000","last_clean":"2024-09-11T23:16:53.677327+0000","last_became_active":"2024-09-11T23:16:53.677002+0000","last_became_peered":"2024-09-11T23:16:53.677002+0000","last_unstale":"2024-09-11T23:16:53.677327+0000","last_undegraded":"2024-09-11T23:16:53.677327+0000","last_fullsized":"2024-09-11T23:16:53.677327+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:22:48.495448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"93'7","reported_seq":45,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:17:02.745207+0000","last_change":"2024-09-11T23:16:13.161384+0000","last_active":"2024-09-11T23:17:02.745207+0000","last_peered":"2024-09-11T23:17:02.745207+0000","last_clean":"2024-09-11T23:17:02.745207+0000","last_became_active":"2024-09-11T23:16:13.161001+0000","last_became_peered":"2024-09-11T23:16:13.161001+0000","last_unstale":"2024-09-11T23:17:02.745207+0000","last_undegraded":"2024-09-11T23:17:02.745207+0000","last_fullsized":"2024-09-11T23:17:02.745207+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:17.421851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.764156+0000","last_change":"2024-09-11T23:16:23.539741+0000","last_active":"2024-09-11T23:16:53.764156+0000","last_peered":"2024-09-11T23:16:53.764156+0000","last_clean":"2024-09-11T23:16:53.764156+0000","last_became_active":"2024-09-11T23:16:23.539340+0000","last_became_peered":"2024-09-11T23:16:23.539340+0000","last_unstale":"2024-09-11T23:16:53.764156+0000","last_undegraded":"2024-09-11T23:16:53.764156+0000","last_fullsized":"2024-09-11T23:16:53.764156+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:22:41.272385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.668065+0000","last_change":"2024-09-11T23:16:15.483285+0000","last_active":"2024-09-11T23:16:53.668065+0000","last_peered":"2024-09-11T23:16:53.668065+0000","last_clean":"2024-09-11T23:16:53.668065+0000","last_became_active":"2024-09-11T23:16:15.482883+0000","last_became_peered":"2024-09-11T23:16:15.482883+0000","last_unstale":"2024-09-11T23:16:53.668065+0000","last_undegraded":"2024-09-11T23:16:53.668065+0000","last_fullsized":"2024-09-11T23:16:53.668065+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:49.979519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"93'11","reported_seq":50,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:17:12.490450+0000","last_change":"2024-09-11T23:16:12.460660+0000","last_active":"2024-09-11T23:17:12.490450+0000","last_peered":"2024-09-11T23:17:12.490450+0000","last_clean":"2024-09-11T23:17:12.490450+0000","last_became_active":"2024-09-11T23:16:12.460231+0000","last_became_peered":"2024-09-11T23:16:12.460231+0000","last_unstale":"2024-09-11T23:17:12.490450+0000","last_undegraded":"2024-09-11T23:17:12.490450+0000","last_fullsized":"2024-09-11T23:17:12.490450+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:21.839388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.666468+0000","last_change":"2024-09-11T23:16:23.556322+0000","last_active":"2024-09-11T23:16:53.666468+0000","last_peered":"2024-09-11T23:16:53.666468+0000","last_clean":"2024-09-11T23:16:53.666468+0000","last_became_active":"2024-09-11T23:16:23.555141+0000","last_became_peered":"2024-09-11T23:16:23.555141+0000","last_unstale":"2024-09-11T23:16:53.666468+0000","last_undegraded":"2024-09-11T23:16:53.666468+0000","last_fullsized":"2024-09-11T23:16:53.666468+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:55.778708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.664274+0000","last_change":"2024-09-11T23:16:15.490482+0000","last_active":"2024-09-11T23:16:53.664274+0000","last_peered":"2024-09-11T23:16:53.664274+0000","last_clean":"2024-09-11T23:16:53.664274+0000","last_became_active":"2024-09-11T23:16:15.490160+0000","last_became_peered":"2024-09-11T23:16:15.490160+0000","last_unstale":"2024-09-11T23:16:53.664274+0000","last_undegraded":"2024-09-11T23:16:53.664274+0000","last_fullsized":"2024-09-11T23:16:53.664274+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:58:40.588941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"93'4","reported_seq":44,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:17:02.745072+0000","last_change":"2024-09-11T23:16:12.634120+0000","last_active":"2024-09-11T23:17:02.745072+0000","last_peered":"2024-09-11T23:17:02.745072+0000","last_clean":"2024-09-11T23:17:02.745072+0000","last_became_active":"2024-09-11T23:16:12.633691+0000","last_became_peered":"2024-09-11T23:16:12.633691+0000","last_unstale":"2024-09-11T23:17:02.745072+0000","last_undegraded":"2024-09-11T23:17:02.745072+0000","last_fullsized":"2024-09-11T23:17:02.745072+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:21.577310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.927244+0000","last_change":"2024-09-11T23:16:23.545820+0000","last_active":"2024-09-11T23:16:53.927244+0000","last_peered":"2024-09-11T23:16:53.927244+0000","last_clean":"2024-09-11T23:16:53.927244+0000","last_became_active":"2024-09-11T23:16:23.545303+0000","last_became_peered":"2024-09-11T23:16:23.545303+0000","last_unstale":"2024-09-11T23:16:53.927244+0000","last_undegraded":"2024-09-11T23:16:53.927244+0000","last_fullsized":"2024-09-11T23:16:53.927244+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:52:28.969393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.667051+0000","last_change":"2024-09-11T23:16:15.497083+0000","last_active":"2024-09-11T23:16:53.667051+0000","last_peered":"2024-09-11T23:16:53.667051+0000","last_clean":"2024-09-11T23:16:53.667051+0000","last_became_active":"2024-09-11T23:16:15.496777+0000","last_became_peered":"2024-09-11T23:16:15.496777+0000","last_unstale":"2024-09-11T23:16:53.667051+0000","last_undegraded":"2024-09-11T23:16:53.667051+0000","last_fullsized":"2024-09-11T23:16:53.667051+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:14.456290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"93'1","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.670281+0000","last_change":"2024-09-11T23:16:12.633452+0000","last_active":"2024-09-11T23:16:53.670281+0000","last_peered":"2024-09-11T23:16:53.670281+0000","last_clean":"2024-09-11T23:16:53.670281+0000","last_became_active":"2024-09-11T23:16:12.633127+0000","last_became_peered":"2024-09-11T23:16:12.633127+0000","last_unstale":"2024-09-11T23:16:53.670281+0000","last_undegraded":"2024-09-11T23:16:53.670281+0000","last_fullsized":"2024-09-11T23:16:53.670281+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:37:07.269809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.667925+0000","last_change":"2024-09-11T23:16:23.555590+0000","last_active":"2024-09-11T23:16:53.667925+0000","last_peered":"2024-09-11T23:16:53.667925+0000","last_clean":"2024-09-11T23:16:53.667925+0000","last_became_active":"2024-09-11T23:16:23.555194+0000","last_became_peered":"2024-09-11T23:16:23.555194+0000","last_unstale":"2024-09-11T23:16:53.667925+0000","last_undegraded":"2024-09-11T23:16:53.667925+0000","last_fullsized":"2024-09-11T23:16:53.667925+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:36:50.069355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.667109+0000","last_change":"2024-09-11T23:16:15.498764+0000","last_active":"2024-09-11T23:16:53.667109+0000","last_peered":"2024-09-11T23:16:53.667109+0000","last_clean":"2024-09-11T23:16:53.667109+0000","last_became_active":"2024-09-11T23:16:15.498430+0000","last_became_peered":"2024-09-11T23:16:15.498430+0000","last_unstale":"2024-09-11T23:16:53.667109+0000","last_undegraded":"2024-09-11T23:16:53.667109+0000","last_fullsized":"2024-09-11T23:16:53.667109+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:28:44.899651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"93'6","reported_seq":62,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:17:17.773352+0000","last_change":"2024-09-11T23:16:12.456701+0000","last_active":"2024-09-11T23:17:17.773352+0000","last_peered":"2024-09-11T23:17:17.773352+0000","last_clean":"2024-09-11T23:17:17.773352+0000","last_became_active":"2024-09-11T23:16:12.456231+0000","last_became_peered":"2024-09-11T23:16:12.456231+0000","last_unstale":"2024-09-11T23:17:17.773352+0000","last_undegraded":"2024-09-11T23:17:17.773352+0000","last_fullsized":"2024-09-11T23:17:17.773352+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:02.372204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.664090+0000","last_change":"2024-09-11T23:16:23.550929+0000","last_active":"2024-09-11T23:16:53.664090+0000","last_peered":"2024-09-11T23:16:53.664090+0000","last_clean":"2024-09-11T23:16:53.664090+0000","last_became_active":"2024-09-11T23:16:23.550509+0000","last_became_peered":"2024-09-11T23:16:23.550509+0000","last_unstale":"2024-09-11T23:16:53.664090+0000","last_undegraded":"2024-09-11T23:16:53.664090+0000","last_fullsized":"2024-09-11T23:16:53.664090+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:53.112937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.765655+0000","last_change":"2024-09-11T23:16:53.765655+0000","last_active":"2024-09-11T23:16:53.765655+0000","last_peered":"2024-09-11T23:16:53.765655+0000","last_clean":"2024-09-11T23:16:53.765655+0000","last_became_active":"2024-09-11T23:16:53.765189+0000","last_became_peered":"2024-09-11T23:16:53.765189+0000","last_unstale":"2024-09-11T23:16:53.765655+0000","last_undegraded":"2024-09-11T23:16:53.765655+0000","last_fullsized":"2024-09-11T23:16:53.765655+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:13.142041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"93'5","reported_seq":62,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:17:17.770805+0000","last_change":"2024-09-11T23:16:12.633522+0000","last_active":"2024-09-11T23:17:17.770805+0000","last_peered":"2024-09-11T23:17:17.770805+0000","last_clean":"2024-09-11T23:17:17.770805+0000","last_became_active":"2024-09-11T23:16:12.633207+0000","last_became_peered":"2024-09-11T23:16:12.633207+0000","last_unstale":"2024-09-11T23:17:17.770805+0000","last_undegraded":"2024-09-11T23:17:17.770805+0000","last_fullsized":"2024-09-11T23:17:17.770805+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:08:29.565404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.664100+0000","last_change":"2024-09-11T23:16:23.557033+0000","last_active":"2024-09-11T23:16:53.664100+0000","last_peered":"2024-09-11T23:16:53.664100+0000","last_clean":"2024-09-11T23:16:53.664100+0000","last_became_active":"2024-09-11T23:16:23.555146+0000","last_became_peered":"2024-09-11T23:16:23.555146+0000","last_unstale":"2024-09-11T23:16:53.664100+0000","last_undegraded":"2024-09-11T23:16:53.664100+0000","last_fullsized":"2024-09-11T23:16:53.664100+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:22.460593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.663826+0000","last_change":"2024-09-11T23:16:15.487594+0000","last_active":"2024-09-11T23:16:53.663826+0000","last_peered":"2024-09-11T23:16:53.663826+0000","last_clean":"2024-09-11T23:16:53.663826+0000","last_became_active":"2024-09-11T23:16:15.487299+0000","last_became_peered":"2024-09-11T23:16:15.487299+0000","last_unstale":"2024-09-11T23:16:53.663826+0000","last_undegraded":"2024-09-11T23:16:53.663826+0000","last_fullsized":"2024-09-11T23:16:53.663826+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:32.531617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"93'4","reported_seq":42,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:17:00.729510+0000","last_change":"2024-09-11T23:16:12.464175+0000","last_active":"2024-09-11T23:17:00.729510+0000","last_peered":"2024-09-11T23:17:00.729510+0000","last_clean":"2024-09-11T23:17:00.729510+0000","last_became_active":"2024-09-11T23:16:12.463700+0000","last_became_peered":"2024-09-11T23:16:12.463700+0000","last_unstale":"2024-09-11T23:17:00.729510+0000","last_undegraded":"2024-09-11T23:17:00.729510+0000","last_fullsized":"2024-09-11T23:17:00.729510+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:35.784469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.665212+0000","last_change":"2024-09-11T23:16:23.555436+0000","last_active":"2024-09-11T23:16:53.665212+0000","last_peered":"2024-09-11T23:16:53.665212+0000","last_clean":"2024-09-11T23:16:53.665212+0000","last_became_active":"2024-09-11T23:16:23.555003+0000","last_became_peered":"2024-09-11T23:16:23.555003+0000","last_unstale":"2024-09-11T23:16:53.665212+0000","last_undegraded":"2024-09-11T23:16:53.665212+0000","last_fullsized":"2024-09-11T23:16:53.665212+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:39:18.810730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.675477+0000","last_change":"2024-09-11T23:16:53.674972+0000","last_active":"2024-09-11T23:16:53.675477+0000","last_peered":"2024-09-11T23:16:53.675477+0000","last_clean":"2024-09-11T23:16:53.675477+0000","last_became_active":"2024-09-11T23:16:53.674116+0000","last_became_peered":"2024-09-11T23:16:53.674116+0000","last_unstale":"2024-09-11T23:16:53.675477+0000","last_undegraded":"2024-09-11T23:16:53.675477+0000","last_fullsized":"2024-09-11T23:16:53.675477+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:03:32.615819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.3","version":"93'6","reported_seq":46,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:17:03.748368+0000","last_change":"2024-09-11T23:16:12.459491+0000","last_active":"2024-09-11T23:17:03.748368+0000","last_peered":"2024-09-11T23:17:03.748368+0000","last_clean":"2024-09-11T23:17:03.748368+0000","last_became_active":"2024-09-11T23:16:12.459106+0000","last_became_peered":"2024-09-11T23:16:12.459106+0000","last_unstale":"2024-09-11T23:17:03.748368+0000","last_undegraded":"2024-09-11T23:17:03.748368+0000","last_fullsized":"2024-09-11T23:17:03.748368+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:21.797304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":351,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.667712+0000","last_change":"2024-09-11T23:14:54.165458+0000","last_active":"2024-09-11T23:16:53.667712+0000","last_peered":"2024-09-11T23:16:53.667712+0000","last_clean":"2024-09-11T23:16:53.667712+0000","last_became_active":"2024-09-11T23:14:54.164935+0000","last_became_peered":"2024-09-11T23:14:54.164935+0000","last_unstale":"2024-09-11T23:16:53.667712+0000","last_undegraded":"2024-09-11T23:16:53.667712+0000","last_fullsized":"2024-09-11T23:16:53.667712+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:11:16.597789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:11:16.597789+0000","last_clean_scrub_stamp":"2024-09-11T23:11:16.597789+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:19.889271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"93'1","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.668492+0000","last_change":"2024-09-11T23:16:23.542921+0000","last_active":"2024-09-11T23:16:53.668492+0000","last_peered":"2024-09-11T23:16:53.668492+0000","last_clean":"2024-09-11T23:16:53.668492+0000","last_became_active":"2024-09-11T23:16:23.542424+0000","last_became_peered":"2024-09-11T23:16:23.542424+0000","last_unstale":"2024-09-11T23:16:53.668492+0000","last_undegraded":"2024-09-11T23:16:53.668492+0000","last_fullsized":"2024-09-11T23:16:53.668492+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:26:06.637721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.669182+0000","last_change":"2024-09-11T23:16:15.483724+0000","last_active":"2024-09-11T23:16:53.669182+0000","last_peered":"2024-09-11T23:16:53.669182+0000","last_clean":"2024-09-11T23:16:53.669182+0000","last_became_active":"2024-09-11T23:16:15.483371+0000","last_became_peered":"2024-09-11T23:16:15.483371+0000","last_unstale":"2024-09-11T23:16:53.669182+0000","last_undegraded":"2024-09-11T23:16:53.669182+0000","last_fullsized":"2024-09-11T23:16:53.669182+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:27:43.844805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"93'6","reported_seq":63,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:17:17.774185+0000","last_change":"2024-09-11T23:16:13.161358+0000","last_active":"2024-09-11T23:17:17.774185+0000","last_peered":"2024-09-11T23:17:17.774185+0000","last_clean":"2024-09-11T23:17:17.774185+0000","last_became_active":"2024-09-11T23:16:13.160856+0000","last_became_peered":"2024-09-11T23:16:13.160856+0000","last_unstale":"2024-09-11T23:17:17.774185+0000","last_undegraded":"2024-09-11T23:17:17.774185+0000","last_fullsized":"2024-09-11T23:17:17.774185+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:23:35.519588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1563,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":19,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.670708+0000","last_change":"2024-09-11T23:16:23.542098+0000","last_active":"2024-09-11T23:16:53.670708+0000","last_peered":"2024-09-11T23:16:53.670708+0000","last_clean":"2024-09-11T23:16:53.670708+0000","last_became_active":"2024-09-11T23:16:23.541714+0000","last_became_peered":"2024-09-11T23:16:23.541714+0000","last_unstale":"2024-09-11T23:16:53.670708+0000","last_undegraded":"2024-09-11T23:16:53.670708+0000","last_fullsized":"2024-09-11T23:16:53.670708+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:25:53.715886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.675655+0000","last_change":"2024-09-11T23:16:53.675655+0000","last_active":"2024-09-11T23:16:53.675655+0000","last_peered":"2024-09-11T23:16:53.675655+0000","last_clean":"2024-09-11T23:16:53.675655+0000","last_became_active":"2024-09-11T23:16:53.675277+0000","last_became_peered":"2024-09-11T23:16:53.675277+0000","last_unstale":"2024-09-11T23:16:53.675655+0000","last_undegraded":"2024-09-11T23:16:53.675655+0000","last_fullsized":"2024-09-11T23:16:53.675655+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:12.869820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"93'3","reported_seq":44,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:17:02.746087+0000","last_change":"2024-09-11T23:16:12.461590+0000","last_active":"2024-09-11T23:17:02.746087+0000","last_peered":"2024-09-11T23:17:02.746087+0000","last_clean":"2024-09-11T23:17:02.746087+0000","last_became_active":"2024-09-11T23:16:12.461195+0000","last_became_peered":"2024-09-11T23:16:12.461195+0000","last_unstale":"2024-09-11T23:17:02.746087+0000","last_undegraded":"2024-09-11T23:17:02.746087+0000","last_fullsized":"2024-09-11T23:17:02.746087+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:09.929080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.671452+0000","last_change":"2024-09-11T23:16:23.553809+0000","last_active":"2024-09-11T23:16:53.671452+0000","last_peered":"2024-09-11T23:16:53.671452+0000","last_clean":"2024-09-11T23:16:53.671452+0000","last_became_active":"2024-09-11T23:16:23.553248+0000","last_became_peered":"2024-09-11T23:16:23.553248+0000","last_unstale":"2024-09-11T23:16:53.671452+0000","last_undegraded":"2024-09-11T23:16:53.671452+0000","last_fullsized":"2024-09-11T23:16:53.671452+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:05.881682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.668423+0000","last_change":"2024-09-11T23:16:15.483337+0000","last_active":"2024-09-11T23:16:53.668423+0000","last_peered":"2024-09-11T23:16:53.668423+0000","last_clean":"2024-09-11T23:16:53.668423+0000","last_became_active":"2024-09-11T23:16:15.482892+0000","last_became_peered":"2024-09-11T23:16:15.482892+0000","last_unstale":"2024-09-11T23:16:53.668423+0000","last_undegraded":"2024-09-11T23:16:53.668423+0000","last_fullsized":"2024-09-11T23:16:53.668423+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:55.584889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"93'5","reported_seq":45,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:17:02.745765+0000","last_change":"2024-09-11T23:16:12.462527+0000","last_active":"2024-09-11T23:17:02.745765+0000","last_peered":"2024-09-11T23:17:02.745765+0000","last_clean":"2024-09-11T23:17:02.745765+0000","last_became_active":"2024-09-11T23:16:12.462133+0000","last_became_peered":"2024-09-11T23:16:12.462133+0000","last_unstale":"2024-09-11T23:17:02.745765+0000","last_undegraded":"2024-09-11T23:17:02.745765+0000","last_fullsized":"2024-09-11T23:17:02.745765+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:43.745587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.664523+0000","last_change":"2024-09-11T23:16:23.539430+0000","last_active":"2024-09-11T23:16:53.664523+0000","last_peered":"2024-09-11T23:16:53.664523+0000","last_clean":"2024-09-11T23:16:53.664523+0000","last_became_active":"2024-09-11T23:16:23.538995+0000","last_became_peered":"2024-09-11T23:16:23.538995+0000","last_unstale":"2024-09-11T23:16:53.664523+0000","last_undegraded":"2024-09-11T23:16:53.664523+0000","last_fullsized":"2024-09-11T23:16:53.664523+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:00:38.176669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.927549+0000","last_change":"2024-09-11T23:16:15.487497+0000","last_active":"2024-09-11T23:16:53.927549+0000","last_peered":"2024-09-11T23:16:53.927549+0000","last_clean":"2024-09-11T23:16:53.927549+0000","last_became_active":"2024-09-11T23:16:15.487180+0000","last_became_peered":"2024-09-11T23:16:15.487180+0000","last_unstale":"2024-09-11T23:16:53.927549+0000","last_undegraded":"2024-09-11T23:16:53.927549+0000","last_fullsized":"2024-09-11T23:16:53.927549+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:51.400029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"93'2","reported_seq":42,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.725509+0000","last_change":"2024-09-11T23:16:12.463098+0000","last_active":"2024-09-11T23:17:01.725509+0000","last_peered":"2024-09-11T23:17:01.725509+0000","last_clean":"2024-09-11T23:17:01.725509+0000","last_became_active":"2024-09-11T23:16:12.462798+0000","last_became_peered":"2024-09-11T23:16:12.462798+0000","last_unstale":"2024-09-11T23:17:01.725509+0000","last_undegraded":"2024-09-11T23:17:01.725509+0000","last_fullsized":"2024-09-11T23:17:01.725509+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:31.508172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.664679+0000","last_change":"2024-09-11T23:16:23.549141+0000","last_active":"2024-09-11T23:16:53.664679+0000","last_peered":"2024-09-11T23:16:53.664679+0000","last_clean":"2024-09-11T23:16:53.664679+0000","last_became_active":"2024-09-11T23:16:23.548731+0000","last_became_peered":"2024-09-11T23:16:23.548731+0000","last_unstale":"2024-09-11T23:16:53.664679+0000","last_undegraded":"2024-09-11T23:16:53.664679+0000","last_fullsized":"2024-09-11T23:16:53.664679+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:26.781082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.665096+0000","last_change":"2024-09-11T23:16:15.483597+0000","last_active":"2024-09-11T23:16:53.665096+0000","last_peered":"2024-09-11T23:16:53.665096+0000","last_clean":"2024-09-11T23:16:53.665096+0000","last_became_active":"2024-09-11T23:16:15.483192+0000","last_became_peered":"2024-09-11T23:16:15.483192+0000","last_unstale":"2024-09-11T23:16:53.665096+0000","last_undegraded":"2024-09-11T23:16:53.665096+0000","last_fullsized":"2024-09-11T23:16:53.665096+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:33.690922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"93'17","reported_seq":57,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:17:02.744290+0000","last_change":"2024-09-11T23:16:12.633804+0000","last_active":"2024-09-11T23:17:02.744290+0000","last_peered":"2024-09-11T23:17:02.744290+0000","last_clean":"2024-09-11T23:17:02.744290+0000","last_became_active":"2024-09-11T23:16:12.633405+0000","last_became_peered":"2024-09-11T23:16:12.633405+0000","last_unstale":"2024-09-11T23:17:02.744290+0000","last_undegraded":"2024-09-11T23:17:02.744290+0000","last_fullsized":"2024-09-11T23:17:02.744290+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:38.687359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.664214+0000","last_change":"2024-09-11T23:16:23.535084+0000","last_active":"2024-09-11T23:16:53.664214+0000","last_peered":"2024-09-11T23:16:53.664214+0000","last_clean":"2024-09-11T23:16:53.664214+0000","last_became_active":"2024-09-11T23:16:23.534613+0000","last_became_peered":"2024-09-11T23:16:23.534613+0000","last_unstale":"2024-09-11T23:16:53.664214+0000","last_undegraded":"2024-09-11T23:16:53.664214+0000","last_fullsized":"2024-09-11T23:16:53.664214+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:02:19.686195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.667378+0000","last_change":"2024-09-11T23:16:15.488379+0000","last_active":"2024-09-11T23:16:53.667378+0000","last_peered":"2024-09-11T23:16:53.667378+0000","last_clean":"2024-09-11T23:16:53.667378+0000","last_became_active":"2024-09-11T23:16:15.488057+0000","last_became_peered":"2024-09-11T23:16:15.488057+0000","last_unstale":"2024-09-11T23:16:53.667378+0000","last_undegraded":"2024-09-11T23:16:53.667378+0000","last_fullsized":"2024-09-11T23:16:53.667378+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:49:05.609717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"93'6","reported_seq":62,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:17:17.771338+0000","last_change":"2024-09-11T23:16:12.455466+0000","last_active":"2024-09-11T23:17:17.771338+0000","last_peered":"2024-09-11T23:17:17.771338+0000","last_clean":"2024-09-11T23:17:17.771338+0000","last_became_active":"2024-09-11T23:16:12.455149+0000","last_became_peered":"2024-09-11T23:16:12.455149+0000","last_unstale":"2024-09-11T23:17:17.771338+0000","last_undegraded":"2024-09-11T23:17:17.771338+0000","last_fullsized":"2024-09-11T23:17:17.771338+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:27.642229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":20,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.671574+0000","last_change":"2024-09-11T23:16:23.549435+0000","last_active":"2024-09-11T23:16:53.671574+0000","last_peered":"2024-09-11T23:16:53.671574+0000","last_clean":"2024-09-11T23:16:53.671574+0000","last_became_active":"2024-09-11T23:16:23.548974+0000","last_became_peered":"2024-09-11T23:16:23.548974+0000","last_unstale":"2024-09-11T23:16:53.671574+0000","last_undegraded":"2024-09-11T23:16:53.671574+0000","last_fullsized":"2024-09-11T23:16:53.671574+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:16.252974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.668285+0000","last_change":"2024-09-11T23:16:15.486521+0000","last_active":"2024-09-11T23:16:53.668285+0000","last_peered":"2024-09-11T23:16:53.668285+0000","last_clean":"2024-09-11T23:16:53.668285+0000","last_became_active":"2024-09-11T23:16:15.486206+0000","last_became_peered":"2024-09-11T23:16:15.486206+0000","last_unstale":"2024-09-11T23:16:53.668285+0000","last_undegraded":"2024-09-11T23:16:53.668285+0000","last_fullsized":"2024-09-11T23:16:53.668285+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:18.814215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"93'5","reported_seq":46,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:17:02.746129+0000","last_change":"2024-09-11T23:16:12.461530+0000","last_active":"2024-09-11T23:17:02.746129+0000","last_peered":"2024-09-11T23:17:02.746129+0000","last_clean":"2024-09-11T23:17:02.746129+0000","last_became_active":"2024-09-11T23:16:12.460059+0000","last_became_peered":"2024-09-11T23:16:12.460059+0000","last_unstale":"2024-09-11T23:17:02.746129+0000","last_undegraded":"2024-09-11T23:17:02.746129+0000","last_fullsized":"2024-09-11T23:17:02.746129+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:03.797156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.927283+0000","last_change":"2024-09-11T23:16:23.545969+0000","last_active":"2024-09-11T23:16:53.927283+0000","last_peered":"2024-09-11T23:16:53.927283+0000","last_clean":"2024-09-11T23:16:53.927283+0000","last_became_active":"2024-09-11T23:16:23.545458+0000","last_became_peered":"2024-09-11T23:16:23.545458+0000","last_unstale":"2024-09-11T23:16:53.927283+0000","last_undegraded":"2024-09-11T23:16:53.927283+0000","last_fullsized":"2024-09-11T23:16:53.927283+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:46.438353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.664069+0000","last_change":"2024-09-11T23:16:15.480940+0000","last_active":"2024-09-11T23:16:53.664069+0000","last_peered":"2024-09-11T23:16:53.664069+0000","last_clean":"2024-09-11T23:16:53.664069+0000","last_became_active":"2024-09-11T23:16:15.480549+0000","last_became_peered":"2024-09-11T23:16:15.480549+0000","last_unstale":"2024-09-11T23:16:53.664069+0000","last_undegraded":"2024-09-11T23:16:53.664069+0000","last_fullsized":"2024-09-11T23:16:53.664069+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:21:47.576800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"93'9","reported_seq":49,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:17:03.748224+0000","last_change":"2024-09-11T23:16:12.464871+0000","last_active":"2024-09-11T23:17:03.748224+0000","last_peered":"2024-09-11T23:17:03.748224+0000","last_clean":"2024-09-11T23:17:03.748224+0000","last_became_active":"2024-09-11T23:16:12.464364+0000","last_became_peered":"2024-09-11T23:16:12.464364+0000","last_unstale":"2024-09-11T23:17:03.748224+0000","last_undegraded":"2024-09-11T23:17:03.748224+0000","last_fullsized":"2024-09-11T23:17:03.748224+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:48:51.131314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.665253+0000","last_change":"2024-09-11T23:16:23.542318+0000","last_active":"2024-09-11T23:16:53.665253+0000","last_peered":"2024-09-11T23:16:53.665253+0000","last_clean":"2024-09-11T23:16:53.665253+0000","last_became_active":"2024-09-11T23:16:23.541873+0000","last_became_peered":"2024-09-11T23:16:23.541873+0000","last_unstale":"2024-09-11T23:16:53.665253+0000","last_undegraded":"2024-09-11T23:16:53.665253+0000","last_fullsized":"2024-09-11T23:16:53.665253+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:25.287539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.668314+0000","last_change":"2024-09-11T23:16:15.479692+0000","last_active":"2024-09-11T23:16:53.668314+0000","last_peered":"2024-09-11T23:16:53.668314+0000","last_clean":"2024-09-11T23:16:53.668314+0000","last_became_active":"2024-09-11T23:16:15.479370+0000","last_became_peered":"2024-09-11T23:16:15.479370+0000","last_unstale":"2024-09-11T23:16:53.668314+0000","last_undegraded":"2024-09-11T23:16:53.668314+0000","last_fullsized":"2024-09-11T23:16:53.668314+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:09.051394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"93'28","reported_seq":98,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:17:15.769669+0000","last_change":"2024-09-11T23:16:12.463137+0000","last_active":"2024-09-11T23:17:15.769669+0000","last_peered":"2024-09-11T23:17:15.769669+0000","last_clean":"2024-09-11T23:17:15.769669+0000","last_became_active":"2024-09-11T23:16:12.462795+0000","last_became_peered":"2024-09-11T23:16:12.462795+0000","last_unstale":"2024-09-11T23:17:15.769669+0000","last_undegraded":"2024-09-11T23:17:15.769669+0000","last_fullsized":"2024-09-11T23:17:15.769669+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:18.607151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49098,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":31,"num_read_kb":63,"num_write":30,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.671736+0000","last_change":"2024-09-11T23:16:23.540727+0000","last_active":"2024-09-11T23:16:53.671736+0000","last_peered":"2024-09-11T23:16:53.671736+0000","last_clean":"2024-09-11T23:16:53.671736+0000","last_became_active":"2024-09-11T23:16:23.537903+0000","last_became_peered":"2024-09-11T23:16:23.537903+0000","last_unstale":"2024-09-11T23:16:53.671736+0000","last_undegraded":"2024-09-11T23:16:53.671736+0000","last_fullsized":"2024-09-11T23:16:53.671736+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:25.357375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.673255+0000","last_change":"2024-09-11T23:16:53.673255+0000","last_active":"2024-09-11T23:16:53.673255+0000","last_peered":"2024-09-11T23:16:53.673255+0000","last_clean":"2024-09-11T23:16:53.673255+0000","last_became_active":"2024-09-11T23:16:53.672779+0000","last_became_peered":"2024-09-11T23:16:53.672779+0000","last_unstale":"2024-09-11T23:16:53.673255+0000","last_undegraded":"2024-09-11T23:16:53.673255+0000","last_fullsized":"2024-09-11T23:16:53.673255+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:48.377554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,7],"acting":[1,8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"93'5","reported_seq":46,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.735942+0000","last_change":"2024-09-11T23:16:12.634089+0000","last_active":"2024-09-11T23:17:01.735942+0000","last_peered":"2024-09-11T23:17:01.735942+0000","last_clean":"2024-09-11T23:17:01.735942+0000","last_became_active":"2024-09-11T23:16:12.633591+0000","last_became_peered":"2024-09-11T23:16:12.633591+0000","last_unstale":"2024-09-11T23:17:01.735942+0000","last_undegraded":"2024-09-11T23:17:01.735942+0000","last_fullsized":"2024-09-11T23:17:01.735942+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:48.647019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.927985+0000","last_change":"2024-09-11T23:16:23.539351+0000","last_active":"2024-09-11T23:16:53.927985+0000","last_peered":"2024-09-11T23:16:53.927985+0000","last_clean":"2024-09-11T23:16:53.927985+0000","last_became_active":"2024-09-11T23:16:23.538781+0000","last_became_peered":"2024-09-11T23:16:23.538781+0000","last_unstale":"2024-09-11T23:16:53.927985+0000","last_undegraded":"2024-09-11T23:16:53.927985+0000","last_fullsized":"2024-09-11T23:16:53.927985+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:11.384211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.673248+0000","last_change":"2024-09-11T23:16:53.673248+0000","last_active":"2024-09-11T23:16:53.673248+0000","last_peered":"2024-09-11T23:16:53.673248+0000","last_clean":"2024-09-11T23:16:53.673248+0000","last_became_active":"2024-09-11T23:16:53.672359+0000","last_became_peered":"2024-09-11T23:16:53.672359+0000","last_unstale":"2024-09-11T23:16:53.673248+0000","last_undegraded":"2024-09-11T23:16:53.673248+0000","last_fullsized":"2024-09-11T23:16:53.673248+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:52.841263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,5],"acting":[0,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"93'4","reported_seq":48,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:17:02.743702+0000","last_change":"2024-09-11T23:16:53.929781+0000","last_active":"2024-09-11T23:17:02.743702+0000","last_peered":"2024-09-11T23:17:02.743702+0000","last_clean":"2024-09-11T23:17:02.743702+0000","last_became_active":"2024-09-11T23:16:53.929313+0000","last_became_peered":"2024-09-11T23:16:53.929313+0000","last_unstale":"2024-09-11T23:17:02.743702+0000","last_undegraded":"2024-09-11T23:17:02.743702+0000","last_fullsized":"2024-09-11T23:17:02.743702+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:29:50.874721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.669414+0000","last_change":"2024-09-11T23:16:23.551090+0000","last_active":"2024-09-11T23:16:53.669414+0000","last_peered":"2024-09-11T23:16:53.669414+0000","last_clean":"2024-09-11T23:16:53.669414+0000","last_became_active":"2024-09-11T23:16:23.548558+0000","last_became_peered":"2024-09-11T23:16:23.548558+0000","last_unstale":"2024-09-11T23:16:53.669414+0000","last_undegraded":"2024-09-11T23:16:53.669414+0000","last_fullsized":"2024-09-11T23:16:53.669414+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:29:08.416426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.671750+0000","last_change":"2024-09-11T23:16:15.487741+0000","last_active":"2024-09-11T23:16:53.671750+0000","last_peered":"2024-09-11T23:16:53.671750+0000","last_clean":"2024-09-11T23:16:53.671750+0000","last_became_active":"2024-09-11T23:16:15.487410+0000","last_became_peered":"2024-09-11T23:16:15.487410+0000","last_unstale":"2024-09-11T23:16:53.671750+0000","last_undegraded":"2024-09-11T23:16:53.671750+0000","last_fullsized":"2024-09-11T23:16:53.671750+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:48:18.452521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"93'4","reported_seq":69,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:17:15.767621+0000","last_change":"2024-09-11T23:16:12.459784+0000","last_active":"2024-09-11T23:17:15.767621+0000","last_peered":"2024-09-11T23:17:15.767621+0000","last_clean":"2024-09-11T23:17:15.767621+0000","last_became_active":"2024-09-11T23:16:12.459440+0000","last_became_peered":"2024-09-11T23:16:12.459440+0000","last_unstale":"2024-09-11T23:17:15.767621+0000","last_undegraded":"2024-09-11T23:17:15.767621+0000","last_fullsized":"2024-09-11T23:17:15.767621+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:36.380446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.666802+0000","last_change":"2024-09-11T23:16:23.541323+0000","last_active":"2024-09-11T23:16:53.666802+0000","last_peered":"2024-09-11T23:16:53.666802+0000","last_clean":"2024-09-11T23:16:53.666802+0000","last_became_active":"2024-09-11T23:16:23.540912+0000","last_became_peered":"2024-09-11T23:16:23.540912+0000","last_unstale":"2024-09-11T23:16:53.666802+0000","last_undegraded":"2024-09-11T23:16:53.666802+0000","last_fullsized":"2024-09-11T23:16:53.666802+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:43.842799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.671465+0000","last_change":"2024-09-11T23:16:23.547579+0000","last_active":"2024-09-11T23:16:53.671465+0000","last_peered":"2024-09-11T23:16:53.671465+0000","last_clean":"2024-09-11T23:16:53.671465+0000","last_became_active":"2024-09-11T23:16:23.547182+0000","last_became_peered":"2024-09-11T23:16:23.547182+0000","last_unstale":"2024-09-11T23:16:53.671465+0000","last_undegraded":"2024-09-11T23:16:53.671465+0000","last_fullsized":"2024-09-11T23:16:53.671465+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:29.471671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.670025+0000","last_change":"2024-09-11T23:16:15.482342+0000","last_active":"2024-09-11T23:16:53.670025+0000","last_peered":"2024-09-11T23:16:53.670025+0000","last_clean":"2024-09-11T23:16:53.670025+0000","last_became_active":"2024-09-11T23:16:15.481993+0000","last_became_peered":"2024-09-11T23:16:15.481993+0000","last_unstale":"2024-09-11T23:16:53.670025+0000","last_undegraded":"2024-09-11T23:16:53.670025+0000","last_fullsized":"2024-09-11T23:16:53.670025+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:11.432932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"93'3","reported_seq":44,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:17:02.744829+0000","last_change":"2024-09-11T23:16:12.460852+0000","last_active":"2024-09-11T23:17:02.744829+0000","last_peered":"2024-09-11T23:17:02.744829+0000","last_clean":"2024-09-11T23:17:02.744829+0000","last_became_active":"2024-09-11T23:16:12.460500+0000","last_became_peered":"2024-09-11T23:16:12.460500+0000","last_unstale":"2024-09-11T23:17:02.744829+0000","last_undegraded":"2024-09-11T23:17:02.744829+0000","last_fullsized":"2024-09-11T23:17:02.744829+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:36.996441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.927538+0000","last_change":"2024-09-11T23:16:23.548465+0000","last_active":"2024-09-11T23:16:53.927538+0000","last_peered":"2024-09-11T23:16:53.927538+0000","last_clean":"2024-09-11T23:16:53.927538+0000","last_became_active":"2024-09-11T23:16:23.548121+0000","last_became_peered":"2024-09-11T23:16:23.548121+0000","last_unstale":"2024-09-11T23:16:53.927538+0000","last_undegraded":"2024-09-11T23:16:53.927538+0000","last_fullsized":"2024-09-11T23:16:53.927538+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:32:43.950947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.666854+0000","last_change":"2024-09-11T23:16:15.482202+0000","last_active":"2024-09-11T23:16:53.666854+0000","last_peered":"2024-09-11T23:16:53.666854+0000","last_clean":"2024-09-11T23:16:53.666854+0000","last_became_active":"2024-09-11T23:16:15.481817+0000","last_became_peered":"2024-09-11T23:16:15.481817+0000","last_unstale":"2024-09-11T23:16:53.666854+0000","last_undegraded":"2024-09-11T23:16:53.666854+0000","last_fullsized":"2024-09-11T23:16:53.666854+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:30.309241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"93'3","reported_seq":43,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:17:00.730060+0000","last_change":"2024-09-11T23:16:12.460729+0000","last_active":"2024-09-11T23:17:00.730060+0000","last_peered":"2024-09-11T23:17:00.730060+0000","last_clean":"2024-09-11T23:17:00.730060+0000","last_became_active":"2024-09-11T23:16:12.460319+0000","last_became_peered":"2024-09-11T23:16:12.460319+0000","last_unstale":"2024-09-11T23:17:00.730060+0000","last_undegraded":"2024-09-11T23:17:00.730060+0000","last_fullsized":"2024-09-11T23:17:00.730060+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:45:20.901191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"93'7","reported_seq":46,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.736897+0000","last_change":"2024-09-11T23:16:12.455617+0000","last_active":"2024-09-11T23:17:01.736897+0000","last_peered":"2024-09-11T23:17:01.736897+0000","last_clean":"2024-09-11T23:17:01.736897+0000","last_became_active":"2024-09-11T23:16:12.455159+0000","last_became_peered":"2024-09-11T23:16:12.455159+0000","last_unstale":"2024-09-11T23:17:01.736897+0000","last_undegraded":"2024-09-11T23:17:01.736897+0000","last_fullsized":"2024-09-11T23:17:01.736897+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:04:19.956580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.664946+0000","last_change":"2024-09-11T23:16:15.496026+0000","last_active":"2024-09-11T23:16:53.664946+0000","last_peered":"2024-09-11T23:16:53.664946+0000","last_clean":"2024-09-11T23:16:53.664946+0000","last_became_active":"2024-09-11T23:16:15.495785+0000","last_became_peered":"2024-09-11T23:16:15.495785+0000","last_unstale":"2024-09-11T23:16:53.664946+0000","last_undegraded":"2024-09-11T23:16:53.664946+0000","last_fullsized":"2024-09-11T23:16:53.664946+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:11:33.613170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.764170+0000","last_change":"2024-09-11T23:16:23.545144+0000","last_active":"2024-09-11T23:16:53.764170+0000","last_peered":"2024-09-11T23:16:53.764170+0000","last_clean":"2024-09-11T23:16:53.764170+0000","last_became_active":"2024-09-11T23:16:23.544702+0000","last_became_peered":"2024-09-11T23:16:23.544702+0000","last_unstale":"2024-09-11T23:16:53.764170+0000","last_undegraded":"2024-09-11T23:16:53.764170+0000","last_fullsized":"2024-09-11T23:16:53.764170+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:35:39.155913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"93'5","reported_seq":63,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:17:17.770854+0000","last_change":"2024-09-11T23:16:12.464182+0000","last_active":"2024-09-11T23:17:17.770854+0000","last_peered":"2024-09-11T23:17:17.770854+0000","last_clean":"2024-09-11T23:17:17.770854+0000","last_became_active":"2024-09-11T23:16:12.463835+0000","last_became_peered":"2024-09-11T23:16:12.463835+0000","last_unstale":"2024-09-11T23:17:17.770854+0000","last_undegraded":"2024-09-11T23:17:17.770854+0000","last_fullsized":"2024-09-11T23:17:17.770854+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:34:51.682457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.674740+0000","last_change":"2024-09-11T23:16:53.674740+0000","last_active":"2024-09-11T23:16:53.674740+0000","last_peered":"2024-09-11T23:16:53.674740+0000","last_clean":"2024-09-11T23:16:53.674740+0000","last_became_active":"2024-09-11T23:16:53.674285+0000","last_became_peered":"2024-09-11T23:16:53.674285+0000","last_unstale":"2024-09-11T23:16:53.674740+0000","last_undegraded":"2024-09-11T23:16:53.674740+0000","last_fullsized":"2024-09-11T23:16:53.674740+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:08.762810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6],"acting":[8,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.764397+0000","last_change":"2024-09-11T23:16:23.540185+0000","last_active":"2024-09-11T23:16:53.764397+0000","last_peered":"2024-09-11T23:16:53.764397+0000","last_clean":"2024-09-11T23:16:53.764397+0000","last_became_active":"2024-09-11T23:16:23.539760+0000","last_became_peered":"2024-09-11T23:16:23.539760+0000","last_unstale":"2024-09-11T23:16:53.764397+0000","last_undegraded":"2024-09-11T23:16:53.764397+0000","last_fullsized":"2024-09-11T23:16:53.764397+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:40.944999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.927205+0000","last_change":"2024-09-11T23:16:15.489240+0000","last_active":"2024-09-11T23:16:53.927205+0000","last_peered":"2024-09-11T23:16:53.927205+0000","last_clean":"2024-09-11T23:16:53.927205+0000","last_became_active":"2024-09-11T23:16:15.488878+0000","last_became_peered":"2024-09-11T23:16:15.488878+0000","last_unstale":"2024-09-11T23:16:53.927205+0000","last_undegraded":"2024-09-11T23:16:53.927205+0000","last_fullsized":"2024-09-11T23:16:53.927205+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:38.076935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.764380+0000","last_change":"2024-09-11T23:16:15.486369+0000","last_active":"2024-09-11T23:16:53.764380+0000","last_peered":"2024-09-11T23:16:53.764380+0000","last_clean":"2024-09-11T23:16:53.764380+0000","last_became_active":"2024-09-11T23:16:15.486055+0000","last_became_peered":"2024-09-11T23:16:15.486055+0000","last_unstale":"2024-09-11T23:16:53.764380+0000","last_undegraded":"2024-09-11T23:16:53.764380+0000","last_fullsized":"2024-09-11T23:16:53.764380+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:16.233578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.764033+0000","last_change":"2024-09-11T23:16:15.484981+0000","last_active":"2024-09-11T23:16:53.764033+0000","last_peered":"2024-09-11T23:16:53.764033+0000","last_clean":"2024-09-11T23:16:53.764033+0000","last_became_active":"2024-09-11T23:16:15.484640+0000","last_became_peered":"2024-09-11T23:16:15.484640+0000","last_unstale":"2024-09-11T23:16:53.764033+0000","last_undegraded":"2024-09-11T23:16:53.764033+0000","last_fullsized":"2024-09-11T23:16:53.764033+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:32.844009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.671522+0000","last_change":"2024-09-11T23:16:15.488570+0000","last_active":"2024-09-11T23:16:53.671522+0000","last_peered":"2024-09-11T23:16:53.671522+0000","last_clean":"2024-09-11T23:16:53.671522+0000","last_became_active":"2024-09-11T23:16:15.487932+0000","last_became_peered":"2024-09-11T23:16:15.487932+0000","last_unstale":"2024-09-11T23:16:53.671522+0000","last_undegraded":"2024-09-11T23:16:53.671522+0000","last_fullsized":"2024-09-11T23:16:53.671522+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:14.062864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.664248+0000","last_change":"2024-09-11T23:16:15.499493+0000","last_active":"2024-09-11T23:16:53.664248+0000","last_peered":"2024-09-11T23:16:53.664248+0000","last_clean":"2024-09-11T23:16:53.664248+0000","last_became_active":"2024-09-11T23:16:15.499150+0000","last_became_peered":"2024-09-11T23:16:15.499150+0000","last_unstale":"2024-09-11T23:16:53.664248+0000","last_undegraded":"2024-09-11T23:16:53.664248+0000","last_fullsized":"2024-09-11T23:16:53.664248+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:52.538614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.927524+0000","last_change":"2024-09-11T23:16:15.484214+0000","last_active":"2024-09-11T23:16:53.927524+0000","last_peered":"2024-09-11T23:16:53.927524+0000","last_clean":"2024-09-11T23:16:53.927524+0000","last_became_active":"2024-09-11T23:16:15.483911+0000","last_became_peered":"2024-09-11T23:16:15.483911+0000","last_unstale":"2024-09-11T23:16:53.927524+0000","last_undegraded":"2024-09-11T23:16:53.927524+0000","last_fullsized":"2024-09-11T23:16:53.927524+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:19:12.283255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.764671+0000","last_change":"2024-09-11T23:16:15.488454+0000","last_active":"2024-09-11T23:16:53.764671+0000","last_peered":"2024-09-11T23:16:53.764671+0000","last_clean":"2024-09-11T23:16:53.764671+0000","last_became_active":"2024-09-11T23:16:15.488071+0000","last_became_peered":"2024-09-11T23:16:15.488071+0000","last_unstale":"2024-09-11T23:16:53.764671+0000","last_undegraded":"2024-09-11T23:16:53.764671+0000","last_fullsized":"2024-09-11T23:16:53.764671+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:31.249057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.667972+0000","last_change":"2024-09-11T23:16:15.489743+0000","last_active":"2024-09-11T23:16:53.667972+0000","last_peered":"2024-09-11T23:16:53.667972+0000","last_clean":"2024-09-11T23:16:53.667972+0000","last_became_active":"2024-09-11T23:16:15.489411+0000","last_became_peered":"2024-09-11T23:16:15.489411+0000","last_unstale":"2024-09-11T23:16:53.667972+0000","last_undegraded":"2024-09-11T23:16:53.667972+0000","last_fullsized":"2024-09-11T23:16:53.667972+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:09.912448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.664733+0000","last_change":"2024-09-11T23:16:15.494906+0000","last_active":"2024-09-11T23:16:53.664733+0000","last_peered":"2024-09-11T23:16:53.664733+0000","last_clean":"2024-09-11T23:16:53.664733+0000","last_became_active":"2024-09-11T23:16:15.494567+0000","last_became_peered":"2024-09-11T23:16:15.494567+0000","last_unstale":"2024-09-11T23:16:53.664733+0000","last_undegraded":"2024-09-11T23:16:53.664733+0000","last_fullsized":"2024-09-11T23:16:53.664733+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:22.364551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.667162+0000","last_change":"2024-09-11T23:16:15.489363+0000","last_active":"2024-09-11T23:16:53.667162+0000","last_peered":"2024-09-11T23:16:53.667162+0000","last_clean":"2024-09-11T23:16:53.667162+0000","last_became_active":"2024-09-11T23:16:15.489056+0000","last_became_peered":"2024-09-11T23:16:15.489056+0000","last_unstale":"2024-09-11T23:16:53.667162+0000","last_undegraded":"2024-09-11T23:16:53.667162+0000","last_fullsized":"2024-09-11T23:16:53.667162+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:37:37.152715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.671048+0000","last_change":"2024-09-11T23:16:15.483283+0000","last_active":"2024-09-11T23:16:53.671048+0000","last_peered":"2024-09-11T23:16:53.671048+0000","last_clean":"2024-09-11T23:16:53.671048+0000","last_became_active":"2024-09-11T23:16:15.481463+0000","last_became_peered":"2024-09-11T23:16:15.481463+0000","last_unstale":"2024-09-11T23:16:53.671048+0000","last_undegraded":"2024-09-11T23:16:53.671048+0000","last_fullsized":"2024-09-11T23:16:53.671048+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:37.484644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.664318+0000","last_change":"2024-09-11T23:16:15.487478+0000","last_active":"2024-09-11T23:16:53.664318+0000","last_peered":"2024-09-11T23:16:53.664318+0000","last_clean":"2024-09-11T23:16:53.664318+0000","last_became_active":"2024-09-11T23:16:15.487115+0000","last_became_peered":"2024-09-11T23:16:15.487115+0000","last_unstale":"2024-09-11T23:16:53.664318+0000","last_undegraded":"2024-09-11T23:16:53.664318+0000","last_fullsized":"2024-09-11T23:16:53.664318+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:34.967388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.927320+0000","last_change":"2024-09-11T23:16:15.486593+0000","last_active":"2024-09-11T23:16:53.927320+0000","last_peered":"2024-09-11T23:16:53.927320+0000","last_clean":"2024-09-11T23:16:53.927320+0000","last_became_active":"2024-09-11T23:16:15.486282+0000","last_became_peered":"2024-09-11T23:16:15.486282+0000","last_unstale":"2024-09-11T23:16:53.927320+0000","last_undegraded":"2024-09-11T23:16:53.927320+0000","last_fullsized":"2024-09-11T23:16:53.927320+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:33.845679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.764638+0000","last_change":"2024-09-11T23:16:15.488330+0000","last_active":"2024-09-11T23:16:53.764638+0000","last_peered":"2024-09-11T23:16:53.764638+0000","last_clean":"2024-09-11T23:16:53.764638+0000","last_became_active":"2024-09-11T23:16:15.488005+0000","last_became_peered":"2024-09-11T23:16:15.488005+0000","last_unstale":"2024-09-11T23:16:53.764638+0000","last_undegraded":"2024-09-11T23:16:53.764638+0000","last_fullsized":"2024-09-11T23:16:53.764638+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:12.189988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.671148+0000","last_change":"2024-09-11T23:16:15.486251+0000","last_active":"2024-09-11T23:16:53.671148+0000","last_peered":"2024-09-11T23:16:53.671148+0000","last_clean":"2024-09-11T23:16:53.671148+0000","last_became_active":"2024-09-11T23:16:15.485937+0000","last_became_peered":"2024-09-11T23:16:15.485937+0000","last_unstale":"2024-09-11T23:16:53.671148+0000","last_undegraded":"2024-09-11T23:16:53.671148+0000","last_fullsized":"2024-09-11T23:16:53.671148+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:32:01.829834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.927685+0000","last_change":"2024-09-11T23:16:15.488635+0000","last_active":"2024-09-11T23:16:53.927685+0000","last_peered":"2024-09-11T23:16:53.927685+0000","last_clean":"2024-09-11T23:16:53.927685+0000","last_became_active":"2024-09-11T23:16:15.488326+0000","last_became_peered":"2024-09-11T23:16:15.488326+0000","last_unstale":"2024-09-11T23:16:53.927685+0000","last_undegraded":"2024-09-11T23:16:53.927685+0000","last_fullsized":"2024-09-11T23:16:53.927685+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:25.626349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.679440+0000","last_change":"2024-09-11T23:16:53.676716+0000","last_active":"2024-09-11T23:16:53.679440+0000","last_peered":"2024-09-11T23:16:53.679440+0000","last_clean":"2024-09-11T23:16:53.679440+0000","last_became_active":"2024-09-11T23:16:53.674056+0000","last_became_peered":"2024-09-11T23:16:53.674056+0000","last_unstale":"2024-09-11T23:16:53.679440+0000","last_undegraded":"2024-09-11T23:16:53.679440+0000","last_fullsized":"2024-09-11T23:16:53.679440+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:49:44.258607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0],"acting":[9,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.671693+0000","last_change":"2024-09-11T23:16:15.487550+0000","last_active":"2024-09-11T23:16:53.671693+0000","last_peered":"2024-09-11T23:16:53.671693+0000","last_clean":"2024-09-11T23:16:53.671693+0000","last_became_active":"2024-09-11T23:16:15.487197+0000","last_became_peered":"2024-09-11T23:16:15.487197+0000","last_unstale":"2024-09-11T23:16:53.671693+0000","last_undegraded":"2024-09-11T23:16:53.671693+0000","last_fullsized":"2024-09-11T23:16:53.671693+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:51.899470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.670834+0000","last_change":"2024-09-11T23:16:15.493106+0000","last_active":"2024-09-11T23:16:53.670834+0000","last_peered":"2024-09-11T23:16:53.670834+0000","last_clean":"2024-09-11T23:16:53.670834+0000","last_became_active":"2024-09-11T23:16:15.492649+0000","last_became_peered":"2024-09-11T23:16:15.492649+0000","last_unstale":"2024-09-11T23:16:53.670834+0000","last_undegraded":"2024-09-11T23:16:53.670834+0000","last_fullsized":"2024-09-11T23:16:53.670834+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:37.584557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.664285+0000","last_change":"2024-09-11T23:16:15.485444+0000","last_active":"2024-09-11T23:16:53.664285+0000","last_peered":"2024-09-11T23:16:53.664285+0000","last_clean":"2024-09-11T23:16:53.664285+0000","last_became_active":"2024-09-11T23:16:15.484985+0000","last_became_peered":"2024-09-11T23:16:15.484985+0000","last_unstale":"2024-09-11T23:16:53.664285+0000","last_undegraded":"2024-09-11T23:16:53.664285+0000","last_fullsized":"2024-09-11T23:16:53.664285+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:42:38.827500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.928603+0000","last_change":"2024-09-11T23:16:15.488819+0000","last_active":"2024-09-11T23:16:53.928603+0000","last_peered":"2024-09-11T23:16:53.928603+0000","last_clean":"2024-09-11T23:16:53.928603+0000","last_became_active":"2024-09-11T23:16:15.488484+0000","last_became_peered":"2024-09-11T23:16:15.488484+0000","last_unstale":"2024-09-11T23:16:53.928603+0000","last_undegraded":"2024-09-11T23:16:53.928603+0000","last_fullsized":"2024-09-11T23:16:53.928603+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:11.548909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.669104+0000","last_change":"2024-09-11T23:16:15.490369+0000","last_active":"2024-09-11T23:16:53.669104+0000","last_peered":"2024-09-11T23:16:53.669104+0000","last_clean":"2024-09-11T23:16:53.669104+0000","last_became_active":"2024-09-11T23:16:15.489977+0000","last_became_peered":"2024-09-11T23:16:15.489977+0000","last_unstale":"2024-09-11T23:16:53.669104+0000","last_undegraded":"2024-09-11T23:16:53.669104+0000","last_fullsized":"2024-09-11T23:16:53.669104+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:17.161073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.667680+0000","last_change":"2024-09-11T23:16:15.486820+0000","last_active":"2024-09-11T23:16:53.667680+0000","last_peered":"2024-09-11T23:16:53.667680+0000","last_clean":"2024-09-11T23:16:53.667680+0000","last_became_active":"2024-09-11T23:16:15.486259+0000","last_became_peered":"2024-09-11T23:16:15.486259+0000","last_unstale":"2024-09-11T23:16:53.667680+0000","last_undegraded":"2024-09-11T23:16:53.667680+0000","last_fullsized":"2024-09-11T23:16:53.667680+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:11.156989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.671947+0000","last_change":"2024-09-11T23:16:15.482432+0000","last_active":"2024-09-11T23:16:53.671947+0000","last_peered":"2024-09-11T23:16:53.671947+0000","last_clean":"2024-09-11T23:16:53.671947+0000","last_became_active":"2024-09-11T23:16:15.481930+0000","last_became_peered":"2024-09-11T23:16:15.481930+0000","last_unstale":"2024-09-11T23:16:53.671947+0000","last_undegraded":"2024-09-11T23:16:53.671947+0000","last_fullsized":"2024-09-11T23:16:53.671947+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:03.156829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.670447+0000","last_change":"2024-09-11T23:16:53.670447+0000","last_active":"2024-09-11T23:16:53.670447+0000","last_peered":"2024-09-11T23:16:53.670447+0000","last_clean":"2024-09-11T23:16:53.670447+0000","last_became_active":"2024-09-11T23:16:53.670084+0000","last_became_peered":"2024-09-11T23:16:53.670084+0000","last_unstale":"2024-09-11T23:16:53.670447+0000","last_undegraded":"2024-09-11T23:16:53.670447+0000","last_fullsized":"2024-09-11T23:16:53.670447+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:25.603908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,8,10],"acting":[3,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.667926+0000","last_change":"2024-09-11T23:16:15.492210+0000","last_active":"2024-09-11T23:16:53.667926+0000","last_peered":"2024-09-11T23:16:53.667926+0000","last_clean":"2024-09-11T23:16:53.667926+0000","last_became_active":"2024-09-11T23:16:15.491333+0000","last_became_peered":"2024-09-11T23:16:15.491333+0000","last_unstale":"2024-09-11T23:16:53.667926+0000","last_undegraded":"2024-09-11T23:16:53.667926+0000","last_fullsized":"2024-09-11T23:16:53.667926+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:52.824085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.667134+0000","last_change":"2024-09-11T23:16:15.489798+0000","last_active":"2024-09-11T23:16:53.667134+0000","last_peered":"2024-09-11T23:16:53.667134+0000","last_clean":"2024-09-11T23:16:53.667134+0000","last_became_active":"2024-09-11T23:16:15.489357+0000","last_became_peered":"2024-09-11T23:16:15.489357+0000","last_unstale":"2024-09-11T23:16:53.667134+0000","last_undegraded":"2024-09-11T23:16:53.667134+0000","last_fullsized":"2024-09-11T23:16:53.667134+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:13:53.460349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.668009+0000","last_change":"2024-09-11T23:16:15.480192+0000","last_active":"2024-09-11T23:16:53.668009+0000","last_peered":"2024-09-11T23:16:53.668009+0000","last_clean":"2024-09-11T23:16:53.668009+0000","last_became_active":"2024-09-11T23:16:15.479884+0000","last_became_peered":"2024-09-11T23:16:15.479884+0000","last_unstale":"2024-09-11T23:16:53.668009+0000","last_undegraded":"2024-09-11T23:16:53.668009+0000","last_fullsized":"2024-09-11T23:16:53.668009+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:24:34.765550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.928585+0000","last_change":"2024-09-11T23:16:15.483444+0000","last_active":"2024-09-11T23:16:53.928585+0000","last_peered":"2024-09-11T23:16:53.928585+0000","last_clean":"2024-09-11T23:16:53.928585+0000","last_became_active":"2024-09-11T23:16:15.483006+0000","last_became_peered":"2024-09-11T23:16:15.483006+0000","last_unstale":"2024-09-11T23:16:53.928585+0000","last_undegraded":"2024-09-11T23:16:53.928585+0000","last_fullsized":"2024-09-11T23:16:53.928585+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:19:11.855417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.672073+0000","last_change":"2024-09-11T23:16:15.497823+0000","last_active":"2024-09-11T23:16:53.672073+0000","last_peered":"2024-09-11T23:16:53.672073+0000","last_clean":"2024-09-11T23:16:53.672073+0000","last_became_active":"2024-09-11T23:16:15.493688+0000","last_became_peered":"2024-09-11T23:16:15.493688+0000","last_unstale":"2024-09-11T23:16:53.672073+0000","last_undegraded":"2024-09-11T23:16:53.672073+0000","last_fullsized":"2024-09-11T23:16:53.672073+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:50:35.055108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.672251+0000","last_change":"2024-09-11T23:16:15.497942+0000","last_active":"2024-09-11T23:16:53.672251+0000","last_peered":"2024-09-11T23:16:53.672251+0000","last_clean":"2024-09-11T23:16:53.672251+0000","last_became_active":"2024-09-11T23:16:15.492467+0000","last_became_peered":"2024-09-11T23:16:15.492467+0000","last_unstale":"2024-09-11T23:16:53.672251+0000","last_undegraded":"2024-09-11T23:16:53.672251+0000","last_fullsized":"2024-09-11T23:16:53.672251+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:16.156174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.927657+0000","last_change":"2024-09-11T23:16:15.488477+0000","last_active":"2024-09-11T23:16:53.927657+0000","last_peered":"2024-09-11T23:16:53.927657+0000","last_clean":"2024-09-11T23:16:53.927657+0000","last_became_active":"2024-09-11T23:16:15.488169+0000","last_became_peered":"2024-09-11T23:16:15.488169+0000","last_unstale":"2024-09-11T23:16:53.927657+0000","last_undegraded":"2024-09-11T23:16:53.927657+0000","last_fullsized":"2024-09-11T23:16:53.927657+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:19:15.223041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":56699,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":183,"num_read_kb":151,"num_write":234,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":552960,"data_stored":190393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":204,"ondisk_log_size":204,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":76,"seq":326417514522,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28068,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717084,"statfs":{"total":95995035648,"available":95966294016,"internally_reserved":0,"allocated":1069056,"data_stored":530753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":69,"seq":296352743454,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28732,"kb_used_data":1708,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716420,"statfs":{"total":95995035648,"available":95965614080,"internally_reserved":0,"allocated":1748992,"data_stored":1166667,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":64,"seq":274877906980,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28096,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717056,"statfs":{"total":95995035648,"available":95966265344,"internally_reserved":0,"allocated":1097728,"data_stored":534386,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168620,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36408,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708744,"statfs":{"total":95995035648,"available":95957753856,"internally_reserved":0,"allocated":1089536,"data_stored":530668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397551,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36992,"kb_used_data":1648,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708160,"statfs":{"total":95995035648,"available":95957155840,"internally_reserved":0,"allocated":1687552,"data_stored":1127560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561078,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32228,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712924,"statfs":{"total":95995035648,"available":95962034176,"internally_reserved":0,"allocated":1069056,"data_stored":526187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790010,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28680,"kb_used_data":1656,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716472,"statfs":{"total":95995035648,"available":95965667328,"internally_reserved":0,"allocated":1695744,"data_stored":1122356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953535,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32236,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712916,"statfs":{"total":95995035648,"available":95962025984,"internally_reserved":0,"allocated":1077248,"data_stored":530261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182469,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28080,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717072,"statfs":{"total":95995035648,"available":95966281728,"internally_reserved":0,"allocated":1081344,"data_stored":525502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411404,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36472,"kb_used_data":1128,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708680,"statfs":{"total":95995035648,"available":95957688320,"internally_reserved":0,"allocated":1155072,"data_stored":586683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574927,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28132,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717020,"statfs":{"total":95995035648,"available":95966228480,"internally_reserved":0,"allocated":1134592,"data_stored":586463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738453,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32252,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712900,"statfs":{"total":95995035648,"available":95962009600,"internally_reserved":0,"allocated":1093632,"data_stored":527643,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":61391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":61611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":51227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:17:20.892 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-11T23:17:21.271 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:17:21.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:21.842+0000 7fa891000640 1 -- 172.21.15.37:0/3226462179 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa88c102b90 msgr2=0x7fa88c102f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:21.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:21.842+0000 7fa891000640 1 --2- 172.21.15.37:0/3226462179 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa88c102b90 0x7fa88c102f70 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa87c009900 tx=0x7fa87c02a480 comp rx=0 tx=0).stop 2024-09-11T23:17:21.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:21.842+0000 7fa891000640 1 -- 172.21.15.37:0/3226462179 shutdown_connections 2024-09-11T23:17:21.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:21.842+0000 7fa891000640 1 --2- 172.21.15.37:0/3226462179 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa88c10bfc0 0x7fa88c10e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:21.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:21.842+0000 7fa891000640 1 --2- 172.21.15.37:0/3226462179 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa88c1034b0 0x7fa88c10b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:21.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:21.842+0000 7fa891000640 1 --2- 172.21.15.37:0/3226462179 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa88c102b90 0x7fa88c102f70 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:21.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:21.842+0000 7fa891000640 1 -- 172.21.15.37:0/3226462179 >> 172.21.15.37:0/3226462179 conn(0x7fa88c0fc610 msgr2=0x7fa88c0fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:21.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:21.842+0000 7fa891000640 1 -- 172.21.15.37:0/3226462179 shutdown_connections 2024-09-11T23:17:21.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:21.842+0000 7fa891000640 1 -- 172.21.15.37:0/3226462179 wait complete. 2024-09-11T23:17:21.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:21.843+0000 7fa891000640 1 Processor -- start 2024-09-11T23:17:21.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:21.843+0000 7fa891000640 1 -- start start 2024-09-11T23:17:21.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:21.843+0000 7fa891000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa88c102b90 0x7fa88c19a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:21.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:21.844+0000 7fa891000640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa88c1034b0 0x7fa88c19a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:21.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:21.844+0000 7fa891000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa88c10bfc0 0x7fa88c19ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:21.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:21.844+0000 7fa891000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa88c111dc0 con 0x7fa88c102b90 2024-09-11T23:17:21.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:21.844+0000 7fa891000640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fa88c111c40 con 0x7fa88c10bfc0 2024-09-11T23:17:21.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:21.844+0000 7fa891000640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fa88c111f40 con 0x7fa88c1034b0 2024-09-11T23:17:21.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:21.844+0000 7fa88b400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa88c102b90 0x7fa88c19a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:21.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:21.844+0000 7fa88be00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa88c10bfc0 0x7fa88c19ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:21.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:21.844+0000 7fa88b400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa88c102b90 0x7fa88c19a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42084/0 (socket says 172.21.15.37:42084) 2024-09-11T23:17:21.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:21.844+0000 7fa88be00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa88c10bfc0 0x7fa88c19ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.37:43846/0 (socket says 172.21.15.37:43846) 2024-09-11T23:17:21.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:21.844+0000 7fa88b400640 1 -- 172.21.15.37:0/2627873198 learned_addr learned my addr 172.21.15.37:0/2627873198 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:17:21.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:21.844+0000 7fa883e00640 1 --2- 172.21.15.37:0/2627873198 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa88c1034b0 0x7fa88c19a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:21.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:21.844+0000 7fa88be00640 1 -- 172.21.15.37:0/2627873198 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa88c1034b0 msgr2=0x7fa88c19a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:21.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:21.844+0000 7fa88be00640 1 --2- 172.21.15.37:0/2627873198 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa88c1034b0 0x7fa88c19a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:21.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:21.844+0000 7fa88be00640 1 -- 172.21.15.37:0/2627873198 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa88c102b90 msgr2=0x7fa88c19a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:21.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:21.844+0000 7fa88be00640 1 --2- 172.21.15.37:0/2627873198 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa88c102b90 0x7fa88c19a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:21.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:21.844+0000 7fa88be00640 1 -- 172.21.15.37:0/2627873198 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa88c19f420 con 0x7fa88c10bfc0 2024-09-11T23:17:21.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:21.845+0000 7fa88be00640 1 --2- 172.21.15.37:0/2627873198 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa88c10bfc0 0x7fa88c19ed40 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa884009fd0 tx=0x7fa88400ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:21.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:21.845+0000 7fa888c00640 1 -- 172.21.15.37:0/2627873198 <== mon.2 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa88400ce20 con 0x7fa88c10bfc0 2024-09-11T23:17:21.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:21.845+0000 7fa891000640 1 -- 172.21.15.37:0/2627873198 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa88c19f710 con 0x7fa88c10bfc0 2024-09-11T23:17:21.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:21.845+0000 7fa888c00640 1 -- 172.21.15.37:0/2627873198 <== mon.2 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa884005020 con 0x7fa88c10bfc0 2024-09-11T23:17:21.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:21.845+0000 7fa888c00640 1 -- 172.21.15.37:0/2627873198 <== mon.2 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa884010720 con 0x7fa88c10bfc0 2024-09-11T23:17:21.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:21.845+0000 7fa891000640 1 -- 172.21.15.37:0/2627873198 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa88c1a6ff0 con 0x7fa88c10bfc0 2024-09-11T23:17:21.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:21.846+0000 7fa891000640 1 -- 172.21.15.37:0/2627873198 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa88c102f70 con 0x7fa88c10bfc0 2024-09-11T23:17:21.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:21.848+0000 7fa888c00640 1 -- 172.21.15.37:0/2627873198 <== mon.2 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fa884005540 con 0x7fa88c10bfc0 2024-09-11T23:17:21.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:21.849+0000 7fa888c00640 1 --2- 172.21.15.37:0/2627873198 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fa8700a2c10 0x7fa8700a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:21.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:21.849+0000 7fa888c00640 1 -- 172.21.15.37:0/2627873198 <== mon.2 v2:172.21.15.123:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9092+0+0 (secure 0 0 0) 0x7fa8840cfc00 con 0x7fa88c10bfc0 2024-09-11T23:17:21.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:21.850+0000 7fa88b400640 1 --2- 172.21.15.37:0/2627873198 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fa8700a2c10 0x7fa8700a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:21.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:21.850+0000 7fa88b400640 1 --2- 172.21.15.37:0/2627873198 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fa8700a2c10 0x7fa8700a50d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa87c0096c0 tx=0x7fa87c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:21.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:21.853+0000 7fa888c00640 1 -- 172.21.15.37:0/2627873198 <== mon.2 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa88409c640 con 0x7fa88c10bfc0 2024-09-11T23:17:22.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:22.039+0000 7fa891000640 1 -- 172.21.15.37:0/2627873198 --> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa88c101f50 con 0x7fa8700a2c10 2024-09-11T23:17:22.039 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:21 smithi037 ceph-mon[30630]: pgmap v337: 129 pgs: 129 active+clean; 632 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 4.2 KiB/s wr, 12 op/s 2024-09-11T23:17:22.039 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:21 smithi037 ceph-mon[30630]: from='client.14736 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T23:17:22.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:22.048+0000 7fa888c00640 1 -- 172.21.15.37:0/2627873198 <== mgr.14150 v2:172.21.15.37:6800/31543269 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340389 (secure 0 0 0) 0x7fa88c101f50 con 0x7fa8700a2c10 2024-09-11T23:17:22.051 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:17:22.052 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-11T23:17:22.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:22.053+0000 7fa891000640 1 -- 172.21.15.37:0/2627873198 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fa8700a2c10 msgr2=0x7fa8700a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:22.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:22.053+0000 7fa891000640 1 --2- 172.21.15.37:0/2627873198 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fa8700a2c10 0x7fa8700a50d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa87c0096c0 tx=0x7fa87c005a20 comp rx=0 tx=0).stop 2024-09-11T23:17:22.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:22.053+0000 7fa891000640 1 -- 172.21.15.37:0/2627873198 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa88c10bfc0 msgr2=0x7fa88c19ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:22.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:22.053+0000 7fa891000640 1 --2- 172.21.15.37:0/2627873198 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa88c10bfc0 0x7fa88c19ed40 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa884009fd0 tx=0x7fa88400ef10 comp rx=0 tx=0).stop 2024-09-11T23:17:22.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:22.053+0000 7fa891000640 1 -- 172.21.15.37:0/2627873198 shutdown_connections 2024-09-11T23:17:22.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:22.053+0000 7fa891000640 1 --2- 172.21.15.37:0/2627873198 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fa8700a2c10 0x7fa8700a50d0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:22.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:22.053+0000 7fa891000640 1 --2- 172.21.15.37:0/2627873198 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa88c10bfc0 0x7fa88c19ed40 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:22.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:22.053+0000 7fa891000640 1 --2- 172.21.15.37:0/2627873198 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa88c1034b0 0x7fa88c19a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:22.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:22.053+0000 7fa891000640 1 --2- 172.21.15.37:0/2627873198 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa88c102b90 0x7fa88c19a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:22.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:22.053+0000 7fa891000640 1 -- 172.21.15.37:0/2627873198 >> 172.21.15.37:0/2627873198 conn(0x7fa88c0fc610 msgr2=0x7fa88c10d2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:22.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:22.053+0000 7fa891000640 1 -- 172.21.15.37:0/2627873198 shutdown_connections 2024-09-11T23:17:22.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:22.053+0000 7fa891000640 1 -- 172.21.15.37:0/2627873198 wait complete. 2024-09-11T23:17:22.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:21 smithi160 ceph-mon[35055]: pgmap v337: 129 pgs: 129 active+clean; 632 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 4.2 KiB/s wr, 12 op/s 2024-09-11T23:17:22.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:21 smithi160 ceph-mon[35055]: from='client.14736 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T23:17:22.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:21 smithi123 ceph-mon[35438]: pgmap v337: 129 pgs: 129 active+clean; 632 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 4.2 KiB/s wr, 12 op/s 2024-09-11T23:17:22.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:21 smithi123 ceph-mon[35438]: from='client.14736 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T23:17:22.821 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":337,"stamp":"2024-09-11T23:17:20.041327+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":647301,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":309,"num_read_kb":260,"num_write":417,"num_write_kb":3064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":343,"ondisk_log_size":343,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":376376,"kb_used_data":14648,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124565448,"statfs":{"total":1151940427776,"available":1151555018752,"internally_reserved":0,"allocated":14999552,"data_stored":8295129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":370193721},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":40065,"num_objects":3,"num_object_clones":0,"num_object_copies":11,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":130,"num_read_kb":96,"num_write":24,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003085"},"pg_stats":[{"pgid":"2.1f","version":"93'13","reported_seq":66,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:17:14.768824+0000","last_change":"2024-09-11T23:16:12.460818+0000","last_active":"2024-09-11T23:17:14.768824+0000","last_peered":"2024-09-11T23:17:14.768824+0000","last_clean":"2024-09-11T23:17:14.768824+0000","last_became_active":"2024-09-11T23:16:12.460422+0000","last_became_peered":"2024-09-11T23:16:12.460422+0000","last_unstale":"2024-09-11T23:17:14.768824+0000","last_undegraded":"2024-09-11T23:17:14.768824+0000","last_fullsized":"2024-09-11T23:17:14.768824+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:56:55.785615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.667109+0000","last_change":"2024-09-11T23:16:15.493946+0000","last_active":"2024-09-11T23:16:53.667109+0000","last_peered":"2024-09-11T23:16:53.667109+0000","last_clean":"2024-09-11T23:16:53.667109+0000","last_became_active":"2024-09-11T23:16:15.493433+0000","last_became_peered":"2024-09-11T23:16:15.493433+0000","last_unstale":"2024-09-11T23:16:53.667109+0000","last_undegraded":"2024-09-11T23:16:53.667109+0000","last_fullsized":"2024-09-11T23:16:53.667109+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:47.700354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.764019+0000","last_change":"2024-09-11T23:16:23.550528+0000","last_active":"2024-09-11T23:16:53.764019+0000","last_peered":"2024-09-11T23:16:53.764019+0000","last_clean":"2024-09-11T23:16:53.764019+0000","last_became_active":"2024-09-11T23:16:23.550205+0000","last_became_peered":"2024-09-11T23:16:23.550205+0000","last_unstale":"2024-09-11T23:16:53.764019+0000","last_undegraded":"2024-09-11T23:16:53.764019+0000","last_fullsized":"2024-09-11T23:16:53.764019+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:28.318748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"93'2","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.667394+0000","last_change":"2024-09-11T23:16:12.633362+0000","last_active":"2024-09-11T23:16:53.667394+0000","last_peered":"2024-09-11T23:16:53.667394+0000","last_clean":"2024-09-11T23:16:53.667394+0000","last_became_active":"2024-09-11T23:16:12.632909+0000","last_became_peered":"2024-09-11T23:16:12.632909+0000","last_unstale":"2024-09-11T23:16:53.667394+0000","last_undegraded":"2024-09-11T23:16:53.667394+0000","last_fullsized":"2024-09-11T23:16:53.667394+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:08.533740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.672998+0000","last_change":"2024-09-11T23:16:15.499394+0000","last_active":"2024-09-11T23:16:53.672998+0000","last_peered":"2024-09-11T23:16:53.672998+0000","last_clean":"2024-09-11T23:16:53.672998+0000","last_became_active":"2024-09-11T23:16:15.499058+0000","last_became_peered":"2024-09-11T23:16:15.499058+0000","last_unstale":"2024-09-11T23:16:53.672998+0000","last_undegraded":"2024-09-11T23:16:53.672998+0000","last_fullsized":"2024-09-11T23:16:53.672998+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:05.361857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.927518+0000","last_change":"2024-09-11T23:16:23.543358+0000","last_active":"2024-09-11T23:16:53.927518+0000","last_peered":"2024-09-11T23:16:53.927518+0000","last_clean":"2024-09-11T23:16:53.927518+0000","last_became_active":"2024-09-11T23:16:23.542928+0000","last_became_peered":"2024-09-11T23:16:23.542928+0000","last_unstale":"2024-09-11T23:16:53.927518+0000","last_undegraded":"2024-09-11T23:16:53.927518+0000","last_fullsized":"2024-09-11T23:16:53.927518+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:36:36.570865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"93'12","reported_seq":52,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:17:03.748675+0000","last_change":"2024-09-11T23:16:12.461679+0000","last_active":"2024-09-11T23:17:03.748675+0000","last_peered":"2024-09-11T23:17:03.748675+0000","last_clean":"2024-09-11T23:17:03.748675+0000","last_became_active":"2024-09-11T23:16:12.461314+0000","last_became_peered":"2024-09-11T23:16:12.461314+0000","last_unstale":"2024-09-11T23:17:03.748675+0000","last_undegraded":"2024-09-11T23:17:03.748675+0000","last_fullsized":"2024-09-11T23:17:03.748675+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:01:13.352218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.671012+0000","last_change":"2024-09-11T23:16:15.488625+0000","last_active":"2024-09-11T23:16:53.671012+0000","last_peered":"2024-09-11T23:16:53.671012+0000","last_clean":"2024-09-11T23:16:53.671012+0000","last_became_active":"2024-09-11T23:16:15.487540+0000","last_became_peered":"2024-09-11T23:16:15.487540+0000","last_unstale":"2024-09-11T23:16:53.671012+0000","last_undegraded":"2024-09-11T23:16:53.671012+0000","last_fullsized":"2024-09-11T23:16:53.671012+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:54.962317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.928113+0000","last_change":"2024-09-11T23:16:23.544321+0000","last_active":"2024-09-11T23:16:53.928113+0000","last_peered":"2024-09-11T23:16:53.928113+0000","last_clean":"2024-09-11T23:16:53.928113+0000","last_became_active":"2024-09-11T23:16:23.543958+0000","last_became_peered":"2024-09-11T23:16:23.543958+0000","last_unstale":"2024-09-11T23:16:53.928113+0000","last_undegraded":"2024-09-11T23:16:53.928113+0000","last_fullsized":"2024-09-11T23:16:53.928113+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:40:46.510481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"93'5","reported_seq":45,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:17:02.745276+0000","last_change":"2024-09-11T23:16:12.462863+0000","last_active":"2024-09-11T23:17:02.745276+0000","last_peered":"2024-09-11T23:17:02.745276+0000","last_clean":"2024-09-11T23:17:02.745276+0000","last_became_active":"2024-09-11T23:16:12.462484+0000","last_became_peered":"2024-09-11T23:16:12.462484+0000","last_unstale":"2024-09-11T23:17:02.745276+0000","last_undegraded":"2024-09-11T23:17:02.745276+0000","last_fullsized":"2024-09-11T23:17:02.745276+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:13:22.170427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.665366+0000","last_change":"2024-09-11T23:16:15.487956+0000","last_active":"2024-09-11T23:16:53.665366+0000","last_peered":"2024-09-11T23:16:53.665366+0000","last_clean":"2024-09-11T23:16:53.665366+0000","last_became_active":"2024-09-11T23:16:15.487364+0000","last_became_peered":"2024-09-11T23:16:15.487364+0000","last_unstale":"2024-09-11T23:16:53.665366+0000","last_undegraded":"2024-09-11T23:16:53.665366+0000","last_fullsized":"2024-09-11T23:16:53.665366+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:47:10.488221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.927949+0000","last_change":"2024-09-11T23:16:23.541655+0000","last_active":"2024-09-11T23:16:53.927949+0000","last_peered":"2024-09-11T23:16:53.927949+0000","last_clean":"2024-09-11T23:16:53.927949+0000","last_became_active":"2024-09-11T23:16:23.541266+0000","last_became_peered":"2024-09-11T23:16:23.541266+0000","last_unstale":"2024-09-11T23:16:53.927949+0000","last_undegraded":"2024-09-11T23:16:53.927949+0000","last_fullsized":"2024-09-11T23:16:53.927949+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:09.497594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.668062+0000","last_change":"2024-09-11T23:16:15.489507+0000","last_active":"2024-09-11T23:16:53.668062+0000","last_peered":"2024-09-11T23:16:53.668062+0000","last_clean":"2024-09-11T23:16:53.668062+0000","last_became_active":"2024-09-11T23:16:15.489188+0000","last_became_peered":"2024-09-11T23:16:15.489188+0000","last_unstale":"2024-09-11T23:16:53.668062+0000","last_undegraded":"2024-09-11T23:16:53.668062+0000","last_fullsized":"2024-09-11T23:16:53.668062+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:07.530192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"93'4","reported_seq":44,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:59.720003+0000","last_change":"2024-09-11T23:16:12.465473+0000","last_active":"2024-09-11T23:16:59.720003+0000","last_peered":"2024-09-11T23:16:59.720003+0000","last_clean":"2024-09-11T23:16:59.720003+0000","last_became_active":"2024-09-11T23:16:12.465096+0000","last_became_peered":"2024-09-11T23:16:12.465096+0000","last_unstale":"2024-09-11T23:16:59.720003+0000","last_undegraded":"2024-09-11T23:16:59.720003+0000","last_fullsized":"2024-09-11T23:16:59.720003+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:27:22.739927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.928226+0000","last_change":"2024-09-11T23:16:23.555649+0000","last_active":"2024-09-11T23:16:53.928226+0000","last_peered":"2024-09-11T23:16:53.928226+0000","last_clean":"2024-09-11T23:16:53.928226+0000","last_became_active":"2024-09-11T23:16:23.555243+0000","last_became_peered":"2024-09-11T23:16:23.555243+0000","last_unstale":"2024-09-11T23:16:53.928226+0000","last_undegraded":"2024-09-11T23:16:53.928226+0000","last_fullsized":"2024-09-11T23:16:53.928226+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:07.514479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.666622+0000","last_change":"2024-09-11T23:16:15.490203+0000","last_active":"2024-09-11T23:16:53.666622+0000","last_peered":"2024-09-11T23:16:53.666622+0000","last_clean":"2024-09-11T23:16:53.666622+0000","last_became_active":"2024-09-11T23:16:15.489904+0000","last_became_peered":"2024-09-11T23:16:15.489904+0000","last_unstale":"2024-09-11T23:16:53.666622+0000","last_undegraded":"2024-09-11T23:16:53.666622+0000","last_fullsized":"2024-09-11T23:16:53.666622+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:20.291284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"93'3","reported_seq":41,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.735570+0000","last_change":"2024-09-11T23:16:12.465147+0000","last_active":"2024-09-11T23:17:01.735570+0000","last_peered":"2024-09-11T23:17:01.735570+0000","last_clean":"2024-09-11T23:17:01.735570+0000","last_became_active":"2024-09-11T23:16:12.464392+0000","last_became_peered":"2024-09-11T23:16:12.464392+0000","last_unstale":"2024-09-11T23:17:01.735570+0000","last_undegraded":"2024-09-11T23:17:01.735570+0000","last_fullsized":"2024-09-11T23:17:01.735570+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:21.515546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"93'1","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.928302+0000","last_change":"2024-09-11T23:16:23.535965+0000","last_active":"2024-09-11T23:16:53.928302+0000","last_peered":"2024-09-11T23:16:53.928302+0000","last_clean":"2024-09-11T23:16:53.928302+0000","last_became_active":"2024-09-11T23:16:23.535518+0000","last_became_peered":"2024-09-11T23:16:23.535518+0000","last_unstale":"2024-09-11T23:16:53.928302+0000","last_undegraded":"2024-09-11T23:16:53.928302+0000","last_fullsized":"2024-09-11T23:16:53.928302+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:37.406312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.927252+0000","last_change":"2024-09-11T23:16:15.489499+0000","last_active":"2024-09-11T23:16:53.927252+0000","last_peered":"2024-09-11T23:16:53.927252+0000","last_clean":"2024-09-11T23:16:53.927252+0000","last_became_active":"2024-09-11T23:16:15.489190+0000","last_became_peered":"2024-09-11T23:16:15.489190+0000","last_unstale":"2024-09-11T23:16:53.927252+0000","last_undegraded":"2024-09-11T23:16:53.927252+0000","last_fullsized":"2024-09-11T23:16:53.927252+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:01.845410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"93'7","reported_seq":45,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:17:02.745587+0000","last_change":"2024-09-11T23:16:12.461054+0000","last_active":"2024-09-11T23:17:02.745587+0000","last_peered":"2024-09-11T23:17:02.745587+0000","last_clean":"2024-09-11T23:17:02.745587+0000","last_became_active":"2024-09-11T23:16:12.460748+0000","last_became_peered":"2024-09-11T23:16:12.460748+0000","last_unstale":"2024-09-11T23:17:02.745587+0000","last_undegraded":"2024-09-11T23:17:02.745587+0000","last_fullsized":"2024-09-11T23:17:02.745587+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:35.710437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.671421+0000","last_change":"2024-09-11T23:16:23.543637+0000","last_active":"2024-09-11T23:16:53.671421+0000","last_peered":"2024-09-11T23:16:53.671421+0000","last_clean":"2024-09-11T23:16:53.671421+0000","last_became_active":"2024-09-11T23:16:23.542807+0000","last_became_peered":"2024-09-11T23:16:23.542807+0000","last_unstale":"2024-09-11T23:16:53.671421+0000","last_undegraded":"2024-09-11T23:16:53.671421+0000","last_fullsized":"2024-09-11T23:16:53.671421+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:08.559858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.667900+0000","last_change":"2024-09-11T23:16:15.485660+0000","last_active":"2024-09-11T23:16:53.667900+0000","last_peered":"2024-09-11T23:16:53.667900+0000","last_clean":"2024-09-11T23:16:53.667900+0000","last_became_active":"2024-09-11T23:16:15.485283+0000","last_became_peered":"2024-09-11T23:16:15.485283+0000","last_unstale":"2024-09-11T23:16:53.667900+0000","last_undegraded":"2024-09-11T23:16:53.667900+0000","last_fullsized":"2024-09-11T23:16:53.667900+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:20.105534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"93'2","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:59.720113+0000","last_change":"2024-09-11T23:16:12.633115+0000","last_active":"2024-09-11T23:16:59.720113+0000","last_peered":"2024-09-11T23:16:59.720113+0000","last_clean":"2024-09-11T23:16:59.720113+0000","last_became_active":"2024-09-11T23:16:12.632850+0000","last_became_peered":"2024-09-11T23:16:12.632850+0000","last_unstale":"2024-09-11T23:16:59.720113+0000","last_undegraded":"2024-09-11T23:16:59.720113+0000","last_fullsized":"2024-09-11T23:16:59.720113+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:16.709154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.928206+0000","last_change":"2024-09-11T23:16:23.556054+0000","last_active":"2024-09-11T23:16:53.928206+0000","last_peered":"2024-09-11T23:16:53.928206+0000","last_clean":"2024-09-11T23:16:53.928206+0000","last_became_active":"2024-09-11T23:16:23.555640+0000","last_became_peered":"2024-09-11T23:16:23.555640+0000","last_unstale":"2024-09-11T23:16:53.928206+0000","last_undegraded":"2024-09-11T23:16:53.928206+0000","last_fullsized":"2024-09-11T23:16:53.928206+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:23:32.360435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.677327+0000","last_change":"2024-09-11T23:16:53.677327+0000","last_active":"2024-09-11T23:16:53.677327+0000","last_peered":"2024-09-11T23:16:53.677327+0000","last_clean":"2024-09-11T23:16:53.677327+0000","last_became_active":"2024-09-11T23:16:53.677002+0000","last_became_peered":"2024-09-11T23:16:53.677002+0000","last_unstale":"2024-09-11T23:16:53.677327+0000","last_undegraded":"2024-09-11T23:16:53.677327+0000","last_fullsized":"2024-09-11T23:16:53.677327+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:22:48.495448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"93'7","reported_seq":45,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:17:02.745207+0000","last_change":"2024-09-11T23:16:13.161384+0000","last_active":"2024-09-11T23:17:02.745207+0000","last_peered":"2024-09-11T23:17:02.745207+0000","last_clean":"2024-09-11T23:17:02.745207+0000","last_became_active":"2024-09-11T23:16:13.161001+0000","last_became_peered":"2024-09-11T23:16:13.161001+0000","last_unstale":"2024-09-11T23:17:02.745207+0000","last_undegraded":"2024-09-11T23:17:02.745207+0000","last_fullsized":"2024-09-11T23:17:02.745207+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:17.421851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.764156+0000","last_change":"2024-09-11T23:16:23.539741+0000","last_active":"2024-09-11T23:16:53.764156+0000","last_peered":"2024-09-11T23:16:53.764156+0000","last_clean":"2024-09-11T23:16:53.764156+0000","last_became_active":"2024-09-11T23:16:23.539340+0000","last_became_peered":"2024-09-11T23:16:23.539340+0000","last_unstale":"2024-09-11T23:16:53.764156+0000","last_undegraded":"2024-09-11T23:16:53.764156+0000","last_fullsized":"2024-09-11T23:16:53.764156+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:22:41.272385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.668065+0000","last_change":"2024-09-11T23:16:15.483285+0000","last_active":"2024-09-11T23:16:53.668065+0000","last_peered":"2024-09-11T23:16:53.668065+0000","last_clean":"2024-09-11T23:16:53.668065+0000","last_became_active":"2024-09-11T23:16:15.482883+0000","last_became_peered":"2024-09-11T23:16:15.482883+0000","last_unstale":"2024-09-11T23:16:53.668065+0000","last_undegraded":"2024-09-11T23:16:53.668065+0000","last_fullsized":"2024-09-11T23:16:53.668065+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:49.979519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"93'11","reported_seq":50,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:17:12.490450+0000","last_change":"2024-09-11T23:16:12.460660+0000","last_active":"2024-09-11T23:17:12.490450+0000","last_peered":"2024-09-11T23:17:12.490450+0000","last_clean":"2024-09-11T23:17:12.490450+0000","last_became_active":"2024-09-11T23:16:12.460231+0000","last_became_peered":"2024-09-11T23:16:12.460231+0000","last_unstale":"2024-09-11T23:17:12.490450+0000","last_undegraded":"2024-09-11T23:17:12.490450+0000","last_fullsized":"2024-09-11T23:17:12.490450+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:21.839388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.666468+0000","last_change":"2024-09-11T23:16:23.556322+0000","last_active":"2024-09-11T23:16:53.666468+0000","last_peered":"2024-09-11T23:16:53.666468+0000","last_clean":"2024-09-11T23:16:53.666468+0000","last_became_active":"2024-09-11T23:16:23.555141+0000","last_became_peered":"2024-09-11T23:16:23.555141+0000","last_unstale":"2024-09-11T23:16:53.666468+0000","last_undegraded":"2024-09-11T23:16:53.666468+0000","last_fullsized":"2024-09-11T23:16:53.666468+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:55.778708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.664274+0000","last_change":"2024-09-11T23:16:15.490482+0000","last_active":"2024-09-11T23:16:53.664274+0000","last_peered":"2024-09-11T23:16:53.664274+0000","last_clean":"2024-09-11T23:16:53.664274+0000","last_became_active":"2024-09-11T23:16:15.490160+0000","last_became_peered":"2024-09-11T23:16:15.490160+0000","last_unstale":"2024-09-11T23:16:53.664274+0000","last_undegraded":"2024-09-11T23:16:53.664274+0000","last_fullsized":"2024-09-11T23:16:53.664274+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:58:40.588941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"93'4","reported_seq":44,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:17:02.745072+0000","last_change":"2024-09-11T23:16:12.634120+0000","last_active":"2024-09-11T23:17:02.745072+0000","last_peered":"2024-09-11T23:17:02.745072+0000","last_clean":"2024-09-11T23:17:02.745072+0000","last_became_active":"2024-09-11T23:16:12.633691+0000","last_became_peered":"2024-09-11T23:16:12.633691+0000","last_unstale":"2024-09-11T23:17:02.745072+0000","last_undegraded":"2024-09-11T23:17:02.745072+0000","last_fullsized":"2024-09-11T23:17:02.745072+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:21.577310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.927244+0000","last_change":"2024-09-11T23:16:23.545820+0000","last_active":"2024-09-11T23:16:53.927244+0000","last_peered":"2024-09-11T23:16:53.927244+0000","last_clean":"2024-09-11T23:16:53.927244+0000","last_became_active":"2024-09-11T23:16:23.545303+0000","last_became_peered":"2024-09-11T23:16:23.545303+0000","last_unstale":"2024-09-11T23:16:53.927244+0000","last_undegraded":"2024-09-11T23:16:53.927244+0000","last_fullsized":"2024-09-11T23:16:53.927244+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:52:28.969393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.667051+0000","last_change":"2024-09-11T23:16:15.497083+0000","last_active":"2024-09-11T23:16:53.667051+0000","last_peered":"2024-09-11T23:16:53.667051+0000","last_clean":"2024-09-11T23:16:53.667051+0000","last_became_active":"2024-09-11T23:16:15.496777+0000","last_became_peered":"2024-09-11T23:16:15.496777+0000","last_unstale":"2024-09-11T23:16:53.667051+0000","last_undegraded":"2024-09-11T23:16:53.667051+0000","last_fullsized":"2024-09-11T23:16:53.667051+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:14.456290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"93'1","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.670281+0000","last_change":"2024-09-11T23:16:12.633452+0000","last_active":"2024-09-11T23:16:53.670281+0000","last_peered":"2024-09-11T23:16:53.670281+0000","last_clean":"2024-09-11T23:16:53.670281+0000","last_became_active":"2024-09-11T23:16:12.633127+0000","last_became_peered":"2024-09-11T23:16:12.633127+0000","last_unstale":"2024-09-11T23:16:53.670281+0000","last_undegraded":"2024-09-11T23:16:53.670281+0000","last_fullsized":"2024-09-11T23:16:53.670281+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:37:07.269809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.667925+0000","last_change":"2024-09-11T23:16:23.555590+0000","last_active":"2024-09-11T23:16:53.667925+0000","last_peered":"2024-09-11T23:16:53.667925+0000","last_clean":"2024-09-11T23:16:53.667925+0000","last_became_active":"2024-09-11T23:16:23.555194+0000","last_became_peered":"2024-09-11T23:16:23.555194+0000","last_unstale":"2024-09-11T23:16:53.667925+0000","last_undegraded":"2024-09-11T23:16:53.667925+0000","last_fullsized":"2024-09-11T23:16:53.667925+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:36:50.069355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.667109+0000","last_change":"2024-09-11T23:16:15.498764+0000","last_active":"2024-09-11T23:16:53.667109+0000","last_peered":"2024-09-11T23:16:53.667109+0000","last_clean":"2024-09-11T23:16:53.667109+0000","last_became_active":"2024-09-11T23:16:15.498430+0000","last_became_peered":"2024-09-11T23:16:15.498430+0000","last_unstale":"2024-09-11T23:16:53.667109+0000","last_undegraded":"2024-09-11T23:16:53.667109+0000","last_fullsized":"2024-09-11T23:16:53.667109+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:28:44.899651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"93'6","reported_seq":62,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:17:17.773352+0000","last_change":"2024-09-11T23:16:12.456701+0000","last_active":"2024-09-11T23:17:17.773352+0000","last_peered":"2024-09-11T23:17:17.773352+0000","last_clean":"2024-09-11T23:17:17.773352+0000","last_became_active":"2024-09-11T23:16:12.456231+0000","last_became_peered":"2024-09-11T23:16:12.456231+0000","last_unstale":"2024-09-11T23:17:17.773352+0000","last_undegraded":"2024-09-11T23:17:17.773352+0000","last_fullsized":"2024-09-11T23:17:17.773352+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:02.372204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.664090+0000","last_change":"2024-09-11T23:16:23.550929+0000","last_active":"2024-09-11T23:16:53.664090+0000","last_peered":"2024-09-11T23:16:53.664090+0000","last_clean":"2024-09-11T23:16:53.664090+0000","last_became_active":"2024-09-11T23:16:23.550509+0000","last_became_peered":"2024-09-11T23:16:23.550509+0000","last_unstale":"2024-09-11T23:16:53.664090+0000","last_undegraded":"2024-09-11T23:16:53.664090+0000","last_fullsized":"2024-09-11T23:16:53.664090+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:53.112937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.765655+0000","last_change":"2024-09-11T23:16:53.765655+0000","last_active":"2024-09-11T23:16:53.765655+0000","last_peered":"2024-09-11T23:16:53.765655+0000","last_clean":"2024-09-11T23:16:53.765655+0000","last_became_active":"2024-09-11T23:16:53.765189+0000","last_became_peered":"2024-09-11T23:16:53.765189+0000","last_unstale":"2024-09-11T23:16:53.765655+0000","last_undegraded":"2024-09-11T23:16:53.765655+0000","last_fullsized":"2024-09-11T23:16:53.765655+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:13.142041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"93'5","reported_seq":62,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:17:17.770805+0000","last_change":"2024-09-11T23:16:12.633522+0000","last_active":"2024-09-11T23:17:17.770805+0000","last_peered":"2024-09-11T23:17:17.770805+0000","last_clean":"2024-09-11T23:17:17.770805+0000","last_became_active":"2024-09-11T23:16:12.633207+0000","last_became_peered":"2024-09-11T23:16:12.633207+0000","last_unstale":"2024-09-11T23:17:17.770805+0000","last_undegraded":"2024-09-11T23:17:17.770805+0000","last_fullsized":"2024-09-11T23:17:17.770805+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:08:29.565404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.664100+0000","last_change":"2024-09-11T23:16:23.557033+0000","last_active":"2024-09-11T23:16:53.664100+0000","last_peered":"2024-09-11T23:16:53.664100+0000","last_clean":"2024-09-11T23:16:53.664100+0000","last_became_active":"2024-09-11T23:16:23.555146+0000","last_became_peered":"2024-09-11T23:16:23.555146+0000","last_unstale":"2024-09-11T23:16:53.664100+0000","last_undegraded":"2024-09-11T23:16:53.664100+0000","last_fullsized":"2024-09-11T23:16:53.664100+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:22.460593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.663826+0000","last_change":"2024-09-11T23:16:15.487594+0000","last_active":"2024-09-11T23:16:53.663826+0000","last_peered":"2024-09-11T23:16:53.663826+0000","last_clean":"2024-09-11T23:16:53.663826+0000","last_became_active":"2024-09-11T23:16:15.487299+0000","last_became_peered":"2024-09-11T23:16:15.487299+0000","last_unstale":"2024-09-11T23:16:53.663826+0000","last_undegraded":"2024-09-11T23:16:53.663826+0000","last_fullsized":"2024-09-11T23:16:53.663826+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:32.531617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"93'4","reported_seq":42,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:17:00.729510+0000","last_change":"2024-09-11T23:16:12.464175+0000","last_active":"2024-09-11T23:17:00.729510+0000","last_peered":"2024-09-11T23:17:00.729510+0000","last_clean":"2024-09-11T23:17:00.729510+0000","last_became_active":"2024-09-11T23:16:12.463700+0000","last_became_peered":"2024-09-11T23:16:12.463700+0000","last_unstale":"2024-09-11T23:17:00.729510+0000","last_undegraded":"2024-09-11T23:17:00.729510+0000","last_fullsized":"2024-09-11T23:17:00.729510+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:35.784469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.665212+0000","last_change":"2024-09-11T23:16:23.555436+0000","last_active":"2024-09-11T23:16:53.665212+0000","last_peered":"2024-09-11T23:16:53.665212+0000","last_clean":"2024-09-11T23:16:53.665212+0000","last_became_active":"2024-09-11T23:16:23.555003+0000","last_became_peered":"2024-09-11T23:16:23.555003+0000","last_unstale":"2024-09-11T23:16:53.665212+0000","last_undegraded":"2024-09-11T23:16:53.665212+0000","last_fullsized":"2024-09-11T23:16:53.665212+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:39:18.810730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.675477+0000","last_change":"2024-09-11T23:16:53.674972+0000","last_active":"2024-09-11T23:16:53.675477+0000","last_peered":"2024-09-11T23:16:53.675477+0000","last_clean":"2024-09-11T23:16:53.675477+0000","last_became_active":"2024-09-11T23:16:53.674116+0000","last_became_peered":"2024-09-11T23:16:53.674116+0000","last_unstale":"2024-09-11T23:16:53.675477+0000","last_undegraded":"2024-09-11T23:16:53.675477+0000","last_fullsized":"2024-09-11T23:16:53.675477+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:03:32.615819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.3","version":"93'6","reported_seq":46,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:17:03.748368+0000","last_change":"2024-09-11T23:16:12.459491+0000","last_active":"2024-09-11T23:17:03.748368+0000","last_peered":"2024-09-11T23:17:03.748368+0000","last_clean":"2024-09-11T23:17:03.748368+0000","last_became_active":"2024-09-11T23:16:12.459106+0000","last_became_peered":"2024-09-11T23:16:12.459106+0000","last_unstale":"2024-09-11T23:17:03.748368+0000","last_undegraded":"2024-09-11T23:17:03.748368+0000","last_fullsized":"2024-09-11T23:17:03.748368+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:21.797304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":351,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.667712+0000","last_change":"2024-09-11T23:14:54.165458+0000","last_active":"2024-09-11T23:16:53.667712+0000","last_peered":"2024-09-11T23:16:53.667712+0000","last_clean":"2024-09-11T23:16:53.667712+0000","last_became_active":"2024-09-11T23:14:54.164935+0000","last_became_peered":"2024-09-11T23:14:54.164935+0000","last_unstale":"2024-09-11T23:16:53.667712+0000","last_undegraded":"2024-09-11T23:16:53.667712+0000","last_fullsized":"2024-09-11T23:16:53.667712+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:11:16.597789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:11:16.597789+0000","last_clean_scrub_stamp":"2024-09-11T23:11:16.597789+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:19.889271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"93'1","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.668492+0000","last_change":"2024-09-11T23:16:23.542921+0000","last_active":"2024-09-11T23:16:53.668492+0000","last_peered":"2024-09-11T23:16:53.668492+0000","last_clean":"2024-09-11T23:16:53.668492+0000","last_became_active":"2024-09-11T23:16:23.542424+0000","last_became_peered":"2024-09-11T23:16:23.542424+0000","last_unstale":"2024-09-11T23:16:53.668492+0000","last_undegraded":"2024-09-11T23:16:53.668492+0000","last_fullsized":"2024-09-11T23:16:53.668492+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:26:06.637721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.669182+0000","last_change":"2024-09-11T23:16:15.483724+0000","last_active":"2024-09-11T23:16:53.669182+0000","last_peered":"2024-09-11T23:16:53.669182+0000","last_clean":"2024-09-11T23:16:53.669182+0000","last_became_active":"2024-09-11T23:16:15.483371+0000","last_became_peered":"2024-09-11T23:16:15.483371+0000","last_unstale":"2024-09-11T23:16:53.669182+0000","last_undegraded":"2024-09-11T23:16:53.669182+0000","last_fullsized":"2024-09-11T23:16:53.669182+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:27:43.844805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"93'6","reported_seq":63,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:17:17.774185+0000","last_change":"2024-09-11T23:16:13.161358+0000","last_active":"2024-09-11T23:17:17.774185+0000","last_peered":"2024-09-11T23:17:17.774185+0000","last_clean":"2024-09-11T23:17:17.774185+0000","last_became_active":"2024-09-11T23:16:13.160856+0000","last_became_peered":"2024-09-11T23:16:13.160856+0000","last_unstale":"2024-09-11T23:17:17.774185+0000","last_undegraded":"2024-09-11T23:17:17.774185+0000","last_fullsized":"2024-09-11T23:17:17.774185+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:23:35.519588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1563,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":19,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.670708+0000","last_change":"2024-09-11T23:16:23.542098+0000","last_active":"2024-09-11T23:16:53.670708+0000","last_peered":"2024-09-11T23:16:53.670708+0000","last_clean":"2024-09-11T23:16:53.670708+0000","last_became_active":"2024-09-11T23:16:23.541714+0000","last_became_peered":"2024-09-11T23:16:23.541714+0000","last_unstale":"2024-09-11T23:16:53.670708+0000","last_undegraded":"2024-09-11T23:16:53.670708+0000","last_fullsized":"2024-09-11T23:16:53.670708+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:25:53.715886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.675655+0000","last_change":"2024-09-11T23:16:53.675655+0000","last_active":"2024-09-11T23:16:53.675655+0000","last_peered":"2024-09-11T23:16:53.675655+0000","last_clean":"2024-09-11T23:16:53.675655+0000","last_became_active":"2024-09-11T23:16:53.675277+0000","last_became_peered":"2024-09-11T23:16:53.675277+0000","last_unstale":"2024-09-11T23:16:53.675655+0000","last_undegraded":"2024-09-11T23:16:53.675655+0000","last_fullsized":"2024-09-11T23:16:53.675655+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:12.869820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"93'3","reported_seq":44,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:17:02.746087+0000","last_change":"2024-09-11T23:16:12.461590+0000","last_active":"2024-09-11T23:17:02.746087+0000","last_peered":"2024-09-11T23:17:02.746087+0000","last_clean":"2024-09-11T23:17:02.746087+0000","last_became_active":"2024-09-11T23:16:12.461195+0000","last_became_peered":"2024-09-11T23:16:12.461195+0000","last_unstale":"2024-09-11T23:17:02.746087+0000","last_undegraded":"2024-09-11T23:17:02.746087+0000","last_fullsized":"2024-09-11T23:17:02.746087+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:09.929080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.671452+0000","last_change":"2024-09-11T23:16:23.553809+0000","last_active":"2024-09-11T23:16:53.671452+0000","last_peered":"2024-09-11T23:16:53.671452+0000","last_clean":"2024-09-11T23:16:53.671452+0000","last_became_active":"2024-09-11T23:16:23.553248+0000","last_became_peered":"2024-09-11T23:16:23.553248+0000","last_unstale":"2024-09-11T23:16:53.671452+0000","last_undegraded":"2024-09-11T23:16:53.671452+0000","last_fullsized":"2024-09-11T23:16:53.671452+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:05.881682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.668423+0000","last_change":"2024-09-11T23:16:15.483337+0000","last_active":"2024-09-11T23:16:53.668423+0000","last_peered":"2024-09-11T23:16:53.668423+0000","last_clean":"2024-09-11T23:16:53.668423+0000","last_became_active":"2024-09-11T23:16:15.482892+0000","last_became_peered":"2024-09-11T23:16:15.482892+0000","last_unstale":"2024-09-11T23:16:53.668423+0000","last_undegraded":"2024-09-11T23:16:53.668423+0000","last_fullsized":"2024-09-11T23:16:53.668423+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:55.584889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"93'5","reported_seq":45,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:17:02.745765+0000","last_change":"2024-09-11T23:16:12.462527+0000","last_active":"2024-09-11T23:17:02.745765+0000","last_peered":"2024-09-11T23:17:02.745765+0000","last_clean":"2024-09-11T23:17:02.745765+0000","last_became_active":"2024-09-11T23:16:12.462133+0000","last_became_peered":"2024-09-11T23:16:12.462133+0000","last_unstale":"2024-09-11T23:17:02.745765+0000","last_undegraded":"2024-09-11T23:17:02.745765+0000","last_fullsized":"2024-09-11T23:17:02.745765+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:43.745587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.664523+0000","last_change":"2024-09-11T23:16:23.539430+0000","last_active":"2024-09-11T23:16:53.664523+0000","last_peered":"2024-09-11T23:16:53.664523+0000","last_clean":"2024-09-11T23:16:53.664523+0000","last_became_active":"2024-09-11T23:16:23.538995+0000","last_became_peered":"2024-09-11T23:16:23.538995+0000","last_unstale":"2024-09-11T23:16:53.664523+0000","last_undegraded":"2024-09-11T23:16:53.664523+0000","last_fullsized":"2024-09-11T23:16:53.664523+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:00:38.176669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.927549+0000","last_change":"2024-09-11T23:16:15.487497+0000","last_active":"2024-09-11T23:16:53.927549+0000","last_peered":"2024-09-11T23:16:53.927549+0000","last_clean":"2024-09-11T23:16:53.927549+0000","last_became_active":"2024-09-11T23:16:15.487180+0000","last_became_peered":"2024-09-11T23:16:15.487180+0000","last_unstale":"2024-09-11T23:16:53.927549+0000","last_undegraded":"2024-09-11T23:16:53.927549+0000","last_fullsized":"2024-09-11T23:16:53.927549+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:51.400029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"93'2","reported_seq":42,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.725509+0000","last_change":"2024-09-11T23:16:12.463098+0000","last_active":"2024-09-11T23:17:01.725509+0000","last_peered":"2024-09-11T23:17:01.725509+0000","last_clean":"2024-09-11T23:17:01.725509+0000","last_became_active":"2024-09-11T23:16:12.462798+0000","last_became_peered":"2024-09-11T23:16:12.462798+0000","last_unstale":"2024-09-11T23:17:01.725509+0000","last_undegraded":"2024-09-11T23:17:01.725509+0000","last_fullsized":"2024-09-11T23:17:01.725509+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:31.508172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.664679+0000","last_change":"2024-09-11T23:16:23.549141+0000","last_active":"2024-09-11T23:16:53.664679+0000","last_peered":"2024-09-11T23:16:53.664679+0000","last_clean":"2024-09-11T23:16:53.664679+0000","last_became_active":"2024-09-11T23:16:23.548731+0000","last_became_peered":"2024-09-11T23:16:23.548731+0000","last_unstale":"2024-09-11T23:16:53.664679+0000","last_undegraded":"2024-09-11T23:16:53.664679+0000","last_fullsized":"2024-09-11T23:16:53.664679+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:26.781082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.665096+0000","last_change":"2024-09-11T23:16:15.483597+0000","last_active":"2024-09-11T23:16:53.665096+0000","last_peered":"2024-09-11T23:16:53.665096+0000","last_clean":"2024-09-11T23:16:53.665096+0000","last_became_active":"2024-09-11T23:16:15.483192+0000","last_became_peered":"2024-09-11T23:16:15.483192+0000","last_unstale":"2024-09-11T23:16:53.665096+0000","last_undegraded":"2024-09-11T23:16:53.665096+0000","last_fullsized":"2024-09-11T23:16:53.665096+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:33.690922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"93'17","reported_seq":57,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:17:02.744290+0000","last_change":"2024-09-11T23:16:12.633804+0000","last_active":"2024-09-11T23:17:02.744290+0000","last_peered":"2024-09-11T23:17:02.744290+0000","last_clean":"2024-09-11T23:17:02.744290+0000","last_became_active":"2024-09-11T23:16:12.633405+0000","last_became_peered":"2024-09-11T23:16:12.633405+0000","last_unstale":"2024-09-11T23:17:02.744290+0000","last_undegraded":"2024-09-11T23:17:02.744290+0000","last_fullsized":"2024-09-11T23:17:02.744290+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:38.687359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.664214+0000","last_change":"2024-09-11T23:16:23.535084+0000","last_active":"2024-09-11T23:16:53.664214+0000","last_peered":"2024-09-11T23:16:53.664214+0000","last_clean":"2024-09-11T23:16:53.664214+0000","last_became_active":"2024-09-11T23:16:23.534613+0000","last_became_peered":"2024-09-11T23:16:23.534613+0000","last_unstale":"2024-09-11T23:16:53.664214+0000","last_undegraded":"2024-09-11T23:16:53.664214+0000","last_fullsized":"2024-09-11T23:16:53.664214+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:02:19.686195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.667378+0000","last_change":"2024-09-11T23:16:15.488379+0000","last_active":"2024-09-11T23:16:53.667378+0000","last_peered":"2024-09-11T23:16:53.667378+0000","last_clean":"2024-09-11T23:16:53.667378+0000","last_became_active":"2024-09-11T23:16:15.488057+0000","last_became_peered":"2024-09-11T23:16:15.488057+0000","last_unstale":"2024-09-11T23:16:53.667378+0000","last_undegraded":"2024-09-11T23:16:53.667378+0000","last_fullsized":"2024-09-11T23:16:53.667378+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:49:05.609717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"93'6","reported_seq":62,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:17:17.771338+0000","last_change":"2024-09-11T23:16:12.455466+0000","last_active":"2024-09-11T23:17:17.771338+0000","last_peered":"2024-09-11T23:17:17.771338+0000","last_clean":"2024-09-11T23:17:17.771338+0000","last_became_active":"2024-09-11T23:16:12.455149+0000","last_became_peered":"2024-09-11T23:16:12.455149+0000","last_unstale":"2024-09-11T23:17:17.771338+0000","last_undegraded":"2024-09-11T23:17:17.771338+0000","last_fullsized":"2024-09-11T23:17:17.771338+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:27.642229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":20,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.671574+0000","last_change":"2024-09-11T23:16:23.549435+0000","last_active":"2024-09-11T23:16:53.671574+0000","last_peered":"2024-09-11T23:16:53.671574+0000","last_clean":"2024-09-11T23:16:53.671574+0000","last_became_active":"2024-09-11T23:16:23.548974+0000","last_became_peered":"2024-09-11T23:16:23.548974+0000","last_unstale":"2024-09-11T23:16:53.671574+0000","last_undegraded":"2024-09-11T23:16:53.671574+0000","last_fullsized":"2024-09-11T23:16:53.671574+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:16.252974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.668285+0000","last_change":"2024-09-11T23:16:15.486521+0000","last_active":"2024-09-11T23:16:53.668285+0000","last_peered":"2024-09-11T23:16:53.668285+0000","last_clean":"2024-09-11T23:16:53.668285+0000","last_became_active":"2024-09-11T23:16:15.486206+0000","last_became_peered":"2024-09-11T23:16:15.486206+0000","last_unstale":"2024-09-11T23:16:53.668285+0000","last_undegraded":"2024-09-11T23:16:53.668285+0000","last_fullsized":"2024-09-11T23:16:53.668285+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:18.814215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"93'5","reported_seq":46,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:17:02.746129+0000","last_change":"2024-09-11T23:16:12.461530+0000","last_active":"2024-09-11T23:17:02.746129+0000","last_peered":"2024-09-11T23:17:02.746129+0000","last_clean":"2024-09-11T23:17:02.746129+0000","last_became_active":"2024-09-11T23:16:12.460059+0000","last_became_peered":"2024-09-11T23:16:12.460059+0000","last_unstale":"2024-09-11T23:17:02.746129+0000","last_undegraded":"2024-09-11T23:17:02.746129+0000","last_fullsized":"2024-09-11T23:17:02.746129+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:03.797156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.927283+0000","last_change":"2024-09-11T23:16:23.545969+0000","last_active":"2024-09-11T23:16:53.927283+0000","last_peered":"2024-09-11T23:16:53.927283+0000","last_clean":"2024-09-11T23:16:53.927283+0000","last_became_active":"2024-09-11T23:16:23.545458+0000","last_became_peered":"2024-09-11T23:16:23.545458+0000","last_unstale":"2024-09-11T23:16:53.927283+0000","last_undegraded":"2024-09-11T23:16:53.927283+0000","last_fullsized":"2024-09-11T23:16:53.927283+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:46.438353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.664069+0000","last_change":"2024-09-11T23:16:15.480940+0000","last_active":"2024-09-11T23:16:53.664069+0000","last_peered":"2024-09-11T23:16:53.664069+0000","last_clean":"2024-09-11T23:16:53.664069+0000","last_became_active":"2024-09-11T23:16:15.480549+0000","last_became_peered":"2024-09-11T23:16:15.480549+0000","last_unstale":"2024-09-11T23:16:53.664069+0000","last_undegraded":"2024-09-11T23:16:53.664069+0000","last_fullsized":"2024-09-11T23:16:53.664069+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:21:47.576800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"93'9","reported_seq":49,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:17:03.748224+0000","last_change":"2024-09-11T23:16:12.464871+0000","last_active":"2024-09-11T23:17:03.748224+0000","last_peered":"2024-09-11T23:17:03.748224+0000","last_clean":"2024-09-11T23:17:03.748224+0000","last_became_active":"2024-09-11T23:16:12.464364+0000","last_became_peered":"2024-09-11T23:16:12.464364+0000","last_unstale":"2024-09-11T23:17:03.748224+0000","last_undegraded":"2024-09-11T23:17:03.748224+0000","last_fullsized":"2024-09-11T23:17:03.748224+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:48:51.131314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.665253+0000","last_change":"2024-09-11T23:16:23.542318+0000","last_active":"2024-09-11T23:16:53.665253+0000","last_peered":"2024-09-11T23:16:53.665253+0000","last_clean":"2024-09-11T23:16:53.665253+0000","last_became_active":"2024-09-11T23:16:23.541873+0000","last_became_peered":"2024-09-11T23:16:23.541873+0000","last_unstale":"2024-09-11T23:16:53.665253+0000","last_undegraded":"2024-09-11T23:16:53.665253+0000","last_fullsized":"2024-09-11T23:16:53.665253+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:25.287539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.668314+0000","last_change":"2024-09-11T23:16:15.479692+0000","last_active":"2024-09-11T23:16:53.668314+0000","last_peered":"2024-09-11T23:16:53.668314+0000","last_clean":"2024-09-11T23:16:53.668314+0000","last_became_active":"2024-09-11T23:16:15.479370+0000","last_became_peered":"2024-09-11T23:16:15.479370+0000","last_unstale":"2024-09-11T23:16:53.668314+0000","last_undegraded":"2024-09-11T23:16:53.668314+0000","last_fullsized":"2024-09-11T23:16:53.668314+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:09.051394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"93'28","reported_seq":98,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:17:15.769669+0000","last_change":"2024-09-11T23:16:12.463137+0000","last_active":"2024-09-11T23:17:15.769669+0000","last_peered":"2024-09-11T23:17:15.769669+0000","last_clean":"2024-09-11T23:17:15.769669+0000","last_became_active":"2024-09-11T23:16:12.462795+0000","last_became_peered":"2024-09-11T23:16:12.462795+0000","last_unstale":"2024-09-11T23:17:15.769669+0000","last_undegraded":"2024-09-11T23:17:15.769669+0000","last_fullsized":"2024-09-11T23:17:15.769669+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:18.607151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49098,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":31,"num_read_kb":63,"num_write":30,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.671736+0000","last_change":"2024-09-11T23:16:23.540727+0000","last_active":"2024-09-11T23:16:53.671736+0000","last_peered":"2024-09-11T23:16:53.671736+0000","last_clean":"2024-09-11T23:16:53.671736+0000","last_became_active":"2024-09-11T23:16:23.537903+0000","last_became_peered":"2024-09-11T23:16:23.537903+0000","last_unstale":"2024-09-11T23:16:53.671736+0000","last_undegraded":"2024-09-11T23:16:53.671736+0000","last_fullsized":"2024-09-11T23:16:53.671736+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:25.357375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.673255+0000","last_change":"2024-09-11T23:16:53.673255+0000","last_active":"2024-09-11T23:16:53.673255+0000","last_peered":"2024-09-11T23:16:53.673255+0000","last_clean":"2024-09-11T23:16:53.673255+0000","last_became_active":"2024-09-11T23:16:53.672779+0000","last_became_peered":"2024-09-11T23:16:53.672779+0000","last_unstale":"2024-09-11T23:16:53.673255+0000","last_undegraded":"2024-09-11T23:16:53.673255+0000","last_fullsized":"2024-09-11T23:16:53.673255+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:48.377554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,7],"acting":[1,8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"93'5","reported_seq":46,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.735942+0000","last_change":"2024-09-11T23:16:12.634089+0000","last_active":"2024-09-11T23:17:01.735942+0000","last_peered":"2024-09-11T23:17:01.735942+0000","last_clean":"2024-09-11T23:17:01.735942+0000","last_became_active":"2024-09-11T23:16:12.633591+0000","last_became_peered":"2024-09-11T23:16:12.633591+0000","last_unstale":"2024-09-11T23:17:01.735942+0000","last_undegraded":"2024-09-11T23:17:01.735942+0000","last_fullsized":"2024-09-11T23:17:01.735942+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:48.647019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.927985+0000","last_change":"2024-09-11T23:16:23.539351+0000","last_active":"2024-09-11T23:16:53.927985+0000","last_peered":"2024-09-11T23:16:53.927985+0000","last_clean":"2024-09-11T23:16:53.927985+0000","last_became_active":"2024-09-11T23:16:23.538781+0000","last_became_peered":"2024-09-11T23:16:23.538781+0000","last_unstale":"2024-09-11T23:16:53.927985+0000","last_undegraded":"2024-09-11T23:16:53.927985+0000","last_fullsized":"2024-09-11T23:16:53.927985+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:11.384211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.673248+0000","last_change":"2024-09-11T23:16:53.673248+0000","last_active":"2024-09-11T23:16:53.673248+0000","last_peered":"2024-09-11T23:16:53.673248+0000","last_clean":"2024-09-11T23:16:53.673248+0000","last_became_active":"2024-09-11T23:16:53.672359+0000","last_became_peered":"2024-09-11T23:16:53.672359+0000","last_unstale":"2024-09-11T23:16:53.673248+0000","last_undegraded":"2024-09-11T23:16:53.673248+0000","last_fullsized":"2024-09-11T23:16:53.673248+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:52.841263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,5],"acting":[0,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"93'4","reported_seq":48,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:17:02.743702+0000","last_change":"2024-09-11T23:16:53.929781+0000","last_active":"2024-09-11T23:17:02.743702+0000","last_peered":"2024-09-11T23:17:02.743702+0000","last_clean":"2024-09-11T23:17:02.743702+0000","last_became_active":"2024-09-11T23:16:53.929313+0000","last_became_peered":"2024-09-11T23:16:53.929313+0000","last_unstale":"2024-09-11T23:17:02.743702+0000","last_undegraded":"2024-09-11T23:17:02.743702+0000","last_fullsized":"2024-09-11T23:17:02.743702+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:29:50.874721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.669414+0000","last_change":"2024-09-11T23:16:23.551090+0000","last_active":"2024-09-11T23:16:53.669414+0000","last_peered":"2024-09-11T23:16:53.669414+0000","last_clean":"2024-09-11T23:16:53.669414+0000","last_became_active":"2024-09-11T23:16:23.548558+0000","last_became_peered":"2024-09-11T23:16:23.548558+0000","last_unstale":"2024-09-11T23:16:53.669414+0000","last_undegraded":"2024-09-11T23:16:53.669414+0000","last_fullsized":"2024-09-11T23:16:53.669414+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:29:08.416426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.671750+0000","last_change":"2024-09-11T23:16:15.487741+0000","last_active":"2024-09-11T23:16:53.671750+0000","last_peered":"2024-09-11T23:16:53.671750+0000","last_clean":"2024-09-11T23:16:53.671750+0000","last_became_active":"2024-09-11T23:16:15.487410+0000","last_became_peered":"2024-09-11T23:16:15.487410+0000","last_unstale":"2024-09-11T23:16:53.671750+0000","last_undegraded":"2024-09-11T23:16:53.671750+0000","last_fullsized":"2024-09-11T23:16:53.671750+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:48:18.452521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"93'4","reported_seq":69,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:17:15.767621+0000","last_change":"2024-09-11T23:16:12.459784+0000","last_active":"2024-09-11T23:17:15.767621+0000","last_peered":"2024-09-11T23:17:15.767621+0000","last_clean":"2024-09-11T23:17:15.767621+0000","last_became_active":"2024-09-11T23:16:12.459440+0000","last_became_peered":"2024-09-11T23:16:12.459440+0000","last_unstale":"2024-09-11T23:17:15.767621+0000","last_undegraded":"2024-09-11T23:17:15.767621+0000","last_fullsized":"2024-09-11T23:17:15.767621+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:36.380446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.666802+0000","last_change":"2024-09-11T23:16:23.541323+0000","last_active":"2024-09-11T23:16:53.666802+0000","last_peered":"2024-09-11T23:16:53.666802+0000","last_clean":"2024-09-11T23:16:53.666802+0000","last_became_active":"2024-09-11T23:16:23.540912+0000","last_became_peered":"2024-09-11T23:16:23.540912+0000","last_unstale":"2024-09-11T23:16:53.666802+0000","last_undegraded":"2024-09-11T23:16:53.666802+0000","last_fullsized":"2024-09-11T23:16:53.666802+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:43.842799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.671465+0000","last_change":"2024-09-11T23:16:23.547579+0000","last_active":"2024-09-11T23:16:53.671465+0000","last_peered":"2024-09-11T23:16:53.671465+0000","last_clean":"2024-09-11T23:16:53.671465+0000","last_became_active":"2024-09-11T23:16:23.547182+0000","last_became_peered":"2024-09-11T23:16:23.547182+0000","last_unstale":"2024-09-11T23:16:53.671465+0000","last_undegraded":"2024-09-11T23:16:53.671465+0000","last_fullsized":"2024-09-11T23:16:53.671465+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:29.471671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.670025+0000","last_change":"2024-09-11T23:16:15.482342+0000","last_active":"2024-09-11T23:16:53.670025+0000","last_peered":"2024-09-11T23:16:53.670025+0000","last_clean":"2024-09-11T23:16:53.670025+0000","last_became_active":"2024-09-11T23:16:15.481993+0000","last_became_peered":"2024-09-11T23:16:15.481993+0000","last_unstale":"2024-09-11T23:16:53.670025+0000","last_undegraded":"2024-09-11T23:16:53.670025+0000","last_fullsized":"2024-09-11T23:16:53.670025+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:11.432932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"93'3","reported_seq":44,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:17:02.744829+0000","last_change":"2024-09-11T23:16:12.460852+0000","last_active":"2024-09-11T23:17:02.744829+0000","last_peered":"2024-09-11T23:17:02.744829+0000","last_clean":"2024-09-11T23:17:02.744829+0000","last_became_active":"2024-09-11T23:16:12.460500+0000","last_became_peered":"2024-09-11T23:16:12.460500+0000","last_unstale":"2024-09-11T23:17:02.744829+0000","last_undegraded":"2024-09-11T23:17:02.744829+0000","last_fullsized":"2024-09-11T23:17:02.744829+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:36.996441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.927538+0000","last_change":"2024-09-11T23:16:23.548465+0000","last_active":"2024-09-11T23:16:53.927538+0000","last_peered":"2024-09-11T23:16:53.927538+0000","last_clean":"2024-09-11T23:16:53.927538+0000","last_became_active":"2024-09-11T23:16:23.548121+0000","last_became_peered":"2024-09-11T23:16:23.548121+0000","last_unstale":"2024-09-11T23:16:53.927538+0000","last_undegraded":"2024-09-11T23:16:53.927538+0000","last_fullsized":"2024-09-11T23:16:53.927538+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:32:43.950947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.666854+0000","last_change":"2024-09-11T23:16:15.482202+0000","last_active":"2024-09-11T23:16:53.666854+0000","last_peered":"2024-09-11T23:16:53.666854+0000","last_clean":"2024-09-11T23:16:53.666854+0000","last_became_active":"2024-09-11T23:16:15.481817+0000","last_became_peered":"2024-09-11T23:16:15.481817+0000","last_unstale":"2024-09-11T23:16:53.666854+0000","last_undegraded":"2024-09-11T23:16:53.666854+0000","last_fullsized":"2024-09-11T23:16:53.666854+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:30.309241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"93'3","reported_seq":43,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:17:00.730060+0000","last_change":"2024-09-11T23:16:12.460729+0000","last_active":"2024-09-11T23:17:00.730060+0000","last_peered":"2024-09-11T23:17:00.730060+0000","last_clean":"2024-09-11T23:17:00.730060+0000","last_became_active":"2024-09-11T23:16:12.460319+0000","last_became_peered":"2024-09-11T23:16:12.460319+0000","last_unstale":"2024-09-11T23:17:00.730060+0000","last_undegraded":"2024-09-11T23:17:00.730060+0000","last_fullsized":"2024-09-11T23:17:00.730060+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:45:20.901191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"93'7","reported_seq":46,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:17:01.736897+0000","last_change":"2024-09-11T23:16:12.455617+0000","last_active":"2024-09-11T23:17:01.736897+0000","last_peered":"2024-09-11T23:17:01.736897+0000","last_clean":"2024-09-11T23:17:01.736897+0000","last_became_active":"2024-09-11T23:16:12.455159+0000","last_became_peered":"2024-09-11T23:16:12.455159+0000","last_unstale":"2024-09-11T23:17:01.736897+0000","last_undegraded":"2024-09-11T23:17:01.736897+0000","last_fullsized":"2024-09-11T23:17:01.736897+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:04:19.956580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.664946+0000","last_change":"2024-09-11T23:16:15.496026+0000","last_active":"2024-09-11T23:16:53.664946+0000","last_peered":"2024-09-11T23:16:53.664946+0000","last_clean":"2024-09-11T23:16:53.664946+0000","last_became_active":"2024-09-11T23:16:15.495785+0000","last_became_peered":"2024-09-11T23:16:15.495785+0000","last_unstale":"2024-09-11T23:16:53.664946+0000","last_undegraded":"2024-09-11T23:16:53.664946+0000","last_fullsized":"2024-09-11T23:16:53.664946+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:11:33.613170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.764170+0000","last_change":"2024-09-11T23:16:23.545144+0000","last_active":"2024-09-11T23:16:53.764170+0000","last_peered":"2024-09-11T23:16:53.764170+0000","last_clean":"2024-09-11T23:16:53.764170+0000","last_became_active":"2024-09-11T23:16:23.544702+0000","last_became_peered":"2024-09-11T23:16:23.544702+0000","last_unstale":"2024-09-11T23:16:53.764170+0000","last_undegraded":"2024-09-11T23:16:53.764170+0000","last_fullsized":"2024-09-11T23:16:53.764170+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:35:39.155913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"93'5","reported_seq":63,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:17:17.770854+0000","last_change":"2024-09-11T23:16:12.464182+0000","last_active":"2024-09-11T23:17:17.770854+0000","last_peered":"2024-09-11T23:17:17.770854+0000","last_clean":"2024-09-11T23:17:17.770854+0000","last_became_active":"2024-09-11T23:16:12.463835+0000","last_became_peered":"2024-09-11T23:16:12.463835+0000","last_unstale":"2024-09-11T23:17:17.770854+0000","last_undegraded":"2024-09-11T23:17:17.770854+0000","last_fullsized":"2024-09-11T23:17:17.770854+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:34:51.682457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.674740+0000","last_change":"2024-09-11T23:16:53.674740+0000","last_active":"2024-09-11T23:16:53.674740+0000","last_peered":"2024-09-11T23:16:53.674740+0000","last_clean":"2024-09-11T23:16:53.674740+0000","last_became_active":"2024-09-11T23:16:53.674285+0000","last_became_peered":"2024-09-11T23:16:53.674285+0000","last_unstale":"2024-09-11T23:16:53.674740+0000","last_undegraded":"2024-09-11T23:16:53.674740+0000","last_fullsized":"2024-09-11T23:16:53.674740+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:08.762810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6],"acting":[8,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.764397+0000","last_change":"2024-09-11T23:16:23.540185+0000","last_active":"2024-09-11T23:16:53.764397+0000","last_peered":"2024-09-11T23:16:53.764397+0000","last_clean":"2024-09-11T23:16:53.764397+0000","last_became_active":"2024-09-11T23:16:23.539760+0000","last_became_peered":"2024-09-11T23:16:23.539760+0000","last_unstale":"2024-09-11T23:16:53.764397+0000","last_undegraded":"2024-09-11T23:16:53.764397+0000","last_fullsized":"2024-09-11T23:16:53.764397+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:40.944999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.927205+0000","last_change":"2024-09-11T23:16:15.489240+0000","last_active":"2024-09-11T23:16:53.927205+0000","last_peered":"2024-09-11T23:16:53.927205+0000","last_clean":"2024-09-11T23:16:53.927205+0000","last_became_active":"2024-09-11T23:16:15.488878+0000","last_became_peered":"2024-09-11T23:16:15.488878+0000","last_unstale":"2024-09-11T23:16:53.927205+0000","last_undegraded":"2024-09-11T23:16:53.927205+0000","last_fullsized":"2024-09-11T23:16:53.927205+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:38.076935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.764380+0000","last_change":"2024-09-11T23:16:15.486369+0000","last_active":"2024-09-11T23:16:53.764380+0000","last_peered":"2024-09-11T23:16:53.764380+0000","last_clean":"2024-09-11T23:16:53.764380+0000","last_became_active":"2024-09-11T23:16:15.486055+0000","last_became_peered":"2024-09-11T23:16:15.486055+0000","last_unstale":"2024-09-11T23:16:53.764380+0000","last_undegraded":"2024-09-11T23:16:53.764380+0000","last_fullsized":"2024-09-11T23:16:53.764380+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:16.233578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.764033+0000","last_change":"2024-09-11T23:16:15.484981+0000","last_active":"2024-09-11T23:16:53.764033+0000","last_peered":"2024-09-11T23:16:53.764033+0000","last_clean":"2024-09-11T23:16:53.764033+0000","last_became_active":"2024-09-11T23:16:15.484640+0000","last_became_peered":"2024-09-11T23:16:15.484640+0000","last_unstale":"2024-09-11T23:16:53.764033+0000","last_undegraded":"2024-09-11T23:16:53.764033+0000","last_fullsized":"2024-09-11T23:16:53.764033+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:32.844009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.671522+0000","last_change":"2024-09-11T23:16:15.488570+0000","last_active":"2024-09-11T23:16:53.671522+0000","last_peered":"2024-09-11T23:16:53.671522+0000","last_clean":"2024-09-11T23:16:53.671522+0000","last_became_active":"2024-09-11T23:16:15.487932+0000","last_became_peered":"2024-09-11T23:16:15.487932+0000","last_unstale":"2024-09-11T23:16:53.671522+0000","last_undegraded":"2024-09-11T23:16:53.671522+0000","last_fullsized":"2024-09-11T23:16:53.671522+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:14.062864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.664248+0000","last_change":"2024-09-11T23:16:15.499493+0000","last_active":"2024-09-11T23:16:53.664248+0000","last_peered":"2024-09-11T23:16:53.664248+0000","last_clean":"2024-09-11T23:16:53.664248+0000","last_became_active":"2024-09-11T23:16:15.499150+0000","last_became_peered":"2024-09-11T23:16:15.499150+0000","last_unstale":"2024-09-11T23:16:53.664248+0000","last_undegraded":"2024-09-11T23:16:53.664248+0000","last_fullsized":"2024-09-11T23:16:53.664248+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:52.538614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.927524+0000","last_change":"2024-09-11T23:16:15.484214+0000","last_active":"2024-09-11T23:16:53.927524+0000","last_peered":"2024-09-11T23:16:53.927524+0000","last_clean":"2024-09-11T23:16:53.927524+0000","last_became_active":"2024-09-11T23:16:15.483911+0000","last_became_peered":"2024-09-11T23:16:15.483911+0000","last_unstale":"2024-09-11T23:16:53.927524+0000","last_undegraded":"2024-09-11T23:16:53.927524+0000","last_fullsized":"2024-09-11T23:16:53.927524+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:19:12.283255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.764671+0000","last_change":"2024-09-11T23:16:15.488454+0000","last_active":"2024-09-11T23:16:53.764671+0000","last_peered":"2024-09-11T23:16:53.764671+0000","last_clean":"2024-09-11T23:16:53.764671+0000","last_became_active":"2024-09-11T23:16:15.488071+0000","last_became_peered":"2024-09-11T23:16:15.488071+0000","last_unstale":"2024-09-11T23:16:53.764671+0000","last_undegraded":"2024-09-11T23:16:53.764671+0000","last_fullsized":"2024-09-11T23:16:53.764671+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:31.249057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.667972+0000","last_change":"2024-09-11T23:16:15.489743+0000","last_active":"2024-09-11T23:16:53.667972+0000","last_peered":"2024-09-11T23:16:53.667972+0000","last_clean":"2024-09-11T23:16:53.667972+0000","last_became_active":"2024-09-11T23:16:15.489411+0000","last_became_peered":"2024-09-11T23:16:15.489411+0000","last_unstale":"2024-09-11T23:16:53.667972+0000","last_undegraded":"2024-09-11T23:16:53.667972+0000","last_fullsized":"2024-09-11T23:16:53.667972+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:09.912448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.664733+0000","last_change":"2024-09-11T23:16:15.494906+0000","last_active":"2024-09-11T23:16:53.664733+0000","last_peered":"2024-09-11T23:16:53.664733+0000","last_clean":"2024-09-11T23:16:53.664733+0000","last_became_active":"2024-09-11T23:16:15.494567+0000","last_became_peered":"2024-09-11T23:16:15.494567+0000","last_unstale":"2024-09-11T23:16:53.664733+0000","last_undegraded":"2024-09-11T23:16:53.664733+0000","last_fullsized":"2024-09-11T23:16:53.664733+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:22.364551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.667162+0000","last_change":"2024-09-11T23:16:15.489363+0000","last_active":"2024-09-11T23:16:53.667162+0000","last_peered":"2024-09-11T23:16:53.667162+0000","last_clean":"2024-09-11T23:16:53.667162+0000","last_became_active":"2024-09-11T23:16:15.489056+0000","last_became_peered":"2024-09-11T23:16:15.489056+0000","last_unstale":"2024-09-11T23:16:53.667162+0000","last_undegraded":"2024-09-11T23:16:53.667162+0000","last_fullsized":"2024-09-11T23:16:53.667162+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:37:37.152715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.671048+0000","last_change":"2024-09-11T23:16:15.483283+0000","last_active":"2024-09-11T23:16:53.671048+0000","last_peered":"2024-09-11T23:16:53.671048+0000","last_clean":"2024-09-11T23:16:53.671048+0000","last_became_active":"2024-09-11T23:16:15.481463+0000","last_became_peered":"2024-09-11T23:16:15.481463+0000","last_unstale":"2024-09-11T23:16:53.671048+0000","last_undegraded":"2024-09-11T23:16:53.671048+0000","last_fullsized":"2024-09-11T23:16:53.671048+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:37.484644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.664318+0000","last_change":"2024-09-11T23:16:15.487478+0000","last_active":"2024-09-11T23:16:53.664318+0000","last_peered":"2024-09-11T23:16:53.664318+0000","last_clean":"2024-09-11T23:16:53.664318+0000","last_became_active":"2024-09-11T23:16:15.487115+0000","last_became_peered":"2024-09-11T23:16:15.487115+0000","last_unstale":"2024-09-11T23:16:53.664318+0000","last_undegraded":"2024-09-11T23:16:53.664318+0000","last_fullsized":"2024-09-11T23:16:53.664318+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:34.967388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.927320+0000","last_change":"2024-09-11T23:16:15.486593+0000","last_active":"2024-09-11T23:16:53.927320+0000","last_peered":"2024-09-11T23:16:53.927320+0000","last_clean":"2024-09-11T23:16:53.927320+0000","last_became_active":"2024-09-11T23:16:15.486282+0000","last_became_peered":"2024-09-11T23:16:15.486282+0000","last_unstale":"2024-09-11T23:16:53.927320+0000","last_undegraded":"2024-09-11T23:16:53.927320+0000","last_fullsized":"2024-09-11T23:16:53.927320+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:33.845679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.764638+0000","last_change":"2024-09-11T23:16:15.488330+0000","last_active":"2024-09-11T23:16:53.764638+0000","last_peered":"2024-09-11T23:16:53.764638+0000","last_clean":"2024-09-11T23:16:53.764638+0000","last_became_active":"2024-09-11T23:16:15.488005+0000","last_became_peered":"2024-09-11T23:16:15.488005+0000","last_unstale":"2024-09-11T23:16:53.764638+0000","last_undegraded":"2024-09-11T23:16:53.764638+0000","last_fullsized":"2024-09-11T23:16:53.764638+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:12.189988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.671148+0000","last_change":"2024-09-11T23:16:15.486251+0000","last_active":"2024-09-11T23:16:53.671148+0000","last_peered":"2024-09-11T23:16:53.671148+0000","last_clean":"2024-09-11T23:16:53.671148+0000","last_became_active":"2024-09-11T23:16:15.485937+0000","last_became_peered":"2024-09-11T23:16:15.485937+0000","last_unstale":"2024-09-11T23:16:53.671148+0000","last_undegraded":"2024-09-11T23:16:53.671148+0000","last_fullsized":"2024-09-11T23:16:53.671148+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:32:01.829834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.927685+0000","last_change":"2024-09-11T23:16:15.488635+0000","last_active":"2024-09-11T23:16:53.927685+0000","last_peered":"2024-09-11T23:16:53.927685+0000","last_clean":"2024-09-11T23:16:53.927685+0000","last_became_active":"2024-09-11T23:16:15.488326+0000","last_became_peered":"2024-09-11T23:16:15.488326+0000","last_unstale":"2024-09-11T23:16:53.927685+0000","last_undegraded":"2024-09-11T23:16:53.927685+0000","last_fullsized":"2024-09-11T23:16:53.927685+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:25.626349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.679440+0000","last_change":"2024-09-11T23:16:53.676716+0000","last_active":"2024-09-11T23:16:53.679440+0000","last_peered":"2024-09-11T23:16:53.679440+0000","last_clean":"2024-09-11T23:16:53.679440+0000","last_became_active":"2024-09-11T23:16:53.674056+0000","last_became_peered":"2024-09-11T23:16:53.674056+0000","last_unstale":"2024-09-11T23:16:53.679440+0000","last_undegraded":"2024-09-11T23:16:53.679440+0000","last_fullsized":"2024-09-11T23:16:53.679440+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:49:44.258607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0],"acting":[9,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.671693+0000","last_change":"2024-09-11T23:16:15.487550+0000","last_active":"2024-09-11T23:16:53.671693+0000","last_peered":"2024-09-11T23:16:53.671693+0000","last_clean":"2024-09-11T23:16:53.671693+0000","last_became_active":"2024-09-11T23:16:15.487197+0000","last_became_peered":"2024-09-11T23:16:15.487197+0000","last_unstale":"2024-09-11T23:16:53.671693+0000","last_undegraded":"2024-09-11T23:16:53.671693+0000","last_fullsized":"2024-09-11T23:16:53.671693+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:51.899470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.670834+0000","last_change":"2024-09-11T23:16:15.493106+0000","last_active":"2024-09-11T23:16:53.670834+0000","last_peered":"2024-09-11T23:16:53.670834+0000","last_clean":"2024-09-11T23:16:53.670834+0000","last_became_active":"2024-09-11T23:16:15.492649+0000","last_became_peered":"2024-09-11T23:16:15.492649+0000","last_unstale":"2024-09-11T23:16:53.670834+0000","last_undegraded":"2024-09-11T23:16:53.670834+0000","last_fullsized":"2024-09-11T23:16:53.670834+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:37.584557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.664285+0000","last_change":"2024-09-11T23:16:15.485444+0000","last_active":"2024-09-11T23:16:53.664285+0000","last_peered":"2024-09-11T23:16:53.664285+0000","last_clean":"2024-09-11T23:16:53.664285+0000","last_became_active":"2024-09-11T23:16:15.484985+0000","last_became_peered":"2024-09-11T23:16:15.484985+0000","last_unstale":"2024-09-11T23:16:53.664285+0000","last_undegraded":"2024-09-11T23:16:53.664285+0000","last_fullsized":"2024-09-11T23:16:53.664285+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:42:38.827500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.928603+0000","last_change":"2024-09-11T23:16:15.488819+0000","last_active":"2024-09-11T23:16:53.928603+0000","last_peered":"2024-09-11T23:16:53.928603+0000","last_clean":"2024-09-11T23:16:53.928603+0000","last_became_active":"2024-09-11T23:16:15.488484+0000","last_became_peered":"2024-09-11T23:16:15.488484+0000","last_unstale":"2024-09-11T23:16:53.928603+0000","last_undegraded":"2024-09-11T23:16:53.928603+0000","last_fullsized":"2024-09-11T23:16:53.928603+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:11.548909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.669104+0000","last_change":"2024-09-11T23:16:15.490369+0000","last_active":"2024-09-11T23:16:53.669104+0000","last_peered":"2024-09-11T23:16:53.669104+0000","last_clean":"2024-09-11T23:16:53.669104+0000","last_became_active":"2024-09-11T23:16:15.489977+0000","last_became_peered":"2024-09-11T23:16:15.489977+0000","last_unstale":"2024-09-11T23:16:53.669104+0000","last_undegraded":"2024-09-11T23:16:53.669104+0000","last_fullsized":"2024-09-11T23:16:53.669104+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:17.161073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.667680+0000","last_change":"2024-09-11T23:16:15.486820+0000","last_active":"2024-09-11T23:16:53.667680+0000","last_peered":"2024-09-11T23:16:53.667680+0000","last_clean":"2024-09-11T23:16:53.667680+0000","last_became_active":"2024-09-11T23:16:15.486259+0000","last_became_peered":"2024-09-11T23:16:15.486259+0000","last_unstale":"2024-09-11T23:16:53.667680+0000","last_undegraded":"2024-09-11T23:16:53.667680+0000","last_fullsized":"2024-09-11T23:16:53.667680+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:11.156989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.671947+0000","last_change":"2024-09-11T23:16:15.482432+0000","last_active":"2024-09-11T23:16:53.671947+0000","last_peered":"2024-09-11T23:16:53.671947+0000","last_clean":"2024-09-11T23:16:53.671947+0000","last_became_active":"2024-09-11T23:16:15.481930+0000","last_became_peered":"2024-09-11T23:16:15.481930+0000","last_unstale":"2024-09-11T23:16:53.671947+0000","last_undegraded":"2024-09-11T23:16:53.671947+0000","last_fullsized":"2024-09-11T23:16:53.671947+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:03.156829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.670447+0000","last_change":"2024-09-11T23:16:53.670447+0000","last_active":"2024-09-11T23:16:53.670447+0000","last_peered":"2024-09-11T23:16:53.670447+0000","last_clean":"2024-09-11T23:16:53.670447+0000","last_became_active":"2024-09-11T23:16:53.670084+0000","last_became_peered":"2024-09-11T23:16:53.670084+0000","last_unstale":"2024-09-11T23:16:53.670447+0000","last_undegraded":"2024-09-11T23:16:53.670447+0000","last_fullsized":"2024-09-11T23:16:53.670447+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:25.603908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,8,10],"acting":[3,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.667926+0000","last_change":"2024-09-11T23:16:15.492210+0000","last_active":"2024-09-11T23:16:53.667926+0000","last_peered":"2024-09-11T23:16:53.667926+0000","last_clean":"2024-09-11T23:16:53.667926+0000","last_became_active":"2024-09-11T23:16:15.491333+0000","last_became_peered":"2024-09-11T23:16:15.491333+0000","last_unstale":"2024-09-11T23:16:53.667926+0000","last_undegraded":"2024-09-11T23:16:53.667926+0000","last_fullsized":"2024-09-11T23:16:53.667926+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:52.824085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.667134+0000","last_change":"2024-09-11T23:16:15.489798+0000","last_active":"2024-09-11T23:16:53.667134+0000","last_peered":"2024-09-11T23:16:53.667134+0000","last_clean":"2024-09-11T23:16:53.667134+0000","last_became_active":"2024-09-11T23:16:15.489357+0000","last_became_peered":"2024-09-11T23:16:15.489357+0000","last_unstale":"2024-09-11T23:16:53.667134+0000","last_undegraded":"2024-09-11T23:16:53.667134+0000","last_fullsized":"2024-09-11T23:16:53.667134+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:13:53.460349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.668009+0000","last_change":"2024-09-11T23:16:15.480192+0000","last_active":"2024-09-11T23:16:53.668009+0000","last_peered":"2024-09-11T23:16:53.668009+0000","last_clean":"2024-09-11T23:16:53.668009+0000","last_became_active":"2024-09-11T23:16:15.479884+0000","last_became_peered":"2024-09-11T23:16:15.479884+0000","last_unstale":"2024-09-11T23:16:53.668009+0000","last_undegraded":"2024-09-11T23:16:53.668009+0000","last_fullsized":"2024-09-11T23:16:53.668009+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:24:34.765550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.928585+0000","last_change":"2024-09-11T23:16:15.483444+0000","last_active":"2024-09-11T23:16:53.928585+0000","last_peered":"2024-09-11T23:16:53.928585+0000","last_clean":"2024-09-11T23:16:53.928585+0000","last_became_active":"2024-09-11T23:16:15.483006+0000","last_became_peered":"2024-09-11T23:16:15.483006+0000","last_unstale":"2024-09-11T23:16:53.928585+0000","last_undegraded":"2024-09-11T23:16:53.928585+0000","last_fullsized":"2024-09-11T23:16:53.928585+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:19:11.855417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.672073+0000","last_change":"2024-09-11T23:16:15.497823+0000","last_active":"2024-09-11T23:16:53.672073+0000","last_peered":"2024-09-11T23:16:53.672073+0000","last_clean":"2024-09-11T23:16:53.672073+0000","last_became_active":"2024-09-11T23:16:15.493688+0000","last_became_peered":"2024-09-11T23:16:15.493688+0000","last_unstale":"2024-09-11T23:16:53.672073+0000","last_undegraded":"2024-09-11T23:16:53.672073+0000","last_fullsized":"2024-09-11T23:16:53.672073+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:50:35.055108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.672251+0000","last_change":"2024-09-11T23:16:15.497942+0000","last_active":"2024-09-11T23:16:53.672251+0000","last_peered":"2024-09-11T23:16:53.672251+0000","last_clean":"2024-09-11T23:16:53.672251+0000","last_became_active":"2024-09-11T23:16:15.492467+0000","last_became_peered":"2024-09-11T23:16:15.492467+0000","last_unstale":"2024-09-11T23:16:53.672251+0000","last_undegraded":"2024-09-11T23:16:53.672251+0000","last_fullsized":"2024-09-11T23:16:53.672251+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:16.156174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T23:16:53.927657+0000","last_change":"2024-09-11T23:16:15.488477+0000","last_active":"2024-09-11T23:16:53.927657+0000","last_peered":"2024-09-11T23:16:53.927657+0000","last_clean":"2024-09-11T23:16:53.927657+0000","last_became_active":"2024-09-11T23:16:15.488169+0000","last_became_peered":"2024-09-11T23:16:15.488169+0000","last_unstale":"2024-09-11T23:16:53.927657+0000","last_undegraded":"2024-09-11T23:16:53.927657+0000","last_fullsized":"2024-09-11T23:16:53.927657+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:19:15.223041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":56699,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":183,"num_read_kb":151,"num_write":234,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":552960,"data_stored":190393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":204,"ondisk_log_size":204,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":76,"seq":326417514522,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28068,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717084,"statfs":{"total":95995035648,"available":95966294016,"internally_reserved":0,"allocated":1069056,"data_stored":530753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":69,"seq":296352743454,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28732,"kb_used_data":1708,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716420,"statfs":{"total":95995035648,"available":95965614080,"internally_reserved":0,"allocated":1748992,"data_stored":1166667,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":64,"seq":274877906980,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28096,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717056,"statfs":{"total":95995035648,"available":95966265344,"internally_reserved":0,"allocated":1097728,"data_stored":534386,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168620,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36408,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708744,"statfs":{"total":95995035648,"available":95957753856,"internally_reserved":0,"allocated":1089536,"data_stored":530668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397551,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36992,"kb_used_data":1648,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708160,"statfs":{"total":95995035648,"available":95957155840,"internally_reserved":0,"allocated":1687552,"data_stored":1127560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561078,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32228,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712924,"statfs":{"total":95995035648,"available":95962034176,"internally_reserved":0,"allocated":1069056,"data_stored":526187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790010,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28680,"kb_used_data":1656,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716472,"statfs":{"total":95995035648,"available":95965667328,"internally_reserved":0,"allocated":1695744,"data_stored":1122356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953535,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32236,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712916,"statfs":{"total":95995035648,"available":95962025984,"internally_reserved":0,"allocated":1077248,"data_stored":530261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182469,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28080,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717072,"statfs":{"total":95995035648,"available":95966281728,"internally_reserved":0,"allocated":1081344,"data_stored":525502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411404,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36472,"kb_used_data":1128,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708680,"statfs":{"total":95995035648,"available":95957688320,"internally_reserved":0,"allocated":1155072,"data_stored":586683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574927,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28132,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717020,"statfs":{"total":95995035648,"available":95966228480,"internally_reserved":0,"allocated":1134592,"data_stored":586463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738453,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32252,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712900,"statfs":{"total":95995035648,"available":95962009600,"internally_reserved":0,"allocated":1093632,"data_stored":527643,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":61391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":61611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":51227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:17:22.826 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-11T23:17:22.827 INFO:tasks.cephadm:Setting up client nodes... 2024-09-11T23:17:22.827 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-11T23:17:23.240 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:17:23.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:23.792+0000 7f144e200640 1 -- 172.21.15.37:0/2604355069 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1448103e00 msgr2=0x7f1448104200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:23.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:23.792+0000 7f144e200640 1 --2- 172.21.15.37:0/2604355069 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1448103e00 0x7f1448104200 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f1438009900 tx=0x7f143802a410 comp rx=0 tx=0).stop 2024-09-11T23:17:23.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:23.792+0000 7f144e200640 1 -- 172.21.15.37:0/2604355069 shutdown_connections 2024-09-11T23:17:23.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:23.792+0000 7f144e200640 1 --2- 172.21.15.37:0/2604355069 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1448104f60 0x7f14481053e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:23.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:23.792+0000 7f144e200640 1 --2- 172.21.15.37:0/2604355069 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1448105920 0x7f144810c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:23.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:23.792+0000 7f144e200640 1 --2- 172.21.15.37:0/2604355069 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1448103e00 0x7f1448104200 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:23.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:23.792+0000 7f144e200640 1 -- 172.21.15.37:0/2604355069 >> 172.21.15.37:0/2604355069 conn(0x7f14480ff5b0 msgr2=0x7f14481019d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:23.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:23.792+0000 7f144e200640 1 -- 172.21.15.37:0/2604355069 shutdown_connections 2024-09-11T23:17:23.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:23.792+0000 7f144e200640 1 -- 172.21.15.37:0/2604355069 wait complete. 2024-09-11T23:17:23.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:23.793+0000 7f144e200640 1 Processor -- start 2024-09-11T23:17:23.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:23.794+0000 7f144e200640 1 -- start start 2024-09-11T23:17:23.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:23.794+0000 7f144e200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1448103e00 0x7f144819a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:23.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:23.794+0000 7f144e200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1448104f60 0x7f144819a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:23.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:23.794+0000 7f144e200640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1448105920 0x7f14481a1680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:23.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:23.794+0000 7f144e200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f144810fb00 con 0x7f1448103e00 2024-09-11T23:17:23.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:23.794+0000 7f144e200640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f144810f980 con 0x7f1448104f60 2024-09-11T23:17:23.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:23.794+0000 7f144e200640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f144810fc80 con 0x7f1448105920 2024-09-11T23:17:23.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:23.794+0000 7f1447400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1448103e00 0x7f144819a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:23.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:23.794+0000 7f1447400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1448103e00 0x7f144819a0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42094/0 (socket says 172.21.15.37:42094) 2024-09-11T23:17:23.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:23.794+0000 7f1447400640 1 -- 172.21.15.37:0/3672958222 learned_addr learned my addr 172.21.15.37:0/3672958222 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:17:23.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:23.794+0000 7f1447e00640 1 --2- 172.21.15.37:0/3672958222 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1448105920 0x7f14481a1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:23.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:23.794+0000 7f143ea00640 1 --2- 172.21.15.37:0/3672958222 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1448104f60 0x7f144819a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:23.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:23.795+0000 7f1447400640 1 -- 172.21.15.37:0/3672958222 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1448105920 msgr2=0x7f14481a1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:23.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:23.795+0000 7f1447400640 1 --2- 172.21.15.37:0/3672958222 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1448105920 0x7f14481a1680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:23.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:23.795+0000 7f1447400640 1 -- 172.21.15.37:0/3672958222 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1448104f60 msgr2=0x7f144819a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:23.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:23.795+0000 7f1447400640 1 --2- 172.21.15.37:0/3672958222 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1448104f60 0x7f144819a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:23.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:23.795+0000 7f1447400640 1 -- 172.21.15.37:0/3672958222 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14481a1cf0 con 0x7f1448103e00 2024-09-11T23:17:23.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:23.795+0000 7f1447400640 1 --2- 172.21.15.37:0/3672958222 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1448103e00 0x7f144819a0c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f1438031440 tx=0x7f1438032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:23.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:23.795+0000 7f1444c00640 1 -- 172.21.15.37:0/3672958222 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f143803f030 con 0x7f1448103e00 2024-09-11T23:17:23.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:23.796+0000 7f1444c00640 1 -- 172.21.15.37:0/3672958222 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1438003ce0 con 0x7f1448103e00 2024-09-11T23:17:23.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:23.796+0000 7f144e200640 1 -- 172.21.15.37:0/3672958222 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14481a1f80 con 0x7f1448103e00 2024-09-11T23:17:23.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:23.796+0000 7f1444c00640 1 -- 172.21.15.37:0/3672958222 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1438035070 con 0x7f1448103e00 2024-09-11T23:17:23.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:23.796+0000 7f144e200640 1 -- 172.21.15.37:0/3672958222 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14481a2380 con 0x7f1448103e00 2024-09-11T23:17:23.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:23.797+0000 7f144e200640 1 -- 172.21.15.37:0/3672958222 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f144810b1a0 con 0x7f1448103e00 2024-09-11T23:17:23.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:23.799+0000 7f1444c00640 1 -- 172.21.15.37:0/3672958222 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f1438042030 con 0x7f1448103e00 2024-09-11T23:17:23.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:23.800+0000 7f1444c00640 1 --2- 172.21.15.37:0/3672958222 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f142c0a2c40 0x7f142c0a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:23.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:23.800+0000 7f1444c00640 1 -- 172.21.15.37:0/3672958222 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9092+0+0 (secure 0 0 0) 0x7f14380ef690 con 0x7f1448103e00 2024-09-11T23:17:23.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:23.800+0000 7f143ea00640 1 --2- 172.21.15.37:0/3672958222 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f142c0a2c40 0x7f142c0a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:23.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:23.801+0000 7f143ea00640 1 --2- 172.21.15.37:0/3672958222 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f142c0a2c40 0x7f142c0a5100 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f14300095f0 tx=0x7f1430005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:23.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:23.804+0000 7f1444c00640 1 -- 172.21.15.37:0/3672958222 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f14380bba80 con 0x7f1448103e00 2024-09-11T23:17:24.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:24.056+0000 7f144e200640 1 -- 172.21.15.37:0/3672958222 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f144802d7c0 con 0x7f1448103e00 2024-09-11T23:17:24.057 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:23 smithi037 ceph-mon[30630]: from='client.24755 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T23:17:24.057 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:23 smithi037 ceph-mon[30630]: pgmap v338: 129 pgs: 129 active+clean; 642 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 4.8 KiB/s wr, 13 op/s 2024-09-11T23:17:24.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:24.059+0000 7f1444c00640 1 -- 172.21.15.37:0/3672958222 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7f14380bfd80 con 0x7f1448103e00 2024-09-11T23:17:24.059 INFO:teuthology.orchestra.run.smithi037.stdout:[client.0] 2024-09-11T23:17:24.059 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQAEJeJmKkt0AxAA6w179qOhJlwrqKto0POmQw== 2024-09-11T23:17:24.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:24.061+0000 7f144e200640 1 -- 172.21.15.37:0/3672958222 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f142c0a2c40 msgr2=0x7f142c0a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:24.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:24.061+0000 7f144e200640 1 --2- 172.21.15.37:0/3672958222 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f142c0a2c40 0x7f142c0a5100 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f14300095f0 tx=0x7f1430005f90 comp rx=0 tx=0).stop 2024-09-11T23:17:24.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:24.061+0000 7f144e200640 1 -- 172.21.15.37:0/3672958222 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1448103e00 msgr2=0x7f144819a0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:24.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:24.061+0000 7f144e200640 1 --2- 172.21.15.37:0/3672958222 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1448103e00 0x7f144819a0c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f1438031440 tx=0x7f1438032ce0 comp rx=0 tx=0).stop 2024-09-11T23:17:24.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:24.061+0000 7f144e200640 1 -- 172.21.15.37:0/3672958222 shutdown_connections 2024-09-11T23:17:24.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:24.061+0000 7f144e200640 1 --2- 172.21.15.37:0/3672958222 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f142c0a2c40 0x7f142c0a5100 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:24.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:24.061+0000 7f144e200640 1 --2- 172.21.15.37:0/3672958222 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1448104f60 0x7f144819a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:24.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:24.061+0000 7f144e200640 1 --2- 172.21.15.37:0/3672958222 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1448105920 0x7f14481a1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:24.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:24.061+0000 7f144e200640 1 --2- 172.21.15.37:0/3672958222 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1448103e00 0x7f144819a0c0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:24.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:24.062+0000 7f144e200640 1 -- 172.21.15.37:0/3672958222 >> 172.21.15.37:0/3672958222 conn(0x7f14480ff5b0 msgr2=0x7f1448108370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:24.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:24.062+0000 7f144e200640 1 -- 172.21.15.37:0/3672958222 shutdown_connections 2024-09-11T23:17:24.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:24.062+0000 7f144e200640 1 -- 172.21.15.37:0/3672958222 wait complete. 2024-09-11T23:17:24.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:23 smithi160 ceph-mon[35055]: from='client.24755 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T23:17:24.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:23 smithi160 ceph-mon[35055]: pgmap v338: 129 pgs: 129 active+clean; 642 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 4.8 KiB/s wr, 13 op/s 2024-09-11T23:17:24.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:23 smithi123 ceph-mon[35438]: from='client.24755 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T23:17:24.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:23 smithi123 ceph-mon[35438]: pgmap v338: 129 pgs: 129 active+clean; 642 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 4.8 KiB/s wr, 13 op/s 2024-09-11T23:17:24.841 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-11T23:17:24.841 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-11T23:17:24.841 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-11T23:17:24.921 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-11T23:17:24.921 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-11T23:17:24.922 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph mgr dump --format=json 2024-09-11T23:17:25.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:24 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/3672958222' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-11T23:17:25.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:24 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/3672958222' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-11T23:17:25.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:24 smithi160 ceph-mon[35055]: from='client.? 172.21.15.37:0/3672958222' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-11T23:17:25.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:24 smithi160 ceph-mon[35055]: from='client.? 172.21.15.37:0/3672958222' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-11T23:17:25.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:24 smithi123 ceph-mon[35438]: from='client.? 172.21.15.37:0/3672958222' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-11T23:17:25.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:24 smithi123 ceph-mon[35438]: from='client.? 172.21.15.37:0/3672958222' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-11T23:17:25.340 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:17:25.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:25.958+0000 7f8e65c00640 1 -- 172.21.15.37:0/3502902165 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e60102790 msgr2=0x7f8e601067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:25.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:25.958+0000 7f8e65c00640 1 --2- 172.21.15.37:0/3502902165 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e60102790 0x7f8e601067e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f8e48009900 tx=0x7f8e4802a400 comp rx=0 tx=0).stop 2024-09-11T23:17:25.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:25.958+0000 7f8e65c00640 1 -- 172.21.15.37:0/3502902165 shutdown_connections 2024-09-11T23:17:25.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:25.958+0000 7f8e65c00640 1 --2- 172.21.15.37:0/3502902165 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e60106f10 0x7f8e6010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:25.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:25.958+0000 7f8e65c00640 1 --2- 172.21.15.37:0/3502902165 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e60102790 0x7f8e601067e0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:25.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:25.958+0000 7f8e65c00640 1 --2- 172.21.15.37:0/3502902165 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8e60101de0 0x7f8e601021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:25.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:25.958+0000 7f8e65c00640 1 -- 172.21.15.37:0/3502902165 >> 172.21.15.37:0/3502902165 conn(0x7f8e600fd8c0 msgr2=0x7f8e600ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:25.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:25.959+0000 7f8e65c00640 1 -- 172.21.15.37:0/3502902165 shutdown_connections 2024-09-11T23:17:25.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:25.959+0000 7f8e65c00640 1 -- 172.21.15.37:0/3502902165 wait complete. 2024-09-11T23:17:25.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:25.960+0000 7f8e65c00640 1 Processor -- start 2024-09-11T23:17:25.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:25.960+0000 7f8e65c00640 1 -- start start 2024-09-11T23:17:25.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:25.960+0000 7f8e65c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e60101de0 0x7f8e600744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:25.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:25.960+0000 7f8e65c00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e60102790 0x7f8e60074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:25.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:25.960+0000 7f8e65c00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8e60106f10 0x7f8e60074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:25.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:25.960+0000 7f8e65c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8e60111f70 con 0x7f8e60101de0 2024-09-11T23:17:25.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:25.960+0000 7f8e65c00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f8e60111df0 con 0x7f8e60102790 2024-09-11T23:17:25.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:25.960+0000 7f8e65c00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f8e601120f0 con 0x7f8e60106f10 2024-09-11T23:17:25.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:25.961+0000 7f8e5ea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e60101de0 0x7f8e600744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:25.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:25.961+0000 7f8e5ea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e60101de0 0x7f8e600744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42114/0 (socket says 172.21.15.37:42114) 2024-09-11T23:17:25.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:25.961+0000 7f8e5ea00640 1 -- 172.21.15.37:0/910597356 learned_addr learned my addr 172.21.15.37:0/910597356 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:17:25.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:25.961+0000 7f8e5f400640 1 --2- 172.21.15.37:0/910597356 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8e60106f10 0x7f8e60074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:25.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:25.961+0000 7f8e56000640 1 --2- 172.21.15.37:0/910597356 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e60102790 0x7f8e60074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:25.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:25.961+0000 7f8e5ea00640 1 -- 172.21.15.37:0/910597356 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8e60106f10 msgr2=0x7f8e60074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:25.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:25.961+0000 7f8e5ea00640 1 --2- 172.21.15.37:0/910597356 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8e60106f10 0x7f8e60074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:25.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:25.961+0000 7f8e5ea00640 1 -- 172.21.15.37:0/910597356 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e60102790 msgr2=0x7f8e60074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:25.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:25.961+0000 7f8e5ea00640 1 --2- 172.21.15.37:0/910597356 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e60102790 0x7f8e60074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:25.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:25.961+0000 7f8e5ea00640 1 -- 172.21.15.37:0/910597356 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e601a6910 con 0x7f8e60101de0 2024-09-11T23:17:25.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:25.962+0000 7f8e5ea00640 1 --2- 172.21.15.37:0/910597356 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e60101de0 0x7f8e600744f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f8e5000e9f0 tx=0x7f8e5000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:25.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:25.962+0000 7f8e57e00640 1 -- 172.21.15.37:0/910597356 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e5000cd80 con 0x7f8e60101de0 2024-09-11T23:17:25.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:25.962+0000 7f8e57e00640 1 -- 172.21.15.37:0/910597356 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8e50010910 con 0x7f8e60101de0 2024-09-11T23:17:25.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:25.962+0000 7f8e57e00640 1 -- 172.21.15.37:0/910597356 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e50018990 con 0x7f8e60101de0 2024-09-11T23:17:25.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:25.962+0000 7f8e65c00640 1 -- 172.21.15.37:0/910597356 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e601a6c00 con 0x7f8e60101de0 2024-09-11T23:17:25.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:25.962+0000 7f8e65c00640 1 -- 172.21.15.37:0/910597356 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e601a70c0 con 0x7f8e60101de0 2024-09-11T23:17:25.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:25.963+0000 7f8e65c00640 1 -- 172.21.15.37:0/910597356 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e601021c0 con 0x7f8e60101de0 2024-09-11T23:17:25.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:25.965+0000 7f8e57e00640 1 -- 172.21.15.37:0/910597356 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f8e50010ac0 con 0x7f8e60101de0 2024-09-11T23:17:25.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:25.966+0000 7f8e57e00640 1 --2- 172.21.15.37:0/910597356 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f8e440a2c90 0x7f8e440a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:25.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:25.966+0000 7f8e57e00640 1 -- 172.21.15.37:0/910597356 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9092+0+0 (secure 0 0 0) 0x7f8e500cf800 con 0x7f8e60101de0 2024-09-11T23:17:25.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:25.967+0000 7f8e56000640 1 --2- 172.21.15.37:0/910597356 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f8e440a2c90 0x7f8e440a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:25.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:25.967+0000 7f8e56000640 1 --2- 172.21.15.37:0/910597356 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f8e440a2c90 0x7f8e440a5150 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8e48009230 tx=0x7f8e480058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:25.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:25.970+0000 7f8e57e00640 1 -- 172.21.15.37:0/910597356 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8e5009bbf0 con 0x7f8e60101de0 2024-09-11T23:17:26.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:25 smithi037 ceph-mon[30630]: pgmap v339: 129 pgs: 129 active+clean; 642 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 3.4 KiB/s wr, 11 op/s 2024-09-11T23:17:26.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:25 smithi160 ceph-mon[35055]: pgmap v339: 129 pgs: 129 active+clean; 642 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 3.4 KiB/s wr, 11 op/s 2024-09-11T23:17:26.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:26.205+0000 7f8e65c00640 1 -- 172.21.15.37:0/910597356 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f8e6002d810 con 0x7f8e60101de0 2024-09-11T23:17:26.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:26.211+0000 7f8e57e00640 1 -- 172.21.15.37:0/910597356 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+263189 (secure 0 0 0) 0x7f8e5009fef0 con 0x7f8e60101de0 2024-09-11T23:17:26.215 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:17:26.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:26.215+0000 7f8e65c00640 1 -- 172.21.15.37:0/910597356 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f8e440a2c90 msgr2=0x7f8e440a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:26.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:26.215+0000 7f8e65c00640 1 --2- 172.21.15.37:0/910597356 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f8e440a2c90 0x7f8e440a5150 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8e48009230 tx=0x7f8e480058d0 comp rx=0 tx=0).stop 2024-09-11T23:17:26.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:26.215+0000 7f8e65c00640 1 -- 172.21.15.37:0/910597356 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e60101de0 msgr2=0x7f8e600744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:26.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:26.215+0000 7f8e65c00640 1 --2- 172.21.15.37:0/910597356 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e60101de0 0x7f8e600744f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f8e5000e9f0 tx=0x7f8e5000eeb0 comp rx=0 tx=0).stop 2024-09-11T23:17:26.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:26.215+0000 7f8e65c00640 1 -- 172.21.15.37:0/910597356 shutdown_connections 2024-09-11T23:17:26.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:26.215+0000 7f8e65c00640 1 --2- 172.21.15.37:0/910597356 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f8e440a2c90 0x7f8e440a5150 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:26.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:26.215+0000 7f8e65c00640 1 --2- 172.21.15.37:0/910597356 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e60102790 0x7f8e60074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:26.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:26.215+0000 7f8e65c00640 1 --2- 172.21.15.37:0/910597356 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8e60106f10 0x7f8e60074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:26.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:26.215+0000 7f8e65c00640 1 --2- 172.21.15.37:0/910597356 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e60101de0 0x7f8e600744f0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:26.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:26.215+0000 7f8e65c00640 1 -- 172.21.15.37:0/910597356 >> 172.21.15.37:0/910597356 conn(0x7f8e600fd8c0 msgr2=0x7f8e600febd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:26.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:26.215+0000 7f8e65c00640 1 -- 172.21.15.37:0/910597356 shutdown_connections 2024-09-11T23:17:26.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:26.215+0000 7f8e65c00640 1 -- 172.21.15.37:0/910597356 wait complete. 2024-09-11T23:17:26.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:25 smithi123 ceph-mon[35438]: pgmap v339: 129 pgs: 129 active+clean; 642 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 3.4 KiB/s wr, 11 op/s 2024-09-11T23:17:26.973 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":17,"flags":0,"active_gid":14150,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":31543269},{"type":"v1","addr":"172.21.15.37:6801","nonce":31543269}]},"active_addr":"172.21.15.37:6801/31543269","active_change":"2024-09-11T23:08:51.934273+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24109,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24110,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.37:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.37:0","nonce":2972484732}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.37:0","nonce":697451617}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.37:0","nonce":78478380}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.37:0","nonce":21877475}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.37:0","nonce":316098664}]}]} 2024-09-11T23:17:26.980 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-11T23:17:26.980 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-11T23:17:26.980 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T23:17:27.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:26 smithi160 ceph-mon[35055]: from='client.? 172.21.15.37:0/910597356' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-11T23:17:27.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:26 smithi123 ceph-mon[35438]: from='client.? 172.21.15.37:0/910597356' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-11T23:17:27.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:26 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/910597356' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-11T23:17:27.355 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:17:27.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:27.978+0000 7f4c87e00640 1 -- 172.21.15.37:0/2332837976 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c88103e30 msgr2=0x7f4c88104210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:27.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:27.978+0000 7f4c87e00640 1 --2- 172.21.15.37:0/2332837976 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c88103e30 0x7f4c88104210 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4c78009900 tx=0x7f4c7802a400 comp rx=0 tx=0).stop 2024-09-11T23:17:27.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:27.978+0000 7f4c87e00640 1 -- 172.21.15.37:0/2332837976 shutdown_connections 2024-09-11T23:17:27.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:27.978+0000 7f4c87e00640 1 --2- 172.21.15.37:0/2332837976 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4c881047e0 0x7f4c88108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:27.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:27.978+0000 7f4c87e00640 1 --2- 172.21.15.37:0/2332837976 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4c88108f60 0x7f4c88110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:27.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:27.978+0000 7f4c87e00640 1 --2- 172.21.15.37:0/2332837976 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c88103e30 0x7f4c88104210 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:27.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:27.978+0000 7f4c87e00640 1 -- 172.21.15.37:0/2332837976 >> 172.21.15.37:0/2332837976 conn(0x7f4c880ff8d0 msgr2=0x7f4c88101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:27.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:27.978+0000 7f4c87e00640 1 -- 172.21.15.37:0/2332837976 shutdown_connections 2024-09-11T23:17:27.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:27.978+0000 7f4c87e00640 1 -- 172.21.15.37:0/2332837976 wait complete. 2024-09-11T23:17:27.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:27.979+0000 7f4c87e00640 1 Processor -- start 2024-09-11T23:17:27.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:27.979+0000 7f4c87e00640 1 -- start start 2024-09-11T23:17:27.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:27.980+0000 7f4c87e00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4c88103e30 0x7f4c8819a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:27.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:27.980+0000 7f4c87e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4c881047e0 0x7f4c8819a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:27.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:27.980+0000 7f4c87e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c88108f60 0x7f4c8819ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:27.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:27.980+0000 7f4c87e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4c88113f80 con 0x7f4c88108f60 2024-09-11T23:17:27.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:27.980+0000 7f4c87e00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f4c88113e00 con 0x7f4c881047e0 2024-09-11T23:17:27.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:27.980+0000 7f4c87e00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f4c88114100 con 0x7f4c88103e30 2024-09-11T23:17:27.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:27.980+0000 7f4c86a00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4c88103e30 0x7f4c8819a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:27.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:27.980+0000 7f4c87400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c88108f60 0x7f4c8819ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:27.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:27.980+0000 7f4c86a00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4c88103e30 0x7f4c8819a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.37:54660/0 (socket says 172.21.15.37:54660) 2024-09-11T23:17:27.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:27.980+0000 7f4c86a00640 1 -- 172.21.15.37:0/2041520929 learned_addr learned my addr 172.21.15.37:0/2041520929 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:17:27.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:27.980+0000 7f4c86000640 1 --2- 172.21.15.37:0/2041520929 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4c881047e0 0x7f4c8819a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:27.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:27.981+0000 7f4c86000640 1 -- 172.21.15.37:0/2041520929 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4c88103e30 msgr2=0x7f4c8819a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:27.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:27.981+0000 7f4c86000640 1 --2- 172.21.15.37:0/2041520929 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4c88103e30 0x7f4c8819a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:27.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:27.981+0000 7f4c86000640 1 -- 172.21.15.37:0/2041520929 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c88108f60 msgr2=0x7f4c8819ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:27.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:27.981+0000 7f4c86000640 1 --2- 172.21.15.37:0/2041520929 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c88108f60 0x7f4c8819ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:27.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:27.981+0000 7f4c86000640 1 -- 172.21.15.37:0/2041520929 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c8819f430 con 0x7f4c881047e0 2024-09-11T23:17:27.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:27.981+0000 7f4c86000640 1 --2- 172.21.15.37:0/2041520929 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4c881047e0 0x7f4c8819a9c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4c7400d6d0 tx=0x7f4c7400db90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:27.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:27.981+0000 7f4c7f400640 1 -- 172.21.15.37:0/2041520929 <== mon.2 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c74017070 con 0x7f4c881047e0 2024-09-11T23:17:27.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:27.981+0000 7f4c7f400640 1 -- 172.21.15.37:0/2041520929 <== mon.2 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4c74009820 con 0x7f4c881047e0 2024-09-11T23:17:27.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:27.981+0000 7f4c7f400640 1 -- 172.21.15.37:0/2041520929 <== mon.2 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c74004d00 con 0x7f4c881047e0 2024-09-11T23:17:27.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:27.981+0000 7f4c87e00640 1 -- 172.21.15.37:0/2041520929 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c8819f720 con 0x7f4c881047e0 2024-09-11T23:17:27.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:27.981+0000 7f4c87e00640 1 -- 172.21.15.37:0/2041520929 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c881a7000 con 0x7f4c881047e0 2024-09-11T23:17:27.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:27.982+0000 7f4c87e00640 1 -- 172.21.15.37:0/2041520929 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c88104210 con 0x7f4c881047e0 2024-09-11T23:17:27.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:27.984+0000 7f4c7f400640 1 -- 172.21.15.37:0/2041520929 <== mon.2 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f4c740099d0 con 0x7f4c881047e0 2024-09-11T23:17:27.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:27.986+0000 7f4c7f400640 1 --2- 172.21.15.37:0/2041520929 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f4c6c0a2c90 0x7f4c6c0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:27.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:27.986+0000 7f4c7f400640 1 -- 172.21.15.37:0/2041520929 <== mon.2 v2:172.21.15.123:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9092+0+0 (secure 0 0 0) 0x7f4c740ceff0 con 0x7f4c881047e0 2024-09-11T23:17:27.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:27.986+0000 7f4c86a00640 1 --2- 172.21.15.37:0/2041520929 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f4c6c0a2c90 0x7f4c6c0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:27.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:27.986+0000 7f4c86a00640 1 --2- 172.21.15.37:0/2041520929 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f4c6c0a2c90 0x7f4c6c0a5150 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f4c780096c0 tx=0x7f4c78005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:27.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:27.990+0000 7f4c7f400640 1 -- 172.21.15.37:0/2041520929 <== mon.2 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4c7409b400 con 0x7f4c881047e0 2024-09-11T23:17:28.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:28.180+0000 7f4c87e00640 1 -- 172.21.15.37:0/2041520929 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4c8810bbb0 con 0x7f4c881047e0 2024-09-11T23:17:28.181 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:27 smithi037 ceph-mon[30630]: pgmap v340: 129 pgs: 129 active+clean; 646 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 3.8 KiB/s wr, 13 op/s 2024-09-11T23:17:28.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:28.182+0000 7f4c7f400640 1 -- 172.21.15.37:0/2041520929 <== mon.2 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) ==== 74+0+24669 (secure 0 0 0) 0x7f4c7409f700 con 0x7f4c881047e0 2024-09-11T23:17:28.183 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:17:28.183 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":93,"fsid":"8b03efce-7092-11ef-bcea-c7b262605968","created":"2024-09-11T23:07:59.386838+0000","modified":"2024-09-11T23:16:53.660246+0000","last_up_change":"2024-09-11T23:15:16.985748+0000","last_in_change":"2024-09-11T23:14:54.154116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:11:16.547642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:16:11.075859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T23:16:14.019910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-11T23:16:22.041463+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f76ccb11-fe3b-4df1-9a71-e6ca50de80e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1678472768},{"type":"v1","addr":"172.21.15.37:6803","nonce":1678472768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1678472768},{"type":"v1","addr":"172.21.15.37:6805","nonce":1678472768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1678472768},{"type":"v1","addr":"172.21.15.37:6809","nonce":1678472768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1678472768},{"type":"v1","addr":"172.21.15.37:6807","nonce":1678472768}]},"public_addr":"172.21.15.37:6803/1678472768","cluster_addr":"172.21.15.37:6805/1678472768","heartbeat_back_addr":"172.21.15.37:6809/1678472768","heartbeat_front_addr":"172.21.15.37:6807/1678472768","state":["exists","up"]},{"osd":1,"uuid":"13d26eed-1160-4b15-b66b-66c89066c66f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":141504725},{"type":"v1","addr":"172.21.15.123:6801","nonce":141504725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":141504725},{"type":"v1","addr":"172.21.15.123:6803","nonce":141504725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":141504725},{"type":"v1","addr":"172.21.15.123:6807","nonce":141504725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":141504725},{"type":"v1","addr":"172.21.15.123:6805","nonce":141504725}]},"public_addr":"172.21.15.123:6801/141504725","cluster_addr":"172.21.15.123:6803/141504725","heartbeat_back_addr":"172.21.15.123:6807/141504725","heartbeat_front_addr":"172.21.15.123:6805/141504725","state":["exists","up"]},{"osd":2,"uuid":"53daf4d5-2a43-4a89-bae9-f32b89b517f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":1866489133},{"type":"v1","addr":"172.21.15.160:6801","nonce":1866489133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":1866489133},{"type":"v1","addr":"172.21.15.160:6803","nonce":1866489133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":1866489133},{"type":"v1","addr":"172.21.15.160:6807","nonce":1866489133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":1866489133},{"type":"v1","addr":"172.21.15.160:6805","nonce":1866489133}]},"public_addr":"172.21.15.160:6801/1866489133","cluster_addr":"172.21.15.160:6803/1866489133","heartbeat_back_addr":"172.21.15.160:6807/1866489133","heartbeat_front_addr":"172.21.15.160:6805/1866489133","state":["exists","up"]},{"osd":3,"uuid":"7c819225-964b-44f2-93e5-1d7585eb0b36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":412656036},{"type":"v1","addr":"172.21.15.37:6811","nonce":412656036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":412656036},{"type":"v1","addr":"172.21.15.37:6813","nonce":412656036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":412656036},{"type":"v1","addr":"172.21.15.37:6817","nonce":412656036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":412656036},{"type":"v1","addr":"172.21.15.37:6815","nonce":412656036}]},"public_addr":"172.21.15.37:6811/412656036","cluster_addr":"172.21.15.37:6813/412656036","heartbeat_back_addr":"172.21.15.37:6817/412656036","heartbeat_front_addr":"172.21.15.37:6815/412656036","state":["exists","up"]},{"osd":4,"uuid":"e5ab5638-8c7e-4433-8dd0-ba57e28f39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":3228822066},{"type":"v1","addr":"172.21.15.123:6809","nonce":3228822066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":3228822066},{"type":"v1","addr":"172.21.15.123:6811","nonce":3228822066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":3228822066},{"type":"v1","addr":"172.21.15.123:6815","nonce":3228822066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":3228822066},{"type":"v1","addr":"172.21.15.123:6813","nonce":3228822066}]},"public_addr":"172.21.15.123:6809/3228822066","cluster_addr":"172.21.15.123:6811/3228822066","heartbeat_back_addr":"172.21.15.123:6815/3228822066","heartbeat_front_addr":"172.21.15.123:6813/3228822066","state":["exists","up"]},{"osd":5,"uuid":"7f080d49-eec8-4cd9-b410-b2e84139292e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":1618319675},{"type":"v1","addr":"172.21.15.160:6809","nonce":1618319675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":1618319675},{"type":"v1","addr":"172.21.15.160:6811","nonce":1618319675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":1618319675},{"type":"v1","addr":"172.21.15.160:6815","nonce":1618319675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":1618319675},{"type":"v1","addr":"172.21.15.160:6813","nonce":1618319675}]},"public_addr":"172.21.15.160:6809/1618319675","cluster_addr":"172.21.15.160:6811/1618319675","heartbeat_back_addr":"172.21.15.160:6815/1618319675","heartbeat_front_addr":"172.21.15.160:6813/1618319675","state":["exists","up"]},{"osd":6,"uuid":"d0881c4e-bd8d-4575-8c81-94d21825c227","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3541251299},{"type":"v1","addr":"172.21.15.37:6819","nonce":3541251299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3541251299},{"type":"v1","addr":"172.21.15.37:6821","nonce":3541251299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":3541251299},{"type":"v1","addr":"172.21.15.37:6825","nonce":3541251299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3541251299},{"type":"v1","addr":"172.21.15.37:6823","nonce":3541251299}]},"public_addr":"172.21.15.37:6819/3541251299","cluster_addr":"172.21.15.37:6821/3541251299","heartbeat_back_addr":"172.21.15.37:6825/3541251299","heartbeat_front_addr":"172.21.15.37:6823/3541251299","state":["exists","up"]},{"osd":7,"uuid":"04fbec2e-91b5-4a89-a4a3-472398c45288","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":4279933341},{"type":"v1","addr":"172.21.15.123:6817","nonce":4279933341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":4279933341},{"type":"v1","addr":"172.21.15.123:6819","nonce":4279933341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":4279933341},{"type":"v1","addr":"172.21.15.123:6823","nonce":4279933341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":4279933341},{"type":"v1","addr":"172.21.15.123:6821","nonce":4279933341}]},"public_addr":"172.21.15.123:6817/4279933341","cluster_addr":"172.21.15.123:6819/4279933341","heartbeat_back_addr":"172.21.15.123:6823/4279933341","heartbeat_front_addr":"172.21.15.123:6821/4279933341","state":["exists","up"]},{"osd":8,"uuid":"c77090a7-308e-4c6d-a56e-ce6f8e050ae5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":740968584},{"type":"v1","addr":"172.21.15.160:6817","nonce":740968584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":740968584},{"type":"v1","addr":"172.21.15.160:6819","nonce":740968584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":740968584},{"type":"v1","addr":"172.21.15.160:6823","nonce":740968584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":740968584},{"type":"v1","addr":"172.21.15.160:6821","nonce":740968584}]},"public_addr":"172.21.15.160:6817/740968584","cluster_addr":"172.21.15.160:6819/740968584","heartbeat_back_addr":"172.21.15.160:6823/740968584","heartbeat_front_addr":"172.21.15.160:6821/740968584","state":["exists","up"]},{"osd":9,"uuid":"bcd19bd4-88bc-46f7-b48c-af9e3d17aa96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":692114850},{"type":"v1","addr":"172.21.15.37:6827","nonce":692114850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":692114850},{"type":"v1","addr":"172.21.15.37:6829","nonce":692114850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":692114850},{"type":"v1","addr":"172.21.15.37:6833","nonce":692114850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":692114850},{"type":"v1","addr":"172.21.15.37:6831","nonce":692114850}]},"public_addr":"172.21.15.37:6827/692114850","cluster_addr":"172.21.15.37:6829/692114850","heartbeat_back_addr":"172.21.15.37:6833/692114850","heartbeat_front_addr":"172.21.15.37:6831/692114850","state":["exists","up"]},{"osd":10,"uuid":"9e956e6c-c28a-4a4c-b385-c458788858ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":471058996},{"type":"v1","addr":"172.21.15.123:6825","nonce":471058996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":471058996},{"type":"v1","addr":"172.21.15.123:6827","nonce":471058996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":471058996},{"type":"v1","addr":"172.21.15.123:6831","nonce":471058996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":471058996},{"type":"v1","addr":"172.21.15.123:6829","nonce":471058996}]},"public_addr":"172.21.15.123:6825/471058996","cluster_addr":"172.21.15.123:6827/471058996","heartbeat_back_addr":"172.21.15.123:6831/471058996","heartbeat_front_addr":"172.21.15.123:6829/471058996","state":["exists","up"]},{"osd":11,"uuid":"0b5b3364-9a40-4cab-90d4-b7b1cba57bc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":3982315018},{"type":"v1","addr":"172.21.15.160:6825","nonce":3982315018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3982315018},{"type":"v1","addr":"172.21.15.160:6827","nonce":3982315018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3982315018},{"type":"v1","addr":"172.21.15.160:6831","nonce":3982315018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3982315018},{"type":"v1","addr":"172.21.15.160:6829","nonce":3982315018}]},"public_addr":"172.21.15.160:6825/3982315018","cluster_addr":"172.21.15.160:6827/3982315018","heartbeat_back_addr":"172.21.15.160:6831/3982315018","heartbeat_front_addr":"172.21.15.160:6829/3982315018","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:10:21.139833+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:10:47.004960+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:11:11.460263+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:11:40.849286+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:12:06.497448+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:12:32.043206+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:13:01.402019+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:13:27.993489+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:13:52.291643+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:23.840299+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:49.448254+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:15:15.310947+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":7}]},{"pgid":"3.17","mappings":[{"from":4,"to":7}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.30","mappings":[{"from":1,"to":9}]},{"pgid":"3.38","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:6801/2886800769":"2024-09-12T23:08:51.934167+0000","172.21.15.37:0/1811301224":"2024-09-12T23:08:51.934167+0000","172.21.15.37:0/513883980":"2024-09-12T23:08:51.934167+0000","172.21.15.37:0/3698260188":"2024-09-12T23:08:23.793913+0000","172.21.15.37:6800/2886800769":"2024-09-12T23:08:51.934167+0000","172.21.15.37:0/4134736061":"2024-09-12T23:08:23.793913+0000","172.21.15.37:0/3426758476":"2024-09-12T23:08:51.934167+0000","172.21.15.37:0/2545840561":"2024-09-12T23:08:23.793913+0000","172.21.15.37:6801/3447426643":"2024-09-12T23:08:23.793913+0000","172.21.15.37:6800/3447426643":"2024-09-12T23:08:23.793913+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:17:28.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:27 smithi160 ceph-mon[35055]: pgmap v340: 129 pgs: 129 active+clean; 646 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 3.8 KiB/s wr, 13 op/s 2024-09-11T23:17:28.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:28.185+0000 7f4c87e00640 1 -- 172.21.15.37:0/2041520929 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f4c6c0a2c90 msgr2=0x7f4c6c0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:28.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:28.185+0000 7f4c87e00640 1 --2- 172.21.15.37:0/2041520929 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f4c6c0a2c90 0x7f4c6c0a5150 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f4c780096c0 tx=0x7f4c78005a20 comp rx=0 tx=0).stop 2024-09-11T23:17:28.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:28.185+0000 7f4c87e00640 1 -- 172.21.15.37:0/2041520929 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4c881047e0 msgr2=0x7f4c8819a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:28.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:28.185+0000 7f4c87e00640 1 --2- 172.21.15.37:0/2041520929 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4c881047e0 0x7f4c8819a9c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4c7400d6d0 tx=0x7f4c7400db90 comp rx=0 tx=0).stop 2024-09-11T23:17:28.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:28.185+0000 7f4c87e00640 1 -- 172.21.15.37:0/2041520929 shutdown_connections 2024-09-11T23:17:28.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:28.185+0000 7f4c87e00640 1 --2- 172.21.15.37:0/2041520929 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f4c6c0a2c90 0x7f4c6c0a5150 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:28.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:28.185+0000 7f4c87e00640 1 --2- 172.21.15.37:0/2041520929 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4c881047e0 0x7f4c8819a9c0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:28.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:28.185+0000 7f4c87e00640 1 --2- 172.21.15.37:0/2041520929 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c88108f60 0x7f4c8819ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:28.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:28.185+0000 7f4c87e00640 1 --2- 172.21.15.37:0/2041520929 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4c88103e30 0x7f4c8819a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:28.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:28.185+0000 7f4c87e00640 1 -- 172.21.15.37:0/2041520929 >> 172.21.15.37:0/2041520929 conn(0x7f4c880ff8d0 msgr2=0x7f4c88100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:28.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:28.185+0000 7f4c87e00640 1 -- 172.21.15.37:0/2041520929 shutdown_connections 2024-09-11T23:17:28.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:28.185+0000 7f4c87e00640 1 -- 172.21.15.37:0/2041520929 wait complete. 2024-09-11T23:17:28.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:27 smithi123 ceph-mon[35438]: pgmap v340: 129 pgs: 129 active+clean; 646 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 3.8 KiB/s wr, 13 op/s 2024-09-11T23:17:28.952 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:28 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/2041520929' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:17:28.992 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-11T23:17:28.992 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T23:17:29.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:28 smithi160 ceph-mon[35055]: from='client.? 172.21.15.37:0/2041520929' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:17:29.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:28 smithi123 ceph-mon[35438]: from='client.? 172.21.15.37:0/2041520929' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:17:29.371 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:17:29.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:29.910+0000 7f5112e00640 1 -- 172.21.15.37:0/1914140833 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f510c076720 msgr2=0x7f510c076b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:29.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:29.910+0000 7f5112e00640 1 --2- 172.21.15.37:0/1914140833 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f510c076720 0x7f510c076b00 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f50fc009900 tx=0x7f50fc02a3f0 comp rx=0 tx=0).stop 2024-09-11T23:17:29.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:29.910+0000 7f5112e00640 1 -- 172.21.15.37:0/1914140833 shutdown_connections 2024-09-11T23:17:29.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:29.910+0000 7f5112e00640 1 --2- 172.21.15.37:0/1914140833 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f510c112a50 0x7f510c114e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:29.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:29.910+0000 7f5112e00640 1 --2- 172.21.15.37:0/1914140833 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f510c077040 0x7f510c112510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:29.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:29.910+0000 7f5112e00640 1 --2- 172.21.15.37:0/1914140833 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f510c076720 0x7f510c076b00 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:29.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:29.910+0000 7f5112e00640 1 -- 172.21.15.37:0/1914140833 >> 172.21.15.37:0/1914140833 conn(0x7f510c0ffa50 msgr2=0x7f510c101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:29.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:29.911+0000 7f5112e00640 1 -- 172.21.15.37:0/1914140833 shutdown_connections 2024-09-11T23:17:29.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:29.911+0000 7f5112e00640 1 -- 172.21.15.37:0/1914140833 wait complete. 2024-09-11T23:17:29.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:29.911+0000 7f5112e00640 1 Processor -- start 2024-09-11T23:17:29.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:29.912+0000 7f5112e00640 1 -- start start 2024-09-11T23:17:29.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:29.912+0000 7f5112e00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f510c076720 0x7f510c1a4800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:29.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:29.912+0000 7f5112e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f510c077040 0x7f510c1a4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:29.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:29.912+0000 7f5112e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f510c112a50 0x7f510c19e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:29.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:29.912+0000 7f5112e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f510c118610 con 0x7f510c112a50 2024-09-11T23:17:29.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:29.912+0000 7f5112e00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f510c118490 con 0x7f510c077040 2024-09-11T23:17:29.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:29.912+0000 7f5112e00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f510c118790 con 0x7f510c076720 2024-09-11T23:17:29.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:29.912+0000 7f5103e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f510c077040 0x7f510c1a4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:29.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:29.912+0000 7f5110e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f510c112a50 0x7f510c19e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:29.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:29.912+0000 7f5103e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f510c077040 0x7f510c1a4d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.37:55390/0 (socket says 172.21.15.37:55390) 2024-09-11T23:17:29.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:29.912+0000 7f5103e00640 1 -- 172.21.15.37:0/2765026898 learned_addr learned my addr 172.21.15.37:0/2765026898 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:17:29.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:29.912+0000 7f510be00640 1 --2- 172.21.15.37:0/2765026898 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f510c076720 0x7f510c1a4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:29.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:29.913+0000 7f5103e00640 1 -- 172.21.15.37:0/2765026898 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f510c076720 msgr2=0x7f510c1a4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:29.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:29.913+0000 7f5103e00640 1 --2- 172.21.15.37:0/2765026898 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f510c076720 0x7f510c1a4800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:29.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:29.913+0000 7f5103e00640 1 -- 172.21.15.37:0/2765026898 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f510c112a50 msgr2=0x7f510c19e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:29.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:29.913+0000 7f5103e00640 1 --2- 172.21.15.37:0/2765026898 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f510c112a50 0x7f510c19e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:29.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:29.913+0000 7f5103e00640 1 -- 172.21.15.37:0/2765026898 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f510c19f0f0 con 0x7f510c077040 2024-09-11T23:17:29.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:29.913+0000 7f5110e00640 1 --2- 172.21.15.37:0/2765026898 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f510c112a50 0x7f510c19e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:17:29.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:29.913+0000 7f5103e00640 1 --2- 172.21.15.37:0/2765026898 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f510c077040 0x7f510c1a4d40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f50f400d950 tx=0x7f50f400de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:29.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:29.913+0000 7f5109600640 1 -- 172.21.15.37:0/2765026898 <== mon.2 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50f4017070 con 0x7f510c077040 2024-09-11T23:17:29.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:29.913+0000 7f5109600640 1 -- 172.21.15.37:0/2765026898 <== mon.2 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f50f4009c30 con 0x7f510c077040 2024-09-11T23:17:29.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:29.913+0000 7f5109600640 1 -- 172.21.15.37:0/2765026898 <== mon.2 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50f400f6b0 con 0x7f510c077040 2024-09-11T23:17:29.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:29.914+0000 7f5112e00640 1 -- 172.21.15.37:0/2765026898 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f510c19f3e0 con 0x7f510c077040 2024-09-11T23:17:29.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:29.914+0000 7f5112e00640 1 -- 172.21.15.37:0/2765026898 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f510c1ab6d0 con 0x7f510c077040 2024-09-11T23:17:29.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:29.915+0000 7f5112e00640 1 -- 172.21.15.37:0/2765026898 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f510c076b00 con 0x7f510c077040 2024-09-11T23:17:29.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:29.917+0000 7f5109600640 1 -- 172.21.15.37:0/2765026898 <== mon.2 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f50f40109d0 con 0x7f510c077040 2024-09-11T23:17:29.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:29.918+0000 7f5109600640 1 --2- 172.21.15.37:0/2765026898 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f50f00a2c10 0x7f50f00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:29.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:29.918+0000 7f5109600640 1 -- 172.21.15.37:0/2765026898 <== mon.2 v2:172.21.15.123:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9092+0+0 (secure 0 0 0) 0x7f50f40cf140 con 0x7f510c077040 2024-09-11T23:17:29.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:29.918+0000 7f510be00640 1 --2- 172.21.15.37:0/2765026898 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f50f00a2c10 0x7f50f00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:29.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:29.919+0000 7f510be00640 1 --2- 172.21.15.37:0/2765026898 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f50f00a2c10 0x7f50f00a50d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f50fc006010 tx=0x7f50fc000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:29.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:29.920+0000 7f5109600640 1 -- 172.21.15.37:0/2765026898 <== mon.2 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f50f4009de0 con 0x7f510c077040 2024-09-11T23:17:30.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:29 smithi037 ceph-mon[30630]: pgmap v341: 129 pgs: 129 active+clean; 646 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.5 KiB/s wr, 9 op/s 2024-09-11T23:17:30.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:30.109+0000 7f5112e00640 1 -- 172.21.15.37:0/2765026898 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f510c19fef0 con 0x7f510c077040 2024-09-11T23:17:30.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:30.111+0000 7f5109600640 1 -- 172.21.15.37:0/2765026898 <== mon.2 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) ==== 74+0+24669 (secure 0 0 0) 0x7f50f409b530 con 0x7f510c077040 2024-09-11T23:17:30.111 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:17:30.112 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":93,"fsid":"8b03efce-7092-11ef-bcea-c7b262605968","created":"2024-09-11T23:07:59.386838+0000","modified":"2024-09-11T23:16:53.660246+0000","last_up_change":"2024-09-11T23:15:16.985748+0000","last_in_change":"2024-09-11T23:14:54.154116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:11:16.547642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:16:11.075859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T23:16:14.019910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-11T23:16:22.041463+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f76ccb11-fe3b-4df1-9a71-e6ca50de80e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1678472768},{"type":"v1","addr":"172.21.15.37:6803","nonce":1678472768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1678472768},{"type":"v1","addr":"172.21.15.37:6805","nonce":1678472768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1678472768},{"type":"v1","addr":"172.21.15.37:6809","nonce":1678472768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1678472768},{"type":"v1","addr":"172.21.15.37:6807","nonce":1678472768}]},"public_addr":"172.21.15.37:6803/1678472768","cluster_addr":"172.21.15.37:6805/1678472768","heartbeat_back_addr":"172.21.15.37:6809/1678472768","heartbeat_front_addr":"172.21.15.37:6807/1678472768","state":["exists","up"]},{"osd":1,"uuid":"13d26eed-1160-4b15-b66b-66c89066c66f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":141504725},{"type":"v1","addr":"172.21.15.123:6801","nonce":141504725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":141504725},{"type":"v1","addr":"172.21.15.123:6803","nonce":141504725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":141504725},{"type":"v1","addr":"172.21.15.123:6807","nonce":141504725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":141504725},{"type":"v1","addr":"172.21.15.123:6805","nonce":141504725}]},"public_addr":"172.21.15.123:6801/141504725","cluster_addr":"172.21.15.123:6803/141504725","heartbeat_back_addr":"172.21.15.123:6807/141504725","heartbeat_front_addr":"172.21.15.123:6805/141504725","state":["exists","up"]},{"osd":2,"uuid":"53daf4d5-2a43-4a89-bae9-f32b89b517f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":1866489133},{"type":"v1","addr":"172.21.15.160:6801","nonce":1866489133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":1866489133},{"type":"v1","addr":"172.21.15.160:6803","nonce":1866489133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":1866489133},{"type":"v1","addr":"172.21.15.160:6807","nonce":1866489133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":1866489133},{"type":"v1","addr":"172.21.15.160:6805","nonce":1866489133}]},"public_addr":"172.21.15.160:6801/1866489133","cluster_addr":"172.21.15.160:6803/1866489133","heartbeat_back_addr":"172.21.15.160:6807/1866489133","heartbeat_front_addr":"172.21.15.160:6805/1866489133","state":["exists","up"]},{"osd":3,"uuid":"7c819225-964b-44f2-93e5-1d7585eb0b36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":412656036},{"type":"v1","addr":"172.21.15.37:6811","nonce":412656036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":412656036},{"type":"v1","addr":"172.21.15.37:6813","nonce":412656036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":412656036},{"type":"v1","addr":"172.21.15.37:6817","nonce":412656036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":412656036},{"type":"v1","addr":"172.21.15.37:6815","nonce":412656036}]},"public_addr":"172.21.15.37:6811/412656036","cluster_addr":"172.21.15.37:6813/412656036","heartbeat_back_addr":"172.21.15.37:6817/412656036","heartbeat_front_addr":"172.21.15.37:6815/412656036","state":["exists","up"]},{"osd":4,"uuid":"e5ab5638-8c7e-4433-8dd0-ba57e28f39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":3228822066},{"type":"v1","addr":"172.21.15.123:6809","nonce":3228822066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":3228822066},{"type":"v1","addr":"172.21.15.123:6811","nonce":3228822066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":3228822066},{"type":"v1","addr":"172.21.15.123:6815","nonce":3228822066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":3228822066},{"type":"v1","addr":"172.21.15.123:6813","nonce":3228822066}]},"public_addr":"172.21.15.123:6809/3228822066","cluster_addr":"172.21.15.123:6811/3228822066","heartbeat_back_addr":"172.21.15.123:6815/3228822066","heartbeat_front_addr":"172.21.15.123:6813/3228822066","state":["exists","up"]},{"osd":5,"uuid":"7f080d49-eec8-4cd9-b410-b2e84139292e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":1618319675},{"type":"v1","addr":"172.21.15.160:6809","nonce":1618319675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":1618319675},{"type":"v1","addr":"172.21.15.160:6811","nonce":1618319675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":1618319675},{"type":"v1","addr":"172.21.15.160:6815","nonce":1618319675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":1618319675},{"type":"v1","addr":"172.21.15.160:6813","nonce":1618319675}]},"public_addr":"172.21.15.160:6809/1618319675","cluster_addr":"172.21.15.160:6811/1618319675","heartbeat_back_addr":"172.21.15.160:6815/1618319675","heartbeat_front_addr":"172.21.15.160:6813/1618319675","state":["exists","up"]},{"osd":6,"uuid":"d0881c4e-bd8d-4575-8c81-94d21825c227","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3541251299},{"type":"v1","addr":"172.21.15.37:6819","nonce":3541251299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3541251299},{"type":"v1","addr":"172.21.15.37:6821","nonce":3541251299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":3541251299},{"type":"v1","addr":"172.21.15.37:6825","nonce":3541251299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3541251299},{"type":"v1","addr":"172.21.15.37:6823","nonce":3541251299}]},"public_addr":"172.21.15.37:6819/3541251299","cluster_addr":"172.21.15.37:6821/3541251299","heartbeat_back_addr":"172.21.15.37:6825/3541251299","heartbeat_front_addr":"172.21.15.37:6823/3541251299","state":["exists","up"]},{"osd":7,"uuid":"04fbec2e-91b5-4a89-a4a3-472398c45288","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":4279933341},{"type":"v1","addr":"172.21.15.123:6817","nonce":4279933341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":4279933341},{"type":"v1","addr":"172.21.15.123:6819","nonce":4279933341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":4279933341},{"type":"v1","addr":"172.21.15.123:6823","nonce":4279933341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":4279933341},{"type":"v1","addr":"172.21.15.123:6821","nonce":4279933341}]},"public_addr":"172.21.15.123:6817/4279933341","cluster_addr":"172.21.15.123:6819/4279933341","heartbeat_back_addr":"172.21.15.123:6823/4279933341","heartbeat_front_addr":"172.21.15.123:6821/4279933341","state":["exists","up"]},{"osd":8,"uuid":"c77090a7-308e-4c6d-a56e-ce6f8e050ae5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":740968584},{"type":"v1","addr":"172.21.15.160:6817","nonce":740968584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":740968584},{"type":"v1","addr":"172.21.15.160:6819","nonce":740968584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":740968584},{"type":"v1","addr":"172.21.15.160:6823","nonce":740968584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":740968584},{"type":"v1","addr":"172.21.15.160:6821","nonce":740968584}]},"public_addr":"172.21.15.160:6817/740968584","cluster_addr":"172.21.15.160:6819/740968584","heartbeat_back_addr":"172.21.15.160:6823/740968584","heartbeat_front_addr":"172.21.15.160:6821/740968584","state":["exists","up"]},{"osd":9,"uuid":"bcd19bd4-88bc-46f7-b48c-af9e3d17aa96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":692114850},{"type":"v1","addr":"172.21.15.37:6827","nonce":692114850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":692114850},{"type":"v1","addr":"172.21.15.37:6829","nonce":692114850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":692114850},{"type":"v1","addr":"172.21.15.37:6833","nonce":692114850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":692114850},{"type":"v1","addr":"172.21.15.37:6831","nonce":692114850}]},"public_addr":"172.21.15.37:6827/692114850","cluster_addr":"172.21.15.37:6829/692114850","heartbeat_back_addr":"172.21.15.37:6833/692114850","heartbeat_front_addr":"172.21.15.37:6831/692114850","state":["exists","up"]},{"osd":10,"uuid":"9e956e6c-c28a-4a4c-b385-c458788858ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":471058996},{"type":"v1","addr":"172.21.15.123:6825","nonce":471058996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":471058996},{"type":"v1","addr":"172.21.15.123:6827","nonce":471058996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":471058996},{"type":"v1","addr":"172.21.15.123:6831","nonce":471058996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":471058996},{"type":"v1","addr":"172.21.15.123:6829","nonce":471058996}]},"public_addr":"172.21.15.123:6825/471058996","cluster_addr":"172.21.15.123:6827/471058996","heartbeat_back_addr":"172.21.15.123:6831/471058996","heartbeat_front_addr":"172.21.15.123:6829/471058996","state":["exists","up"]},{"osd":11,"uuid":"0b5b3364-9a40-4cab-90d4-b7b1cba57bc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":3982315018},{"type":"v1","addr":"172.21.15.160:6825","nonce":3982315018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3982315018},{"type":"v1","addr":"172.21.15.160:6827","nonce":3982315018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3982315018},{"type":"v1","addr":"172.21.15.160:6831","nonce":3982315018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3982315018},{"type":"v1","addr":"172.21.15.160:6829","nonce":3982315018}]},"public_addr":"172.21.15.160:6825/3982315018","cluster_addr":"172.21.15.160:6827/3982315018","heartbeat_back_addr":"172.21.15.160:6831/3982315018","heartbeat_front_addr":"172.21.15.160:6829/3982315018","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:10:21.139833+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:10:47.004960+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:11:11.460263+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:11:40.849286+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:12:06.497448+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:12:32.043206+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:13:01.402019+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:13:27.993489+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:13:52.291643+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:23.840299+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:49.448254+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:15:15.310947+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":7}]},{"pgid":"3.17","mappings":[{"from":4,"to":7}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.30","mappings":[{"from":1,"to":9}]},{"pgid":"3.38","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:6801/2886800769":"2024-09-12T23:08:51.934167+0000","172.21.15.37:0/1811301224":"2024-09-12T23:08:51.934167+0000","172.21.15.37:0/513883980":"2024-09-12T23:08:51.934167+0000","172.21.15.37:0/3698260188":"2024-09-12T23:08:23.793913+0000","172.21.15.37:6800/2886800769":"2024-09-12T23:08:51.934167+0000","172.21.15.37:0/4134736061":"2024-09-12T23:08:23.793913+0000","172.21.15.37:0/3426758476":"2024-09-12T23:08:51.934167+0000","172.21.15.37:0/2545840561":"2024-09-12T23:08:23.793913+0000","172.21.15.37:6801/3447426643":"2024-09-12T23:08:23.793913+0000","172.21.15.37:6800/3447426643":"2024-09-12T23:08:23.793913+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:17:30.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:30.113+0000 7f5112e00640 1 -- 172.21.15.37:0/2765026898 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f50f00a2c10 msgr2=0x7f50f00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:30.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:30.113+0000 7f5112e00640 1 --2- 172.21.15.37:0/2765026898 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f50f00a2c10 0x7f50f00a50d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f50fc006010 tx=0x7f50fc000bc0 comp rx=0 tx=0).stop 2024-09-11T23:17:30.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:30.113+0000 7f5112e00640 1 -- 172.21.15.37:0/2765026898 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f510c077040 msgr2=0x7f510c1a4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:30.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:30.113+0000 7f5112e00640 1 --2- 172.21.15.37:0/2765026898 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f510c077040 0x7f510c1a4d40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f50f400d950 tx=0x7f50f400de10 comp rx=0 tx=0).stop 2024-09-11T23:17:30.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:30.113+0000 7f5112e00640 1 -- 172.21.15.37:0/2765026898 shutdown_connections 2024-09-11T23:17:30.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:30.113+0000 7f5112e00640 1 --2- 172.21.15.37:0/2765026898 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f50f00a2c10 0x7f50f00a50d0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:30.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:30.113+0000 7f5112e00640 1 --2- 172.21.15.37:0/2765026898 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f510c077040 0x7f510c1a4d40 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:30.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:30.113+0000 7f5112e00640 1 --2- 172.21.15.37:0/2765026898 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f510c112a50 0x7f510c19e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:30.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:30.113+0000 7f5112e00640 1 --2- 172.21.15.37:0/2765026898 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f510c076720 0x7f510c1a4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:30.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:30.113+0000 7f5112e00640 1 -- 172.21.15.37:0/2765026898 >> 172.21.15.37:0/2765026898 conn(0x7f510c0ffa50 msgr2=0x7f510c101e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:30.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:30.114+0000 7f5112e00640 1 -- 172.21.15.37:0/2765026898 shutdown_connections 2024-09-11T23:17:30.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:30.114+0000 7f5112e00640 1 -- 172.21.15.37:0/2765026898 wait complete. 2024-09-11T23:17:30.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:29 smithi160 ceph-mon[35055]: pgmap v341: 129 pgs: 129 active+clean; 646 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.5 KiB/s wr, 9 op/s 2024-09-11T23:17:30.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:29 smithi123 ceph-mon[35438]: pgmap v341: 129 pgs: 129 active+clean; 646 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.5 KiB/s wr, 9 op/s 2024-09-11T23:17:30.935 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-11T23:17:30.935 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-11T23:17:30.936 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-11T23:17:30.936 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-11T23:17:30.937 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-11T23:17:30.937 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-11T23:17:30.937 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-09-11T23:17:30.938 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-09-11T23:17:30.938 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-09-11T23:17:30.939 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-09-11T23:17:30.939 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-09-11T23:17:30.940 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-09-11T23:17:31.089 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:30 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/2765026898' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:17:31.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:30 smithi160 ceph-mon[35055]: from='client.? 172.21.15.37:0/2765026898' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:17:31.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:30 smithi123 ceph-mon[35438]: from='client.? 172.21.15.37:0/2765026898' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:17:31.950 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:17:31.955 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:17:31.967 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:17:31.968 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:17:31.978 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:17:32.074 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:17:32.076 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:17:32.136 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:17:32.140 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:31 smithi037 ceph-mon[30630]: pgmap v342: 129 pgs: 129 active+clean; 646 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.5 KiB/s wr, 11 op/s 2024-09-11T23:17:32.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:31 smithi160 ceph-mon[35055]: pgmap v342: 129 pgs: 129 active+clean; 646 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.5 KiB/s wr, 11 op/s 2024-09-11T23:17:32.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:31 smithi123 ceph-mon[35438]: pgmap v342: 129 pgs: 129 active+clean; 646 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.5 KiB/s wr, 11 op/s 2024-09-11T23:17:32.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:32.858+0000 7f751a800640 1 -- 172.21.15.37:0/1910278143 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7514104010 msgr2=0x7f75141043f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:32.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:32.858+0000 7f751a800640 1 --2- 172.21.15.37:0/1910278143 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7514104010 0x7f75141043f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7504009860 tx=0x7f750402a340 comp rx=0 tx=0).stop 2024-09-11T23:17:32.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:32.859+0000 7f751a800640 1 -- 172.21.15.37:0/1910278143 shutdown_connections 2024-09-11T23:17:32.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:32.859+0000 7f751a800640 1 --2- 172.21.15.37:0/1910278143 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f75141049c0 0x7f7514108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:32.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:32.859+0000 7f751a800640 1 --2- 172.21.15.37:0/1910278143 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7514109140 0x7f7514110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:32.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:32.859+0000 7f751a800640 1 --2- 172.21.15.37:0/1910278143 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7514104010 0x7f75141043f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:32.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:32.859+0000 7f751a800640 1 -- 172.21.15.37:0/1910278143 >> 172.21.15.37:0/1910278143 conn(0x7f75140ffa50 msgr2=0x7f7514101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:32.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:32.859+0000 7f751a800640 1 -- 172.21.15.37:0/1910278143 shutdown_connections 2024-09-11T23:17:32.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:32.859+0000 7f751a800640 1 -- 172.21.15.37:0/1910278143 wait complete. 2024-09-11T23:17:32.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:32.860+0000 7f751a800640 1 Processor -- start 2024-09-11T23:17:32.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:32.860+0000 7f751a800640 1 -- start start 2024-09-11T23:17:32.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:32.860+0000 7f751a800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7514104010 0x7f751419a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:32.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:32.860+0000 7f751a800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75141049c0 0x7f751419ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:32.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:32.860+0000 7f751a800640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7514109140 0x7f751419ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:32.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:32.860+0000 7f751a800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7514114140 con 0x7f75141049c0 2024-09-11T23:17:32.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:32.860+0000 7f751a800640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f7514113fc0 con 0x7f7514104010 2024-09-11T23:17:32.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:32.860+0000 7f751a800640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f75141142c0 con 0x7f7514109140 2024-09-11T23:17:32.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:32.861+0000 7f7512a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75141049c0 0x7f751419ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:32.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:32.861+0000 7f7513400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7514104010 0x7f751419a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:32.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:32.861+0000 7f7512a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75141049c0 0x7f751419ab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34990/0 (socket says 172.21.15.37:34990) 2024-09-11T23:17:32.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:32.861+0000 7f7512a00640 1 -- 172.21.15.37:0/2459234391 learned_addr learned my addr 172.21.15.37:0/2459234391 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:17:32.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:32.861+0000 7f7513e00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7514109140 0x7f751419ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:32.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:32.861+0000 7f7513e00640 1 -- 172.21.15.37:0/2459234391 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7514104010 msgr2=0x7f751419a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:32.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:32.861+0000 7f7513e00640 1 --2- 172.21.15.37:0/2459234391 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7514104010 0x7f751419a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:32.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:32.861+0000 7f7513e00640 1 -- 172.21.15.37:0/2459234391 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75141049c0 msgr2=0x7f751419ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:32.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:32.861+0000 7f7513e00640 1 --2- 172.21.15.37:0/2459234391 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75141049c0 0x7f751419ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:32.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:32.861+0000 7f7513e00640 1 -- 172.21.15.37:0/2459234391 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f751419f5e0 con 0x7f7514109140 2024-09-11T23:17:32.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:32.861+0000 7f7513400640 1 --2- 172.21.15.37:0/2459234391 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7514104010 0x7f751419a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:17:32.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:32.861+0000 7f7513e00640 1 --2- 172.21.15.37:0/2459234391 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7514109140 0x7f751419ef00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f750c00efc0 tx=0x7f750c00c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:32.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:32.862+0000 7f750be00640 1 -- 172.21.15.37:0/2459234391 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f750c003970 con 0x7f7514109140 2024-09-11T23:17:32.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:32.862+0000 7f750be00640 1 -- 172.21.15.37:0/2459234391 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f750c004020 con 0x7f7514109140 2024-09-11T23:17:32.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:32.862+0000 7f750be00640 1 -- 172.21.15.37:0/2459234391 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f750c00b9f0 con 0x7f7514109140 2024-09-11T23:17:32.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:32.862+0000 7f751a800640 1 -- 172.21.15.37:0/2459234391 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f751419f8d0 con 0x7f7514109140 2024-09-11T23:17:32.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:32.862+0000 7f751a800640 1 -- 172.21.15.37:0/2459234391 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75141a71b0 con 0x7f7514109140 2024-09-11T23:17:32.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:32.863+0000 7f751a800640 1 -- 172.21.15.37:0/2459234391 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7514062980 con 0x7f7514109140 2024-09-11T23:17:32.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:32.865+0000 7f750be00640 1 -- 172.21.15.37:0/2459234391 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f750c01d020 con 0x7f7514109140 2024-09-11T23:17:32.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:32.866+0000 7f750be00640 1 --2- 172.21.15.37:0/2459234391 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f74f80a2c90 0x7f74f80a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:32.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:32.866+0000 7f750be00640 1 -- 172.21.15.37:0/2459234391 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9092+0+0 (secure 0 0 0) 0x7f750c0cfbc0 con 0x7f7514109140 2024-09-11T23:17:32.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:32.866+0000 7f7513400640 1 --2- 172.21.15.37:0/2459234391 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f74f80a2c90 0x7f74f80a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:32.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:32.867+0000 7f750be00640 1 --2- 172.21.15.37:0/2459234391 >> [v2:172.21.15.160:6800/1866489133,v1:172.21.15.160:6801/1866489133] conn(0x7f74f80ade60 0x7f74f80b0300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:32.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:32.867+0000 7f750be00640 1 -- 172.21.15.37:0/2459234391 --> [v2:172.21.15.160:6800/1866489133,v1:172.21.15.160:6801/1866489133] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f750c012ec0 con 0x7f74f80ade60 2024-09-11T23:17:32.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:32.867+0000 7f750be00640 1 -- 172.21.15.37:0/2459234391 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_get_version_reply(handle=1 version=93) ==== 24+0+0 (secure 0 0 0) 0x7f750c0cff70 con 0x7f7514109140 2024-09-11T23:17:32.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:32.867+0000 7f7512a00640 1 --2- 172.21.15.37:0/2459234391 >> [v2:172.21.15.160:6800/1866489133,v1:172.21.15.160:6801/1866489133] conn(0x7f74f80ade60 0x7f74f80b0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:32.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:32.867+0000 7f7513400640 1 --2- 172.21.15.37:0/2459234391 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f74f80a2c90 0x7f74f80a5150 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f750402a930 tx=0x7f75040056d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:32.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:32.867+0000 7f7512a00640 1 --2- 172.21.15.37:0/2459234391 >> [v2:172.21.15.160:6800/1866489133,v1:172.21.15.160:6801/1866489133] conn(0x7f74f80ade60 0x7f74f80b0300 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:32.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:32.868+0000 7f750be00640 1 -- 172.21.15.37:0/2459234391 <== osd.2 v2:172.21.15.160:6800/1866489133 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f750c012ec0 con 0x7f74f80ade60 2024-09-11T23:17:32.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:32.883+0000 7f751a800640 1 -- 172.21.15.37:0/2459234391 --> [v2:172.21.15.160:6800/1866489133,v1:172.21.15.160:6801/1866489133] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7514062d80 con 0x7f74f80ade60 2024-09-11T23:17:32.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:32.884+0000 7f750be00640 1 -- 172.21.15.37:0/2459234391 <== osd.2 v2:172.21.15.160:6800/1866489133 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f7514062d80 con 0x7f74f80ade60 2024-09-11T23:17:32.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:32.884+0000 7f751a800640 1 -- 172.21.15.37:0/2459234391 >> [v2:172.21.15.160:6800/1866489133,v1:172.21.15.160:6801/1866489133] conn(0x7f74f80ade60 msgr2=0x7f74f80b0300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:32.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:32.884+0000 7f751a800640 1 --2- 172.21.15.37:0/2459234391 >> [v2:172.21.15.160:6800/1866489133,v1:172.21.15.160:6801/1866489133] conn(0x7f74f80ade60 0x7f74f80b0300 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:32.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:32.884+0000 7f751a800640 1 -- 172.21.15.37:0/2459234391 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f74f80a2c90 msgr2=0x7f74f80a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:32.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:32.884+0000 7f751a800640 1 --2- 172.21.15.37:0/2459234391 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f74f80a2c90 0x7f74f80a5150 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f750402a930 tx=0x7f75040056d0 comp rx=0 tx=0).stop 2024-09-11T23:17:32.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:32.884+0000 7f751a800640 1 -- 172.21.15.37:0/2459234391 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7514109140 msgr2=0x7f751419ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:32.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:32.884+0000 7f751a800640 1 --2- 172.21.15.37:0/2459234391 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7514109140 0x7f751419ef00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f750c00efc0 tx=0x7f750c00c800 comp rx=0 tx=0).stop 2024-09-11T23:17:32.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:32.884+0000 7f7513e00640 1 -- 172.21.15.37:0/2459234391 reap_dead start 2024-09-11T23:17:32.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:32.884+0000 7f751a800640 1 -- 172.21.15.37:0/2459234391 shutdown_connections 2024-09-11T23:17:32.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:32.884+0000 7f751a800640 1 -- 172.21.15.37:0/2459234391 >> 172.21.15.37:0/2459234391 conn(0x7f75140ffa50 msgr2=0x7f7514100ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:32.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:32.885+0000 7f751a800640 1 -- 172.21.15.37:0/2459234391 shutdown_connections 2024-09-11T23:17:32.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:32.885+0000 7f751a800640 1 -- 172.21.15.37:0/2459234391 wait complete. 2024-09-11T23:17:34.013 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:33 smithi037 ceph-mon[30630]: pgmap v343: 129 pgs: 129 active+clean; 646 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 1.5 KiB/s wr, 11 op/s 2024-09-11T23:17:34.049 INFO:teuthology.orchestra.run.smithi037.stdout:77309411407 2024-09-11T23:17:34.049 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-11T23:17:34.070 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:17:34.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:33 smithi160 ceph-mon[35055]: pgmap v343: 129 pgs: 129 active+clean; 646 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 1.5 KiB/s wr, 11 op/s 2024-09-11T23:17:34.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:33 smithi123 ceph-mon[35438]: pgmap v343: 129 pgs: 129 active+clean; 646 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 1.5 KiB/s wr, 11 op/s 2024-09-11T23:17:35.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.092+0000 7f56e8e00640 1 -- 172.21.15.37:0/4117749275 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f56e41079c0 msgr2=0x7f56e4107da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:35.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.092+0000 7f56e8e00640 1 --2- 172.21.15.37:0/4117749275 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f56e41079c0 0x7f56e4107da0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f56d4009be0 tx=0x7f56d402a6d0 comp rx=0 tx=0).stop 2024-09-11T23:17:35.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.092+0000 7f56e8e00640 1 -- 172.21.15.37:0/4117749275 shutdown_connections 2024-09-11T23:17:35.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.092+0000 7f56e8e00640 1 --2- 172.21.15.37:0/4117749275 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56e4102360 0x7f56e410e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:35.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.092+0000 7f56e8e00640 1 --2- 172.21.15.37:0/4117749275 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f56e41019c0 0x7f56e4101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:35.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.092+0000 7f56e8e00640 1 --2- 172.21.15.37:0/4117749275 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f56e41079c0 0x7f56e4107da0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:35.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.092+0000 7f56e8e00640 1 -- 172.21.15.37:0/4117749275 >> 172.21.15.37:0/4117749275 conn(0x7f56e40fd740 msgr2=0x7f56e40ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:35.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.092+0000 7f56e8e00640 1 -- 172.21.15.37:0/4117749275 shutdown_connections 2024-09-11T23:17:35.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.092+0000 7f56e8e00640 1 -- 172.21.15.37:0/4117749275 wait complete. 2024-09-11T23:17:35.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.093+0000 7f56e8e00640 1 Processor -- start 2024-09-11T23:17:35.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.094+0000 7f56e8e00640 1 -- start start 2024-09-11T23:17:35.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.094+0000 7f56e8e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56e41019c0 0x7f56e419a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:35.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.094+0000 7f56e8e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f56e4102360 0x7f56e419aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:35.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.094+0000 7f56e8e00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f56e41079c0 0x7f56e419edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:35.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.094+0000 7f56e8e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f56e4111de0 con 0x7f56e41019c0 2024-09-11T23:17:35.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.094+0000 7f56e8e00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f56e4111c60 con 0x7f56e4102360 2024-09-11T23:17:35.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.094+0000 7f56e8e00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f56e4111f60 con 0x7f56e41079c0 2024-09-11T23:17:35.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.094+0000 7f56e3400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56e41019c0 0x7f56e419a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:35.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.094+0000 7f56e3e00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f56e41079c0 0x7f56e419edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:35.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.094+0000 7f56e3400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56e41019c0 0x7f56e419a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35036/0 (socket says 172.21.15.37:35036) 2024-09-11T23:17:35.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.094+0000 7f56e3400640 1 -- 172.21.15.37:0/736760714 learned_addr learned my addr 172.21.15.37:0/736760714 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:17:35.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.094+0000 7f56daa00640 1 --2- 172.21.15.37:0/736760714 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f56e4102360 0x7f56e419aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:35.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.095+0000 7f56e3400640 1 -- 172.21.15.37:0/736760714 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f56e41079c0 msgr2=0x7f56e419edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:35.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.095+0000 7f56e3400640 1 --2- 172.21.15.37:0/736760714 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f56e41079c0 0x7f56e419edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:35.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.095+0000 7f56e3400640 1 -- 172.21.15.37:0/736760714 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f56e4102360 msgr2=0x7f56e419aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:35.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.095+0000 7f56e3400640 1 --2- 172.21.15.37:0/736760714 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f56e4102360 0x7f56e419aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:35.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.095+0000 7f56e3400640 1 -- 172.21.15.37:0/736760714 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56e419f4b0 con 0x7f56e41019c0 2024-09-11T23:17:35.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.095+0000 7f56e3e00640 1 --2- 172.21.15.37:0/736760714 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f56e41079c0 0x7f56e419edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:17:35.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.095+0000 7f56e3400640 1 --2- 172.21.15.37:0/736760714 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56e41019c0 0x7f56e419a500 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f56d402acc0 tx=0x7f56d4030c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:35.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.095+0000 7f56e0c00640 1 -- 172.21.15.37:0/736760714 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56d4041020 con 0x7f56e41019c0 2024-09-11T23:17:35.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.095+0000 7f56e0c00640 1 -- 172.21.15.37:0/736760714 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f56d4003e50 con 0x7f56e41019c0 2024-09-11T23:17:35.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.096+0000 7f56e0c00640 1 -- 172.21.15.37:0/736760714 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56d4036040 con 0x7f56e41019c0 2024-09-11T23:17:35.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.096+0000 7f56e8e00640 1 -- 172.21.15.37:0/736760714 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56e419f740 con 0x7f56e41019c0 2024-09-11T23:17:35.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.096+0000 7f56e8e00640 1 -- 172.21.15.37:0/736760714 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56e41a7080 con 0x7f56e41019c0 2024-09-11T23:17:35.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.096+0000 7f56e8e00640 1 -- 172.21.15.37:0/736760714 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f56e40ff060 con 0x7f56e41019c0 2024-09-11T23:17:35.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.098+0000 7f56e0c00640 1 -- 172.21.15.37:0/736760714 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f56d4044020 con 0x7f56e41019c0 2024-09-11T23:17:35.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.100+0000 7f56e0c00640 1 --2- 172.21.15.37:0/736760714 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f56c80a2c10 0x7f56c80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:35.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.100+0000 7f56e0c00640 1 -- 172.21.15.37:0/736760714 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9092+0+0 (secure 0 0 0) 0x7f56d40f05a0 con 0x7f56e41019c0 2024-09-11T23:17:35.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.100+0000 7f56daa00640 1 --2- 172.21.15.37:0/736760714 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f56c80a2c10 0x7f56c80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:35.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.100+0000 7f56e0c00640 1 --2- 172.21.15.37:0/736760714 >> [v2:172.21.15.37:6818/3541251299,v1:172.21.15.37:6819/3541251299] conn(0x7f56c80adde0 0x7f56c80b0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:35.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.100+0000 7f56e0c00640 1 -- 172.21.15.37:0/736760714 --> [v2:172.21.15.37:6818/3541251299,v1:172.21.15.37:6819/3541251299] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f56d4045e70 con 0x7f56c80adde0 2024-09-11T23:17:35.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.100+0000 7f56e0c00640 1 -- 172.21.15.37:0/736760714 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=93) ==== 24+0+0 (secure 0 0 0) 0x7f56d40f0950 con 0x7f56e41019c0 2024-09-11T23:17:35.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.101+0000 7f56e3e00640 1 --2- 172.21.15.37:0/736760714 >> [v2:172.21.15.37:6818/3541251299,v1:172.21.15.37:6819/3541251299] conn(0x7f56c80adde0 0x7f56c80b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:35.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.101+0000 7f56daa00640 1 --2- 172.21.15.37:0/736760714 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f56c80a2c10 0x7f56c80a50d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f56e410eaf0 tx=0x7f56cc009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:35.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.101+0000 7f56e3e00640 1 --2- 172.21.15.37:0/736760714 >> [v2:172.21.15.37:6818/3541251299,v1:172.21.15.37:6819/3541251299] conn(0x7f56c80adde0 0x7f56c80b0280 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:35.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.102+0000 7f56e0c00640 1 -- 172.21.15.37:0/736760714 <== osd.6 v2:172.21.15.37:6818/3541251299 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f56d4045e70 con 0x7f56c80adde0 2024-09-11T23:17:35.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.117+0000 7f56e8e00640 1 -- 172.21.15.37:0/736760714 --> [v2:172.21.15.37:6818/3541251299,v1:172.21.15.37:6819/3541251299] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f56e4103100 con 0x7f56c80adde0 2024-09-11T23:17:35.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.117+0000 7f56e0c00640 1 -- 172.21.15.37:0/736760714 <== osd.6 v2:172.21.15.37:6818/3541251299 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f56e4103100 con 0x7f56c80adde0 2024-09-11T23:17:35.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.117+0000 7f56e8e00640 1 -- 172.21.15.37:0/736760714 >> [v2:172.21.15.37:6818/3541251299,v1:172.21.15.37:6819/3541251299] conn(0x7f56c80adde0 msgr2=0x7f56c80b0280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:35.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.117+0000 7f56e8e00640 1 --2- 172.21.15.37:0/736760714 >> [v2:172.21.15.37:6818/3541251299,v1:172.21.15.37:6819/3541251299] conn(0x7f56c80adde0 0x7f56c80b0280 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:35.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.118+0000 7f56e8e00640 1 -- 172.21.15.37:0/736760714 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f56c80a2c10 msgr2=0x7f56c80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:35.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.118+0000 7f56e8e00640 1 --2- 172.21.15.37:0/736760714 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f56c80a2c10 0x7f56c80a50d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f56e410eaf0 tx=0x7f56cc009110 comp rx=0 tx=0).stop 2024-09-11T23:17:35.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.118+0000 7f56e8e00640 1 -- 172.21.15.37:0/736760714 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56e41019c0 msgr2=0x7f56e419a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:35.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.118+0000 7f56e8e00640 1 --2- 172.21.15.37:0/736760714 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56e41019c0 0x7f56e419a500 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f56d402acc0 tx=0x7f56d4030c30 comp rx=0 tx=0).stop 2024-09-11T23:17:35.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.118+0000 7f56e3e00640 1 -- 172.21.15.37:0/736760714 reap_dead start 2024-09-11T23:17:35.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.118+0000 7f56e8e00640 1 -- 172.21.15.37:0/736760714 shutdown_connections 2024-09-11T23:17:35.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.118+0000 7f56e8e00640 1 -- 172.21.15.37:0/736760714 >> 172.21.15.37:0/736760714 conn(0x7f56e40fd740 msgr2=0x7f56e410d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:35.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.118+0000 7f56e8e00640 1 -- 172.21.15.37:0/736760714 shutdown_connections 2024-09-11T23:17:35.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.118+0000 7f56e8e00640 1 -- 172.21.15.37:0/736760714 wait complete. 2024-09-11T23:17:35.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.348+0000 7fded1a00640 1 -- 172.21.15.37:0/3348629440 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdecc074eb0 msgr2=0x7fdecc112650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:35.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.348+0000 7fded1a00640 1 --2- 172.21.15.37:0/3348629440 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdecc074eb0 0x7fdecc112650 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fdeb8009900 tx=0x7fdeb802a480 comp rx=0 tx=0).stop 2024-09-11T23:17:35.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.348+0000 7fded1a00640 1 -- 172.21.15.37:0/3348629440 shutdown_connections 2024-09-11T23:17:35.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.348+0000 7fded1a00640 1 --2- 172.21.15.37:0/3348629440 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdecc112b90 0x7fdecc114f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:35.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.348+0000 7fded1a00640 1 --2- 172.21.15.37:0/3348629440 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdecc074eb0 0x7fdecc112650 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:35.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.348+0000 7fded1a00640 1 --2- 172.21.15.37:0/3348629440 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdecc074590 0x7fdecc074970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:35.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.348+0000 7fded1a00640 1 -- 172.21.15.37:0/3348629440 >> 172.21.15.37:0/3348629440 conn(0x7fdecc0fd8c0 msgr2=0x7fdecc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:35.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.348+0000 7fded1a00640 1 -- 172.21.15.37:0/3348629440 shutdown_connections 2024-09-11T23:17:35.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.348+0000 7fded1a00640 1 -- 172.21.15.37:0/3348629440 wait complete. 2024-09-11T23:17:35.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.350+0000 7fded1a00640 1 Processor -- start 2024-09-11T23:17:35.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.350+0000 7fded1a00640 1 -- start start 2024-09-11T23:17:35.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.350+0000 7fded1a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdecc074590 0x7fdecc1a46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:35.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.350+0000 7fded1a00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdecc074eb0 0x7fdecc1a4c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:35.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.350+0000 7fded1a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdecc112b90 0x7fdecc19e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:35.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.350+0000 7fded1a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fdecc118540 con 0x7fdecc074590 2024-09-11T23:17:35.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.350+0000 7fded1a00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fdecc1183c0 con 0x7fdecc112b90 2024-09-11T23:17:35.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.350+0000 7fded1a00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fdecc1186c0 con 0x7fdecc074eb0 2024-09-11T23:17:35.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.350+0000 7fdecaa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdecc074590 0x7fdecc1a46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:35.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.350+0000 7fdecaa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdecc074590 0x7fdecc1a46f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35052/0 (socket says 172.21.15.37:35052) 2024-09-11T23:17:35.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.350+0000 7fdecaa00640 1 -- 172.21.15.37:0/3031738049 learned_addr learned my addr 172.21.15.37:0/3031738049 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:17:35.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.351+0000 7fdeca000640 1 --2- 172.21.15.37:0/3031738049 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdecc074eb0 0x7fdecc1a4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:35.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.351+0000 7fdecb400640 1 --2- 172.21.15.37:0/3031738049 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdecc112b90 0x7fdecc19e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:35.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.351+0000 7fdecaa00640 1 -- 172.21.15.37:0/3031738049 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdecc074eb0 msgr2=0x7fdecc1a4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:35.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.351+0000 7fdecaa00640 1 --2- 172.21.15.37:0/3031738049 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdecc074eb0 0x7fdecc1a4c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:35.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.351+0000 7fdecaa00640 1 -- 172.21.15.37:0/3031738049 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdecc112b90 msgr2=0x7fdecc19e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:35.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.351+0000 7fdecaa00640 1 --2- 172.21.15.37:0/3031738049 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdecc112b90 0x7fdecc19e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:35.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.351+0000 7fdecaa00640 1 -- 172.21.15.37:0/3031738049 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdecc19efe0 con 0x7fdecc074590 2024-09-11T23:17:35.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.351+0000 7fdecaa00640 1 --2- 172.21.15.37:0/3031738049 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdecc074590 0x7fdecc1a46f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fdebc00e9f0 tx=0x7fdebc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:35.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.351+0000 7fdec3400640 1 -- 172.21.15.37:0/3031738049 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdebc00cd80 con 0x7fdecc074590 2024-09-11T23:17:35.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.352+0000 7fdec3400640 1 -- 172.21.15.37:0/3031738049 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdebc010910 con 0x7fdecc074590 2024-09-11T23:17:35.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.352+0000 7fded1a00640 1 -- 172.21.15.37:0/3031738049 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdecc19f2d0 con 0x7fdecc074590 2024-09-11T23:17:35.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.352+0000 7fdec3400640 1 -- 172.21.15.37:0/3031738049 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdebc018990 con 0x7fdecc074590 2024-09-11T23:17:35.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.352+0000 7fded1a00640 1 -- 172.21.15.37:0/3031738049 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdecc1ab5c0 con 0x7fdecc074590 2024-09-11T23:17:35.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.352+0000 7fded1a00640 1 -- 172.21.15.37:0/3031738049 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdecc062900 con 0x7fdecc074590 2024-09-11T23:17:35.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.355+0000 7fdec3400640 1 -- 172.21.15.37:0/3031738049 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fdebc010ac0 con 0x7fdecc074590 2024-09-11T23:17:35.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.356+0000 7fdec3400640 1 --2- 172.21.15.37:0/3031738049 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fdeb00a2c10 0x7fdeb00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:35.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.356+0000 7fdec3400640 1 -- 172.21.15.37:0/3031738049 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9092+0+0 (secure 0 0 0) 0x7fdebc0cfeb0 con 0x7fdecc074590 2024-09-11T23:17:35.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.356+0000 7fdeca000640 1 --2- 172.21.15.37:0/3031738049 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fdeb00a2c10 0x7fdeb00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:35.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.356+0000 7fdec3400640 1 --2- 172.21.15.37:0/3031738049 >> [v2:172.21.15.37:6810/412656036,v1:172.21.15.37:6811/412656036] conn(0x7fdeb00adde0 0x7fdeb00b0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:35.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.356+0000 7fdec3400640 1 -- 172.21.15.37:0/3031738049 --> [v2:172.21.15.37:6810/412656036,v1:172.21.15.37:6811/412656036] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdebc022e50 con 0x7fdeb00adde0 2024-09-11T23:17:35.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.356+0000 7fdec3400640 1 -- 172.21.15.37:0/3031738049 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=93) ==== 24+0+0 (secure 0 0 0) 0x7fdebc0d0300 con 0x7fdecc074590 2024-09-11T23:17:35.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.357+0000 7fdecb400640 1 --2- 172.21.15.37:0/3031738049 >> [v2:172.21.15.37:6810/412656036,v1:172.21.15.37:6811/412656036] conn(0x7fdeb00adde0 0x7fdeb00b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:35.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.357+0000 7fdeca000640 1 --2- 172.21.15.37:0/3031738049 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fdeb00a2c10 0x7fdeb00a50d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fdeb8009230 tx=0x7fdeb80058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:35.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.357+0000 7fdecb400640 1 --2- 172.21.15.37:0/3031738049 >> [v2:172.21.15.37:6810/412656036,v1:172.21.15.37:6811/412656036] conn(0x7fdeb00adde0 0x7fdeb00b0280 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:35.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.358+0000 7fdec3400640 1 -- 172.21.15.37:0/3031738049 <== osd.3 v2:172.21.15.37:6810/412656036 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdebc022e50 con 0x7fdeb00adde0 2024-09-11T23:17:35.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.372+0000 7fded1a00640 1 -- 172.21.15.37:0/3031738049 --> [v2:172.21.15.37:6810/412656036,v1:172.21.15.37:6811/412656036] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fdecc062d80 con 0x7fdeb00adde0 2024-09-11T23:17:35.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.373+0000 7fdec3400640 1 -- 172.21.15.37:0/3031738049 <== osd.3 v2:172.21.15.37:6810/412656036 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fdecc062d80 con 0x7fdeb00adde0 2024-09-11T23:17:35.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.373+0000 7fded1a00640 1 -- 172.21.15.37:0/3031738049 >> [v2:172.21.15.37:6810/412656036,v1:172.21.15.37:6811/412656036] conn(0x7fdeb00adde0 msgr2=0x7fdeb00b0280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:35.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.373+0000 7fded1a00640 1 --2- 172.21.15.37:0/3031738049 >> [v2:172.21.15.37:6810/412656036,v1:172.21.15.37:6811/412656036] conn(0x7fdeb00adde0 0x7fdeb00b0280 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:35.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.373+0000 7fded1a00640 1 -- 172.21.15.37:0/3031738049 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fdeb00a2c10 msgr2=0x7fdeb00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:35.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.373+0000 7fded1a00640 1 --2- 172.21.15.37:0/3031738049 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fdeb00a2c10 0x7fdeb00a50d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fdeb8009230 tx=0x7fdeb80058d0 comp rx=0 tx=0).stop 2024-09-11T23:17:35.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.373+0000 7fded1a00640 1 -- 172.21.15.37:0/3031738049 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdecc074590 msgr2=0x7fdecc1a46f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:35.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.373+0000 7fded1a00640 1 --2- 172.21.15.37:0/3031738049 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdecc074590 0x7fdecc1a46f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fdebc00e9f0 tx=0x7fdebc00eeb0 comp rx=0 tx=0).stop 2024-09-11T23:17:35.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.373+0000 7fdecb400640 1 -- 172.21.15.37:0/3031738049 reap_dead start 2024-09-11T23:17:35.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.374+0000 7fded1a00640 1 -- 172.21.15.37:0/3031738049 shutdown_connections 2024-09-11T23:17:35.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.374+0000 7fded1a00640 1 -- 172.21.15.37:0/3031738049 >> 172.21.15.37:0/3031738049 conn(0x7fdecc0fd8c0 msgr2=0x7fdecc0ff0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:35.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.374+0000 7fded1a00640 1 -- 172.21.15.37:0/3031738049 shutdown_connections 2024-09-11T23:17:35.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.374+0000 7fded1a00640 1 -- 172.21.15.37:0/3031738049 wait complete. 2024-09-11T23:17:35.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:33.757+0000 7f2368a00640 1 -- 172.21.15.37:0/2005185959 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f236410bfc0 msgr2=0x7f236410e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:35.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:33.757+0000 7f2368a00640 1 --2- 172.21.15.37:0/2005185959 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f236410bfc0 0x7f236410e460 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f235c009900 tx=0x7f235c02a480 comp rx=0 tx=0).stop 2024-09-11T23:17:35.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:33.757+0000 7f2368a00640 1 -- 172.21.15.37:0/2005185959 shutdown_connections 2024-09-11T23:17:35.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:33.757+0000 7f2368a00640 1 --2- 172.21.15.37:0/2005185959 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f23641034b0 0x7f236410b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:35.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:33.757+0000 7f2368a00640 1 --2- 172.21.15.37:0/2005185959 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f236410bfc0 0x7f236410e460 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:35.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:33.757+0000 7f2368a00640 1 --2- 172.21.15.37:0/2005185959 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2364102b90 0x7f2364102f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:35.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:33.757+0000 7f2368a00640 1 -- 172.21.15.37:0/2005185959 >> 172.21.15.37:0/2005185959 conn(0x7f23640fc610 msgr2=0x7f23640fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:35.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:33.757+0000 7f2368a00640 1 -- 172.21.15.37:0/2005185959 shutdown_connections 2024-09-11T23:17:35.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:33.757+0000 7f2368a00640 1 -- 172.21.15.37:0/2005185959 wait complete. 2024-09-11T23:17:35.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:33.758+0000 7f2368a00640 1 Processor -- start 2024-09-11T23:17:35.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:33.758+0000 7f2368a00640 1 -- start start 2024-09-11T23:17:35.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:33.759+0000 7f2368a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2364102b90 0x7f2364198250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:35.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:33.759+0000 7f2368a00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f23641034b0 0x7f2364198790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:35.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:33.759+0000 7f2368a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f236410bfc0 0x7f236419cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:35.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:33.759+0000 7f2368a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2364111dc0 con 0x7f2364102b90 2024-09-11T23:17:35.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:33.759+0000 7f2368a00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f2364111c40 con 0x7f236410bfc0 2024-09-11T23:17:35.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:33.759+0000 7f2368a00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f2364111f40 con 0x7f23641034b0 2024-09-11T23:17:35.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:33.759+0000 7f2363400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2364102b90 0x7f2364198250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:35.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:33.759+0000 7f2363400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2364102b90 0x7f2364198250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35002/0 (socket says 172.21.15.37:35002) 2024-09-11T23:17:35.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:33.759+0000 7f2363400640 1 -- 172.21.15.37:0/691305978 learned_addr learned my addr 172.21.15.37:0/691305978 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:17:35.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:33.759+0000 7f2362a00640 1 --2- 172.21.15.37:0/691305978 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f23641034b0 0x7f2364198790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:35.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:33.759+0000 7f2363e00640 1 --2- 172.21.15.37:0/691305978 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f236410bfc0 0x7f236419cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:35.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:33.760+0000 7f2363400640 1 -- 172.21.15.37:0/691305978 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f23641034b0 msgr2=0x7f2364198790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:35.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:33.760+0000 7f2363400640 1 --2- 172.21.15.37:0/691305978 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f23641034b0 0x7f2364198790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:35.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:33.760+0000 7f2363400640 1 -- 172.21.15.37:0/691305978 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f236410bfc0 msgr2=0x7f236419cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:35.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:33.760+0000 7f2363400640 1 --2- 172.21.15.37:0/691305978 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f236410bfc0 0x7f236419cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:35.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:33.760+0000 7f2363400640 1 -- 172.21.15.37:0/691305978 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f236419d200 con 0x7f2364102b90 2024-09-11T23:17:35.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:33.760+0000 7f2362a00640 1 --2- 172.21.15.37:0/691305978 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f23641034b0 0x7f2364198790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:17:35.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:33.760+0000 7f2363400640 1 --2- 172.21.15.37:0/691305978 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2364102b90 0x7f2364198250 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f235400eb90 tx=0x7f235400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:35.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:33.760+0000 7f235be00640 1 -- 172.21.15.37:0/691305978 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2354004d20 con 0x7f2364102b90 2024-09-11T23:17:35.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:33.760+0000 7f235be00640 1 -- 172.21.15.37:0/691305978 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f235400ee90 con 0x7f2364102b90 2024-09-11T23:17:35.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:33.760+0000 7f235be00640 1 -- 172.21.15.37:0/691305978 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2354010830 con 0x7f2364102b90 2024-09-11T23:17:35.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:33.760+0000 7f2368a00640 1 -- 172.21.15.37:0/691305978 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f236419d4f0 con 0x7f2364102b90 2024-09-11T23:17:35.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:33.760+0000 7f2368a00640 1 -- 172.21.15.37:0/691305978 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23641a4dd0 con 0x7f2364102b90 2024-09-11T23:17:35.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:33.761+0000 7f2368a00640 1 -- 172.21.15.37:0/691305978 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2364062980 con 0x7f2364102b90 2024-09-11T23:17:35.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:33.763+0000 7f235be00640 1 -- 172.21.15.37:0/691305978 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f2354005020 con 0x7f2364102b90 2024-09-11T23:17:35.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:33.765+0000 7f235be00640 1 --2- 172.21.15.37:0/691305978 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f23480a2c10 0x7f23480a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:35.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:33.765+0000 7f235be00640 1 -- 172.21.15.37:0/691305978 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9092+0+0 (secure 0 0 0) 0x7f23540cfff0 con 0x7f2364102b90 2024-09-11T23:17:35.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:33.765+0000 7f2362a00640 1 --2- 172.21.15.37:0/691305978 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f23480a2c10 0x7f23480a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:35.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:33.765+0000 7f235be00640 1 --2- 172.21.15.37:0/691305978 >> [v2:172.21.15.37:6802/1678472768,v1:172.21.15.37:6803/1678472768] conn(0x7f23480adde0 0x7f23480b0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:35.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:33.765+0000 7f235be00640 1 -- 172.21.15.37:0/691305978 --> [v2:172.21.15.37:6802/1678472768,v1:172.21.15.37:6803/1678472768] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f23480b0950 con 0x7f23480adde0 2024-09-11T23:17:35.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:33.765+0000 7f235be00640 1 -- 172.21.15.37:0/691305978 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=93) ==== 24+0+0 (secure 0 0 0) 0x7f23540d0400 con 0x7f2364102b90 2024-09-11T23:17:35.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:33.765+0000 7f2363e00640 1 --2- 172.21.15.37:0/691305978 >> [v2:172.21.15.37:6802/1678472768,v1:172.21.15.37:6803/1678472768] conn(0x7f23480adde0 0x7f23480b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:35.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:33.766+0000 7f2362a00640 1 --2- 172.21.15.37:0/691305978 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f23480a2c10 0x7f23480a50d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f236410d350 tx=0x7f235000b360 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:35.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:33.766+0000 7f2363e00640 1 --2- 172.21.15.37:0/691305978 >> [v2:172.21.15.37:6802/1678472768,v1:172.21.15.37:6803/1678472768] conn(0x7f23480adde0 0x7f23480b0280 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:35.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:33.767+0000 7f235be00640 1 -- 172.21.15.37:0/691305978 <== osd.0 v2:172.21.15.37:6802/1678472768 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f23480b0950 con 0x7f23480adde0 2024-09-11T23:17:35.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:33.781+0000 7f2368a00640 1 -- 172.21.15.37:0/691305978 --> [v2:172.21.15.37:6802/1678472768,v1:172.21.15.37:6803/1678472768] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2364062d80 con 0x7f23480adde0 2024-09-11T23:17:35.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:33.782+0000 7f235be00640 1 -- 172.21.15.37:0/691305978 <== osd.0 v2:172.21.15.37:6802/1678472768 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f2364062d80 con 0x7f23480adde0 2024-09-11T23:17:35.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:33.782+0000 7f2368a00640 1 -- 172.21.15.37:0/691305978 >> [v2:172.21.15.37:6802/1678472768,v1:172.21.15.37:6803/1678472768] conn(0x7f23480adde0 msgr2=0x7f23480b0280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:35.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:33.782+0000 7f2368a00640 1 --2- 172.21.15.37:0/691305978 >> [v2:172.21.15.37:6802/1678472768,v1:172.21.15.37:6803/1678472768] conn(0x7f23480adde0 0x7f23480b0280 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:35.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:33.782+0000 7f2368a00640 1 -- 172.21.15.37:0/691305978 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f23480a2c10 msgr2=0x7f23480a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:35.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:33.782+0000 7f2368a00640 1 --2- 172.21.15.37:0/691305978 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f23480a2c10 0x7f23480a50d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f236410d350 tx=0x7f235000b360 comp rx=0 tx=0).stop 2024-09-11T23:17:35.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:33.782+0000 7f2368a00640 1 -- 172.21.15.37:0/691305978 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2364102b90 msgr2=0x7f2364198250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:35.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:33.782+0000 7f2368a00640 1 --2- 172.21.15.37:0/691305978 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2364102b90 0x7f2364198250 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f235400eb90 tx=0x7f235400c6a0 comp rx=0 tx=0).stop 2024-09-11T23:17:35.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:33.782+0000 7f2363e00640 1 -- 172.21.15.37:0/691305978 reap_dead start 2024-09-11T23:17:35.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:33.783+0000 7f2368a00640 1 -- 172.21.15.37:0/691305978 shutdown_connections 2024-09-11T23:17:35.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:33.783+0000 7f2368a00640 1 -- 172.21.15.37:0/691305978 >> 172.21.15.37:0/691305978 conn(0x7f23640fc610 msgr2=0x7f23640fd2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:35.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:33.783+0000 7f2368a00640 1 -- 172.21.15.37:0/691305978 shutdown_connections 2024-09-11T23:17:35.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:33.783+0000 7f2368a00640 1 -- 172.21.15.37:0/691305978 wait complete. 2024-09-11T23:17:36.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:35 smithi160 ceph-mon[35055]: pgmap v344: 129 pgs: 129 active+clean; 646 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 511 B/s wr, 9 op/s 2024-09-11T23:17:36.245 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:35 smithi037 ceph-mon[30630]: pgmap v344: 129 pgs: 129 active+clean; 646 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 511 B/s wr, 9 op/s 2024-09-11T23:17:36.481 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:35 smithi123 ceph-mon[35438]: pgmap v344: 129 pgs: 129 active+clean; 646 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 511 B/s wr, 9 op/s 2024-09-11T23:17:36.884 INFO:teuthology.orchestra.run.smithi037.stdout:34359738456 2024-09-11T23:17:36.885 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-11T23:17:37.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.090+0000 7fed28000640 1 -- 172.21.15.37:0/1909600313 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed20109120 msgr2=0x7fed20110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:37.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.090+0000 7fed28000640 1 --2- 172.21.15.37:0/1909600313 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed20109120 0x7fed20110ca0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fed18009ca0 tx=0x7fed1802a8c0 comp rx=0 tx=0).stop 2024-09-11T23:17:37.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.090+0000 7fed28000640 1 -- 172.21.15.37:0/1909600313 shutdown_connections 2024-09-11T23:17:37.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.090+0000 7fed28000640 1 --2- 172.21.15.37:0/1909600313 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed20109120 0x7fed20110ca0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:37.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.090+0000 7fed28000640 1 --2- 172.21.15.37:0/1909600313 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fed201049a0 0x7fed201089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:37.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.090+0000 7fed28000640 1 --2- 172.21.15.37:0/1909600313 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed20103ff0 0x7fed201043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:37.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.090+0000 7fed28000640 1 -- 172.21.15.37:0/1909600313 >> 172.21.15.37:0/1909600313 conn(0x7fed200ffa90 msgr2=0x7fed20101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:37.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.090+0000 7fed28000640 1 -- 172.21.15.37:0/1909600313 shutdown_connections 2024-09-11T23:17:37.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.090+0000 7fed28000640 1 -- 172.21.15.37:0/1909600313 wait complete. 2024-09-11T23:17:37.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.091+0000 7fed28000640 1 Processor -- start 2024-09-11T23:17:37.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.092+0000 7fed28000640 1 -- start start 2024-09-11T23:17:37.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.092+0000 7fed28000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed20103ff0 0x7fed2019a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:37.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.092+0000 7fed28000640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fed201049a0 0x7fed2019ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:37.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.092+0000 7fed28000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed20109120 0x7fed2019eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:37.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.092+0000 7fed28000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fed20114150 con 0x7fed20103ff0 2024-09-11T23:17:37.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.092+0000 7fed28000640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fed20113fd0 con 0x7fed20109120 2024-09-11T23:17:37.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.092+0000 7fed28000640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fed201142d0 con 0x7fed201049a0 2024-09-11T23:17:37.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.093+0000 7fed25600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed20103ff0 0x7fed2019a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:37.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.093+0000 7fed25600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed20103ff0 0x7fed2019a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35064/0 (socket says 172.21.15.37:35064) 2024-09-11T23:17:37.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.093+0000 7fed25600640 1 -- 172.21.15.37:0/455369786 learned_addr learned my addr 172.21.15.37:0/455369786 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:17:37.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.093+0000 7fed26000640 1 --2- 172.21.15.37:0/455369786 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed20109120 0x7fed2019eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:37.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.093+0000 7fed24c00640 1 --2- 172.21.15.37:0/455369786 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fed201049a0 0x7fed2019ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:37.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.093+0000 7fed25600640 1 -- 172.21.15.37:0/455369786 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fed201049a0 msgr2=0x7fed2019ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:37.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.093+0000 7fed25600640 1 --2- 172.21.15.37:0/455369786 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fed201049a0 0x7fed2019ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:37.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.093+0000 7fed25600640 1 -- 172.21.15.37:0/455369786 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed20109120 msgr2=0x7fed2019eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:37.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.093+0000 7fed25600640 1 --2- 172.21.15.37:0/455369786 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed20109120 0x7fed2019eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:37.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.093+0000 7fed25600640 1 -- 172.21.15.37:0/455369786 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed2019f5a0 con 0x7fed20103ff0 2024-09-11T23:17:37.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.093+0000 7fed26000640 1 --2- 172.21.15.37:0/455369786 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed20109120 0x7fed2019eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:17:37.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.094+0000 7fed25600640 1 --2- 172.21.15.37:0/455369786 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed20103ff0 0x7fed2019a5f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fed1400ea60 tx=0x7fed1400ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:37.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.094+0000 7fed1e000640 1 -- 172.21.15.37:0/455369786 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed1400cde0 con 0x7fed20103ff0 2024-09-11T23:17:37.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.094+0000 7fed1e000640 1 -- 172.21.15.37:0/455369786 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fed140035f0 con 0x7fed20103ff0 2024-09-11T23:17:37.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.094+0000 7fed1e000640 1 -- 172.21.15.37:0/455369786 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed14010670 con 0x7fed20103ff0 2024-09-11T23:17:37.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.094+0000 7fed28000640 1 -- 172.21.15.37:0/455369786 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed2019f890 con 0x7fed20103ff0 2024-09-11T23:17:37.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.094+0000 7fed28000640 1 -- 172.21.15.37:0/455369786 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed201a7170 con 0x7fed20103ff0 2024-09-11T23:17:37.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.095+0000 7fed28000640 1 -- 172.21.15.37:0/455369786 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fed20062940 con 0x7fed20103ff0 2024-09-11T23:17:37.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.098+0000 7fed1e000640 1 -- 172.21.15.37:0/455369786 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fed140037a0 con 0x7fed20103ff0 2024-09-11T23:17:37.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.099+0000 7fed1e000640 1 --2- 172.21.15.37:0/455369786 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fed080a2c90 0x7fed080a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:37.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.100+0000 7fed1e000640 1 -- 172.21.15.37:0/455369786 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9092+0+0 (secure 0 0 0) 0x7fed140cfab0 con 0x7fed20103ff0 2024-09-11T23:17:37.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.100+0000 7fed24c00640 1 --2- 172.21.15.37:0/455369786 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fed080a2c90 0x7fed080a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:37.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.100+0000 7fed1e000640 1 --2- 172.21.15.37:0/455369786 >> [v2:172.21.15.37:6826/692114850,v1:172.21.15.37:6827/692114850] conn(0x7fed080ade60 0x7fed080b0300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:37.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.100+0000 7fed1e000640 1 -- 172.21.15.37:0/455369786 --> [v2:172.21.15.37:6826/692114850,v1:172.21.15.37:6827/692114850] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fed14023e50 con 0x7fed080ade60 2024-09-11T23:17:37.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.100+0000 7fed1e000640 1 -- 172.21.15.37:0/455369786 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=93) ==== 24+0+0 (secure 0 0 0) 0x7fed140cfe60 con 0x7fed20103ff0 2024-09-11T23:17:37.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.101+0000 7fed26000640 1 --2- 172.21.15.37:0/455369786 >> [v2:172.21.15.37:6826/692114850,v1:172.21.15.37:6827/692114850] conn(0x7fed080ade60 0x7fed080b0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:37.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.102+0000 7fed24c00640 1 --2- 172.21.15.37:0/455369786 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fed080a2c90 0x7fed080a5150 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fed200ffeb0 tx=0x7fed0c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:37.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.102+0000 7fed26000640 1 --2- 172.21.15.37:0/455369786 >> [v2:172.21.15.37:6826/692114850,v1:172.21.15.37:6827/692114850] conn(0x7fed080ade60 0x7fed080b0300 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:37.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.103+0000 7fed1e000640 1 -- 172.21.15.37:0/455369786 <== osd.9 v2:172.21.15.37:6826/692114850 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fed14023e50 con 0x7fed080ade60 2024-09-11T23:17:37.119 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:17:37.120 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:17:37.120 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:17:37.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.127+0000 7fed28000640 1 -- 172.21.15.37:0/455369786 --> [v2:172.21.15.37:6826/692114850,v1:172.21.15.37:6827/692114850] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fed20062dc0 con 0x7fed080ade60 2024-09-11T23:17:37.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.128+0000 7fed1e000640 1 -- 172.21.15.37:0/455369786 <== osd.9 v2:172.21.15.37:6826/692114850 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fed20062dc0 con 0x7fed080ade60 2024-09-11T23:17:37.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.129+0000 7fed28000640 1 -- 172.21.15.37:0/455369786 >> [v2:172.21.15.37:6826/692114850,v1:172.21.15.37:6827/692114850] conn(0x7fed080ade60 msgr2=0x7fed080b0300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:37.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.129+0000 7fed28000640 1 --2- 172.21.15.37:0/455369786 >> [v2:172.21.15.37:6826/692114850,v1:172.21.15.37:6827/692114850] conn(0x7fed080ade60 0x7fed080b0300 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:37.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.129+0000 7fed28000640 1 -- 172.21.15.37:0/455369786 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fed080a2c90 msgr2=0x7fed080a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:37.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.129+0000 7fed28000640 1 --2- 172.21.15.37:0/455369786 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fed080a2c90 0x7fed080a5150 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fed200ffeb0 tx=0x7fed0c005f90 comp rx=0 tx=0).stop 2024-09-11T23:17:37.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.129+0000 7fed28000640 1 -- 172.21.15.37:0/455369786 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed20103ff0 msgr2=0x7fed2019a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:37.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.129+0000 7fed28000640 1 --2- 172.21.15.37:0/455369786 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed20103ff0 0x7fed2019a5f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fed1400ea60 tx=0x7fed1400ef20 comp rx=0 tx=0).stop 2024-09-11T23:17:37.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.129+0000 7fed26000640 1 -- 172.21.15.37:0/455369786 reap_dead start 2024-09-11T23:17:37.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.130+0000 7fed28000640 1 -- 172.21.15.37:0/455369786 shutdown_connections 2024-09-11T23:17:37.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.130+0000 7fed28000640 1 -- 172.21.15.37:0/455369786 >> 172.21.15.37:0/455369786 conn(0x7fed200ffa90 msgr2=0x7fed20100d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:37.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.130+0000 7fed28000640 1 -- 172.21.15.37:0/455369786 shutdown_connections 2024-09-11T23:17:37.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.130+0000 7fed28000640 1 -- 172.21.15.37:0/455369786 wait complete. 2024-09-11T23:17:37.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.534+0000 7f574f000640 1 -- 172.21.15.37:0/2797314005 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5748076720 msgr2=0x7f5748076b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:37.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.534+0000 7f574f000640 1 --2- 172.21.15.37:0/2797314005 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5748076720 0x7f5748076b00 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f573c009900 tx=0x7f573c02a400 comp rx=0 tx=0).stop 2024-09-11T23:17:37.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.534+0000 7f574f000640 1 -- 172.21.15.37:0/2797314005 shutdown_connections 2024-09-11T23:17:37.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.534+0000 7f574f000640 1 --2- 172.21.15.37:0/2797314005 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5748077040 0x7f5748112330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:37.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.534+0000 7f574f000640 1 --2- 172.21.15.37:0/2797314005 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5748112870 0x7f5748114c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:37.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.534+0000 7f574f000640 1 --2- 172.21.15.37:0/2797314005 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5748076720 0x7f5748076b00 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:37.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.534+0000 7f574f000640 1 -- 172.21.15.37:0/2797314005 >> 172.21.15.37:0/2797314005 conn(0x7f57480ff8d0 msgr2=0x7f5748101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:37.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.534+0000 7f574f000640 1 -- 172.21.15.37:0/2797314005 shutdown_connections 2024-09-11T23:17:37.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.534+0000 7f574f000640 1 -- 172.21.15.37:0/2797314005 wait complete. 2024-09-11T23:17:37.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.535+0000 7f574f000640 1 Processor -- start 2024-09-11T23:17:37.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.535+0000 7f574f000640 1 -- start start 2024-09-11T23:17:37.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.535+0000 7f574f000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5748076720 0x7f57481a4600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:37.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.535+0000 7f574f000640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5748077040 0x7f57481a4b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:37.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.535+0000 7f574f000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5748112870 0x7f574819e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:37.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.535+0000 7f574f000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5748118450 con 0x7f5748112870 2024-09-11T23:17:37.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.535+0000 7f574f000640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f57481182d0 con 0x7f5748076720 2024-09-11T23:17:37.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.535+0000 7f574f000640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f57481185d0 con 0x7f5748077040 2024-09-11T23:17:37.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.536+0000 7f574e600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5748112870 0x7f574819e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:37.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.536+0000 7f574e600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5748112870 0x7f574819e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35084/0 (socket says 172.21.15.37:35084) 2024-09-11T23:17:37.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.536+0000 7f574e600640 1 -- 172.21.15.37:0/1491693595 learned_addr learned my addr 172.21.15.37:0/1491693595 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:17:37.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.536+0000 7f574dc00640 1 --2- 172.21.15.37:0/1491693595 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5748076720 0x7f57481a4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:37.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.536+0000 7f574d200640 1 --2- 172.21.15.37:0/1491693595 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5748077040 0x7f57481a4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:37.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.536+0000 7f574e600640 1 -- 172.21.15.37:0/1491693595 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5748077040 msgr2=0x7f57481a4b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:37.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.536+0000 7f574e600640 1 --2- 172.21.15.37:0/1491693595 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5748077040 0x7f57481a4b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:37.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.536+0000 7f574e600640 1 -- 172.21.15.37:0/1491693595 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5748076720 msgr2=0x7f57481a4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:37.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.536+0000 7f574e600640 1 --2- 172.21.15.37:0/1491693595 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5748076720 0x7f57481a4600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:37.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.536+0000 7f574e600640 1 -- 172.21.15.37:0/1491693595 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f574819ef40 con 0x7f5748112870 2024-09-11T23:17:37.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.536+0000 7f574e600640 1 --2- 172.21.15.37:0/1491693595 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5748112870 0x7f574819e6d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f574000eb10 tx=0x7f574000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:37.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.537+0000 7f5746000640 1 -- 172.21.15.37:0/1491693595 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5740004b20 con 0x7f5748112870 2024-09-11T23:17:37.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.537+0000 7f5746000640 1 -- 172.21.15.37:0/1491693595 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5740004cc0 con 0x7f5748112870 2024-09-11T23:17:37.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.537+0000 7f5746000640 1 -- 172.21.15.37:0/1491693595 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5740010790 con 0x7f5748112870 2024-09-11T23:17:37.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.537+0000 7f574f000640 1 -- 172.21.15.37:0/1491693595 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f574819f230 con 0x7f5748112870 2024-09-11T23:17:37.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.537+0000 7f574f000640 1 -- 172.21.15.37:0/1491693595 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57481ab3b0 con 0x7f5748112870 2024-09-11T23:17:37.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.538+0000 7f574f000640 1 -- 172.21.15.37:0/1491693595 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5748062940 con 0x7f5748112870 2024-09-11T23:17:37.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.540+0000 7f5746000640 1 -- 172.21.15.37:0/1491693595 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f5740005000 con 0x7f5748112870 2024-09-11T23:17:37.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.541+0000 7f5746000640 1 --2- 172.21.15.37:0/1491693595 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f57300a2c90 0x7f57300a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:37.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.541+0000 7f5746000640 1 -- 172.21.15.37:0/1491693595 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9092+0+0 (secure 0 0 0) 0x7f57400cfd40 con 0x7f5748112870 2024-09-11T23:17:37.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.541+0000 7f574dc00640 1 --2- 172.21.15.37:0/1491693595 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f57300a2c90 0x7f57300a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:37.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.542+0000 7f5746000640 1 --2- 172.21.15.37:0/1491693595 >> [v2:172.21.15.160:6824/3982315018,v1:172.21.15.160:6825/3982315018] conn(0x7f57300ade60 0x7f57300b0300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:37.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.542+0000 7f5746000640 1 -- 172.21.15.37:0/1491693595 --> [v2:172.21.15.160:6824/3982315018,v1:172.21.15.160:6825/3982315018] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f57300b09d0 con 0x7f57300ade60 2024-09-11T23:17:37.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.542+0000 7f5746000640 1 -- 172.21.15.37:0/1491693595 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=93) ==== 24+0+0 (secure 0 0 0) 0x7f57400d00f0 con 0x7f5748112870 2024-09-11T23:17:37.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.542+0000 7f574dc00640 1 --2- 172.21.15.37:0/1491693595 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f57300a2c90 0x7f57300a5150 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f573c000c00 tx=0x7f573c005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:37.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.542+0000 7f574d200640 1 --2- 172.21.15.37:0/1491693595 >> [v2:172.21.15.160:6824/3982315018,v1:172.21.15.160:6825/3982315018] conn(0x7f57300ade60 0x7f57300b0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:37.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.543+0000 7f574d200640 1 --2- 172.21.15.37:0/1491693595 >> [v2:172.21.15.160:6824/3982315018,v1:172.21.15.160:6825/3982315018] conn(0x7f57300ade60 0x7f57300b0300 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:37.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.544+0000 7f5746000640 1 -- 172.21.15.37:0/1491693595 <== osd.11 v2:172.21.15.160:6824/3982315018 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f57300b09d0 con 0x7f57300ade60 2024-09-11T23:17:37.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.558+0000 7f574f000640 1 -- 172.21.15.37:0/1491693595 --> [v2:172.21.15.160:6824/3982315018,v1:172.21.15.160:6825/3982315018] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5748062e10 con 0x7f57300ade60 2024-09-11T23:17:37.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.559+0000 7f5746000640 1 -- 172.21.15.37:0/1491693595 <== osd.11 v2:172.21.15.160:6824/3982315018 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f5748062e10 con 0x7f57300ade60 2024-09-11T23:17:37.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.559+0000 7f574f000640 1 -- 172.21.15.37:0/1491693595 >> [v2:172.21.15.160:6824/3982315018,v1:172.21.15.160:6825/3982315018] conn(0x7f57300ade60 msgr2=0x7f57300b0300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:37.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.559+0000 7f574f000640 1 --2- 172.21.15.37:0/1491693595 >> [v2:172.21.15.160:6824/3982315018,v1:172.21.15.160:6825/3982315018] conn(0x7f57300ade60 0x7f57300b0300 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:37.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.560+0000 7f574f000640 1 -- 172.21.15.37:0/1491693595 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f57300a2c90 msgr2=0x7f57300a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:37.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.560+0000 7f574f000640 1 --2- 172.21.15.37:0/1491693595 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f57300a2c90 0x7f57300a5150 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f573c000c00 tx=0x7f573c005b50 comp rx=0 tx=0).stop 2024-09-11T23:17:37.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.560+0000 7f574f000640 1 -- 172.21.15.37:0/1491693595 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5748112870 msgr2=0x7f574819e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:37.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.560+0000 7f574f000640 1 --2- 172.21.15.37:0/1491693595 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5748112870 0x7f574819e6d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f574000eb10 tx=0x7f574000c2d0 comp rx=0 tx=0).stop 2024-09-11T23:17:37.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.560+0000 7f574e600640 1 -- 172.21.15.37:0/1491693595 reap_dead start 2024-09-11T23:17:37.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.560+0000 7f574f000640 1 -- 172.21.15.37:0/1491693595 shutdown_connections 2024-09-11T23:17:37.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.560+0000 7f574f000640 1 -- 172.21.15.37:0/1491693595 >> 172.21.15.37:0/1491693595 conn(0x7f57480ff8d0 msgr2=0x7f5748101cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:37.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.560+0000 7f574f000640 1 -- 172.21.15.37:0/1491693595 shutdown_connections 2024-09-11T23:17:37.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:37.560+0000 7f574f000640 1 -- 172.21.15.37:0/1491693595 wait complete. 2024-09-11T23:17:38.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:37 smithi037 ceph-mon[30630]: pgmap v345: 129 pgs: 129 active+clean; 646 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 511 B/s wr, 12 op/s 2024-09-11T23:17:38.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:34.985+0000 7f3ed5c00640 1 -- 172.21.15.37:0/923603609 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ed0074e30 msgr2=0x7f3ed010df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:38.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:34.985+0000 7f3ed5c00640 1 --2- 172.21.15.37:0/923603609 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ed0074e30 0x7f3ed010df10 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f3eb8009900 tx=0x7f3eb802a480 comp rx=0 tx=0).stop 2024-09-11T23:17:38.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:34.985+0000 7f3ed5c00640 1 -- 172.21.15.37:0/923603609 shutdown_connections 2024-09-11T23:17:38.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:34.985+0000 7f3ed5c00640 1 --2- 172.21.15.37:0/923603609 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3ed010e450 0x7f3ed0110840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:38.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:34.985+0000 7f3ed5c00640 1 --2- 172.21.15.37:0/923603609 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ed0074e30 0x7f3ed010df10 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:38.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:34.985+0000 7f3ed5c00640 1 --2- 172.21.15.37:0/923603609 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3ed0074510 0x7f3ed00748f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:38.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:34.985+0000 7f3ed5c00640 1 -- 172.21.15.37:0/923603609 >> 172.21.15.37:0/923603609 conn(0x7f3ed00fd8b0 msgr2=0x7f3ed00ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:38.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:34.985+0000 7f3ed5c00640 1 -- 172.21.15.37:0/923603609 shutdown_connections 2024-09-11T23:17:38.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:34.985+0000 7f3ed5c00640 1 -- 172.21.15.37:0/923603609 wait complete. 2024-09-11T23:17:38.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:34.986+0000 7f3ed5c00640 1 Processor -- start 2024-09-11T23:17:38.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:34.986+0000 7f3ed5c00640 1 -- start start 2024-09-11T23:17:38.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:34.986+0000 7f3ed5c00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3ed0074510 0x7f3ed019a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:38.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:34.987+0000 7f3ed5c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ed0074e30 0x7f3ed019ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:38.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:34.987+0000 7f3ed5c00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3ed010e450 0x7f3ed019efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:38.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:34.987+0000 7f3ed5c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3ed0114230 con 0x7f3ed0074e30 2024-09-11T23:17:38.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:34.987+0000 7f3ed5c00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f3ed01140b0 con 0x7f3ed010e450 2024-09-11T23:17:38.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:34.987+0000 7f3ed5c00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f3ed01143b0 con 0x7f3ed0074510 2024-09-11T23:17:38.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:34.987+0000 7f3ec6000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ed0074e30 0x7f3ed019ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:38.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:34.987+0000 7f3ecea00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3ed0074510 0x7f3ed019a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:38.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:34.987+0000 7f3ecea00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3ed0074510 0x7f3ed019a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.37:45676/0 (socket says 172.21.15.37:45676) 2024-09-11T23:17:38.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:34.987+0000 7f3ec6000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ed0074e30 0x7f3ed019ac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35014/0 (socket says 172.21.15.37:35014) 2024-09-11T23:17:38.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:34.987+0000 7f3ecf400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3ed010e450 0x7f3ed019efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:38.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:34.987+0000 7f3ecea00640 1 -- 172.21.15.37:0/1725149143 learned_addr learned my addr 172.21.15.37:0/1725149143 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:17:38.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:34.987+0000 7f3ecea00640 1 -- 172.21.15.37:0/1725149143 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3ed010e450 msgr2=0x7f3ed019efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:38.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:34.987+0000 7f3ecea00640 1 --2- 172.21.15.37:0/1725149143 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3ed010e450 0x7f3ed019efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:38.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:34.987+0000 7f3ecea00640 1 -- 172.21.15.37:0/1725149143 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ed0074e30 msgr2=0x7f3ed019ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:38.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:34.987+0000 7f3ecea00640 1 --2- 172.21.15.37:0/1725149143 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ed0074e30 0x7f3ed019ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:38.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:34.987+0000 7f3ecea00640 1 -- 172.21.15.37:0/1725149143 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ed019f690 con 0x7f3ed0074510 2024-09-11T23:17:38.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:34.988+0000 7f3ec6000640 1 --2- 172.21.15.37:0/1725149143 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ed0074e30 0x7f3ed019ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:17:38.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:34.988+0000 7f3ecea00640 1 --2- 172.21.15.37:0/1725149143 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3ed0074510 0x7f3ed019a6e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3ec000ea60 tx=0x7f3ec000ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:38.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:34.988+0000 7f3ec7e00640 1 -- 172.21.15.37:0/1725149143 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ec000cde0 con 0x7f3ed0074510 2024-09-11T23:17:38.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:34.988+0000 7f3ec7e00640 1 -- 172.21.15.37:0/1725149143 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3ec00035f0 con 0x7f3ed0074510 2024-09-11T23:17:38.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:34.988+0000 7f3ec7e00640 1 -- 172.21.15.37:0/1725149143 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ec0010670 con 0x7f3ed0074510 2024-09-11T23:17:38.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:34.988+0000 7f3ed5c00640 1 -- 172.21.15.37:0/1725149143 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ed019f980 con 0x7f3ed0074510 2024-09-11T23:17:38.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:34.988+0000 7f3ed5c00640 1 -- 172.21.15.37:0/1725149143 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ed01a7260 con 0x7f3ed0074510 2024-09-11T23:17:38.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:34.989+0000 7f3ed5c00640 1 -- 172.21.15.37:0/1725149143 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3ed0062940 con 0x7f3ed0074510 2024-09-11T23:17:38.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:34.991+0000 7f3ec7e00640 1 -- 172.21.15.37:0/1725149143 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f3ec00037a0 con 0x7f3ed0074510 2024-09-11T23:17:38.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:34.992+0000 7f3ec7e00640 1 --2- 172.21.15.37:0/1725149143 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f3eb40a2c10 0x7f3eb40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:38.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:34.992+0000 7f3ec7e00640 1 -- 172.21.15.37:0/1725149143 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9092+0+0 (secure 0 0 0) 0x7f3ec00cfb10 con 0x7f3ed0074510 2024-09-11T23:17:38.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:34.993+0000 7f3ec6000640 1 --2- 172.21.15.37:0/1725149143 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f3eb40a2c10 0x7f3eb40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:38.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:34.993+0000 7f3ec7e00640 1 --2- 172.21.15.37:0/1725149143 >> [v2:172.21.15.160:6808/1618319675,v1:172.21.15.160:6809/1618319675] conn(0x7f3eb40adde0 0x7f3eb40b0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:38.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:34.993+0000 7f3ec7e00640 1 -- 172.21.15.37:0/1725149143 --> [v2:172.21.15.160:6808/1618319675,v1:172.21.15.160:6809/1618319675] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3ec0023e50 con 0x7f3eb40adde0 2024-09-11T23:17:38.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:34.993+0000 7f3ec7e00640 1 -- 172.21.15.37:0/1725149143 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_get_version_reply(handle=1 version=93) ==== 24+0+0 (secure 0 0 0) 0x7f3ec00cfec0 con 0x7f3ed0074510 2024-09-11T23:17:38.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:34.993+0000 7f3ecf400640 1 --2- 172.21.15.37:0/1725149143 >> [v2:172.21.15.160:6808/1618319675,v1:172.21.15.160:6809/1618319675] conn(0x7f3eb40adde0 0x7f3eb40b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:38.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:34.993+0000 7f3ec6000640 1 --2- 172.21.15.37:0/1725149143 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f3eb40a2c10 0x7f3eb40a50d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3eb8000c00 tx=0x7f3eb8031510 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:38.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:34.994+0000 7f3ecf400640 1 --2- 172.21.15.37:0/1725149143 >> [v2:172.21.15.160:6808/1618319675,v1:172.21.15.160:6809/1618319675] conn(0x7f3eb40adde0 0x7f3eb40b0280 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:38.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:34.995+0000 7f3ec7e00640 1 -- 172.21.15.37:0/1725149143 <== osd.5 v2:172.21.15.160:6808/1618319675 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3ec0023e50 con 0x7f3eb40adde0 2024-09-11T23:17:38.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.009+0000 7f3ed5c00640 1 -- 172.21.15.37:0/1725149143 --> [v2:172.21.15.160:6808/1618319675,v1:172.21.15.160:6809/1618319675] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3ed0062d40 con 0x7f3eb40adde0 2024-09-11T23:17:38.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.010+0000 7f3ec7e00640 1 -- 172.21.15.37:0/1725149143 <== osd.5 v2:172.21.15.160:6808/1618319675 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f3ed0062d40 con 0x7f3eb40adde0 2024-09-11T23:17:38.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.010+0000 7f3ed5c00640 1 -- 172.21.15.37:0/1725149143 >> [v2:172.21.15.160:6808/1618319675,v1:172.21.15.160:6809/1618319675] conn(0x7f3eb40adde0 msgr2=0x7f3eb40b0280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:38.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.010+0000 7f3ed5c00640 1 --2- 172.21.15.37:0/1725149143 >> [v2:172.21.15.160:6808/1618319675,v1:172.21.15.160:6809/1618319675] conn(0x7f3eb40adde0 0x7f3eb40b0280 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:38.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.011+0000 7f3ed5c00640 1 -- 172.21.15.37:0/1725149143 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f3eb40a2c10 msgr2=0x7f3eb40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:38.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.011+0000 7f3ed5c00640 1 --2- 172.21.15.37:0/1725149143 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f3eb40a2c10 0x7f3eb40a50d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3eb8000c00 tx=0x7f3eb8031510 comp rx=0 tx=0).stop 2024-09-11T23:17:38.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.011+0000 7f3ed5c00640 1 -- 172.21.15.37:0/1725149143 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3ed0074510 msgr2=0x7f3ed019a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:38.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.011+0000 7f3ed5c00640 1 --2- 172.21.15.37:0/1725149143 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3ed0074510 0x7f3ed019a6e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3ec000ea60 tx=0x7f3ec000ef20 comp rx=0 tx=0).stop 2024-09-11T23:17:38.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.011+0000 7f3ecf400640 1 -- 172.21.15.37:0/1725149143 reap_dead start 2024-09-11T23:17:38.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.011+0000 7f3ed5c00640 1 -- 172.21.15.37:0/1725149143 shutdown_connections 2024-09-11T23:17:38.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.011+0000 7f3ed5c00640 1 -- 172.21.15.37:0/1725149143 >> 172.21.15.37:0/1725149143 conn(0x7f3ed00fd8b0 msgr2=0x7f3ed00fe550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:38.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.011+0000 7f3ed5c00640 1 -- 172.21.15.37:0/1725149143 shutdown_connections 2024-09-11T23:17:38.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:35.011+0000 7f3ed5c00640 1 -- 172.21.15.37:0/1725149143 wait complete. 2024-09-11T23:17:38.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:37 smithi160 ceph-mon[35055]: pgmap v345: 129 pgs: 129 active+clean; 646 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 511 B/s wr, 12 op/s 2024-09-11T23:17:38.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:37 smithi123 ceph-mon[35438]: pgmap v345: 129 pgs: 129 active+clean; 646 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 511 B/s wr, 12 op/s 2024-09-11T23:17:38.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:38.120+0000 7f9b26e00640 1 -- 172.21.15.37:0/405078003 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b201049c0 msgr2=0x7f9b20108a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:38.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:38.120+0000 7f9b26e00640 1 --2- 172.21.15.37:0/405078003 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b201049c0 0x7f9b20108a10 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f9b08009900 tx=0x7f9b0802a410 comp rx=0 tx=0).stop 2024-09-11T23:17:38.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:38.121+0000 7f9b26e00640 1 -- 172.21.15.37:0/405078003 shutdown_connections 2024-09-11T23:17:38.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:38.121+0000 7f9b26e00640 1 --2- 172.21.15.37:0/405078003 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9b20109140 0x7f9b20110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:38.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:38.121+0000 7f9b26e00640 1 --2- 172.21.15.37:0/405078003 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b201049c0 0x7f9b20108a10 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:38.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:38.121+0000 7f9b26e00640 1 --2- 172.21.15.37:0/405078003 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b20104010 0x7f9b201043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:38.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:38.121+0000 7f9b26e00640 1 -- 172.21.15.37:0/405078003 >> 172.21.15.37:0/405078003 conn(0x7f9b200ffa50 msgr2=0x7f9b20101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:38.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:38.121+0000 7f9b26e00640 1 -- 172.21.15.37:0/405078003 shutdown_connections 2024-09-11T23:17:38.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:38.121+0000 7f9b26e00640 1 -- 172.21.15.37:0/405078003 wait complete. 2024-09-11T23:17:38.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:38.122+0000 7f9b26e00640 1 Processor -- start 2024-09-11T23:17:38.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:38.122+0000 7f9b26e00640 1 -- start start 2024-09-11T23:17:38.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:38.123+0000 7f9b26e00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9b20104010 0x7f9b2019a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:38.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:38.123+0000 7f9b26e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b201049c0 0x7f9b2019abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:38.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:38.123+0000 7f9b26e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b20109140 0x7f9b2019ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:38.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:38.123+0000 7f9b26e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9b20114140 con 0x7f9b20109140 2024-09-11T23:17:38.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:38.123+0000 7f9b26e00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f9b20113fc0 con 0x7f9b201049c0 2024-09-11T23:17:38.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:38.123+0000 7f9b26e00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f9b201142c0 con 0x7f9b20104010 2024-09-11T23:17:38.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:38.123+0000 7f9b24e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b20109140 0x7f9b2019ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:38.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:38.123+0000 7f9b17400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b201049c0 0x7f9b2019abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:38.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:38.123+0000 7f9b1fe00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9b20104010 0x7f9b2019a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:38.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:38.123+0000 7f9b17400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b201049c0 0x7f9b2019abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.37:55552/0 (socket says 172.21.15.37:55552) 2024-09-11T23:17:38.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:38.123+0000 7f9b17400640 1 -- 172.21.15.37:0/2465453926 learned_addr learned my addr 172.21.15.37:0/2465453926 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:17:38.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:38.123+0000 7f9b24e00640 1 --2- 172.21.15.37:0/2465453926 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b20109140 0x7f9b2019ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35114/0 (socket says 172.21.15.37:35114) 2024-09-11T23:17:38.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:38.123+0000 7f9b17400640 1 -- 172.21.15.37:0/2465453926 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9b20104010 msgr2=0x7f9b2019a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:38.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:38.123+0000 7f9b17400640 1 --2- 172.21.15.37:0/2465453926 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9b20104010 0x7f9b2019a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:38.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:38.123+0000 7f9b17400640 1 -- 172.21.15.37:0/2465453926 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b20109140 msgr2=0x7f9b2019ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:38.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:38.123+0000 7f9b17400640 1 --2- 172.21.15.37:0/2465453926 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b20109140 0x7f9b2019ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:38.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:38.123+0000 7f9b17400640 1 -- 172.21.15.37:0/2465453926 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b2019f630 con 0x7f9b201049c0 2024-09-11T23:17:38.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:38.123+0000 7f9b24e00640 1 --2- 172.21.15.37:0/2465453926 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b20109140 0x7f9b2019ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:17:38.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:38.124+0000 7f9b17400640 1 --2- 172.21.15.37:0/2465453926 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b201049c0 0x7f9b2019abc0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9b08006010 tx=0x7f9b08004040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:38.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:38.124+0000 7f9b1d600640 1 -- 172.21.15.37:0/2465453926 <== mon.2 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b0803f030 con 0x7f9b201049c0 2024-09-11T23:17:38.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:38.124+0000 7f9b26e00640 1 -- 172.21.15.37:0/2465453926 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b2019f8c0 con 0x7f9b201049c0 2024-09-11T23:17:38.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:38.124+0000 7f9b1d600640 1 -- 172.21.15.37:0/2465453926 <== mon.2 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9b08004440 con 0x7f9b201049c0 2024-09-11T23:17:38.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:38.124+0000 7f9b1d600640 1 -- 172.21.15.37:0/2465453926 <== mon.2 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b08035070 con 0x7f9b201049c0 2024-09-11T23:17:38.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:38.124+0000 7f9b26e00640 1 -- 172.21.15.37:0/2465453926 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b201a7200 con 0x7f9b201049c0 2024-09-11T23:17:38.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:38.125+0000 7f9b26e00640 1 -- 172.21.15.37:0/2465453926 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9b20062980 con 0x7f9b201049c0 2024-09-11T23:17:38.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:38.127+0000 7f9b1d600640 1 -- 172.21.15.37:0/2465453926 <== mon.2 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f9b08042030 con 0x7f9b201049c0 2024-09-11T23:17:38.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:38.128+0000 7f9b1d600640 1 --2- 172.21.15.37:0/2465453926 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f9b040a2c90 0x7f9b040a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:38.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:38.129+0000 7f9b1d600640 1 -- 172.21.15.37:0/2465453926 <== mon.2 v2:172.21.15.123:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9092+0+0 (secure 0 0 0) 0x7f9b080efe50 con 0x7f9b201049c0 2024-09-11T23:17:38.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:38.129+0000 7f9b1fe00640 1 --2- 172.21.15.37:0/2465453926 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f9b040a2c90 0x7f9b040a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:38.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:38.129+0000 7f9b1d600640 1 --2- 172.21.15.37:0/2465453926 >> [v2:172.21.15.123:6808/3228822066,v1:172.21.15.123:6809/3228822066] conn(0x7f9b040ade60 0x7f9b040b0300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:38.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:38.129+0000 7f9b1d600640 1 -- 172.21.15.37:0/2465453926 --> [v2:172.21.15.123:6808/3228822066,v1:172.21.15.123:6809/3228822066] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9b0803ce50 con 0x7f9b040ade60 2024-09-11T23:17:38.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:38.129+0000 7f9b1d600640 1 -- 172.21.15.37:0/2465453926 <== mon.2 v2:172.21.15.123:3300/0 6 ==== mon_get_version_reply(handle=1 version=93) ==== 24+0+0 (secure 0 0 0) 0x7f9b080f0200 con 0x7f9b201049c0 2024-09-11T23:17:38.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:38.129+0000 7f9b24e00640 1 --2- 172.21.15.37:0/2465453926 >> [v2:172.21.15.123:6808/3228822066,v1:172.21.15.123:6809/3228822066] conn(0x7f9b040ade60 0x7f9b040b0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:38.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:38.129+0000 7f9b1fe00640 1 --2- 172.21.15.37:0/2465453926 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f9b040a2c90 0x7f9b040a5150 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f9b10009bd0 tx=0x7f9b10005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:38.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:38.130+0000 7f9b24e00640 1 --2- 172.21.15.37:0/2465453926 >> [v2:172.21.15.123:6808/3228822066,v1:172.21.15.123:6809/3228822066] conn(0x7f9b040ade60 0x7f9b040b0300 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:38.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:38.131+0000 7f9b1d600640 1 -- 172.21.15.37:0/2465453926 <== osd.4 v2:172.21.15.123:6808/3228822066 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9b0803ce50 con 0x7f9b040ade60 2024-09-11T23:17:38.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:38.146+0000 7f9b26e00640 1 -- 172.21.15.37:0/2465453926 --> [v2:172.21.15.123:6808/3228822066,v1:172.21.15.123:6809/3228822066] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9b20062d80 con 0x7f9b040ade60 2024-09-11T23:17:38.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:38.146+0000 7f9b1d600640 1 -- 172.21.15.37:0/2465453926 <== osd.4 v2:172.21.15.123:6808/3228822066 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f9b20062d80 con 0x7f9b040ade60 2024-09-11T23:17:38.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:38.147+0000 7f9b26e00640 1 -- 172.21.15.37:0/2465453926 >> [v2:172.21.15.123:6808/3228822066,v1:172.21.15.123:6809/3228822066] conn(0x7f9b040ade60 msgr2=0x7f9b040b0300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:38.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:38.147+0000 7f9b26e00640 1 --2- 172.21.15.37:0/2465453926 >> [v2:172.21.15.123:6808/3228822066,v1:172.21.15.123:6809/3228822066] conn(0x7f9b040ade60 0x7f9b040b0300 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:38.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:38.147+0000 7f9b26e00640 1 -- 172.21.15.37:0/2465453926 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f9b040a2c90 msgr2=0x7f9b040a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:38.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:38.147+0000 7f9b26e00640 1 --2- 172.21.15.37:0/2465453926 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f9b040a2c90 0x7f9b040a5150 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f9b10009bd0 tx=0x7f9b10005f90 comp rx=0 tx=0).stop 2024-09-11T23:17:38.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:38.147+0000 7f9b26e00640 1 -- 172.21.15.37:0/2465453926 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b201049c0 msgr2=0x7f9b2019abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:38.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:38.147+0000 7f9b26e00640 1 --2- 172.21.15.37:0/2465453926 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b201049c0 0x7f9b2019abc0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9b08006010 tx=0x7f9b08004040 comp rx=0 tx=0).stop 2024-09-11T23:17:38.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:38.147+0000 7f9b24e00640 1 -- 172.21.15.37:0/2465453926 reap_dead start 2024-09-11T23:17:38.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:38.147+0000 7f9b26e00640 1 -- 172.21.15.37:0/2465453926 shutdown_connections 2024-09-11T23:17:38.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:38.147+0000 7f9b26e00640 1 -- 172.21.15.37:0/2465453926 >> 172.21.15.37:0/2465453926 conn(0x7f9b200ffa50 msgr2=0x7f9b20100e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:38.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:38.147+0000 7f9b26e00640 1 -- 172.21.15.37:0/2465453926 shutdown_connections 2024-09-11T23:17:38.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:38.147+0000 7f9b26e00640 1 -- 172.21.15.37:0/2465453926 wait complete. 2024-09-11T23:17:39.531 INFO:teuthology.orchestra.run.smithi037.stdout:107374182473 2024-09-11T23:17:39.531 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-11T23:17:40.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:39 smithi160 ceph-mon[35055]: pgmap v346: 129 pgs: 129 active+clean; 646 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-11T23:17:40.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:39 smithi123 ceph-mon[35438]: pgmap v346: 129 pgs: 129 active+clean; 646 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-11T23:17:40.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:39 smithi037 ceph-mon[30630]: pgmap v346: 129 pgs: 129 active+clean; 646 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-11T23:17:40.394 INFO:teuthology.orchestra.run.smithi037.stdout:326417514526 2024-09-11T23:17:40.394 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-09-11T23:17:40.733 INFO:teuthology.orchestra.run.smithi037.stdout:188978561082 2024-09-11T23:17:40.733 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-09-11T23:17:41.086 INFO:teuthology.orchestra.run.smithi037.stdout:158913790014 2024-09-11T23:17:41.087 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-11T23:17:41.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:41.826+0000 7fd95b000640 1 -- 172.21.15.37:0/3815814997 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd954076720 msgr2=0x7fd954076b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:41.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:41.826+0000 7fd95b000640 1 --2- 172.21.15.37:0/3815814997 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd954076720 0x7fd954076b00 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fd944009900 tx=0x7fd94402a3f0 comp rx=0 tx=0).stop 2024-09-11T23:17:41.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:41.826+0000 7fd95b000640 1 -- 172.21.15.37:0/3815814997 shutdown_connections 2024-09-11T23:17:41.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:41.826+0000 7fd95b000640 1 --2- 172.21.15.37:0/3815814997 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd954077040 0x7fd9541124f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:41.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:41.826+0000 7fd95b000640 1 --2- 172.21.15.37:0/3815814997 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd954112a30 0x7fd954114e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:41.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:41.826+0000 7fd95b000640 1 --2- 172.21.15.37:0/3815814997 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd954076720 0x7fd954076b00 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:41.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:41.826+0000 7fd95b000640 1 -- 172.21.15.37:0/3815814997 >> 172.21.15.37:0/3815814997 conn(0x7fd9540ffa90 msgr2=0x7fd954101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:41.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:41.826+0000 7fd95b000640 1 -- 172.21.15.37:0/3815814997 shutdown_connections 2024-09-11T23:17:41.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:41.826+0000 7fd95b000640 1 -- 172.21.15.37:0/3815814997 wait complete. 2024-09-11T23:17:41.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:41.827+0000 7fd95b000640 1 Processor -- start 2024-09-11T23:17:41.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:41.827+0000 7fd95b000640 1 -- start start 2024-09-11T23:17:41.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:41.828+0000 7fd95b000640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd954076720 0x7fd9541a4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:41.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:41.828+0000 7fd95b000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd954077040 0x7fd9541a4c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:41.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:41.828+0000 7fd95b000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd954112a30 0x7fd95419e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:41.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:41.828+0000 7fd95b000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd9541185f0 con 0x7fd954077040 2024-09-11T23:17:41.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:41.828+0000 7fd95b000640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fd954118470 con 0x7fd954112a30 2024-09-11T23:17:41.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:41.828+0000 7fd95b000640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fd954118770 con 0x7fd954076720 2024-09-11T23:17:41.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:41.828+0000 7fd953400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd954077040 0x7fd9541a4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:41.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:41.828+0000 7fd953e00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd954076720 0x7fd9541a4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:41.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:41.828+0000 7fd953e00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd954076720 0x7fd9541a4720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.37:42204/0 (socket says 172.21.15.37:42204) 2024-09-11T23:17:41.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:41.828+0000 7fd953400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd954077040 0x7fd9541a4c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48300/0 (socket says 172.21.15.37:48300) 2024-09-11T23:17:41.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:41.828+0000 7fd953e00640 1 -- 172.21.15.37:0/496093127 learned_addr learned my addr 172.21.15.37:0/496093127 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:17:41.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:41.828+0000 7fd959000640 1 --2- 172.21.15.37:0/496093127 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd954112a30 0x7fd95419e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:41.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:41.828+0000 7fd959000640 1 -- 172.21.15.37:0/496093127 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd954076720 msgr2=0x7fd9541a4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:41.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:41.828+0000 7fd959000640 1 --2- 172.21.15.37:0/496093127 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd954076720 0x7fd9541a4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:41.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:41.828+0000 7fd959000640 1 -- 172.21.15.37:0/496093127 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd954077040 msgr2=0x7fd9541a4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:41.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:41.828+0000 7fd959000640 1 --2- 172.21.15.37:0/496093127 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd954077040 0x7fd9541a4c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:41.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:41.828+0000 7fd959000640 1 -- 172.21.15.37:0/496093127 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd95419f010 con 0x7fd954112a30 2024-09-11T23:17:41.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:41.829+0000 7fd953400640 1 --2- 172.21.15.37:0/496093127 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd954077040 0x7fd9541a4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:17:41.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:41.829+0000 7fd959000640 1 --2- 172.21.15.37:0/496093127 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd954112a30 0x7fd95419e8e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd95407aa10 tx=0x7fd94c00c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:41.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:41.829+0000 7fd950c00640 1 -- 172.21.15.37:0/496093127 <== mon.2 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd94c003b70 con 0x7fd954112a30 2024-09-11T23:17:41.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:41.829+0000 7fd950c00640 1 -- 172.21.15.37:0/496093127 <== mon.2 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd94c00ce40 con 0x7fd954112a30 2024-09-11T23:17:41.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:41.829+0000 7fd95b000640 1 -- 172.21.15.37:0/496093127 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd95419f300 con 0x7fd954112a30 2024-09-11T23:17:41.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:41.829+0000 7fd950c00640 1 -- 172.21.15.37:0/496093127 <== mon.2 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd94c010830 con 0x7fd954112a30 2024-09-11T23:17:41.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:41.829+0000 7fd95b000640 1 -- 172.21.15.37:0/496093127 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9541ab5f0 con 0x7fd954112a30 2024-09-11T23:17:41.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:41.830+0000 7fd95b000640 1 -- 172.21.15.37:0/496093127 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd954062980 con 0x7fd954112a30 2024-09-11T23:17:41.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:41.832+0000 7fd950c00640 1 -- 172.21.15.37:0/496093127 <== mon.2 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fd94c0109d0 con 0x7fd954112a30 2024-09-11T23:17:41.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:41.834+0000 7fd950c00640 1 --2- 172.21.15.37:0/496093127 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fd9380a2c10 0x7fd9380a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:41.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:41.834+0000 7fd950c00640 1 -- 172.21.15.37:0/496093127 <== mon.2 v2:172.21.15.123:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9092+0+0 (secure 0 0 0) 0x7fd94c0cfd50 con 0x7fd954112a30 2024-09-11T23:17:41.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:41.834+0000 7fd953e00640 1 --2- 172.21.15.37:0/496093127 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fd9380a2c10 0x7fd9380a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:41.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:41.834+0000 7fd950c00640 1 --2- 172.21.15.37:0/496093127 >> [v2:172.21.15.123:6800/141504725,v1:172.21.15.123:6801/141504725] conn(0x7fd9380adde0 0x7fd9380b0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:41.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:41.834+0000 7fd950c00640 1 -- 172.21.15.37:0/496093127 --> [v2:172.21.15.123:6800/141504725,v1:172.21.15.123:6801/141504725] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd94c017e50 con 0x7fd9380adde0 2024-09-11T23:17:41.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:41.834+0000 7fd950c00640 1 -- 172.21.15.37:0/496093127 <== mon.2 v2:172.21.15.123:3300/0 6 ==== mon_get_version_reply(handle=1 version=93) ==== 24+0+0 (secure 0 0 0) 0x7fd94c0d0100 con 0x7fd954112a30 2024-09-11T23:17:41.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:41.835+0000 7fd953400640 1 --2- 172.21.15.37:0/496093127 >> [v2:172.21.15.123:6800/141504725,v1:172.21.15.123:6801/141504725] conn(0x7fd9380adde0 0x7fd9380b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:41.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:41.835+0000 7fd953e00640 1 --2- 172.21.15.37:0/496093127 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fd9380a2c10 0x7fd9380a50d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd9440096c0 tx=0x7fd9440046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:41.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:41.835+0000 7fd953400640 1 --2- 172.21.15.37:0/496093127 >> [v2:172.21.15.123:6800/141504725,v1:172.21.15.123:6801/141504725] conn(0x7fd9380adde0 0x7fd9380b0280 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:41.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:41.836+0000 7fd950c00640 1 -- 172.21.15.37:0/496093127 <== osd.1 v2:172.21.15.123:6800/141504725 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd94c017e50 con 0x7fd9380adde0 2024-09-11T23:17:41.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:41.851+0000 7fd95b000640 1 -- 172.21.15.37:0/496093127 --> [v2:172.21.15.123:6800/141504725,v1:172.21.15.123:6801/141504725] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd954062e00 con 0x7fd9380adde0 2024-09-11T23:17:41.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:41.852+0000 7fd950c00640 1 -- 172.21.15.37:0/496093127 <== osd.1 v2:172.21.15.123:6800/141504725 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fd954062e00 con 0x7fd9380adde0 2024-09-11T23:17:41.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:41.852+0000 7fd95b000640 1 -- 172.21.15.37:0/496093127 >> [v2:172.21.15.123:6800/141504725,v1:172.21.15.123:6801/141504725] conn(0x7fd9380adde0 msgr2=0x7fd9380b0280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:41.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:41.852+0000 7fd95b000640 1 --2- 172.21.15.37:0/496093127 >> [v2:172.21.15.123:6800/141504725,v1:172.21.15.123:6801/141504725] conn(0x7fd9380adde0 0x7fd9380b0280 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:41.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:41.852+0000 7fd95b000640 1 -- 172.21.15.37:0/496093127 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fd9380a2c10 msgr2=0x7fd9380a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:41.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:41.852+0000 7fd95b000640 1 --2- 172.21.15.37:0/496093127 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fd9380a2c10 0x7fd9380a50d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd9440096c0 tx=0x7fd9440046c0 comp rx=0 tx=0).stop 2024-09-11T23:17:41.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:41.853+0000 7fd95b000640 1 -- 172.21.15.37:0/496093127 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd954112a30 msgr2=0x7fd95419e8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:41.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:41.853+0000 7fd95b000640 1 --2- 172.21.15.37:0/496093127 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd954112a30 0x7fd95419e8e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd95407aa10 tx=0x7fd94c00c6a0 comp rx=0 tx=0).stop 2024-09-11T23:17:41.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:41.853+0000 7fd959000640 1 -- 172.21.15.37:0/496093127 reap_dead start 2024-09-11T23:17:41.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:41.853+0000 7fd95b000640 1 -- 172.21.15.37:0/496093127 shutdown_connections 2024-09-11T23:17:41.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:41.853+0000 7fd95b000640 1 -- 172.21.15.37:0/496093127 >> 172.21.15.37:0/496093127 conn(0x7fd9540ffa90 msgr2=0x7fd954113630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:41.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:41.853+0000 7fd95b000640 1 -- 172.21.15.37:0/496093127 shutdown_connections 2024-09-11T23:17:41.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:41.853+0000 7fd95b000640 1 -- 172.21.15.37:0/496093127 wait complete. 2024-09-11T23:17:42.086 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:41 smithi037 ceph-mon[30630]: pgmap v347: 129 pgs: 129 active+clean; 646 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 10 op/s 2024-09-11T23:17:42.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:41 smithi160 ceph-mon[35055]: pgmap v347: 129 pgs: 129 active+clean; 646 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 10 op/s 2024-09-11T23:17:42.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:41 smithi123 ceph-mon[35438]: pgmap v347: 129 pgs: 129 active+clean; 646 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 10 op/s 2024-09-11T23:17:42.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:42.079+0000 7f08e7800640 1 -- 172.21.15.37:0/1858285990 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f08e0103ff0 msgr2=0x7f08e01043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:42.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:42.079+0000 7f08e7800640 1 --2- 172.21.15.37:0/1858285990 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f08e0103ff0 0x7f08e01043d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f08d4009860 tx=0x7f08d402a340 comp rx=0 tx=0).stop 2024-09-11T23:17:42.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:42.079+0000 7f08e7800640 1 -- 172.21.15.37:0/1858285990 shutdown_connections 2024-09-11T23:17:42.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:42.079+0000 7f08e7800640 1 --2- 172.21.15.37:0/1858285990 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f08e01049a0 0x7f08e01089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:42.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:42.079+0000 7f08e7800640 1 --2- 172.21.15.37:0/1858285990 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08e0109120 0x7f08e0110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:42.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:42.079+0000 7f08e7800640 1 --2- 172.21.15.37:0/1858285990 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f08e0103ff0 0x7f08e01043d0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:42.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:42.079+0000 7f08e7800640 1 -- 172.21.15.37:0/1858285990 >> 172.21.15.37:0/1858285990 conn(0x7f08e00ffa90 msgr2=0x7f08e0101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:42.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:42.079+0000 7f08e7800640 1 -- 172.21.15.37:0/1858285990 shutdown_connections 2024-09-11T23:17:42.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:42.079+0000 7f08e7800640 1 -- 172.21.15.37:0/1858285990 wait complete. 2024-09-11T23:17:42.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:42.080+0000 7f08e7800640 1 Processor -- start 2024-09-11T23:17:42.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:42.080+0000 7f08e7800640 1 -- start start 2024-09-11T23:17:42.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:42.081+0000 7f08e7800640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f08e0103ff0 0x7f08e019a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:42.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:42.081+0000 7f08e7800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f08e01049a0 0x7f08e019ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:42.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:42.081+0000 7f08e7800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08e0109120 0x7f08e019eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:42.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:42.081+0000 7f08e7800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f08e0114120 con 0x7f08e0109120 2024-09-11T23:17:42.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:42.081+0000 7f08e7800640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f08e0113fa0 con 0x7f08e01049a0 2024-09-11T23:17:42.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:42.081+0000 7f08e7800640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f08e01142a0 con 0x7f08e0103ff0 2024-09-11T23:17:42.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:42.081+0000 7f08e4e00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f08e0103ff0 0x7f08e019a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:42.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:42.081+0000 7f08e4e00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f08e0103ff0 0x7f08e019a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.37:42226/0 (socket says 172.21.15.37:42226) 2024-09-11T23:17:42.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:42.081+0000 7f08e4e00640 1 -- 172.21.15.37:0/3588089478 learned_addr learned my addr 172.21.15.37:0/3588089478 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:17:42.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:42.081+0000 7f08e5800640 1 --2- 172.21.15.37:0/3588089478 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08e0109120 0x7f08e019eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:42.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:42.081+0000 7f08dfe00640 1 --2- 172.21.15.37:0/3588089478 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f08e01049a0 0x7f08e019ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:42.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:42.082+0000 7f08e4e00640 1 -- 172.21.15.37:0/3588089478 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f08e01049a0 msgr2=0x7f08e019ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:42.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:42.082+0000 7f08e4e00640 1 --2- 172.21.15.37:0/3588089478 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f08e01049a0 0x7f08e019ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:42.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:42.082+0000 7f08e4e00640 1 -- 172.21.15.37:0/3588089478 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08e0109120 msgr2=0x7f08e019eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:42.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:42.082+0000 7f08e4e00640 1 --2- 172.21.15.37:0/3588089478 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08e0109120 0x7f08e019eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:42.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:42.082+0000 7f08e4e00640 1 -- 172.21.15.37:0/3588089478 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08e019f5d0 con 0x7f08e0103ff0 2024-09-11T23:17:42.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:42.082+0000 7f08e4e00640 1 --2- 172.21.15.37:0/3588089478 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f08e0103ff0 0x7f08e019a620 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f08d4035040 tx=0x7f08d4033d90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:42.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:42.082+0000 7f08dd600640 1 -- 172.21.15.37:0/3588089478 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08d403f020 con 0x7f08e0103ff0 2024-09-11T23:17:42.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:42.082+0000 7f08dd600640 1 -- 172.21.15.37:0/3588089478 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f08d4032770 con 0x7f08e0103ff0 2024-09-11T23:17:42.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:42.082+0000 7f08e7800640 1 -- 172.21.15.37:0/3588089478 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08e019f860 con 0x7f08e0103ff0 2024-09-11T23:17:42.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:42.082+0000 7f08dd600640 1 -- 172.21.15.37:0/3588089478 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08d4037040 con 0x7f08e0103ff0 2024-09-11T23:17:42.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:42.083+0000 7f08e7800640 1 -- 172.21.15.37:0/3588089478 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08e01a71a0 con 0x7f08e0103ff0 2024-09-11T23:17:42.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:42.083+0000 7f08d2a00640 1 -- 172.21.15.37:0/3588089478 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f08e0062980 con 0x7f08e0103ff0 2024-09-11T23:17:42.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:42.086+0000 7f08dd600640 1 -- 172.21.15.37:0/3588089478 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f08d4042020 con 0x7f08e0103ff0 2024-09-11T23:17:42.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:42.087+0000 7f08dd600640 1 --2- 172.21.15.37:0/3588089478 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f08c80a2c10 0x7f08c80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:42.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:42.087+0000 7f08dd600640 1 -- 172.21.15.37:0/3588089478 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9092+0+0 (secure 0 0 0) 0x7f08d40ef9e0 con 0x7f08e0103ff0 2024-09-11T23:17:42.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:42.088+0000 7f08dfe00640 1 --2- 172.21.15.37:0/3588089478 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f08c80a2c10 0x7f08c80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:42.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:42.088+0000 7f08dd600640 1 --2- 172.21.15.37:0/3588089478 >> [v2:172.21.15.160:6816/740968584,v1:172.21.15.160:6817/740968584] conn(0x7f08c80adde0 0x7f08c80b0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:42.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:42.088+0000 7f08dd600640 1 -- 172.21.15.37:0/3588089478 --> [v2:172.21.15.160:6816/740968584,v1:172.21.15.160:6817/740968584] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f08d4048e70 con 0x7f08c80adde0 2024-09-11T23:17:42.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:42.088+0000 7f08dd600640 1 -- 172.21.15.37:0/3588089478 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_get_version_reply(handle=1 version=93) ==== 24+0+0 (secure 0 0 0) 0x7f08d40efd90 con 0x7f08e0103ff0 2024-09-11T23:17:42.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:42.088+0000 7f08e5800640 1 --2- 172.21.15.37:0/3588089478 >> [v2:172.21.15.160:6816/740968584,v1:172.21.15.160:6817/740968584] conn(0x7f08c80adde0 0x7f08c80b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:42.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:42.088+0000 7f08dfe00640 1 --2- 172.21.15.37:0/3588089478 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f08c80a2c10 0x7f08c80a50d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f08e00ffeb0 tx=0x7f08cc009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:42.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:42.089+0000 7f08e5800640 1 --2- 172.21.15.37:0/3588089478 >> [v2:172.21.15.160:6816/740968584,v1:172.21.15.160:6817/740968584] conn(0x7f08c80adde0 0x7f08c80b0280 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:42.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:42.090+0000 7f08dd600640 1 -- 172.21.15.37:0/3588089478 <== osd.8 v2:172.21.15.160:6816/740968584 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f08d4048e70 con 0x7f08c80adde0 2024-09-11T23:17:42.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:42.105+0000 7f08d2a00640 1 -- 172.21.15.37:0/3588089478 --> [v2:172.21.15.160:6816/740968584,v1:172.21.15.160:6817/740968584] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f08e0062e00 con 0x7f08c80adde0 2024-09-11T23:17:42.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:42.105+0000 7f08dd600640 1 -- 172.21.15.37:0/3588089478 <== osd.8 v2:172.21.15.160:6816/740968584 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f08e0062e00 con 0x7f08c80adde0 2024-09-11T23:17:42.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:42.106+0000 7f08d2a00640 1 -- 172.21.15.37:0/3588089478 >> [v2:172.21.15.160:6816/740968584,v1:172.21.15.160:6817/740968584] conn(0x7f08c80adde0 msgr2=0x7f08c80b0280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:42.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:42.106+0000 7f08d2a00640 1 --2- 172.21.15.37:0/3588089478 >> [v2:172.21.15.160:6816/740968584,v1:172.21.15.160:6817/740968584] conn(0x7f08c80adde0 0x7f08c80b0280 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:42.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:42.106+0000 7f08d2a00640 1 -- 172.21.15.37:0/3588089478 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f08c80a2c10 msgr2=0x7f08c80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:42.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:42.106+0000 7f08d2a00640 1 --2- 172.21.15.37:0/3588089478 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f08c80a2c10 0x7f08c80a50d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f08e00ffeb0 tx=0x7f08cc009260 comp rx=0 tx=0).stop 2024-09-11T23:17:42.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:42.106+0000 7f08d2a00640 1 -- 172.21.15.37:0/3588089478 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f08e0103ff0 msgr2=0x7f08e019a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:42.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:42.106+0000 7f08d2a00640 1 --2- 172.21.15.37:0/3588089478 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f08e0103ff0 0x7f08e019a620 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f08d4035040 tx=0x7f08d4033d90 comp rx=0 tx=0).stop 2024-09-11T23:17:42.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:42.106+0000 7f08e5800640 1 -- 172.21.15.37:0/3588089478 reap_dead start 2024-09-11T23:17:42.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:42.106+0000 7f08d2a00640 1 -- 172.21.15.37:0/3588089478 shutdown_connections 2024-09-11T23:17:42.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:42.106+0000 7f08d2a00640 1 -- 172.21.15.37:0/3588089478 >> 172.21.15.37:0/3588089478 conn(0x7f08e00ffa90 msgr2=0x7f08e0100db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:42.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:42.106+0000 7f08d2a00640 1 -- 172.21.15.37:0/3588089478 shutdown_connections 2024-09-11T23:17:42.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:42.106+0000 7f08d2a00640 1 -- 172.21.15.37:0/3588089478 wait complete. 2024-09-11T23:17:43.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:43.021+0000 7f8b4e800640 1 -- 172.21.15.37:0/3361920218 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b481034b0 msgr2=0x7f8b4810b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:43.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:43.021+0000 7f8b4e800640 1 --2- 172.21.15.37:0/3361920218 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b481034b0 0x7f8b4810b9a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f8b34009900 tx=0x7f8b3402a480 comp rx=0 tx=0).stop 2024-09-11T23:17:43.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:43.021+0000 7f8b4e800640 1 -- 172.21.15.37:0/3361920218 shutdown_connections 2024-09-11T23:17:43.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:43.021+0000 7f8b4e800640 1 --2- 172.21.15.37:0/3361920218 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8b4810bfc0 0x7f8b4810e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:43.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:43.021+0000 7f8b4e800640 1 --2- 172.21.15.37:0/3361920218 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b481034b0 0x7f8b4810b9a0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:43.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:43.021+0000 7f8b4e800640 1 --2- 172.21.15.37:0/3361920218 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b48102b90 0x7f8b48102f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:43.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:43.021+0000 7f8b4e800640 1 -- 172.21.15.37:0/3361920218 >> 172.21.15.37:0/3361920218 conn(0x7f8b480fc610 msgr2=0x7f8b480fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:43.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:43.021+0000 7f8b4e800640 1 -- 172.21.15.37:0/3361920218 shutdown_connections 2024-09-11T23:17:43.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:43.021+0000 7f8b4e800640 1 -- 172.21.15.37:0/3361920218 wait complete. 2024-09-11T23:17:43.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:43.022+0000 7f8b4e800640 1 Processor -- start 2024-09-11T23:17:43.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:43.022+0000 7f8b4e800640 1 -- start start 2024-09-11T23:17:43.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:43.022+0000 7f8b4e800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b48102b90 0x7f8b4819a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:43.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:43.022+0000 7f8b4e800640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8b481034b0 0x7f8b4819a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:43.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:43.022+0000 7f8b4e800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b4810bfc0 0x7f8b4819ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:43.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:43.022+0000 7f8b4e800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8b48111dc0 con 0x7f8b48102b90 2024-09-11T23:17:43.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:43.022+0000 7f8b4e800640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f8b48111c40 con 0x7f8b4810bfc0 2024-09-11T23:17:43.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:43.022+0000 7f8b4e800640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f8b48111f40 con 0x7f8b481034b0 2024-09-11T23:17:43.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:43.023+0000 7f8b4d400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b48102b90 0x7f8b4819a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:43.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:43.023+0000 7f8b4d400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b48102b90 0x7f8b4819a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48334/0 (socket says 172.21.15.37:48334) 2024-09-11T23:17:43.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:43.023+0000 7f8b4d400640 1 -- 172.21.15.37:0/2682358228 learned_addr learned my addr 172.21.15.37:0/2682358228 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:17:43.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:43.023+0000 7f8b4ca00640 1 --2- 172.21.15.37:0/2682358228 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8b481034b0 0x7f8b4819a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:43.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:43.023+0000 7f8b4de00640 1 --2- 172.21.15.37:0/2682358228 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b4810bfc0 0x7f8b4819ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:43.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:43.023+0000 7f8b4d400640 1 -- 172.21.15.37:0/2682358228 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8b481034b0 msgr2=0x7f8b4819a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:43.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:43.023+0000 7f8b4d400640 1 --2- 172.21.15.37:0/2682358228 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8b481034b0 0x7f8b4819a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:43.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:43.023+0000 7f8b4d400640 1 -- 172.21.15.37:0/2682358228 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b4810bfc0 msgr2=0x7f8b4819ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:43.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:43.023+0000 7f8b4d400640 1 --2- 172.21.15.37:0/2682358228 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b4810bfc0 0x7f8b4819ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:43.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:43.023+0000 7f8b4d400640 1 -- 172.21.15.37:0/2682358228 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b4819f440 con 0x7f8b48102b90 2024-09-11T23:17:43.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:43.024+0000 7f8b4d400640 1 --2- 172.21.15.37:0/2682358228 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b48102b90 0x7f8b4819a490 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c00ea60 tx=0x7f8b3c00ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:43.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:43.024+0000 7f8b46000640 1 -- 172.21.15.37:0/2682358228 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b3c00cde0 con 0x7f8b48102b90 2024-09-11T23:17:43.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:43.024+0000 7f8b4e800640 1 -- 172.21.15.37:0/2682358228 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b4819f730 con 0x7f8b48102b90 2024-09-11T23:17:43.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:43.024+0000 7f8b4e800640 1 -- 172.21.15.37:0/2682358228 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b481a7010 con 0x7f8b48102b90 2024-09-11T23:17:43.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:43.025+0000 7f8b46000640 1 -- 172.21.15.37:0/2682358228 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8b3c0035f0 con 0x7f8b48102b90 2024-09-11T23:17:43.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:43.025+0000 7f8b46000640 1 -- 172.21.15.37:0/2682358228 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b3c010670 con 0x7f8b48102b90 2024-09-11T23:17:43.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:43.025+0000 7f8b4e800640 1 -- 172.21.15.37:0/2682358228 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8b28001030 con 0x7f8b48102b90 2024-09-11T23:17:43.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:43.027+0000 7f8b46000640 1 -- 172.21.15.37:0/2682358228 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f8b3c004020 con 0x7f8b48102b90 2024-09-11T23:17:43.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:43.029+0000 7f8b46000640 1 --2- 172.21.15.37:0/2682358228 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f8b300a2c90 0x7f8b300a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:43.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:43.029+0000 7f8b46000640 1 -- 172.21.15.37:0/2682358228 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9092+0+0 (secure 0 0 0) 0x7f8b3c0cffc0 con 0x7f8b48102b90 2024-09-11T23:17:43.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:43.029+0000 7f8b4ca00640 1 --2- 172.21.15.37:0/2682358228 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f8b300a2c90 0x7f8b300a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:43.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:43.029+0000 7f8b46000640 1 --2- 172.21.15.37:0/2682358228 >> [v2:172.21.15.123:6816/4279933341,v1:172.21.15.123:6817/4279933341] conn(0x7f8b300ade60 0x7f8b300b0300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:43.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:43.029+0000 7f8b46000640 1 -- 172.21.15.37:0/2682358228 --> [v2:172.21.15.123:6816/4279933341,v1:172.21.15.123:6817/4279933341] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8b300b09d0 con 0x7f8b300ade60 2024-09-11T23:17:43.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:43.029+0000 7f8b46000640 1 -- 172.21.15.37:0/2682358228 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=93) ==== 24+0+0 (secure 0 0 0) 0x7f8b3c0d0370 con 0x7f8b48102b90 2024-09-11T23:17:43.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:43.030+0000 7f8b4de00640 1 --2- 172.21.15.37:0/2682358228 >> [v2:172.21.15.123:6816/4279933341,v1:172.21.15.123:6817/4279933341] conn(0x7f8b300ade60 0x7f8b300b0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:43.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:43.030+0000 7f8b4ca00640 1 --2- 172.21.15.37:0/2682358228 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f8b300a2c90 0x7f8b300a5150 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f8b34009230 tx=0x7f8b340058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:43.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:43.030+0000 7f8b4de00640 1 --2- 172.21.15.37:0/2682358228 >> [v2:172.21.15.123:6816/4279933341,v1:172.21.15.123:6817/4279933341] conn(0x7f8b300ade60 0x7f8b300b0300 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:43.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:43.031+0000 7f8b46000640 1 -- 172.21.15.37:0/2682358228 <== osd.7 v2:172.21.15.123:6816/4279933341 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8b300b09d0 con 0x7f8b300ade60 2024-09-11T23:17:43.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:43.045+0000 7f8b4e800640 1 -- 172.21.15.37:0/2682358228 --> [v2:172.21.15.123:6816/4279933341,v1:172.21.15.123:6817/4279933341] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8b28002dd0 con 0x7f8b300ade60 2024-09-11T23:17:43.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:43.046+0000 7f8b46000640 1 -- 172.21.15.37:0/2682358228 <== osd.7 v2:172.21.15.123:6816/4279933341 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f8b28002dd0 con 0x7f8b300ade60 2024-09-11T23:17:43.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:43.046+0000 7f8b4e800640 1 -- 172.21.15.37:0/2682358228 >> [v2:172.21.15.123:6816/4279933341,v1:172.21.15.123:6817/4279933341] conn(0x7f8b300ade60 msgr2=0x7f8b300b0300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:43.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:43.046+0000 7f8b4e800640 1 --2- 172.21.15.37:0/2682358228 >> [v2:172.21.15.123:6816/4279933341,v1:172.21.15.123:6817/4279933341] conn(0x7f8b300ade60 0x7f8b300b0300 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:43.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:43.047+0000 7f8b4e800640 1 -- 172.21.15.37:0/2682358228 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f8b300a2c90 msgr2=0x7f8b300a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:43.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:43.047+0000 7f8b4e800640 1 --2- 172.21.15.37:0/2682358228 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f8b300a2c90 0x7f8b300a5150 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f8b34009230 tx=0x7f8b340058d0 comp rx=0 tx=0).stop 2024-09-11T23:17:43.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:43.047+0000 7f8b4e800640 1 -- 172.21.15.37:0/2682358228 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b48102b90 msgr2=0x7f8b4819a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:43.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:43.047+0000 7f8b4e800640 1 --2- 172.21.15.37:0/2682358228 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b48102b90 0x7f8b4819a490 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c00ea60 tx=0x7f8b3c00ef20 comp rx=0 tx=0).stop 2024-09-11T23:17:43.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:43.047+0000 7f8b4de00640 1 -- 172.21.15.37:0/2682358228 reap_dead start 2024-09-11T23:17:43.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:43.047+0000 7f8b4e800640 1 -- 172.21.15.37:0/2682358228 shutdown_connections 2024-09-11T23:17:43.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:43.047+0000 7f8b4e800640 1 -- 172.21.15.37:0/2682358228 >> 172.21.15.37:0/2682358228 conn(0x7f8b480fc610 msgr2=0x7f8b4810d2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:43.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:43.047+0000 7f8b4e800640 1 -- 172.21.15.37:0/2682358228 shutdown_connections 2024-09-11T23:17:43.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:43.047+0000 7f8b4e800640 1 -- 172.21.15.37:0/2682358228 wait complete. 2024-09-11T23:17:43.482 INFO:teuthology.orchestra.run.smithi037.stdout:137438953539 2024-09-11T23:17:43.483 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-11T23:17:43.795 INFO:teuthology.orchestra.run.smithi037.stdout:274877906985 2024-09-11T23:17:43.795 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-09-11T23:17:44.054 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:43 smithi037 ceph-mon[30630]: pgmap v348: 129 pgs: 129 active+clean; 646 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-11T23:17:44.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:43 smithi160 ceph-mon[35055]: pgmap v348: 129 pgs: 129 active+clean; 646 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-11T23:17:44.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:43 smithi123 ceph-mon[35438]: pgmap v348: 129 pgs: 129 active+clean; 646 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-11T23:17:44.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:44.760+0000 7f758dc00640 1 -- 172.21.15.37:0/3157597759 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f758810e440 msgr2=0x7f7588110830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:44.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:44.760+0000 7f758dc00640 1 --2- 172.21.15.37:0/3157597759 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f758810e440 0x7f7588110830 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f7580009ca0 tx=0x7f758002a950 comp rx=0 tx=0).stop 2024-09-11T23:17:44.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:44.760+0000 7f758dc00640 1 -- 172.21.15.37:0/3157597759 shutdown_connections 2024-09-11T23:17:44.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:44.760+0000 7f758dc00640 1 --2- 172.21.15.37:0/3157597759 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7588074e30 0x7f758810df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:44.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:44.760+0000 7f758dc00640 1 --2- 172.21.15.37:0/3157597759 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f758810e440 0x7f7588110830 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:44.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:44.760+0000 7f758dc00640 1 --2- 172.21.15.37:0/3157597759 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7588074510 0x7f75880748f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:44.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:44.760+0000 7f758dc00640 1 -- 172.21.15.37:0/3157597759 >> 172.21.15.37:0/3157597759 conn(0x7f75880fd8c0 msgr2=0x7f75880ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:44.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:44.760+0000 7f758dc00640 1 -- 172.21.15.37:0/3157597759 shutdown_connections 2024-09-11T23:17:44.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:44.760+0000 7f758dc00640 1 -- 172.21.15.37:0/3157597759 wait complete. 2024-09-11T23:17:44.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:44.761+0000 7f758dc00640 1 Processor -- start 2024-09-11T23:17:44.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:44.761+0000 7f758dc00640 1 -- start start 2024-09-11T23:17:44.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:44.762+0000 7f758dc00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7588074510 0x7f758819a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:44.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:44.762+0000 7f758dc00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7588074e30 0x7f758819ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:44.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:44.762+0000 7f758dc00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f758810e440 0x7f758819eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:44.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:44.762+0000 7f758dc00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7588114150 con 0x7f758810e440 2024-09-11T23:17:44.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:44.762+0000 7f758dc00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f7588113fd0 con 0x7f7588074510 2024-09-11T23:17:44.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:44.762+0000 7f758dc00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f75881142d0 con 0x7f7588074e30 2024-09-11T23:17:44.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:44.762+0000 7f7586a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7588074510 0x7f758819a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:44.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:44.762+0000 7f7586000640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7588074e30 0x7f758819ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:44.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:44.762+0000 7f7586000640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7588074e30 0x7f758819ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.37:42250/0 (socket says 172.21.15.37:42250) 2024-09-11T23:17:44.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:44.762+0000 7f7586000640 1 -- 172.21.15.37:0/130667687 learned_addr learned my addr 172.21.15.37:0/130667687 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:17:44.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:44.762+0000 7f7586a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7588074510 0x7f758819a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.37:45720/0 (socket says 172.21.15.37:45720) 2024-09-11T23:17:44.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:44.762+0000 7f7587400640 1 --2- 172.21.15.37:0/130667687 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f758810e440 0x7f758819eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:44.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:44.762+0000 7f7586000640 1 -- 172.21.15.37:0/130667687 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7588074510 msgr2=0x7f758819a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:44.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:44.762+0000 7f7586000640 1 --2- 172.21.15.37:0/130667687 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7588074510 0x7f758819a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:44.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:44.762+0000 7f7586000640 1 -- 172.21.15.37:0/130667687 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f758810e440 msgr2=0x7f758819eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:44.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:44.762+0000 7f7586000640 1 --2- 172.21.15.37:0/130667687 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f758810e440 0x7f758819eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:44.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:44.762+0000 7f7586000640 1 -- 172.21.15.37:0/130667687 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f758819f5a0 con 0x7f7588074e30 2024-09-11T23:17:44.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:44.762+0000 7f7586a00640 1 --2- 172.21.15.37:0/130667687 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7588074510 0x7f758819a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:17:44.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:44.763+0000 7f7586000640 1 --2- 172.21.15.37:0/130667687 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7588074e30 0x7f758819ab30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f757400e9f0 tx=0x7f757400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:44.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:44.763+0000 7f757f400640 1 -- 172.21.15.37:0/130667687 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f757400cd80 con 0x7f7588074e30 2024-09-11T23:17:44.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:44.763+0000 7f758dc00640 1 -- 172.21.15.37:0/130667687 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f758819f890 con 0x7f7588074e30 2024-09-11T23:17:44.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:44.763+0000 7f757f400640 1 -- 172.21.15.37:0/130667687 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7574010910 con 0x7f7588074e30 2024-09-11T23:17:44.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:44.763+0000 7f757f400640 1 -- 172.21.15.37:0/130667687 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75740188f0 con 0x7f7588074e30 2024-09-11T23:17:44.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:44.763+0000 7f758dc00640 1 -- 172.21.15.37:0/130667687 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75881a7170 con 0x7f7588074e30 2024-09-11T23:17:44.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:44.764+0000 7f758dc00640 1 -- 172.21.15.37:0/130667687 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7588062980 con 0x7f7588074e30 2024-09-11T23:17:44.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:44.767+0000 7f757f400640 1 -- 172.21.15.37:0/130667687 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f7574010ac0 con 0x7f7588074e30 2024-09-11T23:17:44.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:44.768+0000 7f757f400640 1 --2- 172.21.15.37:0/130667687 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f756c0a2c90 0x7f756c0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:44.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:44.769+0000 7f757f400640 1 -- 172.21.15.37:0/130667687 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9092+0+0 (secure 0 0 0) 0x7f75740cfe90 con 0x7f7588074e30 2024-09-11T23:17:44.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:44.769+0000 7f7586a00640 1 --2- 172.21.15.37:0/130667687 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f756c0a2c90 0x7f756c0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:44.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:44.769+0000 7f757f400640 1 --2- 172.21.15.37:0/130667687 >> [v2:172.21.15.123:6824/471058996,v1:172.21.15.123:6825/471058996] conn(0x7f756c0ade60 0x7f756c0b0300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:44.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:44.769+0000 7f757f400640 1 -- 172.21.15.37:0/130667687 --> [v2:172.21.15.123:6824/471058996,v1:172.21.15.123:6825/471058996] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f756c0b09d0 con 0x7f756c0ade60 2024-09-11T23:17:44.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:44.769+0000 7f757f400640 1 -- 172.21.15.37:0/130667687 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_get_version_reply(handle=1 version=93) ==== 24+0+0 (secure 0 0 0) 0x7f75740d0240 con 0x7f7588074e30 2024-09-11T23:17:44.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:44.769+0000 7f7587400640 1 --2- 172.21.15.37:0/130667687 >> [v2:172.21.15.123:6824/471058996,v1:172.21.15.123:6825/471058996] conn(0x7f756c0ade60 0x7f756c0b0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:44.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:44.769+0000 7f7586a00640 1 --2- 172.21.15.37:0/130667687 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f756c0a2c90 0x7f756c0a5150 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f7578005d00 tx=0x7f757800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:44.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:44.770+0000 7f7587400640 1 --2- 172.21.15.37:0/130667687 >> [v2:172.21.15.123:6824/471058996,v1:172.21.15.123:6825/471058996] conn(0x7f756c0ade60 0x7f756c0b0300 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:44.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:44.771+0000 7f757f400640 1 -- 172.21.15.37:0/130667687 <== osd.10 v2:172.21.15.123:6824/471058996 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f756c0b09d0 con 0x7f756c0ade60 2024-09-11T23:17:44.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:44.785+0000 7f758dc00640 1 -- 172.21.15.37:0/130667687 --> [v2:172.21.15.123:6824/471058996,v1:172.21.15.123:6825/471058996] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7588062d80 con 0x7f756c0ade60 2024-09-11T23:17:44.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:44.786+0000 7f757f400640 1 -- 172.21.15.37:0/130667687 <== osd.10 v2:172.21.15.123:6824/471058996 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f7588062d80 con 0x7f756c0ade60 2024-09-11T23:17:44.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:44.786+0000 7f758dc00640 1 -- 172.21.15.37:0/130667687 >> [v2:172.21.15.123:6824/471058996,v1:172.21.15.123:6825/471058996] conn(0x7f756c0ade60 msgr2=0x7f756c0b0300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:44.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:44.786+0000 7f758dc00640 1 --2- 172.21.15.37:0/130667687 >> [v2:172.21.15.123:6824/471058996,v1:172.21.15.123:6825/471058996] conn(0x7f756c0ade60 0x7f756c0b0300 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:44.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:44.786+0000 7f758dc00640 1 -- 172.21.15.37:0/130667687 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f756c0a2c90 msgr2=0x7f756c0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:44.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:44.786+0000 7f758dc00640 1 --2- 172.21.15.37:0/130667687 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f756c0a2c90 0x7f756c0a5150 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f7578005d00 tx=0x7f757800b410 comp rx=0 tx=0).stop 2024-09-11T23:17:44.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:44.786+0000 7f758dc00640 1 -- 172.21.15.37:0/130667687 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7588074e30 msgr2=0x7f758819ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:44.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:44.786+0000 7f758dc00640 1 --2- 172.21.15.37:0/130667687 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7588074e30 0x7f758819ab30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f757400e9f0 tx=0x7f757400eeb0 comp rx=0 tx=0).stop 2024-09-11T23:17:44.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:44.786+0000 7f7587400640 1 -- 172.21.15.37:0/130667687 reap_dead start 2024-09-11T23:17:44.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:44.787+0000 7f758dc00640 1 -- 172.21.15.37:0/130667687 shutdown_connections 2024-09-11T23:17:44.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:44.787+0000 7f758dc00640 1 -- 172.21.15.37:0/130667687 >> 172.21.15.37:0/130667687 conn(0x7f75880fd8c0 msgr2=0x7f75880fe520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:44.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:44.787+0000 7f758dc00640 1 -- 172.21.15.37:0/130667687 shutdown_connections 2024-09-11T23:17:44.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:44.787+0000 7f758dc00640 1 -- 172.21.15.37:0/130667687 wait complete. 2024-09-11T23:17:45.284 INFO:teuthology.orchestra.run.smithi037.stdout:55834574932 2024-09-11T23:17:45.285 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-11T23:17:45.637 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:17:45.647 INFO:teuthology.orchestra.run.smithi037.stdout:210453397556 2024-09-11T23:17:45.647 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-09-11T23:17:45.897 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:17:46.144 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:45 smithi037 ceph-mon[30630]: pgmap v349: 129 pgs: 129 active+clean; 646 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-11T23:17:46.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:45 smithi160 ceph-mon[35055]: pgmap v349: 129 pgs: 129 active+clean; 646 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-11T23:17:46.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:45 smithi123 ceph-mon[35438]: pgmap v349: 129 pgs: 129 active+clean; 646 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-11T23:17:46.459 INFO:teuthology.orchestra.run.smithi037.stdout:296352743460 2024-09-11T23:17:46.459 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-09-11T23:17:46.971 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:17:47.000 INFO:teuthology.orchestra.run.smithi037.stdout:240518168625 2024-09-11T23:17:47.001 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-09-11T23:17:47.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:47.648+0000 7f7ae1600640 1 -- 172.21.15.37:0/1329110912 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7adc1079c0 msgr2=0x7f7adc107da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:47.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:47.648+0000 7f7ae1600640 1 --2- 172.21.15.37:0/1329110912 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7adc1079c0 0x7f7adc107da0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7acc009860 tx=0x7f7acc02a340 comp rx=0 tx=0).stop 2024-09-11T23:17:47.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:47.648+0000 7f7ae1600640 1 -- 172.21.15.37:0/1329110912 shutdown_connections 2024-09-11T23:17:47.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:47.648+0000 7f7ae1600640 1 --2- 172.21.15.37:0/1329110912 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7adc102360 0x7f7adc10e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:47.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:47.648+0000 7f7ae1600640 1 --2- 172.21.15.37:0/1329110912 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7adc1019c0 0x7f7adc101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:47.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:47.648+0000 7f7ae1600640 1 --2- 172.21.15.37:0/1329110912 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7adc1079c0 0x7f7adc107da0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:47.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:47.648+0000 7f7ae1600640 1 -- 172.21.15.37:0/1329110912 >> 172.21.15.37:0/1329110912 conn(0x7f7adc0fd740 msgr2=0x7f7adc0ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:47.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:47.648+0000 7f7ae1600640 1 -- 172.21.15.37:0/1329110912 shutdown_connections 2024-09-11T23:17:47.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:47.648+0000 7f7ae1600640 1 -- 172.21.15.37:0/1329110912 wait complete. 2024-09-11T23:17:47.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:47.649+0000 7f7ae1600640 1 Processor -- start 2024-09-11T23:17:47.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:47.649+0000 7f7ae1600640 1 -- start start 2024-09-11T23:17:47.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:47.649+0000 7f7ae1600640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7adc1019c0 0x7f7adc198280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:47.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:47.649+0000 7f7ae1600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7adc102360 0x7f7adc1987c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:47.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:47.649+0000 7f7ae1600640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7adc1079c0 0x7f7adc19cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:47.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:47.649+0000 7f7ae1600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7adc111dc0 con 0x7f7adc102360 2024-09-11T23:17:47.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:47.649+0000 7f7ae1600640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f7adc111c40 con 0x7f7adc1079c0 2024-09-11T23:17:47.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:47.649+0000 7f7ae1600640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f7adc111f40 con 0x7f7adc1019c0 2024-09-11T23:17:47.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:47.649+0000 7f7adb400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7adc102360 0x7f7adc1987c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:47.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:47.650+0000 7f7adb400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7adc102360 0x7f7adc1987c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48366/0 (socket says 172.21.15.37:48366) 2024-09-11T23:17:47.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:47.650+0000 7f7adb400640 1 -- 172.21.15.37:0/4166481515 learned_addr learned my addr 172.21.15.37:0/4166481515 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:17:47.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:47.650+0000 7f7adbe00640 1 --2- 172.21.15.37:0/4166481515 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7adc1019c0 0x7f7adc198280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:47.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:47.650+0000 7f7ae0c00640 1 --2- 172.21.15.37:0/4166481515 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7adc1079c0 0x7f7adc19cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:47.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:47.650+0000 7f7adb400640 1 -- 172.21.15.37:0/4166481515 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7adc1019c0 msgr2=0x7f7adc198280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:47.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:47.650+0000 7f7adb400640 1 --2- 172.21.15.37:0/4166481515 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7adc1019c0 0x7f7adc198280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:47.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:47.650+0000 7f7adb400640 1 -- 172.21.15.37:0/4166481515 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7adc1079c0 msgr2=0x7f7adc19cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:47.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:47.650+0000 7f7adb400640 1 --2- 172.21.15.37:0/4166481515 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7adc1079c0 0x7f7adc19cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:47.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:47.650+0000 7f7adb400640 1 -- 172.21.15.37:0/4166481515 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7adc19d230 con 0x7f7adc102360 2024-09-11T23:17:47.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:47.650+0000 7f7adbe00640 1 --2- 172.21.15.37:0/4166481515 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7adc1019c0 0x7f7adc198280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:17:47.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:47.650+0000 7f7adb400640 1 --2- 172.21.15.37:0/4166481515 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7adc102360 0x7f7adc1987c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f7ac800e9c0 tx=0x7f7ac800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:47.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:47.651+0000 7f7ad8c00640 1 -- 172.21.15.37:0/4166481515 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ac800cde0 con 0x7f7adc102360 2024-09-11T23:17:47.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:47.651+0000 7f7ad8c00640 1 -- 172.21.15.37:0/4166481515 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7ac80035f0 con 0x7f7adc102360 2024-09-11T23:17:47.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:47.651+0000 7f7ad8c00640 1 -- 172.21.15.37:0/4166481515 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ac8010690 con 0x7f7adc102360 2024-09-11T23:17:47.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:47.651+0000 7f7ae1600640 1 -- 172.21.15.37:0/4166481515 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7adc19d520 con 0x7f7adc102360 2024-09-11T23:17:47.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:47.651+0000 7f7ae1600640 1 -- 172.21.15.37:0/4166481515 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7adc1a4e00 con 0x7f7adc102360 2024-09-11T23:17:47.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:47.652+0000 7f7ae1600640 1 -- 172.21.15.37:0/4166481515 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7adc101e20 con 0x7f7adc102360 2024-09-11T23:17:47.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:47.655+0000 7f7ad8c00640 1 -- 172.21.15.37:0/4166481515 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f7ac80037a0 con 0x7f7adc102360 2024-09-11T23:17:47.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:47.657+0000 7f7ad8c00640 1 --2- 172.21.15.37:0/4166481515 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f7ac00a2c10 0x7f7ac00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:47.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:47.657+0000 7f7ad8c00640 1 -- 172.21.15.37:0/4166481515 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9092+0+0 (secure 0 0 0) 0x7f7ac80cf880 con 0x7f7adc102360 2024-09-11T23:17:47.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:47.657+0000 7f7adbe00640 1 --2- 172.21.15.37:0/4166481515 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f7ac00a2c10 0x7f7ac00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:47.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:47.658+0000 7f7adbe00640 1 --2- 172.21.15.37:0/4166481515 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f7ac00a2c10 0x7f7ac00a50d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f7acc02a930 tx=0x7f7acc0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:47.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:47.660+0000 7f7ad8c00640 1 -- 172.21.15.37:0/4166481515 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7ac809c2c0 con 0x7f7adc102360 2024-09-11T23:17:47.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:47.852+0000 7f7ae1600640 1 -- 172.21.15.37:0/4166481515 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f7adc1099a0 con 0x7f7adc102360 2024-09-11T23:17:47.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:47.852+0000 7f7ad8c00640 1 -- 172.21.15.37:0/4166481515 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f7ac809bbc0 con 0x7f7adc102360 2024-09-11T23:17:47.853 INFO:teuthology.orchestra.run.smithi037.stdout:188978561084 2024-09-11T23:17:47.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:47.854+0000 7f7ae1600640 1 -- 172.21.15.37:0/4166481515 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f7ac00a2c10 msgr2=0x7f7ac00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:47.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:47.854+0000 7f7ae1600640 1 --2- 172.21.15.37:0/4166481515 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f7ac00a2c10 0x7f7ac00a50d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f7acc02a930 tx=0x7f7acc0058d0 comp rx=0 tx=0).stop 2024-09-11T23:17:47.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:47.854+0000 7f7ae1600640 1 -- 172.21.15.37:0/4166481515 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7adc102360 msgr2=0x7f7adc1987c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:47.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:47.854+0000 7f7ae1600640 1 --2- 172.21.15.37:0/4166481515 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7adc102360 0x7f7adc1987c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f7ac800e9c0 tx=0x7f7ac800ee80 comp rx=0 tx=0).stop 2024-09-11T23:17:47.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:47.854+0000 7f7ae1600640 1 -- 172.21.15.37:0/4166481515 shutdown_connections 2024-09-11T23:17:47.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:47.854+0000 7f7ae1600640 1 --2- 172.21.15.37:0/4166481515 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f7ac00a2c10 0x7f7ac00a50d0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:47.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:47.854+0000 7f7ae1600640 1 --2- 172.21.15.37:0/4166481515 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7adc1079c0 0x7f7adc19cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:47.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:47.854+0000 7f7ae1600640 1 --2- 172.21.15.37:0/4166481515 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7adc102360 0x7f7adc1987c0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:47.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:47.854+0000 7f7ae1600640 1 --2- 172.21.15.37:0/4166481515 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7adc1019c0 0x7f7adc198280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:47.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:47.854+0000 7f7ae1600640 1 -- 172.21.15.37:0/4166481515 >> 172.21.15.37:0/4166481515 conn(0x7f7adc0fd740 msgr2=0x7f7adc0fdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:47.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:47.855+0000 7f7ae1600640 1 -- 172.21.15.37:0/4166481515 shutdown_connections 2024-09-11T23:17:47.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:47.855+0000 7f7ae1600640 1 -- 172.21.15.37:0/4166481515 wait complete. 2024-09-11T23:17:48.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:47 smithi037 ceph-mon[30630]: pgmap v350: 129 pgs: 129 active+clean; 646 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-09-11T23:17:48.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:47 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/4166481515' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-11T23:17:48.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:47 smithi160 ceph-mon[35055]: pgmap v350: 129 pgs: 129 active+clean; 646 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-09-11T23:17:48.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:47 smithi160 ceph-mon[35055]: from='client.? 172.21.15.37:0/4166481515' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-11T23:17:48.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:47 smithi123 ceph-mon[35438]: pgmap v350: 129 pgs: 129 active+clean; 646 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-09-11T23:17:48.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:47 smithi123 ceph-mon[35438]: from='client.? 172.21.15.37:0/4166481515' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-11T23:17:48.324 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:17:48.324 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:17:48.797 INFO:tasks.cephadm.ceph_manager.ceph:need seq 188978561082 got 188978561084 for osd.6 2024-09-11T23:17:48.798 DEBUG:teuthology.parallel:result is None 2024-09-11T23:17:49.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:49.050+0000 7fd138a00640 1 -- 172.21.15.37:0/1767411849 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd134112b90 msgr2=0x7fd134114f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:49.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:49.050+0000 7fd138a00640 1 --2- 172.21.15.37:0/1767411849 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd134112b90 0x7fd134114f80 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd12c009ca0 tx=0x7fd12c02a950 comp rx=0 tx=0).stop 2024-09-11T23:17:49.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:49.050+0000 7fd138a00640 1 -- 172.21.15.37:0/1767411849 shutdown_connections 2024-09-11T23:17:49.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:49.050+0000 7fd138a00640 1 --2- 172.21.15.37:0/1767411849 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd134112b90 0x7fd134114f80 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:49.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:49.050+0000 7fd138a00640 1 --2- 172.21.15.37:0/1767411849 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd134074eb0 0x7fd134112650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:49.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:49.050+0000 7fd138a00640 1 --2- 172.21.15.37:0/1767411849 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd134074590 0x7fd134074970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:49.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:49.050+0000 7fd138a00640 1 -- 172.21.15.37:0/1767411849 >> 172.21.15.37:0/1767411849 conn(0x7fd1340fd8c0 msgr2=0x7fd1340ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:49.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:49.050+0000 7fd138a00640 1 -- 172.21.15.37:0/1767411849 shutdown_connections 2024-09-11T23:17:49.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:49.050+0000 7fd138a00640 1 -- 172.21.15.37:0/1767411849 wait complete. 2024-09-11T23:17:49.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:49.051+0000 7fd138a00640 1 Processor -- start 2024-09-11T23:17:49.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:49.051+0000 7fd138a00640 1 -- start start 2024-09-11T23:17:49.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:49.052+0000 7fd138a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd134074590 0x7fd1341a4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:49.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:49.052+0000 7fd138a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd134074eb0 0x7fd1341a4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:49.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:49.052+0000 7fd138a00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd134112b90 0x7fd13419e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:49.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:49.052+0000 7fd138a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd134118570 con 0x7fd134074eb0 2024-09-11T23:17:49.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:49.052+0000 7fd138a00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fd1341183f0 con 0x7fd134074590 2024-09-11T23:17:49.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:49.052+0000 7fd138a00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fd1341186f0 con 0x7fd134112b90 2024-09-11T23:17:49.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:49.052+0000 7fd12be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd134074eb0 0x7fd1341a4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:49.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:49.052+0000 7fd131e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd134074590 0x7fd1341a4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:49.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:49.052+0000 7fd132800640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd134112b90 0x7fd13419e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:49.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:49.052+0000 7fd12be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd134074eb0 0x7fd1341a4c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37856/0 (socket says 172.21.15.37:37856) 2024-09-11T23:17:49.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:49.052+0000 7fd12be00640 1 -- 172.21.15.37:0/2512030638 learned_addr learned my addr 172.21.15.37:0/2512030638 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:17:49.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:49.052+0000 7fd132800640 1 --2- 172.21.15.37:0/2512030638 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd134112b90 0x7fd13419e8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.37:49614/0 (socket says 172.21.15.37:49614) 2024-09-11T23:17:49.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:49.053+0000 7fd131e00640 1 -- 172.21.15.37:0/2512030638 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd134112b90 msgr2=0x7fd13419e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:49.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:49.053+0000 7fd131e00640 1 --2- 172.21.15.37:0/2512030638 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd134112b90 0x7fd13419e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:49.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:49.053+0000 7fd131e00640 1 -- 172.21.15.37:0/2512030638 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd134074eb0 msgr2=0x7fd1341a4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:49.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:49.053+0000 7fd131e00640 1 --2- 172.21.15.37:0/2512030638 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd134074eb0 0x7fd1341a4c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:49.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:49.053+0000 7fd131e00640 1 -- 172.21.15.37:0/2512030638 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd13419eff0 con 0x7fd134074590 2024-09-11T23:17:49.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:49.053+0000 7fd131e00640 1 --2- 172.21.15.37:0/2512030638 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd134074590 0x7fd1341a4700 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd12400e9f0 tx=0x7fd12400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:49.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:49.053+0000 7fd12aa00640 1 -- 172.21.15.37:0/2512030638 <== mon.2 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd12400cd80 con 0x7fd134074590 2024-09-11T23:17:49.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:49.053+0000 7fd138a00640 1 -- 172.21.15.37:0/2512030638 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd13419f2e0 con 0x7fd134074590 2024-09-11T23:17:49.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:49.053+0000 7fd12aa00640 1 -- 172.21.15.37:0/2512030638 <== mon.2 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd1240035f0 con 0x7fd134074590 2024-09-11T23:17:49.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:49.054+0000 7fd12aa00640 1 -- 172.21.15.37:0/2512030638 <== mon.2 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd124010670 con 0x7fd134074590 2024-09-11T23:17:49.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:49.054+0000 7fd138a00640 1 -- 172.21.15.37:0/2512030638 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1341ab5d0 con 0x7fd134074590 2024-09-11T23:17:49.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:49.055+0000 7fd138a00640 1 -- 172.21.15.37:0/2512030638 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd134074970 con 0x7fd134074590 2024-09-11T23:17:49.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:49.057+0000 7fd12aa00640 1 -- 172.21.15.37:0/2512030638 <== mon.2 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fd1240037a0 con 0x7fd134074590 2024-09-11T23:17:49.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:49.058+0000 7fd12aa00640 1 --2- 172.21.15.37:0/2512030638 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fd1180a2c90 0x7fd1180a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:49.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:49.058+0000 7fd12aa00640 1 -- 172.21.15.37:0/2512030638 <== mon.2 v2:172.21.15.123:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9092+0+0 (secure 0 0 0) 0x7fd1240cf7b0 con 0x7fd134074590 2024-09-11T23:17:49.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:49.058+0000 7fd12be00640 1 --2- 172.21.15.37:0/2512030638 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fd1180a2c90 0x7fd1180a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:49.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:49.059+0000 7fd12be00640 1 --2- 172.21.15.37:0/2512030638 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fd1180a2c90 0x7fd1180a5150 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd134114c10 tx=0x7fd11c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:49.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:49.062+0000 7fd12aa00640 1 -- 172.21.15.37:0/2512030638 <== mon.2 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd12409c1f0 con 0x7fd134074590 2024-09-11T23:17:49.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:49.252+0000 7fd138a00640 1 -- 172.21.15.37:0/2512030638 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fd1341ab900 con 0x7fd134074590 2024-09-11T23:17:49.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:49.253+0000 7fd12aa00640 1 -- 172.21.15.37:0/2512030638 <== mon.2 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd12409baf0 con 0x7fd134074590 2024-09-11T23:17:49.254 INFO:teuthology.orchestra.run.smithi037.stdout:77309411410 2024-09-11T23:17:49.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:49.255+0000 7fd138a00640 1 -- 172.21.15.37:0/2512030638 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fd1180a2c90 msgr2=0x7fd1180a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:49.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:49.255+0000 7fd138a00640 1 --2- 172.21.15.37:0/2512030638 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fd1180a2c90 0x7fd1180a5150 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd134114c10 tx=0x7fd11c005f90 comp rx=0 tx=0).stop 2024-09-11T23:17:49.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:49.255+0000 7fd138a00640 1 -- 172.21.15.37:0/2512030638 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd134074590 msgr2=0x7fd1341a4700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:49.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:49.255+0000 7fd138a00640 1 --2- 172.21.15.37:0/2512030638 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd134074590 0x7fd1341a4700 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd12400e9f0 tx=0x7fd12400eeb0 comp rx=0 tx=0).stop 2024-09-11T23:17:49.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:49.255+0000 7fd138a00640 1 -- 172.21.15.37:0/2512030638 shutdown_connections 2024-09-11T23:17:49.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:49.255+0000 7fd138a00640 1 --2- 172.21.15.37:0/2512030638 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fd1180a2c90 0x7fd1180a5150 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:49.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:49.255+0000 7fd138a00640 1 --2- 172.21.15.37:0/2512030638 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd134112b90 0x7fd13419e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:49.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:49.255+0000 7fd138a00640 1 --2- 172.21.15.37:0/2512030638 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd134074eb0 0x7fd1341a4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:49.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:49.255+0000 7fd138a00640 1 --2- 172.21.15.37:0/2512030638 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd134074590 0x7fd1341a4700 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:49.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:49.255+0000 7fd138a00640 1 -- 172.21.15.37:0/2512030638 >> 172.21.15.37:0/2512030638 conn(0x7fd1340fd8c0 msgr2=0x7fd1340ff080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:49.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:49.256+0000 7fd138a00640 1 -- 172.21.15.37:0/2512030638 shutdown_connections 2024-09-11T23:17:49.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:49.256+0000 7fd138a00640 1 -- 172.21.15.37:0/2512030638 wait complete. 2024-09-11T23:17:49.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:49.823+0000 7f5717e00640 1 -- 172.21.15.37:0/269039875 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5710103ff0 msgr2=0x7f57101043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:49.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:49.823+0000 7f5717e00640 1 --2- 172.21.15.37:0/269039875 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5710103ff0 0x7f57101043d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f5704009900 tx=0x7f570402a3f0 comp rx=0 tx=0).stop 2024-09-11T23:17:49.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:49.824+0000 7f5717e00640 1 -- 172.21.15.37:0/269039875 shutdown_connections 2024-09-11T23:17:49.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:49.824+0000 7f5717e00640 1 --2- 172.21.15.37:0/269039875 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5710109120 0x7f5710110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:49.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:49.824+0000 7f5717e00640 1 --2- 172.21.15.37:0/269039875 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f57101049a0 0x7f57101089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:49.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:49.824+0000 7f5717e00640 1 --2- 172.21.15.37:0/269039875 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5710103ff0 0x7f57101043d0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:49.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:49.824+0000 7f5717e00640 1 -- 172.21.15.37:0/269039875 >> 172.21.15.37:0/269039875 conn(0x7f57100ffa90 msgr2=0x7f5710101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:49.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:49.824+0000 7f5717e00640 1 -- 172.21.15.37:0/269039875 shutdown_connections 2024-09-11T23:17:49.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:49.824+0000 7f5717e00640 1 -- 172.21.15.37:0/269039875 wait complete. 2024-09-11T23:17:49.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:49.825+0000 7f5717e00640 1 Processor -- start 2024-09-11T23:17:49.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:49.825+0000 7f5717e00640 1 -- start start 2024-09-11T23:17:49.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:49.825+0000 7f5717e00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5710103ff0 0x7f571019a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:49.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:49.825+0000 7f5717e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57101049a0 0x7f571019ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:49.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:49.825+0000 7f5717e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5710109120 0x7f571019eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:49.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:49.825+0000 7f5717e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5710114170 con 0x7f57101049a0 2024-09-11T23:17:49.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:49.825+0000 7f5717e00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f5710113ff0 con 0x7f5710109120 2024-09-11T23:17:49.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:49.825+0000 7f5717e00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f57101142f0 con 0x7f5710103ff0 2024-09-11T23:17:49.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:49.826+0000 7f5714a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57101049a0 0x7f571019ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:49.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:49.826+0000 7f5715e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5710109120 0x7f571019eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:49.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:49.826+0000 7f5715400640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5710103ff0 0x7f571019a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:49.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:49.826+0000 7f5714a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57101049a0 0x7f571019ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37882/0 (socket says 172.21.15.37:37882) 2024-09-11T23:17:49.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:49.826+0000 7f5715e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5710109120 0x7f571019eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.37:49346/0 (socket says 172.21.15.37:49346) 2024-09-11T23:17:49.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:49.826+0000 7f5714a00640 1 -- 172.21.15.37:0/1357721981 learned_addr learned my addr 172.21.15.37:0/1357721981 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:17:49.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:49.826+0000 7f5715e00640 1 -- 172.21.15.37:0/1357721981 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5710103ff0 msgr2=0x7f571019a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:49.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:49.826+0000 7f5715e00640 1 --2- 172.21.15.37:0/1357721981 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5710103ff0 0x7f571019a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:49.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:49.826+0000 7f5715e00640 1 -- 172.21.15.37:0/1357721981 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57101049a0 msgr2=0x7f571019ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:49.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:49.826+0000 7f5715e00640 1 --2- 172.21.15.37:0/1357721981 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57101049a0 0x7f571019ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:49.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:49.826+0000 7f5715e00640 1 -- 172.21.15.37:0/1357721981 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f571019f5b0 con 0x7f5710109120 2024-09-11T23:17:49.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:49.827+0000 7f5715e00640 1 --2- 172.21.15.37:0/1357721981 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5710109120 0x7f571019eed0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5708009fd0 tx=0x7f570800ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:49.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:49.827+0000 7f570e000640 1 -- 172.21.15.37:0/1357721981 <== mon.2 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f570800ce20 con 0x7f5710109120 2024-09-11T23:17:49.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:49.827+0000 7f5717e00640 1 -- 172.21.15.37:0/1357721981 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f571019f8a0 con 0x7f5710109120 2024-09-11T23:17:49.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:49.827+0000 7f570e000640 1 -- 172.21.15.37:0/1357721981 <== mon.2 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5708005020 con 0x7f5710109120 2024-09-11T23:17:49.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:49.827+0000 7f570e000640 1 -- 172.21.15.37:0/1357721981 <== mon.2 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5708010720 con 0x7f5710109120 2024-09-11T23:17:49.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:49.827+0000 7f5717e00640 1 -- 172.21.15.37:0/1357721981 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57101a7180 con 0x7f5710109120 2024-09-11T23:17:49.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:49.828+0000 7f5717e00640 1 -- 172.21.15.37:0/1357721981 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57101043d0 con 0x7f5710109120 2024-09-11T23:17:49.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:49.831+0000 7f570e000640 1 -- 172.21.15.37:0/1357721981 <== mon.2 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f5708005540 con 0x7f5710109120 2024-09-11T23:17:49.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:49.833+0000 7f570e000640 1 --2- 172.21.15.37:0/1357721981 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f56f80a2c10 0x7f56f80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:49.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:49.833+0000 7f570e000640 1 -- 172.21.15.37:0/1357721981 <== mon.2 v2:172.21.15.123:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9092+0+0 (secure 0 0 0) 0x7f57080cfb70 con 0x7f5710109120 2024-09-11T23:17:49.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:49.834+0000 7f5715400640 1 --2- 172.21.15.37:0/1357721981 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f56f80a2c10 0x7f56f80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:49.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:49.834+0000 7f570e000640 1 -- 172.21.15.37:0/1357721981 <== mon.2 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f570809c610 con 0x7f5710109120 2024-09-11T23:17:49.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:49.835+0000 7f5715400640 1 --2- 172.21.15.37:0/1357721981 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f56f80a2c10 0x7f56f80a50d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5704000c00 tx=0x7f5704005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:49.961 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:49 smithi037 ceph-mon[30630]: pgmap v351: 129 pgs: 129 active+clean; 646 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-09-11T23:17:49.961 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:49 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/2512030638' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-11T23:17:50.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:50.024+0000 7f5717e00640 1 -- 172.21.15.37:0/1357721981 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f571019b960 con 0x7f5710109120 2024-09-11T23:17:50.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:50.025+0000 7f570e000640 1 -- 172.21.15.37:0/1357721981 <== mon.2 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f571019b960 con 0x7f5710109120 2024-09-11T23:17:50.026 INFO:teuthology.orchestra.run.smithi037.stdout:107374182476 2024-09-11T23:17:50.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:50.028+0000 7f5717e00640 1 -- 172.21.15.37:0/1357721981 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f56f80a2c10 msgr2=0x7f56f80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:50.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:50.028+0000 7f5717e00640 1 --2- 172.21.15.37:0/1357721981 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f56f80a2c10 0x7f56f80a50d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5704000c00 tx=0x7f5704005b50 comp rx=0 tx=0).stop 2024-09-11T23:17:50.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:50.028+0000 7f5717e00640 1 -- 172.21.15.37:0/1357721981 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5710109120 msgr2=0x7f571019eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:50.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:50.028+0000 7f5717e00640 1 --2- 172.21.15.37:0/1357721981 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5710109120 0x7f571019eed0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5708009fd0 tx=0x7f570800ef10 comp rx=0 tx=0).stop 2024-09-11T23:17:50.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:50.028+0000 7f5717e00640 1 -- 172.21.15.37:0/1357721981 shutdown_connections 2024-09-11T23:17:50.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:50.028+0000 7f5717e00640 1 --2- 172.21.15.37:0/1357721981 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f56f80a2c10 0x7f56f80a50d0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:50.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:50.028+0000 7f5717e00640 1 --2- 172.21.15.37:0/1357721981 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5710109120 0x7f571019eed0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:50.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:50.028+0000 7f5717e00640 1 --2- 172.21.15.37:0/1357721981 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57101049a0 0x7f571019ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:50.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:50.028+0000 7f5717e00640 1 --2- 172.21.15.37:0/1357721981 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5710103ff0 0x7f571019a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:50.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:50.028+0000 7f5717e00640 1 -- 172.21.15.37:0/1357721981 >> 172.21.15.37:0/1357721981 conn(0x7f57100ffa90 msgr2=0x7f5710100d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:50.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:50.028+0000 7f5717e00640 1 -- 172.21.15.37:0/1357721981 shutdown_connections 2024-09-11T23:17:50.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:50.028+0000 7f5717e00640 1 -- 172.21.15.37:0/1357721981 wait complete. 2024-09-11T23:17:50.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:50.076+0000 7f49d1600640 1 -- 172.21.15.37:0/2638123824 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49cc1049a0 msgr2=0x7f49cc1089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:50.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:50.076+0000 7f49d1600640 1 --2- 172.21.15.37:0/2638123824 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49cc1049a0 0x7f49cc1089f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f49b8009860 tx=0x7f49b802a340 comp rx=0 tx=0).stop 2024-09-11T23:17:50.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:50.076+0000 7f49d1600640 1 -- 172.21.15.37:0/2638123824 shutdown_connections 2024-09-11T23:17:50.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:50.076+0000 7f49d1600640 1 --2- 172.21.15.37:0/2638123824 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f49cc109120 0x7f49cc110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:50.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:50.076+0000 7f49d1600640 1 --2- 172.21.15.37:0/2638123824 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49cc1049a0 0x7f49cc1089f0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:50.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:50.076+0000 7f49d1600640 1 --2- 172.21.15.37:0/2638123824 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f49cc103ff0 0x7f49cc1043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:50.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:50.076+0000 7f49d1600640 1 -- 172.21.15.37:0/2638123824 >> 172.21.15.37:0/2638123824 conn(0x7f49cc0ffa90 msgr2=0x7f49cc101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:50.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:50.076+0000 7f49d1600640 1 -- 172.21.15.37:0/2638123824 shutdown_connections 2024-09-11T23:17:50.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:50.076+0000 7f49d1600640 1 -- 172.21.15.37:0/2638123824 wait complete. 2024-09-11T23:17:50.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:50.077+0000 7f49d1600640 1 Processor -- start 2024-09-11T23:17:50.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:50.078+0000 7f49d1600640 1 -- start start 2024-09-11T23:17:50.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:50.078+0000 7f49d1600640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f49cc103ff0 0x7f49cc076700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:50.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:50.078+0000 7f49d1600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49cc1049a0 0x7f49cc076c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:50.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:50.078+0000 7f49d1600640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f49cc109120 0x7f49cc077180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:50.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:50.078+0000 7f49d1600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f49cc114120 con 0x7f49cc1049a0 2024-09-11T23:17:50.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:50.078+0000 7f49d1600640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f49cc113fa0 con 0x7f49cc109120 2024-09-11T23:17:50.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:50.078+0000 7f49d1600640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f49cc1142a0 con 0x7f49cc103ff0 2024-09-11T23:17:50.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:50.078+0000 7f49caa00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f49cc103ff0 0x7f49cc076700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:50.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:50.079+0000 7f49caa00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f49cc103ff0 0x7f49cc076700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.37:49642/0 (socket says 172.21.15.37:49642) 2024-09-11T23:17:50.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:50.079+0000 7f49caa00640 1 -- 172.21.15.37:0/3677038733 learned_addr learned my addr 172.21.15.37:0/3677038733 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:17:50.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:50.079+0000 7f49cb400640 1 --2- 172.21.15.37:0/3677038733 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f49cc109120 0x7f49cc077180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:50.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:50.079+0000 7f49ca000640 1 --2- 172.21.15.37:0/3677038733 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49cc1049a0 0x7f49cc076c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:50.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:50.079+0000 7f49caa00640 1 -- 172.21.15.37:0/3677038733 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f49cc109120 msgr2=0x7f49cc077180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:50.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:50.079+0000 7f49caa00640 1 --2- 172.21.15.37:0/3677038733 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f49cc109120 0x7f49cc077180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:50.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:50.079+0000 7f49caa00640 1 -- 172.21.15.37:0/3677038733 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49cc1049a0 msgr2=0x7f49cc076c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:50.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:50.079+0000 7f49caa00640 1 --2- 172.21.15.37:0/3677038733 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49cc1049a0 0x7f49cc076c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:50.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:50.079+0000 7f49caa00640 1 -- 172.21.15.37:0/3677038733 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49cc1aace0 con 0x7f49cc103ff0 2024-09-11T23:17:50.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:50.079+0000 7f49ca000640 1 --2- 172.21.15.37:0/3677038733 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49cc1049a0 0x7f49cc076c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:17:50.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:50.080+0000 7f49caa00640 1 --2- 172.21.15.37:0/3677038733 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f49cc103ff0 0x7f49cc076700 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f49bc00ea90 tx=0x7f49bc00ef50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:50.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:50.080+0000 7f49c3400640 1 -- 172.21.15.37:0/3677038733 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49bc00ce40 con 0x7f49cc103ff0 2024-09-11T23:17:50.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:50.080+0000 7f49d1600640 1 -- 172.21.15.37:0/3677038733 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49cc19a400 con 0x7f49cc103ff0 2024-09-11T23:17:50.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:50.080+0000 7f49c3400640 1 -- 172.21.15.37:0/3677038733 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f49bc0035f0 con 0x7f49cc103ff0 2024-09-11T23:17:50.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:50.080+0000 7f49c3400640 1 -- 172.21.15.37:0/3677038733 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49bc010690 con 0x7f49cc103ff0 2024-09-11T23:17:50.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:50.080+0000 7f49d1600640 1 -- 172.21.15.37:0/3677038733 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49cc19a910 con 0x7f49cc103ff0 2024-09-11T23:17:50.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:50.082+0000 7f49d1600640 1 -- 172.21.15.37:0/3677038733 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49ac005290 con 0x7f49cc103ff0 2024-09-11T23:17:50.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:50.084+0000 7f49c3400640 1 -- 172.21.15.37:0/3677038733 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f49bc044b60 con 0x7f49cc103ff0 2024-09-11T23:17:50.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:50.086+0000 7f49c3400640 1 --2- 172.21.15.37:0/3677038733 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f49b00a2c90 0x7f49b00a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:50.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:50.086+0000 7f49c3400640 1 -- 172.21.15.37:0/3677038733 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9092+0+0 (secure 0 0 0) 0x7f49bc0cfa30 con 0x7f49cc103ff0 2024-09-11T23:17:50.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:50.086+0000 7f49ca000640 1 --2- 172.21.15.37:0/3677038733 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f49b00a2c90 0x7f49b00a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:50.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:50.086+0000 7f49ca000640 1 --2- 172.21.15.37:0/3677038733 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f49b00a2c90 0x7f49b00a5150 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f49b8000c00 tx=0x7f49b80058b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:50.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:50.087+0000 7f49c3400640 1 -- 172.21.15.37:0/3677038733 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f49bc09c470 con 0x7f49cc103ff0 2024-09-11T23:17:50.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:49 smithi160 ceph-mon[35055]: pgmap v351: 129 pgs: 129 active+clean; 646 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-09-11T23:17:50.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:49 smithi160 ceph-mon[35055]: from='client.? 172.21.15.37:0/2512030638' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-11T23:17:50.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:49 smithi123 ceph-mon[35438]: pgmap v351: 129 pgs: 129 active+clean; 646 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-09-11T23:17:50.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:49 smithi123 ceph-mon[35438]: from='client.? 172.21.15.37:0/2512030638' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-11T23:17:50.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:50.273+0000 7f49d1600640 1 -- 172.21.15.37:0/3677038733 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f49ac005850 con 0x7f49cc103ff0 2024-09-11T23:17:50.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:50.274+0000 7f49c3400640 1 -- 172.21.15.37:0/3677038733 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f49bc09bd70 con 0x7f49cc103ff0 2024-09-11T23:17:50.275 INFO:teuthology.orchestra.run.smithi037.stdout:326417514529 2024-09-11T23:17:50.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:50.276+0000 7f49d1600640 1 -- 172.21.15.37:0/3677038733 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f49b00a2c90 msgr2=0x7f49b00a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:50.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:50.276+0000 7f49d1600640 1 --2- 172.21.15.37:0/3677038733 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f49b00a2c90 0x7f49b00a5150 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f49b8000c00 tx=0x7f49b80058b0 comp rx=0 tx=0).stop 2024-09-11T23:17:50.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:50.276+0000 7f49d1600640 1 -- 172.21.15.37:0/3677038733 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f49cc103ff0 msgr2=0x7f49cc076700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:50.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:50.276+0000 7f49d1600640 1 --2- 172.21.15.37:0/3677038733 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f49cc103ff0 0x7f49cc076700 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f49bc00ea90 tx=0x7f49bc00ef50 comp rx=0 tx=0).stop 2024-09-11T23:17:50.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:50.276+0000 7f49d1600640 1 -- 172.21.15.37:0/3677038733 shutdown_connections 2024-09-11T23:17:50.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:50.276+0000 7f49d1600640 1 --2- 172.21.15.37:0/3677038733 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f49b00a2c90 0x7f49b00a5150 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:50.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:50.276+0000 7f49d1600640 1 --2- 172.21.15.37:0/3677038733 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f49cc109120 0x7f49cc077180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:50.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:50.276+0000 7f49d1600640 1 --2- 172.21.15.37:0/3677038733 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49cc1049a0 0x7f49cc076c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:50.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:50.276+0000 7f49d1600640 1 --2- 172.21.15.37:0/3677038733 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f49cc103ff0 0x7f49cc076700 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:50.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:50.276+0000 7f49d1600640 1 -- 172.21.15.37:0/3677038733 >> 172.21.15.37:0/3677038733 conn(0x7f49cc0ffa90 msgr2=0x7f49cc100db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:50.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:50.276+0000 7f49d1600640 1 -- 172.21.15.37:0/3677038733 shutdown_connections 2024-09-11T23:17:50.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:50.276+0000 7f49d1600640 1 -- 172.21.15.37:0/3677038733 wait complete. 2024-09-11T23:17:50.709 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:17:51.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:50 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/1357721981' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-11T23:17:51.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:50 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/3677038733' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-11T23:17:51.157 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182473 got 107374182476 for osd.3 2024-09-11T23:17:51.157 DEBUG:teuthology.parallel:result is None 2024-09-11T23:17:51.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:50 smithi160 ceph-mon[35055]: from='client.? 172.21.15.37:0/1357721981' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-11T23:17:51.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:50 smithi160 ceph-mon[35055]: from='client.? 172.21.15.37:0/3677038733' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-11T23:17:51.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:50 smithi123 ceph-mon[35438]: from='client.? 172.21.15.37:0/1357721981' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-11T23:17:51.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:50 smithi123 ceph-mon[35438]: from='client.? 172.21.15.37:0/3677038733' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-11T23:17:51.510 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:17:51.511 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:17:51.517 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:17:52.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:51 smithi037 ceph-mon[30630]: pgmap v352: 129 pgs: 129 active+clean; 646 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 10 op/s 2024-09-11T23:17:52.174 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411407 got 77309411410 for osd.2 2024-09-11T23:17:52.174 DEBUG:teuthology.parallel:result is None 2024-09-11T23:17:52.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:51 smithi160 ceph-mon[35055]: pgmap v352: 129 pgs: 129 active+clean; 646 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 10 op/s 2024-09-11T23:17:52.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:51 smithi123 ceph-mon[35438]: pgmap v352: 129 pgs: 129 active+clean; 646 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 10 op/s 2024-09-11T23:17:52.707 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:17:52.715 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:17:52.745 INFO:tasks.cephadm.ceph_manager.ceph:need seq 326417514526 got 326417514529 for osd.11 2024-09-11T23:17:52.745 DEBUG:teuthology.parallel:result is None 2024-09-11T23:17:52.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:52.929+0000 7f728a000640 1 -- 172.21.15.37:0/2411670187 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7284074590 msgr2=0x7f7284074970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:52.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:52.929+0000 7f728a000640 1 --2- 172.21.15.37:0/2411670187 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7284074590 0x7f7284074970 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f7274009900 tx=0x7f727402a480 comp rx=0 tx=0).stop 2024-09-11T23:17:52.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:52.930+0000 7f728a000640 1 -- 172.21.15.37:0/2411670187 shutdown_connections 2024-09-11T23:17:52.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:52.930+0000 7f728a000640 1 --2- 172.21.15.37:0/2411670187 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7284112b90 0x7f7284114f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:52.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:52.930+0000 7f728a000640 1 --2- 172.21.15.37:0/2411670187 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7284074eb0 0x7f7284112650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:52.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:52.930+0000 7f728a000640 1 --2- 172.21.15.37:0/2411670187 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7284074590 0x7f7284074970 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:52.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:52.930+0000 7f728a000640 1 -- 172.21.15.37:0/2411670187 >> 172.21.15.37:0/2411670187 conn(0x7f72840fd8c0 msgr2=0x7f72840ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:52.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:52.930+0000 7f728a000640 1 -- 172.21.15.37:0/2411670187 shutdown_connections 2024-09-11T23:17:52.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:52.930+0000 7f728a000640 1 -- 172.21.15.37:0/2411670187 wait complete. 2024-09-11T23:17:52.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:52.931+0000 7f728a000640 1 Processor -- start 2024-09-11T23:17:52.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:52.931+0000 7f728a000640 1 -- start start 2024-09-11T23:17:52.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:52.931+0000 7f728a000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7284074590 0x7f72841a4730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:52.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:52.931+0000 7f728a000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7284074eb0 0x7f72841a4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:52.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:52.931+0000 7f728a000640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7284112b90 0x7f728419e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:52.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:52.931+0000 7f728a000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f72841185c0 con 0x7f7284074590 2024-09-11T23:17:52.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:52.931+0000 7f728a000640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f7284118440 con 0x7f7284074eb0 2024-09-11T23:17:52.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:52.931+0000 7f728a000640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f7284118740 con 0x7f7284112b90 2024-09-11T23:17:52.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:52.932+0000 7f7283400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7284074590 0x7f72841a4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:52.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:52.932+0000 7f7282a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7284074eb0 0x7f72841a4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:52.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:52.932+0000 7f7282a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7284074eb0 0x7f72841a4c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.37:49412/0 (socket says 172.21.15.37:49412) 2024-09-11T23:17:52.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:52.932+0000 7f7282a00640 1 -- 172.21.15.37:0/2357543033 learned_addr learned my addr 172.21.15.37:0/2357543033 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:17:52.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:52.932+0000 7f7283400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7284074590 0x7f72841a4730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37908/0 (socket says 172.21.15.37:37908) 2024-09-11T23:17:52.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:52.932+0000 7f7283e00640 1 --2- 172.21.15.37:0/2357543033 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7284112b90 0x7f728419e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:52.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:52.932+0000 7f7282a00640 1 -- 172.21.15.37:0/2357543033 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7284112b90 msgr2=0x7f728419e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:52.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:52.932+0000 7f7282a00640 1 --2- 172.21.15.37:0/2357543033 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7284112b90 0x7f728419e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:52.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:52.932+0000 7f7282a00640 1 -- 172.21.15.37:0/2357543033 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7284074590 msgr2=0x7f72841a4730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:52.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:52.932+0000 7f7282a00640 1 --2- 172.21.15.37:0/2357543033 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7284074590 0x7f72841a4730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:52.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:52.932+0000 7f7282a00640 1 -- 172.21.15.37:0/2357543033 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f728419f020 con 0x7f7284074eb0 2024-09-11T23:17:52.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:52.933+0000 7f7282a00640 1 --2- 172.21.15.37:0/2357543033 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7284074eb0 0x7f72841a4c70 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f727000e9f0 tx=0x7f727000edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:52.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:52.933+0000 7f727be00640 1 -- 172.21.15.37:0/2357543033 <== mon.2 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f727000cd80 con 0x7f7284074eb0 2024-09-11T23:17:52.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:52.933+0000 7f728a000640 1 -- 172.21.15.37:0/2357543033 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f728419f310 con 0x7f7284074eb0 2024-09-11T23:17:52.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:52.933+0000 7f727be00640 1 -- 172.21.15.37:0/2357543033 <== mon.2 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7270005500 con 0x7f7284074eb0 2024-09-11T23:17:52.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:52.933+0000 7f727be00640 1 -- 172.21.15.37:0/2357543033 <== mon.2 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7270010690 con 0x7f7284074eb0 2024-09-11T23:17:52.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:52.933+0000 7f728a000640 1 -- 172.21.15.37:0/2357543033 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72841ab600 con 0x7f7284074eb0 2024-09-11T23:17:52.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:52.934+0000 7f728a000640 1 -- 172.21.15.37:0/2357543033 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7284074970 con 0x7f7284074eb0 2024-09-11T23:17:52.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:52.937+0000 7f727be00640 1 -- 172.21.15.37:0/2357543033 <== mon.2 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f72700046c0 con 0x7f7284074eb0 2024-09-11T23:17:52.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:52.938+0000 7f727be00640 1 --2- 172.21.15.37:0/2357543033 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f72680a2c10 0x7f72680a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:52.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:52.938+0000 7f727be00640 1 -- 172.21.15.37:0/2357543033 <== mon.2 v2:172.21.15.123:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9295+0+0 (secure 0 0 0) 0x7f72700cf9d0 con 0x7f7284074eb0 2024-09-11T23:17:52.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:52.938+0000 7f7283400640 1 --2- 172.21.15.37:0/2357543033 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f72680a2c10 0x7f72680a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:52.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:52.939+0000 7f7283400640 1 --2- 172.21.15.37:0/2357543033 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f72680a2c10 0x7f72680a50d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f7274006010 tx=0x7f7274000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:52.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:52.942+0000 7f727be00640 1 -- 172.21.15.37:0/2357543033 <== mon.2 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f727009c350 con 0x7f7284074eb0 2024-09-11T23:17:53.031 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:52 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/1315304906' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-11T23:17:53.031 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:52 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]: dispatch 2024-09-11T23:17:53.031 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:52 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 1]}]: dispatch 2024-09-11T23:17:53.031 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:52 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 11]}]: dispatch 2024-09-11T23:17:53.031 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:52 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.5", "id": [9, 10]}]: dispatch 2024-09-11T23:17:53.031 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:52 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [9, 8]}]: dispatch 2024-09-11T23:17:53.032 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:52 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.11", "id": [5, 8]}]: dispatch 2024-09-11T23:17:53.032 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:52 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.16", "id": [9, 8]}]: dispatch 2024-09-11T23:17:53.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:52.419+0000 7f7b50a00640 1 -- 172.21.15.37:0/3179034368 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b4c1049a0 msgr2=0x7f7b4c1089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:53.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:52.419+0000 7f7b50a00640 1 --2- 172.21.15.37:0/3179034368 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b4c1049a0 0x7f7b4c1089f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f7b38009900 tx=0x7f7b3802a410 comp rx=0 tx=0).stop 2024-09-11T23:17:53.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:52.419+0000 7f7b50a00640 1 -- 172.21.15.37:0/3179034368 shutdown_connections 2024-09-11T23:17:53.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:52.419+0000 7f7b50a00640 1 --2- 172.21.15.37:0/3179034368 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7b4c109120 0x7f7b4c110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:53.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:52.419+0000 7f7b50a00640 1 --2- 172.21.15.37:0/3179034368 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b4c1049a0 0x7f7b4c1089f0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:53.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:52.419+0000 7f7b50a00640 1 --2- 172.21.15.37:0/3179034368 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b4c103ff0 0x7f7b4c1043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:53.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:52.419+0000 7f7b50a00640 1 -- 172.21.15.37:0/3179034368 >> 172.21.15.37:0/3179034368 conn(0x7f7b4c0ffa90 msgr2=0x7f7b4c101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:53.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:52.419+0000 7f7b50a00640 1 -- 172.21.15.37:0/3179034368 shutdown_connections 2024-09-11T23:17:53.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:52.419+0000 7f7b50a00640 1 -- 172.21.15.37:0/3179034368 wait complete. 2024-09-11T23:17:53.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:52.420+0000 7f7b50a00640 1 Processor -- start 2024-09-11T23:17:53.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:52.420+0000 7f7b50a00640 1 -- start start 2024-09-11T23:17:53.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:52.421+0000 7f7b50a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b4c103ff0 0x7f7b4c19a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:53.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:52.421+0000 7f7b50a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b4c1049a0 0x7f7b4c19abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:53.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:52.421+0000 7f7b50a00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7b4c109120 0x7f7b4c19ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:53.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:52.421+0000 7f7b50a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7b4c114190 con 0x7f7b4c103ff0 2024-09-11T23:17:53.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:52.421+0000 7f7b50a00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f7b4c114010 con 0x7f7b4c1049a0 2024-09-11T23:17:53.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:52.421+0000 7f7b50a00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f7b4c114310 con 0x7f7b4c109120 2024-09-11T23:17:53.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:52.421+0000 7f7b49e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b4c103ff0 0x7f7b4c19a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:53.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:52.421+0000 7f7b49e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b4c103ff0 0x7f7b4c19a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37896/0 (socket says 172.21.15.37:37896) 2024-09-11T23:17:53.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:52.421+0000 7f7b49e00640 1 -- 172.21.15.37:0/1315304906 learned_addr learned my addr 172.21.15.37:0/1315304906 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:17:53.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:52.421+0000 7f7b49400640 1 --2- 172.21.15.37:0/1315304906 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b4c1049a0 0x7f7b4c19abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:53.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:52.421+0000 7f7b4a800640 1 --2- 172.21.15.37:0/1315304906 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7b4c109120 0x7f7b4c19ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:53.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:52.422+0000 7f7b49e00640 1 -- 172.21.15.37:0/1315304906 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7b4c109120 msgr2=0x7f7b4c19ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:53.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:52.422+0000 7f7b49e00640 1 --2- 172.21.15.37:0/1315304906 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7b4c109120 0x7f7b4c19ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:53.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:52.422+0000 7f7b49e00640 1 -- 172.21.15.37:0/1315304906 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b4c1049a0 msgr2=0x7f7b4c19abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:53.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:52.422+0000 7f7b49e00640 1 --2- 172.21.15.37:0/1315304906 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b4c1049a0 0x7f7b4c19abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:53.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:52.422+0000 7f7b49e00640 1 -- 172.21.15.37:0/1315304906 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b4c19f620 con 0x7f7b4c103ff0 2024-09-11T23:17:53.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:52.422+0000 7f7b49e00640 1 --2- 172.21.15.37:0/1315304906 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b4c103ff0 0x7f7b4c19a670 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c00e9f0 tx=0x7f7b3c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:53.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:52.422+0000 7f7b42a00640 1 -- 172.21.15.37:0/1315304906 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b3c00cd80 con 0x7f7b4c103ff0 2024-09-11T23:17:53.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:52.422+0000 7f7b50a00640 1 -- 172.21.15.37:0/1315304906 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b4c19f910 con 0x7f7b4c103ff0 2024-09-11T23:17:53.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:52.422+0000 7f7b42a00640 1 -- 172.21.15.37:0/1315304906 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7b3c010910 con 0x7f7b4c103ff0 2024-09-11T23:17:53.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:52.422+0000 7f7b42a00640 1 -- 172.21.15.37:0/1315304906 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b3c0188f0 con 0x7f7b4c103ff0 2024-09-11T23:17:53.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:52.422+0000 7f7b50a00640 1 -- 172.21.15.37:0/1315304906 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b4c1a71f0 con 0x7f7b4c103ff0 2024-09-11T23:17:53.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:52.424+0000 7f7b50a00640 1 -- 172.21.15.37:0/1315304906 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b4c1043d0 con 0x7f7b4c103ff0 2024-09-11T23:17:53.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:52.426+0000 7f7b42a00640 1 -- 172.21.15.37:0/1315304906 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f7b3c010ac0 con 0x7f7b4c103ff0 2024-09-11T23:17:53.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:52.427+0000 7f7b42a00640 1 --2- 172.21.15.37:0/1315304906 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f7b300a2c90 0x7f7b300a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:53.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:52.427+0000 7f7b42a00640 1 -- 172.21.15.37:0/1315304906 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9092+0+0 (secure 0 0 0) 0x7f7b3c0cfd30 con 0x7f7b4c103ff0 2024-09-11T23:17:53.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:52.427+0000 7f7b49400640 1 --2- 172.21.15.37:0/1315304906 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f7b300a2c90 0x7f7b300a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:53.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:52.428+0000 7f7b49400640 1 --2- 172.21.15.37:0/1315304906 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f7b300a2c90 0x7f7b300a5150 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f7b38000c00 tx=0x7f7b38005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:53.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:52.429+0000 7f7b42a00640 1 -- 172.21.15.37:0/1315304906 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7b3c09c770 con 0x7f7b4c103ff0 2024-09-11T23:17:53.102 INFO:teuthology.orchestra.run.smithi037.stdout:137438953542 2024-09-11T23:17:53.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:52.616+0000 7f7b50a00640 1 -- 172.21.15.37:0/1315304906 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f7b4c10c360 con 0x7f7b4c103ff0 2024-09-11T23:17:53.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:52.616+0000 7f7b42a00640 1 -- 172.21.15.37:0/1315304906 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f7b3c09c070 con 0x7f7b4c103ff0 2024-09-11T23:17:53.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:52.618+0000 7f7b50a00640 1 -- 172.21.15.37:0/1315304906 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f7b300a2c90 msgr2=0x7f7b300a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:53.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:52.618+0000 7f7b50a00640 1 --2- 172.21.15.37:0/1315304906 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f7b300a2c90 0x7f7b300a5150 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f7b38000c00 tx=0x7f7b38005b50 comp rx=0 tx=0).stop 2024-09-11T23:17:53.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:52.618+0000 7f7b50a00640 1 -- 172.21.15.37:0/1315304906 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b4c103ff0 msgr2=0x7f7b4c19a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:53.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:52.618+0000 7f7b50a00640 1 --2- 172.21.15.37:0/1315304906 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b4c103ff0 0x7f7b4c19a670 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c00e9f0 tx=0x7f7b3c00eeb0 comp rx=0 tx=0).stop 2024-09-11T23:17:53.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:52.619+0000 7f7b50a00640 1 -- 172.21.15.37:0/1315304906 shutdown_connections 2024-09-11T23:17:53.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:52.619+0000 7f7b50a00640 1 --2- 172.21.15.37:0/1315304906 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f7b300a2c90 0x7f7b300a5150 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:53.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:52.619+0000 7f7b50a00640 1 --2- 172.21.15.37:0/1315304906 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b4c1049a0 0x7f7b4c19abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:53.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:52.619+0000 7f7b50a00640 1 --2- 172.21.15.37:0/1315304906 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7b4c109120 0x7f7b4c19ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:53.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:52.619+0000 7f7b50a00640 1 --2- 172.21.15.37:0/1315304906 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b4c103ff0 0x7f7b4c19a670 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:53.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:52.619+0000 7f7b50a00640 1 -- 172.21.15.37:0/1315304906 >> 172.21.15.37:0/1315304906 conn(0x7f7b4c0ffa90 msgr2=0x7f7b4c100d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:53.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:52.619+0000 7f7b50a00640 1 -- 172.21.15.37:0/1315304906 shutdown_connections 2024-09-11T23:17:53.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:52.619+0000 7f7b50a00640 1 -- 172.21.15.37:0/1315304906 wait complete. 2024-09-11T23:17:53.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:53.136+0000 7f728a000640 1 -- 172.21.15.37:0/2357543033 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f728402d7c0 con 0x7f7284074eb0 2024-09-11T23:17:53.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:53.137+0000 7f727be00640 1 -- 172.21.15.37:0/2357543033 <== mon.2 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f727009bc50 con 0x7f7284074eb0 2024-09-11T23:17:53.138 INFO:teuthology.orchestra.run.smithi037.stdout:55834574934 2024-09-11T23:17:53.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:53.139+0000 7f728a000640 1 -- 172.21.15.37:0/2357543033 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f72680a2c10 msgr2=0x7f72680a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:53.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:53.139+0000 7f728a000640 1 --2- 172.21.15.37:0/2357543033 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f72680a2c10 0x7f72680a50d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f7274006010 tx=0x7f7274000bc0 comp rx=0 tx=0).stop 2024-09-11T23:17:53.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:53.139+0000 7f728a000640 1 -- 172.21.15.37:0/2357543033 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7284074eb0 msgr2=0x7f72841a4c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:53.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:53.139+0000 7f728a000640 1 --2- 172.21.15.37:0/2357543033 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7284074eb0 0x7f72841a4c70 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f727000e9f0 tx=0x7f727000edf0 comp rx=0 tx=0).stop 2024-09-11T23:17:53.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:53.139+0000 7f728a000640 1 -- 172.21.15.37:0/2357543033 shutdown_connections 2024-09-11T23:17:53.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:53.139+0000 7f728a000640 1 --2- 172.21.15.37:0/2357543033 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f72680a2c10 0x7f72680a50d0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:53.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:53.139+0000 7f728a000640 1 --2- 172.21.15.37:0/2357543033 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7284074eb0 0x7f72841a4c70 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:53.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:53.139+0000 7f728a000640 1 --2- 172.21.15.37:0/2357543033 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7284112b90 0x7f728419e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:53.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:53.139+0000 7f728a000640 1 --2- 172.21.15.37:0/2357543033 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7284074590 0x7f72841a4730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:53.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:53.139+0000 7f728a000640 1 -- 172.21.15.37:0/2357543033 >> 172.21.15.37:0/2357543033 conn(0x7f72840fd8c0 msgr2=0x7f72840ff010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:53.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:53.140+0000 7f728a000640 1 -- 172.21.15.37:0/2357543033 shutdown_connections 2024-09-11T23:17:53.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:53.140+0000 7f728a000640 1 -- 172.21.15.37:0/2357543033 wait complete. 2024-09-11T23:17:53.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:52 smithi160 ceph-mon[35055]: from='client.? 172.21.15.37:0/1315304906' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-11T23:17:53.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:52 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]: dispatch 2024-09-11T23:17:53.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:52 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 1]}]: dispatch 2024-09-11T23:17:53.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:52 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 11]}]: dispatch 2024-09-11T23:17:53.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:52 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.5", "id": [9, 10]}]: dispatch 2024-09-11T23:17:53.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:52 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [9, 8]}]: dispatch 2024-09-11T23:17:53.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:52 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.11", "id": [5, 8]}]: dispatch 2024-09-11T23:17:53.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:52 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.16", "id": [9, 8]}]: dispatch 2024-09-11T23:17:53.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:52 smithi123 ceph-mon[35438]: from='client.? 172.21.15.37:0/1315304906' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-11T23:17:53.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:52 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]: dispatch 2024-09-11T23:17:53.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:52 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 1]}]: dispatch 2024-09-11T23:17:53.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:52 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 11]}]: dispatch 2024-09-11T23:17:53.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:52 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.5", "id": [9, 10]}]: dispatch 2024-09-11T23:17:53.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:52 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [9, 8]}]: dispatch 2024-09-11T23:17:53.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:52 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.11", "id": [5, 8]}]: dispatch 2024-09-11T23:17:53.252 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:52 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.16", "id": [9, 8]}]: dispatch 2024-09-11T23:17:54.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:53 smithi037 ceph-mon[30630]: pgmap v353: 129 pgs: 129 active+clean; 646 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-09-11T23:17:54.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:53 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2024-09-11T23:17:54.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:53 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 1]}]': finished 2024-09-11T23:17:54.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:53 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 11]}]': finished 2024-09-11T23:17:54.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:53 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.5", "id": [9, 10]}]': finished 2024-09-11T23:17:54.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:53 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [9, 8]}]': finished 2024-09-11T23:17:54.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:53 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.11", "id": [5, 8]}]': finished 2024-09-11T23:17:54.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:53 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.16", "id": [9, 8]}]': finished 2024-09-11T23:17:54.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:53 smithi037 ceph-mon[30630]: osdmap e94: 12 total, 12 up, 12 in 2024-09-11T23:17:54.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:53 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/2357543033' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-11T23:17:54.125 INFO:tasks.cephadm.ceph_manager.ceph:need seq 137438953539 got 137438953542 for osd.4 2024-09-11T23:17:54.125 DEBUG:teuthology.parallel:result is None 2024-09-11T23:17:54.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:53 smithi160 ceph-mon[35055]: pgmap v353: 129 pgs: 129 active+clean; 646 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-09-11T23:17:54.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:53 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2024-09-11T23:17:54.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:53 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 1]}]': finished 2024-09-11T23:17:54.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:53 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 11]}]': finished 2024-09-11T23:17:54.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:53 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.5", "id": [9, 10]}]': finished 2024-09-11T23:17:54.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:53 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [9, 8]}]': finished 2024-09-11T23:17:54.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:53 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.11", "id": [5, 8]}]': finished 2024-09-11T23:17:54.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:53 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.16", "id": [9, 8]}]': finished 2024-09-11T23:17:54.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:53 smithi160 ceph-mon[35055]: osdmap e94: 12 total, 12 up, 12 in 2024-09-11T23:17:54.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:53 smithi160 ceph-mon[35055]: from='client.? 172.21.15.37:0/2357543033' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-11T23:17:54.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:53 smithi123 ceph-mon[35438]: pgmap v353: 129 pgs: 129 active+clean; 646 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-09-11T23:17:54.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:53 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2024-09-11T23:17:54.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:53 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 1]}]': finished 2024-09-11T23:17:54.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:53 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 11]}]': finished 2024-09-11T23:17:54.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:53 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.5", "id": [9, 10]}]': finished 2024-09-11T23:17:54.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:53 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [9, 8]}]': finished 2024-09-11T23:17:54.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:53 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.11", "id": [5, 8]}]': finished 2024-09-11T23:17:54.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:53 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.16", "id": [9, 8]}]': finished 2024-09-11T23:17:54.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:53 smithi123 ceph-mon[35438]: osdmap e94: 12 total, 12 up, 12 in 2024-09-11T23:17:54.252 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:53 smithi123 ceph-mon[35438]: from='client.? 172.21.15.37:0/2357543033' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-11T23:17:54.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:54.372+0000 7effa2a00640 1 -- 172.21.15.37:0/2158205814 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff9c074ee0 msgr2=0x7eff9c10def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:54.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:54.372+0000 7effa2a00640 1 --2- 172.21.15.37:0/2158205814 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff9c074ee0 0x7eff9c10def0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7eff84009900 tx=0x7eff8402a480 comp rx=0 tx=0).stop 2024-09-11T23:17:54.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:54.372+0000 7effa2a00640 1 -- 172.21.15.37:0/2158205814 shutdown_connections 2024-09-11T23:17:54.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:54.372+0000 7effa2a00640 1 --2- 172.21.15.37:0/2158205814 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7eff9c10e430 0x7eff9c110820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:54.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:54.372+0000 7effa2a00640 1 --2- 172.21.15.37:0/2158205814 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff9c074ee0 0x7eff9c10def0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:54.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:54.372+0000 7effa2a00640 1 --2- 172.21.15.37:0/2158205814 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7eff9c0745c0 0x7eff9c0749a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:54.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:54.372+0000 7effa2a00640 1 -- 172.21.15.37:0/2158205814 >> 172.21.15.37:0/2158205814 conn(0x7eff9c0fd8b0 msgr2=0x7eff9c0ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:54.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:54.372+0000 7effa2a00640 1 -- 172.21.15.37:0/2158205814 shutdown_connections 2024-09-11T23:17:54.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:54.372+0000 7effa2a00640 1 -- 172.21.15.37:0/2158205814 wait complete. 2024-09-11T23:17:54.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:54.373+0000 7effa2a00640 1 Processor -- start 2024-09-11T23:17:54.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:54.373+0000 7effa2a00640 1 -- start start 2024-09-11T23:17:54.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:54.373+0000 7effa2a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7eff9c0745c0 0x7eff9c19a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:54.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:54.373+0000 7effa2a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff9c074ee0 0x7eff9c19ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:54.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:54.374+0000 7effa2a00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7eff9c10e430 0x7eff9c19efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:54.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:54.374+0000 7effa2a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7eff9c114190 con 0x7eff9c074ee0 2024-09-11T23:17:54.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:54.374+0000 7effa2a00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7eff9c114010 con 0x7eff9c0745c0 2024-09-11T23:17:54.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:54.374+0000 7effa2a00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7eff9c114310 con 0x7eff9c10e430 2024-09-11T23:17:54.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:54.374+0000 7eff93400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff9c074ee0 0x7eff9c19ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:54.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:54.374+0000 7eff93400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff9c074ee0 0x7eff9c19ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37928/0 (socket says 172.21.15.37:37928) 2024-09-11T23:17:54.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:54.374+0000 7eff93400640 1 -- 172.21.15.37:0/1921161917 learned_addr learned my addr 172.21.15.37:0/1921161917 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:17:54.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:54.374+0000 7eff9be00640 1 --2- 172.21.15.37:0/1921161917 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7eff9c0745c0 0x7eff9c19a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:54.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:54.374+0000 7effa0a00640 1 --2- 172.21.15.37:0/1921161917 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7eff9c10e430 0x7eff9c19efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:54.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:54.374+0000 7eff93400640 1 -- 172.21.15.37:0/1921161917 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7eff9c10e430 msgr2=0x7eff9c19efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:54.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:54.374+0000 7eff93400640 1 --2- 172.21.15.37:0/1921161917 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7eff9c10e430 0x7eff9c19efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:54.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:54.374+0000 7eff93400640 1 -- 172.21.15.37:0/1921161917 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7eff9c0745c0 msgr2=0x7eff9c19a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:54.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:54.374+0000 7eff93400640 1 --2- 172.21.15.37:0/1921161917 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7eff9c0745c0 0x7eff9c19a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:54.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:54.374+0000 7eff93400640 1 -- 172.21.15.37:0/1921161917 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff9c19f6a0 con 0x7eff9c074ee0 2024-09-11T23:17:54.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:54.374+0000 7eff9be00640 1 --2- 172.21.15.37:0/1921161917 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7eff9c0745c0 0x7eff9c19a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:17:54.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:54.375+0000 7eff93400640 1 --2- 172.21.15.37:0/1921161917 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff9c074ee0 0x7eff9c19ac30 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7eff84006010 tx=0x7eff84004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:54.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:54.375+0000 7eff99600640 1 -- 172.21.15.37:0/1921161917 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff8403f030 con 0x7eff9c074ee0 2024-09-11T23:17:54.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:54.375+0000 7eff99600640 1 -- 172.21.15.37:0/1921161917 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7eff84004440 con 0x7eff9c074ee0 2024-09-11T23:17:54.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:54.375+0000 7effa2a00640 1 -- 172.21.15.37:0/1921161917 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff9c19f930 con 0x7eff9c074ee0 2024-09-11T23:17:54.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:54.375+0000 7eff99600640 1 -- 172.21.15.37:0/1921161917 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff84035070 con 0x7eff9c074ee0 2024-09-11T23:17:54.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:54.375+0000 7effa2a00640 1 -- 172.21.15.37:0/1921161917 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff9c1a7270 con 0x7eff9c074ee0 2024-09-11T23:17:54.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:54.376+0000 7effa2a00640 1 -- 172.21.15.37:0/1921161917 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff9c075c70 con 0x7eff9c074ee0 2024-09-11T23:17:54.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:54.378+0000 7eff99600640 1 -- 172.21.15.37:0/1921161917 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7eff84042030 con 0x7eff9c074ee0 2024-09-11T23:17:54.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:54.379+0000 7eff99600640 1 --2- 172.21.15.37:0/1921161917 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7eff800a2c10 0x7eff800a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:54.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:54.380+0000 7eff99600640 1 -- 172.21.15.37:0/1921161917 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9295+0+0 (secure 0 0 0) 0x7eff840ef9a0 con 0x7eff9c074ee0 2024-09-11T23:17:54.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:54.380+0000 7eff9be00640 1 --2- 172.21.15.37:0/1921161917 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7eff800a2c10 0x7eff800a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:54.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:54.380+0000 7eff9be00640 1 --2- 172.21.15.37:0/1921161917 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7eff800a2c10 0x7eff800a50d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7eff8c009fc0 tx=0x7eff8c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:54.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:54.384+0000 7eff99600640 1 -- 172.21.15.37:0/1921161917 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7eff840bbcd0 con 0x7eff9c074ee0 2024-09-11T23:17:54.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:54.573+0000 7effa2a00640 1 -- 172.21.15.37:0/1921161917 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7eff9c1095b0 con 0x7eff9c074ee0 2024-09-11T23:17:54.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:54.574+0000 7eff99600640 1 -- 172.21.15.37:0/1921161917 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7eff840bffd0 con 0x7eff9c074ee0 2024-09-11T23:17:54.575 INFO:teuthology.orchestra.run.smithi037.stdout:158913790017 2024-09-11T23:17:54.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:54.576+0000 7effa2a00640 1 -- 172.21.15.37:0/1921161917 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7eff800a2c10 msgr2=0x7eff800a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:54.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:54.576+0000 7effa2a00640 1 --2- 172.21.15.37:0/1921161917 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7eff800a2c10 0x7eff800a50d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7eff8c009fc0 tx=0x7eff8c005f90 comp rx=0 tx=0).stop 2024-09-11T23:17:54.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:54.576+0000 7effa2a00640 1 -- 172.21.15.37:0/1921161917 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff9c074ee0 msgr2=0x7eff9c19ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:54.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:54.576+0000 7effa2a00640 1 --2- 172.21.15.37:0/1921161917 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff9c074ee0 0x7eff9c19ac30 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7eff84006010 tx=0x7eff84004040 comp rx=0 tx=0).stop 2024-09-11T23:17:54.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:54.576+0000 7effa2a00640 1 -- 172.21.15.37:0/1921161917 shutdown_connections 2024-09-11T23:17:54.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:54.576+0000 7effa2a00640 1 --2- 172.21.15.37:0/1921161917 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7eff800a2c10 0x7eff800a50d0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:54.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:54.576+0000 7effa2a00640 1 --2- 172.21.15.37:0/1921161917 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7eff9c10e430 0x7eff9c19efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:54.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:54.576+0000 7effa2a00640 1 --2- 172.21.15.37:0/1921161917 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff9c074ee0 0x7eff9c19ac30 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:54.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:54.576+0000 7effa2a00640 1 --2- 172.21.15.37:0/1921161917 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7eff9c0745c0 0x7eff9c19a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:54.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:54.576+0000 7effa2a00640 1 -- 172.21.15.37:0/1921161917 >> 172.21.15.37:0/1921161917 conn(0x7eff9c0fd8b0 msgr2=0x7eff9c0fe510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:54.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:54.577+0000 7effa2a00640 1 -- 172.21.15.37:0/1921161917 shutdown_connections 2024-09-11T23:17:54.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:54.577+0000 7effa2a00640 1 -- 172.21.15.37:0/1921161917 wait complete. 2024-09-11T23:17:55.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:55.068+0000 7f1a32800640 1 -- 172.21.15.37:0/3501363991 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a2c101de0 msgr2=0x7f1a2c1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:55.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:55.069+0000 7f1a32800640 1 --2- 172.21.15.37:0/3501363991 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a2c101de0 0x7f1a2c1021c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c009900 tx=0x7f1a1c02a3f0 comp rx=0 tx=0).stop 2024-09-11T23:17:55.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:55.069+0000 7f1a32800640 1 -- 172.21.15.37:0/3501363991 shutdown_connections 2024-09-11T23:17:55.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:55.069+0000 7f1a32800640 1 --2- 172.21.15.37:0/3501363991 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1a2c106f10 0x7f1a2c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:55.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:55.069+0000 7f1a32800640 1 --2- 172.21.15.37:0/3501363991 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1a2c102790 0x7f1a2c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:55.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:55.069+0000 7f1a32800640 1 --2- 172.21.15.37:0/3501363991 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a2c101de0 0x7f1a2c1021c0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:55.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:55.069+0000 7f1a32800640 1 -- 172.21.15.37:0/3501363991 >> 172.21.15.37:0/3501363991 conn(0x7f1a2c0fd8c0 msgr2=0x7f1a2c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:55.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:55.069+0000 7f1a32800640 1 -- 172.21.15.37:0/3501363991 shutdown_connections 2024-09-11T23:17:55.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:55.069+0000 7f1a32800640 1 -- 172.21.15.37:0/3501363991 wait complete. 2024-09-11T23:17:55.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:55.070+0000 7f1a32800640 1 Processor -- start 2024-09-11T23:17:55.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:55.070+0000 7f1a32800640 1 -- start start 2024-09-11T23:17:55.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:55.070+0000 7f1a32800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1a2c101de0 0x7f1a2c19a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:55.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:55.070+0000 7f1a32800640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1a2c102790 0x7f1a2c19ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:55.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:55.070+0000 7f1a32800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a2c106f10 0x7f1a2c19ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:55.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:55.070+0000 7f1a32800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1a2c111f70 con 0x7f1a2c106f10 2024-09-11T23:17:55.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:55.070+0000 7f1a32800640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f1a2c111df0 con 0x7f1a2c101de0 2024-09-11T23:17:55.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:55.070+0000 7f1a32800640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f1a2c1120f0 con 0x7f1a2c102790 2024-09-11T23:17:55.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:55.071+0000 7f1a2be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a2c106f10 0x7f1a2c19ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:55.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:55.071+0000 7f1a2b400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1a2c101de0 0x7f1a2c19a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:55.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:55.071+0000 7f1a2be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a2c106f10 0x7f1a2c19ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37944/0 (socket says 172.21.15.37:37944) 2024-09-11T23:17:55.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:55.071+0000 7f1a2b400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1a2c101de0 0x7f1a2c19a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.37:49446/0 (socket says 172.21.15.37:49446) 2024-09-11T23:17:55.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:55.071+0000 7f1a2be00640 1 -- 172.21.15.37:0/493886621 learned_addr learned my addr 172.21.15.37:0/493886621 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:17:55.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:55.071+0000 7f1a22a00640 1 --2- 172.21.15.37:0/493886621 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1a2c102790 0x7f1a2c19ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:55.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:55.071+0000 7f1a2b400640 1 -- 172.21.15.37:0/493886621 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1a2c102790 msgr2=0x7f1a2c19ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:55.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:55.071+0000 7f1a2b400640 1 --2- 172.21.15.37:0/493886621 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1a2c102790 0x7f1a2c19ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:55.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:55.071+0000 7f1a2b400640 1 -- 172.21.15.37:0/493886621 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a2c106f10 msgr2=0x7f1a2c19ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:55.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:55.071+0000 7f1a2b400640 1 --2- 172.21.15.37:0/493886621 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a2c106f10 0x7f1a2c19ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:55.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:55.071+0000 7f1a2b400640 1 -- 172.21.15.37:0/493886621 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a2c19f5e0 con 0x7f1a2c101de0 2024-09-11T23:17:55.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:55.071+0000 7f1a2be00640 1 --2- 172.21.15.37:0/493886621 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a2c106f10 0x7f1a2c19ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:17:55.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:55.072+0000 7f1a2b400640 1 --2- 172.21.15.37:0/493886621 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1a2c101de0 0x7f1a2c19a630 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c005940 tx=0x7f1a1c0040c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:55.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:55.072+0000 7f1a28c00640 1 -- 172.21.15.37:0/493886621 <== mon.2 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a1c03f030 con 0x7f1a2c101de0 2024-09-11T23:17:55.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:55.072+0000 7f1a28c00640 1 -- 172.21.15.37:0/493886621 <== mon.2 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1a1c0044c0 con 0x7f1a2c101de0 2024-09-11T23:17:55.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:55.072+0000 7f1a32800640 1 -- 172.21.15.37:0/493886621 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a2c19f870 con 0x7f1a2c101de0 2024-09-11T23:17:55.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:55.072+0000 7f1a28c00640 1 -- 172.21.15.37:0/493886621 <== mon.2 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a1c035070 con 0x7f1a2c101de0 2024-09-11T23:17:55.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:55.072+0000 7f1a32800640 1 -- 172.21.15.37:0/493886621 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a2c1a71b0 con 0x7f1a2c101de0 2024-09-11T23:17:55.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:55.073+0000 7f1a32800640 1 -- 172.21.15.37:0/493886621 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a2c1032c0 con 0x7f1a2c101de0 2024-09-11T23:17:55.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:55.075+0000 7f1a28c00640 1 -- 172.21.15.37:0/493886621 <== mon.2 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f1a1c042030 con 0x7f1a2c101de0 2024-09-11T23:17:55.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:55.076+0000 7f1a28c00640 1 --2- 172.21.15.37:0/493886621 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f1a100a2c10 0x7f1a100a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:55.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:55.076+0000 7f1a28c00640 1 -- 172.21.15.37:0/493886621 <== mon.2 v2:172.21.15.123:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9295+0+0 (secure 0 0 0) 0x7f1a1c0ef5d0 con 0x7f1a2c101de0 2024-09-11T23:17:55.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:55.076+0000 7f1a22a00640 1 --2- 172.21.15.37:0/493886621 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f1a100a2c10 0x7f1a100a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:55.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:55.077+0000 7f1a22a00640 1 --2- 172.21.15.37:0/493886621 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f1a100a2c10 0x7f1a100a50d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c0fe1a0 tx=0x7f1a14005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:55.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:55.080+0000 7f1a28c00640 1 -- 172.21.15.37:0/493886621 <== mon.2 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1a1c0bb900 con 0x7f1a2c101de0 2024-09-11T23:17:55.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:54 smithi160 ceph-mon[35055]: osdmap e95: 12 total, 12 up, 12 in 2024-09-11T23:17:55.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:54 smithi160 ceph-mon[35055]: from='client.? 172.21.15.37:0/1921161917' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-11T23:17:55.188 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:54 smithi037 ceph-mon[30630]: osdmap e95: 12 total, 12 up, 12 in 2024-09-11T23:17:55.188 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:54 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/1921161917' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-11T23:17:55.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:54 smithi123 ceph-mon[35438]: osdmap e95: 12 total, 12 up, 12 in 2024-09-11T23:17:55.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:54 smithi123 ceph-mon[35438]: from='client.? 172.21.15.37:0/1921161917' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-11T23:17:55.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:55.268+0000 7f1a32800640 1 -- 172.21.15.37:0/493886621 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f1a2c1a7380 con 0x7f1a2c101de0 2024-09-11T23:17:55.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:55.268+0000 7f1a28c00640 1 -- 172.21.15.37:0/493886621 <== mon.2 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f1a1c0bfc00 con 0x7f1a2c101de0 2024-09-11T23:17:55.269 INFO:teuthology.orchestra.run.smithi037.stdout:274877906988 2024-09-11T23:17:55.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:55.271+0000 7f1a32800640 1 -- 172.21.15.37:0/493886621 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f1a100a2c10 msgr2=0x7f1a100a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:55.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:55.271+0000 7f1a32800640 1 --2- 172.21.15.37:0/493886621 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f1a100a2c10 0x7f1a100a50d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c0fe1a0 tx=0x7f1a14005f90 comp rx=0 tx=0).stop 2024-09-11T23:17:55.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:55.271+0000 7f1a32800640 1 -- 172.21.15.37:0/493886621 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1a2c101de0 msgr2=0x7f1a2c19a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:55.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:55.271+0000 7f1a32800640 1 --2- 172.21.15.37:0/493886621 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1a2c101de0 0x7f1a2c19a630 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c005940 tx=0x7f1a1c0040c0 comp rx=0 tx=0).stop 2024-09-11T23:17:55.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:55.271+0000 7f1a32800640 1 -- 172.21.15.37:0/493886621 shutdown_connections 2024-09-11T23:17:55.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:55.271+0000 7f1a32800640 1 --2- 172.21.15.37:0/493886621 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f1a100a2c10 0x7f1a100a50d0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:55.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:55.271+0000 7f1a32800640 1 --2- 172.21.15.37:0/493886621 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a2c106f10 0x7f1a2c19ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:55.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:55.271+0000 7f1a32800640 1 --2- 172.21.15.37:0/493886621 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1a2c102790 0x7f1a2c19ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:55.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:55.271+0000 7f1a32800640 1 --2- 172.21.15.37:0/493886621 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1a2c101de0 0x7f1a2c19a630 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:55.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:55.271+0000 7f1a32800640 1 -- 172.21.15.37:0/493886621 >> 172.21.15.37:0/493886621 conn(0x7f1a2c0fd8c0 msgr2=0x7f1a2c0feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:55.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:55.271+0000 7f1a32800640 1 -- 172.21.15.37:0/493886621 shutdown_connections 2024-09-11T23:17:55.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:55.271+0000 7f1a32800640 1 -- 172.21.15.37:0/493886621 wait complete. 2024-09-11T23:17:56.017 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:17:56.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:55 smithi037 ceph-mon[30630]: pgmap v356: 129 pgs: 2 peering, 127 active+clean; 646 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 7 op/s 2024-09-11T23:17:56.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:55 smithi037 ceph-mon[30630]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-09-11T23:17:56.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:55 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/493886621' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-11T23:17:56.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:55 smithi160 ceph-mon[35055]: pgmap v356: 129 pgs: 2 peering, 127 active+clean; 646 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 7 op/s 2024-09-11T23:17:56.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:55 smithi160 ceph-mon[35055]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-09-11T23:17:56.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:55 smithi160 ceph-mon[35055]: from='client.? 172.21.15.37:0/493886621' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-11T23:17:56.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:55 smithi123 ceph-mon[35438]: pgmap v356: 129 pgs: 2 peering, 127 active+clean; 646 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 7 op/s 2024-09-11T23:17:56.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:55 smithi123 ceph-mon[35438]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-09-11T23:17:56.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:55 smithi123 ceph-mon[35438]: from='client.? 172.21.15.37:0/493886621' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-11T23:17:56.666 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574932 got 55834574934 for osd.1 2024-09-11T23:17:56.666 DEBUG:teuthology.parallel:result is None 2024-09-11T23:17:56.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:56.900+0000 7f42db800640 1 -- 172.21.15.37:0/4202655298 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f42d4101260 msgr2=0x7f42d410df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:56.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:56.900+0000 7f42db800640 1 --2- 172.21.15.37:0/4202655298 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f42d4101260 0x7f42d410df20 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f42c0009860 tx=0x7f42c002a340 comp rx=0 tx=0).stop 2024-09-11T23:17:56.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:56.900+0000 7f42db800640 1 -- 172.21.15.37:0/4202655298 shutdown_connections 2024-09-11T23:17:56.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:56.900+0000 7f42db800640 1 --2- 172.21.15.37:0/4202655298 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f42d410e460 0x7f42d4110850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:56.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:56.900+0000 7f42db800640 1 --2- 172.21.15.37:0/4202655298 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f42d4101260 0x7f42d410df20 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:56.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:56.900+0000 7f42db800640 1 --2- 172.21.15.37:0/4202655298 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42d41008b0 0x7f42d4100c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:56.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:56.900+0000 7f42db800640 1 -- 172.21.15.37:0/4202655298 >> 172.21.15.37:0/4202655298 conn(0x7f42d40fc780 msgr2=0x7f42d40feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:56.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:56.900+0000 7f42db800640 1 -- 172.21.15.37:0/4202655298 shutdown_connections 2024-09-11T23:17:56.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:56.900+0000 7f42db800640 1 -- 172.21.15.37:0/4202655298 wait complete. 2024-09-11T23:17:56.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:56.901+0000 7f42db800640 1 Processor -- start 2024-09-11T23:17:56.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:56.901+0000 7f42db800640 1 -- start start 2024-09-11T23:17:56.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:56.902+0000 7f42db800640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f42d41008b0 0x7f42d419a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:56.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:56.902+0000 7f42db800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f42d4101260 0x7f42d419ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:56.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:56.902+0000 7f42db800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42d410e460 0x7f42d419efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:56.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:56.902+0000 7f42db800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f42d4114180 con 0x7f42d410e460 2024-09-11T23:17:56.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:56.902+0000 7f42db800640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f42d4114000 con 0x7f42d4101260 2024-09-11T23:17:56.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:56.902+0000 7f42db800640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f42d4114300 con 0x7f42d41008b0 2024-09-11T23:17:56.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:56.902+0000 7f42d8e00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f42d41008b0 0x7f42d419a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:56.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:56.902+0000 7f42d3e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f42d4101260 0x7f42d419ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:56.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:56.902+0000 7f42d8e00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f42d41008b0 0x7f42d419a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.37:49736/0 (socket says 172.21.15.37:49736) 2024-09-11T23:17:56.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:56.902+0000 7f42d8e00640 1 -- 172.21.15.37:0/2546644056 learned_addr learned my addr 172.21.15.37:0/2546644056 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:17:56.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:56.902+0000 7f42d3e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f42d4101260 0x7f42d419ac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.37:49458/0 (socket says 172.21.15.37:49458) 2024-09-11T23:17:56.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:56.902+0000 7f42d9800640 1 --2- 172.21.15.37:0/2546644056 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42d410e460 0x7f42d419efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:56.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:56.902+0000 7f42d3e00640 1 -- 172.21.15.37:0/2546644056 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f42d41008b0 msgr2=0x7f42d419a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:56.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:56.902+0000 7f42d3e00640 1 --2- 172.21.15.37:0/2546644056 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f42d41008b0 0x7f42d419a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:56.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:56.902+0000 7f42d3e00640 1 -- 172.21.15.37:0/2546644056 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42d410e460 msgr2=0x7f42d419efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:56.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:56.902+0000 7f42d3e00640 1 --2- 172.21.15.37:0/2546644056 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42d410e460 0x7f42d419efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:56.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:56.902+0000 7f42d3e00640 1 -- 172.21.15.37:0/2546644056 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42d419f690 con 0x7f42d4101260 2024-09-11T23:17:56.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:56.903+0000 7f42d8e00640 1 --2- 172.21.15.37:0/2546644056 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f42d41008b0 0x7f42d419a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:17:56.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:56.903+0000 7f42d3e00640 1 --2- 172.21.15.37:0/2546644056 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f42d4101260 0x7f42d419ac20 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f42c002a860 tx=0x7f42c0033b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:56.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:56.903+0000 7f42d1600640 1 -- 172.21.15.37:0/2546644056 <== mon.2 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42c0037040 con 0x7f42d4101260 2024-09-11T23:17:56.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:56.903+0000 7f42db800640 1 -- 172.21.15.37:0/2546644056 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42d419f920 con 0x7f42d4101260 2024-09-11T23:17:56.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:56.903+0000 7f42d1600640 1 -- 172.21.15.37:0/2546644056 <== mon.2 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f42c0033d50 con 0x7f42d4101260 2024-09-11T23:17:56.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:56.903+0000 7f42d1600640 1 -- 172.21.15.37:0/2546644056 <== mon.2 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42c0003960 con 0x7f42d4101260 2024-09-11T23:17:56.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:56.903+0000 7f42db800640 1 -- 172.21.15.37:0/2546644056 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42d41a7260 con 0x7f42d4101260 2024-09-11T23:17:56.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:56.904+0000 7f42db800640 1 -- 172.21.15.37:0/2546644056 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42d4100c90 con 0x7f42d4101260 2024-09-11T23:17:56.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:56.906+0000 7f42d1600640 1 -- 172.21.15.37:0/2546644056 <== mon.2 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f42c0042020 con 0x7f42d4101260 2024-09-11T23:17:56.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:56.908+0000 7f42d1600640 1 --2- 172.21.15.37:0/2546644056 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f42bc0a2c90 0x7f42bc0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:56.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:56.908+0000 7f42d1600640 1 -- 172.21.15.37:0/2546644056 <== mon.2 v2:172.21.15.123:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9295+0+0 (secure 0 0 0) 0x7f42c00eea30 con 0x7f42d4101260 2024-09-11T23:17:56.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:56.909+0000 7f42d8e00640 1 --2- 172.21.15.37:0/2546644056 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f42bc0a2c90 0x7f42bc0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:56.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:56.909+0000 7f42d8e00640 1 --2- 172.21.15.37:0/2546644056 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f42bc0a2c90 0x7f42bc0a5150 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f42c80096c0 tx=0x7f42c8009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:56.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:56.911+0000 7f42d1600640 1 -- 172.21.15.37:0/2546644056 <== mon.2 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f42c0049020 con 0x7f42d4101260 2024-09-11T23:17:57.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:56 smithi037 ceph-mon[30630]: Health check failed: Degraded data redundancy: 1/308 objects degraded (0.325%), 1 pg degraded (PG_DEGRADED) 2024-09-11T23:17:57.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.011+0000 7f98ff200640 1 -- 172.21.15.37:0/608860503 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f98f8112a50 msgr2=0x7f98f8114e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:57.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.011+0000 7f98ff200640 1 --2- 172.21.15.37:0/608860503 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f98f8112a50 0x7f98f8114e40 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f98f0009be0 tx=0x7f98f002a6c0 comp rx=0 tx=0).stop 2024-09-11T23:17:57.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.011+0000 7f98ff200640 1 -- 172.21.15.37:0/608860503 shutdown_connections 2024-09-11T23:17:57.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.011+0000 7f98ff200640 1 --2- 172.21.15.37:0/608860503 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f98f8112a50 0x7f98f8114e40 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:57.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.011+0000 7f98ff200640 1 --2- 172.21.15.37:0/608860503 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98f8077040 0x7f98f8112510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:57.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.011+0000 7f98ff200640 1 --2- 172.21.15.37:0/608860503 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f98f8076720 0x7f98f8076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:57.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.011+0000 7f98ff200640 1 -- 172.21.15.37:0/608860503 >> 172.21.15.37:0/608860503 conn(0x7f98f80ffa50 msgr2=0x7f98f8101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:57.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.011+0000 7f98ff200640 1 -- 172.21.15.37:0/608860503 shutdown_connections 2024-09-11T23:17:57.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.011+0000 7f98ff200640 1 -- 172.21.15.37:0/608860503 wait complete. 2024-09-11T23:17:57.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.012+0000 7f98ff200640 1 Processor -- start 2024-09-11T23:17:57.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.012+0000 7f98ff200640 1 -- start start 2024-09-11T23:17:57.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.012+0000 7f98ff200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f98f8076720 0x7f98f81a46b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:57.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.012+0000 7f98ff200640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f98f8077040 0x7f98f81a4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:57.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.012+0000 7f98ff200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98f8112a50 0x7f98f819e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:57.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.012+0000 7f98ff200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f98f81185a0 con 0x7f98f8112a50 2024-09-11T23:17:57.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.012+0000 7f98ff200640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f98f8118420 con 0x7f98f8076720 2024-09-11T23:17:57.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.012+0000 7f98ff200640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f98f8118720 con 0x7f98f8077040 2024-09-11T23:17:57.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.013+0000 7f98f7400640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f98f8077040 0x7f98f81a4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:57.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.013+0000 7f98f7400640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f98f8077040 0x7f98f81a4bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.37:49764/0 (socket says 172.21.15.37:49764) 2024-09-11T23:17:57.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.013+0000 7f98fd200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98f8112a50 0x7f98f819e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:57.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.013+0000 7f98f7400640 1 -- 172.21.15.37:0/4214802776 learned_addr learned my addr 172.21.15.37:0/4214802776 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:17:57.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.013+0000 7f98f7e00640 1 --2- 172.21.15.37:0/4214802776 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f98f8076720 0x7f98f81a46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:57.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.013+0000 7f98f7400640 1 -- 172.21.15.37:0/4214802776 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f98f8076720 msgr2=0x7f98f81a46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:57.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.013+0000 7f98f7400640 1 --2- 172.21.15.37:0/4214802776 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f98f8076720 0x7f98f81a46b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:57.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.013+0000 7f98f7400640 1 -- 172.21.15.37:0/4214802776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98f8112a50 msgr2=0x7f98f819e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:57.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.013+0000 7f98f7400640 1 --2- 172.21.15.37:0/4214802776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98f8112a50 0x7f98f819e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:57.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.013+0000 7f98f7400640 1 -- 172.21.15.37:0/4214802776 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98f819efa0 con 0x7f98f8077040 2024-09-11T23:17:57.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.013+0000 7f98fd200640 1 --2- 172.21.15.37:0/4214802776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98f8112a50 0x7f98f819e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:17:57.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.013+0000 7f98f7400640 1 --2- 172.21.15.37:0/4214802776 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f98f8077040 0x7f98f81a4bf0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f98e400e9c0 tx=0x7f98e400ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:57.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.014+0000 7f98f4c00640 1 -- 172.21.15.37:0/4214802776 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98e400cde0 con 0x7f98f8077040 2024-09-11T23:17:57.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.014+0000 7f98f4c00640 1 -- 172.21.15.37:0/4214802776 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f98e40035f0 con 0x7f98f8077040 2024-09-11T23:17:57.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.014+0000 7f98ff200640 1 -- 172.21.15.37:0/4214802776 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98f819f290 con 0x7f98f8077040 2024-09-11T23:17:57.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.014+0000 7f98f4c00640 1 -- 172.21.15.37:0/4214802776 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98e4010690 con 0x7f98f8077040 2024-09-11T23:17:57.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.014+0000 7f98ff200640 1 -- 172.21.15.37:0/4214802776 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98f81ab580 con 0x7f98f8077040 2024-09-11T23:17:57.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.015+0000 7f98ff200640 1 -- 172.21.15.37:0/4214802776 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98f8076b00 con 0x7f98f8077040 2024-09-11T23:17:57.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.018+0000 7f98f4c00640 1 -- 172.21.15.37:0/4214802776 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f98e40037a0 con 0x7f98f8077040 2024-09-11T23:17:57.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.019+0000 7f98f4c00640 1 --2- 172.21.15.37:0/4214802776 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f98dc0a2c90 0x7f98dc0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:57.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.019+0000 7f98f4c00640 1 -- 172.21.15.37:0/4214802776 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9295+0+0 (secure 0 0 0) 0x7f98e40cf890 con 0x7f98f8077040 2024-09-11T23:17:57.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.019+0000 7f98f7e00640 1 --2- 172.21.15.37:0/4214802776 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f98dc0a2c90 0x7f98dc0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:57.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.020+0000 7f98f7e00640 1 --2- 172.21.15.37:0/4214802776 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f98dc0a2c90 0x7f98dc0a5150 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f98f819f9b0 tx=0x7f98e8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:57.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.023+0000 7f98f4c00640 1 -- 172.21.15.37:0/4214802776 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f98e409c210 con 0x7f98f8077040 2024-09-11T23:17:57.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.104+0000 7f42db800640 1 -- 172.21.15.37:0/2546644056 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f42d4109650 con 0x7f42d4101260 2024-09-11T23:17:57.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.104+0000 7f42d1600640 1 -- 172.21.15.37:0/2546644056 <== mon.2 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f42c00bb4c0 con 0x7f42d4101260 2024-09-11T23:17:57.105 INFO:teuthology.orchestra.run.smithi037.stdout:296352743463 2024-09-11T23:17:57.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.107+0000 7f42db800640 1 -- 172.21.15.37:0/2546644056 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f42bc0a2c90 msgr2=0x7f42bc0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:57.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.107+0000 7f42db800640 1 --2- 172.21.15.37:0/2546644056 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f42bc0a2c90 0x7f42bc0a5150 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f42c80096c0 tx=0x7f42c8009260 comp rx=0 tx=0).stop 2024-09-11T23:17:57.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.107+0000 7f42db800640 1 -- 172.21.15.37:0/2546644056 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f42d4101260 msgr2=0x7f42d419ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:57.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.107+0000 7f42db800640 1 --2- 172.21.15.37:0/2546644056 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f42d4101260 0x7f42d419ac20 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f42c002a860 tx=0x7f42c0033b60 comp rx=0 tx=0).stop 2024-09-11T23:17:57.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.107+0000 7f42db800640 1 -- 172.21.15.37:0/2546644056 shutdown_connections 2024-09-11T23:17:57.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.107+0000 7f42db800640 1 --2- 172.21.15.37:0/2546644056 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f42bc0a2c90 0x7f42bc0a5150 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:57.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.107+0000 7f42db800640 1 --2- 172.21.15.37:0/2546644056 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f42d4101260 0x7f42d419ac20 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:57.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.107+0000 7f42db800640 1 --2- 172.21.15.37:0/2546644056 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42d410e460 0x7f42d419efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:57.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.107+0000 7f42db800640 1 --2- 172.21.15.37:0/2546644056 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f42d41008b0 0x7f42d419a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:57.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.107+0000 7f42db800640 1 -- 172.21.15.37:0/2546644056 >> 172.21.15.37:0/2546644056 conn(0x7f42d40fc780 msgr2=0x7f42d40feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:57.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.107+0000 7f42db800640 1 -- 172.21.15.37:0/2546644056 shutdown_connections 2024-09-11T23:17:57.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.107+0000 7f42db800640 1 -- 172.21.15.37:0/2546644056 wait complete. 2024-09-11T23:17:57.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.215+0000 7f98ff200640 1 -- 172.21.15.37:0/4214802776 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f98f81ab900 con 0x7f98f8077040 2024-09-11T23:17:57.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.216+0000 7f98f4c00640 1 -- 172.21.15.37:0/4214802776 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f98e409bb10 con 0x7f98f8077040 2024-09-11T23:17:57.217 INFO:teuthology.orchestra.run.smithi037.stdout:210453397559 2024-09-11T23:17:57.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.218+0000 7f98ff200640 1 -- 172.21.15.37:0/4214802776 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f98dc0a2c90 msgr2=0x7f98dc0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:57.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.218+0000 7f98ff200640 1 --2- 172.21.15.37:0/4214802776 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f98dc0a2c90 0x7f98dc0a5150 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f98f819f9b0 tx=0x7f98e8005f90 comp rx=0 tx=0).stop 2024-09-11T23:17:57.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.218+0000 7f98ff200640 1 -- 172.21.15.37:0/4214802776 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f98f8077040 msgr2=0x7f98f81a4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:57.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.218+0000 7f98ff200640 1 --2- 172.21.15.37:0/4214802776 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f98f8077040 0x7f98f81a4bf0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f98e400e9c0 tx=0x7f98e400ee80 comp rx=0 tx=0).stop 2024-09-11T23:17:57.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.218+0000 7f98ff200640 1 -- 172.21.15.37:0/4214802776 shutdown_connections 2024-09-11T23:17:57.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.218+0000 7f98ff200640 1 --2- 172.21.15.37:0/4214802776 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f98dc0a2c90 0x7f98dc0a5150 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:57.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.218+0000 7f98ff200640 1 --2- 172.21.15.37:0/4214802776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98f8112a50 0x7f98f819e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:57.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.218+0000 7f98ff200640 1 --2- 172.21.15.37:0/4214802776 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f98f8077040 0x7f98f81a4bf0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:57.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.218+0000 7f98ff200640 1 --2- 172.21.15.37:0/4214802776 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f98f8076720 0x7f98f81a46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:57.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.218+0000 7f98ff200640 1 -- 172.21.15.37:0/4214802776 >> 172.21.15.37:0/4214802776 conn(0x7f98f80ffa50 msgr2=0x7f98f8101e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:57.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.219+0000 7f98ff200640 1 -- 172.21.15.37:0/4214802776 shutdown_connections 2024-09-11T23:17:57.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.219+0000 7f98ff200640 1 -- 172.21.15.37:0/4214802776 wait complete. 2024-09-11T23:17:57.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:56 smithi123 ceph-mon[35438]: Health check failed: Degraded data redundancy: 1/308 objects degraded (0.325%), 1 pg degraded (PG_DEGRADED) 2024-09-11T23:17:57.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:56 smithi160 ceph-mon[35055]: Health check failed: Degraded data redundancy: 1/308 objects degraded (0.325%), 1 pg degraded (PG_DEGRADED) 2024-09-11T23:17:58.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:57 smithi123 ceph-mon[35438]: pgmap v357: 129 pgs: 1 activating+degraded, 1 activating, 2 peering, 125 active+clean; 646 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 11 op/s; 1/308 objects degraded (0.325%); 97 B/s, 1 objects/s recovering 2024-09-11T23:17:58.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:57 smithi123 ceph-mon[35438]: from='client.? 172.21.15.37:0/2546644056' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-11T23:17:58.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:57 smithi123 ceph-mon[35438]: from='client.? 172.21.15.37:0/4214802776' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-11T23:17:58.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:57 smithi037 ceph-mon[30630]: pgmap v357: 129 pgs: 1 activating+degraded, 1 activating, 2 peering, 125 active+clean; 646 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 11 op/s; 1/308 objects degraded (0.325%); 97 B/s, 1 objects/s recovering 2024-09-11T23:17:58.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:57 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/2546644056' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-11T23:17:58.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:57 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/4214802776' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-11T23:17:58.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.748+0000 7fbdfac00640 1 -- 172.21.15.37:0/3475054117 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbdf41047e0 msgr2=0x7fbdf4108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:58.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.748+0000 7fbdfac00640 1 --2- 172.21.15.37:0/3475054117 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbdf41047e0 0x7fbdf4108830 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbde0009900 tx=0x7fbde002a400 comp rx=0 tx=0).stop 2024-09-11T23:17:58.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.748+0000 7fbdfac00640 1 -- 172.21.15.37:0/3475054117 shutdown_connections 2024-09-11T23:17:58.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.748+0000 7fbdfac00640 1 --2- 172.21.15.37:0/3475054117 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbdf41047e0 0x7fbdf4108830 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:58.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.748+0000 7fbdfac00640 1 --2- 172.21.15.37:0/3475054117 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbdf4108f60 0x7fbdf4110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:58.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.748+0000 7fbdfac00640 1 --2- 172.21.15.37:0/3475054117 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbdf4103e30 0x7fbdf4104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:58.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.748+0000 7fbdfac00640 1 -- 172.21.15.37:0/3475054117 >> 172.21.15.37:0/3475054117 conn(0x7fbdf40ff8d0 msgr2=0x7fbdf4101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:58.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.748+0000 7fbdfac00640 1 -- 172.21.15.37:0/3475054117 shutdown_connections 2024-09-11T23:17:58.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.748+0000 7fbdfac00640 1 -- 172.21.15.37:0/3475054117 wait complete. 2024-09-11T23:17:58.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.749+0000 7fbdfac00640 1 Processor -- start 2024-09-11T23:17:58.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.749+0000 7fbdfac00640 1 -- start start 2024-09-11T23:17:58.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.750+0000 7fbdfac00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbdf4103e30 0x7fbdf419a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:58.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.750+0000 7fbdfac00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbdf41047e0 0x7fbdf419a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:58.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.750+0000 7fbdfac00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbdf4108f60 0x7fbdf419ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:58.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.750+0000 7fbdfac00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbdf4114010 con 0x7fbdf41047e0 2024-09-11T23:17:58.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.750+0000 7fbdfac00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fbdf4113e90 con 0x7fbdf4108f60 2024-09-11T23:17:58.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.750+0000 7fbdfac00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fbdf4114190 con 0x7fbdf4103e30 2024-09-11T23:17:58.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.750+0000 7fbdf8e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbdf41047e0 0x7fbdf419a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:58.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.750+0000 7fbdf9800640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbdf4103e30 0x7fbdf419a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:58.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.750+0000 7fbdf8e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbdf41047e0 0x7fbdf419a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37982/0 (socket says 172.21.15.37:37982) 2024-09-11T23:17:58.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.750+0000 7fbdf8e00640 1 -- 172.21.15.37:0/4104776410 learned_addr learned my addr 172.21.15.37:0/4104776410 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:17:58.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.750+0000 7fbdfa200640 1 --2- 172.21.15.37:0/4104776410 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbdf4108f60 0x7fbdf419ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:58.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.751+0000 7fbdf9800640 1 -- 172.21.15.37:0/4104776410 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbdf4108f60 msgr2=0x7fbdf419ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:58.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.751+0000 7fbdf9800640 1 --2- 172.21.15.37:0/4104776410 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbdf4108f60 0x7fbdf419ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:58.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.751+0000 7fbdf9800640 1 -- 172.21.15.37:0/4104776410 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbdf41047e0 msgr2=0x7fbdf419a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:58.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.751+0000 7fbdf9800640 1 --2- 172.21.15.37:0/4104776410 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbdf41047e0 0x7fbdf419a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:58.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.751+0000 7fbdf9800640 1 -- 172.21.15.37:0/4104776410 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdf419f430 con 0x7fbdf4103e30 2024-09-11T23:17:58.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.751+0000 7fbdf9800640 1 --2- 172.21.15.37:0/4104776410 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbdf4103e30 0x7fbdf419a480 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fbde800e9f0 tx=0x7fbde800edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:58.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.751+0000 7fbdf2000640 1 -- 172.21.15.37:0/4104776410 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbde800ccc0 con 0x7fbdf4103e30 2024-09-11T23:17:58.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.751+0000 7fbdfac00640 1 -- 172.21.15.37:0/4104776410 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdf419f720 con 0x7fbdf4103e30 2024-09-11T23:17:58.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.751+0000 7fbdf2000640 1 -- 172.21.15.37:0/4104776410 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbde80035f0 con 0x7fbdf4103e30 2024-09-11T23:17:58.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.751+0000 7fbdf2000640 1 -- 172.21.15.37:0/4104776410 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbde800ce60 con 0x7fbdf4103e30 2024-09-11T23:17:58.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.751+0000 7fbdfac00640 1 -- 172.21.15.37:0/4104776410 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdf41a7000 con 0x7fbdf4103e30 2024-09-11T23:17:58.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.752+0000 7fbdfac00640 1 -- 172.21.15.37:0/4104776410 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbdf4104210 con 0x7fbdf4103e30 2024-09-11T23:17:58.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.755+0000 7fbdf2000640 1 -- 172.21.15.37:0/4104776410 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fbde80037a0 con 0x7fbdf4103e30 2024-09-11T23:17:58.395 INFO:teuthology.orchestra.run.smithi037.stdout:34359738461 2024-09-11T23:17:58.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.756+0000 7fbdf2000640 1 --2- 172.21.15.37:0/4104776410 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fbddc0a2c10 0x7fbddc0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:58.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.756+0000 7fbdf2000640 1 -- 172.21.15.37:0/4104776410 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9295+0+0 (secure 0 0 0) 0x7fbde80cf970 con 0x7fbdf4103e30 2024-09-11T23:17:58.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.756+0000 7fbdf8e00640 1 --2- 172.21.15.37:0/4104776410 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fbddc0a2c10 0x7fbddc0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:58.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.757+0000 7fbdf8e00640 1 --2- 172.21.15.37:0/4104776410 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fbddc0a2c10 0x7fbddc0a50d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fbde00096c0 tx=0x7fbde00046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:58.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.758+0000 7fbdf2000640 1 -- 172.21.15.37:0/4104776410 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbde809c380 con 0x7fbdf4103e30 2024-09-11T23:17:58.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.951+0000 7fbdfac00640 1 -- 172.21.15.37:0/4104776410 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fbdf410c200 con 0x7fbdf4103e30 2024-09-11T23:17:58.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.952+0000 7fbdf2000640 1 -- 172.21.15.37:0/4104776410 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fbde809bc80 con 0x7fbdf4103e30 2024-09-11T23:17:58.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.954+0000 7fbdfac00640 1 -- 172.21.15.37:0/4104776410 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fbddc0a2c10 msgr2=0x7fbddc0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:58.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.954+0000 7fbdfac00640 1 --2- 172.21.15.37:0/4104776410 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fbddc0a2c10 0x7fbddc0a50d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fbde00096c0 tx=0x7fbde00046c0 comp rx=0 tx=0).stop 2024-09-11T23:17:58.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.954+0000 7fbdfac00640 1 -- 172.21.15.37:0/4104776410 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbdf4103e30 msgr2=0x7fbdf419a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:58.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.954+0000 7fbdfac00640 1 --2- 172.21.15.37:0/4104776410 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbdf4103e30 0x7fbdf419a480 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fbde800e9f0 tx=0x7fbde800edf0 comp rx=0 tx=0).stop 2024-09-11T23:17:58.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.954+0000 7fbdfac00640 1 -- 172.21.15.37:0/4104776410 shutdown_connections 2024-09-11T23:17:58.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.954+0000 7fbdfac00640 1 --2- 172.21.15.37:0/4104776410 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fbddc0a2c10 0x7fbddc0a50d0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:58.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.954+0000 7fbdfac00640 1 --2- 172.21.15.37:0/4104776410 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbdf4108f60 0x7fbdf419ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:58.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.954+0000 7fbdfac00640 1 --2- 172.21.15.37:0/4104776410 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbdf41047e0 0x7fbdf419a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:58.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.954+0000 7fbdfac00640 1 --2- 172.21.15.37:0/4104776410 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbdf4103e30 0x7fbdf419a480 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:58.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.954+0000 7fbdfac00640 1 -- 172.21.15.37:0/4104776410 >> 172.21.15.37:0/4104776410 conn(0x7fbdf40ff8d0 msgr2=0x7fbdf4100c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:58.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.955+0000 7fbdfac00640 1 -- 172.21.15.37:0/4104776410 shutdown_connections 2024-09-11T23:17:58.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:57.955+0000 7fbdfac00640 1 -- 172.21.15.37:0/4104776410 wait complete. 2024-09-11T23:17:58.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:57 smithi160 ceph-mon[35055]: pgmap v357: 129 pgs: 1 activating+degraded, 1 activating, 2 peering, 125 active+clean; 646 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 11 op/s; 1/308 objects degraded (0.325%); 97 B/s, 1 objects/s recovering 2024-09-11T23:17:58.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:57 smithi160 ceph-mon[35055]: from='client.? 172.21.15.37:0/2546644056' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-11T23:17:58.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:57 smithi160 ceph-mon[35055]: from='client.? 172.21.15.37:0/4214802776' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-11T23:17:59.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:58 smithi123 ceph-mon[35438]: from='client.? 172.21.15.37:0/4104776410' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-11T23:17:59.312 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:58 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/4104776410' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-11T23:17:59.353 INFO:tasks.cephadm.ceph_manager.ceph:need seq 274877906985 got 274877906988 for osd.9 2024-09-11T23:17:59.353 DEBUG:teuthology.parallel:result is None 2024-09-11T23:17:59.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:58 smithi160 ceph-mon[35055]: from='client.? 172.21.15.37:0/4104776410' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-11T23:17:59.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:59.542+0000 7f193b800640 1 -- 172.21.15.37:0/1967518758 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f193410e3c0 msgr2=0x7f1934110810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:59.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:59.542+0000 7f193b800640 1 --2- 172.21.15.37:0/1967518758 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f193410e3c0 0x7f1934110810 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f192c009be0 tx=0x7f192c02a750 comp rx=0 tx=0).stop 2024-09-11T23:17:59.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:59.542+0000 7f193b800640 1 -- 172.21.15.37:0/1967518758 shutdown_connections 2024-09-11T23:17:59.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:59.542+0000 7f193b800640 1 --2- 172.21.15.37:0/1967518758 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f193410e3c0 0x7f1934110810 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:59.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:59.542+0000 7f193b800640 1 --2- 172.21.15.37:0/1967518758 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1934074f40 0x7f193410de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:59.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:59.542+0000 7f193b800640 1 --2- 172.21.15.37:0/1967518758 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1934074620 0x7f1934074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:59.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:59.542+0000 7f193b800640 1 -- 172.21.15.37:0/1967518758 >> 172.21.15.37:0/1967518758 conn(0x7f19340fd8c0 msgr2=0x7f19340ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:59.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:59.542+0000 7f193b800640 1 -- 172.21.15.37:0/1967518758 shutdown_connections 2024-09-11T23:17:59.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:59.542+0000 7f193b800640 1 -- 172.21.15.37:0/1967518758 wait complete. 2024-09-11T23:17:59.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:59.543+0000 7f193b800640 1 Processor -- start 2024-09-11T23:17:59.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:59.544+0000 7f193b800640 1 -- start start 2024-09-11T23:17:59.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:59.544+0000 7f193b800640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1934074620 0x7f193410dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:59.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:59.544+0000 7f193b800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1934074f40 0x7f193410add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:59.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:59.544+0000 7f193b800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f193410e3c0 0x7f193410b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:59.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:59.544+0000 7f193b800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1934114160 con 0x7f1934074f40 2024-09-11T23:17:59.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:59.544+0000 7f193b800640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f1934113fe0 con 0x7f193410e3c0 2024-09-11T23:17:59.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:59.544+0000 7f193b800640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f19341142e0 con 0x7f1934074620 2024-09-11T23:17:59.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:59.544+0000 7f1939800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f193410e3c0 0x7f193410b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:59.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:59.544+0000 7f1933e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1934074f40 0x7f193410add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:59.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:59.544+0000 7f1938e00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1934074620 0x7f193410dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:59.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:59.544+0000 7f1939800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f193410e3c0 0x7f193410b310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.37:34216/0 (socket says 172.21.15.37:34216) 2024-09-11T23:17:59.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:59.544+0000 7f1939800640 1 -- 172.21.15.37:0/1712706252 learned_addr learned my addr 172.21.15.37:0/1712706252 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:17:59.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:59.545+0000 7f1939800640 1 -- 172.21.15.37:0/1712706252 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1934074620 msgr2=0x7f193410dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:59.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:59.545+0000 7f1939800640 1 --2- 172.21.15.37:0/1712706252 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1934074620 0x7f193410dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:59.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:59.545+0000 7f1939800640 1 -- 172.21.15.37:0/1712706252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1934074f40 msgr2=0x7f193410add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:59.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:59.545+0000 7f1939800640 1 --2- 172.21.15.37:0/1712706252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1934074f40 0x7f193410add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:59.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:59.545+0000 7f1939800640 1 -- 172.21.15.37:0/1712706252 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f193410bbd0 con 0x7f193410e3c0 2024-09-11T23:17:59.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:59.545+0000 7f1938e00640 1 --2- 172.21.15.37:0/1712706252 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1934074620 0x7f193410dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:17:59.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:59.545+0000 7f1933e00640 1 --2- 172.21.15.37:0/1712706252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1934074f40 0x7f193410add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:17:59.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:59.545+0000 7f1939800640 1 --2- 172.21.15.37:0/1712706252 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f193410e3c0 0x7f193410b310 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f192c009b30 tx=0x7f192c0305d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:59.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:59.545+0000 7f1931600640 1 -- 172.21.15.37:0/1712706252 <== mon.2 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f192c041020 con 0x7f193410e3c0 2024-09-11T23:17:59.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:59.545+0000 7f1931600640 1 -- 172.21.15.37:0/1712706252 <== mon.2 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f192c003e50 con 0x7f193410e3c0 2024-09-11T23:17:59.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:59.546+0000 7f193b800640 1 -- 172.21.15.37:0/1712706252 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19341aaf60 con 0x7f193410e3c0 2024-09-11T23:17:59.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:59.546+0000 7f1931600640 1 -- 172.21.15.37:0/1712706252 <== mon.2 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f192c036040 con 0x7f193410e3c0 2024-09-11T23:17:59.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:59.546+0000 7f193b800640 1 -- 172.21.15.37:0/1712706252 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19341ab460 con 0x7f193410e3c0 2024-09-11T23:17:59.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:59.547+0000 7f193b800640 1 -- 172.21.15.37:0/1712706252 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1934075cd0 con 0x7f193410e3c0 2024-09-11T23:17:59.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:59.549+0000 7f1931600640 1 -- 172.21.15.37:0/1712706252 <== mon.2 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f192c044020 con 0x7f193410e3c0 2024-09-11T23:17:59.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:59.551+0000 7f1931600640 1 --2- 172.21.15.37:0/1712706252 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f191c0a2c90 0x7f191c0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:59.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:59.551+0000 7f1931600640 1 -- 172.21.15.37:0/1712706252 <== mon.2 v2:172.21.15.123:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9295+0+0 (secure 0 0 0) 0x7f192c0f00b0 con 0x7f193410e3c0 2024-09-11T23:17:59.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:59.551+0000 7f1938e00640 1 --2- 172.21.15.37:0/1712706252 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f191c0a2c90 0x7f191c0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:59.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:59.552+0000 7f1938e00640 1 --2- 172.21.15.37:0/1712706252 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f191c0a2c90 0x7f191c0a5150 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1928009fc0 tx=0x7f1928005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:59.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:59.552+0000 7f1931600640 1 -- 172.21.15.37:0/1712706252 <== mon.2 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f192c04b030 con 0x7f193410e3c0 2024-09-11T23:17:59.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:59.742+0000 7f193b800640 1 -- 172.21.15.37:0/1712706252 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f193410c300 con 0x7f193410e3c0 2024-09-11T23:17:59.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:59.743+0000 7f1931600640 1 -- 172.21.15.37:0/1712706252 <== mon.2 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f192c0bca30 con 0x7f193410e3c0 2024-09-11T23:17:59.746 INFO:teuthology.orchestra.run.smithi037.stdout:240518168628 2024-09-11T23:17:59.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:59.745+0000 7f193b800640 1 -- 172.21.15.37:0/1712706252 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f191c0a2c90 msgr2=0x7f191c0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:59.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:59.745+0000 7f193b800640 1 --2- 172.21.15.37:0/1712706252 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f191c0a2c90 0x7f191c0a5150 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1928009fc0 tx=0x7f1928005f90 comp rx=0 tx=0).stop 2024-09-11T23:17:59.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:59.745+0000 7f193b800640 1 -- 172.21.15.37:0/1712706252 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f193410e3c0 msgr2=0x7f193410b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:59.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:59.745+0000 7f193b800640 1 --2- 172.21.15.37:0/1712706252 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f193410e3c0 0x7f193410b310 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f192c009b30 tx=0x7f192c0305d0 comp rx=0 tx=0).stop 2024-09-11T23:17:59.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:59.745+0000 7f193b800640 1 -- 172.21.15.37:0/1712706252 shutdown_connections 2024-09-11T23:17:59.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:59.746+0000 7f193b800640 1 --2- 172.21.15.37:0/1712706252 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f191c0a2c90 0x7f191c0a5150 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:59.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:59.746+0000 7f193b800640 1 --2- 172.21.15.37:0/1712706252 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f193410e3c0 0x7f193410b310 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:59.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:59.746+0000 7f193b800640 1 --2- 172.21.15.37:0/1712706252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1934074f40 0x7f193410add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:59.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:59.746+0000 7f193b800640 1 --2- 172.21.15.37:0/1712706252 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1934074620 0x7f193410dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:59.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:59.746+0000 7f193b800640 1 -- 172.21.15.37:0/1712706252 >> 172.21.15.37:0/1712706252 conn(0x7f19340fd8c0 msgr2=0x7f19340fe560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:59.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:59.746+0000 7f193b800640 1 -- 172.21.15.37:0/1712706252 shutdown_connections 2024-09-11T23:17:59.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:17:59.746+0000 7f193b800640 1 -- 172.21.15.37:0/1712706252 wait complete. 2024-09-11T23:17:59.791 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738456 got 34359738461 for osd.0 2024-09-11T23:17:59.791 DEBUG:teuthology.parallel:result is None 2024-09-11T23:18:00.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:59 smithi037 ceph-mon[30630]: pgmap v358: 129 pgs: 1 activating+degraded, 1 activating, 127 active+clean; 646 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s; 1/308 objects degraded (0.325%); 100 B/s, 1 objects/s recovering 2024-09-11T23:18:00.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:59 smithi037 ceph-mon[30630]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-09-11T23:18:00.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:17:59 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/1712706252' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-11T23:18:00.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:59 smithi123 ceph-mon[35438]: pgmap v358: 129 pgs: 1 activating+degraded, 1 activating, 127 active+clean; 646 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s; 1/308 objects degraded (0.325%); 100 B/s, 1 objects/s recovering 2024-09-11T23:18:00.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:59 smithi123 ceph-mon[35438]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-09-11T23:18:00.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:17:59 smithi123 ceph-mon[35438]: from='client.? 172.21.15.37:0/1712706252' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-11T23:18:00.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:59 smithi160 ceph-mon[35055]: pgmap v358: 129 pgs: 1 activating+degraded, 1 activating, 127 active+clean; 646 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s; 1/308 objects degraded (0.325%); 100 B/s, 1 objects/s recovering 2024-09-11T23:18:00.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:59 smithi160 ceph-mon[35055]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-09-11T23:18:00.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:17:59 smithi160 ceph-mon[35055]: from='client.? 172.21.15.37:0/1712706252' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-11T23:18:00.590 INFO:tasks.cephadm.ceph_manager.ceph:need seq 296352743460 got 296352743463 for osd.10 2024-09-11T23:18:00.590 DEBUG:teuthology.parallel:result is None 2024-09-11T23:18:01.226 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:18:01 smithi037 ceph-mon[30630]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1/308 objects degraded (0.325%), 1 pg degraded) 2024-09-11T23:18:01.227 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:18:01 smithi037 ceph-mon[30630]: Cluster is now healthy 2024-09-11T23:18:01.266 INFO:tasks.cephadm.ceph_manager.ceph:need seq 158913790014 got 158913790017 for osd.5 2024-09-11T23:18:01.267 DEBUG:teuthology.parallel:result is None 2024-09-11T23:18:01.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:18:01 smithi160 ceph-mon[35055]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1/308 objects degraded (0.325%), 1 pg degraded) 2024-09-11T23:18:01.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:18:01 smithi160 ceph-mon[35055]: Cluster is now healthy 2024-09-11T23:18:01.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:18:01 smithi123 ceph-mon[35438]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1/308 objects degraded (0.325%), 1 pg degraded) 2024-09-11T23:18:01.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:18:01 smithi123 ceph-mon[35438]: Cluster is now healthy 2024-09-11T23:18:01.736 INFO:tasks.cephadm.ceph_manager.ceph:need seq 240518168625 got 240518168628 for osd.8 2024-09-11T23:18:01.737 DEBUG:teuthology.parallel:result is None 2024-09-11T23:18:02.059 INFO:tasks.cephadm.ceph_manager.ceph:need seq 210453397556 got 210453397559 for osd.7 2024-09-11T23:18:02.059 DEBUG:teuthology.parallel:result is None 2024-09-11T23:18:02.059 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-11T23:18:02.060 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-11T23:18:02.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:18:02 smithi037 ceph-mon[30630]: pgmap v359: 129 pgs: 129 active+clean; 646 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 8 op/s; 115 B/s, 2 objects/s recovering 2024-09-11T23:18:02.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:18:02 smithi160 ceph-mon[35055]: pgmap v359: 129 pgs: 129 active+clean; 646 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 8 op/s; 115 B/s, 2 objects/s recovering 2024-09-11T23:18:02.439 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:18:02.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:18:02 smithi123 ceph-mon[35438]: pgmap v359: 129 pgs: 129 active+clean; 646 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 8 op/s; 115 B/s, 2 objects/s recovering 2024-09-11T23:18:03.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:03.017+0000 7f240f000640 1 -- 172.21.15.37:0/1788465749 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24081079c0 msgr2=0x7f2408107da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:03.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:03.017+0000 7f240f000640 1 --2- 172.21.15.37:0/1788465749 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24081079c0 0x7f2408107da0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f23fc009930 tx=0x7f23fc02a440 comp rx=0 tx=0).stop 2024-09-11T23:18:03.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:03.017+0000 7f240f000640 1 -- 172.21.15.37:0/1788465749 shutdown_connections 2024-09-11T23:18:03.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:03.017+0000 7f240f000640 1 --2- 172.21.15.37:0/1788465749 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f24081019c0 0x7f2408101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:03.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:03.017+0000 7f240f000640 1 --2- 172.21.15.37:0/1788465749 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2408102360 0x7f240810e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:03.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:03.017+0000 7f240f000640 1 --2- 172.21.15.37:0/1788465749 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24081079c0 0x7f2408107da0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:03.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:03.017+0000 7f240f000640 1 -- 172.21.15.37:0/1788465749 >> 172.21.15.37:0/1788465749 conn(0x7f24080fd740 msgr2=0x7f24080ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:03.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:03.018+0000 7f240f000640 1 -- 172.21.15.37:0/1788465749 shutdown_connections 2024-09-11T23:18:03.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:03.018+0000 7f240f000640 1 -- 172.21.15.37:0/1788465749 wait complete. 2024-09-11T23:18:03.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:03.018+0000 7f240f000640 1 Processor -- start 2024-09-11T23:18:03.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:03.019+0000 7f240f000640 1 -- start start 2024-09-11T23:18:03.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:03.019+0000 7f240f000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f24081019c0 0x7f240819a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:03.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:03.019+0000 7f240f000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2408102360 0x7f240819a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:03.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:03.019+0000 7f240f000640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f24081079c0 0x7f240819ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:03.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:03.019+0000 7f240f000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2408111e10 con 0x7f2408102360 2024-09-11T23:18:03.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:03.019+0000 7f240f000640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f2408111c90 con 0x7f24081019c0 2024-09-11T23:18:03.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:03.019+0000 7f240f000640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f2408111f90 con 0x7f24081079c0 2024-09-11T23:18:03.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:03.019+0000 7f240dc00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f24081019c0 0x7f240819a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:03.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:03.019+0000 7f240dc00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f24081019c0 0x7f240819a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.37:34230/0 (socket says 172.21.15.37:34230) 2024-09-11T23:18:03.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:03.019+0000 7f240dc00640 1 -- 172.21.15.37:0/2520816367 learned_addr learned my addr 172.21.15.37:0/2520816367 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:18:03.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:03.019+0000 7f240d200640 1 --2- 172.21.15.37:0/2520816367 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2408102360 0x7f240819a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:03.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:03.020+0000 7f240e600640 1 --2- 172.21.15.37:0/2520816367 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f24081079c0 0x7f240819ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:03.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:03.020+0000 7f240dc00640 1 -- 172.21.15.37:0/2520816367 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f24081079c0 msgr2=0x7f240819ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:03.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:03.020+0000 7f240dc00640 1 --2- 172.21.15.37:0/2520816367 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f24081079c0 0x7f240819ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:03.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:03.020+0000 7f240dc00640 1 -- 172.21.15.37:0/2520816367 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2408102360 msgr2=0x7f240819a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:03.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:03.020+0000 7f240dc00640 1 --2- 172.21.15.37:0/2520816367 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2408102360 0x7f240819a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:03.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:03.020+0000 7f240dc00640 1 -- 172.21.15.37:0/2520816367 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f240819f3f0 con 0x7f24081019c0 2024-09-11T23:18:03.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:03.020+0000 7f240dc00640 1 --2- 172.21.15.37:0/2520816367 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f24081019c0 0x7f240819a440 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f23fc02a960 tx=0x7f23fc003b20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:03.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:03.020+0000 7f2406000640 1 -- 172.21.15.37:0/2520816367 <== mon.2 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23fc03f070 con 0x7f24081019c0 2024-09-11T23:18:03.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:03.020+0000 7f240f000640 1 -- 172.21.15.37:0/2520816367 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f240819f680 con 0x7f24081019c0 2024-09-11T23:18:03.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:03.020+0000 7f2406000640 1 -- 172.21.15.37:0/2520816367 <== mon.2 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f23fc031c90 con 0x7f24081019c0 2024-09-11T23:18:03.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:03.020+0000 7f2406000640 1 -- 172.21.15.37:0/2520816367 <== mon.2 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23fc035030 con 0x7f24081019c0 2024-09-11T23:18:03.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:03.021+0000 7f240f000640 1 -- 172.21.15.37:0/2520816367 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24081a6fc0 con 0x7f24081019c0 2024-09-11T23:18:03.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:03.022+0000 7f240f000640 1 -- 172.21.15.37:0/2520816367 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2408103100 con 0x7f24081019c0 2024-09-11T23:18:03.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:03.024+0000 7f2406000640 1 -- 172.21.15.37:0/2520816367 <== mon.2 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f23fc042070 con 0x7f24081019c0 2024-09-11T23:18:03.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:03.025+0000 7f2406000640 1 --2- 172.21.15.37:0/2520816367 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f23f00a2c90 0x7f23f00a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:03.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:03.025+0000 7f2406000640 1 -- 172.21.15.37:0/2520816367 <== mon.2 v2:172.21.15.123:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9295+0+0 (secure 0 0 0) 0x7f23fc0f0120 con 0x7f24081019c0 2024-09-11T23:18:03.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:03.025+0000 7f240d200640 1 --2- 172.21.15.37:0/2520816367 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f23f00a2c90 0x7f23f00a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:03.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:03.026+0000 7f240d200640 1 --2- 172.21.15.37:0/2520816367 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f23f00a2c90 0x7f23f00a5150 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f23f40095f0 tx=0x7f23f4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:03.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:03.027+0000 7f2406000640 1 -- 172.21.15.37:0/2520816367 <== mon.2 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f23fc0bc450 con 0x7f24081019c0 2024-09-11T23:18:03.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:03.209+0000 7f240f000640 1 -- 172.21.15.37:0/2520816367 --> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f24080feb30 con 0x7f23f00a2c90 2024-09-11T23:18:03.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:03.218+0000 7f2406000640 1 -- 172.21.15.37:0/2520816367 <== mgr.14150 v2:172.21.15.37:6800/31543269 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340443 (secure 0 0 0) 0x7f24080feb30 con 0x7f23f00a2c90 2024-09-11T23:18:03.225 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:18:03.228 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-11T23:18:03.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:03.222+0000 7f240f000640 1 -- 172.21.15.37:0/2520816367 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f23f00a2c90 msgr2=0x7f23f00a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:03.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:03.222+0000 7f240f000640 1 --2- 172.21.15.37:0/2520816367 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f23f00a2c90 0x7f23f00a5150 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f23f40095f0 tx=0x7f23f4005f90 comp rx=0 tx=0).stop 2024-09-11T23:18:03.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:03.222+0000 7f240f000640 1 -- 172.21.15.37:0/2520816367 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f24081019c0 msgr2=0x7f240819a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:03.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:03.222+0000 7f240f000640 1 --2- 172.21.15.37:0/2520816367 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f24081019c0 0x7f240819a440 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f23fc02a960 tx=0x7f23fc003b20 comp rx=0 tx=0).stop 2024-09-11T23:18:03.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:03.222+0000 7f240f000640 1 -- 172.21.15.37:0/2520816367 shutdown_connections 2024-09-11T23:18:03.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:03.222+0000 7f240f000640 1 --2- 172.21.15.37:0/2520816367 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f23f00a2c90 0x7f23f00a5150 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:03.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:03.222+0000 7f240f000640 1 --2- 172.21.15.37:0/2520816367 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f24081079c0 0x7f240819ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:03.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:03.222+0000 7f240f000640 1 --2- 172.21.15.37:0/2520816367 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2408102360 0x7f240819a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:03.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:03.222+0000 7f240f000640 1 --2- 172.21.15.37:0/2520816367 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f24081019c0 0x7f240819a440 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:03.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:03.222+0000 7f240f000640 1 -- 172.21.15.37:0/2520816367 >> 172.21.15.37:0/2520816367 conn(0x7f24080fd740 msgr2=0x7f240810d170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:03.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:03.222+0000 7f240f000640 1 -- 172.21.15.37:0/2520816367 shutdown_connections 2024-09-11T23:18:03.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:03.223+0000 7f240f000640 1 -- 172.21.15.37:0/2520816367 wait complete. 2024-09-11T23:18:04.015 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":360,"stamp":"2024-09-11T23:18:02.058607+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":661714,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":729,"num_read_kb":489,"num_write":429,"num_write_kb":3082,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":1181659,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":352,"ondisk_log_size":352,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":376844,"kb_used_data":15056,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124564980,"statfs":{"total":1151940427776,"available":1151554539520,"internally_reserved":0,"allocated":15417344,"data_stored":8549060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":370193721},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":44,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":923,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.179022"},"pg_stats":[{"pgid":"2.1f","version":"93'13","reported_seq":135,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.901690+0000","last_change":"2024-09-11T23:17:53.901109+0000","last_active":"2024-09-11T23:17:59.901690+0000","last_peered":"2024-09-11T23:17:59.901690+0000","last_clean":"2024-09-11T23:17:59.901690+0000","last_became_active":"2024-09-11T23:17:53.892737+0000","last_became_peered":"2024-09-11T23:17:53.892737+0000","last_unstale":"2024-09-11T23:17:59.901690+0000","last_undegraded":"2024-09-11T23:17:59.901690+0000","last_fullsized":"2024-09-11T23:17:59.901690+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:40:43.977951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":672,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,8],"acting":[9,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.884919+0000","last_change":"2024-09-11T23:16:15.493946+0000","last_active":"2024-09-11T23:17:53.884919+0000","last_peered":"2024-09-11T23:17:53.884919+0000","last_clean":"2024-09-11T23:17:53.884919+0000","last_became_active":"2024-09-11T23:16:15.493433+0000","last_became_peered":"2024-09-11T23:16:15.493433+0000","last_unstale":"2024-09-11T23:17:53.884919+0000","last_undegraded":"2024-09-11T23:17:53.884919+0000","last_fullsized":"2024-09-11T23:17:53.884919+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:47.700354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.885413+0000","last_change":"2024-09-11T23:16:23.550528+0000","last_active":"2024-09-11T23:17:53.885413+0000","last_peered":"2024-09-11T23:17:53.885413+0000","last_clean":"2024-09-11T23:17:53.885413+0000","last_became_active":"2024-09-11T23:16:23.550205+0000","last_became_peered":"2024-09-11T23:16:23.550205+0000","last_unstale":"2024-09-11T23:17:53.885413+0000","last_undegraded":"2024-09-11T23:17:53.885413+0000","last_fullsized":"2024-09-11T23:17:53.885413+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:28.318748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"93'2","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.885606+0000","last_change":"2024-09-11T23:16:12.633362+0000","last_active":"2024-09-11T23:17:53.885606+0000","last_peered":"2024-09-11T23:17:53.885606+0000","last_clean":"2024-09-11T23:17:53.885606+0000","last_became_active":"2024-09-11T23:16:12.632909+0000","last_became_peered":"2024-09-11T23:16:12.632909+0000","last_unstale":"2024-09-11T23:17:53.885606+0000","last_undegraded":"2024-09-11T23:17:53.885606+0000","last_fullsized":"2024-09-11T23:17:53.885606+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:08.533740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.888095+0000","last_change":"2024-09-11T23:16:15.499394+0000","last_active":"2024-09-11T23:17:53.888095+0000","last_peered":"2024-09-11T23:17:53.888095+0000","last_clean":"2024-09-11T23:17:53.888095+0000","last_became_active":"2024-09-11T23:16:15.499058+0000","last_became_peered":"2024-09-11T23:16:15.499058+0000","last_unstale":"2024-09-11T23:17:53.888095+0000","last_undegraded":"2024-09-11T23:17:53.888095+0000","last_fullsized":"2024-09-11T23:17:53.888095+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:05.361857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":26,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.890078+0000","last_change":"2024-09-11T23:16:23.543358+0000","last_active":"2024-09-11T23:17:53.890078+0000","last_peered":"2024-09-11T23:17:53.890078+0000","last_clean":"2024-09-11T23:17:53.890078+0000","last_became_active":"2024-09-11T23:16:23.542928+0000","last_became_peered":"2024-09-11T23:16:23.542928+0000","last_unstale":"2024-09-11T23:17:53.890078+0000","last_undegraded":"2024-09-11T23:17:53.890078+0000","last_fullsized":"2024-09-11T23:17:53.890078+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:36:36.570865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"93'12","reported_seq":56,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.884093+0000","last_change":"2024-09-11T23:16:12.461679+0000","last_active":"2024-09-11T23:17:53.884093+0000","last_peered":"2024-09-11T23:17:53.884093+0000","last_clean":"2024-09-11T23:17:53.884093+0000","last_became_active":"2024-09-11T23:16:12.461314+0000","last_became_peered":"2024-09-11T23:16:12.461314+0000","last_unstale":"2024-09-11T23:17:53.884093+0000","last_undegraded":"2024-09-11T23:17:53.884093+0000","last_fullsized":"2024-09-11T23:17:53.884093+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:01:13.352218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:54.296205+0000","last_change":"2024-09-11T23:16:15.488625+0000","last_active":"2024-09-11T23:17:54.296205+0000","last_peered":"2024-09-11T23:17:54.296205+0000","last_clean":"2024-09-11T23:17:54.296205+0000","last_became_active":"2024-09-11T23:16:15.487540+0000","last_became_peered":"2024-09-11T23:16:15.487540+0000","last_unstale":"2024-09-11T23:17:54.296205+0000","last_undegraded":"2024-09-11T23:17:54.296205+0000","last_fullsized":"2024-09-11T23:17:54.296205+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:54.962317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":26,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.890725+0000","last_change":"2024-09-11T23:16:23.544321+0000","last_active":"2024-09-11T23:17:53.890725+0000","last_peered":"2024-09-11T23:17:53.890725+0000","last_clean":"2024-09-11T23:17:53.890725+0000","last_became_active":"2024-09-11T23:16:23.543958+0000","last_became_peered":"2024-09-11T23:16:23.543958+0000","last_unstale":"2024-09-11T23:17:53.890725+0000","last_undegraded":"2024-09-11T23:17:53.890725+0000","last_fullsized":"2024-09-11T23:17:53.890725+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:40:46.510481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"93'5","reported_seq":49,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.883799+0000","last_change":"2024-09-11T23:16:12.462863+0000","last_active":"2024-09-11T23:17:53.883799+0000","last_peered":"2024-09-11T23:17:53.883799+0000","last_clean":"2024-09-11T23:17:53.883799+0000","last_became_active":"2024-09-11T23:16:12.462484+0000","last_became_peered":"2024-09-11T23:16:12.462484+0000","last_unstale":"2024-09-11T23:17:53.883799+0000","last_undegraded":"2024-09-11T23:17:53.883799+0000","last_fullsized":"2024-09-11T23:17:53.883799+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:13:22.170427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.886578+0000","last_change":"2024-09-11T23:16:15.487956+0000","last_active":"2024-09-11T23:17:53.886578+0000","last_peered":"2024-09-11T23:17:53.886578+0000","last_clean":"2024-09-11T23:17:53.886578+0000","last_became_active":"2024-09-11T23:16:15.487364+0000","last_became_peered":"2024-09-11T23:16:15.487364+0000","last_unstale":"2024-09-11T23:17:53.886578+0000","last_undegraded":"2024-09-11T23:17:53.886578+0000","last_fullsized":"2024-09-11T23:17:53.886578+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:47:10.488221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":26,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.890785+0000","last_change":"2024-09-11T23:16:23.541655+0000","last_active":"2024-09-11T23:17:53.890785+0000","last_peered":"2024-09-11T23:17:53.890785+0000","last_clean":"2024-09-11T23:17:53.890785+0000","last_became_active":"2024-09-11T23:16:23.541266+0000","last_became_peered":"2024-09-11T23:16:23.541266+0000","last_unstale":"2024-09-11T23:17:53.890785+0000","last_undegraded":"2024-09-11T23:17:53.890785+0000","last_fullsized":"2024-09-11T23:17:53.890785+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:09.497594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.883733+0000","last_change":"2024-09-11T23:16:15.489507+0000","last_active":"2024-09-11T23:17:53.883733+0000","last_peered":"2024-09-11T23:17:53.883733+0000","last_clean":"2024-09-11T23:17:53.883733+0000","last_became_active":"2024-09-11T23:16:15.489188+0000","last_became_peered":"2024-09-11T23:16:15.489188+0000","last_unstale":"2024-09-11T23:17:53.883733+0000","last_undegraded":"2024-09-11T23:17:53.883733+0000","last_fullsized":"2024-09-11T23:17:53.883733+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:07.530192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"93'4","reported_seq":48,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.883306+0000","last_change":"2024-09-11T23:16:12.465473+0000","last_active":"2024-09-11T23:17:53.883306+0000","last_peered":"2024-09-11T23:17:53.883306+0000","last_clean":"2024-09-11T23:17:53.883306+0000","last_became_active":"2024-09-11T23:16:12.465096+0000","last_became_peered":"2024-09-11T23:16:12.465096+0000","last_unstale":"2024-09-11T23:17:53.883306+0000","last_undegraded":"2024-09-11T23:17:53.883306+0000","last_fullsized":"2024-09-11T23:17:53.883306+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:27:22.739927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":26,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.890340+0000","last_change":"2024-09-11T23:16:23.555649+0000","last_active":"2024-09-11T23:17:53.890340+0000","last_peered":"2024-09-11T23:17:53.890340+0000","last_clean":"2024-09-11T23:17:53.890340+0000","last_became_active":"2024-09-11T23:16:23.555243+0000","last_became_peered":"2024-09-11T23:16:23.555243+0000","last_unstale":"2024-09-11T23:17:53.890340+0000","last_undegraded":"2024-09-11T23:17:53.890340+0000","last_fullsized":"2024-09-11T23:17:53.890340+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:07.514479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.885001+0000","last_change":"2024-09-11T23:16:15.490203+0000","last_active":"2024-09-11T23:17:53.885001+0000","last_peered":"2024-09-11T23:17:53.885001+0000","last_clean":"2024-09-11T23:17:53.885001+0000","last_became_active":"2024-09-11T23:16:15.489904+0000","last_became_peered":"2024-09-11T23:16:15.489904+0000","last_unstale":"2024-09-11T23:17:53.885001+0000","last_undegraded":"2024-09-11T23:17:53.885001+0000","last_fullsized":"2024-09-11T23:17:53.885001+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:20.291284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"93'3","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.885984+0000","last_change":"2024-09-11T23:16:12.465147+0000","last_active":"2024-09-11T23:17:53.885984+0000","last_peered":"2024-09-11T23:17:53.885984+0000","last_clean":"2024-09-11T23:17:53.885984+0000","last_became_active":"2024-09-11T23:16:12.464392+0000","last_became_peered":"2024-09-11T23:16:12.464392+0000","last_unstale":"2024-09-11T23:17:53.885984+0000","last_undegraded":"2024-09-11T23:17:53.885984+0000","last_fullsized":"2024-09-11T23:17:53.885984+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:21.515546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"93'1","reported_seq":27,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.890344+0000","last_change":"2024-09-11T23:16:23.535965+0000","last_active":"2024-09-11T23:17:53.890344+0000","last_peered":"2024-09-11T23:17:53.890344+0000","last_clean":"2024-09-11T23:17:53.890344+0000","last_became_active":"2024-09-11T23:16:23.535518+0000","last_became_peered":"2024-09-11T23:16:23.535518+0000","last_unstale":"2024-09-11T23:17:53.890344+0000","last_undegraded":"2024-09-11T23:17:53.890344+0000","last_fullsized":"2024-09-11T23:17:53.890344+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:37.406312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.886706+0000","last_change":"2024-09-11T23:16:15.489499+0000","last_active":"2024-09-11T23:17:53.886706+0000","last_peered":"2024-09-11T23:17:53.886706+0000","last_clean":"2024-09-11T23:17:53.886706+0000","last_became_active":"2024-09-11T23:16:15.489190+0000","last_became_peered":"2024-09-11T23:16:15.489190+0000","last_unstale":"2024-09-11T23:17:53.886706+0000","last_undegraded":"2024-09-11T23:17:53.886706+0000","last_fullsized":"2024-09-11T23:17:53.886706+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:01.845410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"93'7","reported_seq":49,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.885355+0000","last_change":"2024-09-11T23:16:12.461054+0000","last_active":"2024-09-11T23:17:53.885355+0000","last_peered":"2024-09-11T23:17:53.885355+0000","last_clean":"2024-09-11T23:17:53.885355+0000","last_became_active":"2024-09-11T23:16:12.460748+0000","last_became_peered":"2024-09-11T23:16:12.460748+0000","last_unstale":"2024-09-11T23:17:53.885355+0000","last_undegraded":"2024-09-11T23:17:53.885355+0000","last_fullsized":"2024-09-11T23:17:53.885355+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:35.710437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.887646+0000","last_change":"2024-09-11T23:16:23.543637+0000","last_active":"2024-09-11T23:17:53.887646+0000","last_peered":"2024-09-11T23:17:53.887646+0000","last_clean":"2024-09-11T23:17:53.887646+0000","last_became_active":"2024-09-11T23:16:23.542807+0000","last_became_peered":"2024-09-11T23:16:23.542807+0000","last_unstale":"2024-09-11T23:17:53.887646+0000","last_undegraded":"2024-09-11T23:17:53.887646+0000","last_fullsized":"2024-09-11T23:17:53.887646+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:08.559858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.883137+0000","last_change":"2024-09-11T23:16:15.485660+0000","last_active":"2024-09-11T23:17:53.883137+0000","last_peered":"2024-09-11T23:17:53.883137+0000","last_clean":"2024-09-11T23:17:53.883137+0000","last_became_active":"2024-09-11T23:16:15.485283+0000","last_became_peered":"2024-09-11T23:16:15.485283+0000","last_unstale":"2024-09-11T23:17:53.883137+0000","last_undegraded":"2024-09-11T23:17:53.883137+0000","last_fullsized":"2024-09-11T23:17:53.883137+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:20.105534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"93'2","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:54.296356+0000","last_change":"2024-09-11T23:16:12.633115+0000","last_active":"2024-09-11T23:17:54.296356+0000","last_peered":"2024-09-11T23:17:54.296356+0000","last_clean":"2024-09-11T23:17:54.296356+0000","last_became_active":"2024-09-11T23:16:12.632850+0000","last_became_peered":"2024-09-11T23:16:12.632850+0000","last_unstale":"2024-09-11T23:17:54.296356+0000","last_undegraded":"2024-09-11T23:17:54.296356+0000","last_fullsized":"2024-09-11T23:17:54.296356+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:16.709154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":26,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.890474+0000","last_change":"2024-09-11T23:16:23.556054+0000","last_active":"2024-09-11T23:17:53.890474+0000","last_peered":"2024-09-11T23:17:53.890474+0000","last_clean":"2024-09-11T23:17:53.890474+0000","last_became_active":"2024-09-11T23:16:23.555640+0000","last_became_peered":"2024-09-11T23:16:23.555640+0000","last_unstale":"2024-09-11T23:17:53.890474+0000","last_undegraded":"2024-09-11T23:17:53.890474+0000","last_fullsized":"2024-09-11T23:17:53.890474+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:23:32.360435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.887433+0000","last_change":"2024-09-11T23:16:53.677327+0000","last_active":"2024-09-11T23:17:53.887433+0000","last_peered":"2024-09-11T23:17:53.887433+0000","last_clean":"2024-09-11T23:17:53.887433+0000","last_became_active":"2024-09-11T23:16:53.677002+0000","last_became_peered":"2024-09-11T23:16:53.677002+0000","last_unstale":"2024-09-11T23:17:53.887433+0000","last_undegraded":"2024-09-11T23:17:53.887433+0000","last_fullsized":"2024-09-11T23:17:53.887433+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:22:48.495448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"93'7","reported_seq":49,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.891096+0000","last_change":"2024-09-11T23:16:13.161384+0000","last_active":"2024-09-11T23:17:53.891096+0000","last_peered":"2024-09-11T23:17:53.891096+0000","last_clean":"2024-09-11T23:17:53.891096+0000","last_became_active":"2024-09-11T23:16:13.161001+0000","last_became_peered":"2024-09-11T23:16:13.161001+0000","last_unstale":"2024-09-11T23:17:53.891096+0000","last_undegraded":"2024-09-11T23:17:53.891096+0000","last_fullsized":"2024-09-11T23:17:53.891096+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:17.421851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.885858+0000","last_change":"2024-09-11T23:16:23.539741+0000","last_active":"2024-09-11T23:17:53.885858+0000","last_peered":"2024-09-11T23:17:53.885858+0000","last_clean":"2024-09-11T23:17:53.885858+0000","last_became_active":"2024-09-11T23:16:23.539340+0000","last_became_peered":"2024-09-11T23:16:23.539340+0000","last_unstale":"2024-09-11T23:17:53.885858+0000","last_undegraded":"2024-09-11T23:17:53.885858+0000","last_fullsized":"2024-09-11T23:17:53.885858+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:22:41.272385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.885519+0000","last_change":"2024-09-11T23:16:15.483285+0000","last_active":"2024-09-11T23:17:53.885519+0000","last_peered":"2024-09-11T23:17:53.885519+0000","last_clean":"2024-09-11T23:17:53.885519+0000","last_became_active":"2024-09-11T23:16:15.482883+0000","last_became_peered":"2024-09-11T23:16:15.482883+0000","last_unstale":"2024-09-11T23:17:53.885519+0000","last_undegraded":"2024-09-11T23:17:53.885519+0000","last_fullsized":"2024-09-11T23:17:53.885519+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:49.979519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"93'14","reported_seq":57,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.889338+0000","last_change":"2024-09-11T23:16:12.460660+0000","last_active":"2024-09-11T23:17:53.889338+0000","last_peered":"2024-09-11T23:17:53.889338+0000","last_clean":"2024-09-11T23:17:53.889338+0000","last_became_active":"2024-09-11T23:16:12.460231+0000","last_became_peered":"2024-09-11T23:16:12.460231+0000","last_unstale":"2024-09-11T23:17:53.889338+0000","last_undegraded":"2024-09-11T23:17:53.889338+0000","last_fullsized":"2024-09-11T23:17:53.889338+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:21.839388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.884610+0000","last_change":"2024-09-11T23:16:23.556322+0000","last_active":"2024-09-11T23:17:53.884610+0000","last_peered":"2024-09-11T23:17:53.884610+0000","last_clean":"2024-09-11T23:17:53.884610+0000","last_became_active":"2024-09-11T23:16:23.555141+0000","last_became_peered":"2024-09-11T23:16:23.555141+0000","last_unstale":"2024-09-11T23:17:53.884610+0000","last_undegraded":"2024-09-11T23:17:53.884610+0000","last_fullsized":"2024-09-11T23:17:53.884610+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:55.778708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.890340+0000","last_change":"2024-09-11T23:16:15.490482+0000","last_active":"2024-09-11T23:17:53.890340+0000","last_peered":"2024-09-11T23:17:53.890340+0000","last_clean":"2024-09-11T23:17:53.890340+0000","last_became_active":"2024-09-11T23:16:15.490160+0000","last_became_peered":"2024-09-11T23:16:15.490160+0000","last_unstale":"2024-09-11T23:17:53.890340+0000","last_undegraded":"2024-09-11T23:17:53.890340+0000","last_fullsized":"2024-09-11T23:17:53.890340+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:58:40.588941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"93'4","reported_seq":48,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.884106+0000","last_change":"2024-09-11T23:16:12.634120+0000","last_active":"2024-09-11T23:17:53.884106+0000","last_peered":"2024-09-11T23:17:53.884106+0000","last_clean":"2024-09-11T23:17:53.884106+0000","last_became_active":"2024-09-11T23:16:12.633691+0000","last_became_peered":"2024-09-11T23:16:12.633691+0000","last_unstale":"2024-09-11T23:17:53.884106+0000","last_undegraded":"2024-09-11T23:17:53.884106+0000","last_fullsized":"2024-09-11T23:17:53.884106+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:21.577310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.888371+0000","last_change":"2024-09-11T23:16:23.545820+0000","last_active":"2024-09-11T23:17:53.888371+0000","last_peered":"2024-09-11T23:17:53.888371+0000","last_clean":"2024-09-11T23:17:53.888371+0000","last_became_active":"2024-09-11T23:16:23.545303+0000","last_became_peered":"2024-09-11T23:16:23.545303+0000","last_unstale":"2024-09-11T23:17:53.888371+0000","last_undegraded":"2024-09-11T23:17:53.888371+0000","last_fullsized":"2024-09-11T23:17:53.888371+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:52:28.969393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:54.296085+0000","last_change":"2024-09-11T23:16:15.497083+0000","last_active":"2024-09-11T23:17:54.296085+0000","last_peered":"2024-09-11T23:17:54.296085+0000","last_clean":"2024-09-11T23:17:54.296085+0000","last_became_active":"2024-09-11T23:16:15.496777+0000","last_became_peered":"2024-09-11T23:16:15.496777+0000","last_unstale":"2024-09-11T23:17:54.296085+0000","last_undegraded":"2024-09-11T23:17:54.296085+0000","last_fullsized":"2024-09-11T23:17:54.296085+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:14.456290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"93'1","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.888455+0000","last_change":"2024-09-11T23:16:12.633452+0000","last_active":"2024-09-11T23:17:53.888455+0000","last_peered":"2024-09-11T23:17:53.888455+0000","last_clean":"2024-09-11T23:17:53.888455+0000","last_became_active":"2024-09-11T23:16:12.633127+0000","last_became_peered":"2024-09-11T23:16:12.633127+0000","last_unstale":"2024-09-11T23:17:53.888455+0000","last_undegraded":"2024-09-11T23:17:53.888455+0000","last_fullsized":"2024-09-11T23:17:53.888455+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:37:07.269809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.883151+0000","last_change":"2024-09-11T23:16:23.555590+0000","last_active":"2024-09-11T23:17:53.883151+0000","last_peered":"2024-09-11T23:17:53.883151+0000","last_clean":"2024-09-11T23:17:53.883151+0000","last_became_active":"2024-09-11T23:16:23.555194+0000","last_became_peered":"2024-09-11T23:16:23.555194+0000","last_unstale":"2024-09-11T23:17:53.883151+0000","last_undegraded":"2024-09-11T23:17:53.883151+0000","last_fullsized":"2024-09-11T23:17:53.883151+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:36:50.069355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:54.295719+0000","last_change":"2024-09-11T23:16:15.498764+0000","last_active":"2024-09-11T23:17:54.295719+0000","last_peered":"2024-09-11T23:17:54.295719+0000","last_clean":"2024-09-11T23:17:54.295719+0000","last_became_active":"2024-09-11T23:16:15.498430+0000","last_became_peered":"2024-09-11T23:16:15.498430+0000","last_unstale":"2024-09-11T23:17:54.295719+0000","last_undegraded":"2024-09-11T23:17:54.295719+0000","last_fullsized":"2024-09-11T23:17:54.295719+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:28:44.899651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"93'6","reported_seq":106,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:57.899327+0000","last_change":"2024-09-11T23:16:12.456701+0000","last_active":"2024-09-11T23:17:57.899327+0000","last_peered":"2024-09-11T23:17:57.899327+0000","last_clean":"2024-09-11T23:17:57.899327+0000","last_became_active":"2024-09-11T23:16:12.456231+0000","last_became_peered":"2024-09-11T23:16:12.456231+0000","last_unstale":"2024-09-11T23:17:57.899327+0000","last_undegraded":"2024-09-11T23:17:57.899327+0000","last_fullsized":"2024-09-11T23:17:57.899327+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:02.372204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":58,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.890090+0000","last_change":"2024-09-11T23:16:23.550929+0000","last_active":"2024-09-11T23:17:53.890090+0000","last_peered":"2024-09-11T23:17:53.890090+0000","last_clean":"2024-09-11T23:17:53.890090+0000","last_became_active":"2024-09-11T23:16:23.550509+0000","last_became_peered":"2024-09-11T23:16:23.550509+0000","last_unstale":"2024-09-11T23:17:53.890090+0000","last_undegraded":"2024-09-11T23:17:53.890090+0000","last_fullsized":"2024-09-11T23:17:53.890090+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:53.112937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.886365+0000","last_change":"2024-09-11T23:16:53.765655+0000","last_active":"2024-09-11T23:17:53.886365+0000","last_peered":"2024-09-11T23:17:53.886365+0000","last_clean":"2024-09-11T23:17:53.886365+0000","last_became_active":"2024-09-11T23:16:53.765189+0000","last_became_peered":"2024-09-11T23:16:53.765189+0000","last_unstale":"2024-09-11T23:17:53.886365+0000","last_undegraded":"2024-09-11T23:17:53.886365+0000","last_fullsized":"2024-09-11T23:17:53.886365+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:13.142041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"93'5","reported_seq":106,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:57.823963+0000","last_change":"2024-09-11T23:16:12.633522+0000","last_active":"2024-09-11T23:17:57.823963+0000","last_peered":"2024-09-11T23:17:57.823963+0000","last_clean":"2024-09-11T23:17:57.823963+0000","last_became_active":"2024-09-11T23:16:12.633207+0000","last_became_peered":"2024-09-11T23:16:12.633207+0000","last_unstale":"2024-09-11T23:17:57.823963+0000","last_undegraded":"2024-09-11T23:17:57.823963+0000","last_fullsized":"2024-09-11T23:17:57.823963+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:08:29.565404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":57,"num_read_kb":57,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.890396+0000","last_change":"2024-09-11T23:16:23.557033+0000","last_active":"2024-09-11T23:17:53.890396+0000","last_peered":"2024-09-11T23:17:53.890396+0000","last_clean":"2024-09-11T23:17:53.890396+0000","last_became_active":"2024-09-11T23:16:23.555146+0000","last_became_peered":"2024-09-11T23:16:23.555146+0000","last_unstale":"2024-09-11T23:17:53.890396+0000","last_undegraded":"2024-09-11T23:17:53.890396+0000","last_fullsized":"2024-09-11T23:17:53.890396+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:22.460593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.889163+0000","last_change":"2024-09-11T23:16:15.487594+0000","last_active":"2024-09-11T23:17:53.889163+0000","last_peered":"2024-09-11T23:17:53.889163+0000","last_clean":"2024-09-11T23:17:53.889163+0000","last_became_active":"2024-09-11T23:16:15.487299+0000","last_became_peered":"2024-09-11T23:16:15.487299+0000","last_unstale":"2024-09-11T23:17:53.889163+0000","last_undegraded":"2024-09-11T23:17:53.889163+0000","last_fullsized":"2024-09-11T23:17:53.889163+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:32.531617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"93'4","reported_seq":46,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.883494+0000","last_change":"2024-09-11T23:16:12.464175+0000","last_active":"2024-09-11T23:17:53.883494+0000","last_peered":"2024-09-11T23:17:53.883494+0000","last_clean":"2024-09-11T23:17:53.883494+0000","last_became_active":"2024-09-11T23:16:12.463700+0000","last_became_peered":"2024-09-11T23:16:12.463700+0000","last_unstale":"2024-09-11T23:17:53.883494+0000","last_undegraded":"2024-09-11T23:17:53.883494+0000","last_fullsized":"2024-09-11T23:17:53.883494+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:35.784469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.887501+0000","last_change":"2024-09-11T23:16:23.555436+0000","last_active":"2024-09-11T23:17:53.887501+0000","last_peered":"2024-09-11T23:17:53.887501+0000","last_clean":"2024-09-11T23:17:53.887501+0000","last_became_active":"2024-09-11T23:16:23.555003+0000","last_became_peered":"2024-09-11T23:16:23.555003+0000","last_unstale":"2024-09-11T23:17:53.887501+0000","last_undegraded":"2024-09-11T23:17:53.887501+0000","last_fullsized":"2024-09-11T23:17:53.887501+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:39:18.810730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.888397+0000","last_change":"2024-09-11T23:16:53.674972+0000","last_active":"2024-09-11T23:17:53.888397+0000","last_peered":"2024-09-11T23:17:53.888397+0000","last_clean":"2024-09-11T23:17:53.888397+0000","last_became_active":"2024-09-11T23:16:53.674116+0000","last_became_peered":"2024-09-11T23:16:53.674116+0000","last_unstale":"2024-09-11T23:17:53.888397+0000","last_undegraded":"2024-09-11T23:17:53.888397+0000","last_fullsized":"2024-09-11T23:17:53.888397+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:03:32.615819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.3","version":"93'6","reported_seq":50,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.890864+0000","last_change":"2024-09-11T23:16:12.459491+0000","last_active":"2024-09-11T23:17:53.890864+0000","last_peered":"2024-09-11T23:17:53.890864+0000","last_clean":"2024-09-11T23:17:53.890864+0000","last_became_active":"2024-09-11T23:16:12.459106+0000","last_became_peered":"2024-09-11T23:16:12.459106+0000","last_unstale":"2024-09-11T23:17:53.890864+0000","last_undegraded":"2024-09-11T23:17:53.890864+0000","last_fullsized":"2024-09-11T23:17:53.890864+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:21.797304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":356,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.883626+0000","last_change":"2024-09-11T23:14:54.165458+0000","last_active":"2024-09-11T23:17:53.883626+0000","last_peered":"2024-09-11T23:17:53.883626+0000","last_clean":"2024-09-11T23:17:53.883626+0000","last_became_active":"2024-09-11T23:14:54.164935+0000","last_became_peered":"2024-09-11T23:14:54.164935+0000","last_unstale":"2024-09-11T23:17:53.883626+0000","last_undegraded":"2024-09-11T23:17:53.883626+0000","last_fullsized":"2024-09-11T23:17:53.883626+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:11:16.597789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:11:16.597789+0000","last_clean_scrub_stamp":"2024-09-11T23:11:16.597789+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:19.889271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"93'1","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:54.303154+0000","last_change":"2024-09-11T23:17:54.303154+0000","last_active":"2024-09-11T23:17:54.303154+0000","last_peered":"2024-09-11T23:17:54.303154+0000","last_clean":"2024-09-11T23:17:54.303154+0000","last_became_active":"2024-09-11T23:17:54.297651+0000","last_became_peered":"2024-09-11T23:17:54.297651+0000","last_unstale":"2024-09-11T23:17:54.303154+0000","last_undegraded":"2024-09-11T23:17:54.303154+0000","last_fullsized":"2024-09-11T23:17:54.303154+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:12:13.319358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,10],"acting":[7,5,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.884318+0000","last_change":"2024-09-11T23:16:15.483724+0000","last_active":"2024-09-11T23:17:53.884318+0000","last_peered":"2024-09-11T23:17:53.884318+0000","last_clean":"2024-09-11T23:17:53.884318+0000","last_became_active":"2024-09-11T23:16:15.483371+0000","last_became_peered":"2024-09-11T23:16:15.483371+0000","last_unstale":"2024-09-11T23:17:53.884318+0000","last_undegraded":"2024-09-11T23:17:53.884318+0000","last_fullsized":"2024-09-11T23:17:53.884318+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:27:43.844805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"93'6","reported_seq":107,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:57.842844+0000","last_change":"2024-09-11T23:16:13.161358+0000","last_active":"2024-09-11T23:17:57.842844+0000","last_peered":"2024-09-11T23:17:57.842844+0000","last_clean":"2024-09-11T23:17:57.842844+0000","last_became_active":"2024-09-11T23:16:13.160856+0000","last_became_peered":"2024-09-11T23:16:13.160856+0000","last_unstale":"2024-09-11T23:17:57.842844+0000","last_undegraded":"2024-09-11T23:17:57.842844+0000","last_fullsized":"2024-09-11T23:17:57.842844+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:23:35.519588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1563,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":59,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:54.296221+0000","last_change":"2024-09-11T23:16:23.542098+0000","last_active":"2024-09-11T23:17:54.296221+0000","last_peered":"2024-09-11T23:17:54.296221+0000","last_clean":"2024-09-11T23:17:54.296221+0000","last_became_active":"2024-09-11T23:16:23.541714+0000","last_became_peered":"2024-09-11T23:16:23.541714+0000","last_unstale":"2024-09-11T23:17:54.296221+0000","last_undegraded":"2024-09-11T23:17:54.296221+0000","last_fullsized":"2024-09-11T23:17:54.296221+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:25:53.715886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.884086+0000","last_change":"2024-09-11T23:16:53.675655+0000","last_active":"2024-09-11T23:17:53.884086+0000","last_peered":"2024-09-11T23:17:53.884086+0000","last_clean":"2024-09-11T23:17:53.884086+0000","last_became_active":"2024-09-11T23:16:53.675277+0000","last_became_peered":"2024-09-11T23:16:53.675277+0000","last_unstale":"2024-09-11T23:17:53.884086+0000","last_undegraded":"2024-09-11T23:17:53.884086+0000","last_fullsized":"2024-09-11T23:17:53.884086+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:12.869820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"93'3","reported_seq":48,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.887758+0000","last_change":"2024-09-11T23:16:12.461590+0000","last_active":"2024-09-11T23:17:53.887758+0000","last_peered":"2024-09-11T23:17:53.887758+0000","last_clean":"2024-09-11T23:17:53.887758+0000","last_became_active":"2024-09-11T23:16:12.461195+0000","last_became_peered":"2024-09-11T23:16:12.461195+0000","last_unstale":"2024-09-11T23:17:53.887758+0000","last_undegraded":"2024-09-11T23:17:53.887758+0000","last_fullsized":"2024-09-11T23:17:53.887758+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:09.929080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:54.298134+0000","last_change":"2024-09-11T23:17:54.298134+0000","last_active":"2024-09-11T23:17:54.298134+0000","last_peered":"2024-09-11T23:17:54.298134+0000","last_clean":"2024-09-11T23:17:54.298134+0000","last_became_active":"2024-09-11T23:17:54.297616+0000","last_became_peered":"2024-09-11T23:17:54.297616+0000","last_unstale":"2024-09-11T23:17:54.298134+0000","last_undegraded":"2024-09-11T23:17:54.298134+0000","last_fullsized":"2024-09-11T23:17:54.298134+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:45.382256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,1,4],"acting":[0,8,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.884281+0000","last_change":"2024-09-11T23:16:15.483337+0000","last_active":"2024-09-11T23:17:53.884281+0000","last_peered":"2024-09-11T23:17:53.884281+0000","last_clean":"2024-09-11T23:17:53.884281+0000","last_became_active":"2024-09-11T23:16:15.482892+0000","last_became_peered":"2024-09-11T23:16:15.482892+0000","last_unstale":"2024-09-11T23:17:53.884281+0000","last_undegraded":"2024-09-11T23:17:53.884281+0000","last_fullsized":"2024-09-11T23:17:53.884281+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:55.584889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"93'5","reported_seq":49,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.890195+0000","last_change":"2024-09-11T23:16:12.462527+0000","last_active":"2024-09-11T23:17:53.890195+0000","last_peered":"2024-09-11T23:17:53.890195+0000","last_clean":"2024-09-11T23:17:53.890195+0000","last_became_active":"2024-09-11T23:16:12.462133+0000","last_became_peered":"2024-09-11T23:16:12.462133+0000","last_unstale":"2024-09-11T23:17:53.890195+0000","last_undegraded":"2024-09-11T23:17:53.890195+0000","last_fullsized":"2024-09-11T23:17:53.890195+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:43.745587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.886088+0000","last_change":"2024-09-11T23:16:23.539430+0000","last_active":"2024-09-11T23:17:53.886088+0000","last_peered":"2024-09-11T23:17:53.886088+0000","last_clean":"2024-09-11T23:17:53.886088+0000","last_became_active":"2024-09-11T23:16:23.538995+0000","last_became_peered":"2024-09-11T23:16:23.538995+0000","last_unstale":"2024-09-11T23:17:53.886088+0000","last_undegraded":"2024-09-11T23:17:53.886088+0000","last_fullsized":"2024-09-11T23:17:53.886088+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:00:38.176669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.886814+0000","last_change":"2024-09-11T23:16:15.487497+0000","last_active":"2024-09-11T23:17:53.886814+0000","last_peered":"2024-09-11T23:17:53.886814+0000","last_clean":"2024-09-11T23:17:53.886814+0000","last_became_active":"2024-09-11T23:16:15.487180+0000","last_became_peered":"2024-09-11T23:16:15.487180+0000","last_unstale":"2024-09-11T23:17:53.886814+0000","last_undegraded":"2024-09-11T23:17:53.886814+0000","last_fullsized":"2024-09-11T23:17:53.886814+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:51.400029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"93'2","reported_seq":17,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.897261+0000","last_change":"2024-09-11T23:17:53.897261+0000","last_active":"2024-09-11T23:17:53.897261+0000","last_peered":"2024-09-11T23:17:53.897261+0000","last_clean":"2024-09-11T23:17:53.897261+0000","last_became_active":"2024-09-11T23:17:53.893347+0000","last_became_peered":"2024-09-11T23:17:53.893347+0000","last_unstale":"2024-09-11T23:17:53.897261+0000","last_undegraded":"2024-09-11T23:17:53.897261+0000","last_fullsized":"2024-09-11T23:17:53.897261+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:59:47.756415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.886548+0000","last_change":"2024-09-11T23:16:23.549141+0000","last_active":"2024-09-11T23:17:53.886548+0000","last_peered":"2024-09-11T23:17:53.886548+0000","last_clean":"2024-09-11T23:17:53.886548+0000","last_became_active":"2024-09-11T23:16:23.548731+0000","last_became_peered":"2024-09-11T23:16:23.548731+0000","last_unstale":"2024-09-11T23:17:53.886548+0000","last_undegraded":"2024-09-11T23:17:53.886548+0000","last_fullsized":"2024-09-11T23:17:53.886548+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:26.781082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.886762+0000","last_change":"2024-09-11T23:16:15.483597+0000","last_active":"2024-09-11T23:17:53.886762+0000","last_peered":"2024-09-11T23:17:53.886762+0000","last_clean":"2024-09-11T23:17:53.886762+0000","last_became_active":"2024-09-11T23:16:15.483192+0000","last_became_peered":"2024-09-11T23:16:15.483192+0000","last_unstale":"2024-09-11T23:17:53.886762+0000","last_undegraded":"2024-09-11T23:17:53.886762+0000","last_fullsized":"2024-09-11T23:17:53.886762+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:33.690922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"93'17","reported_seq":85,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:54.310036+0000","last_change":"2024-09-11T23:17:54.310036+0000","last_active":"2024-09-11T23:17:54.310036+0000","last_peered":"2024-09-11T23:17:54.310036+0000","last_clean":"2024-09-11T23:17:54.310036+0000","last_became_active":"2024-09-11T23:17:54.297497+0000","last_became_peered":"2024-09-11T23:17:54.297497+0000","last_unstale":"2024-09-11T23:17:54.310036+0000","last_undegraded":"2024-09-11T23:17:54.310036+0000","last_fullsized":"2024-09-11T23:17:54.310036+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:02.074117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,1],"acting":[8,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.892280+0000","last_change":"2024-09-11T23:17:53.892280+0000","last_active":"2024-09-11T23:17:53.892280+0000","last_peered":"2024-09-11T23:17:53.892280+0000","last_clean":"2024-09-11T23:17:53.892280+0000","last_became_active":"2024-09-11T23:17:53.891781+0000","last_became_peered":"2024-09-11T23:17:53.891781+0000","last_unstale":"2024-09-11T23:17:53.892280+0000","last_undegraded":"2024-09-11T23:17:53.892280+0000","last_fullsized":"2024-09-11T23:17:53.892280+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:15.510526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,8,11],"acting":[6,3,8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.883455+0000","last_change":"2024-09-11T23:16:15.488379+0000","last_active":"2024-09-11T23:17:53.883455+0000","last_peered":"2024-09-11T23:17:53.883455+0000","last_clean":"2024-09-11T23:17:53.883455+0000","last_became_active":"2024-09-11T23:16:15.488057+0000","last_became_peered":"2024-09-11T23:16:15.488057+0000","last_unstale":"2024-09-11T23:17:53.883455+0000","last_undegraded":"2024-09-11T23:17:53.883455+0000","last_fullsized":"2024-09-11T23:17:53.883455+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:49:05.609717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"93'6","reported_seq":105,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:56.823304+0000","last_change":"2024-09-11T23:16:12.455466+0000","last_active":"2024-09-11T23:17:56.823304+0000","last_peered":"2024-09-11T23:17:56.823304+0000","last_clean":"2024-09-11T23:17:56.823304+0000","last_became_active":"2024-09-11T23:16:12.455149+0000","last_became_peered":"2024-09-11T23:16:12.455149+0000","last_unstale":"2024-09-11T23:17:56.823304+0000","last_undegraded":"2024-09-11T23:17:56.823304+0000","last_fullsized":"2024-09-11T23:17:56.823304+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:27.642229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":59,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.887768+0000","last_change":"2024-09-11T23:16:23.549435+0000","last_active":"2024-09-11T23:17:53.887768+0000","last_peered":"2024-09-11T23:17:53.887768+0000","last_clean":"2024-09-11T23:17:53.887768+0000","last_became_active":"2024-09-11T23:16:23.548974+0000","last_became_peered":"2024-09-11T23:16:23.548974+0000","last_unstale":"2024-09-11T23:17:53.887768+0000","last_undegraded":"2024-09-11T23:17:53.887768+0000","last_fullsized":"2024-09-11T23:17:53.887768+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:16.252974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.883822+0000","last_change":"2024-09-11T23:16:15.486521+0000","last_active":"2024-09-11T23:17:53.883822+0000","last_peered":"2024-09-11T23:17:53.883822+0000","last_clean":"2024-09-11T23:17:53.883822+0000","last_became_active":"2024-09-11T23:16:15.486206+0000","last_became_peered":"2024-09-11T23:16:15.486206+0000","last_unstale":"2024-09-11T23:17:53.883822+0000","last_undegraded":"2024-09-11T23:17:53.883822+0000","last_fullsized":"2024-09-11T23:17:53.883822+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:18.814215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"93'5","reported_seq":50,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.887081+0000","last_change":"2024-09-11T23:16:12.461530+0000","last_active":"2024-09-11T23:17:53.887081+0000","last_peered":"2024-09-11T23:17:53.887081+0000","last_clean":"2024-09-11T23:17:53.887081+0000","last_became_active":"2024-09-11T23:16:12.460059+0000","last_became_peered":"2024-09-11T23:16:12.460059+0000","last_unstale":"2024-09-11T23:17:53.887081+0000","last_undegraded":"2024-09-11T23:17:53.887081+0000","last_fullsized":"2024-09-11T23:17:53.887081+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:03.797156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.886733+0000","last_change":"2024-09-11T23:16:23.545969+0000","last_active":"2024-09-11T23:17:53.886733+0000","last_peered":"2024-09-11T23:17:53.886733+0000","last_clean":"2024-09-11T23:17:53.886733+0000","last_became_active":"2024-09-11T23:16:23.545458+0000","last_became_peered":"2024-09-11T23:16:23.545458+0000","last_unstale":"2024-09-11T23:17:53.886733+0000","last_undegraded":"2024-09-11T23:17:53.886733+0000","last_fullsized":"2024-09-11T23:17:53.886733+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:46.438353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.889656+0000","last_change":"2024-09-11T23:16:15.480940+0000","last_active":"2024-09-11T23:17:53.889656+0000","last_peered":"2024-09-11T23:17:53.889656+0000","last_clean":"2024-09-11T23:17:53.889656+0000","last_became_active":"2024-09-11T23:16:15.480549+0000","last_became_peered":"2024-09-11T23:16:15.480549+0000","last_unstale":"2024-09-11T23:17:53.889656+0000","last_undegraded":"2024-09-11T23:17:53.889656+0000","last_fullsized":"2024-09-11T23:17:53.889656+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:21:47.576800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"93'9","reported_seq":53,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.886792+0000","last_change":"2024-09-11T23:16:12.464871+0000","last_active":"2024-09-11T23:17:53.886792+0000","last_peered":"2024-09-11T23:17:53.886792+0000","last_clean":"2024-09-11T23:17:53.886792+0000","last_became_active":"2024-09-11T23:16:12.464364+0000","last_became_peered":"2024-09-11T23:16:12.464364+0000","last_unstale":"2024-09-11T23:17:53.886792+0000","last_undegraded":"2024-09-11T23:17:53.886792+0000","last_fullsized":"2024-09-11T23:17:53.886792+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:48:51.131314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.886465+0000","last_change":"2024-09-11T23:16:23.542318+0000","last_active":"2024-09-11T23:17:53.886465+0000","last_peered":"2024-09-11T23:17:53.886465+0000","last_clean":"2024-09-11T23:17:53.886465+0000","last_became_active":"2024-09-11T23:16:23.541873+0000","last_became_peered":"2024-09-11T23:16:23.541873+0000","last_unstale":"2024-09-11T23:17:53.886465+0000","last_undegraded":"2024-09-11T23:17:53.886465+0000","last_fullsized":"2024-09-11T23:17:53.886465+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:25.287539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.883946+0000","last_change":"2024-09-11T23:16:15.479692+0000","last_active":"2024-09-11T23:17:53.883946+0000","last_peered":"2024-09-11T23:17:53.883946+0000","last_clean":"2024-09-11T23:17:53.883946+0000","last_became_active":"2024-09-11T23:16:15.479370+0000","last_became_peered":"2024-09-11T23:16:15.479370+0000","last_unstale":"2024-09-11T23:17:53.883946+0000","last_undegraded":"2024-09-11T23:17:53.883946+0000","last_fullsized":"2024-09-11T23:17:53.883946+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:09.051394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"93'34","reported_seq":200,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.827793+0000","last_change":"2024-09-11T23:16:12.463137+0000","last_active":"2024-09-11T23:18:00.827793+0000","last_peered":"2024-09-11T23:18:00.827793+0000","last_clean":"2024-09-11T23:18:00.827793+0000","last_became_active":"2024-09-11T23:16:12.462795+0000","last_became_peered":"2024-09-11T23:16:12.462795+0000","last_unstale":"2024-09-11T23:18:00.827793+0000","last_undegraded":"2024-09-11T23:18:00.827793+0000","last_fullsized":"2024-09-11T23:18:00.827793+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:18.607151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63511,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":123,"num_read_kb":123,"num_write":36,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.888717+0000","last_change":"2024-09-11T23:16:23.540727+0000","last_active":"2024-09-11T23:17:53.888717+0000","last_peered":"2024-09-11T23:17:53.888717+0000","last_clean":"2024-09-11T23:17:53.888717+0000","last_became_active":"2024-09-11T23:16:23.537903+0000","last_became_peered":"2024-09-11T23:16:23.537903+0000","last_unstale":"2024-09-11T23:17:53.888717+0000","last_undegraded":"2024-09-11T23:17:53.888717+0000","last_fullsized":"2024-09-11T23:17:53.888717+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:25.357375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:54.296316+0000","last_change":"2024-09-11T23:16:53.673255+0000","last_active":"2024-09-11T23:17:54.296316+0000","last_peered":"2024-09-11T23:17:54.296316+0000","last_clean":"2024-09-11T23:17:54.296316+0000","last_became_active":"2024-09-11T23:16:53.672779+0000","last_became_peered":"2024-09-11T23:16:53.672779+0000","last_unstale":"2024-09-11T23:17:54.296316+0000","last_undegraded":"2024-09-11T23:17:54.296316+0000","last_fullsized":"2024-09-11T23:17:54.296316+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:48.377554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,7],"acting":[1,8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"93'5","reported_seq":50,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.887623+0000","last_change":"2024-09-11T23:16:12.634089+0000","last_active":"2024-09-11T23:17:53.887623+0000","last_peered":"2024-09-11T23:17:53.887623+0000","last_clean":"2024-09-11T23:17:53.887623+0000","last_became_active":"2024-09-11T23:16:12.633591+0000","last_became_peered":"2024-09-11T23:16:12.633591+0000","last_unstale":"2024-09-11T23:17:53.887623+0000","last_undegraded":"2024-09-11T23:17:53.887623+0000","last_fullsized":"2024-09-11T23:17:53.887623+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:48.647019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":26,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.890617+0000","last_change":"2024-09-11T23:16:23.539351+0000","last_active":"2024-09-11T23:17:53.890617+0000","last_peered":"2024-09-11T23:17:53.890617+0000","last_clean":"2024-09-11T23:17:53.890617+0000","last_became_active":"2024-09-11T23:16:23.538781+0000","last_became_peered":"2024-09-11T23:16:23.538781+0000","last_unstale":"2024-09-11T23:17:53.890617+0000","last_undegraded":"2024-09-11T23:17:53.890617+0000","last_fullsized":"2024-09-11T23:17:53.890617+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:11.384211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.888189+0000","last_change":"2024-09-11T23:16:53.673248+0000","last_active":"2024-09-11T23:17:53.888189+0000","last_peered":"2024-09-11T23:17:53.888189+0000","last_clean":"2024-09-11T23:17:53.888189+0000","last_became_active":"2024-09-11T23:16:53.672359+0000","last_became_peered":"2024-09-11T23:16:53.672359+0000","last_unstale":"2024-09-11T23:17:53.888189+0000","last_undegraded":"2024-09-11T23:17:53.888189+0000","last_fullsized":"2024-09-11T23:17:53.888189+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:52.841263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,5],"acting":[0,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"93'4","reported_seq":52,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.884216+0000","last_change":"2024-09-11T23:16:53.929781+0000","last_active":"2024-09-11T23:17:53.884216+0000","last_peered":"2024-09-11T23:17:53.884216+0000","last_clean":"2024-09-11T23:17:53.884216+0000","last_became_active":"2024-09-11T23:16:53.929313+0000","last_became_peered":"2024-09-11T23:16:53.929313+0000","last_unstale":"2024-09-11T23:17:53.884216+0000","last_undegraded":"2024-09-11T23:17:53.884216+0000","last_fullsized":"2024-09-11T23:17:53.884216+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:29:50.874721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.887509+0000","last_change":"2024-09-11T23:16:23.551090+0000","last_active":"2024-09-11T23:17:53.887509+0000","last_peered":"2024-09-11T23:17:53.887509+0000","last_clean":"2024-09-11T23:17:53.887509+0000","last_became_active":"2024-09-11T23:16:23.548558+0000","last_became_peered":"2024-09-11T23:16:23.548558+0000","last_unstale":"2024-09-11T23:17:53.887509+0000","last_undegraded":"2024-09-11T23:17:53.887509+0000","last_fullsized":"2024-09-11T23:17:53.887509+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:29:08.416426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:54.296485+0000","last_change":"2024-09-11T23:16:15.487741+0000","last_active":"2024-09-11T23:17:54.296485+0000","last_peered":"2024-09-11T23:17:54.296485+0000","last_clean":"2024-09-11T23:17:54.296485+0000","last_became_active":"2024-09-11T23:16:15.487410+0000","last_became_peered":"2024-09-11T23:16:15.487410+0000","last_unstale":"2024-09-11T23:17:54.296485+0000","last_undegraded":"2024-09-11T23:17:54.296485+0000","last_fullsized":"2024-09-11T23:17:54.296485+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:48:18.452521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"93'4","reported_seq":163,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.828002+0000","last_change":"2024-09-11T23:16:12.459784+0000","last_active":"2024-09-11T23:18:00.828002+0000","last_peered":"2024-09-11T23:18:00.828002+0000","last_clean":"2024-09-11T23:18:00.828002+0000","last_became_active":"2024-09-11T23:16:12.459440+0000","last_became_peered":"2024-09-11T23:16:12.459440+0000","last_unstale":"2024-09-11T23:18:00.828002+0000","last_undegraded":"2024-09-11T23:18:00.828002+0000","last_fullsized":"2024-09-11T23:18:00.828002+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:36.380446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":116,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:54.298110+0000","last_change":"2024-09-11T23:17:54.298110+0000","last_active":"2024-09-11T23:17:54.298110+0000","last_peered":"2024-09-11T23:17:54.298110+0000","last_clean":"2024-09-11T23:17:54.298110+0000","last_became_active":"2024-09-11T23:17:54.297397+0000","last_became_peered":"2024-09-11T23:17:54.297397+0000","last_unstale":"2024-09-11T23:17:54.298110+0000","last_undegraded":"2024-09-11T23:17:54.298110+0000","last_fullsized":"2024-09-11T23:17:54.298110+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:05.296303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,8],"acting":[3,7,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.886565+0000","last_change":"2024-09-11T23:16:23.547579+0000","last_active":"2024-09-11T23:17:53.886565+0000","last_peered":"2024-09-11T23:17:53.886565+0000","last_clean":"2024-09-11T23:17:53.886565+0000","last_became_active":"2024-09-11T23:16:23.547182+0000","last_became_peered":"2024-09-11T23:16:23.547182+0000","last_unstale":"2024-09-11T23:17:53.886565+0000","last_undegraded":"2024-09-11T23:17:53.886565+0000","last_fullsized":"2024-09-11T23:17:53.886565+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:29.471671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.887866+0000","last_change":"2024-09-11T23:16:15.482342+0000","last_active":"2024-09-11T23:17:53.887866+0000","last_peered":"2024-09-11T23:17:53.887866+0000","last_clean":"2024-09-11T23:17:53.887866+0000","last_became_active":"2024-09-11T23:16:15.481993+0000","last_became_peered":"2024-09-11T23:16:15.481993+0000","last_unstale":"2024-09-11T23:17:53.887866+0000","last_undegraded":"2024-09-11T23:17:53.887866+0000","last_fullsized":"2024-09-11T23:17:53.887866+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:11.432932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"93'3","reported_seq":48,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.886538+0000","last_change":"2024-09-11T23:16:12.460852+0000","last_active":"2024-09-11T23:17:53.886538+0000","last_peered":"2024-09-11T23:17:53.886538+0000","last_clean":"2024-09-11T23:17:53.886538+0000","last_became_active":"2024-09-11T23:16:12.460500+0000","last_became_peered":"2024-09-11T23:16:12.460500+0000","last_unstale":"2024-09-11T23:17:53.886538+0000","last_undegraded":"2024-09-11T23:17:53.886538+0000","last_fullsized":"2024-09-11T23:17:53.886538+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:36.996441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.888513+0000","last_change":"2024-09-11T23:16:23.548465+0000","last_active":"2024-09-11T23:17:53.888513+0000","last_peered":"2024-09-11T23:17:53.888513+0000","last_clean":"2024-09-11T23:17:53.888513+0000","last_became_active":"2024-09-11T23:16:23.548121+0000","last_became_peered":"2024-09-11T23:16:23.548121+0000","last_unstale":"2024-09-11T23:17:53.888513+0000","last_undegraded":"2024-09-11T23:17:53.888513+0000","last_fullsized":"2024-09-11T23:17:53.888513+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:32:43.950947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.884783+0000","last_change":"2024-09-11T23:16:15.482202+0000","last_active":"2024-09-11T23:17:53.884783+0000","last_peered":"2024-09-11T23:17:53.884783+0000","last_clean":"2024-09-11T23:17:53.884783+0000","last_became_active":"2024-09-11T23:16:15.481817+0000","last_became_peered":"2024-09-11T23:16:15.481817+0000","last_unstale":"2024-09-11T23:17:53.884783+0000","last_undegraded":"2024-09-11T23:17:53.884783+0000","last_fullsized":"2024-09-11T23:17:53.884783+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:30.309241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"93'3","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.889260+0000","last_change":"2024-09-11T23:16:12.460729+0000","last_active":"2024-09-11T23:17:53.889260+0000","last_peered":"2024-09-11T23:17:53.889260+0000","last_clean":"2024-09-11T23:17:53.889260+0000","last_became_active":"2024-09-11T23:16:12.460319+0000","last_became_peered":"2024-09-11T23:16:12.460319+0000","last_unstale":"2024-09-11T23:17:53.889260+0000","last_undegraded":"2024-09-11T23:17:53.889260+0000","last_fullsized":"2024-09-11T23:17:53.889260+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:45:20.901191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"93'7","reported_seq":50,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:54.295728+0000","last_change":"2024-09-11T23:16:12.455617+0000","last_active":"2024-09-11T23:17:54.295728+0000","last_peered":"2024-09-11T23:17:54.295728+0000","last_clean":"2024-09-11T23:17:54.295728+0000","last_became_active":"2024-09-11T23:16:12.455159+0000","last_became_peered":"2024-09-11T23:16:12.455159+0000","last_unstale":"2024-09-11T23:17:54.295728+0000","last_undegraded":"2024-09-11T23:17:54.295728+0000","last_fullsized":"2024-09-11T23:17:54.295728+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:04:19.956580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.887393+0000","last_change":"2024-09-11T23:16:15.496026+0000","last_active":"2024-09-11T23:17:53.887393+0000","last_peered":"2024-09-11T23:17:53.887393+0000","last_clean":"2024-09-11T23:17:53.887393+0000","last_became_active":"2024-09-11T23:16:15.495785+0000","last_became_peered":"2024-09-11T23:16:15.495785+0000","last_unstale":"2024-09-11T23:17:53.887393+0000","last_undegraded":"2024-09-11T23:17:53.887393+0000","last_fullsized":"2024-09-11T23:17:53.887393+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:11:33.613170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.885794+0000","last_change":"2024-09-11T23:16:23.545144+0000","last_active":"2024-09-11T23:17:53.885794+0000","last_peered":"2024-09-11T23:17:53.885794+0000","last_clean":"2024-09-11T23:17:53.885794+0000","last_became_active":"2024-09-11T23:16:23.544702+0000","last_became_peered":"2024-09-11T23:16:23.544702+0000","last_unstale":"2024-09-11T23:17:53.885794+0000","last_undegraded":"2024-09-11T23:17:53.885794+0000","last_fullsized":"2024-09-11T23:17:53.885794+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:35:39.155913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"93'5","reported_seq":107,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:57.824618+0000","last_change":"2024-09-11T23:16:12.464182+0000","last_active":"2024-09-11T23:17:57.824618+0000","last_peered":"2024-09-11T23:17:57.824618+0000","last_clean":"2024-09-11T23:17:57.824618+0000","last_became_active":"2024-09-11T23:16:12.463835+0000","last_became_peered":"2024-09-11T23:16:12.463835+0000","last_unstale":"2024-09-11T23:17:57.824618+0000","last_undegraded":"2024-09-11T23:17:57.824618+0000","last_fullsized":"2024-09-11T23:17:57.824618+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:34:51.682457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":58,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.883223+0000","last_change":"2024-09-11T23:16:53.674740+0000","last_active":"2024-09-11T23:17:53.883223+0000","last_peered":"2024-09-11T23:17:53.883223+0000","last_clean":"2024-09-11T23:17:53.883223+0000","last_became_active":"2024-09-11T23:16:53.674285+0000","last_became_peered":"2024-09-11T23:16:53.674285+0000","last_unstale":"2024-09-11T23:17:53.883223+0000","last_undegraded":"2024-09-11T23:17:53.883223+0000","last_fullsized":"2024-09-11T23:17:53.883223+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:08.762810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6],"acting":[8,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.887086+0000","last_change":"2024-09-11T23:16:23.540185+0000","last_active":"2024-09-11T23:17:53.887086+0000","last_peered":"2024-09-11T23:17:53.887086+0000","last_clean":"2024-09-11T23:17:53.887086+0000","last_became_active":"2024-09-11T23:16:23.539760+0000","last_became_peered":"2024-09-11T23:16:23.539760+0000","last_unstale":"2024-09-11T23:17:53.887086+0000","last_undegraded":"2024-09-11T23:17:53.887086+0000","last_fullsized":"2024-09-11T23:17:53.887086+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:40.944999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.886585+0000","last_change":"2024-09-11T23:16:15.489240+0000","last_active":"2024-09-11T23:17:53.886585+0000","last_peered":"2024-09-11T23:17:53.886585+0000","last_clean":"2024-09-11T23:17:53.886585+0000","last_became_active":"2024-09-11T23:16:15.488878+0000","last_became_peered":"2024-09-11T23:16:15.488878+0000","last_unstale":"2024-09-11T23:17:53.886585+0000","last_undegraded":"2024-09-11T23:17:53.886585+0000","last_fullsized":"2024-09-11T23:17:53.886585+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:38.076935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.885977+0000","last_change":"2024-09-11T23:16:15.486369+0000","last_active":"2024-09-11T23:17:53.885977+0000","last_peered":"2024-09-11T23:17:53.885977+0000","last_clean":"2024-09-11T23:17:53.885977+0000","last_became_active":"2024-09-11T23:16:15.486055+0000","last_became_peered":"2024-09-11T23:16:15.486055+0000","last_unstale":"2024-09-11T23:17:53.885977+0000","last_undegraded":"2024-09-11T23:17:53.885977+0000","last_fullsized":"2024-09-11T23:17:53.885977+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:16.233578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.885857+0000","last_change":"2024-09-11T23:16:15.484981+0000","last_active":"2024-09-11T23:17:53.885857+0000","last_peered":"2024-09-11T23:17:53.885857+0000","last_clean":"2024-09-11T23:17:53.885857+0000","last_became_active":"2024-09-11T23:16:15.484640+0000","last_became_peered":"2024-09-11T23:16:15.484640+0000","last_unstale":"2024-09-11T23:17:53.885857+0000","last_undegraded":"2024-09-11T23:17:53.885857+0000","last_fullsized":"2024-09-11T23:17:53.885857+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:32.844009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.887023+0000","last_change":"2024-09-11T23:16:15.488570+0000","last_active":"2024-09-11T23:17:53.887023+0000","last_peered":"2024-09-11T23:17:53.887023+0000","last_clean":"2024-09-11T23:17:53.887023+0000","last_became_active":"2024-09-11T23:16:15.487932+0000","last_became_peered":"2024-09-11T23:16:15.487932+0000","last_unstale":"2024-09-11T23:17:53.887023+0000","last_undegraded":"2024-09-11T23:17:53.887023+0000","last_fullsized":"2024-09-11T23:17:53.887023+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:14.062864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.890249+0000","last_change":"2024-09-11T23:16:15.499493+0000","last_active":"2024-09-11T23:17:53.890249+0000","last_peered":"2024-09-11T23:17:53.890249+0000","last_clean":"2024-09-11T23:17:53.890249+0000","last_became_active":"2024-09-11T23:16:15.499150+0000","last_became_peered":"2024-09-11T23:16:15.499150+0000","last_unstale":"2024-09-11T23:17:53.890249+0000","last_undegraded":"2024-09-11T23:17:53.890249+0000","last_fullsized":"2024-09-11T23:17:53.890249+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:52.538614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.887548+0000","last_change":"2024-09-11T23:16:15.484214+0000","last_active":"2024-09-11T23:17:53.887548+0000","last_peered":"2024-09-11T23:17:53.887548+0000","last_clean":"2024-09-11T23:17:53.887548+0000","last_became_active":"2024-09-11T23:16:15.483911+0000","last_became_peered":"2024-09-11T23:16:15.483911+0000","last_unstale":"2024-09-11T23:17:53.887548+0000","last_undegraded":"2024-09-11T23:17:53.887548+0000","last_fullsized":"2024-09-11T23:17:53.887548+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:19:12.283255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.885768+0000","last_change":"2024-09-11T23:16:15.488454+0000","last_active":"2024-09-11T23:17:53.885768+0000","last_peered":"2024-09-11T23:17:53.885768+0000","last_clean":"2024-09-11T23:17:53.885768+0000","last_became_active":"2024-09-11T23:16:15.488071+0000","last_became_peered":"2024-09-11T23:16:15.488071+0000","last_unstale":"2024-09-11T23:17:53.885768+0000","last_undegraded":"2024-09-11T23:17:53.885768+0000","last_fullsized":"2024-09-11T23:17:53.885768+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:31.249057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.885419+0000","last_change":"2024-09-11T23:16:15.489743+0000","last_active":"2024-09-11T23:17:53.885419+0000","last_peered":"2024-09-11T23:17:53.885419+0000","last_clean":"2024-09-11T23:17:53.885419+0000","last_became_active":"2024-09-11T23:16:15.489411+0000","last_became_peered":"2024-09-11T23:16:15.489411+0000","last_unstale":"2024-09-11T23:17:53.885419+0000","last_undegraded":"2024-09-11T23:17:53.885419+0000","last_fullsized":"2024-09-11T23:17:53.885419+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:09.912448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.888040+0000","last_change":"2024-09-11T23:16:15.494906+0000","last_active":"2024-09-11T23:17:53.888040+0000","last_peered":"2024-09-11T23:17:53.888040+0000","last_clean":"2024-09-11T23:17:53.888040+0000","last_became_active":"2024-09-11T23:16:15.494567+0000","last_became_peered":"2024-09-11T23:16:15.494567+0000","last_unstale":"2024-09-11T23:17:53.888040+0000","last_undegraded":"2024-09-11T23:17:53.888040+0000","last_fullsized":"2024-09-11T23:17:53.888040+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:22.364551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.885151+0000","last_change":"2024-09-11T23:16:15.489363+0000","last_active":"2024-09-11T23:17:53.885151+0000","last_peered":"2024-09-11T23:17:53.885151+0000","last_clean":"2024-09-11T23:17:53.885151+0000","last_became_active":"2024-09-11T23:16:15.489056+0000","last_became_peered":"2024-09-11T23:16:15.489056+0000","last_unstale":"2024-09-11T23:17:53.885151+0000","last_undegraded":"2024-09-11T23:17:53.885151+0000","last_fullsized":"2024-09-11T23:17:53.885151+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:37:37.152715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:54.296879+0000","last_change":"2024-09-11T23:16:15.483283+0000","last_active":"2024-09-11T23:17:54.296879+0000","last_peered":"2024-09-11T23:17:54.296879+0000","last_clean":"2024-09-11T23:17:54.296879+0000","last_became_active":"2024-09-11T23:16:15.481463+0000","last_became_peered":"2024-09-11T23:16:15.481463+0000","last_unstale":"2024-09-11T23:17:54.296879+0000","last_undegraded":"2024-09-11T23:17:54.296879+0000","last_fullsized":"2024-09-11T23:17:54.296879+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:37.484644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.890381+0000","last_change":"2024-09-11T23:16:15.487478+0000","last_active":"2024-09-11T23:17:53.890381+0000","last_peered":"2024-09-11T23:17:53.890381+0000","last_clean":"2024-09-11T23:17:53.890381+0000","last_became_active":"2024-09-11T23:16:15.487115+0000","last_became_peered":"2024-09-11T23:16:15.487115+0000","last_unstale":"2024-09-11T23:17:53.890381+0000","last_undegraded":"2024-09-11T23:17:53.890381+0000","last_fullsized":"2024-09-11T23:17:53.890381+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:34.967388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.886854+0000","last_change":"2024-09-11T23:16:15.486593+0000","last_active":"2024-09-11T23:17:53.886854+0000","last_peered":"2024-09-11T23:17:53.886854+0000","last_clean":"2024-09-11T23:17:53.886854+0000","last_became_active":"2024-09-11T23:16:15.486282+0000","last_became_peered":"2024-09-11T23:16:15.486282+0000","last_unstale":"2024-09-11T23:17:53.886854+0000","last_undegraded":"2024-09-11T23:17:53.886854+0000","last_fullsized":"2024-09-11T23:17:53.886854+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:33.845679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.887259+0000","last_change":"2024-09-11T23:16:15.488330+0000","last_active":"2024-09-11T23:17:53.887259+0000","last_peered":"2024-09-11T23:17:53.887259+0000","last_clean":"2024-09-11T23:17:53.887259+0000","last_became_active":"2024-09-11T23:16:15.488005+0000","last_became_peered":"2024-09-11T23:16:15.488005+0000","last_unstale":"2024-09-11T23:17:53.887259+0000","last_undegraded":"2024-09-11T23:17:53.887259+0000","last_fullsized":"2024-09-11T23:17:53.887259+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:12.189988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.889244+0000","last_change":"2024-09-11T23:16:15.486251+0000","last_active":"2024-09-11T23:17:53.889244+0000","last_peered":"2024-09-11T23:17:53.889244+0000","last_clean":"2024-09-11T23:17:53.889244+0000","last_became_active":"2024-09-11T23:16:15.485937+0000","last_became_peered":"2024-09-11T23:16:15.485937+0000","last_unstale":"2024-09-11T23:17:53.889244+0000","last_undegraded":"2024-09-11T23:17:53.889244+0000","last_fullsized":"2024-09-11T23:17:53.889244+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:32:01.829834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.888653+0000","last_change":"2024-09-11T23:16:15.488635+0000","last_active":"2024-09-11T23:17:53.888653+0000","last_peered":"2024-09-11T23:17:53.888653+0000","last_clean":"2024-09-11T23:17:53.888653+0000","last_became_active":"2024-09-11T23:16:15.488326+0000","last_became_peered":"2024-09-11T23:16:15.488326+0000","last_unstale":"2024-09-11T23:17:53.888653+0000","last_undegraded":"2024-09-11T23:17:53.888653+0000","last_fullsized":"2024-09-11T23:17:53.888653+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:25.626349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":15,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.887410+0000","last_change":"2024-09-11T23:16:53.676716+0000","last_active":"2024-09-11T23:17:53.887410+0000","last_peered":"2024-09-11T23:17:53.887410+0000","last_clean":"2024-09-11T23:17:53.887410+0000","last_became_active":"2024-09-11T23:16:53.674056+0000","last_became_peered":"2024-09-11T23:16:53.674056+0000","last_unstale":"2024-09-11T23:17:53.887410+0000","last_undegraded":"2024-09-11T23:17:53.887410+0000","last_fullsized":"2024-09-11T23:17:53.887410+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:49:44.258607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0],"acting":[9,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.886371+0000","last_change":"2024-09-11T23:16:15.487550+0000","last_active":"2024-09-11T23:17:53.886371+0000","last_peered":"2024-09-11T23:17:53.886371+0000","last_clean":"2024-09-11T23:17:53.886371+0000","last_became_active":"2024-09-11T23:16:15.487197+0000","last_became_peered":"2024-09-11T23:16:15.487197+0000","last_unstale":"2024-09-11T23:17:53.886371+0000","last_undegraded":"2024-09-11T23:17:53.886371+0000","last_fullsized":"2024-09-11T23:17:53.886371+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:51.899470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.886100+0000","last_change":"2024-09-11T23:16:15.493106+0000","last_active":"2024-09-11T23:17:53.886100+0000","last_peered":"2024-09-11T23:17:53.886100+0000","last_clean":"2024-09-11T23:17:53.886100+0000","last_became_active":"2024-09-11T23:16:15.492649+0000","last_became_peered":"2024-09-11T23:16:15.492649+0000","last_unstale":"2024-09-11T23:17:53.886100+0000","last_undegraded":"2024-09-11T23:17:53.886100+0000","last_fullsized":"2024-09-11T23:17:53.886100+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:37.584557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.890285+0000","last_change":"2024-09-11T23:16:15.485444+0000","last_active":"2024-09-11T23:17:53.890285+0000","last_peered":"2024-09-11T23:17:53.890285+0000","last_clean":"2024-09-11T23:17:53.890285+0000","last_became_active":"2024-09-11T23:16:15.484985+0000","last_became_peered":"2024-09-11T23:16:15.484985+0000","last_unstale":"2024-09-11T23:17:53.890285+0000","last_undegraded":"2024-09-11T23:17:53.890285+0000","last_fullsized":"2024-09-11T23:17:53.890285+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:42:38.827500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":36,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.890678+0000","last_change":"2024-09-11T23:16:15.488819+0000","last_active":"2024-09-11T23:17:53.890678+0000","last_peered":"2024-09-11T23:17:53.890678+0000","last_clean":"2024-09-11T23:17:53.890678+0000","last_became_active":"2024-09-11T23:16:15.488484+0000","last_became_peered":"2024-09-11T23:16:15.488484+0000","last_unstale":"2024-09-11T23:17:53.890678+0000","last_undegraded":"2024-09-11T23:17:53.890678+0000","last_fullsized":"2024-09-11T23:17:53.890678+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:11.548909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.884217+0000","last_change":"2024-09-11T23:16:15.490369+0000","last_active":"2024-09-11T23:17:53.884217+0000","last_peered":"2024-09-11T23:17:53.884217+0000","last_clean":"2024-09-11T23:17:53.884217+0000","last_became_active":"2024-09-11T23:16:15.489977+0000","last_became_peered":"2024-09-11T23:16:15.489977+0000","last_unstale":"2024-09-11T23:17:53.884217+0000","last_undegraded":"2024-09-11T23:17:53.884217+0000","last_fullsized":"2024-09-11T23:17:53.884217+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:17.161073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:54.296269+0000","last_change":"2024-09-11T23:16:15.486820+0000","last_active":"2024-09-11T23:17:54.296269+0000","last_peered":"2024-09-11T23:17:54.296269+0000","last_clean":"2024-09-11T23:17:54.296269+0000","last_became_active":"2024-09-11T23:16:15.486259+0000","last_became_peered":"2024-09-11T23:16:15.486259+0000","last_unstale":"2024-09-11T23:17:54.296269+0000","last_undegraded":"2024-09-11T23:17:54.296269+0000","last_fullsized":"2024-09-11T23:17:54.296269+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:11.156989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:54.296637+0000","last_change":"2024-09-11T23:16:15.482432+0000","last_active":"2024-09-11T23:17:54.296637+0000","last_peered":"2024-09-11T23:17:54.296637+0000","last_clean":"2024-09-11T23:17:54.296637+0000","last_became_active":"2024-09-11T23:16:15.481930+0000","last_became_peered":"2024-09-11T23:16:15.481930+0000","last_unstale":"2024-09-11T23:17:54.296637+0000","last_undegraded":"2024-09-11T23:17:54.296637+0000","last_fullsized":"2024-09-11T23:17:54.296637+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:03.156829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.884698+0000","last_change":"2024-09-11T23:16:53.670447+0000","last_active":"2024-09-11T23:17:53.884698+0000","last_peered":"2024-09-11T23:17:53.884698+0000","last_clean":"2024-09-11T23:17:53.884698+0000","last_became_active":"2024-09-11T23:16:53.670084+0000","last_became_peered":"2024-09-11T23:16:53.670084+0000","last_unstale":"2024-09-11T23:17:53.884698+0000","last_undegraded":"2024-09-11T23:17:53.884698+0000","last_fullsized":"2024-09-11T23:17:53.884698+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:25.603908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,8,10],"acting":[3,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.883442+0000","last_change":"2024-09-11T23:16:15.492210+0000","last_active":"2024-09-11T23:17:53.883442+0000","last_peered":"2024-09-11T23:17:53.883442+0000","last_clean":"2024-09-11T23:17:53.883442+0000","last_became_active":"2024-09-11T23:16:15.491333+0000","last_became_peered":"2024-09-11T23:16:15.491333+0000","last_unstale":"2024-09-11T23:17:53.883442+0000","last_undegraded":"2024-09-11T23:17:53.883442+0000","last_fullsized":"2024-09-11T23:17:53.883442+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:52.824085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:54.295685+0000","last_change":"2024-09-11T23:16:15.489798+0000","last_active":"2024-09-11T23:17:54.295685+0000","last_peered":"2024-09-11T23:17:54.295685+0000","last_clean":"2024-09-11T23:17:54.295685+0000","last_became_active":"2024-09-11T23:16:15.489357+0000","last_became_peered":"2024-09-11T23:16:15.489357+0000","last_unstale":"2024-09-11T23:17:54.295685+0000","last_undegraded":"2024-09-11T23:17:54.295685+0000","last_fullsized":"2024-09-11T23:17:54.295685+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:13:53.460349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.883298+0000","last_change":"2024-09-11T23:16:15.480192+0000","last_active":"2024-09-11T23:17:53.883298+0000","last_peered":"2024-09-11T23:17:53.883298+0000","last_clean":"2024-09-11T23:17:53.883298+0000","last_became_active":"2024-09-11T23:16:15.479884+0000","last_became_peered":"2024-09-11T23:16:15.479884+0000","last_unstale":"2024-09-11T23:17:53.883298+0000","last_undegraded":"2024-09-11T23:17:53.883298+0000","last_fullsized":"2024-09-11T23:17:53.883298+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:24:34.765550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":36,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.890565+0000","last_change":"2024-09-11T23:16:15.483444+0000","last_active":"2024-09-11T23:17:53.890565+0000","last_peered":"2024-09-11T23:17:53.890565+0000","last_clean":"2024-09-11T23:17:53.890565+0000","last_became_active":"2024-09-11T23:16:15.483006+0000","last_became_peered":"2024-09-11T23:16:15.483006+0000","last_unstale":"2024-09-11T23:17:53.890565+0000","last_undegraded":"2024-09-11T23:17:53.890565+0000","last_fullsized":"2024-09-11T23:17:53.890565+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:19:11.855417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.886751+0000","last_change":"2024-09-11T23:16:15.497823+0000","last_active":"2024-09-11T23:17:53.886751+0000","last_peered":"2024-09-11T23:17:53.886751+0000","last_clean":"2024-09-11T23:17:53.886751+0000","last_became_active":"2024-09-11T23:16:15.493688+0000","last_became_peered":"2024-09-11T23:16:15.493688+0000","last_unstale":"2024-09-11T23:17:53.886751+0000","last_undegraded":"2024-09-11T23:17:53.886751+0000","last_fullsized":"2024-09-11T23:17:53.886751+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:50:35.055108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.887213+0000","last_change":"2024-09-11T23:16:15.497942+0000","last_active":"2024-09-11T23:17:53.887213+0000","last_peered":"2024-09-11T23:17:53.887213+0000","last_clean":"2024-09-11T23:17:53.887213+0000","last_became_active":"2024-09-11T23:16:15.492467+0000","last_became_peered":"2024-09-11T23:16:15.492467+0000","last_unstale":"2024-09-11T23:17:53.887213+0000","last_undegraded":"2024-09-11T23:17:53.887213+0000","last_fullsized":"2024-09-11T23:17:53.887213+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:16.156174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.888634+0000","last_change":"2024-09-11T23:16:15.488477+0000","last_active":"2024-09-11T23:17:53.888634+0000","last_peered":"2024-09-11T23:17:53.888634+0000","last_clean":"2024-09-11T23:17:53.888634+0000","last_became_active":"2024-09-11T23:16:15.488169+0000","last_became_peered":"2024-09-11T23:16:15.488169+0000","last_unstale":"2024-09-11T23:17:53.888634+0000","last_undegraded":"2024-09-11T23:17:53.888634+0000","last_fullsized":"2024-09-11T23:17:53.888634+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:19:15.223041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":71112,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":603,"num_read_kb":380,"num_write":246,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":806,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":577536,"data_stored":213336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":213,"ondisk_log_size":213,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":76,"seq":326417514531,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28116,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717036,"statfs":{"total":95995035648,"available":95966244864,"internally_reserved":0,"allocated":1114112,"data_stored":550696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":69,"seq":296352743464,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28792,"kb_used_data":1760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716360,"statfs":{"total":95995035648,"available":95965552640,"internally_reserved":0,"allocated":1802240,"data_stored":1204425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":64,"seq":274877906990,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28128,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717024,"statfs":{"total":95995035648,"available":95966232576,"internally_reserved":0,"allocated":1126400,"data_stored":549539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168629,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36436,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708716,"statfs":{"total":95995035648,"available":95957725184,"internally_reserved":0,"allocated":1118208,"data_stored":549895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397560,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":37020,"kb_used_data":1672,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708132,"statfs":{"total":95995035648,"available":95957127168,"internally_reserved":0,"allocated":1712128,"data_stored":1146137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561087,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32268,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712884,"statfs":{"total":95995035648,"available":95961993216,"internally_reserved":0,"allocated":1101824,"data_stored":545436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790019,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28720,"kb_used_data":1688,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716432,"statfs":{"total":95995035648,"available":95965626368,"internally_reserved":0,"allocated":1728512,"data_stored":1141605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953544,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32272,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712880,"statfs":{"total":95995035648,"available":95961989120,"internally_reserved":0,"allocated":1110016,"data_stored":549510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182478,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28116,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717036,"statfs":{"total":95995035648,"available":95966244864,"internally_reserved":0,"allocated":1114112,"data_stored":544751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411413,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36508,"kb_used_data":1156,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708644,"statfs":{"total":95995035648,"available":95957651456,"internally_reserved":0,"allocated":1183744,"data_stored":610085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574936,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28180,"kb_used_data":1152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716972,"statfs":{"total":95995035648,"available":95966179328,"internally_reserved":0,"allocated":1179648,"data_stored":610089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738462,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32288,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712864,"statfs":{"total":95995035648,"available":95961972736,"internally_reserved":0,"allocated":1126400,"data_stored":546892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":65768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":65764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":3256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":65640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:18:04.022 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-11T23:18:04.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:18:04 smithi037 ceph-mon[30630]: pgmap v360: 129 pgs: 129 active+clean; 646 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 10 op/s; 100 B/s, 1 objects/s recovering 2024-09-11T23:18:04.403 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:18:04.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:18:04 smithi160 ceph-mon[35055]: pgmap v360: 129 pgs: 129 active+clean; 646 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 10 op/s; 100 B/s, 1 objects/s recovering 2024-09-11T23:18:04.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:18:04 smithi123 ceph-mon[35438]: pgmap v360: 129 pgs: 129 active+clean; 646 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 10 op/s; 100 B/s, 1 objects/s recovering 2024-09-11T23:18:04.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:04.959+0000 7fa556000640 1 -- 172.21.15.37:0/1818251942 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa550074620 msgr2=0x7fa550074a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:04.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:04.959+0000 7fa556000640 1 --2- 172.21.15.37:0/1818251942 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa550074620 0x7fa550074a00 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa540009900 tx=0x7fa54002a480 comp rx=0 tx=0).stop 2024-09-11T23:18:04.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:04.960+0000 7fa556000640 1 -- 172.21.15.37:0/1818251942 shutdown_connections 2024-09-11T23:18:04.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:04.960+0000 7fa556000640 1 --2- 172.21.15.37:0/1818251942 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa55010e3c0 0x7fa550110810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:04.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:04.960+0000 7fa556000640 1 --2- 172.21.15.37:0/1818251942 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa550074f40 0x7fa55010de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:04.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:04.960+0000 7fa556000640 1 --2- 172.21.15.37:0/1818251942 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa550074620 0x7fa550074a00 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:04.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:04.960+0000 7fa556000640 1 -- 172.21.15.37:0/1818251942 >> 172.21.15.37:0/1818251942 conn(0x7fa5500fd8c0 msgr2=0x7fa5500ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:04.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:04.960+0000 7fa556000640 1 -- 172.21.15.37:0/1818251942 shutdown_connections 2024-09-11T23:18:04.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:04.960+0000 7fa556000640 1 -- 172.21.15.37:0/1818251942 wait complete. 2024-09-11T23:18:04.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:04.961+0000 7fa556000640 1 Processor -- start 2024-09-11T23:18:04.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:04.961+0000 7fa556000640 1 -- start start 2024-09-11T23:18:04.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:04.961+0000 7fa556000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa550074620 0x7fa55019a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:04.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:04.961+0000 7fa556000640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa550074f40 0x7fa55019ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:04.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:04.961+0000 7fa556000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa55010e3c0 0x7fa55019f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:04.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:04.961+0000 7fa556000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa550114170 con 0x7fa550074620 2024-09-11T23:18:04.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:04.961+0000 7fa556000640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fa550113ff0 con 0x7fa55010e3c0 2024-09-11T23:18:04.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:04.961+0000 7fa556000640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fa5501142f0 con 0x7fa550074f40 2024-09-11T23:18:04.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:04.961+0000 7fa54f400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa550074620 0x7fa55019a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:04.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:04.961+0000 7fa54f400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa550074620 0x7fa55019a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58238/0 (socket says 172.21.15.37:58238) 2024-09-11T23:18:04.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:04.961+0000 7fa54f400640 1 -- 172.21.15.37:0/2432186373 learned_addr learned my addr 172.21.15.37:0/2432186373 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:18:04.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:04.962+0000 7fa546a00640 1 --2- 172.21.15.37:0/2432186373 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa550074f40 0x7fa55019ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:04.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:04.962+0000 7fa54fe00640 1 --2- 172.21.15.37:0/2432186373 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa55010e3c0 0x7fa55019f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:04.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:04.962+0000 7fa54f400640 1 -- 172.21.15.37:0/2432186373 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa550074f40 msgr2=0x7fa55019ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:04.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:04.962+0000 7fa54f400640 1 --2- 172.21.15.37:0/2432186373 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa550074f40 0x7fa55019ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:04.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:04.962+0000 7fa54f400640 1 -- 172.21.15.37:0/2432186373 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa55010e3c0 msgr2=0x7fa55019f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:04.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:04.962+0000 7fa54f400640 1 --2- 172.21.15.37:0/2432186373 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa55010e3c0 0x7fa55019f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:04.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:04.962+0000 7fa54f400640 1 -- 172.21.15.37:0/2432186373 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa55019f6e0 con 0x7fa550074620 2024-09-11T23:18:04.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:04.962+0000 7fa546a00640 1 --2- 172.21.15.37:0/2432186373 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa550074f40 0x7fa55019ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:18:04.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:04.962+0000 7fa54fe00640 1 --2- 172.21.15.37:0/2432186373 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa55010e3c0 0x7fa55019f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:18:04.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:04.962+0000 7fa54f400640 1 --2- 172.21.15.37:0/2432186373 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa550074620 0x7fa55019a730 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa540006010 tx=0x7fa540004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:04.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:04.963+0000 7fa54cc00640 1 -- 172.21.15.37:0/2432186373 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa54003f030 con 0x7fa550074620 2024-09-11T23:18:04.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:04.963+0000 7fa54cc00640 1 -- 172.21.15.37:0/2432186373 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa540004440 con 0x7fa550074620 2024-09-11T23:18:04.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:04.963+0000 7fa556000640 1 -- 172.21.15.37:0/2432186373 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa55019f970 con 0x7fa550074620 2024-09-11T23:18:04.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:04.963+0000 7fa54cc00640 1 -- 172.21.15.37:0/2432186373 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa540035070 con 0x7fa550074620 2024-09-11T23:18:04.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:04.963+0000 7fa556000640 1 -- 172.21.15.37:0/2432186373 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5501a72b0 con 0x7fa550074620 2024-09-11T23:18:04.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:04.964+0000 7fa556000640 1 -- 172.21.15.37:0/2432186373 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa550074a00 con 0x7fa550074620 2024-09-11T23:18:04.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:04.966+0000 7fa54cc00640 1 -- 172.21.15.37:0/2432186373 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fa540042030 con 0x7fa550074620 2024-09-11T23:18:04.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:04.967+0000 7fa54cc00640 1 --2- 172.21.15.37:0/2432186373 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fa5340a2c90 0x7fa5340a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:04.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:04.968+0000 7fa54cc00640 1 -- 172.21.15.37:0/2432186373 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9295+0+0 (secure 0 0 0) 0x7fa5400ef9d0 con 0x7fa550074620 2024-09-11T23:18:04.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:04.968+0000 7fa546a00640 1 --2- 172.21.15.37:0/2432186373 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fa5340a2c90 0x7fa5340a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:04.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:04.968+0000 7fa546a00640 1 --2- 172.21.15.37:0/2432186373 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fa5340a2c90 0x7fa5340a5150 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa55010f880 tx=0x7fa538005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:04.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:04.972+0000 7fa54cc00640 1 -- 172.21.15.37:0/2432186373 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa5400bc350 con 0x7fa550074620 2024-09-11T23:18:05.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:05.157+0000 7fa556000640 1 -- 172.21.15.37:0/2432186373 --> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa550062630 con 0x7fa5340a2c90 2024-09-11T23:18:05.157 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:18:05 smithi037 ceph-mon[30630]: from='client.24929 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T23:18:05.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:05.166+0000 7fa54cc00640 1 -- 172.21.15.37:0/2432186373 <== mgr.14150 v2:172.21.15.37:6800/31543269 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340422 (secure 0 0 0) 0x7fa550062630 con 0x7fa5340a2c90 2024-09-11T23:18:05.172 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:18:05.175 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-11T23:18:05.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:05.171+0000 7fa556000640 1 -- 172.21.15.37:0/2432186373 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fa5340a2c90 msgr2=0x7fa5340a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:05.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:05.171+0000 7fa556000640 1 --2- 172.21.15.37:0/2432186373 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fa5340a2c90 0x7fa5340a5150 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa55010f880 tx=0x7fa538005f90 comp rx=0 tx=0).stop 2024-09-11T23:18:05.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:05.171+0000 7fa556000640 1 -- 172.21.15.37:0/2432186373 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa550074620 msgr2=0x7fa55019a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:05.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:05.171+0000 7fa556000640 1 --2- 172.21.15.37:0/2432186373 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa550074620 0x7fa55019a730 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa540006010 tx=0x7fa540004040 comp rx=0 tx=0).stop 2024-09-11T23:18:05.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:05.171+0000 7fa556000640 1 -- 172.21.15.37:0/2432186373 shutdown_connections 2024-09-11T23:18:05.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:05.171+0000 7fa556000640 1 --2- 172.21.15.37:0/2432186373 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fa5340a2c90 0x7fa5340a5150 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:05.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:05.171+0000 7fa556000640 1 --2- 172.21.15.37:0/2432186373 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa55010e3c0 0x7fa55019f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:05.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:05.171+0000 7fa556000640 1 --2- 172.21.15.37:0/2432186373 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa550074f40 0x7fa55019ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:05.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:05.171+0000 7fa556000640 1 --2- 172.21.15.37:0/2432186373 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa550074620 0x7fa55019a730 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:05.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:05.171+0000 7fa556000640 1 -- 172.21.15.37:0/2432186373 >> 172.21.15.37:0/2432186373 conn(0x7fa5500fd8c0 msgr2=0x7fa5500fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:05.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:05.171+0000 7fa556000640 1 -- 172.21.15.37:0/2432186373 shutdown_connections 2024-09-11T23:18:05.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:05.171+0000 7fa556000640 1 -- 172.21.15.37:0/2432186373 wait complete. 2024-09-11T23:18:05.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:18:05 smithi160 ceph-mon[35055]: from='client.24929 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T23:18:05.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:18:05 smithi123 ceph-mon[35438]: from='client.24929 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T23:18:05.950 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":361,"stamp":"2024-09-11T23:18:04.059040+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":661714,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":739,"num_read_kb":489,"num_write":429,"num_write_kb":3082,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":1181659,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":352,"ondisk_log_size":352,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":376844,"kb_used_data":15056,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124564980,"statfs":{"total":1151940427776,"available":1151554539520,"internally_reserved":0,"allocated":15417344,"data_stored":8549060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":370193721},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":-2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":45,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":923,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.175655"},"pg_stats":[{"pgid":"2.1f","version":"93'13","reported_seq":135,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.901690+0000","last_change":"2024-09-11T23:17:53.901109+0000","last_active":"2024-09-11T23:17:59.901690+0000","last_peered":"2024-09-11T23:17:59.901690+0000","last_clean":"2024-09-11T23:17:59.901690+0000","last_became_active":"2024-09-11T23:17:53.892737+0000","last_became_peered":"2024-09-11T23:17:53.892737+0000","last_unstale":"2024-09-11T23:17:59.901690+0000","last_undegraded":"2024-09-11T23:17:59.901690+0000","last_fullsized":"2024-09-11T23:17:59.901690+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:40:43.977951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":672,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,8],"acting":[9,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.884919+0000","last_change":"2024-09-11T23:16:15.493946+0000","last_active":"2024-09-11T23:17:53.884919+0000","last_peered":"2024-09-11T23:17:53.884919+0000","last_clean":"2024-09-11T23:17:53.884919+0000","last_became_active":"2024-09-11T23:16:15.493433+0000","last_became_peered":"2024-09-11T23:16:15.493433+0000","last_unstale":"2024-09-11T23:17:53.884919+0000","last_undegraded":"2024-09-11T23:17:53.884919+0000","last_fullsized":"2024-09-11T23:17:53.884919+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:47.700354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.885413+0000","last_change":"2024-09-11T23:16:23.550528+0000","last_active":"2024-09-11T23:17:53.885413+0000","last_peered":"2024-09-11T23:17:53.885413+0000","last_clean":"2024-09-11T23:17:53.885413+0000","last_became_active":"2024-09-11T23:16:23.550205+0000","last_became_peered":"2024-09-11T23:16:23.550205+0000","last_unstale":"2024-09-11T23:17:53.885413+0000","last_undegraded":"2024-09-11T23:17:53.885413+0000","last_fullsized":"2024-09-11T23:17:53.885413+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:28.318748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"93'2","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.885606+0000","last_change":"2024-09-11T23:16:12.633362+0000","last_active":"2024-09-11T23:17:53.885606+0000","last_peered":"2024-09-11T23:17:53.885606+0000","last_clean":"2024-09-11T23:17:53.885606+0000","last_became_active":"2024-09-11T23:16:12.632909+0000","last_became_peered":"2024-09-11T23:16:12.632909+0000","last_unstale":"2024-09-11T23:17:53.885606+0000","last_undegraded":"2024-09-11T23:17:53.885606+0000","last_fullsized":"2024-09-11T23:17:53.885606+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:08.533740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.888095+0000","last_change":"2024-09-11T23:16:15.499394+0000","last_active":"2024-09-11T23:17:53.888095+0000","last_peered":"2024-09-11T23:17:53.888095+0000","last_clean":"2024-09-11T23:17:53.888095+0000","last_became_active":"2024-09-11T23:16:15.499058+0000","last_became_peered":"2024-09-11T23:16:15.499058+0000","last_unstale":"2024-09-11T23:17:53.888095+0000","last_undegraded":"2024-09-11T23:17:53.888095+0000","last_fullsized":"2024-09-11T23:17:53.888095+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:05.361857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":26,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.890078+0000","last_change":"2024-09-11T23:16:23.543358+0000","last_active":"2024-09-11T23:17:53.890078+0000","last_peered":"2024-09-11T23:17:53.890078+0000","last_clean":"2024-09-11T23:17:53.890078+0000","last_became_active":"2024-09-11T23:16:23.542928+0000","last_became_peered":"2024-09-11T23:16:23.542928+0000","last_unstale":"2024-09-11T23:17:53.890078+0000","last_undegraded":"2024-09-11T23:17:53.890078+0000","last_fullsized":"2024-09-11T23:17:53.890078+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:36:36.570865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"93'12","reported_seq":56,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.884093+0000","last_change":"2024-09-11T23:16:12.461679+0000","last_active":"2024-09-11T23:17:53.884093+0000","last_peered":"2024-09-11T23:17:53.884093+0000","last_clean":"2024-09-11T23:17:53.884093+0000","last_became_active":"2024-09-11T23:16:12.461314+0000","last_became_peered":"2024-09-11T23:16:12.461314+0000","last_unstale":"2024-09-11T23:17:53.884093+0000","last_undegraded":"2024-09-11T23:17:53.884093+0000","last_fullsized":"2024-09-11T23:17:53.884093+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:01:13.352218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:54.296205+0000","last_change":"2024-09-11T23:16:15.488625+0000","last_active":"2024-09-11T23:17:54.296205+0000","last_peered":"2024-09-11T23:17:54.296205+0000","last_clean":"2024-09-11T23:17:54.296205+0000","last_became_active":"2024-09-11T23:16:15.487540+0000","last_became_peered":"2024-09-11T23:16:15.487540+0000","last_unstale":"2024-09-11T23:17:54.296205+0000","last_undegraded":"2024-09-11T23:17:54.296205+0000","last_fullsized":"2024-09-11T23:17:54.296205+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:54.962317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":26,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.890725+0000","last_change":"2024-09-11T23:16:23.544321+0000","last_active":"2024-09-11T23:17:53.890725+0000","last_peered":"2024-09-11T23:17:53.890725+0000","last_clean":"2024-09-11T23:17:53.890725+0000","last_became_active":"2024-09-11T23:16:23.543958+0000","last_became_peered":"2024-09-11T23:16:23.543958+0000","last_unstale":"2024-09-11T23:17:53.890725+0000","last_undegraded":"2024-09-11T23:17:53.890725+0000","last_fullsized":"2024-09-11T23:17:53.890725+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:40:46.510481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"93'5","reported_seq":49,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.883799+0000","last_change":"2024-09-11T23:16:12.462863+0000","last_active":"2024-09-11T23:17:53.883799+0000","last_peered":"2024-09-11T23:17:53.883799+0000","last_clean":"2024-09-11T23:17:53.883799+0000","last_became_active":"2024-09-11T23:16:12.462484+0000","last_became_peered":"2024-09-11T23:16:12.462484+0000","last_unstale":"2024-09-11T23:17:53.883799+0000","last_undegraded":"2024-09-11T23:17:53.883799+0000","last_fullsized":"2024-09-11T23:17:53.883799+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:13:22.170427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.886578+0000","last_change":"2024-09-11T23:16:15.487956+0000","last_active":"2024-09-11T23:17:53.886578+0000","last_peered":"2024-09-11T23:17:53.886578+0000","last_clean":"2024-09-11T23:17:53.886578+0000","last_became_active":"2024-09-11T23:16:15.487364+0000","last_became_peered":"2024-09-11T23:16:15.487364+0000","last_unstale":"2024-09-11T23:17:53.886578+0000","last_undegraded":"2024-09-11T23:17:53.886578+0000","last_fullsized":"2024-09-11T23:17:53.886578+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:47:10.488221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":26,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.890785+0000","last_change":"2024-09-11T23:16:23.541655+0000","last_active":"2024-09-11T23:17:53.890785+0000","last_peered":"2024-09-11T23:17:53.890785+0000","last_clean":"2024-09-11T23:17:53.890785+0000","last_became_active":"2024-09-11T23:16:23.541266+0000","last_became_peered":"2024-09-11T23:16:23.541266+0000","last_unstale":"2024-09-11T23:17:53.890785+0000","last_undegraded":"2024-09-11T23:17:53.890785+0000","last_fullsized":"2024-09-11T23:17:53.890785+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:09.497594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.883733+0000","last_change":"2024-09-11T23:16:15.489507+0000","last_active":"2024-09-11T23:17:53.883733+0000","last_peered":"2024-09-11T23:17:53.883733+0000","last_clean":"2024-09-11T23:17:53.883733+0000","last_became_active":"2024-09-11T23:16:15.489188+0000","last_became_peered":"2024-09-11T23:16:15.489188+0000","last_unstale":"2024-09-11T23:17:53.883733+0000","last_undegraded":"2024-09-11T23:17:53.883733+0000","last_fullsized":"2024-09-11T23:17:53.883733+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:07.530192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"93'4","reported_seq":48,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.883306+0000","last_change":"2024-09-11T23:16:12.465473+0000","last_active":"2024-09-11T23:17:53.883306+0000","last_peered":"2024-09-11T23:17:53.883306+0000","last_clean":"2024-09-11T23:17:53.883306+0000","last_became_active":"2024-09-11T23:16:12.465096+0000","last_became_peered":"2024-09-11T23:16:12.465096+0000","last_unstale":"2024-09-11T23:17:53.883306+0000","last_undegraded":"2024-09-11T23:17:53.883306+0000","last_fullsized":"2024-09-11T23:17:53.883306+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:27:22.739927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":26,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.890340+0000","last_change":"2024-09-11T23:16:23.555649+0000","last_active":"2024-09-11T23:17:53.890340+0000","last_peered":"2024-09-11T23:17:53.890340+0000","last_clean":"2024-09-11T23:17:53.890340+0000","last_became_active":"2024-09-11T23:16:23.555243+0000","last_became_peered":"2024-09-11T23:16:23.555243+0000","last_unstale":"2024-09-11T23:17:53.890340+0000","last_undegraded":"2024-09-11T23:17:53.890340+0000","last_fullsized":"2024-09-11T23:17:53.890340+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:07.514479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.885001+0000","last_change":"2024-09-11T23:16:15.490203+0000","last_active":"2024-09-11T23:17:53.885001+0000","last_peered":"2024-09-11T23:17:53.885001+0000","last_clean":"2024-09-11T23:17:53.885001+0000","last_became_active":"2024-09-11T23:16:15.489904+0000","last_became_peered":"2024-09-11T23:16:15.489904+0000","last_unstale":"2024-09-11T23:17:53.885001+0000","last_undegraded":"2024-09-11T23:17:53.885001+0000","last_fullsized":"2024-09-11T23:17:53.885001+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:20.291284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"93'3","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.885984+0000","last_change":"2024-09-11T23:16:12.465147+0000","last_active":"2024-09-11T23:17:53.885984+0000","last_peered":"2024-09-11T23:17:53.885984+0000","last_clean":"2024-09-11T23:17:53.885984+0000","last_became_active":"2024-09-11T23:16:12.464392+0000","last_became_peered":"2024-09-11T23:16:12.464392+0000","last_unstale":"2024-09-11T23:17:53.885984+0000","last_undegraded":"2024-09-11T23:17:53.885984+0000","last_fullsized":"2024-09-11T23:17:53.885984+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:21.515546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"93'1","reported_seq":27,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.890344+0000","last_change":"2024-09-11T23:16:23.535965+0000","last_active":"2024-09-11T23:17:53.890344+0000","last_peered":"2024-09-11T23:17:53.890344+0000","last_clean":"2024-09-11T23:17:53.890344+0000","last_became_active":"2024-09-11T23:16:23.535518+0000","last_became_peered":"2024-09-11T23:16:23.535518+0000","last_unstale":"2024-09-11T23:17:53.890344+0000","last_undegraded":"2024-09-11T23:17:53.890344+0000","last_fullsized":"2024-09-11T23:17:53.890344+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:37.406312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.886706+0000","last_change":"2024-09-11T23:16:15.489499+0000","last_active":"2024-09-11T23:17:53.886706+0000","last_peered":"2024-09-11T23:17:53.886706+0000","last_clean":"2024-09-11T23:17:53.886706+0000","last_became_active":"2024-09-11T23:16:15.489190+0000","last_became_peered":"2024-09-11T23:16:15.489190+0000","last_unstale":"2024-09-11T23:17:53.886706+0000","last_undegraded":"2024-09-11T23:17:53.886706+0000","last_fullsized":"2024-09-11T23:17:53.886706+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:01.845410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"93'7","reported_seq":49,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.885355+0000","last_change":"2024-09-11T23:16:12.461054+0000","last_active":"2024-09-11T23:17:53.885355+0000","last_peered":"2024-09-11T23:17:53.885355+0000","last_clean":"2024-09-11T23:17:53.885355+0000","last_became_active":"2024-09-11T23:16:12.460748+0000","last_became_peered":"2024-09-11T23:16:12.460748+0000","last_unstale":"2024-09-11T23:17:53.885355+0000","last_undegraded":"2024-09-11T23:17:53.885355+0000","last_fullsized":"2024-09-11T23:17:53.885355+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:35.710437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.887646+0000","last_change":"2024-09-11T23:16:23.543637+0000","last_active":"2024-09-11T23:17:53.887646+0000","last_peered":"2024-09-11T23:17:53.887646+0000","last_clean":"2024-09-11T23:17:53.887646+0000","last_became_active":"2024-09-11T23:16:23.542807+0000","last_became_peered":"2024-09-11T23:16:23.542807+0000","last_unstale":"2024-09-11T23:17:53.887646+0000","last_undegraded":"2024-09-11T23:17:53.887646+0000","last_fullsized":"2024-09-11T23:17:53.887646+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:08.559858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.883137+0000","last_change":"2024-09-11T23:16:15.485660+0000","last_active":"2024-09-11T23:17:53.883137+0000","last_peered":"2024-09-11T23:17:53.883137+0000","last_clean":"2024-09-11T23:17:53.883137+0000","last_became_active":"2024-09-11T23:16:15.485283+0000","last_became_peered":"2024-09-11T23:16:15.485283+0000","last_unstale":"2024-09-11T23:17:53.883137+0000","last_undegraded":"2024-09-11T23:17:53.883137+0000","last_fullsized":"2024-09-11T23:17:53.883137+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:20.105534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"93'2","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:54.296356+0000","last_change":"2024-09-11T23:16:12.633115+0000","last_active":"2024-09-11T23:17:54.296356+0000","last_peered":"2024-09-11T23:17:54.296356+0000","last_clean":"2024-09-11T23:17:54.296356+0000","last_became_active":"2024-09-11T23:16:12.632850+0000","last_became_peered":"2024-09-11T23:16:12.632850+0000","last_unstale":"2024-09-11T23:17:54.296356+0000","last_undegraded":"2024-09-11T23:17:54.296356+0000","last_fullsized":"2024-09-11T23:17:54.296356+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:16.709154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":26,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.890474+0000","last_change":"2024-09-11T23:16:23.556054+0000","last_active":"2024-09-11T23:17:53.890474+0000","last_peered":"2024-09-11T23:17:53.890474+0000","last_clean":"2024-09-11T23:17:53.890474+0000","last_became_active":"2024-09-11T23:16:23.555640+0000","last_became_peered":"2024-09-11T23:16:23.555640+0000","last_unstale":"2024-09-11T23:17:53.890474+0000","last_undegraded":"2024-09-11T23:17:53.890474+0000","last_fullsized":"2024-09-11T23:17:53.890474+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:23:32.360435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.887433+0000","last_change":"2024-09-11T23:16:53.677327+0000","last_active":"2024-09-11T23:17:53.887433+0000","last_peered":"2024-09-11T23:17:53.887433+0000","last_clean":"2024-09-11T23:17:53.887433+0000","last_became_active":"2024-09-11T23:16:53.677002+0000","last_became_peered":"2024-09-11T23:16:53.677002+0000","last_unstale":"2024-09-11T23:17:53.887433+0000","last_undegraded":"2024-09-11T23:17:53.887433+0000","last_fullsized":"2024-09-11T23:17:53.887433+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:22:48.495448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"93'7","reported_seq":49,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.891096+0000","last_change":"2024-09-11T23:16:13.161384+0000","last_active":"2024-09-11T23:17:53.891096+0000","last_peered":"2024-09-11T23:17:53.891096+0000","last_clean":"2024-09-11T23:17:53.891096+0000","last_became_active":"2024-09-11T23:16:13.161001+0000","last_became_peered":"2024-09-11T23:16:13.161001+0000","last_unstale":"2024-09-11T23:17:53.891096+0000","last_undegraded":"2024-09-11T23:17:53.891096+0000","last_fullsized":"2024-09-11T23:17:53.891096+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:17.421851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.885858+0000","last_change":"2024-09-11T23:16:23.539741+0000","last_active":"2024-09-11T23:17:53.885858+0000","last_peered":"2024-09-11T23:17:53.885858+0000","last_clean":"2024-09-11T23:17:53.885858+0000","last_became_active":"2024-09-11T23:16:23.539340+0000","last_became_peered":"2024-09-11T23:16:23.539340+0000","last_unstale":"2024-09-11T23:17:53.885858+0000","last_undegraded":"2024-09-11T23:17:53.885858+0000","last_fullsized":"2024-09-11T23:17:53.885858+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:22:41.272385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.885519+0000","last_change":"2024-09-11T23:16:15.483285+0000","last_active":"2024-09-11T23:17:53.885519+0000","last_peered":"2024-09-11T23:17:53.885519+0000","last_clean":"2024-09-11T23:17:53.885519+0000","last_became_active":"2024-09-11T23:16:15.482883+0000","last_became_peered":"2024-09-11T23:16:15.482883+0000","last_unstale":"2024-09-11T23:17:53.885519+0000","last_undegraded":"2024-09-11T23:17:53.885519+0000","last_fullsized":"2024-09-11T23:17:53.885519+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:49.979519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"93'14","reported_seq":57,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.889338+0000","last_change":"2024-09-11T23:16:12.460660+0000","last_active":"2024-09-11T23:17:53.889338+0000","last_peered":"2024-09-11T23:17:53.889338+0000","last_clean":"2024-09-11T23:17:53.889338+0000","last_became_active":"2024-09-11T23:16:12.460231+0000","last_became_peered":"2024-09-11T23:16:12.460231+0000","last_unstale":"2024-09-11T23:17:53.889338+0000","last_undegraded":"2024-09-11T23:17:53.889338+0000","last_fullsized":"2024-09-11T23:17:53.889338+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:21.839388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.884610+0000","last_change":"2024-09-11T23:16:23.556322+0000","last_active":"2024-09-11T23:17:53.884610+0000","last_peered":"2024-09-11T23:17:53.884610+0000","last_clean":"2024-09-11T23:17:53.884610+0000","last_became_active":"2024-09-11T23:16:23.555141+0000","last_became_peered":"2024-09-11T23:16:23.555141+0000","last_unstale":"2024-09-11T23:17:53.884610+0000","last_undegraded":"2024-09-11T23:17:53.884610+0000","last_fullsized":"2024-09-11T23:17:53.884610+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:55.778708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.890340+0000","last_change":"2024-09-11T23:16:15.490482+0000","last_active":"2024-09-11T23:17:53.890340+0000","last_peered":"2024-09-11T23:17:53.890340+0000","last_clean":"2024-09-11T23:17:53.890340+0000","last_became_active":"2024-09-11T23:16:15.490160+0000","last_became_peered":"2024-09-11T23:16:15.490160+0000","last_unstale":"2024-09-11T23:17:53.890340+0000","last_undegraded":"2024-09-11T23:17:53.890340+0000","last_fullsized":"2024-09-11T23:17:53.890340+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:58:40.588941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"93'4","reported_seq":48,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.884106+0000","last_change":"2024-09-11T23:16:12.634120+0000","last_active":"2024-09-11T23:17:53.884106+0000","last_peered":"2024-09-11T23:17:53.884106+0000","last_clean":"2024-09-11T23:17:53.884106+0000","last_became_active":"2024-09-11T23:16:12.633691+0000","last_became_peered":"2024-09-11T23:16:12.633691+0000","last_unstale":"2024-09-11T23:17:53.884106+0000","last_undegraded":"2024-09-11T23:17:53.884106+0000","last_fullsized":"2024-09-11T23:17:53.884106+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:21.577310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.888371+0000","last_change":"2024-09-11T23:16:23.545820+0000","last_active":"2024-09-11T23:17:53.888371+0000","last_peered":"2024-09-11T23:17:53.888371+0000","last_clean":"2024-09-11T23:17:53.888371+0000","last_became_active":"2024-09-11T23:16:23.545303+0000","last_became_peered":"2024-09-11T23:16:23.545303+0000","last_unstale":"2024-09-11T23:17:53.888371+0000","last_undegraded":"2024-09-11T23:17:53.888371+0000","last_fullsized":"2024-09-11T23:17:53.888371+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:52:28.969393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:54.296085+0000","last_change":"2024-09-11T23:16:15.497083+0000","last_active":"2024-09-11T23:17:54.296085+0000","last_peered":"2024-09-11T23:17:54.296085+0000","last_clean":"2024-09-11T23:17:54.296085+0000","last_became_active":"2024-09-11T23:16:15.496777+0000","last_became_peered":"2024-09-11T23:16:15.496777+0000","last_unstale":"2024-09-11T23:17:54.296085+0000","last_undegraded":"2024-09-11T23:17:54.296085+0000","last_fullsized":"2024-09-11T23:17:54.296085+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:14.456290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"93'1","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.888455+0000","last_change":"2024-09-11T23:16:12.633452+0000","last_active":"2024-09-11T23:17:53.888455+0000","last_peered":"2024-09-11T23:17:53.888455+0000","last_clean":"2024-09-11T23:17:53.888455+0000","last_became_active":"2024-09-11T23:16:12.633127+0000","last_became_peered":"2024-09-11T23:16:12.633127+0000","last_unstale":"2024-09-11T23:17:53.888455+0000","last_undegraded":"2024-09-11T23:17:53.888455+0000","last_fullsized":"2024-09-11T23:17:53.888455+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:37:07.269809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.883151+0000","last_change":"2024-09-11T23:16:23.555590+0000","last_active":"2024-09-11T23:17:53.883151+0000","last_peered":"2024-09-11T23:17:53.883151+0000","last_clean":"2024-09-11T23:17:53.883151+0000","last_became_active":"2024-09-11T23:16:23.555194+0000","last_became_peered":"2024-09-11T23:16:23.555194+0000","last_unstale":"2024-09-11T23:17:53.883151+0000","last_undegraded":"2024-09-11T23:17:53.883151+0000","last_fullsized":"2024-09-11T23:17:53.883151+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:36:50.069355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:54.295719+0000","last_change":"2024-09-11T23:16:15.498764+0000","last_active":"2024-09-11T23:17:54.295719+0000","last_peered":"2024-09-11T23:17:54.295719+0000","last_clean":"2024-09-11T23:17:54.295719+0000","last_became_active":"2024-09-11T23:16:15.498430+0000","last_became_peered":"2024-09-11T23:16:15.498430+0000","last_unstale":"2024-09-11T23:17:54.295719+0000","last_undegraded":"2024-09-11T23:17:54.295719+0000","last_fullsized":"2024-09-11T23:17:54.295719+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:28:44.899651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"93'6","reported_seq":106,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:57.899327+0000","last_change":"2024-09-11T23:16:12.456701+0000","last_active":"2024-09-11T23:17:57.899327+0000","last_peered":"2024-09-11T23:17:57.899327+0000","last_clean":"2024-09-11T23:17:57.899327+0000","last_became_active":"2024-09-11T23:16:12.456231+0000","last_became_peered":"2024-09-11T23:16:12.456231+0000","last_unstale":"2024-09-11T23:17:57.899327+0000","last_undegraded":"2024-09-11T23:17:57.899327+0000","last_fullsized":"2024-09-11T23:17:57.899327+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:02.372204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":58,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.890090+0000","last_change":"2024-09-11T23:16:23.550929+0000","last_active":"2024-09-11T23:17:53.890090+0000","last_peered":"2024-09-11T23:17:53.890090+0000","last_clean":"2024-09-11T23:17:53.890090+0000","last_became_active":"2024-09-11T23:16:23.550509+0000","last_became_peered":"2024-09-11T23:16:23.550509+0000","last_unstale":"2024-09-11T23:17:53.890090+0000","last_undegraded":"2024-09-11T23:17:53.890090+0000","last_fullsized":"2024-09-11T23:17:53.890090+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:53.112937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.886365+0000","last_change":"2024-09-11T23:16:53.765655+0000","last_active":"2024-09-11T23:17:53.886365+0000","last_peered":"2024-09-11T23:17:53.886365+0000","last_clean":"2024-09-11T23:17:53.886365+0000","last_became_active":"2024-09-11T23:16:53.765189+0000","last_became_peered":"2024-09-11T23:16:53.765189+0000","last_unstale":"2024-09-11T23:17:53.886365+0000","last_undegraded":"2024-09-11T23:17:53.886365+0000","last_fullsized":"2024-09-11T23:17:53.886365+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:13.142041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"93'5","reported_seq":106,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:57.823963+0000","last_change":"2024-09-11T23:16:12.633522+0000","last_active":"2024-09-11T23:17:57.823963+0000","last_peered":"2024-09-11T23:17:57.823963+0000","last_clean":"2024-09-11T23:17:57.823963+0000","last_became_active":"2024-09-11T23:16:12.633207+0000","last_became_peered":"2024-09-11T23:16:12.633207+0000","last_unstale":"2024-09-11T23:17:57.823963+0000","last_undegraded":"2024-09-11T23:17:57.823963+0000","last_fullsized":"2024-09-11T23:17:57.823963+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:08:29.565404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":57,"num_read_kb":57,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.890396+0000","last_change":"2024-09-11T23:16:23.557033+0000","last_active":"2024-09-11T23:17:53.890396+0000","last_peered":"2024-09-11T23:17:53.890396+0000","last_clean":"2024-09-11T23:17:53.890396+0000","last_became_active":"2024-09-11T23:16:23.555146+0000","last_became_peered":"2024-09-11T23:16:23.555146+0000","last_unstale":"2024-09-11T23:17:53.890396+0000","last_undegraded":"2024-09-11T23:17:53.890396+0000","last_fullsized":"2024-09-11T23:17:53.890396+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:22.460593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.889163+0000","last_change":"2024-09-11T23:16:15.487594+0000","last_active":"2024-09-11T23:17:53.889163+0000","last_peered":"2024-09-11T23:17:53.889163+0000","last_clean":"2024-09-11T23:17:53.889163+0000","last_became_active":"2024-09-11T23:16:15.487299+0000","last_became_peered":"2024-09-11T23:16:15.487299+0000","last_unstale":"2024-09-11T23:17:53.889163+0000","last_undegraded":"2024-09-11T23:17:53.889163+0000","last_fullsized":"2024-09-11T23:17:53.889163+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:32.531617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"93'4","reported_seq":46,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.883494+0000","last_change":"2024-09-11T23:16:12.464175+0000","last_active":"2024-09-11T23:17:53.883494+0000","last_peered":"2024-09-11T23:17:53.883494+0000","last_clean":"2024-09-11T23:17:53.883494+0000","last_became_active":"2024-09-11T23:16:12.463700+0000","last_became_peered":"2024-09-11T23:16:12.463700+0000","last_unstale":"2024-09-11T23:17:53.883494+0000","last_undegraded":"2024-09-11T23:17:53.883494+0000","last_fullsized":"2024-09-11T23:17:53.883494+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:35.784469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.887501+0000","last_change":"2024-09-11T23:16:23.555436+0000","last_active":"2024-09-11T23:17:53.887501+0000","last_peered":"2024-09-11T23:17:53.887501+0000","last_clean":"2024-09-11T23:17:53.887501+0000","last_became_active":"2024-09-11T23:16:23.555003+0000","last_became_peered":"2024-09-11T23:16:23.555003+0000","last_unstale":"2024-09-11T23:17:53.887501+0000","last_undegraded":"2024-09-11T23:17:53.887501+0000","last_fullsized":"2024-09-11T23:17:53.887501+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:39:18.810730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.888397+0000","last_change":"2024-09-11T23:16:53.674972+0000","last_active":"2024-09-11T23:17:53.888397+0000","last_peered":"2024-09-11T23:17:53.888397+0000","last_clean":"2024-09-11T23:17:53.888397+0000","last_became_active":"2024-09-11T23:16:53.674116+0000","last_became_peered":"2024-09-11T23:16:53.674116+0000","last_unstale":"2024-09-11T23:17:53.888397+0000","last_undegraded":"2024-09-11T23:17:53.888397+0000","last_fullsized":"2024-09-11T23:17:53.888397+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:03:32.615819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.3","version":"93'6","reported_seq":50,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.890864+0000","last_change":"2024-09-11T23:16:12.459491+0000","last_active":"2024-09-11T23:17:53.890864+0000","last_peered":"2024-09-11T23:17:53.890864+0000","last_clean":"2024-09-11T23:17:53.890864+0000","last_became_active":"2024-09-11T23:16:12.459106+0000","last_became_peered":"2024-09-11T23:16:12.459106+0000","last_unstale":"2024-09-11T23:17:53.890864+0000","last_undegraded":"2024-09-11T23:17:53.890864+0000","last_fullsized":"2024-09-11T23:17:53.890864+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:21.797304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":356,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.883626+0000","last_change":"2024-09-11T23:14:54.165458+0000","last_active":"2024-09-11T23:17:53.883626+0000","last_peered":"2024-09-11T23:17:53.883626+0000","last_clean":"2024-09-11T23:17:53.883626+0000","last_became_active":"2024-09-11T23:14:54.164935+0000","last_became_peered":"2024-09-11T23:14:54.164935+0000","last_unstale":"2024-09-11T23:17:53.883626+0000","last_undegraded":"2024-09-11T23:17:53.883626+0000","last_fullsized":"2024-09-11T23:17:53.883626+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:11:16.597789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:11:16.597789+0000","last_clean_scrub_stamp":"2024-09-11T23:11:16.597789+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:19.889271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"93'1","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:54.303154+0000","last_change":"2024-09-11T23:17:54.303154+0000","last_active":"2024-09-11T23:17:54.303154+0000","last_peered":"2024-09-11T23:17:54.303154+0000","last_clean":"2024-09-11T23:17:54.303154+0000","last_became_active":"2024-09-11T23:17:54.297651+0000","last_became_peered":"2024-09-11T23:17:54.297651+0000","last_unstale":"2024-09-11T23:17:54.303154+0000","last_undegraded":"2024-09-11T23:17:54.303154+0000","last_fullsized":"2024-09-11T23:17:54.303154+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:12:13.319358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,10],"acting":[7,5,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.884318+0000","last_change":"2024-09-11T23:16:15.483724+0000","last_active":"2024-09-11T23:17:53.884318+0000","last_peered":"2024-09-11T23:17:53.884318+0000","last_clean":"2024-09-11T23:17:53.884318+0000","last_became_active":"2024-09-11T23:16:15.483371+0000","last_became_peered":"2024-09-11T23:16:15.483371+0000","last_unstale":"2024-09-11T23:17:53.884318+0000","last_undegraded":"2024-09-11T23:17:53.884318+0000","last_fullsized":"2024-09-11T23:17:53.884318+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:27:43.844805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"93'6","reported_seq":107,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:57.842844+0000","last_change":"2024-09-11T23:16:13.161358+0000","last_active":"2024-09-11T23:17:57.842844+0000","last_peered":"2024-09-11T23:17:57.842844+0000","last_clean":"2024-09-11T23:17:57.842844+0000","last_became_active":"2024-09-11T23:16:13.160856+0000","last_became_peered":"2024-09-11T23:16:13.160856+0000","last_unstale":"2024-09-11T23:17:57.842844+0000","last_undegraded":"2024-09-11T23:17:57.842844+0000","last_fullsized":"2024-09-11T23:17:57.842844+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:23:35.519588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1563,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":59,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:54.296221+0000","last_change":"2024-09-11T23:16:23.542098+0000","last_active":"2024-09-11T23:17:54.296221+0000","last_peered":"2024-09-11T23:17:54.296221+0000","last_clean":"2024-09-11T23:17:54.296221+0000","last_became_active":"2024-09-11T23:16:23.541714+0000","last_became_peered":"2024-09-11T23:16:23.541714+0000","last_unstale":"2024-09-11T23:17:54.296221+0000","last_undegraded":"2024-09-11T23:17:54.296221+0000","last_fullsized":"2024-09-11T23:17:54.296221+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:25:53.715886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.884086+0000","last_change":"2024-09-11T23:16:53.675655+0000","last_active":"2024-09-11T23:17:53.884086+0000","last_peered":"2024-09-11T23:17:53.884086+0000","last_clean":"2024-09-11T23:17:53.884086+0000","last_became_active":"2024-09-11T23:16:53.675277+0000","last_became_peered":"2024-09-11T23:16:53.675277+0000","last_unstale":"2024-09-11T23:17:53.884086+0000","last_undegraded":"2024-09-11T23:17:53.884086+0000","last_fullsized":"2024-09-11T23:17:53.884086+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:12.869820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"93'3","reported_seq":48,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.887758+0000","last_change":"2024-09-11T23:16:12.461590+0000","last_active":"2024-09-11T23:17:53.887758+0000","last_peered":"2024-09-11T23:17:53.887758+0000","last_clean":"2024-09-11T23:17:53.887758+0000","last_became_active":"2024-09-11T23:16:12.461195+0000","last_became_peered":"2024-09-11T23:16:12.461195+0000","last_unstale":"2024-09-11T23:17:53.887758+0000","last_undegraded":"2024-09-11T23:17:53.887758+0000","last_fullsized":"2024-09-11T23:17:53.887758+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:09.929080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:54.298134+0000","last_change":"2024-09-11T23:17:54.298134+0000","last_active":"2024-09-11T23:17:54.298134+0000","last_peered":"2024-09-11T23:17:54.298134+0000","last_clean":"2024-09-11T23:17:54.298134+0000","last_became_active":"2024-09-11T23:17:54.297616+0000","last_became_peered":"2024-09-11T23:17:54.297616+0000","last_unstale":"2024-09-11T23:17:54.298134+0000","last_undegraded":"2024-09-11T23:17:54.298134+0000","last_fullsized":"2024-09-11T23:17:54.298134+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:45.382256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,1,4],"acting":[0,8,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.884281+0000","last_change":"2024-09-11T23:16:15.483337+0000","last_active":"2024-09-11T23:17:53.884281+0000","last_peered":"2024-09-11T23:17:53.884281+0000","last_clean":"2024-09-11T23:17:53.884281+0000","last_became_active":"2024-09-11T23:16:15.482892+0000","last_became_peered":"2024-09-11T23:16:15.482892+0000","last_unstale":"2024-09-11T23:17:53.884281+0000","last_undegraded":"2024-09-11T23:17:53.884281+0000","last_fullsized":"2024-09-11T23:17:53.884281+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:55.584889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"93'5","reported_seq":49,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.890195+0000","last_change":"2024-09-11T23:16:12.462527+0000","last_active":"2024-09-11T23:17:53.890195+0000","last_peered":"2024-09-11T23:17:53.890195+0000","last_clean":"2024-09-11T23:17:53.890195+0000","last_became_active":"2024-09-11T23:16:12.462133+0000","last_became_peered":"2024-09-11T23:16:12.462133+0000","last_unstale":"2024-09-11T23:17:53.890195+0000","last_undegraded":"2024-09-11T23:17:53.890195+0000","last_fullsized":"2024-09-11T23:17:53.890195+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:43.745587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.886088+0000","last_change":"2024-09-11T23:16:23.539430+0000","last_active":"2024-09-11T23:17:53.886088+0000","last_peered":"2024-09-11T23:17:53.886088+0000","last_clean":"2024-09-11T23:17:53.886088+0000","last_became_active":"2024-09-11T23:16:23.538995+0000","last_became_peered":"2024-09-11T23:16:23.538995+0000","last_unstale":"2024-09-11T23:17:53.886088+0000","last_undegraded":"2024-09-11T23:17:53.886088+0000","last_fullsized":"2024-09-11T23:17:53.886088+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:00:38.176669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.886814+0000","last_change":"2024-09-11T23:16:15.487497+0000","last_active":"2024-09-11T23:17:53.886814+0000","last_peered":"2024-09-11T23:17:53.886814+0000","last_clean":"2024-09-11T23:17:53.886814+0000","last_became_active":"2024-09-11T23:16:15.487180+0000","last_became_peered":"2024-09-11T23:16:15.487180+0000","last_unstale":"2024-09-11T23:17:53.886814+0000","last_undegraded":"2024-09-11T23:17:53.886814+0000","last_fullsized":"2024-09-11T23:17:53.886814+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:51.400029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"93'2","reported_seq":17,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.897261+0000","last_change":"2024-09-11T23:17:53.897261+0000","last_active":"2024-09-11T23:17:53.897261+0000","last_peered":"2024-09-11T23:17:53.897261+0000","last_clean":"2024-09-11T23:17:53.897261+0000","last_became_active":"2024-09-11T23:17:53.893347+0000","last_became_peered":"2024-09-11T23:17:53.893347+0000","last_unstale":"2024-09-11T23:17:53.897261+0000","last_undegraded":"2024-09-11T23:17:53.897261+0000","last_fullsized":"2024-09-11T23:17:53.897261+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:59:47.756415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.886548+0000","last_change":"2024-09-11T23:16:23.549141+0000","last_active":"2024-09-11T23:17:53.886548+0000","last_peered":"2024-09-11T23:17:53.886548+0000","last_clean":"2024-09-11T23:17:53.886548+0000","last_became_active":"2024-09-11T23:16:23.548731+0000","last_became_peered":"2024-09-11T23:16:23.548731+0000","last_unstale":"2024-09-11T23:17:53.886548+0000","last_undegraded":"2024-09-11T23:17:53.886548+0000","last_fullsized":"2024-09-11T23:17:53.886548+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:26.781082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.886762+0000","last_change":"2024-09-11T23:16:15.483597+0000","last_active":"2024-09-11T23:17:53.886762+0000","last_peered":"2024-09-11T23:17:53.886762+0000","last_clean":"2024-09-11T23:17:53.886762+0000","last_became_active":"2024-09-11T23:16:15.483192+0000","last_became_peered":"2024-09-11T23:16:15.483192+0000","last_unstale":"2024-09-11T23:17:53.886762+0000","last_undegraded":"2024-09-11T23:17:53.886762+0000","last_fullsized":"2024-09-11T23:17:53.886762+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:33.690922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"93'17","reported_seq":85,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:54.310036+0000","last_change":"2024-09-11T23:17:54.310036+0000","last_active":"2024-09-11T23:17:54.310036+0000","last_peered":"2024-09-11T23:17:54.310036+0000","last_clean":"2024-09-11T23:17:54.310036+0000","last_became_active":"2024-09-11T23:17:54.297497+0000","last_became_peered":"2024-09-11T23:17:54.297497+0000","last_unstale":"2024-09-11T23:17:54.310036+0000","last_undegraded":"2024-09-11T23:17:54.310036+0000","last_fullsized":"2024-09-11T23:17:54.310036+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:02.074117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,1],"acting":[8,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.892280+0000","last_change":"2024-09-11T23:17:53.892280+0000","last_active":"2024-09-11T23:17:53.892280+0000","last_peered":"2024-09-11T23:17:53.892280+0000","last_clean":"2024-09-11T23:17:53.892280+0000","last_became_active":"2024-09-11T23:17:53.891781+0000","last_became_peered":"2024-09-11T23:17:53.891781+0000","last_unstale":"2024-09-11T23:17:53.892280+0000","last_undegraded":"2024-09-11T23:17:53.892280+0000","last_fullsized":"2024-09-11T23:17:53.892280+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:15.510526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,8,11],"acting":[6,3,8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.883455+0000","last_change":"2024-09-11T23:16:15.488379+0000","last_active":"2024-09-11T23:17:53.883455+0000","last_peered":"2024-09-11T23:17:53.883455+0000","last_clean":"2024-09-11T23:17:53.883455+0000","last_became_active":"2024-09-11T23:16:15.488057+0000","last_became_peered":"2024-09-11T23:16:15.488057+0000","last_unstale":"2024-09-11T23:17:53.883455+0000","last_undegraded":"2024-09-11T23:17:53.883455+0000","last_fullsized":"2024-09-11T23:17:53.883455+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:49:05.609717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"93'6","reported_seq":110,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:18:01.829899+0000","last_change":"2024-09-11T23:16:12.455466+0000","last_active":"2024-09-11T23:18:01.829899+0000","last_peered":"2024-09-11T23:18:01.829899+0000","last_clean":"2024-09-11T23:18:01.829899+0000","last_became_active":"2024-09-11T23:16:12.455149+0000","last_became_peered":"2024-09-11T23:16:12.455149+0000","last_unstale":"2024-09-11T23:18:01.829899+0000","last_undegraded":"2024-09-11T23:18:01.829899+0000","last_fullsized":"2024-09-11T23:18:01.829899+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:27.642229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":64,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.887768+0000","last_change":"2024-09-11T23:16:23.549435+0000","last_active":"2024-09-11T23:17:53.887768+0000","last_peered":"2024-09-11T23:17:53.887768+0000","last_clean":"2024-09-11T23:17:53.887768+0000","last_became_active":"2024-09-11T23:16:23.548974+0000","last_became_peered":"2024-09-11T23:16:23.548974+0000","last_unstale":"2024-09-11T23:17:53.887768+0000","last_undegraded":"2024-09-11T23:17:53.887768+0000","last_fullsized":"2024-09-11T23:17:53.887768+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:16.252974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.883822+0000","last_change":"2024-09-11T23:16:15.486521+0000","last_active":"2024-09-11T23:17:53.883822+0000","last_peered":"2024-09-11T23:17:53.883822+0000","last_clean":"2024-09-11T23:17:53.883822+0000","last_became_active":"2024-09-11T23:16:15.486206+0000","last_became_peered":"2024-09-11T23:16:15.486206+0000","last_unstale":"2024-09-11T23:17:53.883822+0000","last_undegraded":"2024-09-11T23:17:53.883822+0000","last_fullsized":"2024-09-11T23:17:53.883822+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:18.814215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"93'5","reported_seq":50,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.887081+0000","last_change":"2024-09-11T23:16:12.461530+0000","last_active":"2024-09-11T23:17:53.887081+0000","last_peered":"2024-09-11T23:17:53.887081+0000","last_clean":"2024-09-11T23:17:53.887081+0000","last_became_active":"2024-09-11T23:16:12.460059+0000","last_became_peered":"2024-09-11T23:16:12.460059+0000","last_unstale":"2024-09-11T23:17:53.887081+0000","last_undegraded":"2024-09-11T23:17:53.887081+0000","last_fullsized":"2024-09-11T23:17:53.887081+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:03.797156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.886733+0000","last_change":"2024-09-11T23:16:23.545969+0000","last_active":"2024-09-11T23:17:53.886733+0000","last_peered":"2024-09-11T23:17:53.886733+0000","last_clean":"2024-09-11T23:17:53.886733+0000","last_became_active":"2024-09-11T23:16:23.545458+0000","last_became_peered":"2024-09-11T23:16:23.545458+0000","last_unstale":"2024-09-11T23:17:53.886733+0000","last_undegraded":"2024-09-11T23:17:53.886733+0000","last_fullsized":"2024-09-11T23:17:53.886733+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:46.438353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.889656+0000","last_change":"2024-09-11T23:16:15.480940+0000","last_active":"2024-09-11T23:17:53.889656+0000","last_peered":"2024-09-11T23:17:53.889656+0000","last_clean":"2024-09-11T23:17:53.889656+0000","last_became_active":"2024-09-11T23:16:15.480549+0000","last_became_peered":"2024-09-11T23:16:15.480549+0000","last_unstale":"2024-09-11T23:17:53.889656+0000","last_undegraded":"2024-09-11T23:17:53.889656+0000","last_fullsized":"2024-09-11T23:17:53.889656+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:21:47.576800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"93'9","reported_seq":53,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.886792+0000","last_change":"2024-09-11T23:16:12.464871+0000","last_active":"2024-09-11T23:17:53.886792+0000","last_peered":"2024-09-11T23:17:53.886792+0000","last_clean":"2024-09-11T23:17:53.886792+0000","last_became_active":"2024-09-11T23:16:12.464364+0000","last_became_peered":"2024-09-11T23:16:12.464364+0000","last_unstale":"2024-09-11T23:17:53.886792+0000","last_undegraded":"2024-09-11T23:17:53.886792+0000","last_fullsized":"2024-09-11T23:17:53.886792+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:48:51.131314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.886465+0000","last_change":"2024-09-11T23:16:23.542318+0000","last_active":"2024-09-11T23:17:53.886465+0000","last_peered":"2024-09-11T23:17:53.886465+0000","last_clean":"2024-09-11T23:17:53.886465+0000","last_became_active":"2024-09-11T23:16:23.541873+0000","last_became_peered":"2024-09-11T23:16:23.541873+0000","last_unstale":"2024-09-11T23:17:53.886465+0000","last_undegraded":"2024-09-11T23:17:53.886465+0000","last_fullsized":"2024-09-11T23:17:53.886465+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:25.287539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.883946+0000","last_change":"2024-09-11T23:16:15.479692+0000","last_active":"2024-09-11T23:17:53.883946+0000","last_peered":"2024-09-11T23:17:53.883946+0000","last_clean":"2024-09-11T23:17:53.883946+0000","last_became_active":"2024-09-11T23:16:15.479370+0000","last_became_peered":"2024-09-11T23:16:15.479370+0000","last_unstale":"2024-09-11T23:17:53.883946+0000","last_undegraded":"2024-09-11T23:17:53.883946+0000","last_fullsized":"2024-09-11T23:17:53.883946+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:09.051394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"93'34","reported_seq":200,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.827793+0000","last_change":"2024-09-11T23:16:12.463137+0000","last_active":"2024-09-11T23:18:00.827793+0000","last_peered":"2024-09-11T23:18:00.827793+0000","last_clean":"2024-09-11T23:18:00.827793+0000","last_became_active":"2024-09-11T23:16:12.462795+0000","last_became_peered":"2024-09-11T23:16:12.462795+0000","last_unstale":"2024-09-11T23:18:00.827793+0000","last_undegraded":"2024-09-11T23:18:00.827793+0000","last_fullsized":"2024-09-11T23:18:00.827793+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:18.607151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63511,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":123,"num_read_kb":123,"num_write":36,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.888717+0000","last_change":"2024-09-11T23:16:23.540727+0000","last_active":"2024-09-11T23:17:53.888717+0000","last_peered":"2024-09-11T23:17:53.888717+0000","last_clean":"2024-09-11T23:17:53.888717+0000","last_became_active":"2024-09-11T23:16:23.537903+0000","last_became_peered":"2024-09-11T23:16:23.537903+0000","last_unstale":"2024-09-11T23:17:53.888717+0000","last_undegraded":"2024-09-11T23:17:53.888717+0000","last_fullsized":"2024-09-11T23:17:53.888717+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:25.357375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:54.296316+0000","last_change":"2024-09-11T23:16:53.673255+0000","last_active":"2024-09-11T23:17:54.296316+0000","last_peered":"2024-09-11T23:17:54.296316+0000","last_clean":"2024-09-11T23:17:54.296316+0000","last_became_active":"2024-09-11T23:16:53.672779+0000","last_became_peered":"2024-09-11T23:16:53.672779+0000","last_unstale":"2024-09-11T23:17:54.296316+0000","last_undegraded":"2024-09-11T23:17:54.296316+0000","last_fullsized":"2024-09-11T23:17:54.296316+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:48.377554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,7],"acting":[1,8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"93'5","reported_seq":50,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.887623+0000","last_change":"2024-09-11T23:16:12.634089+0000","last_active":"2024-09-11T23:17:53.887623+0000","last_peered":"2024-09-11T23:17:53.887623+0000","last_clean":"2024-09-11T23:17:53.887623+0000","last_became_active":"2024-09-11T23:16:12.633591+0000","last_became_peered":"2024-09-11T23:16:12.633591+0000","last_unstale":"2024-09-11T23:17:53.887623+0000","last_undegraded":"2024-09-11T23:17:53.887623+0000","last_fullsized":"2024-09-11T23:17:53.887623+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:48.647019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":26,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.890617+0000","last_change":"2024-09-11T23:16:23.539351+0000","last_active":"2024-09-11T23:17:53.890617+0000","last_peered":"2024-09-11T23:17:53.890617+0000","last_clean":"2024-09-11T23:17:53.890617+0000","last_became_active":"2024-09-11T23:16:23.538781+0000","last_became_peered":"2024-09-11T23:16:23.538781+0000","last_unstale":"2024-09-11T23:17:53.890617+0000","last_undegraded":"2024-09-11T23:17:53.890617+0000","last_fullsized":"2024-09-11T23:17:53.890617+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:11.384211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.888189+0000","last_change":"2024-09-11T23:16:53.673248+0000","last_active":"2024-09-11T23:17:53.888189+0000","last_peered":"2024-09-11T23:17:53.888189+0000","last_clean":"2024-09-11T23:17:53.888189+0000","last_became_active":"2024-09-11T23:16:53.672359+0000","last_became_peered":"2024-09-11T23:16:53.672359+0000","last_unstale":"2024-09-11T23:17:53.888189+0000","last_undegraded":"2024-09-11T23:17:53.888189+0000","last_fullsized":"2024-09-11T23:17:53.888189+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:52.841263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,5],"acting":[0,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"93'4","reported_seq":52,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.884216+0000","last_change":"2024-09-11T23:16:53.929781+0000","last_active":"2024-09-11T23:17:53.884216+0000","last_peered":"2024-09-11T23:17:53.884216+0000","last_clean":"2024-09-11T23:17:53.884216+0000","last_became_active":"2024-09-11T23:16:53.929313+0000","last_became_peered":"2024-09-11T23:16:53.929313+0000","last_unstale":"2024-09-11T23:17:53.884216+0000","last_undegraded":"2024-09-11T23:17:53.884216+0000","last_fullsized":"2024-09-11T23:17:53.884216+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:29:50.874721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.887509+0000","last_change":"2024-09-11T23:16:23.551090+0000","last_active":"2024-09-11T23:17:53.887509+0000","last_peered":"2024-09-11T23:17:53.887509+0000","last_clean":"2024-09-11T23:17:53.887509+0000","last_became_active":"2024-09-11T23:16:23.548558+0000","last_became_peered":"2024-09-11T23:16:23.548558+0000","last_unstale":"2024-09-11T23:17:53.887509+0000","last_undegraded":"2024-09-11T23:17:53.887509+0000","last_fullsized":"2024-09-11T23:17:53.887509+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:29:08.416426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:54.296485+0000","last_change":"2024-09-11T23:16:15.487741+0000","last_active":"2024-09-11T23:17:54.296485+0000","last_peered":"2024-09-11T23:17:54.296485+0000","last_clean":"2024-09-11T23:17:54.296485+0000","last_became_active":"2024-09-11T23:16:15.487410+0000","last_became_peered":"2024-09-11T23:16:15.487410+0000","last_unstale":"2024-09-11T23:17:54.296485+0000","last_undegraded":"2024-09-11T23:17:54.296485+0000","last_fullsized":"2024-09-11T23:17:54.296485+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:48:18.452521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"93'4","reported_seq":163,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.828002+0000","last_change":"2024-09-11T23:16:12.459784+0000","last_active":"2024-09-11T23:18:00.828002+0000","last_peered":"2024-09-11T23:18:00.828002+0000","last_clean":"2024-09-11T23:18:00.828002+0000","last_became_active":"2024-09-11T23:16:12.459440+0000","last_became_peered":"2024-09-11T23:16:12.459440+0000","last_unstale":"2024-09-11T23:18:00.828002+0000","last_undegraded":"2024-09-11T23:18:00.828002+0000","last_fullsized":"2024-09-11T23:18:00.828002+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:36.380446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":116,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:54.298110+0000","last_change":"2024-09-11T23:17:54.298110+0000","last_active":"2024-09-11T23:17:54.298110+0000","last_peered":"2024-09-11T23:17:54.298110+0000","last_clean":"2024-09-11T23:17:54.298110+0000","last_became_active":"2024-09-11T23:17:54.297397+0000","last_became_peered":"2024-09-11T23:17:54.297397+0000","last_unstale":"2024-09-11T23:17:54.298110+0000","last_undegraded":"2024-09-11T23:17:54.298110+0000","last_fullsized":"2024-09-11T23:17:54.298110+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:05.296303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,8],"acting":[3,7,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.886565+0000","last_change":"2024-09-11T23:16:23.547579+0000","last_active":"2024-09-11T23:17:53.886565+0000","last_peered":"2024-09-11T23:17:53.886565+0000","last_clean":"2024-09-11T23:17:53.886565+0000","last_became_active":"2024-09-11T23:16:23.547182+0000","last_became_peered":"2024-09-11T23:16:23.547182+0000","last_unstale":"2024-09-11T23:17:53.886565+0000","last_undegraded":"2024-09-11T23:17:53.886565+0000","last_fullsized":"2024-09-11T23:17:53.886565+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:29.471671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.887866+0000","last_change":"2024-09-11T23:16:15.482342+0000","last_active":"2024-09-11T23:17:53.887866+0000","last_peered":"2024-09-11T23:17:53.887866+0000","last_clean":"2024-09-11T23:17:53.887866+0000","last_became_active":"2024-09-11T23:16:15.481993+0000","last_became_peered":"2024-09-11T23:16:15.481993+0000","last_unstale":"2024-09-11T23:17:53.887866+0000","last_undegraded":"2024-09-11T23:17:53.887866+0000","last_fullsized":"2024-09-11T23:17:53.887866+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:11.432932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"93'3","reported_seq":48,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.886538+0000","last_change":"2024-09-11T23:16:12.460852+0000","last_active":"2024-09-11T23:17:53.886538+0000","last_peered":"2024-09-11T23:17:53.886538+0000","last_clean":"2024-09-11T23:17:53.886538+0000","last_became_active":"2024-09-11T23:16:12.460500+0000","last_became_peered":"2024-09-11T23:16:12.460500+0000","last_unstale":"2024-09-11T23:17:53.886538+0000","last_undegraded":"2024-09-11T23:17:53.886538+0000","last_fullsized":"2024-09-11T23:17:53.886538+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:36.996441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.888513+0000","last_change":"2024-09-11T23:16:23.548465+0000","last_active":"2024-09-11T23:17:53.888513+0000","last_peered":"2024-09-11T23:17:53.888513+0000","last_clean":"2024-09-11T23:17:53.888513+0000","last_became_active":"2024-09-11T23:16:23.548121+0000","last_became_peered":"2024-09-11T23:16:23.548121+0000","last_unstale":"2024-09-11T23:17:53.888513+0000","last_undegraded":"2024-09-11T23:17:53.888513+0000","last_fullsized":"2024-09-11T23:17:53.888513+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:32:43.950947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.884783+0000","last_change":"2024-09-11T23:16:15.482202+0000","last_active":"2024-09-11T23:17:53.884783+0000","last_peered":"2024-09-11T23:17:53.884783+0000","last_clean":"2024-09-11T23:17:53.884783+0000","last_became_active":"2024-09-11T23:16:15.481817+0000","last_became_peered":"2024-09-11T23:16:15.481817+0000","last_unstale":"2024-09-11T23:17:53.884783+0000","last_undegraded":"2024-09-11T23:17:53.884783+0000","last_fullsized":"2024-09-11T23:17:53.884783+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:30.309241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"93'3","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.889260+0000","last_change":"2024-09-11T23:16:12.460729+0000","last_active":"2024-09-11T23:17:53.889260+0000","last_peered":"2024-09-11T23:17:53.889260+0000","last_clean":"2024-09-11T23:17:53.889260+0000","last_became_active":"2024-09-11T23:16:12.460319+0000","last_became_peered":"2024-09-11T23:16:12.460319+0000","last_unstale":"2024-09-11T23:17:53.889260+0000","last_undegraded":"2024-09-11T23:17:53.889260+0000","last_fullsized":"2024-09-11T23:17:53.889260+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:45:20.901191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"93'7","reported_seq":50,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:54.295728+0000","last_change":"2024-09-11T23:16:12.455617+0000","last_active":"2024-09-11T23:17:54.295728+0000","last_peered":"2024-09-11T23:17:54.295728+0000","last_clean":"2024-09-11T23:17:54.295728+0000","last_became_active":"2024-09-11T23:16:12.455159+0000","last_became_peered":"2024-09-11T23:16:12.455159+0000","last_unstale":"2024-09-11T23:17:54.295728+0000","last_undegraded":"2024-09-11T23:17:54.295728+0000","last_fullsized":"2024-09-11T23:17:54.295728+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:04:19.956580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.887393+0000","last_change":"2024-09-11T23:16:15.496026+0000","last_active":"2024-09-11T23:17:53.887393+0000","last_peered":"2024-09-11T23:17:53.887393+0000","last_clean":"2024-09-11T23:17:53.887393+0000","last_became_active":"2024-09-11T23:16:15.495785+0000","last_became_peered":"2024-09-11T23:16:15.495785+0000","last_unstale":"2024-09-11T23:17:53.887393+0000","last_undegraded":"2024-09-11T23:17:53.887393+0000","last_fullsized":"2024-09-11T23:17:53.887393+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:11:33.613170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.885794+0000","last_change":"2024-09-11T23:16:23.545144+0000","last_active":"2024-09-11T23:17:53.885794+0000","last_peered":"2024-09-11T23:17:53.885794+0000","last_clean":"2024-09-11T23:17:53.885794+0000","last_became_active":"2024-09-11T23:16:23.544702+0000","last_became_peered":"2024-09-11T23:16:23.544702+0000","last_unstale":"2024-09-11T23:17:53.885794+0000","last_undegraded":"2024-09-11T23:17:53.885794+0000","last_fullsized":"2024-09-11T23:17:53.885794+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:35:39.155913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"93'5","reported_seq":112,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:18:02.831348+0000","last_change":"2024-09-11T23:16:12.464182+0000","last_active":"2024-09-11T23:18:02.831348+0000","last_peered":"2024-09-11T23:18:02.831348+0000","last_clean":"2024-09-11T23:18:02.831348+0000","last_became_active":"2024-09-11T23:16:12.463835+0000","last_became_peered":"2024-09-11T23:16:12.463835+0000","last_unstale":"2024-09-11T23:18:02.831348+0000","last_undegraded":"2024-09-11T23:18:02.831348+0000","last_fullsized":"2024-09-11T23:18:02.831348+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:11.433332+0000","last_clean_scrub_stamp":"2024-09-11T23:16:11.433332+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:34:51.682457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":63,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.883223+0000","last_change":"2024-09-11T23:16:53.674740+0000","last_active":"2024-09-11T23:17:53.883223+0000","last_peered":"2024-09-11T23:17:53.883223+0000","last_clean":"2024-09-11T23:17:53.883223+0000","last_became_active":"2024-09-11T23:16:53.674285+0000","last_became_peered":"2024-09-11T23:16:53.674285+0000","last_unstale":"2024-09-11T23:17:53.883223+0000","last_undegraded":"2024-09-11T23:17:53.883223+0000","last_fullsized":"2024-09-11T23:17:53.883223+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:08.762810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6],"acting":[8,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.887086+0000","last_change":"2024-09-11T23:16:23.540185+0000","last_active":"2024-09-11T23:17:53.887086+0000","last_peered":"2024-09-11T23:17:53.887086+0000","last_clean":"2024-09-11T23:17:53.887086+0000","last_became_active":"2024-09-11T23:16:23.539760+0000","last_became_peered":"2024-09-11T23:16:23.539760+0000","last_unstale":"2024-09-11T23:17:53.887086+0000","last_undegraded":"2024-09-11T23:17:53.887086+0000","last_fullsized":"2024-09-11T23:17:53.887086+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:22.513792+0000","last_clean_scrub_stamp":"2024-09-11T23:16:22.513792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:40.944999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.886585+0000","last_change":"2024-09-11T23:16:15.489240+0000","last_active":"2024-09-11T23:17:53.886585+0000","last_peered":"2024-09-11T23:17:53.886585+0000","last_clean":"2024-09-11T23:17:53.886585+0000","last_became_active":"2024-09-11T23:16:15.488878+0000","last_became_peered":"2024-09-11T23:16:15.488878+0000","last_unstale":"2024-09-11T23:17:53.886585+0000","last_undegraded":"2024-09-11T23:17:53.886585+0000","last_fullsized":"2024-09-11T23:17:53.886585+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:38.076935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.885977+0000","last_change":"2024-09-11T23:16:15.486369+0000","last_active":"2024-09-11T23:17:53.885977+0000","last_peered":"2024-09-11T23:17:53.885977+0000","last_clean":"2024-09-11T23:17:53.885977+0000","last_became_active":"2024-09-11T23:16:15.486055+0000","last_became_peered":"2024-09-11T23:16:15.486055+0000","last_unstale":"2024-09-11T23:17:53.885977+0000","last_undegraded":"2024-09-11T23:17:53.885977+0000","last_fullsized":"2024-09-11T23:17:53.885977+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:16.233578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.885857+0000","last_change":"2024-09-11T23:16:15.484981+0000","last_active":"2024-09-11T23:17:53.885857+0000","last_peered":"2024-09-11T23:17:53.885857+0000","last_clean":"2024-09-11T23:17:53.885857+0000","last_became_active":"2024-09-11T23:16:15.484640+0000","last_became_peered":"2024-09-11T23:16:15.484640+0000","last_unstale":"2024-09-11T23:17:53.885857+0000","last_undegraded":"2024-09-11T23:17:53.885857+0000","last_fullsized":"2024-09-11T23:17:53.885857+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:32.844009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.887023+0000","last_change":"2024-09-11T23:16:15.488570+0000","last_active":"2024-09-11T23:17:53.887023+0000","last_peered":"2024-09-11T23:17:53.887023+0000","last_clean":"2024-09-11T23:17:53.887023+0000","last_became_active":"2024-09-11T23:16:15.487932+0000","last_became_peered":"2024-09-11T23:16:15.487932+0000","last_unstale":"2024-09-11T23:17:53.887023+0000","last_undegraded":"2024-09-11T23:17:53.887023+0000","last_fullsized":"2024-09-11T23:17:53.887023+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:14.062864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.890249+0000","last_change":"2024-09-11T23:16:15.499493+0000","last_active":"2024-09-11T23:17:53.890249+0000","last_peered":"2024-09-11T23:17:53.890249+0000","last_clean":"2024-09-11T23:17:53.890249+0000","last_became_active":"2024-09-11T23:16:15.499150+0000","last_became_peered":"2024-09-11T23:16:15.499150+0000","last_unstale":"2024-09-11T23:17:53.890249+0000","last_undegraded":"2024-09-11T23:17:53.890249+0000","last_fullsized":"2024-09-11T23:17:53.890249+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:52.538614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.887548+0000","last_change":"2024-09-11T23:16:15.484214+0000","last_active":"2024-09-11T23:17:53.887548+0000","last_peered":"2024-09-11T23:17:53.887548+0000","last_clean":"2024-09-11T23:17:53.887548+0000","last_became_active":"2024-09-11T23:16:15.483911+0000","last_became_peered":"2024-09-11T23:16:15.483911+0000","last_unstale":"2024-09-11T23:17:53.887548+0000","last_undegraded":"2024-09-11T23:17:53.887548+0000","last_fullsized":"2024-09-11T23:17:53.887548+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:19:12.283255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.885768+0000","last_change":"2024-09-11T23:16:15.488454+0000","last_active":"2024-09-11T23:17:53.885768+0000","last_peered":"2024-09-11T23:17:53.885768+0000","last_clean":"2024-09-11T23:17:53.885768+0000","last_became_active":"2024-09-11T23:16:15.488071+0000","last_became_peered":"2024-09-11T23:16:15.488071+0000","last_unstale":"2024-09-11T23:17:53.885768+0000","last_undegraded":"2024-09-11T23:17:53.885768+0000","last_fullsized":"2024-09-11T23:17:53.885768+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:31.249057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.885419+0000","last_change":"2024-09-11T23:16:15.489743+0000","last_active":"2024-09-11T23:17:53.885419+0000","last_peered":"2024-09-11T23:17:53.885419+0000","last_clean":"2024-09-11T23:17:53.885419+0000","last_became_active":"2024-09-11T23:16:15.489411+0000","last_became_peered":"2024-09-11T23:16:15.489411+0000","last_unstale":"2024-09-11T23:17:53.885419+0000","last_undegraded":"2024-09-11T23:17:53.885419+0000","last_fullsized":"2024-09-11T23:17:53.885419+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:09.912448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.888040+0000","last_change":"2024-09-11T23:16:15.494906+0000","last_active":"2024-09-11T23:17:53.888040+0000","last_peered":"2024-09-11T23:17:53.888040+0000","last_clean":"2024-09-11T23:17:53.888040+0000","last_became_active":"2024-09-11T23:16:15.494567+0000","last_became_peered":"2024-09-11T23:16:15.494567+0000","last_unstale":"2024-09-11T23:17:53.888040+0000","last_undegraded":"2024-09-11T23:17:53.888040+0000","last_fullsized":"2024-09-11T23:17:53.888040+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:22.364551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.885151+0000","last_change":"2024-09-11T23:16:15.489363+0000","last_active":"2024-09-11T23:17:53.885151+0000","last_peered":"2024-09-11T23:17:53.885151+0000","last_clean":"2024-09-11T23:17:53.885151+0000","last_became_active":"2024-09-11T23:16:15.489056+0000","last_became_peered":"2024-09-11T23:16:15.489056+0000","last_unstale":"2024-09-11T23:17:53.885151+0000","last_undegraded":"2024-09-11T23:17:53.885151+0000","last_fullsized":"2024-09-11T23:17:53.885151+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:37:37.152715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:54.296879+0000","last_change":"2024-09-11T23:16:15.483283+0000","last_active":"2024-09-11T23:17:54.296879+0000","last_peered":"2024-09-11T23:17:54.296879+0000","last_clean":"2024-09-11T23:17:54.296879+0000","last_became_active":"2024-09-11T23:16:15.481463+0000","last_became_peered":"2024-09-11T23:16:15.481463+0000","last_unstale":"2024-09-11T23:17:54.296879+0000","last_undegraded":"2024-09-11T23:17:54.296879+0000","last_fullsized":"2024-09-11T23:17:54.296879+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:37.484644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.890381+0000","last_change":"2024-09-11T23:16:15.487478+0000","last_active":"2024-09-11T23:17:53.890381+0000","last_peered":"2024-09-11T23:17:53.890381+0000","last_clean":"2024-09-11T23:17:53.890381+0000","last_became_active":"2024-09-11T23:16:15.487115+0000","last_became_peered":"2024-09-11T23:16:15.487115+0000","last_unstale":"2024-09-11T23:17:53.890381+0000","last_undegraded":"2024-09-11T23:17:53.890381+0000","last_fullsized":"2024-09-11T23:17:53.890381+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:34.967388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.886854+0000","last_change":"2024-09-11T23:16:15.486593+0000","last_active":"2024-09-11T23:17:53.886854+0000","last_peered":"2024-09-11T23:17:53.886854+0000","last_clean":"2024-09-11T23:17:53.886854+0000","last_became_active":"2024-09-11T23:16:15.486282+0000","last_became_peered":"2024-09-11T23:16:15.486282+0000","last_unstale":"2024-09-11T23:17:53.886854+0000","last_undegraded":"2024-09-11T23:17:53.886854+0000","last_fullsized":"2024-09-11T23:17:53.886854+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:33.845679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.887259+0000","last_change":"2024-09-11T23:16:15.488330+0000","last_active":"2024-09-11T23:17:53.887259+0000","last_peered":"2024-09-11T23:17:53.887259+0000","last_clean":"2024-09-11T23:17:53.887259+0000","last_became_active":"2024-09-11T23:16:15.488005+0000","last_became_peered":"2024-09-11T23:16:15.488005+0000","last_unstale":"2024-09-11T23:17:53.887259+0000","last_undegraded":"2024-09-11T23:17:53.887259+0000","last_fullsized":"2024-09-11T23:17:53.887259+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:12.189988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.889244+0000","last_change":"2024-09-11T23:16:15.486251+0000","last_active":"2024-09-11T23:17:53.889244+0000","last_peered":"2024-09-11T23:17:53.889244+0000","last_clean":"2024-09-11T23:17:53.889244+0000","last_became_active":"2024-09-11T23:16:15.485937+0000","last_became_peered":"2024-09-11T23:16:15.485937+0000","last_unstale":"2024-09-11T23:17:53.889244+0000","last_undegraded":"2024-09-11T23:17:53.889244+0000","last_fullsized":"2024-09-11T23:17:53.889244+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:32:01.829834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.888653+0000","last_change":"2024-09-11T23:16:15.488635+0000","last_active":"2024-09-11T23:17:53.888653+0000","last_peered":"2024-09-11T23:17:53.888653+0000","last_clean":"2024-09-11T23:17:53.888653+0000","last_became_active":"2024-09-11T23:16:15.488326+0000","last_became_peered":"2024-09-11T23:16:15.488326+0000","last_unstale":"2024-09-11T23:17:53.888653+0000","last_undegraded":"2024-09-11T23:17:53.888653+0000","last_fullsized":"2024-09-11T23:17:53.888653+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:25.626349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":15,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.887410+0000","last_change":"2024-09-11T23:16:53.676716+0000","last_active":"2024-09-11T23:17:53.887410+0000","last_peered":"2024-09-11T23:17:53.887410+0000","last_clean":"2024-09-11T23:17:53.887410+0000","last_became_active":"2024-09-11T23:16:53.674056+0000","last_became_peered":"2024-09-11T23:16:53.674056+0000","last_unstale":"2024-09-11T23:17:53.887410+0000","last_undegraded":"2024-09-11T23:17:53.887410+0000","last_fullsized":"2024-09-11T23:17:53.887410+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:49:44.258607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0],"acting":[9,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.886371+0000","last_change":"2024-09-11T23:16:15.487550+0000","last_active":"2024-09-11T23:17:53.886371+0000","last_peered":"2024-09-11T23:17:53.886371+0000","last_clean":"2024-09-11T23:17:53.886371+0000","last_became_active":"2024-09-11T23:16:15.487197+0000","last_became_peered":"2024-09-11T23:16:15.487197+0000","last_unstale":"2024-09-11T23:17:53.886371+0000","last_undegraded":"2024-09-11T23:17:53.886371+0000","last_fullsized":"2024-09-11T23:17:53.886371+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:51.899470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.886100+0000","last_change":"2024-09-11T23:16:15.493106+0000","last_active":"2024-09-11T23:17:53.886100+0000","last_peered":"2024-09-11T23:17:53.886100+0000","last_clean":"2024-09-11T23:17:53.886100+0000","last_became_active":"2024-09-11T23:16:15.492649+0000","last_became_peered":"2024-09-11T23:16:15.492649+0000","last_unstale":"2024-09-11T23:17:53.886100+0000","last_undegraded":"2024-09-11T23:17:53.886100+0000","last_fullsized":"2024-09-11T23:17:53.886100+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:37.584557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.890285+0000","last_change":"2024-09-11T23:16:15.485444+0000","last_active":"2024-09-11T23:17:53.890285+0000","last_peered":"2024-09-11T23:17:53.890285+0000","last_clean":"2024-09-11T23:17:53.890285+0000","last_became_active":"2024-09-11T23:16:15.484985+0000","last_became_peered":"2024-09-11T23:16:15.484985+0000","last_unstale":"2024-09-11T23:17:53.890285+0000","last_undegraded":"2024-09-11T23:17:53.890285+0000","last_fullsized":"2024-09-11T23:17:53.890285+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:42:38.827500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":36,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.890678+0000","last_change":"2024-09-11T23:16:15.488819+0000","last_active":"2024-09-11T23:17:53.890678+0000","last_peered":"2024-09-11T23:17:53.890678+0000","last_clean":"2024-09-11T23:17:53.890678+0000","last_became_active":"2024-09-11T23:16:15.488484+0000","last_became_peered":"2024-09-11T23:16:15.488484+0000","last_unstale":"2024-09-11T23:17:53.890678+0000","last_undegraded":"2024-09-11T23:17:53.890678+0000","last_fullsized":"2024-09-11T23:17:53.890678+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:11.548909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.884217+0000","last_change":"2024-09-11T23:16:15.490369+0000","last_active":"2024-09-11T23:17:53.884217+0000","last_peered":"2024-09-11T23:17:53.884217+0000","last_clean":"2024-09-11T23:17:53.884217+0000","last_became_active":"2024-09-11T23:16:15.489977+0000","last_became_peered":"2024-09-11T23:16:15.489977+0000","last_unstale":"2024-09-11T23:17:53.884217+0000","last_undegraded":"2024-09-11T23:17:53.884217+0000","last_fullsized":"2024-09-11T23:17:53.884217+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:17.161073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:54.296269+0000","last_change":"2024-09-11T23:16:15.486820+0000","last_active":"2024-09-11T23:17:54.296269+0000","last_peered":"2024-09-11T23:17:54.296269+0000","last_clean":"2024-09-11T23:17:54.296269+0000","last_became_active":"2024-09-11T23:16:15.486259+0000","last_became_peered":"2024-09-11T23:16:15.486259+0000","last_unstale":"2024-09-11T23:17:54.296269+0000","last_undegraded":"2024-09-11T23:17:54.296269+0000","last_fullsized":"2024-09-11T23:17:54.296269+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:11.156989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:54.296637+0000","last_change":"2024-09-11T23:16:15.482432+0000","last_active":"2024-09-11T23:17:54.296637+0000","last_peered":"2024-09-11T23:17:54.296637+0000","last_clean":"2024-09-11T23:17:54.296637+0000","last_became_active":"2024-09-11T23:16:15.481930+0000","last_became_peered":"2024-09-11T23:16:15.481930+0000","last_unstale":"2024-09-11T23:17:54.296637+0000","last_undegraded":"2024-09-11T23:17:54.296637+0000","last_fullsized":"2024-09-11T23:17:54.296637+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:03.156829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.884698+0000","last_change":"2024-09-11T23:16:53.670447+0000","last_active":"2024-09-11T23:17:53.884698+0000","last_peered":"2024-09-11T23:17:53.884698+0000","last_clean":"2024-09-11T23:17:53.884698+0000","last_became_active":"2024-09-11T23:16:53.670084+0000","last_became_peered":"2024-09-11T23:16:53.670084+0000","last_unstale":"2024-09-11T23:17:53.884698+0000","last_undegraded":"2024-09-11T23:17:53.884698+0000","last_fullsized":"2024-09-11T23:17:53.884698+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:25.603908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,8,10],"acting":[3,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.883442+0000","last_change":"2024-09-11T23:16:15.492210+0000","last_active":"2024-09-11T23:17:53.883442+0000","last_peered":"2024-09-11T23:17:53.883442+0000","last_clean":"2024-09-11T23:17:53.883442+0000","last_became_active":"2024-09-11T23:16:15.491333+0000","last_became_peered":"2024-09-11T23:16:15.491333+0000","last_unstale":"2024-09-11T23:17:53.883442+0000","last_undegraded":"2024-09-11T23:17:53.883442+0000","last_fullsized":"2024-09-11T23:17:53.883442+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:52.824085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:54.295685+0000","last_change":"2024-09-11T23:16:15.489798+0000","last_active":"2024-09-11T23:17:54.295685+0000","last_peered":"2024-09-11T23:17:54.295685+0000","last_clean":"2024-09-11T23:17:54.295685+0000","last_became_active":"2024-09-11T23:16:15.489357+0000","last_became_peered":"2024-09-11T23:16:15.489357+0000","last_unstale":"2024-09-11T23:17:54.295685+0000","last_undegraded":"2024-09-11T23:17:54.295685+0000","last_fullsized":"2024-09-11T23:17:54.295685+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:13:53.460349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.883298+0000","last_change":"2024-09-11T23:16:15.480192+0000","last_active":"2024-09-11T23:17:53.883298+0000","last_peered":"2024-09-11T23:17:53.883298+0000","last_clean":"2024-09-11T23:17:53.883298+0000","last_became_active":"2024-09-11T23:16:15.479884+0000","last_became_peered":"2024-09-11T23:16:15.479884+0000","last_unstale":"2024-09-11T23:17:53.883298+0000","last_undegraded":"2024-09-11T23:17:53.883298+0000","last_fullsized":"2024-09-11T23:17:53.883298+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:24:34.765550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":36,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.890565+0000","last_change":"2024-09-11T23:16:15.483444+0000","last_active":"2024-09-11T23:17:53.890565+0000","last_peered":"2024-09-11T23:17:53.890565+0000","last_clean":"2024-09-11T23:17:53.890565+0000","last_became_active":"2024-09-11T23:16:15.483006+0000","last_became_peered":"2024-09-11T23:16:15.483006+0000","last_unstale":"2024-09-11T23:17:53.890565+0000","last_undegraded":"2024-09-11T23:17:53.890565+0000","last_fullsized":"2024-09-11T23:17:53.890565+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:19:11.855417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.886751+0000","last_change":"2024-09-11T23:16:15.497823+0000","last_active":"2024-09-11T23:17:53.886751+0000","last_peered":"2024-09-11T23:17:53.886751+0000","last_clean":"2024-09-11T23:17:53.886751+0000","last_became_active":"2024-09-11T23:16:15.493688+0000","last_became_peered":"2024-09-11T23:16:15.493688+0000","last_unstale":"2024-09-11T23:17:53.886751+0000","last_undegraded":"2024-09-11T23:17:53.886751+0000","last_fullsized":"2024-09-11T23:17:53.886751+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:50:35.055108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.887213+0000","last_change":"2024-09-11T23:16:15.497942+0000","last_active":"2024-09-11T23:17:53.887213+0000","last_peered":"2024-09-11T23:17:53.887213+0000","last_clean":"2024-09-11T23:17:53.887213+0000","last_became_active":"2024-09-11T23:16:15.492467+0000","last_became_peered":"2024-09-11T23:16:15.492467+0000","last_unstale":"2024-09-11T23:17:53.887213+0000","last_undegraded":"2024-09-11T23:17:53.887213+0000","last_fullsized":"2024-09-11T23:17:53.887213+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:16.156174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T23:17:53.888634+0000","last_change":"2024-09-11T23:16:15.488477+0000","last_active":"2024-09-11T23:17:53.888634+0000","last_peered":"2024-09-11T23:17:53.888634+0000","last_clean":"2024-09-11T23:17:53.888634+0000","last_became_active":"2024-09-11T23:16:15.488169+0000","last_became_peered":"2024-09-11T23:16:15.488169+0000","last_unstale":"2024-09-11T23:17:53.888634+0000","last_undegraded":"2024-09-11T23:17:53.888634+0000","last_fullsized":"2024-09-11T23:17:53.888634+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:16:14.454338+0000","last_clean_scrub_stamp":"2024-09-11T23:16:14.454338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:19:15.223041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":71112,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":613,"num_read_kb":380,"num_write":246,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":806,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":577536,"data_stored":213336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":213,"ondisk_log_size":213,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":76,"seq":326417514532,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28116,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717036,"statfs":{"total":95995035648,"available":95966244864,"internally_reserved":0,"allocated":1114112,"data_stored":550696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":69,"seq":296352743464,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28792,"kb_used_data":1760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716360,"statfs":{"total":95995035648,"available":95965552640,"internally_reserved":0,"allocated":1802240,"data_stored":1204425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":64,"seq":274877906990,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28128,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717024,"statfs":{"total":95995035648,"available":95966232576,"internally_reserved":0,"allocated":1126400,"data_stored":549539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168629,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36436,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708716,"statfs":{"total":95995035648,"available":95957725184,"internally_reserved":0,"allocated":1118208,"data_stored":549895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397560,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":37020,"kb_used_data":1672,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708132,"statfs":{"total":95995035648,"available":95957127168,"internally_reserved":0,"allocated":1712128,"data_stored":1146137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561087,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32268,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712884,"statfs":{"total":95995035648,"available":95961993216,"internally_reserved":0,"allocated":1101824,"data_stored":545436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790020,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28720,"kb_used_data":1688,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716432,"statfs":{"total":95995035648,"available":95965626368,"internally_reserved":0,"allocated":1728512,"data_stored":1141605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953545,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32272,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712880,"statfs":{"total":95995035648,"available":95961989120,"internally_reserved":0,"allocated":1110016,"data_stored":549510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182479,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28116,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717036,"statfs":{"total":95995035648,"available":95966244864,"internally_reserved":0,"allocated":1114112,"data_stored":544751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411413,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36508,"kb_used_data":1156,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708644,"statfs":{"total":95995035648,"available":95957651456,"internally_reserved":0,"allocated":1183744,"data_stored":610085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574936,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28180,"kb_used_data":1152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716972,"statfs":{"total":95995035648,"available":95966179328,"internally_reserved":0,"allocated":1179648,"data_stored":610089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738462,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32288,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712864,"statfs":{"total":95995035648,"available":95961972736,"internally_reserved":0,"allocated":1126400,"data_stored":546892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":65768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":65764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":3256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":65640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:18:05.957 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-11T23:18:05.957 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-11T23:18:05.957 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-11T23:18:05.957 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph health --format=json 2024-09-11T23:18:06.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:18:06 smithi037 ceph-mon[30630]: pgmap v361: 129 pgs: 129 active+clean; 646 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s; 90 B/s, 1 objects/s recovering 2024-09-11T23:18:06.336 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:18:06.402 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:18:06 smithi123 ceph-mon[35438]: pgmap v361: 129 pgs: 129 active+clean; 646 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s; 90 B/s, 1 objects/s recovering 2024-09-11T23:18:06.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:18:06 smithi160 ceph-mon[35055]: pgmap v361: 129 pgs: 129 active+clean; 646 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s; 90 B/s, 1 objects/s recovering 2024-09-11T23:18:06.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:06.859+0000 7f49f4c00640 1 -- 172.21.15.37:0/1667352893 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f49f0102c50 msgr2=0x7f49f0103030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:06.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:06.859+0000 7f49f4c00640 1 --2- 172.21.15.37:0/1667352893 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f49f0102c50 0x7f49f0103030 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f49e0009860 tx=0x7f49e002a3d0 comp rx=0 tx=0).stop 2024-09-11T23:18:06.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:06.859+0000 7f49f4c00640 1 -- 172.21.15.37:0/1667352893 shutdown_connections 2024-09-11T23:18:06.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:06.859+0000 7f49f4c00640 1 --2- 172.21.15.37:0/1667352893 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f49f010bff0 0x7f49f010e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:06.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:06.859+0000 7f49f4c00640 1 --2- 172.21.15.37:0/1667352893 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49f0103570 0x7f49f010ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:06.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:06.859+0000 7f49f4c00640 1 --2- 172.21.15.37:0/1667352893 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f49f0102c50 0x7f49f0103030 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:06.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:06.859+0000 7f49f4c00640 1 -- 172.21.15.37:0/1667352893 >> 172.21.15.37:0/1667352893 conn(0x7f49f00fc610 msgr2=0x7f49f00fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:06.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:06.859+0000 7f49f4c00640 1 -- 172.21.15.37:0/1667352893 shutdown_connections 2024-09-11T23:18:06.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:06.859+0000 7f49f4c00640 1 -- 172.21.15.37:0/1667352893 wait complete. 2024-09-11T23:18:06.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:06.860+0000 7f49f4c00640 1 Processor -- start 2024-09-11T23:18:06.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:06.860+0000 7f49f4c00640 1 -- start start 2024-09-11T23:18:06.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:06.860+0000 7f49f4c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49f0102c50 0x7f49f01982a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:06.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:06.860+0000 7f49f4c00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f49f0103570 0x7f49f01987e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:06.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:06.861+0000 7f49f4c00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f49f010bff0 0x7f49f019cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:06.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:06.861+0000 7f49f4c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f49f0111dc0 con 0x7f49f0102c50 2024-09-11T23:18:06.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:06.861+0000 7f49f4c00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f49f0111c40 con 0x7f49f010bff0 2024-09-11T23:18:06.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:06.861+0000 7f49f4c00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f49f0111f40 con 0x7f49f0103570 2024-09-11T23:18:06.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:06.861+0000 7f49ef400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49f0102c50 0x7f49f01982a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:06.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:06.861+0000 7f49e6a00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f49f0103570 0x7f49f01987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:06.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:06.861+0000 7f49e6a00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f49f0103570 0x7f49f01987e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.37:41558/0 (socket says 172.21.15.37:41558) 2024-09-11T23:18:06.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:06.861+0000 7f49e6a00640 1 -- 172.21.15.37:0/1275618024 learned_addr learned my addr 172.21.15.37:0/1275618024 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:18:06.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:06.861+0000 7f49efe00640 1 --2- 172.21.15.37:0/1275618024 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f49f010bff0 0x7f49f019cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:06.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:06.861+0000 7f49e6a00640 1 -- 172.21.15.37:0/1275618024 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f49f010bff0 msgr2=0x7f49f019cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:06.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:06.861+0000 7f49e6a00640 1 --2- 172.21.15.37:0/1275618024 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f49f010bff0 0x7f49f019cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:06.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:06.861+0000 7f49e6a00640 1 -- 172.21.15.37:0/1275618024 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49f0102c50 msgr2=0x7f49f01982a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:06.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:06.861+0000 7f49e6a00640 1 --2- 172.21.15.37:0/1275618024 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49f0102c50 0x7f49f01982a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:06.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:06.861+0000 7f49e6a00640 1 -- 172.21.15.37:0/1275618024 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49f019d250 con 0x7f49f0103570 2024-09-11T23:18:06.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:06.861+0000 7f49ef400640 1 --2- 172.21.15.37:0/1275618024 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49f0102c50 0x7f49f01982a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:18:06.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:06.862+0000 7f49e6a00640 1 --2- 172.21.15.37:0/1275618024 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f49f0103570 0x7f49f01987e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f49d800e9c0 tx=0x7f49d800ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:06.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:06.862+0000 7f49ecc00640 1 -- 172.21.15.37:0/1275618024 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49d800cde0 con 0x7f49f0103570 2024-09-11T23:18:06.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:06.862+0000 7f49ecc00640 1 -- 172.21.15.37:0/1275618024 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f49d80035f0 con 0x7f49f0103570 2024-09-11T23:18:06.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:06.862+0000 7f49f4c00640 1 -- 172.21.15.37:0/1275618024 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49f019d540 con 0x7f49f0103570 2024-09-11T23:18:06.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:06.862+0000 7f49ecc00640 1 -- 172.21.15.37:0/1275618024 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49d8010690 con 0x7f49f0103570 2024-09-11T23:18:06.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:06.862+0000 7f49f4c00640 1 -- 172.21.15.37:0/1275618024 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49f01a4e20 con 0x7f49f0103570 2024-09-11T23:18:06.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:06.863+0000 7f49f4c00640 1 -- 172.21.15.37:0/1275618024 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49f0103030 con 0x7f49f0103570 2024-09-11T23:18:06.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:06.866+0000 7f49ecc00640 1 -- 172.21.15.37:0/1275618024 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f49d80037a0 con 0x7f49f0103570 2024-09-11T23:18:06.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:06.867+0000 7f49ecc00640 1 --2- 172.21.15.37:0/1275618024 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f49d40a2c10 0x7f49d40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:06.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:06.868+0000 7f49ecc00640 1 -- 172.21.15.37:0/1275618024 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9295+0+0 (secure 0 0 0) 0x7f49d80cf950 con 0x7f49f0103570 2024-09-11T23:18:06.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:06.868+0000 7f49ef400640 1 --2- 172.21.15.37:0/1275618024 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f49d40a2c10 0x7f49d40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:06.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:06.868+0000 7f49ef400640 1 --2- 172.21.15.37:0/1275618024 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f49d40a2c10 0x7f49d40a50d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f49e0031000 tx=0x7f49e0009530 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:06.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:06.869+0000 7f49ecc00640 1 -- 172.21.15.37:0/1275618024 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f49d809c2d0 con 0x7f49f0103570 2024-09-11T23:18:07.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:07.095+0000 7f49f4c00640 1 -- 172.21.15.37:0/1275618024 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f49f0199600 con 0x7f49f0103570 2024-09-11T23:18:07.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:07.095+0000 7f49ecc00640 1 -- 172.21.15.37:0/1275618024 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f49f0199600 con 0x7f49f0103570 2024-09-11T23:18:07.098 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:18:07.098 INFO:teuthology.orchestra.run.smithi037.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-11T23:18:07.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:07.097+0000 7f49f4c00640 1 -- 172.21.15.37:0/1275618024 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f49d40a2c10 msgr2=0x7f49d40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:07.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:07.097+0000 7f49f4c00640 1 --2- 172.21.15.37:0/1275618024 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f49d40a2c10 0x7f49d40a50d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f49e0031000 tx=0x7f49e0009530 comp rx=0 tx=0).stop 2024-09-11T23:18:07.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:07.097+0000 7f49f4c00640 1 -- 172.21.15.37:0/1275618024 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f49f0103570 msgr2=0x7f49f01987e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:07.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:07.097+0000 7f49f4c00640 1 --2- 172.21.15.37:0/1275618024 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f49f0103570 0x7f49f01987e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f49d800e9c0 tx=0x7f49d800ee80 comp rx=0 tx=0).stop 2024-09-11T23:18:07.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:07.098+0000 7f49f4c00640 1 -- 172.21.15.37:0/1275618024 shutdown_connections 2024-09-11T23:18:07.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:07.098+0000 7f49f4c00640 1 --2- 172.21.15.37:0/1275618024 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f49d40a2c10 0x7f49d40a50d0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:07.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:07.098+0000 7f49f4c00640 1 --2- 172.21.15.37:0/1275618024 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f49f010bff0 0x7f49f019cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:07.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:07.098+0000 7f49f4c00640 1 --2- 172.21.15.37:0/1275618024 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f49f0103570 0x7f49f01987e0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:07.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:07.098+0000 7f49f4c00640 1 --2- 172.21.15.37:0/1275618024 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49f0102c50 0x7f49f01982a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:07.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:07.098+0000 7f49f4c00640 1 -- 172.21.15.37:0/1275618024 >> 172.21.15.37:0/1275618024 conn(0x7f49f00fc610 msgr2=0x7f49f00fd310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:07.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:07.098+0000 7f49f4c00640 1 -- 172.21.15.37:0/1275618024 shutdown_connections 2024-09-11T23:18:07.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:07.098+0000 7f49f4c00640 1 -- 172.21.15.37:0/1275618024 wait complete. 2024-09-11T23:18:07.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:18:07 smithi037 ceph-mon[30630]: from='client.14922 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T23:18:07.335 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:18:07 smithi160 ceph-mon[35055]: from='client.14922 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T23:18:07.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:18:07 smithi123 ceph-mon[35438]: from='client.14922 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T23:18:07.817 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-11T23:18:07.817 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T23:18:08.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:18:08 smithi037 ceph-mon[30630]: pgmap v362: 129 pgs: 129 active+clean; 646 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s; 76 B/s, 1 objects/s recovering 2024-09-11T23:18:08.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:18:08 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/1275618024' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-11T23:18:08.194 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:18:08.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:18:08 smithi160 ceph-mon[35055]: pgmap v362: 129 pgs: 129 active+clean; 646 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s; 76 B/s, 1 objects/s recovering 2024-09-11T23:18:08.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:18:08 smithi160 ceph-mon[35055]: from='client.? 172.21.15.37:0/1275618024' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-11T23:18:08.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:18:08 smithi123 ceph-mon[35438]: pgmap v362: 129 pgs: 129 active+clean; 646 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s; 76 B/s, 1 objects/s recovering 2024-09-11T23:18:08.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:18:08 smithi123 ceph-mon[35438]: from='client.? 172.21.15.37:0/1275618024' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-11T23:18:08.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:08.744+0000 7fa507200640 1 -- 172.21.15.37:0/2254226314 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5081047e0 msgr2=0x7fa508108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:08.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:08.744+0000 7fa507200640 1 --2- 172.21.15.37:0/2254226314 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5081047e0 0x7fa508108830 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa4f4009900 tx=0x7fa4f402a410 comp rx=0 tx=0).stop 2024-09-11T23:18:08.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:08.744+0000 7fa507200640 1 -- 172.21.15.37:0/2254226314 shutdown_connections 2024-09-11T23:18:08.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:08.744+0000 7fa507200640 1 --2- 172.21.15.37:0/2254226314 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa508108f60 0x7fa508110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:08.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:08.744+0000 7fa507200640 1 --2- 172.21.15.37:0/2254226314 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5081047e0 0x7fa508108830 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:08.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:08.744+0000 7fa507200640 1 --2- 172.21.15.37:0/2254226314 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa508103e30 0x7fa508104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:08.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:08.744+0000 7fa507200640 1 -- 172.21.15.37:0/2254226314 >> 172.21.15.37:0/2254226314 conn(0x7fa5080ff910 msgr2=0x7fa508101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:08.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:08.744+0000 7fa507200640 1 -- 172.21.15.37:0/2254226314 shutdown_connections 2024-09-11T23:18:08.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:08.744+0000 7fa507200640 1 -- 172.21.15.37:0/2254226314 wait complete. 2024-09-11T23:18:08.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:08.745+0000 7fa507200640 1 Processor -- start 2024-09-11T23:18:08.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:08.745+0000 7fa507200640 1 -- start start 2024-09-11T23:18:08.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:08.745+0000 7fa507200640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa508103e30 0x7fa50819a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:08.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:08.745+0000 7fa507200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5081047e0 0x7fa50819a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:08.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:08.745+0000 7fa507200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa508108f60 0x7fa50819ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:08.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:08.746+0000 7fa507200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa508113fc0 con 0x7fa5081047e0 2024-09-11T23:18:08.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:08.746+0000 7fa507200640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fa508113e40 con 0x7fa508108f60 2024-09-11T23:18:08.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:08.746+0000 7fa507200640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fa508114140 con 0x7fa508103e30 2024-09-11T23:18:08.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:08.746+0000 7fa505400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5081047e0 0x7fa50819a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:08.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:08.746+0000 7fa505400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5081047e0 0x7fa50819a9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58264/0 (socket says 172.21.15.37:58264) 2024-09-11T23:18:08.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:08.746+0000 7fa505e00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa508103e30 0x7fa50819a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:08.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:08.746+0000 7fa505400640 1 -- 172.21.15.37:0/1673494277 learned_addr learned my addr 172.21.15.37:0/1673494277 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:18:08.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:08.746+0000 7fa506800640 1 --2- 172.21.15.37:0/1673494277 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa508108f60 0x7fa50819ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:08.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:08.746+0000 7fa505e00640 1 -- 172.21.15.37:0/1673494277 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa508108f60 msgr2=0x7fa50819ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:08.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:08.746+0000 7fa505e00640 1 --2- 172.21.15.37:0/1673494277 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa508108f60 0x7fa50819ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:08.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:08.746+0000 7fa505e00640 1 -- 172.21.15.37:0/1673494277 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5081047e0 msgr2=0x7fa50819a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:08.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:08.746+0000 7fa505e00640 1 --2- 172.21.15.37:0/1673494277 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5081047e0 0x7fa50819a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:08.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:08.746+0000 7fa505e00640 1 -- 172.21.15.37:0/1673494277 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa50819f460 con 0x7fa508103e30 2024-09-11T23:18:08.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:08.746+0000 7fa505400640 1 --2- 172.21.15.37:0/1673494277 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5081047e0 0x7fa50819a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:18:08.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:08.747+0000 7fa505e00640 1 --2- 172.21.15.37:0/1673494277 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa508103e30 0x7fa50819a4b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa4f800e9f0 tx=0x7fa4f800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:08.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:08.747+0000 7fa4fea00640 1 -- 172.21.15.37:0/1673494277 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4f800ccc0 con 0x7fa508103e30 2024-09-11T23:18:08.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:08.747+0000 7fa507200640 1 -- 172.21.15.37:0/1673494277 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa50819f750 con 0x7fa508103e30 2024-09-11T23:18:08.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:08.747+0000 7fa507200640 1 -- 172.21.15.37:0/1673494277 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5081a7030 con 0x7fa508103e30 2024-09-11T23:18:08.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:08.747+0000 7fa4fea00640 1 -- 172.21.15.37:0/1673494277 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa4f8010910 con 0x7fa508103e30 2024-09-11T23:18:08.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:08.747+0000 7fa4fea00640 1 -- 172.21.15.37:0/1673494277 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4f8018880 con 0x7fa508103e30 2024-09-11T23:18:08.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:08.748+0000 7fa507200640 1 -- 172.21.15.37:0/1673494277 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4e8005290 con 0x7fa508103e30 2024-09-11T23:18:08.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:08.751+0000 7fa4fea00640 1 -- 172.21.15.37:0/1673494277 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fa4f8010430 con 0x7fa508103e30 2024-09-11T23:18:08.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:08.752+0000 7fa4fea00640 1 --2- 172.21.15.37:0/1673494277 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fa4ec0a2c90 0x7fa4ec0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:08.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:08.752+0000 7fa4fea00640 1 -- 172.21.15.37:0/1673494277 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9295+0+0 (secure 0 0 0) 0x7fa4f80cf7d0 con 0x7fa508103e30 2024-09-11T23:18:08.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:08.752+0000 7fa505400640 1 --2- 172.21.15.37:0/1673494277 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fa4ec0a2c90 0x7fa4ec0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:08.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:08.753+0000 7fa505400640 1 --2- 172.21.15.37:0/1673494277 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fa4ec0a2c90 0x7fa4ec0a5150 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa4f4031550 tx=0x7fa4f4005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:08.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:08.753+0000 7fa4fea00640 1 -- 172.21.15.37:0/1673494277 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa4f809bb00 con 0x7fa508103e30 2024-09-11T23:18:08.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:08.974+0000 7fa507200640 1 -- 172.21.15.37:0/1673494277 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa4e8005580 con 0x7fa508103e30 2024-09-11T23:18:08.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:08.975+0000 7fa4fea00640 1 -- 172.21.15.37:0/1673494277 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11986 (secure 0 0 0) 0x7fa4f809fe00 con 0x7fa508103e30 2024-09-11T23:18:08.975 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:18:08.975 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":28,"btime":"2024-09-11T23:17:03:741210+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14448,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/285120996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":285120996},{"type":"v1","addr":"172.21.15.37:6835","nonce":285120996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14460,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/3095283029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":3095283029},{"type":"v1","addr":"172.21.15.37:6837","nonce":3095283029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T23:16:16.642956+0000","modified":"2024-09-11T23:17:03.741190+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24533,"mds_1":24520,"mds_2":24499,"mds_3":24497,"mds_4":24493},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14499":{"gid":14499,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6839/1072030582","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":1072030582},{"type":"v1","addr":"172.21.15.37:6839","nonce":1072030582}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14511":{"gid":14511,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6841/209927476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":209927476},{"type":"v1","addr":"172.21.15.37:6841","nonce":209927476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24440":{"gid":24440,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.123:6833/3380294842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":3380294842},{"type":"v1","addr":"172.21.15.123:6833","nonce":3380294842}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6833/1918127245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":1918127245},{"type":"v1","addr":"172.21.15.160:6833","nonce":1918127245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.123:6835/3928690501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":3928690501},{"type":"v1","addr":"172.21.15.123:6835","nonce":3928690501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":21,"addr":"172.21.15.160:6835/2316897035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":2316897035},{"type":"v1","addr":"172.21.15.160:6835","nonce":2316897035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"h","rank":3,"incarnation":24,"state":"up:active","state_seq":19,"addr":"172.21.15.123:6837/2168535476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":2168535476},{"type":"v1","addr":"172.21.15.123:6837","nonce":2168535476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":20,"addr":"172.21.15.160:6837/2906597021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":2906597021},{"type":"v1","addr":"172.21.15.160:6837","nonce":2906597021}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24520":{"gid":24520,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":18,"addr":"172.21.15.160:6839/2041625862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":2041625862},{"type":"v1","addr":"172.21.15.160:6839","nonce":2041625862}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24533":{"gid":24533,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.123:6839/3077076065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6838","nonce":3077076065},{"type":"v1","addr":"172.21.15.123:6839","nonce":3077076065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24533,"qdb_cluster":[24533,24520,24499,24497,24493]},"id":1}]} 2024-09-11T23:18:08.975 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 28 2024-09-11T23:18:08.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:08.977+0000 7fa507200640 1 -- 172.21.15.37:0/1673494277 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fa4ec0a2c90 msgr2=0x7fa4ec0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:08.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:08.977+0000 7fa507200640 1 --2- 172.21.15.37:0/1673494277 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fa4ec0a2c90 0x7fa4ec0a5150 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa4f4031550 tx=0x7fa4f4005a20 comp rx=0 tx=0).stop 2024-09-11T23:18:08.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:08.977+0000 7fa507200640 1 -- 172.21.15.37:0/1673494277 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa508103e30 msgr2=0x7fa50819a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:08.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:08.977+0000 7fa507200640 1 --2- 172.21.15.37:0/1673494277 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa508103e30 0x7fa50819a4b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa4f800e9f0 tx=0x7fa4f800eeb0 comp rx=0 tx=0).stop 2024-09-11T23:18:08.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:08.977+0000 7fa507200640 1 -- 172.21.15.37:0/1673494277 shutdown_connections 2024-09-11T23:18:08.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:08.977+0000 7fa507200640 1 --2- 172.21.15.37:0/1673494277 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fa4ec0a2c90 0x7fa4ec0a5150 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:08.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:08.977+0000 7fa507200640 1 --2- 172.21.15.37:0/1673494277 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa508108f60 0x7fa50819ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:08.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:08.977+0000 7fa507200640 1 --2- 172.21.15.37:0/1673494277 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5081047e0 0x7fa50819a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:08.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:08.977+0000 7fa507200640 1 --2- 172.21.15.37:0/1673494277 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa508103e30 0x7fa50819a4b0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:08.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:08.977+0000 7fa507200640 1 -- 172.21.15.37:0/1673494277 >> 172.21.15.37:0/1673494277 conn(0x7fa5080ff910 msgr2=0x7fa508100ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:08.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:08.977+0000 7fa507200640 1 -- 172.21.15.37:0/1673494277 shutdown_connections 2024-09-11T23:18:08.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:08.978+0000 7fa507200640 1 -- 172.21.15.37:0/1673494277 wait complete. 2024-09-11T23:18:09.330 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:18:09 smithi037 ceph-mon[30630]: pgmap v363: 129 pgs: 129 active+clean; 646 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s; 11 B/s, 0 objects/s recovering 2024-09-11T23:18:09.330 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:18:09 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/1673494277' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:18:09.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:18:09 smithi160 ceph-mon[35055]: pgmap v363: 129 pgs: 129 active+clean; 646 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s; 11 B/s, 0 objects/s recovering 2024-09-11T23:18:09.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:18:09 smithi160 ceph-mon[35055]: from='client.? 172.21.15.37:0/1673494277' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:18:09.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:18:09 smithi123 ceph-mon[35438]: pgmap v363: 129 pgs: 129 active+clean; 646 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s; 11 B/s, 0 objects/s recovering 2024-09-11T23:18:09.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:18:09 smithi123 ceph-mon[35438]: from='client.? 172.21.15.37:0/1673494277' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:18:09.707 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T23:18:10.085 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:18:10.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:10.635+0000 7ff948000640 1 -- 172.21.15.37:0/943807387 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff940076720 msgr2=0x7ff940076b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:10.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:10.635+0000 7ff948000640 1 --2- 172.21.15.37:0/943807387 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff940076720 0x7ff940076b00 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ff934009900 tx=0x7ff93402a410 comp rx=0 tx=0).stop 2024-09-11T23:18:10.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:10.636+0000 7ff948000640 1 -- 172.21.15.37:0/943807387 shutdown_connections 2024-09-11T23:18:10.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:10.636+0000 7ff948000640 1 --2- 172.21.15.37:0/943807387 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff940077040 0x7ff9401124f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:10.636+0000 7ff948000640 1 --2- 172.21.15.37:0/943807387 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff940112a30 0x7ff940114e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:10.636+0000 7ff948000640 1 --2- 172.21.15.37:0/943807387 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff940076720 0x7ff940076b00 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:10.636+0000 7ff948000640 1 -- 172.21.15.37:0/943807387 >> 172.21.15.37:0/943807387 conn(0x7ff9400ffa90 msgr2=0x7ff940101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:10.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:10.636+0000 7ff948000640 1 -- 172.21.15.37:0/943807387 shutdown_connections 2024-09-11T23:18:10.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:10.636+0000 7ff948000640 1 -- 172.21.15.37:0/943807387 wait complete. 2024-09-11T23:18:10.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:10.637+0000 7ff948000640 1 Processor -- start 2024-09-11T23:18:10.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:10.637+0000 7ff948000640 1 -- start start 2024-09-11T23:18:10.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:10.637+0000 7ff948000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff940076720 0x7ff9401a46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:10.637+0000 7ff948000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff940077040 0x7ff9401a4c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:10.637+0000 7ff948000640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff940112a30 0x7ff94019e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:10.637+0000 7ff948000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff9401185c0 con 0x7ff940076720 2024-09-11T23:18:10.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:10.637+0000 7ff948000640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7ff940118440 con 0x7ff940077040 2024-09-11T23:18:10.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:10.637+0000 7ff948000640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7ff940118740 con 0x7ff940112a30 2024-09-11T23:18:10.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:10.637+0000 7ff945600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff940076720 0x7ff9401a46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:10.637+0000 7ff945600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff940076720 0x7ff9401a46f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38780/0 (socket says 172.21.15.37:38780) 2024-09-11T23:18:10.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:10.637+0000 7ff945600640 1 -- 172.21.15.37:0/2599648115 learned_addr learned my addr 172.21.15.37:0/2599648115 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:18:10.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:10.637+0000 7ff944c00640 1 --2- 172.21.15.37:0/2599648115 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff940077040 0x7ff9401a4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:10.638+0000 7ff946000640 1 --2- 172.21.15.37:0/2599648115 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff940112a30 0x7ff94019e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:10.638+0000 7ff945600640 1 -- 172.21.15.37:0/2599648115 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff940112a30 msgr2=0x7ff94019e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:10.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:10.638+0000 7ff945600640 1 --2- 172.21.15.37:0/2599648115 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff940112a30 0x7ff94019e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:10.638+0000 7ff945600640 1 -- 172.21.15.37:0/2599648115 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff940077040 msgr2=0x7ff9401a4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:10.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:10.638+0000 7ff945600640 1 --2- 172.21.15.37:0/2599648115 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff940077040 0x7ff9401a4c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:10.638+0000 7ff945600640 1 -- 172.21.15.37:0/2599648115 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff94019efe0 con 0x7ff940076720 2024-09-11T23:18:10.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:10.638+0000 7ff945600640 1 --2- 172.21.15.37:0/2599648115 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff940076720 0x7ff9401a46f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ff934006010 tx=0x7ff9340042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:10.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:10.638+0000 7ff93e000640 1 -- 172.21.15.37:0/2599648115 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff93403f030 con 0x7ff940076720 2024-09-11T23:18:10.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:10.639+0000 7ff93e000640 1 -- 172.21.15.37:0/2599648115 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff934003ce0 con 0x7ff940076720 2024-09-11T23:18:10.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:10.639+0000 7ff948000640 1 -- 172.21.15.37:0/2599648115 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff94019f270 con 0x7ff940076720 2024-09-11T23:18:10.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:10.639+0000 7ff93e000640 1 -- 172.21.15.37:0/2599648115 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff934035070 con 0x7ff940076720 2024-09-11T23:18:10.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:10.639+0000 7ff948000640 1 -- 172.21.15.37:0/2599648115 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9401ab5c0 con 0x7ff940076720 2024-09-11T23:18:10.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:10.640+0000 7ff948000640 1 -- 172.21.15.37:0/2599648115 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff940076b00 con 0x7ff940076720 2024-09-11T23:18:10.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:10.642+0000 7ff93e000640 1 -- 172.21.15.37:0/2599648115 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7ff934042030 con 0x7ff940076720 2024-09-11T23:18:10.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:10.643+0000 7ff93e000640 1 --2- 172.21.15.37:0/2599648115 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7ff9280a2c90 0x7ff9280a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:10.643+0000 7ff93e000640 1 -- 172.21.15.37:0/2599648115 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9295+0+0 (secure 0 0 0) 0x7ff9340efb00 con 0x7ff940076720 2024-09-11T23:18:10.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:10.643+0000 7ff944c00640 1 --2- 172.21.15.37:0/2599648115 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7ff9280a2c90 0x7ff9280a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:10.644+0000 7ff944c00640 1 --2- 172.21.15.37:0/2599648115 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7ff9280a2c90 0x7ff9280a5150 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff940079390 tx=0x7ff92c00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:10.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:10.647+0000 7ff93e000640 1 -- 172.21.15.37:0/2599648115 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff9340bbef0 con 0x7ff940076720 2024-09-11T23:18:10.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:10.867+0000 7ff948000640 1 -- 172.21.15.37:0/2599648115 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff94010dc20 con 0x7ff940076720 2024-09-11T23:18:10.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:10.868+0000 7ff93e000640 1 -- 172.21.15.37:0/2599648115 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11986 (secure 0 0 0) 0x7ff9340c01f0 con 0x7ff940076720 2024-09-11T23:18:10.869 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:18:10.869 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":28,"btime":"2024-09-11T23:17:03:741210+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14448,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/285120996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":285120996},{"type":"v1","addr":"172.21.15.37:6835","nonce":285120996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14460,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/3095283029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":3095283029},{"type":"v1","addr":"172.21.15.37:6837","nonce":3095283029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T23:16:16.642956+0000","modified":"2024-09-11T23:17:03.741190+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24533,"mds_1":24520,"mds_2":24499,"mds_3":24497,"mds_4":24493},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14499":{"gid":14499,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6839/1072030582","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":1072030582},{"type":"v1","addr":"172.21.15.37:6839","nonce":1072030582}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14511":{"gid":14511,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6841/209927476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":209927476},{"type":"v1","addr":"172.21.15.37:6841","nonce":209927476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24440":{"gid":24440,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.123:6833/3380294842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":3380294842},{"type":"v1","addr":"172.21.15.123:6833","nonce":3380294842}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6833/1918127245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":1918127245},{"type":"v1","addr":"172.21.15.160:6833","nonce":1918127245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.123:6835/3928690501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":3928690501},{"type":"v1","addr":"172.21.15.123:6835","nonce":3928690501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":21,"addr":"172.21.15.160:6835/2316897035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":2316897035},{"type":"v1","addr":"172.21.15.160:6835","nonce":2316897035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"h","rank":3,"incarnation":24,"state":"up:active","state_seq":19,"addr":"172.21.15.123:6837/2168535476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":2168535476},{"type":"v1","addr":"172.21.15.123:6837","nonce":2168535476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":20,"addr":"172.21.15.160:6837/2906597021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":2906597021},{"type":"v1","addr":"172.21.15.160:6837","nonce":2906597021}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24520":{"gid":24520,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":18,"addr":"172.21.15.160:6839/2041625862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":2041625862},{"type":"v1","addr":"172.21.15.160:6839","nonce":2041625862}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24533":{"gid":24533,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.123:6839/3077076065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6838","nonce":3077076065},{"type":"v1","addr":"172.21.15.123:6839","nonce":3077076065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24533,"qdb_cluster":[24533,24520,24499,24497,24493]},"id":1}]} 2024-09-11T23:18:10.869 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 28 2024-09-11T23:18:10.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:10.870+0000 7ff948000640 1 -- 172.21.15.37:0/2599648115 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7ff9280a2c90 msgr2=0x7ff9280a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:10.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:10.870+0000 7ff948000640 1 --2- 172.21.15.37:0/2599648115 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7ff9280a2c90 0x7ff9280a5150 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff940079390 tx=0x7ff92c00b410 comp rx=0 tx=0).stop 2024-09-11T23:18:10.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:10.870+0000 7ff948000640 1 -- 172.21.15.37:0/2599648115 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff940076720 msgr2=0x7ff9401a46f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:10.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:10.870+0000 7ff948000640 1 --2- 172.21.15.37:0/2599648115 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff940076720 0x7ff9401a46f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ff934006010 tx=0x7ff9340042f0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:10.870+0000 7ff948000640 1 -- 172.21.15.37:0/2599648115 shutdown_connections 2024-09-11T23:18:10.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:10.870+0000 7ff948000640 1 --2- 172.21.15.37:0/2599648115 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7ff9280a2c90 0x7ff9280a5150 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:10.870+0000 7ff948000640 1 --2- 172.21.15.37:0/2599648115 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff940077040 0x7ff9401a4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:10.870+0000 7ff948000640 1 --2- 172.21.15.37:0/2599648115 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff940112a30 0x7ff94019e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:10.870+0000 7ff948000640 1 --2- 172.21.15.37:0/2599648115 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff940076720 0x7ff9401a46f0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:10.870+0000 7ff948000640 1 -- 172.21.15.37:0/2599648115 >> 172.21.15.37:0/2599648115 conn(0x7ff9400ffa90 msgr2=0x7ff940101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:10.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:10.871+0000 7ff948000640 1 -- 172.21.15.37:0/2599648115 shutdown_connections 2024-09-11T23:18:10.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:10.871+0000 7ff948000640 1 -- 172.21.15.37:0/2599648115 wait complete. 2024-09-11T23:18:11.233 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:18:11 smithi037 ceph-mon[30630]: pgmap v364: 129 pgs: 129 active+clean; 646 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s; 9 B/s, 0 objects/s recovering 2024-09-11T23:18:11.234 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:18:11 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/2599648115' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:18:11.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:18:11 smithi160 ceph-mon[35055]: pgmap v364: 129 pgs: 129 active+clean; 646 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s; 9 B/s, 0 objects/s recovering 2024-09-11T23:18:11.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:18:11 smithi160 ceph-mon[35055]: from='client.? 172.21.15.37:0/2599648115' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:18:11.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:18:11 smithi123 ceph-mon[35438]: pgmap v364: 129 pgs: 129 active+clean; 646 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s; 9 B/s, 0 objects/s recovering 2024-09-11T23:18:11.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:18:11 smithi123 ceph-mon[35438]: from='client.? 172.21.15.37:0/2599648115' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:18:11.602 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T23:18:11.977 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:18:12.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:12.514+0000 7ffb3be00640 1 -- 172.21.15.37:0/3658870887 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb3c1047e0 msgr2=0x7ffb3c108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:12.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:12.514+0000 7ffb3be00640 1 --2- 172.21.15.37:0/3658870887 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb3c1047e0 0x7ffb3c108830 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ffb28009900 tx=0x7ffb2802a410 comp rx=0 tx=0).stop 2024-09-11T23:18:12.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:12.514+0000 7ffb3be00640 1 -- 172.21.15.37:0/3658870887 shutdown_connections 2024-09-11T23:18:12.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:12.514+0000 7ffb3be00640 1 --2- 172.21.15.37:0/3658870887 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb3c108f60 0x7ffb3c110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:12.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:12.514+0000 7ffb3be00640 1 --2- 172.21.15.37:0/3658870887 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb3c1047e0 0x7ffb3c108830 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:12.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:12.514+0000 7ffb3be00640 1 --2- 172.21.15.37:0/3658870887 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffb3c103e30 0x7ffb3c104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:12.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:12.514+0000 7ffb3be00640 1 -- 172.21.15.37:0/3658870887 >> 172.21.15.37:0/3658870887 conn(0x7ffb3c0ff910 msgr2=0x7ffb3c101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:12.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:12.515+0000 7ffb3be00640 1 -- 172.21.15.37:0/3658870887 shutdown_connections 2024-09-11T23:18:12.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:12.515+0000 7ffb3be00640 1 -- 172.21.15.37:0/3658870887 wait complete. 2024-09-11T23:18:12.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:12.516+0000 7ffb3be00640 1 Processor -- start 2024-09-11T23:18:12.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:12.516+0000 7ffb3be00640 1 -- start start 2024-09-11T23:18:12.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:12.516+0000 7ffb3be00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffb3c103e30 0x7ffb3c19a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:12.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:12.516+0000 7ffb3be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb3c1047e0 0x7ffb3c19a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:12.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:12.516+0000 7ffb3be00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb3c108f60 0x7ffb3c19ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:12.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:12.516+0000 7ffb3be00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ffb3c113fc0 con 0x7ffb3c1047e0 2024-09-11T23:18:12.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:12.516+0000 7ffb3be00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7ffb3c113e40 con 0x7ffb3c108f60 2024-09-11T23:18:12.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:12.516+0000 7ffb3be00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7ffb3c114140 con 0x7ffb3c103e30 2024-09-11T23:18:12.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:12.516+0000 7ffb3a000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb3c1047e0 0x7ffb3c19a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:12.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:12.516+0000 7ffb3a000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb3c1047e0 0x7ffb3c19a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38804/0 (socket says 172.21.15.37:38804) 2024-09-11T23:18:12.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:12.516+0000 7ffb3a000640 1 -- 172.21.15.37:0/4001164695 learned_addr learned my addr 172.21.15.37:0/4001164695 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:18:12.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:12.516+0000 7ffb3aa00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffb3c103e30 0x7ffb3c19a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:12.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:12.517+0000 7ffb3b400640 1 --2- 172.21.15.37:0/4001164695 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb3c108f60 0x7ffb3c19ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:12.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:12.517+0000 7ffb3b400640 1 -- 172.21.15.37:0/4001164695 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffb3c103e30 msgr2=0x7ffb3c19a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:12.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:12.517+0000 7ffb3b400640 1 --2- 172.21.15.37:0/4001164695 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffb3c103e30 0x7ffb3c19a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:12.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:12.517+0000 7ffb3b400640 1 -- 172.21.15.37:0/4001164695 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb3c1047e0 msgr2=0x7ffb3c19a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:12.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:12.517+0000 7ffb3b400640 1 --2- 172.21.15.37:0/4001164695 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb3c1047e0 0x7ffb3c19a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:12.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:12.517+0000 7ffb3b400640 1 -- 172.21.15.37:0/4001164695 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb3c19f450 con 0x7ffb3c108f60 2024-09-11T23:18:12.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:12.517+0000 7ffb3a000640 1 --2- 172.21.15.37:0/4001164695 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb3c1047e0 0x7ffb3c19a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:18:12.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:12.517+0000 7ffb3aa00640 1 --2- 172.21.15.37:0/4001164695 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffb3c103e30 0x7ffb3c19a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:18:12.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:12.517+0000 7ffb3b400640 1 --2- 172.21.15.37:0/4001164695 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb3c108f60 0x7ffb3c19ed70 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ffb3400ec50 tx=0x7ffb3400c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:12.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:12.518+0000 7ffb33400640 1 -- 172.21.15.37:0/4001164695 <== mon.2 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb34003b70 con 0x7ffb3c108f60 2024-09-11T23:18:12.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:12.518+0000 7ffb3be00640 1 -- 172.21.15.37:0/4001164695 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb3c19f740 con 0x7ffb3c108f60 2024-09-11T23:18:12.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:12.518+0000 7ffb33400640 1 -- 172.21.15.37:0/4001164695 <== mon.2 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffb34003d10 con 0x7ffb3c108f60 2024-09-11T23:18:12.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:12.518+0000 7ffb33400640 1 -- 172.21.15.37:0/4001164695 <== mon.2 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb34010890 con 0x7ffb3c108f60 2024-09-11T23:18:12.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:12.518+0000 7ffb3be00640 1 -- 172.21.15.37:0/4001164695 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb3c1a7020 con 0x7ffb3c108f60 2024-09-11T23:18:12.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:12.519+0000 7ffb3be00640 1 -- 172.21.15.37:0/4001164695 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb3c105310 con 0x7ffb3c108f60 2024-09-11T23:18:12.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:12.523+0000 7ffb33400640 1 -- 172.21.15.37:0/4001164695 <== mon.2 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7ffb34003fc0 con 0x7ffb3c108f60 2024-09-11T23:18:12.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:12.524+0000 7ffb33400640 1 --2- 172.21.15.37:0/4001164695 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7ffb200a2c10 0x7ffb200a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:12.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:12.524+0000 7ffb33400640 1 -- 172.21.15.37:0/4001164695 <== mon.2 v2:172.21.15.123:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9295+0+0 (secure 0 0 0) 0x7ffb340cfb90 con 0x7ffb3c108f60 2024-09-11T23:18:12.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:12.524+0000 7ffb3aa00640 1 --2- 172.21.15.37:0/4001164695 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7ffb200a2c10 0x7ffb200a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:12.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:12.525+0000 7ffb3aa00640 1 --2- 172.21.15.37:0/4001164695 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7ffb200a2c10 0x7ffb200a50d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c009fc0 tx=0x7ffb2c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:12.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:12.528+0000 7ffb33400640 1 -- 172.21.15.37:0/4001164695 <== mon.2 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ffb3409c510 con 0x7ffb3c108f60 2024-09-11T23:18:12.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:12.718+0000 7ffb3be00640 1 -- 172.21.15.37:0/4001164695 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ffb3c10bbb0 con 0x7ffb3c108f60 2024-09-11T23:18:12.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:12.720+0000 7ffb33400640 1 -- 172.21.15.37:0/4001164695 <== mon.2 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) ==== 74+0+25054 (secure 0 0 0) 0x7ffb3409be10 con 0x7ffb3c108f60 2024-09-11T23:18:12.721 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:18:12.721 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":95,"fsid":"8b03efce-7092-11ef-bcea-c7b262605968","created":"2024-09-11T23:07:59.386838+0000","modified":"2024-09-11T23:17:53.878617+0000","last_up_change":"2024-09-11T23:15:16.985748+0000","last_in_change":"2024-09-11T23:14:54.154116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:11:16.547642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:16:11.075859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T23:16:14.019910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-11T23:16:22.041463+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f76ccb11-fe3b-4df1-9a71-e6ca50de80e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1678472768},{"type":"v1","addr":"172.21.15.37:6803","nonce":1678472768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1678472768},{"type":"v1","addr":"172.21.15.37:6805","nonce":1678472768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1678472768},{"type":"v1","addr":"172.21.15.37:6809","nonce":1678472768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1678472768},{"type":"v1","addr":"172.21.15.37:6807","nonce":1678472768}]},"public_addr":"172.21.15.37:6803/1678472768","cluster_addr":"172.21.15.37:6805/1678472768","heartbeat_back_addr":"172.21.15.37:6809/1678472768","heartbeat_front_addr":"172.21.15.37:6807/1678472768","state":["exists","up"]},{"osd":1,"uuid":"13d26eed-1160-4b15-b66b-66c89066c66f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":141504725},{"type":"v1","addr":"172.21.15.123:6801","nonce":141504725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":141504725},{"type":"v1","addr":"172.21.15.123:6803","nonce":141504725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":141504725},{"type":"v1","addr":"172.21.15.123:6807","nonce":141504725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":141504725},{"type":"v1","addr":"172.21.15.123:6805","nonce":141504725}]},"public_addr":"172.21.15.123:6801/141504725","cluster_addr":"172.21.15.123:6803/141504725","heartbeat_back_addr":"172.21.15.123:6807/141504725","heartbeat_front_addr":"172.21.15.123:6805/141504725","state":["exists","up"]},{"osd":2,"uuid":"53daf4d5-2a43-4a89-bae9-f32b89b517f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":1866489133},{"type":"v1","addr":"172.21.15.160:6801","nonce":1866489133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":1866489133},{"type":"v1","addr":"172.21.15.160:6803","nonce":1866489133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":1866489133},{"type":"v1","addr":"172.21.15.160:6807","nonce":1866489133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":1866489133},{"type":"v1","addr":"172.21.15.160:6805","nonce":1866489133}]},"public_addr":"172.21.15.160:6801/1866489133","cluster_addr":"172.21.15.160:6803/1866489133","heartbeat_back_addr":"172.21.15.160:6807/1866489133","heartbeat_front_addr":"172.21.15.160:6805/1866489133","state":["exists","up"]},{"osd":3,"uuid":"7c819225-964b-44f2-93e5-1d7585eb0b36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":412656036},{"type":"v1","addr":"172.21.15.37:6811","nonce":412656036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":412656036},{"type":"v1","addr":"172.21.15.37:6813","nonce":412656036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":412656036},{"type":"v1","addr":"172.21.15.37:6817","nonce":412656036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":412656036},{"type":"v1","addr":"172.21.15.37:6815","nonce":412656036}]},"public_addr":"172.21.15.37:6811/412656036","cluster_addr":"172.21.15.37:6813/412656036","heartbeat_back_addr":"172.21.15.37:6817/412656036","heartbeat_front_addr":"172.21.15.37:6815/412656036","state":["exists","up"]},{"osd":4,"uuid":"e5ab5638-8c7e-4433-8dd0-ba57e28f39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":3228822066},{"type":"v1","addr":"172.21.15.123:6809","nonce":3228822066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":3228822066},{"type":"v1","addr":"172.21.15.123:6811","nonce":3228822066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":3228822066},{"type":"v1","addr":"172.21.15.123:6815","nonce":3228822066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":3228822066},{"type":"v1","addr":"172.21.15.123:6813","nonce":3228822066}]},"public_addr":"172.21.15.123:6809/3228822066","cluster_addr":"172.21.15.123:6811/3228822066","heartbeat_back_addr":"172.21.15.123:6815/3228822066","heartbeat_front_addr":"172.21.15.123:6813/3228822066","state":["exists","up"]},{"osd":5,"uuid":"7f080d49-eec8-4cd9-b410-b2e84139292e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":1618319675},{"type":"v1","addr":"172.21.15.160:6809","nonce":1618319675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":1618319675},{"type":"v1","addr":"172.21.15.160:6811","nonce":1618319675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":1618319675},{"type":"v1","addr":"172.21.15.160:6815","nonce":1618319675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":1618319675},{"type":"v1","addr":"172.21.15.160:6813","nonce":1618319675}]},"public_addr":"172.21.15.160:6809/1618319675","cluster_addr":"172.21.15.160:6811/1618319675","heartbeat_back_addr":"172.21.15.160:6815/1618319675","heartbeat_front_addr":"172.21.15.160:6813/1618319675","state":["exists","up"]},{"osd":6,"uuid":"d0881c4e-bd8d-4575-8c81-94d21825c227","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3541251299},{"type":"v1","addr":"172.21.15.37:6819","nonce":3541251299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3541251299},{"type":"v1","addr":"172.21.15.37:6821","nonce":3541251299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":3541251299},{"type":"v1","addr":"172.21.15.37:6825","nonce":3541251299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3541251299},{"type":"v1","addr":"172.21.15.37:6823","nonce":3541251299}]},"public_addr":"172.21.15.37:6819/3541251299","cluster_addr":"172.21.15.37:6821/3541251299","heartbeat_back_addr":"172.21.15.37:6825/3541251299","heartbeat_front_addr":"172.21.15.37:6823/3541251299","state":["exists","up"]},{"osd":7,"uuid":"04fbec2e-91b5-4a89-a4a3-472398c45288","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":4279933341},{"type":"v1","addr":"172.21.15.123:6817","nonce":4279933341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":4279933341},{"type":"v1","addr":"172.21.15.123:6819","nonce":4279933341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":4279933341},{"type":"v1","addr":"172.21.15.123:6823","nonce":4279933341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":4279933341},{"type":"v1","addr":"172.21.15.123:6821","nonce":4279933341}]},"public_addr":"172.21.15.123:6817/4279933341","cluster_addr":"172.21.15.123:6819/4279933341","heartbeat_back_addr":"172.21.15.123:6823/4279933341","heartbeat_front_addr":"172.21.15.123:6821/4279933341","state":["exists","up"]},{"osd":8,"uuid":"c77090a7-308e-4c6d-a56e-ce6f8e050ae5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":740968584},{"type":"v1","addr":"172.21.15.160:6817","nonce":740968584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":740968584},{"type":"v1","addr":"172.21.15.160:6819","nonce":740968584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":740968584},{"type":"v1","addr":"172.21.15.160:6823","nonce":740968584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":740968584},{"type":"v1","addr":"172.21.15.160:6821","nonce":740968584}]},"public_addr":"172.21.15.160:6817/740968584","cluster_addr":"172.21.15.160:6819/740968584","heartbeat_back_addr":"172.21.15.160:6823/740968584","heartbeat_front_addr":"172.21.15.160:6821/740968584","state":["exists","up"]},{"osd":9,"uuid":"bcd19bd4-88bc-46f7-b48c-af9e3d17aa96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":692114850},{"type":"v1","addr":"172.21.15.37:6827","nonce":692114850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":692114850},{"type":"v1","addr":"172.21.15.37:6829","nonce":692114850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":692114850},{"type":"v1","addr":"172.21.15.37:6833","nonce":692114850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":692114850},{"type":"v1","addr":"172.21.15.37:6831","nonce":692114850}]},"public_addr":"172.21.15.37:6827/692114850","cluster_addr":"172.21.15.37:6829/692114850","heartbeat_back_addr":"172.21.15.37:6833/692114850","heartbeat_front_addr":"172.21.15.37:6831/692114850","state":["exists","up"]},{"osd":10,"uuid":"9e956e6c-c28a-4a4c-b385-c458788858ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":471058996},{"type":"v1","addr":"172.21.15.123:6825","nonce":471058996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":471058996},{"type":"v1","addr":"172.21.15.123:6827","nonce":471058996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":471058996},{"type":"v1","addr":"172.21.15.123:6831","nonce":471058996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":471058996},{"type":"v1","addr":"172.21.15.123:6829","nonce":471058996}]},"public_addr":"172.21.15.123:6825/471058996","cluster_addr":"172.21.15.123:6827/471058996","heartbeat_back_addr":"172.21.15.123:6831/471058996","heartbeat_front_addr":"172.21.15.123:6829/471058996","state":["exists","up"]},{"osd":11,"uuid":"0b5b3364-9a40-4cab-90d4-b7b1cba57bc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":3982315018},{"type":"v1","addr":"172.21.15.160:6825","nonce":3982315018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3982315018},{"type":"v1","addr":"172.21.15.160:6827","nonce":3982315018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3982315018},{"type":"v1","addr":"172.21.15.160:6831","nonce":3982315018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3982315018},{"type":"v1","addr":"172.21.15.160:6829","nonce":3982315018}]},"public_addr":"172.21.15.160:6825/3982315018","cluster_addr":"172.21.15.160:6827/3982315018","heartbeat_back_addr":"172.21.15.160:6831/3982315018","heartbeat_front_addr":"172.21.15.160:6829/3982315018","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:10:21.139833+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:10:47.004960+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:11:11.460263+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:11:40.849286+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:12:06.497448+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:12:32.043206+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:13:01.402019+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:13:27.993489+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:13:52.291643+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:23.840299+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:49.448254+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:15:15.310947+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":1}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":7}]},{"pgid":"3.17","mappings":[{"from":4,"to":7}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.30","mappings":[{"from":1,"to":9}]},{"pgid":"3.38","mappings":[{"from":5,"to":8}]},{"pgid":"4.5","mappings":[{"from":9,"to":10}]},{"pgid":"4.b","mappings":[{"from":9,"to":8}]},{"pgid":"4.11","mappings":[{"from":5,"to":8}]},{"pgid":"4.16","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:6801/2886800769":"2024-09-12T23:08:51.934167+0000","172.21.15.37:0/1811301224":"2024-09-12T23:08:51.934167+0000","172.21.15.37:0/513883980":"2024-09-12T23:08:51.934167+0000","172.21.15.37:0/3698260188":"2024-09-12T23:08:23.793913+0000","172.21.15.37:6800/2886800769":"2024-09-12T23:08:51.934167+0000","172.21.15.37:0/4134736061":"2024-09-12T23:08:23.793913+0000","172.21.15.37:0/3426758476":"2024-09-12T23:08:51.934167+0000","172.21.15.37:0/2545840561":"2024-09-12T23:08:23.793913+0000","172.21.15.37:6801/3447426643":"2024-09-12T23:08:23.793913+0000","172.21.15.37:6800/3447426643":"2024-09-12T23:08:23.793913+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:18:12.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:12.723+0000 7ffb3be00640 1 -- 172.21.15.37:0/4001164695 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7ffb200a2c10 msgr2=0x7ffb200a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:12.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:12.723+0000 7ffb3be00640 1 --2- 172.21.15.37:0/4001164695 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7ffb200a2c10 0x7ffb200a50d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c009fc0 tx=0x7ffb2c005f90 comp rx=0 tx=0).stop 2024-09-11T23:18:12.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:12.723+0000 7ffb3be00640 1 -- 172.21.15.37:0/4001164695 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb3c108f60 msgr2=0x7ffb3c19ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:12.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:12.723+0000 7ffb3be00640 1 --2- 172.21.15.37:0/4001164695 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb3c108f60 0x7ffb3c19ed70 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ffb3400ec50 tx=0x7ffb3400c6a0 comp rx=0 tx=0).stop 2024-09-11T23:18:12.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:12.723+0000 7ffb3be00640 1 -- 172.21.15.37:0/4001164695 shutdown_connections 2024-09-11T23:18:12.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:12.723+0000 7ffb3be00640 1 --2- 172.21.15.37:0/4001164695 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7ffb200a2c10 0x7ffb200a50d0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:12.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:12.723+0000 7ffb3be00640 1 --2- 172.21.15.37:0/4001164695 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb3c108f60 0x7ffb3c19ed70 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:12.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:12.723+0000 7ffb3be00640 1 --2- 172.21.15.37:0/4001164695 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb3c1047e0 0x7ffb3c19a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:12.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:12.723+0000 7ffb3be00640 1 --2- 172.21.15.37:0/4001164695 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffb3c103e30 0x7ffb3c19a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:12.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:12.723+0000 7ffb3be00640 1 -- 172.21.15.37:0/4001164695 >> 172.21.15.37:0/4001164695 conn(0x7ffb3c0ff910 msgr2=0x7ffb3c100d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:12.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:12.723+0000 7ffb3be00640 1 -- 172.21.15.37:0/4001164695 shutdown_connections 2024-09-11T23:18:12.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:12.723+0000 7ffb3be00640 1 -- 172.21.15.37:0/4001164695 wait complete. 2024-09-11T23:18:13.432 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:18:13 smithi037 ceph-mon[30630]: pgmap v365: 129 pgs: 129 active+clean; 646 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-11T23:18:13.432 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:18:13 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/4001164695' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:18:13.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:18:13 smithi160 ceph-mon[35055]: pgmap v365: 129 pgs: 129 active+clean; 646 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-11T23:18:13.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:18:13 smithi160 ceph-mon[35055]: from='client.? 172.21.15.37:0/4001164695' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:18:13.473 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T23:18:13.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:18:13 smithi123 ceph-mon[35438]: pgmap v365: 129 pgs: 129 active+clean; 646 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-11T23:18:13.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:18:13 smithi123 ceph-mon[35438]: from='client.? 172.21.15.37:0/4001164695' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:18:13.870 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:18:14.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:14.455+0000 7f6e50400640 1 -- 172.21.15.37:0/3428248604 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6e48074e30 msgr2=0x7f6e4810df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:14.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:14.455+0000 7f6e50400640 1 --2- 172.21.15.37:0/3428248604 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6e48074e30 0x7f6e4810df10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6e34009900 tx=0x7f6e3402a480 comp rx=0 tx=0).stop 2024-09-11T23:18:14.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:14.455+0000 7f6e50400640 1 -- 172.21.15.37:0/3428248604 shutdown_connections 2024-09-11T23:18:14.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:14.455+0000 7f6e50400640 1 --2- 172.21.15.37:0/3428248604 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e4810e450 0x7f6e48110840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:14.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:14.455+0000 7f6e50400640 1 --2- 172.21.15.37:0/3428248604 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6e48074e30 0x7f6e4810df10 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:14.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:14.455+0000 7f6e50400640 1 --2- 172.21.15.37:0/3428248604 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6e48074510 0x7f6e480748f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:14.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:14.455+0000 7f6e50400640 1 -- 172.21.15.37:0/3428248604 >> 172.21.15.37:0/3428248604 conn(0x7f6e480fd8b0 msgr2=0x7f6e480ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:14.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:14.455+0000 7f6e50400640 1 -- 172.21.15.37:0/3428248604 shutdown_connections 2024-09-11T23:18:14.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:14.455+0000 7f6e50400640 1 -- 172.21.15.37:0/3428248604 wait complete. 2024-09-11T23:18:14.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:14.456+0000 7f6e50400640 1 Processor -- start 2024-09-11T23:18:14.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:14.456+0000 7f6e50400640 1 -- start start 2024-09-11T23:18:14.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:14.457+0000 7f6e50400640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6e48074510 0x7f6e4819a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:14.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:14.457+0000 7f6e50400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e48074e30 0x7f6e4819aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:14.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:14.457+0000 7f6e50400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6e4810e450 0x7f6e4819ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:14.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:14.457+0000 7f6e50400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6e481141a0 con 0x7f6e48074e30 2024-09-11T23:18:14.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:14.457+0000 7f6e50400640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f6e48114020 con 0x7f6e4810e450 2024-09-11T23:18:14.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:14.457+0000 7f6e50400640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f6e48114320 con 0x7f6e48074510 2024-09-11T23:18:14.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:14.457+0000 7f6e4da00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6e48074510 0x7f6e4819a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:14.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:14.457+0000 7f6e4da00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6e48074510 0x7f6e4819a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.37:47920/0 (socket says 172.21.15.37:47920) 2024-09-11T23:18:14.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:14.457+0000 7f6e4d000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e48074e30 0x7f6e4819aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:14.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:14.457+0000 7f6e4da00640 1 -- 172.21.15.37:0/1456926644 learned_addr learned my addr 172.21.15.37:0/1456926644 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:18:14.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:14.457+0000 7f6e4e400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6e4810e450 0x7f6e4819ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:14.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:14.458+0000 7f6e4da00640 1 -- 172.21.15.37:0/1456926644 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6e4810e450 msgr2=0x7f6e4819ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:14.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:14.458+0000 7f6e4da00640 1 --2- 172.21.15.37:0/1456926644 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6e4810e450 0x7f6e4819ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:14.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:14.458+0000 7f6e4da00640 1 -- 172.21.15.37:0/1456926644 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e48074e30 msgr2=0x7f6e4819aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:14.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:14.458+0000 7f6e4da00640 1 --2- 172.21.15.37:0/1456926644 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e48074e30 0x7f6e4819aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:14.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:14.458+0000 7f6e4da00640 1 -- 172.21.15.37:0/1456926644 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e4819f610 con 0x7f6e48074510 2024-09-11T23:18:14.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:14.458+0000 7f6e4da00640 1 --2- 172.21.15.37:0/1456926644 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6e48074510 0x7f6e4819a660 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6e3c00e9f0 tx=0x7f6e3c00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:14.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:14.458+0000 7f6e46000640 1 -- 172.21.15.37:0/1456926644 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e3c00cd80 con 0x7f6e48074510 2024-09-11T23:18:14.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:14.458+0000 7f6e46000640 1 -- 172.21.15.37:0/1456926644 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6e3c010910 con 0x7f6e48074510 2024-09-11T23:18:14.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:14.458+0000 7f6e50400640 1 -- 172.21.15.37:0/1456926644 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e4819f900 con 0x7f6e48074510 2024-09-11T23:18:14.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:14.458+0000 7f6e46000640 1 -- 172.21.15.37:0/1456926644 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e3c018980 con 0x7f6e48074510 2024-09-11T23:18:14.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:14.458+0000 7f6e50400640 1 -- 172.21.15.37:0/1456926644 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e481a71e0 con 0x7f6e48074510 2024-09-11T23:18:14.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:14.459+0000 7f6e50400640 1 -- 172.21.15.37:0/1456926644 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e480748f0 con 0x7f6e48074510 2024-09-11T23:18:14.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:14.461+0000 7f6e46000640 1 -- 172.21.15.37:0/1456926644 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f6e3c010ac0 con 0x7f6e48074510 2024-09-11T23:18:14.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:14.463+0000 7f6e46000640 1 --2- 172.21.15.37:0/1456926644 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f6e300a2c90 0x7f6e300a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:14.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:14.463+0000 7f6e46000640 1 -- 172.21.15.37:0/1456926644 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9295+0+0 (secure 0 0 0) 0x7f6e3c0cfea0 con 0x7f6e48074510 2024-09-11T23:18:14.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:14.463+0000 7f6e4d000640 1 --2- 172.21.15.37:0/1456926644 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f6e300a2c90 0x7f6e300a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:14.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:14.464+0000 7f6e4d000640 1 --2- 172.21.15.37:0/1456926644 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f6e300a2c90 0x7f6e300a5150 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f6e34000c00 tx=0x7f6e34005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:14.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:14.465+0000 7f6e46000640 1 -- 172.21.15.37:0/1456926644 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6e3c09c1d0 con 0x7f6e48074510 2024-09-11T23:18:14.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:14.689+0000 7f6e50400640 1 -- 172.21.15.37:0/1456926644 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6e48109600 con 0x7f6e48074510 2024-09-11T23:18:14.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:14.690+0000 7f6e46000640 1 -- 172.21.15.37:0/1456926644 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11986 (secure 0 0 0) 0x7f6e3c0a04d0 con 0x7f6e48074510 2024-09-11T23:18:14.690 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:18:14.690 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":28,"btime":"2024-09-11T23:17:03:741210+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14448,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/285120996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":285120996},{"type":"v1","addr":"172.21.15.37:6835","nonce":285120996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14460,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/3095283029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":3095283029},{"type":"v1","addr":"172.21.15.37:6837","nonce":3095283029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T23:16:16.642956+0000","modified":"2024-09-11T23:17:03.741190+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24533,"mds_1":24520,"mds_2":24499,"mds_3":24497,"mds_4":24493},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14499":{"gid":14499,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6839/1072030582","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":1072030582},{"type":"v1","addr":"172.21.15.37:6839","nonce":1072030582}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14511":{"gid":14511,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6841/209927476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":209927476},{"type":"v1","addr":"172.21.15.37:6841","nonce":209927476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24440":{"gid":24440,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.123:6833/3380294842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":3380294842},{"type":"v1","addr":"172.21.15.123:6833","nonce":3380294842}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6833/1918127245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":1918127245},{"type":"v1","addr":"172.21.15.160:6833","nonce":1918127245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.123:6835/3928690501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":3928690501},{"type":"v1","addr":"172.21.15.123:6835","nonce":3928690501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":21,"addr":"172.21.15.160:6835/2316897035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":2316897035},{"type":"v1","addr":"172.21.15.160:6835","nonce":2316897035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"h","rank":3,"incarnation":24,"state":"up:active","state_seq":19,"addr":"172.21.15.123:6837/2168535476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":2168535476},{"type":"v1","addr":"172.21.15.123:6837","nonce":2168535476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":20,"addr":"172.21.15.160:6837/2906597021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":2906597021},{"type":"v1","addr":"172.21.15.160:6837","nonce":2906597021}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24520":{"gid":24520,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":18,"addr":"172.21.15.160:6839/2041625862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":2041625862},{"type":"v1","addr":"172.21.15.160:6839","nonce":2041625862}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24533":{"gid":24533,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.123:6839/3077076065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6838","nonce":3077076065},{"type":"v1","addr":"172.21.15.123:6839","nonce":3077076065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24533,"qdb_cluster":[24533,24520,24499,24497,24493]},"id":1}]} 2024-09-11T23:18:14.691 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 28 2024-09-11T23:18:14.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:14.693+0000 7f6e50400640 1 -- 172.21.15.37:0/1456926644 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f6e300a2c90 msgr2=0x7f6e300a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:14.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:14.693+0000 7f6e50400640 1 --2- 172.21.15.37:0/1456926644 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f6e300a2c90 0x7f6e300a5150 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f6e34000c00 tx=0x7f6e34005b50 comp rx=0 tx=0).stop 2024-09-11T23:18:14.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:14.693+0000 7f6e50400640 1 -- 172.21.15.37:0/1456926644 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6e48074510 msgr2=0x7f6e4819a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:14.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:14.693+0000 7f6e50400640 1 --2- 172.21.15.37:0/1456926644 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6e48074510 0x7f6e4819a660 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6e3c00e9f0 tx=0x7f6e3c00eeb0 comp rx=0 tx=0).stop 2024-09-11T23:18:14.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:14.693+0000 7f6e50400640 1 -- 172.21.15.37:0/1456926644 shutdown_connections 2024-09-11T23:18:14.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:14.693+0000 7f6e50400640 1 --2- 172.21.15.37:0/1456926644 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f6e300a2c90 0x7f6e300a5150 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:14.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:14.693+0000 7f6e50400640 1 --2- 172.21.15.37:0/1456926644 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6e4810e450 0x7f6e4819ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:14.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:14.693+0000 7f6e50400640 1 --2- 172.21.15.37:0/1456926644 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e48074e30 0x7f6e4819aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:14.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:14.693+0000 7f6e50400640 1 --2- 172.21.15.37:0/1456926644 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6e48074510 0x7f6e4819a660 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:14.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:14.693+0000 7f6e50400640 1 -- 172.21.15.37:0/1456926644 >> 172.21.15.37:0/1456926644 conn(0x7f6e480fd8b0 msgr2=0x7f6e480fe550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:14.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:14.693+0000 7f6e50400640 1 -- 172.21.15.37:0/1456926644 shutdown_connections 2024-09-11T23:18:14.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:14.693+0000 7f6e50400640 1 -- 172.21.15.37:0/1456926644 wait complete. 2024-09-11T23:18:15.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:18:15 smithi160 ceph-mon[35055]: pgmap v366: 129 pgs: 129 active+clean; 646 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-11T23:18:15.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:18:15 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:18:15.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:18:15 smithi160 ceph-mon[35055]: from='client.? 172.21.15.37:0/1456926644' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:18:15.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:18:15 smithi123 ceph-mon[35438]: pgmap v366: 129 pgs: 129 active+clean; 646 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-11T23:18:15.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:18:15 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:18:15.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:18:15 smithi123 ceph-mon[35438]: from='client.? 172.21.15.37:0/1456926644' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:18:15.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:18:15 smithi037 ceph-mon[30630]: pgmap v366: 129 pgs: 129 active+clean; 646 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-11T23:18:15.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:18:15 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:18:15.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:18:15 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/1456926644' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:18:15.433 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 28, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-11T23:16:16.642956+0000', 'modified': '2024-09-11T23:17:03.741190+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24533, 'mds_1': 24520, 'mds_2': 24499, 'mds_3': 24497, 'mds_4': 24493}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14499': {'gid': 14499, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.37:6839/1072030582', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.37:6838', 'nonce': 1072030582}, {'type': 'v1', 'addr': '172.21.15.37:6839', 'nonce': 1072030582}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14511': {'gid': 14511, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.37:6841/209927476', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.37:6840', 'nonce': 209927476}, {'type': 'v1', 'addr': '172.21.15.37:6841', 'nonce': 209927476}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24440': {'gid': 24440, 'name': 'k', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.123:6833/3380294842', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.123:6832', 'nonce': 3380294842}, {'type': 'v1', 'addr': '172.21.15.123:6833', 'nonce': 3380294842}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24448': {'gid': 24448, 'name': 'l', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.160:6833/1918127245', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.160:6832', 'nonce': 1918127245}, {'type': 'v1', 'addr': '172.21.15.160:6833', 'nonce': 1918127245}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24476': {'gid': 24476, 'name': 'e', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.123:6835/3928690501', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.123:6834', 'nonce': 3928690501}, {'type': 'v1', 'addr': '172.21.15.123:6835', 'nonce': 3928690501}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24493': {'gid': 24493, 'name': 'f', 'rank': 4, 'incarnation': 26, 'state': 'up:active', 'state_seq': 21, 'addr': '172.21.15.160:6835/2316897035', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.160:6834', 'nonce': 2316897035}, {'type': 'v1', 'addr': '172.21.15.160:6835', 'nonce': 2316897035}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24497': {'gid': 24497, 'name': 'h', 'rank': 3, 'incarnation': 24, 'state': 'up:active', 'state_seq': 19, 'addr': '172.21.15.123:6837/2168535476', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.123:6836', 'nonce': 2168535476}, {'type': 'v1', 'addr': '172.21.15.123:6837', 'nonce': 2168535476}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24499': {'gid': 24499, 'name': 'c', 'rank': 2, 'incarnation': 22, 'state': 'up:active', 'state_seq': 20, 'addr': '172.21.15.160:6837/2906597021', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.160:6836', 'nonce': 2906597021}, {'type': 'v1', 'addr': '172.21.15.160:6837', 'nonce': 2906597021}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24520': {'gid': 24520, 'name': 'i', 'rank': 1, 'incarnation': 20, 'state': 'up:active', 'state_seq': 18, 'addr': '172.21.15.160:6839/2041625862', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.160:6838', 'nonce': 2041625862}, {'type': 'v1', 'addr': '172.21.15.160:6839', 'nonce': 2041625862}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24533': {'gid': 24533, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.123:6839/3077076065', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.123:6838', 'nonce': 3077076065}, {'type': 'v1', 'addr': '172.21.15.123:6839', 'nonce': 3077076065}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24533, 'qdb_cluster': [24533, 24520, 24499, 24497, 24493]} 2024-09-11T23:18:15.433 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-09-11T23:18:15.433 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph tell mds.f status 2024-09-11T23:18:16.494 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:18:16.939 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:18:16 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:18:16.939 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:18:16 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:18:16.939 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:18:16 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:18:16.939 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:18:16 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:18:17.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:18:16 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:18:17.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:18:16 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:18:17.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:18:16 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:18:17.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:18:16 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:18:17.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.053+0000 7faaa7200640 1 -- 172.21.15.37:0/1208292692 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faaa0112870 msgr2=0x7faaa0114c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:17.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.053+0000 7faaa7200640 1 --2- 172.21.15.37:0/1208292692 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faaa0112870 0x7faaa0114c60 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7faa9c009ca0 tx=0x7faa9c02a8c0 comp rx=0 tx=0).stop 2024-09-11T23:18:17.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.053+0000 7faaa7200640 1 -- 172.21.15.37:0/1208292692 shutdown_connections 2024-09-11T23:18:17.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.053+0000 7faaa7200640 1 --2- 172.21.15.37:0/1208292692 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faaa0112870 0x7faaa0114c60 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:17.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.053+0000 7faaa7200640 1 --2- 172.21.15.37:0/1208292692 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faaa0077040 0x7faaa0112330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:17.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.053+0000 7faaa7200640 1 --2- 172.21.15.37:0/1208292692 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faaa0076720 0x7faaa0076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:17.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.053+0000 7faaa7200640 1 -- 172.21.15.37:0/1208292692 >> 172.21.15.37:0/1208292692 conn(0x7faaa00ff8d0 msgr2=0x7faaa0101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:17.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.053+0000 7faaa7200640 1 -- 172.21.15.37:0/1208292692 shutdown_connections 2024-09-11T23:18:17.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.053+0000 7faaa7200640 1 -- 172.21.15.37:0/1208292692 wait complete. 2024-09-11T23:18:17.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.054+0000 7faaa7200640 1 Processor -- start 2024-09-11T23:18:17.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.055+0000 7faaa7200640 1 -- start start 2024-09-11T23:18:17.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.055+0000 7faaa7200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faaa0076720 0x7faaa01a45c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:17.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.055+0000 7faaa7200640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faaa0077040 0x7faaa01a4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:17.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.055+0000 7faaa7200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faaa0112870 0x7faaa019e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:17.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.055+0000 7faaa7200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7faaa0118420 con 0x7faaa0112870 2024-09-11T23:18:17.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.055+0000 7faaa7200640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7faaa01182a0 con 0x7faaa0076720 2024-09-11T23:18:17.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.055+0000 7faaa7200640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7faaa01185a0 con 0x7faaa0077040 2024-09-11T23:18:17.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.055+0000 7faaa6800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faaa0112870 0x7faaa019e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:17.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.055+0000 7faaa5e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faaa0076720 0x7faaa01a45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:17.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.055+0000 7faaa6800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faaa0112870 0x7faaa019e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38844/0 (socket says 172.21.15.37:38844) 2024-09-11T23:18:17.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.055+0000 7faaa5e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faaa0076720 0x7faaa01a45c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.37:56996/0 (socket says 172.21.15.37:56996) 2024-09-11T23:18:17.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.055+0000 7faaa6800640 1 -- 172.21.15.37:0/619572280 learned_addr learned my addr 172.21.15.37:0/619572280 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:18:17.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.055+0000 7faaa5400640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faaa0077040 0x7faaa01a4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:17.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.056+0000 7faaa5e00640 1 -- 172.21.15.37:0/619572280 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faaa0077040 msgr2=0x7faaa01a4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:17.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.056+0000 7faaa5e00640 1 --2- 172.21.15.37:0/619572280 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faaa0077040 0x7faaa01a4b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:17.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.056+0000 7faaa5e00640 1 -- 172.21.15.37:0/619572280 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faaa0112870 msgr2=0x7faaa019e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:17.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.056+0000 7faaa5e00640 1 --2- 172.21.15.37:0/619572280 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faaa0112870 0x7faaa019e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:17.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.056+0000 7faaa5e00640 1 -- 172.21.15.37:0/619572280 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faaa019ef00 con 0x7faaa0076720 2024-09-11T23:18:17.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.056+0000 7faaa5e00640 1 --2- 172.21.15.37:0/619572280 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faaa0076720 0x7faaa01a45c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7faa9400e9f0 tx=0x7faa9400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:17.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.056+0000 7faa9aa00640 1 -- 172.21.15.37:0/619572280 <== mon.2 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa9400ccc0 con 0x7faaa0076720 2024-09-11T23:18:17.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.056+0000 7faaa7200640 1 -- 172.21.15.37:0/619572280 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faaa019f1f0 con 0x7faaa0076720 2024-09-11T23:18:17.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.056+0000 7faa9aa00640 1 -- 172.21.15.37:0/619572280 <== mon.2 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faa94010910 con 0x7faaa0076720 2024-09-11T23:18:17.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.056+0000 7faa9aa00640 1 -- 172.21.15.37:0/619572280 <== mon.2 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa94018960 con 0x7faaa0076720 2024-09-11T23:18:17.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.056+0000 7faaa7200640 1 -- 172.21.15.37:0/619572280 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faaa01ab540 con 0x7faaa0076720 2024-09-11T23:18:17.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.059+0000 7faaab25f740 1 Processor -- start 2024-09-11T23:18:17.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.059+0000 7faaab25f740 1 -- start start 2024-09-11T23:18:17.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.060+0000 7faa9aa00640 1 -- 172.21.15.37:0/619572280 <== mon.2 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7faa94010ac0 con 0x7faaa0076720 2024-09-11T23:18:17.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.060+0000 7faaab25f740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557a9b5d14e0 0x557a9b5d18c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:17.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.060+0000 7faaab25f740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557a9b5d1e00 0x557a9b5dc180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:17.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.060+0000 7faaab25f740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557a9b5dc6c0 0x557a9b5deab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:17.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.060+0000 7faaab25f740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x557a9b5370b0 con 0x557a9b5d14e0 2024-09-11T23:18:17.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.060+0000 7faaab25f740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x557a9b4deab0 con 0x557a9b5d1e00 2024-09-11T23:18:17.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.060+0000 7faaab25f740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x557a9b533070 con 0x557a9b5dc6c0 2024-09-11T23:18:17.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.060+0000 7faaa6800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557a9b5d14e0 0x557a9b5d18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:17.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.060+0000 7faaa5e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557a9b5d1e00 0x557a9b5dc180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:17.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.060+0000 7faaa6800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557a9b5d14e0 0x557a9b5d18c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38856/0 (socket says 172.21.15.37:38856) 2024-09-11T23:18:17.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.060+0000 7faaa6800640 1 -- 172.21.15.37:0/2167321594 learned_addr learned my addr 172.21.15.37:0/2167321594 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:18:17.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.060+0000 7faaa5400640 1 --2- 172.21.15.37:0/2167321594 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557a9b5dc6c0 0x557a9b5deab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:17.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.060+0000 7faaa6800640 1 -- 172.21.15.37:0/2167321594 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557a9b5dc6c0 msgr2=0x557a9b5deab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:17.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.061+0000 7faaa6800640 1 --2- 172.21.15.37:0/2167321594 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557a9b5dc6c0 0x557a9b5deab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:17.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.061+0000 7faaa6800640 1 -- 172.21.15.37:0/2167321594 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557a9b5d1e00 msgr2=0x557a9b5dc180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:17.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.061+0000 7faaa6800640 1 --2- 172.21.15.37:0/2167321594 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557a9b5d1e00 0x557a9b5dc180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:17.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.061+0000 7faaa6800640 1 -- 172.21.15.37:0/2167321594 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a9b4eb4a0 con 0x557a9b5d14e0 2024-09-11T23:18:17.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.061+0000 7faaa6800640 1 --2- 172.21.15.37:0/2167321594 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557a9b5d14e0 0x557a9b5d18c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7faa9c005f80 tx=0x7faa9c0093e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be923fd26cf1fb04 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:17.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.061+0000 7faa8f000640 1 -- 172.21.15.37:0/2167321594 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa9c031db0 con 0x557a9b5d14e0 2024-09-11T23:18:17.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.061+0000 7faa8f000640 1 -- 172.21.15.37:0/2167321594 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faa9c036030 con 0x557a9b5d14e0 2024-09-11T23:18:17.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.061+0000 7faa8f000640 1 -- 172.21.15.37:0/2167321594 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa9c004360 con 0x557a9b5d14e0 2024-09-11T23:18:17.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.062+0000 7faa9aa00640 1 --2- 172.21.15.37:0/619572280 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7faa880a2c10 0x7faa880a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:17.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.062+0000 7faa9aa00640 1 -- 172.21.15.37:0/619572280 <== mon.2 v2:172.21.15.123:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9295+0+0 (secure 0 0 0) 0x7faa940cf9e0 con 0x7faaa0076720 2024-09-11T23:18:17.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.062+0000 7faaab25f740 1 -- 172.21.15.37:0/2167321594 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557a9b5d14e0 msgr2=0x557a9b5d18c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:17.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.062+0000 7faaab25f740 1 --2- 172.21.15.37:0/2167321594 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557a9b5d14e0 0x557a9b5d18c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7faa9c005f80 tx=0x7faa9c0093e0 comp rx=0 tx=0).stop 2024-09-11T23:18:17.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.062+0000 7faaa5e00640 1 --2- 172.21.15.37:0/619572280 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7faa880a2c10 0x7faa880a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:17.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.062+0000 7faaab25f740 1 -- 172.21.15.37:0/2167321594 shutdown_connections 2024-09-11T23:18:17.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.062+0000 7faaab25f740 1 --2- 172.21.15.37:0/2167321594 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557a9b5d1e00 0x557a9b5dc180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:17.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.062+0000 7faaab25f740 1 --2- 172.21.15.37:0/2167321594 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557a9b5dc6c0 0x557a9b5deab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:17.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.062+0000 7faaab25f740 1 --2- 172.21.15.37:0/2167321594 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557a9b5d14e0 0x557a9b5d18c0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:17.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.062+0000 7faaab25f740 1 -- 172.21.15.37:0/2167321594 >> 172.21.15.37:0/2167321594 conn(0x557a9b5cda70 msgr2=0x557a9b5cde50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:17.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.062+0000 7faaab25f740 1 -- 172.21.15.37:0/2167321594 shutdown_connections 2024-09-11T23:18:17.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.062+0000 7faaab25f740 1 -- 172.21.15.37:0/2167321594 wait complete. 2024-09-11T23:18:17.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.063+0000 7faaa5e00640 1 --2- 172.21.15.37:0/619572280 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7faa880a2c10 0x7faa880a50d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7faa940986e0 tx=0x7faa940d5530 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:17.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.063+0000 7faaab25f740 1 -- start start 2024-09-11T23:18:17.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.063+0000 7faaab25f740 1 Processor -- start 2024-09-11T23:18:17.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.063+0000 7faaab25f740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557a9b5d14e0 0x557a9b5d9500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:17.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.063+0000 7faaab25f740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557a9b5d1e00 0x557a9b5d9a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:17.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.063+0000 7faaab25f740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557a9b5dc6c0 0x557a9b5d9f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:17.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.063+0000 7faaab25f740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x557a9b5df1b0 con 0x557a9b5d1e00 2024-09-11T23:18:17.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.063+0000 7faaab25f740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x557a9b4bf920 con 0x557a9b5dc6c0 2024-09-11T23:18:17.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.063+0000 7faaab25f740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x557a9b5df330 con 0x557a9b5d14e0 2024-09-11T23:18:17.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.064+0000 7faaab25f740 10 client.0 _ll_register_callbacks cb 0x557a9b4e38a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:18:17.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.064+0000 7faaa5400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557a9b5d1e00 0x557a9b5d9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:17.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.064+0000 7faaa5400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557a9b5d1e00 0x557a9b5d9a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38862/0 (socket says 172.21.15.37:38862) 2024-09-11T23:18:17.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.064+0000 7faaa5400640 1 -- 172.21.15.37:0/1671965854 learned_addr learned my addr 172.21.15.37:0/1671965854 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:18:17.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.064+0000 7faaa6800640 1 --2- 172.21.15.37:0/1671965854 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557a9b5d14e0 0x557a9b5d9500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:17.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.064+0000 7faaa6800640 1 --2- 172.21.15.37:0/1671965854 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557a9b5dc6c0 0x557a9b5d9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:17.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.064+0000 7faaa5400640 1 -- 172.21.15.37:0/1671965854 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557a9b5d14e0 msgr2=0x557a9b5d9500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:17.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.064+0000 7faaa5400640 1 --2- 172.21.15.37:0/1671965854 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557a9b5d14e0 0x557a9b5d9500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:17.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.064+0000 7faaa5400640 1 -- 172.21.15.37:0/1671965854 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557a9b5dc6c0 msgr2=0x557a9b5d9f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:17.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.064+0000 7faaa5400640 1 --2- 172.21.15.37:0/1671965854 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557a9b5dc6c0 0x557a9b5d9f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:17.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.064+0000 7faaa5400640 1 -- 172.21.15.37:0/1671965854 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a9b2a82b0 con 0x557a9b5d1e00 2024-09-11T23:18:17.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.064+0000 7faaa6800640 1 --2- 172.21.15.37:0/1671965854 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557a9b5dc6c0 0x557a9b5d9f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:18:17.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.065+0000 7faaa5400640 1 --2- 172.21.15.37:0/1671965854 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557a9b5d1e00 0x557a9b5d9a40 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7faa90012700 tx=0x7faa90012bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=606d92caf1cbb930 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:17.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.065+0000 7faa83400640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-11T23:18:17.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.065+0000 7faa83400640 1 -- 172.21.15.37:0/1671965854 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa9000f8c0 con 0x557a9b5d1e00 2024-09-11T23:18:17.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.065+0000 7faaab25f740 1 -- 172.21.15.37:0/1671965854 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faa9c036030 con 0x557a9b5d1e00 2024-09-11T23:18:17.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.065+0000 7faa83400640 1 -- 172.21.15.37:0/1671965854 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9295+0+0 (secure 0 0 0) 0x7faa9000fa60 con 0x557a9b5d1e00 2024-09-11T23:18:17.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.065+0000 7faa83400640 1 -- 172.21.15.37:0/1671965854 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7faa90025050 con 0x557a9b5d1e00 2024-09-11T23:18:17.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.065+0000 7faaab25f740 10 client.14964 fetch_fsmap learned FSMap version 28 2024-09-11T23:18:17.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.065+0000 7faaab25f740 1 -- 172.21.15.37:0/1671965854 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557a9b5eae60 con 0x557a9b5d1e00 2024-09-11T23:18:17.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.066+0000 7faa83400640 1 -- 172.21.15.37:0/1671965854 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faa9c036030 con 0x557a9b5d1e00 2024-09-11T23:18:17.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.066+0000 7faa83400640 1 -- 172.21.15.37:0/1671965854 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7faa90010430 con 0x557a9b5d1e00 2024-09-11T23:18:17.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.066+0000 7faaab25f740 10 client.14964 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T23:18:17.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.066+0000 7faaab25f740 10 client.14964 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-11T23:18:17.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.066+0000 7faaab25f740 20 client.14964 populate_metadata read hostname 'smithi037' 2024-09-11T23:18:17.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.066+0000 7faaab25f740 1 --2- 172.21.15.37:0/1671965854 >> [v2:172.21.15.160:6834/2316897035,v1:172.21.15.160:6835/2316897035] conn(0x557a9b5ed440 0x557a9b5ee8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:17.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.066+0000 7faaab25f740 4 client.14964 mds_command: new command op to 24493 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T23:18:17.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.066+0000 7faaab25f740 1 -- 172.21.15.37:0/1671965854 --> [v2:172.21.15.160:6834/2316897035,v1:172.21.15.160:6835/2316897035] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557a9b544620 con 0x557a9b5ed440 2024-09-11T23:18:17.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.067+0000 7faaa6800640 1 --2- 172.21.15.37:0/1671965854 >> [v2:172.21.15.160:6834/2316897035,v1:172.21.15.160:6835/2316897035] conn(0x557a9b5ed440 0x557a9b5ee8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:17.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.067+0000 7faaa6800640 1 --2- 172.21.15.37:0/1671965854 >> [v2:172.21.15.160:6834/2316897035,v1:172.21.15.160:6835/2316897035] conn(0x557a9b5ed440 0x557a9b5ee8b0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=cb5fbb1ac66e0642 server_cookie=d96f217db84697f2 in_seq=0 out_seq=0 2024-09-11T23:18:17.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.067+0000 7faa83400640 10 client.14964 ms_handle_connect on v2:172.21.15.160:6834/2316897035 2024-09-11T23:18:17.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.068+0000 7faa83400640 1 -- 172.21.15.37:0/1671965854 <== mds.4 v2:172.21.15.160:6834/2316897035 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557a9b544620 con 0x557a9b5ed440 2024-09-11T23:18:17.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.068+0000 7faa83400640 10 client.14964 handle_command_reply: tid=0 2024-09-11T23:18:17.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.068+0000 7faaab25f740 1 client.14964 shutdown 2024-09-11T23:18:17.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.069+0000 7faaab25f740 1 -- 172.21.15.37:0/1671965854 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557a9b5d1e00 msgr2=0x557a9b5d9a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:17.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.069+0000 7faaab25f740 1 --2- 172.21.15.37:0/1671965854 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557a9b5d1e00 0x557a9b5d9a40 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7faa90012700 tx=0x7faa90012bc0 comp rx=0 tx=0).stop 2024-09-11T23:18:17.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.069+0000 7faaab25f740 1 -- 172.21.15.37:0/1671965854 shutdown_connections 2024-09-11T23:18:17.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.069+0000 7faaab25f740 1 --2- 172.21.15.37:0/1671965854 >> [v2:172.21.15.160:6834/2316897035,v1:172.21.15.160:6835/2316897035] conn(0x557a9b5ed440 0x557a9b5ee8b0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:17.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.069+0000 7faaab25f740 1 --2- 172.21.15.37:0/1671965854 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557a9b5dc6c0 0x557a9b5d9f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:17.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.069+0000 7faaab25f740 1 --2- 172.21.15.37:0/1671965854 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557a9b5d1e00 0x557a9b5d9a40 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:17.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.069+0000 7faaab25f740 1 --2- 172.21.15.37:0/1671965854 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557a9b5d14e0 0x557a9b5d9500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:17.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.069+0000 7faa83400640 0 client.14964 ms_handle_reset on v2:172.21.15.160:6834/2316897035 2024-09-11T23:18:17.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.069+0000 7faaab25f740 1 -- 172.21.15.37:0/1671965854 >> 172.21.15.37:0/1671965854 conn(0x557a9b5cda70 msgr2=0x557a9b5ccbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:17.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.069+0000 7faaab25f740 1 -- 172.21.15.37:0/1671965854 shutdown_connections 2024-09-11T23:18:17.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.069+0000 7faaab25f740 1 -- 172.21.15.37:0/1671965854 wait complete. 2024-09-11T23:18:17.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.069+0000 7faaab25f740 20 client.14964 trim_cache size 0 max 16384 2024-09-11T23:18:17.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.088+0000 7faaab25f740 1 Processor -- start 2024-09-11T23:18:17.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.088+0000 7faaab25f740 1 -- start start 2024-09-11T23:18:17.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.088+0000 7faaab25f740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557a9b5d14e0 0x557a9b5ecd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:17.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.088+0000 7faaab25f740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557a9b5d1e00 0x557a9b5d4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:17.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.088+0000 7faaab25f740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557a9b5dc6c0 0x557a9b5d9dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:17.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.088+0000 7faaab25f740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x557a9b5ecbf0 con 0x557a9b5d14e0 2024-09-11T23:18:17.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.088+0000 7faaab25f740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x557a9b5ed2c0 con 0x557a9b5d1e00 2024-09-11T23:18:17.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.088+0000 7faaab25f740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x557a9b5ed990 con 0x557a9b5dc6c0 2024-09-11T23:18:17.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.088+0000 7faaa5400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557a9b5d1e00 0x557a9b5d4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:17.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.088+0000 7faaa5400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557a9b5d1e00 0x557a9b5d4800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.37:57026/0 (socket says 172.21.15.37:57026) 2024-09-11T23:18:17.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.088+0000 7faaa6800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557a9b5d14e0 0x557a9b5ecd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:17.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.088+0000 7faaa5400640 1 -- 172.21.15.37:0/3315602915 learned_addr learned my addr 172.21.15.37:0/3315602915 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:18:17.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.089+0000 7faaa5400640 1 -- 172.21.15.37:0/3315602915 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557a9b5dc6c0 msgr2=0x557a9b5d9dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:17.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.089+0000 7faaa5400640 1 --2- 172.21.15.37:0/3315602915 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557a9b5dc6c0 0x557a9b5d9dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:17.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.089+0000 7faaa5400640 1 -- 172.21.15.37:0/3315602915 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557a9b5d14e0 msgr2=0x557a9b5ecd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:17.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.089+0000 7faaa5400640 1 --2- 172.21.15.37:0/3315602915 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557a9b5d14e0 0x557a9b5ecd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:17.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.089+0000 7faaa5400640 1 -- 172.21.15.37:0/3315602915 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a9b5cd8a0 con 0x557a9b5d1e00 2024-09-11T23:18:17.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.089+0000 7faaa5400640 1 --2- 172.21.15.37:0/3315602915 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557a9b5d1e00 0x557a9b5d4800 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7faa90010800 tx=0x7faa90005e30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=168864384eb63a99 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:17.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.089+0000 7faa8e600640 1 -- 172.21.15.37:0/3315602915 <== mon.2 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa900104f0 con 0x557a9b5d1e00 2024-09-11T23:18:17.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.089+0000 7faa8e600640 1 -- 172.21.15.37:0/3315602915 <== mon.2 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faa900055b0 con 0x557a9b5d1e00 2024-09-11T23:18:17.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.089+0000 7faa8e600640 1 -- 172.21.15.37:0/3315602915 <== mon.2 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa9000f880 con 0x557a9b5d1e00 2024-09-11T23:18:17.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.090+0000 7faaab25f740 1 -- 172.21.15.37:0/3315602915 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557a9b5d1e00 msgr2=0x557a9b5d4800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:17.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.090+0000 7faaab25f740 1 --2- 172.21.15.37:0/3315602915 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557a9b5d1e00 0x557a9b5d4800 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7faa90010800 tx=0x7faa90005e30 comp rx=0 tx=0).stop 2024-09-11T23:18:17.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.090+0000 7faaab25f740 1 -- 172.21.15.37:0/3315602915 shutdown_connections 2024-09-11T23:18:17.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.090+0000 7faaab25f740 1 --2- 172.21.15.37:0/3315602915 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557a9b5d1e00 0x557a9b5d4800 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:17.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.090+0000 7faaab25f740 1 --2- 172.21.15.37:0/3315602915 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557a9b5dc6c0 0x557a9b5d9dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:17.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.090+0000 7faaab25f740 1 --2- 172.21.15.37:0/3315602915 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557a9b5d14e0 0x557a9b5ecd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:17.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.090+0000 7faaab25f740 1 -- 172.21.15.37:0/3315602915 >> 172.21.15.37:0/3315602915 conn(0x557a9b5cda70 msgr2=0x557a9b5d85f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:17.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.090+0000 7faaab25f740 1 -- 172.21.15.37:0/3315602915 shutdown_connections 2024-09-11T23:18:17.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.090+0000 7faaab25f740 1 -- 172.21.15.37:0/3315602915 wait complete. 2024-09-11T23:18:17.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.091+0000 7faaab25f740 1 -- start start 2024-09-11T23:18:17.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.091+0000 7faaab25f740 1 Processor -- start 2024-09-11T23:18:17.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.091+0000 7faaab25f740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557a9b5d14e0 0x557a9b5f0b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:17.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.091+0000 7faaab25f740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557a9b5d1e00 0x557a9b5f1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:17.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.091+0000 7faaab25f740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557a9b5dc6c0 0x557a9b5f15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:17.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.091+0000 7faaab25f740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x557a9b5ee730 con 0x557a9b5d1e00 2024-09-11T23:18:17.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.091+0000 7faaab25f740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x557a9b5ee060 con 0x557a9b5dc6c0 2024-09-11T23:18:17.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.091+0000 7faaab25f740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x557a9b5eee00 con 0x557a9b5d14e0 2024-09-11T23:18:17.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.091+0000 7faaab25f740 10 client.0 _ll_register_callbacks cb 0x7faa90009e60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:18:17.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.092+0000 7faaa5400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557a9b5d1e00 0x557a9b5f1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:17.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.092+0000 7faaa5400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557a9b5d1e00 0x557a9b5f1060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38868/0 (socket says 172.21.15.37:38868) 2024-09-11T23:18:17.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.092+0000 7faaa5400640 1 -- 172.21.15.37:0/651360028 learned_addr learned my addr 172.21.15.37:0/651360028 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:18:17.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.092+0000 7faaa6800640 1 --2- 172.21.15.37:0/651360028 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557a9b5d14e0 0x557a9b5f0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:17.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.092+0000 7faaa6800640 1 --2- 172.21.15.37:0/651360028 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557a9b5dc6c0 0x557a9b5f15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:17.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.092+0000 7faaa6800640 1 -- 172.21.15.37:0/651360028 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557a9b5dc6c0 msgr2=0x557a9b5f15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:17.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.092+0000 7faaa6800640 1 --2- 172.21.15.37:0/651360028 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557a9b5dc6c0 0x557a9b5f15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:17.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.092+0000 7faaa6800640 1 -- 172.21.15.37:0/651360028 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557a9b5d1e00 msgr2=0x557a9b5f1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:17.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.092+0000 7faaa6800640 1 --2- 172.21.15.37:0/651360028 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557a9b5d1e00 0x557a9b5f1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:17.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.092+0000 7faaa6800640 1 -- 172.21.15.37:0/651360028 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a9b5d2370 con 0x557a9b5d14e0 2024-09-11T23:18:17.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.092+0000 7faaa6800640 1 --2- 172.21.15.37:0/651360028 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557a9b5d14e0 0x557a9b5f0b20 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7faa9c02ade0 tx=0x7faa9c02a8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2289448ab9c15642 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:17.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.092+0000 7faa83400640 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2024-09-11T23:18:17.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.093+0000 7faa83400640 1 -- 172.21.15.37:0/651360028 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa9c004b40 con 0x557a9b5d14e0 2024-09-11T23:18:17.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.093+0000 7faa83400640 1 -- 172.21.15.37:0/651360028 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9295+0+0 (secure 0 0 0) 0x7faa9c004ce0 con 0x557a9b5d14e0 2024-09-11T23:18:17.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.093+0000 7faaab25f740 1 -- 172.21.15.37:0/651360028 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faa900055b0 con 0x557a9b5d14e0 2024-09-11T23:18:17.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.093+0000 7faa83400640 1 -- 172.21.15.37:0/651360028 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7faa9c003970 con 0x557a9b5d14e0 2024-09-11T23:18:17.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.093+0000 7faaab25f740 10 client.24982 fetch_fsmap learned FSMap version 28 2024-09-11T23:18:17.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.093+0000 7faaab25f740 1 -- 172.21.15.37:0/651360028 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557a9b657eb0 con 0x557a9b5d14e0 2024-09-11T23:18:17.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.093+0000 7faa83400640 1 -- 172.21.15.37:0/651360028 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faa900055b0 con 0x557a9b5d14e0 2024-09-11T23:18:17.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.093+0000 7faa83400640 1 -- 172.21.15.37:0/651360028 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7faa9c043070 con 0x557a9b5d14e0 2024-09-11T23:18:17.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.093+0000 7faaab25f740 10 client.24982 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T23:18:17.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.093+0000 7faaab25f740 10 client.24982 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-11T23:18:17.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.093+0000 7faaab25f740 20 client.24982 populate_metadata read hostname 'smithi037' 2024-09-11T23:18:17.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.094+0000 7faaab25f740 1 --2- 172.21.15.37:0/651360028 >> [v2:172.21.15.160:6834/2316897035,v1:172.21.15.160:6835/2316897035] conn(0x557a9b65c740 0x557a9b65b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:17.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.094+0000 7faaab25f740 4 client.24982 mds_command: new command op to 24493 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T23:18:17.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.094+0000 7faaab25f740 1 -- 172.21.15.37:0/651360028 --> [v2:172.21.15.160:6834/2316897035,v1:172.21.15.160:6835/2316897035] -- command(tid 0: {"prefix": "status"}) -- 0x557a9b53eb30 con 0x557a9b65c740 2024-09-11T23:18:17.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.094+0000 7faaa5400640 1 --2- 172.21.15.37:0/651360028 >> [v2:172.21.15.160:6834/2316897035,v1:172.21.15.160:6835/2316897035] conn(0x557a9b65c740 0x557a9b65b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:17.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.094+0000 7faaa5400640 1 --2- 172.21.15.37:0/651360028 >> [v2:172.21.15.160:6834/2316897035,v1:172.21.15.160:6835/2316897035] conn(0x557a9b65c740 0x557a9b65b450 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=312ab5d311643db9 server_cookie=f2a7c7a6ffadf650 in_seq=0 out_seq=0 2024-09-11T23:18:17.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.094+0000 7faa83400640 10 client.24982 ms_handle_connect on v2:172.21.15.160:6834/2316897035 2024-09-11T23:18:17.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.095+0000 7faa83400640 1 -- 172.21.15.37:0/651360028 <== mds.4 v2:172.21.15.160:6834/2316897035 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x557a9b53eb30 con 0x557a9b65c740 2024-09-11T23:18:17.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.095+0000 7faa83400640 10 client.24982 handle_command_reply: tid=0 2024-09-11T23:18:17.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.095+0000 7faaab25f740 1 client.24982 shutdown 2024-09-11T23:18:17.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.095+0000 7faaab25f740 1 -- 172.21.15.37:0/651360028 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557a9b5d14e0 msgr2=0x557a9b5f0b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:17.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.095+0000 7faaab25f740 1 --2- 172.21.15.37:0/651360028 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557a9b5d14e0 0x557a9b5f0b20 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7faa9c02ade0 tx=0x7faa9c02a8c0 comp rx=0 tx=0).stop 2024-09-11T23:18:17.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.095+0000 7faaab25f740 1 -- 172.21.15.37:0/651360028 shutdown_connections 2024-09-11T23:18:17.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.095+0000 7faaab25f740 1 --2- 172.21.15.37:0/651360028 >> [v2:172.21.15.160:6834/2316897035,v1:172.21.15.160:6835/2316897035] conn(0x557a9b65c740 0x557a9b65b450 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:17.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.095+0000 7faaab25f740 1 --2- 172.21.15.37:0/651360028 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557a9b5dc6c0 0x557a9b5f15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:17.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.095+0000 7faaab25f740 1 --2- 172.21.15.37:0/651360028 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557a9b5d1e00 0x557a9b5f1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:17.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.095+0000 7faa83400640 0 client.24982 ms_handle_reset on v2:172.21.15.160:6834/2316897035 2024-09-11T23:18:17.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.095+0000 7faaab25f740 1 --2- 172.21.15.37:0/651360028 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557a9b5d14e0 0x557a9b5f0b20 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:17.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.095+0000 7faaab25f740 1 -- 172.21.15.37:0/651360028 >> 172.21.15.37:0/651360028 conn(0x557a9b5cda70 msgr2=0x557a9b5cc3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:17.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.095+0000 7faaab25f740 1 -- 172.21.15.37:0/651360028 shutdown_connections 2024-09-11T23:18:17.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.095+0000 7faaab25f740 1 -- 172.21.15.37:0/651360028 wait complete. 2024-09-11T23:18:17.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.095+0000 7faaab25f740 20 client.24982 trim_cache size 0 max 16384 2024-09-11T23:18:17.100 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-11T23:18:17.100 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "8b03efce-7092-11ef-bcea-c7b262605968", 2024-09-11T23:18:17.100 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 4, 2024-09-11T23:18:17.100 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 24493, 2024-09-11T23:18:17.100 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2024-09-11T23:18:17.100 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2024-09-11T23:18:17.100 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2024-09-11T23:18:17.100 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 74.359497442999995, 2024-09-11T23:18:17.100 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 28, 2024-09-11T23:18:17.101 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 95, 2024-09-11T23:18:17.101 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 93, 2024-09-11T23:18:17.101 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 152.343125117 2024-09-11T23:18:17.101 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-11T23:18:17.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.096+0000 7faaa7200640 1 -- 172.21.15.37:0/619572280 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7faa880a2c10 msgr2=0x7faa880a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:17.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.096+0000 7faaa7200640 1 --2- 172.21.15.37:0/619572280 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7faa880a2c10 0x7faa880a50d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7faa940986e0 tx=0x7faa940d5530 comp rx=0 tx=0).stop 2024-09-11T23:18:17.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.096+0000 7faaa7200640 1 -- 172.21.15.37:0/619572280 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faaa0076720 msgr2=0x7faaa01a45c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:17.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.096+0000 7faaa7200640 1 --2- 172.21.15.37:0/619572280 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faaa0076720 0x7faaa01a45c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7faa9400e9f0 tx=0x7faa9400eeb0 comp rx=0 tx=0).stop 2024-09-11T23:18:17.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.096+0000 7faaa7200640 1 -- 172.21.15.37:0/619572280 shutdown_connections 2024-09-11T23:18:17.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.096+0000 7faaa7200640 1 --2- 172.21.15.37:0/619572280 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7faa880a2c10 0x7faa880a50d0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:17.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.096+0000 7faaa7200640 1 --2- 172.21.15.37:0/619572280 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faaa0112870 0x7faaa019e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:17.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.096+0000 7faaa7200640 1 --2- 172.21.15.37:0/619572280 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faaa0077040 0x7faaa01a4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:17.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.096+0000 7faaa7200640 1 --2- 172.21.15.37:0/619572280 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faaa0076720 0x7faaa01a45c0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:17.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.096+0000 7faaa7200640 1 -- 172.21.15.37:0/619572280 >> 172.21.15.37:0/619572280 conn(0x7faaa00ff8d0 msgr2=0x7faaa0101cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:17.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.096+0000 7faaa7200640 1 -- 172.21.15.37:0/619572280 shutdown_connections 2024-09-11T23:18:17.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:17.096+0000 7faaa7200640 1 -- 172.21.15.37:0/619572280 wait complete. 2024-09-11T23:18:17.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:18:16 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:18:17.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:18:16 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:18:17.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:18:16 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:18:17.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:18:16 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:18:17.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:18:17 smithi037 ceph-mon[30630]: pgmap v367: 129 pgs: 129 active+clean; 646 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-09-11T23:18:17.923 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph tell mds.h status 2024-09-11T23:18:18.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:18:17 smithi123 ceph-mon[35438]: pgmap v367: 129 pgs: 129 active+clean; 646 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-09-11T23:18:18.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:18:17 smithi160 ceph-mon[35055]: pgmap v367: 129 pgs: 129 active+clean; 646 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-09-11T23:18:18.343 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:18:18.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.913+0000 7f55ea600640 1 -- 172.21.15.37:0/687493997 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55e4104010 msgr2=0x7f55e41043f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:18.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.913+0000 7f55ea600640 1 --2- 172.21.15.37:0/687493997 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55e4104010 0x7f55e41043f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f55d4009900 tx=0x7f55d402a3f0 comp rx=0 tx=0).stop 2024-09-11T23:18:18.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.913+0000 7f55ea600640 1 -- 172.21.15.37:0/687493997 shutdown_connections 2024-09-11T23:18:18.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.913+0000 7f55ea600640 1 --2- 172.21.15.37:0/687493997 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55e41049c0 0x7f55e4108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:18.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.913+0000 7f55ea600640 1 --2- 172.21.15.37:0/687493997 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f55e4109140 0x7f55e4110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:18.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.913+0000 7f55ea600640 1 --2- 172.21.15.37:0/687493997 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55e4104010 0x7f55e41043f0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:18.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.913+0000 7f55ea600640 1 -- 172.21.15.37:0/687493997 >> 172.21.15.37:0/687493997 conn(0x7f55e40ffa50 msgr2=0x7f55e4101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:18.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.913+0000 7f55ea600640 1 -- 172.21.15.37:0/687493997 shutdown_connections 2024-09-11T23:18:18.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.913+0000 7f55ea600640 1 -- 172.21.15.37:0/687493997 wait complete. 2024-09-11T23:18:18.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.914+0000 7f55ea600640 1 Processor -- start 2024-09-11T23:18:18.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.914+0000 7f55ea600640 1 -- start start 2024-09-11T23:18:18.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.914+0000 7f55ea600640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f55e4104010 0x7f55e419a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:18.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.914+0000 7f55ea600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55e41049c0 0x7f55e419ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:18.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.914+0000 7f55ea600640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55e4109140 0x7f55e419eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:18.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.914+0000 7f55ea600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f55e4114140 con 0x7f55e41049c0 2024-09-11T23:18:18.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.914+0000 7f55ea600640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f55e4113fc0 con 0x7f55e4109140 2024-09-11T23:18:18.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.914+0000 7f55ea600640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f55e41142c0 con 0x7f55e4104010 2024-09-11T23:18:18.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.915+0000 7f55e2a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55e41049c0 0x7f55e419ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:18.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.915+0000 7f55e2a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55e41049c0 0x7f55e419ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38894/0 (socket says 172.21.15.37:38894) 2024-09-11T23:18:18.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.915+0000 7f55e2a00640 1 -- 172.21.15.37:0/2558906006 learned_addr learned my addr 172.21.15.37:0/2558906006 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:18:18.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.915+0000 7f55e3400640 1 --2- 172.21.15.37:0/2558906006 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f55e4104010 0x7f55e419a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:18.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.915+0000 7f55e3e00640 1 --2- 172.21.15.37:0/2558906006 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55e4109140 0x7f55e419eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:18.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.915+0000 7f55e2a00640 1 -- 172.21.15.37:0/2558906006 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f55e4104010 msgr2=0x7f55e419a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:18.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.915+0000 7f55e2a00640 1 --2- 172.21.15.37:0/2558906006 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f55e4104010 0x7f55e419a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:18.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.915+0000 7f55e2a00640 1 -- 172.21.15.37:0/2558906006 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55e4109140 msgr2=0x7f55e419eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:18.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.915+0000 7f55e2a00640 1 --2- 172.21.15.37:0/2558906006 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55e4109140 0x7f55e419eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:18.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.915+0000 7f55e2a00640 1 -- 172.21.15.37:0/2558906006 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55e419f5b0 con 0x7f55e41049c0 2024-09-11T23:18:18.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.915+0000 7f55e2a00640 1 --2- 172.21.15.37:0/2558906006 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55e41049c0 0x7f55e419ab40 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f55d000ea60 tx=0x7f55d000ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:18.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.916+0000 7f55dbe00640 1 -- 172.21.15.37:0/2558906006 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55d000cde0 con 0x7f55e41049c0 2024-09-11T23:18:18.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.916+0000 7f55dbe00640 1 -- 172.21.15.37:0/2558906006 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f55d00035f0 con 0x7f55e41049c0 2024-09-11T23:18:18.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.916+0000 7f55dbe00640 1 -- 172.21.15.37:0/2558906006 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55d0010670 con 0x7f55e41049c0 2024-09-11T23:18:18.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.916+0000 7f55ea600640 1 -- 172.21.15.37:0/2558906006 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55e419f8a0 con 0x7f55e41049c0 2024-09-11T23:18:18.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.916+0000 7f55ea600640 1 -- 172.21.15.37:0/2558906006 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55e41a7180 con 0x7f55e41049c0 2024-09-11T23:18:18.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.919+0000 7f55ed06b740 1 Processor -- start 2024-09-11T23:18:18.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.919+0000 7f55ed06b740 1 -- start start 2024-09-11T23:18:18.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.919+0000 7f55dbe00640 1 -- 172.21.15.37:0/2558906006 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f55d00037a0 con 0x7f55e41049c0 2024-09-11T23:18:18.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.920+0000 7f55ed06b740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c495da7330 0x55c495da7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:18.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.920+0000 7f55ed06b740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c495da7c50 0x55c495db1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:18.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.920+0000 7f55ed06b740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c495db2510 0x55c495db4900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:18.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.920+0000 7f55ed06b740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55c495d0d0b0 con 0x55c495db2510 2024-09-11T23:18:18.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.920+0000 7f55ed06b740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55c495cb4ab0 con 0x55c495da7c50 2024-09-11T23:18:18.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.920+0000 7f55ed06b740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55c495d09070 con 0x55c495da7330 2024-09-11T23:18:18.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.920+0000 7f55e3e00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c495da7330 0x55c495da7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:18.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.920+0000 7f55e2a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c495db2510 0x55c495db4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:18.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.920+0000 7f55e3e00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c495da7330 0x55c495da7710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.37:48000/0 (socket says 172.21.15.37:48000) 2024-09-11T23:18:18.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.920+0000 7f55e3e00640 1 -- 172.21.15.37:0/2249650609 learned_addr learned my addr 172.21.15.37:0/2249650609 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:18:18.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.920+0000 7f55e3400640 1 --2- 172.21.15.37:0/2249650609 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c495da7c50 0x55c495db1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:18.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.920+0000 7f55e3e00640 1 -- 172.21.15.37:0/2249650609 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c495da7c50 msgr2=0x55c495db1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:18.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.920+0000 7f55e3e00640 1 --2- 172.21.15.37:0/2249650609 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c495da7c50 0x55c495db1fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:18.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.920+0000 7f55e3e00640 1 -- 172.21.15.37:0/2249650609 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c495db2510 msgr2=0x55c495db4900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:18.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.920+0000 7f55e3e00640 1 --2- 172.21.15.37:0/2249650609 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c495db2510 0x55c495db4900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:18.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.920+0000 7f55e3e00640 1 -- 172.21.15.37:0/2249650609 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c495cc14a0 con 0x55c495da7330 2024-09-11T23:18:18.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.921+0000 7f55e3e00640 1 --2- 172.21.15.37:0/2249650609 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c495da7330 0x55c495da7710 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f55dc009f50 tx=0x7f55dc0118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=33b3dfc9fd83c6b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:18.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.921+0000 7f55d8c00640 1 -- 172.21.15.37:0/2249650609 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55dc004d20 con 0x55c495da7330 2024-09-11T23:18:18.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.921+0000 7f55d8c00640 1 -- 172.21.15.37:0/2249650609 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f55dc004050 con 0x55c495da7330 2024-09-11T23:18:18.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.921+0000 7f55d8c00640 1 -- 172.21.15.37:0/2249650609 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55dc005280 con 0x55c495da7330 2024-09-11T23:18:18.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.922+0000 7f55dbe00640 1 --2- 172.21.15.37:0/2558906006 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f55c80a2c90 0x7f55c80a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:18.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.922+0000 7f55dbe00640 1 -- 172.21.15.37:0/2558906006 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9295+0+0 (secure 0 0 0) 0x7f55d00cf8a0 con 0x7f55e41049c0 2024-09-11T23:18:18.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.922+0000 7f55e3400640 1 --2- 172.21.15.37:0/2558906006 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f55c80a2c90 0x7f55c80a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:18.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.922+0000 7f55ed06b740 1 -- 172.21.15.37:0/2249650609 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c495da7330 msgr2=0x55c495da7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:18.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.922+0000 7f55ed06b740 1 --2- 172.21.15.37:0/2249650609 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c495da7330 0x55c495da7710 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f55dc009f50 tx=0x7f55dc0118d0 comp rx=0 tx=0).stop 2024-09-11T23:18:18.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.922+0000 7f55ed06b740 1 -- 172.21.15.37:0/2249650609 shutdown_connections 2024-09-11T23:18:18.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.922+0000 7f55ed06b740 1 --2- 172.21.15.37:0/2249650609 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c495da7c50 0x55c495db1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:18.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.922+0000 7f55ed06b740 1 --2- 172.21.15.37:0/2249650609 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c495db2510 0x55c495db4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:18.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.922+0000 7f55ed06b740 1 --2- 172.21.15.37:0/2249650609 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c495da7330 0x55c495da7710 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:18.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.922+0000 7f55ed06b740 1 -- 172.21.15.37:0/2249650609 >> 172.21.15.37:0/2249650609 conn(0x55c495da38c0 msgr2=0x55c495da3ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:18.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.922+0000 7f55ed06b740 1 -- 172.21.15.37:0/2249650609 shutdown_connections 2024-09-11T23:18:18.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.923+0000 7f55ed06b740 1 -- 172.21.15.37:0/2249650609 wait complete. 2024-09-11T23:18:18.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.923+0000 7f55e3400640 1 --2- 172.21.15.37:0/2558906006 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f55c80a2c90 0x7f55c80a5150 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f55d4009230 tx=0x7f55d40058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:18.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.923+0000 7f55ed06b740 1 -- start start 2024-09-11T23:18:18.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.923+0000 7f55ed06b740 1 Processor -- start 2024-09-11T23:18:18.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.924+0000 7f55ed06b740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c495da7330 0x55c495daf510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:18.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.924+0000 7f55ed06b740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c495da7c50 0x55c495dafa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:18.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.924+0000 7f55ed06b740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c495db2510 0x55c495daff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:18.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.924+0000 7f55ed06b740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55c495db5060 con 0x55c495da7c50 2024-09-11T23:18:18.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.924+0000 7f55ed06b740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55c495c95920 con 0x55c495db2510 2024-09-11T23:18:18.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.924+0000 7f55ed06b740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55c495db51e0 con 0x55c495da7330 2024-09-11T23:18:18.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.924+0000 7f55ed06b740 10 client.0 _ll_register_callbacks cb 0x55c495cb98a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:18:18.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.924+0000 7f55e3400640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c495da7330 0x55c495daf510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:18.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.924+0000 7f55e3400640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c495da7330 0x55c495daf510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.37:48010/0 (socket says 172.21.15.37:48010) 2024-09-11T23:18:18.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.924+0000 7f55e3400640 1 -- 172.21.15.37:0/4188581948 learned_addr learned my addr 172.21.15.37:0/4188581948 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:18:18.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.924+0000 7f55e3e00640 1 --2- 172.21.15.37:0/4188581948 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c495db2510 0x55c495daff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:18.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.925+0000 7f55e2a00640 1 --2- 172.21.15.37:0/4188581948 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c495da7c50 0x55c495dafa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:18.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.925+0000 7f55e3400640 1 -- 172.21.15.37:0/4188581948 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c495db2510 msgr2=0x55c495daff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:18.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.925+0000 7f55e3400640 1 --2- 172.21.15.37:0/4188581948 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c495db2510 0x55c495daff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:18.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.925+0000 7f55e3400640 1 -- 172.21.15.37:0/4188581948 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c495da7c50 msgr2=0x55c495dafa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:18.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.925+0000 7f55e3400640 1 --2- 172.21.15.37:0/4188581948 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c495da7c50 0x55c495dafa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:18.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.925+0000 7f55e3400640 1 -- 172.21.15.37:0/4188581948 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c495a7e2b0 con 0x55c495da7330 2024-09-11T23:18:18.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.925+0000 7f55e3400640 1 --2- 172.21.15.37:0/4188581948 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c495da7330 0x55c495daf510 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f55d4033000 tx=0x7f55d4009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c078dc757bc2eebc server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:18.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.925+0000 7f55cd600640 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2024-09-11T23:18:18.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.926+0000 7f55cd600640 1 -- 172.21.15.37:0/4188581948 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55d404e070 con 0x55c495da7330 2024-09-11T23:18:18.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.926+0000 7f55ed06b740 1 -- 172.21.15.37:0/4188581948 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f55dc004050 con 0x55c495da7330 2024-09-11T23:18:18.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.926+0000 7f55cd600640 1 -- 172.21.15.37:0/4188581948 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9295+0+0 (secure 0 0 0) 0x7f55d4003b80 con 0x55c495da7330 2024-09-11T23:18:18.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.926+0000 7f55cd600640 1 -- 172.21.15.37:0/4188581948 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f55d405a050 con 0x55c495da7330 2024-09-11T23:18:18.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.926+0000 7f55ed06b740 10 client.24994 fetch_fsmap learned FSMap version 28 2024-09-11T23:18:18.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.926+0000 7f55ed06b740 1 -- 172.21.15.37:0/4188581948 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c495dc0e00 con 0x55c495da7330 2024-09-11T23:18:18.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.926+0000 7f55cd600640 1 -- 172.21.15.37:0/4188581948 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f55dc004050 con 0x55c495da7330 2024-09-11T23:18:18.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.927+0000 7f55cd600640 1 -- 172.21.15.37:0/4188581948 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f55d403d450 con 0x55c495da7330 2024-09-11T23:18:18.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.927+0000 7f55ed06b740 10 client.24994 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T23:18:18.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.927+0000 7f55ed06b740 10 client.24994 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-11T23:18:18.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.927+0000 7f55ed06b740 20 client.24994 populate_metadata read hostname 'smithi037' 2024-09-11T23:18:18.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.927+0000 7f55ed06b740 1 --2- 172.21.15.37:0/4188581948 >> [v2:172.21.15.123:6836/2168535476,v1:172.21.15.123:6837/2168535476] conn(0x55c495dc3390 0x55c495dc4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:18.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.927+0000 7f55ed06b740 4 client.24994 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T23:18:18.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.927+0000 7f55ed06b740 1 -- 172.21.15.37:0/4188581948 --> [v2:172.21.15.123:6836/2168535476,v1:172.21.15.123:6837/2168535476] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c495d1a620 con 0x55c495dc3390 2024-09-11T23:18:18.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.928+0000 7f55e2a00640 1 --2- 172.21.15.37:0/4188581948 >> [v2:172.21.15.123:6836/2168535476,v1:172.21.15.123:6837/2168535476] conn(0x55c495dc3390 0x55c495dc4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:18.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.928+0000 7f55e2a00640 1 --2- 172.21.15.37:0/4188581948 >> [v2:172.21.15.123:6836/2168535476,v1:172.21.15.123:6837/2168535476] conn(0x55c495dc3390 0x55c495dc4800 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=c476d10d17556ec5 server_cookie=54f807427b6a7e7a in_seq=0 out_seq=0 2024-09-11T23:18:18.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.928+0000 7f55cd600640 10 client.24994 ms_handle_connect on v2:172.21.15.123:6836/2168535476 2024-09-11T23:18:18.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.929+0000 7f55cd600640 1 -- 172.21.15.37:0/4188581948 <== mds.3 v2:172.21.15.123:6836/2168535476 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c495d1a620 con 0x55c495dc3390 2024-09-11T23:18:18.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.929+0000 7f55cd600640 10 client.24994 handle_command_reply: tid=0 2024-09-11T23:18:18.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.929+0000 7f55ed06b740 1 client.24994 shutdown 2024-09-11T23:18:18.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.929+0000 7f55ed06b740 1 -- 172.21.15.37:0/4188581948 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c495da7330 msgr2=0x55c495daf510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:18.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.929+0000 7f55ed06b740 1 --2- 172.21.15.37:0/4188581948 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c495da7330 0x55c495daf510 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f55d4033000 tx=0x7f55d4009260 comp rx=0 tx=0).stop 2024-09-11T23:18:18.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.929+0000 7f55ed06b740 1 -- 172.21.15.37:0/4188581948 shutdown_connections 2024-09-11T23:18:18.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.929+0000 7f55ed06b740 1 --2- 172.21.15.37:0/4188581948 >> [v2:172.21.15.123:6836/2168535476,v1:172.21.15.123:6837/2168535476] conn(0x55c495dc3390 0x55c495dc4800 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:18.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.929+0000 7f55ed06b740 1 --2- 172.21.15.37:0/4188581948 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c495db2510 0x55c495daff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:18.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.929+0000 7f55ed06b740 1 --2- 172.21.15.37:0/4188581948 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c495da7c50 0x55c495dafa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:18.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.929+0000 7f55ed06b740 1 --2- 172.21.15.37:0/4188581948 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c495da7330 0x55c495daf510 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:18.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.929+0000 7f55ed06b740 1 -- 172.21.15.37:0/4188581948 >> 172.21.15.37:0/4188581948 conn(0x55c495da38c0 msgr2=0x55c495da95a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:18.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.929+0000 7f55cd600640 0 client.24994 ms_handle_reset on v2:172.21.15.123:6836/2168535476 2024-09-11T23:18:18.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.930+0000 7f55ed06b740 1 -- 172.21.15.37:0/4188581948 shutdown_connections 2024-09-11T23:18:18.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.930+0000 7f55ed06b740 1 -- 172.21.15.37:0/4188581948 wait complete. 2024-09-11T23:18:18.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.930+0000 7f55ed06b740 20 client.24994 trim_cache size 0 max 16384 2024-09-11T23:18:18.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.948+0000 7f55ed06b740 1 Processor -- start 2024-09-11T23:18:18.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.949+0000 7f55ed06b740 1 -- start start 2024-09-11T23:18:18.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.949+0000 7f55ed06b740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c495da7330 0x55c495da3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:18.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.949+0000 7f55ed06b740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c495da7c50 0x55c495dafaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:18.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.949+0000 7f55ed06b740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c495db2510 0x55c495daffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:18.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.949+0000 7f55ed06b740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55c495dc2b40 con 0x55c495da7c50 2024-09-11T23:18:18.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.949+0000 7f55ed06b740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55c495dc3210 con 0x55c495da7330 2024-09-11T23:18:18.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.949+0000 7f55ed06b740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55c495dc38e0 con 0x55c495db2510 2024-09-11T23:18:18.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.949+0000 7f55e2a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c495da7c50 0x55c495dafaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:18.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.949+0000 7f55e2a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c495da7c50 0x55c495dafaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38914/0 (socket says 172.21.15.37:38914) 2024-09-11T23:18:18.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.949+0000 7f55e2a00640 1 -- 172.21.15.37:0/2103188124 learned_addr learned my addr 172.21.15.37:0/2103188124 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:18:18.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.949+0000 7f55e3e00640 1 --2- 172.21.15.37:0/2103188124 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c495db2510 0x55c495daffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:18.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.950+0000 7f55e3400640 1 --2- 172.21.15.37:0/2103188124 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c495da7330 0x55c495da3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:18.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.950+0000 7f55e3e00640 1 -- 172.21.15.37:0/2103188124 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c495da7330 msgr2=0x55c495da3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:18.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.950+0000 7f55e3e00640 1 --2- 172.21.15.37:0/2103188124 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c495da7330 0x55c495da3ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:18.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.950+0000 7f55e3e00640 1 -- 172.21.15.37:0/2103188124 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c495da7c50 msgr2=0x55c495dafaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:18.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.950+0000 7f55e3e00640 1 --2- 172.21.15.37:0/2103188124 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c495da7c50 0x55c495dafaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:18.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.950+0000 7f55e3e00640 1 -- 172.21.15.37:0/2103188124 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c495da7a40 con 0x55c495db2510 2024-09-11T23:18:18.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.950+0000 7f55e2a00640 1 --2- 172.21.15.37:0/2103188124 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c495da7c50 0x55c495dafaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:18:18.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.950+0000 7f55e3400640 1 --2- 172.21.15.37:0/2103188124 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c495da7330 0x55c495da3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:18:18.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.950+0000 7f55e3e00640 1 --2- 172.21.15.37:0/2103188124 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c495db2510 0x55c495daffe0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f55dc004740 tx=0x7f55dc009ce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f1d0367f7216c988 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:18.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.951+0000 7f55cfe00640 1 -- 172.21.15.37:0/2103188124 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55dc02a070 con 0x55c495db2510 2024-09-11T23:18:18.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.951+0000 7f55cfe00640 1 -- 172.21.15.37:0/2103188124 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f55dc0059b0 con 0x55c495db2510 2024-09-11T23:18:18.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.951+0000 7f55cfe00640 1 -- 172.21.15.37:0/2103188124 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55dc00fa10 con 0x55c495db2510 2024-09-11T23:18:18.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.951+0000 7f55ed06b740 1 -- 172.21.15.37:0/2103188124 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c495db2510 msgr2=0x55c495daffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:18.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.951+0000 7f55ed06b740 1 --2- 172.21.15.37:0/2103188124 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c495db2510 0x55c495daffe0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f55dc004740 tx=0x7f55dc009ce0 comp rx=0 tx=0).stop 2024-09-11T23:18:18.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.951+0000 7f55ed06b740 1 -- 172.21.15.37:0/2103188124 shutdown_connections 2024-09-11T23:18:18.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.951+0000 7f55ed06b740 1 --2- 172.21.15.37:0/2103188124 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c495db2510 0x55c495daffe0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:18.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.951+0000 7f55ed06b740 1 --2- 172.21.15.37:0/2103188124 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c495da7c50 0x55c495dafaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:18.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.952+0000 7f55ed06b740 1 --2- 172.21.15.37:0/2103188124 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c495da7330 0x55c495da3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:18.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.952+0000 7f55ed06b740 1 -- 172.21.15.37:0/2103188124 >> 172.21.15.37:0/2103188124 conn(0x55c495da38c0 msgr2=0x55c495dade20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:18.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.952+0000 7f55ed06b740 1 -- 172.21.15.37:0/2103188124 shutdown_connections 2024-09-11T23:18:18.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.952+0000 7f55ed06b740 1 -- 172.21.15.37:0/2103188124 wait complete. 2024-09-11T23:18:18.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.952+0000 7f55ed06b740 1 -- start start 2024-09-11T23:18:18.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.952+0000 7f55ed06b740 1 Processor -- start 2024-09-11T23:18:18.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.953+0000 7f55ed06b740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c495da7330 0x55c495dcd330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:18.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.953+0000 7f55ed06b740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c495da7c50 0x55c495dac440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:18.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.953+0000 7f55ed06b740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c495db2510 0x55c495daca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:18.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.953+0000 7f55ed06b740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55c495dc4680 con 0x55c495db2510 2024-09-11T23:18:18.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.953+0000 7f55ed06b740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55c495dc3fb0 con 0x55c495da7330 2024-09-11T23:18:18.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.953+0000 7f55ed06b740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55c495dc4d50 con 0x55c495da7c50 2024-09-11T23:18:18.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.953+0000 7f55ed06b740 10 client.0 _ll_register_callbacks cb 0x7f55d40318c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:18:18.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.953+0000 7f55e3e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c495db2510 0x55c495daca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:18.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.953+0000 7f55e3e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c495db2510 0x55c495daca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38926/0 (socket says 172.21.15.37:38926) 2024-09-11T23:18:18.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.953+0000 7f55e3e00640 1 -- 172.21.15.37:0/3206865216 learned_addr learned my addr 172.21.15.37:0/3206865216 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:18:18.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.953+0000 7f55e2a00640 1 --2- 172.21.15.37:0/3206865216 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c495da7c50 0x55c495dac440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:18.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.954+0000 7f55e3400640 1 --2- 172.21.15.37:0/3206865216 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c495da7330 0x55c495dcd330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:18.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.954+0000 7f55e3e00640 1 -- 172.21.15.37:0/3206865216 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c495da7c50 msgr2=0x55c495dac440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:18.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.954+0000 7f55e3e00640 1 --2- 172.21.15.37:0/3206865216 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c495da7c50 0x55c495dac440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:18.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.954+0000 7f55e3e00640 1 -- 172.21.15.37:0/3206865216 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c495da7330 msgr2=0x55c495dcd330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:18.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.954+0000 7f55e3e00640 1 --2- 172.21.15.37:0/3206865216 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c495da7330 0x55c495dcd330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:18.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.954+0000 7f55e3e00640 1 -- 172.21.15.37:0/3206865216 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c495dad270 con 0x55c495db2510 2024-09-11T23:18:18.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.954+0000 7f55e3400640 1 --2- 172.21.15.37:0/3206865216 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c495da7330 0x55c495dcd330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:18:18.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.954+0000 7f55e3e00640 1 --2- 172.21.15.37:0/3206865216 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c495db2510 0x55c495daca70 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f55dc005cd0 tx=0x7f55dc004230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c12858e27b28adf2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:18.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.954+0000 7f55cd600640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-11T23:18:18.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.954+0000 7f55cd600640 1 -- 172.21.15.37:0/3206865216 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55dc035020 con 0x55c495db2510 2024-09-11T23:18:18.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.954+0000 7f55cd600640 1 -- 172.21.15.37:0/3206865216 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9295+0+0 (secure 0 0 0) 0x7f55dc00f790 con 0x55c495db2510 2024-09-11T23:18:18.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.955+0000 7f55ed06b740 1 -- 172.21.15.37:0/3206865216 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c495d14b30 con 0x55c495db2510 2024-09-11T23:18:18.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.955+0000 7f55cd600640 1 -- 172.21.15.37:0/3206865216 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f55dc02a050 con 0x55c495db2510 2024-09-11T23:18:18.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.955+0000 7f55ed06b740 10 client.14988 fetch_fsmap learned FSMap version 28 2024-09-11T23:18:18.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.955+0000 7f55ed06b740 1 -- 172.21.15.37:0/3206865216 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c495e2dbd0 con 0x55c495db2510 2024-09-11T23:18:18.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.955+0000 7f55cd600640 1 -- 172.21.15.37:0/3206865216 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55c495d14b30 con 0x55c495db2510 2024-09-11T23:18:18.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.955+0000 7f55cd600640 1 -- 172.21.15.37:0/3206865216 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f55dc02f770 con 0x55c495db2510 2024-09-11T23:18:18.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.955+0000 7f55ed06b740 10 client.14988 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T23:18:18.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.955+0000 7f55ed06b740 10 client.14988 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-11T23:18:18.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.955+0000 7f55ed06b740 20 client.14988 populate_metadata read hostname 'smithi037' 2024-09-11T23:18:18.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.955+0000 7f55ed06b740 1 --2- 172.21.15.37:0/3206865216 >> [v2:172.21.15.123:6836/2168535476,v1:172.21.15.123:6837/2168535476] conn(0x55c495e32090 0x55c495e30da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:18.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.956+0000 7f55ed06b740 4 client.14988 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T23:18:18.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.956+0000 7f55ed06b740 1 -- 172.21.15.37:0/3206865216 --> [v2:172.21.15.123:6836/2168535476,v1:172.21.15.123:6837/2168535476] -- command(tid 0: {"prefix": "status"}) -- 0x55c495c90f80 con 0x55c495e32090 2024-09-11T23:18:18.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.956+0000 7f55e3400640 1 --2- 172.21.15.37:0/3206865216 >> [v2:172.21.15.123:6836/2168535476,v1:172.21.15.123:6837/2168535476] conn(0x55c495e32090 0x55c495e30da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:18.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.956+0000 7f55e3400640 1 --2- 172.21.15.37:0/3206865216 >> [v2:172.21.15.123:6836/2168535476,v1:172.21.15.123:6837/2168535476] conn(0x55c495e32090 0x55c495e30da0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=8739b1761c7f045c server_cookie=4d4ba1d98bb06b41 in_seq=0 out_seq=0 2024-09-11T23:18:18.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.956+0000 7f55cd600640 10 client.14988 ms_handle_connect on v2:172.21.15.123:6836/2168535476 2024-09-11T23:18:18.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.957+0000 7f55cd600640 1 -- 172.21.15.37:0/3206865216 <== mds.3 v2:172.21.15.123:6836/2168535476 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55c495c90f80 con 0x55c495e32090 2024-09-11T23:18:18.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.957+0000 7f55cd600640 10 client.14988 handle_command_reply: tid=0 2024-09-11T23:18:18.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.957+0000 7f55ed06b740 1 client.14988 shutdown 2024-09-11T23:18:18.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.957+0000 7f55ed06b740 1 -- 172.21.15.37:0/3206865216 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c495db2510 msgr2=0x55c495daca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:18.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.957+0000 7f55ed06b740 1 --2- 172.21.15.37:0/3206865216 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c495db2510 0x55c495daca70 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f55dc005cd0 tx=0x7f55dc004230 comp rx=0 tx=0).stop 2024-09-11T23:18:18.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.957+0000 7f55ed06b740 1 -- 172.21.15.37:0/3206865216 shutdown_connections 2024-09-11T23:18:18.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.957+0000 7f55ed06b740 1 --2- 172.21.15.37:0/3206865216 >> [v2:172.21.15.123:6836/2168535476,v1:172.21.15.123:6837/2168535476] conn(0x55c495e32090 0x55c495e30da0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:18.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.957+0000 7f55ed06b740 1 --2- 172.21.15.37:0/3206865216 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c495db2510 0x55c495daca70 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:18.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.957+0000 7f55ed06b740 1 --2- 172.21.15.37:0/3206865216 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c495da7c50 0x55c495dac440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:18.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.957+0000 7f55ed06b740 1 --2- 172.21.15.37:0/3206865216 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c495da7330 0x55c495dcd330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:18.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.957+0000 7f55ed06b740 1 -- 172.21.15.37:0/3206865216 >> 172.21.15.37:0/3206865216 conn(0x55c495da38c0 msgr2=0x55c495da8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:18.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.957+0000 7f55cd600640 0 client.14988 ms_handle_reset on v2:172.21.15.123:6836/2168535476 2024-09-11T23:18:18.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.957+0000 7f55ed06b740 1 -- 172.21.15.37:0/3206865216 shutdown_connections 2024-09-11T23:18:18.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.957+0000 7f55ed06b740 1 -- 172.21.15.37:0/3206865216 wait complete. 2024-09-11T23:18:18.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.958+0000 7f55ed06b740 20 client.14988 trim_cache size 0 max 16384 2024-09-11T23:18:18.961 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-11T23:18:18.961 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "8b03efce-7092-11ef-bcea-c7b262605968", 2024-09-11T23:18:18.961 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 3, 2024-09-11T23:18:18.961 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 24497, 2024-09-11T23:18:18.962 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2024-09-11T23:18:18.962 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2024-09-11T23:18:18.962 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2024-09-11T23:18:18.962 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 77.230175338999999, 2024-09-11T23:18:18.962 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 28, 2024-09-11T23:18:18.962 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 95, 2024-09-11T23:18:18.962 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 93, 2024-09-11T23:18:18.962 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 148.84171700499999 2024-09-11T23:18:18.962 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-11T23:18:18.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.958+0000 7f55ea600640 1 -- 172.21.15.37:0/2558906006 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f55c80a2c90 msgr2=0x7f55c80a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:18.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.958+0000 7f55ea600640 1 --2- 172.21.15.37:0/2558906006 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f55c80a2c90 0x7f55c80a5150 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f55d4009230 tx=0x7f55d40058d0 comp rx=0 tx=0).stop 2024-09-11T23:18:18.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.958+0000 7f55ea600640 1 -- 172.21.15.37:0/2558906006 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55e41049c0 msgr2=0x7f55e419ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:18.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.958+0000 7f55ea600640 1 --2- 172.21.15.37:0/2558906006 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55e41049c0 0x7f55e419ab40 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f55d000ea60 tx=0x7f55d000ef20 comp rx=0 tx=0).stop 2024-09-11T23:18:18.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.958+0000 7f55ea600640 1 -- 172.21.15.37:0/2558906006 shutdown_connections 2024-09-11T23:18:18.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.958+0000 7f55ea600640 1 --2- 172.21.15.37:0/2558906006 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f55c80a2c90 0x7f55c80a5150 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:18.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.958+0000 7f55ea600640 1 --2- 172.21.15.37:0/2558906006 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55e4109140 0x7f55e419eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:18.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.958+0000 7f55ea600640 1 --2- 172.21.15.37:0/2558906006 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55e41049c0 0x7f55e419ab40 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:18.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.958+0000 7f55ea600640 1 --2- 172.21.15.37:0/2558906006 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f55e4104010 0x7f55e419a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:18.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.958+0000 7f55ea600640 1 -- 172.21.15.37:0/2558906006 >> 172.21.15.37:0/2558906006 conn(0x7f55e40ffa50 msgr2=0x7f55e4100e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:18.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.959+0000 7f55ea600640 1 -- 172.21.15.37:0/2558906006 shutdown_connections 2024-09-11T23:18:18.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:18.959+0000 7f55ea600640 1 -- 172.21.15.37:0/2558906006 wait complete. 2024-09-11T23:18:19.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:18:19 smithi037 ceph-mon[30630]: pgmap v368: 129 pgs: 129 active+clean; 646 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-11T23:18:19.357 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:18:19 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:18:19.357 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:18:19 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:18:19.357 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:18:19 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:18:19.357 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:18:19 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:18:19.357 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:18:19 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:18:19.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:18:19 smithi160 ceph-mon[35055]: pgmap v368: 129 pgs: 129 active+clean; 646 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-11T23:18:19.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:18:19 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:18:19.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:18:19 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:18:19.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:18:19 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:18:19.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:18:19 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:18:19.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:18:19 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:18:19.725 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph tell mds.c status 2024-09-11T23:18:19.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:18:19 smithi123 ceph-mon[35438]: pgmap v368: 129 pgs: 129 active+clean; 646 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-11T23:18:19.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:18:19 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:18:19.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:18:19 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:18:19.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:18:19 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:18:19.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:18:19 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:18:19.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:18:19 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:18:20.104 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:18:20.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.673+0000 7fb05a800640 1 -- 172.21.15.37:0/1237598687 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb0541049a0 msgr2=0x7fb0541089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:20.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.673+0000 7fb05a800640 1 --2- 172.21.15.37:0/1237598687 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb0541049a0 0x7fb0541089f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb03c009860 tx=0x7fb03c02a340 comp rx=0 tx=0).stop 2024-09-11T23:18:20.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.674+0000 7fb05a800640 1 -- 172.21.15.37:0/1237598687 shutdown_connections 2024-09-11T23:18:20.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.674+0000 7fb05a800640 1 --2- 172.21.15.37:0/1237598687 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb0541049a0 0x7fb0541089f0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:20.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.674+0000 7fb05a800640 1 --2- 172.21.15.37:0/1237598687 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb054109120 0x7fb054110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:20.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.674+0000 7fb05a800640 1 --2- 172.21.15.37:0/1237598687 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb054103ff0 0x7fb0541043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:20.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.674+0000 7fb05a800640 1 -- 172.21.15.37:0/1237598687 >> 172.21.15.37:0/1237598687 conn(0x7fb0540ffa90 msgr2=0x7fb054101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:20.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.674+0000 7fb05a800640 1 -- 172.21.15.37:0/1237598687 shutdown_connections 2024-09-11T23:18:20.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.674+0000 7fb05a800640 1 -- 172.21.15.37:0/1237598687 wait complete. 2024-09-11T23:18:20.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.675+0000 7fb05a800640 1 Processor -- start 2024-09-11T23:18:20.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.675+0000 7fb05a800640 1 -- start start 2024-09-11T23:18:20.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.675+0000 7fb05a800640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb054103ff0 0x7fb05419a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:20.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.675+0000 7fb05a800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0541049a0 0x7fb05419ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:20.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.675+0000 7fb05a800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb054109120 0x7fb05419eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:20.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.675+0000 7fb05a800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb054114120 con 0x7fb0541049a0 2024-09-11T23:18:20.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.675+0000 7fb05a800640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fb054113fa0 con 0x7fb054109120 2024-09-11T23:18:20.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.675+0000 7fb05a800640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fb0541142a0 con 0x7fb054103ff0 2024-09-11T23:18:20.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.675+0000 7fb04aa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0541049a0 0x7fb05419ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:20.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.675+0000 7fb053400640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb054103ff0 0x7fb05419a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:20.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.675+0000 7fb04aa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0541049a0 0x7fb05419ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60650/0 (socket says 172.21.15.37:60650) 2024-09-11T23:18:20.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.675+0000 7fb04aa00640 1 -- 172.21.15.37:0/129515962 learned_addr learned my addr 172.21.15.37:0/129515962 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:18:20.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.676+0000 7fb053e00640 1 --2- 172.21.15.37:0/129515962 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb054109120 0x7fb05419eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:20.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.676+0000 7fb053400640 1 -- 172.21.15.37:0/129515962 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb054109120 msgr2=0x7fb05419eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:20.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.676+0000 7fb053400640 1 --2- 172.21.15.37:0/129515962 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb054109120 0x7fb05419eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:20.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.676+0000 7fb053400640 1 -- 172.21.15.37:0/129515962 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0541049a0 msgr2=0x7fb05419ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:20.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.676+0000 7fb053400640 1 --2- 172.21.15.37:0/129515962 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0541049a0 0x7fb05419ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:20.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.676+0000 7fb053400640 1 -- 172.21.15.37:0/129515962 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb05419f5d0 con 0x7fb054103ff0 2024-09-11T23:18:20.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.676+0000 7fb04aa00640 1 --2- 172.21.15.37:0/129515962 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0541049a0 0x7fb05419ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:18:20.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.676+0000 7fb053400640 1 --2- 172.21.15.37:0/129515962 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb054103ff0 0x7fb05419a620 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb04400e790 tx=0x7fb04400ec50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:20.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.677+0000 7fb050c00640 1 -- 172.21.15.37:0/129515962 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb04400eea0 con 0x7fb054103ff0 2024-09-11T23:18:20.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.677+0000 7fb050c00640 1 -- 172.21.15.37:0/129515962 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb04400ccc0 con 0x7fb054103ff0 2024-09-11T23:18:20.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.677+0000 7fb05a800640 1 -- 172.21.15.37:0/129515962 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb05419f8c0 con 0x7fb054103ff0 2024-09-11T23:18:20.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.677+0000 7fb050c00640 1 -- 172.21.15.37:0/129515962 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb044018780 con 0x7fb054103ff0 2024-09-11T23:18:20.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.677+0000 7fb05a800640 1 -- 172.21.15.37:0/129515962 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0541a71a0 con 0x7fb054103ff0 2024-09-11T23:18:20.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.680+0000 7fb05d3da740 1 Processor -- start 2024-09-11T23:18:20.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.680+0000 7fb05d3da740 1 -- start start 2024-09-11T23:18:20.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.680+0000 7fb050c00640 1 -- 172.21.15.37:0/129515962 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fb044010430 con 0x7fb054103ff0 2024-09-11T23:18:20.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.680+0000 7fb05d3da740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556011d92330 0x556011d92710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:20.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.680+0000 7fb05d3da740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556011d92c50 0x556011d9cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:20.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.680+0000 7fb05d3da740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556011d9d510 0x556011d9f900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:20.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.680+0000 7fb05d3da740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x556011cf80b0 con 0x556011d92c50 2024-09-11T23:18:20.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.680+0000 7fb05d3da740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x556011c9fab0 con 0x556011d9d510 2024-09-11T23:18:20.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.680+0000 7fb05d3da740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x556011cf4070 con 0x556011d92330 2024-09-11T23:18:20.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.680+0000 7fb053400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556011d92c50 0x556011d9cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:20.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.681+0000 7fb053e00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556011d92330 0x556011d92710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:20.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.681+0000 7fb04aa00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556011d9d510 0x556011d9f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:20.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.681+0000 7fb053e00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556011d92330 0x556011d92710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.37:37042/0 (socket says 172.21.15.37:37042) 2024-09-11T23:18:20.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.681+0000 7fb053e00640 1 -- 172.21.15.37:0/1755310495 learned_addr learned my addr 172.21.15.37:0/1755310495 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:18:20.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.681+0000 7fb053e00640 1 -- 172.21.15.37:0/1755310495 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556011d9d510 msgr2=0x556011d9f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:20.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.681+0000 7fb053e00640 1 --2- 172.21.15.37:0/1755310495 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556011d9d510 0x556011d9f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:20.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.681+0000 7fb053e00640 1 -- 172.21.15.37:0/1755310495 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556011d92c50 msgr2=0x556011d9cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:20.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.681+0000 7fb053e00640 1 --2- 172.21.15.37:0/1755310495 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556011d92c50 0x556011d9cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:20.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.681+0000 7fb053e00640 1 -- 172.21.15.37:0/1755310495 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556011cac4a0 con 0x556011d92330 2024-09-11T23:18:20.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.681+0000 7fb053e00640 1 --2- 172.21.15.37:0/1755310495 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556011d92330 0x556011d92710 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb04c009f50 tx=0x7fb04c0118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e07843786d70c2f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:20.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.682+0000 7fb048c00640 1 -- 172.21.15.37:0/1755310495 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb04c004d20 con 0x556011d92330 2024-09-11T23:18:20.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.682+0000 7fb048c00640 1 -- 172.21.15.37:0/1755310495 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb04c004050 con 0x556011d92330 2024-09-11T23:18:20.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.682+0000 7fb048c00640 1 -- 172.21.15.37:0/1755310495 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb04c005280 con 0x556011d92330 2024-09-11T23:18:20.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.682+0000 7fb050c00640 1 --2- 172.21.15.37:0/129515962 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fb0380a2c10 0x7fb0380a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:20.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.682+0000 7fb050c00640 1 -- 172.21.15.37:0/129515962 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9295+0+0 (secure 0 0 0) 0x7fb0440cf790 con 0x7fb054103ff0 2024-09-11T23:18:20.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.682+0000 7fb053400640 1 --2- 172.21.15.37:0/129515962 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fb0380a2c10 0x7fb0380a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:20.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.682+0000 7fb05d3da740 1 -- 172.21.15.37:0/1755310495 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556011d92330 msgr2=0x556011d92710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:20.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.682+0000 7fb05d3da740 1 --2- 172.21.15.37:0/1755310495 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556011d92330 0x556011d92710 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb04c009f50 tx=0x7fb04c0118d0 comp rx=0 tx=0).stop 2024-09-11T23:18:20.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.682+0000 7fb05d3da740 1 -- 172.21.15.37:0/1755310495 shutdown_connections 2024-09-11T23:18:20.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.682+0000 7fb05d3da740 1 --2- 172.21.15.37:0/1755310495 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556011d9d510 0x556011d9f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:20.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.682+0000 7fb05d3da740 1 --2- 172.21.15.37:0/1755310495 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556011d92c50 0x556011d9cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:20.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.682+0000 7fb05d3da740 1 --2- 172.21.15.37:0/1755310495 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556011d92330 0x556011d92710 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:20.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.682+0000 7fb05d3da740 1 -- 172.21.15.37:0/1755310495 >> 172.21.15.37:0/1755310495 conn(0x556011d8e8c0 msgr2=0x556011d8eca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:20.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.683+0000 7fb05d3da740 1 -- 172.21.15.37:0/1755310495 shutdown_connections 2024-09-11T23:18:20.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.683+0000 7fb05d3da740 1 -- 172.21.15.37:0/1755310495 wait complete. 2024-09-11T23:18:20.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.683+0000 7fb053400640 1 --2- 172.21.15.37:0/129515962 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fb0380a2c10 0x7fb0380a50d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fb0440a4150 tx=0x7fb0440d5530 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:20.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.683+0000 7fb05d3da740 1 -- start start 2024-09-11T23:18:20.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.683+0000 7fb05d3da740 1 Processor -- start 2024-09-11T23:18:20.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.684+0000 7fb05d3da740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556011d92330 0x556011d9a620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:20.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.684+0000 7fb05d3da740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556011d92c50 0x556011d9ab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:20.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.684+0000 7fb05d3da740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556011d9d510 0x556011d9b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:20.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.684+0000 7fb05d3da740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x556011da0060 con 0x556011d92330 2024-09-11T23:18:20.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.684+0000 7fb05d3da740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x556011c80920 con 0x556011d92c50 2024-09-11T23:18:20.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.684+0000 7fb05d3da740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x556011da01e0 con 0x556011d9d510 2024-09-11T23:18:20.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.684+0000 7fb05d3da740 10 client.0 _ll_register_callbacks cb 0x556011ca48a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:18:20.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.684+0000 7fb053e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556011d92330 0x556011d9a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:20.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.684+0000 7fb053e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556011d92330 0x556011d9a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60662/0 (socket says 172.21.15.37:60662) 2024-09-11T23:18:20.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.684+0000 7fb04aa00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556011d92c50 0x556011d9ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:20.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.684+0000 7fb053e00640 1 -- 172.21.15.37:0/1177516300 learned_addr learned my addr 172.21.15.37:0/1177516300 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:18:20.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.684+0000 7fb053e00640 1 --2- 172.21.15.37:0/1177516300 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556011d9d510 0x556011d9b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:20.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.685+0000 7fb04aa00640 1 -- 172.21.15.37:0/1177516300 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556011d9d510 msgr2=0x556011d9b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:20.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.685+0000 7fb04aa00640 1 --2- 172.21.15.37:0/1177516300 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556011d9d510 0x556011d9b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:20.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.685+0000 7fb04aa00640 1 -- 172.21.15.37:0/1177516300 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556011d92330 msgr2=0x556011d9a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:20.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.685+0000 7fb04aa00640 1 --2- 172.21.15.37:0/1177516300 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556011d92330 0x556011d9a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:20.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.685+0000 7fb04aa00640 1 -- 172.21.15.37:0/1177516300 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556011a692b0 con 0x556011d92c50 2024-09-11T23:18:20.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.685+0000 7fb04aa00640 1 --2- 172.21.15.37:0/1177516300 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556011d92c50 0x556011d9ab60 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb03c009830 tx=0x7fb03c0045d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3238bbcd0c80e712 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:20.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.685+0000 7fb041600640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-11T23:18:20.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.685+0000 7fb041600640 1 -- 172.21.15.37:0/1177516300 <== mon.2 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb03c041070 con 0x556011d92c50 2024-09-11T23:18:20.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.685+0000 7fb05d3da740 1 -- 172.21.15.37:0/1177516300 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb04c004050 con 0x556011d92c50 2024-09-11T23:18:20.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.685+0000 7fb041600640 1 -- 172.21.15.37:0/1177516300 <== mon.2 v2:172.21.15.123:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9295+0+0 (secure 0 0 0) 0x7fb03c030960 con 0x556011d92c50 2024-09-11T23:18:20.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.686+0000 7fb041600640 1 -- 172.21.15.37:0/1177516300 <== mon.2 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb03c04c050 con 0x556011d92c50 2024-09-11T23:18:20.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.686+0000 7fb05d3da740 10 client.25010 fetch_fsmap learned FSMap version 28 2024-09-11T23:18:20.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.686+0000 7fb05d3da740 1 -- 172.21.15.37:0/1177516300 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x556011db4680 con 0x556011d92c50 2024-09-11T23:18:20.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.686+0000 7fb041600640 1 -- 172.21.15.37:0/1177516300 <== mon.2 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb04c004050 con 0x556011d92c50 2024-09-11T23:18:20.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.686+0000 7fb041600640 1 -- 172.21.15.37:0/1177516300 <== mon.2 v2:172.21.15.123:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fb03c03d6f0 con 0x556011d92c50 2024-09-11T23:18:20.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.686+0000 7fb05d3da740 10 client.25010 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T23:18:20.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.686+0000 7fb05d3da740 10 client.25010 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-11T23:18:20.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.686+0000 7fb05d3da740 20 client.25010 populate_metadata read hostname 'smithi037' 2024-09-11T23:18:20.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.686+0000 7fb05d3da740 1 --2- 172.21.15.37:0/1177516300 >> [v2:172.21.15.160:6836/2906597021,v1:172.21.15.160:6837/2906597021] conn(0x556011db6bf0 0x556011db8060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:20.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.686+0000 7fb05d3da740 4 client.25010 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T23:18:20.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.686+0000 7fb05d3da740 1 -- 172.21.15.37:0/1177516300 --> [v2:172.21.15.160:6836/2906597021,v1:172.21.15.160:6837/2906597021] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556011d05620 con 0x556011db6bf0 2024-09-11T23:18:20.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.687+0000 7fb053e00640 1 --2- 172.21.15.37:0/1177516300 >> [v2:172.21.15.160:6836/2906597021,v1:172.21.15.160:6837/2906597021] conn(0x556011db6bf0 0x556011db8060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:20.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.687+0000 7fb053e00640 1 --2- 172.21.15.37:0/1177516300 >> [v2:172.21.15.160:6836/2906597021,v1:172.21.15.160:6837/2906597021] conn(0x556011db6bf0 0x556011db8060 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=cc75a7744eb66764 server_cookie=8ef8b73b99aac7e5 in_seq=0 out_seq=0 2024-09-11T23:18:20.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.687+0000 7fb041600640 10 client.25010 ms_handle_connect on v2:172.21.15.160:6836/2906597021 2024-09-11T23:18:20.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.688+0000 7fb041600640 1 -- 172.21.15.37:0/1177516300 <== mds.2 v2:172.21.15.160:6836/2906597021 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556011d05620 con 0x556011db6bf0 2024-09-11T23:18:20.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.688+0000 7fb041600640 10 client.25010 handle_command_reply: tid=0 2024-09-11T23:18:20.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.688+0000 7fb05d3da740 1 client.25010 shutdown 2024-09-11T23:18:20.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.688+0000 7fb05d3da740 1 -- 172.21.15.37:0/1177516300 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556011d92c50 msgr2=0x556011d9ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:20.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.688+0000 7fb05d3da740 1 --2- 172.21.15.37:0/1177516300 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556011d92c50 0x556011d9ab60 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb03c009830 tx=0x7fb03c0045d0 comp rx=0 tx=0).stop 2024-09-11T23:18:20.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.688+0000 7fb05d3da740 1 -- 172.21.15.37:0/1177516300 shutdown_connections 2024-09-11T23:18:20.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.688+0000 7fb05d3da740 1 --2- 172.21.15.37:0/1177516300 >> [v2:172.21.15.160:6836/2906597021,v1:172.21.15.160:6837/2906597021] conn(0x556011db6bf0 0x556011db8060 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:20.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.688+0000 7fb05d3da740 1 --2- 172.21.15.37:0/1177516300 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556011d92c50 0x556011d9ab60 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:20.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.688+0000 7fb05d3da740 1 --2- 172.21.15.37:0/1177516300 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556011d9d510 0x556011d9b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:20.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.688+0000 7fb05d3da740 1 --2- 172.21.15.37:0/1177516300 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556011d92330 0x556011d9a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:20.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.688+0000 7fb041600640 0 client.25010 ms_handle_reset on v2:172.21.15.160:6836/2906597021 2024-09-11T23:18:20.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.688+0000 7fb05d3da740 1 -- 172.21.15.37:0/1177516300 >> 172.21.15.37:0/1177516300 conn(0x556011d8e8c0 msgr2=0x556011d945f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:20.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.689+0000 7fb05d3da740 1 -- 172.21.15.37:0/1177516300 shutdown_connections 2024-09-11T23:18:20.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.689+0000 7fb05d3da740 1 -- 172.21.15.37:0/1177516300 wait complete. 2024-09-11T23:18:20.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.689+0000 7fb05d3da740 20 client.25010 trim_cache size 0 max 16384 2024-09-11T23:18:20.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.707+0000 7fb05d3da740 1 Processor -- start 2024-09-11T23:18:20.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.707+0000 7fb05d3da740 1 -- start start 2024-09-11T23:18:20.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.708+0000 7fb05d3da740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556011d92330 0x556011db72c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:20.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.708+0000 7fb05d3da740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556011d92c50 0x556011d959d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:20.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.708+0000 7fb05d3da740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556011d9d510 0x556011d9aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:20.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.708+0000 7fb05d3da740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x556011db63a0 con 0x556011d9d510 2024-09-11T23:18:20.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.708+0000 7fb05d3da740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x556011db6a70 con 0x556011d92c50 2024-09-11T23:18:20.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.708+0000 7fb05d3da740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x556011db7140 con 0x556011d92330 2024-09-11T23:18:20.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.708+0000 7fb053e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556011d9d510 0x556011d9aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:20.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.708+0000 7fb04aa00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556011d92c50 0x556011d959d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:20.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.708+0000 7fb053e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556011d9d510 0x556011d9aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60678/0 (socket says 172.21.15.37:60678) 2024-09-11T23:18:20.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.708+0000 7fb04aa00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556011d92c50 0x556011d959d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.37:41382/0 (socket says 172.21.15.37:41382) 2024-09-11T23:18:20.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.708+0000 7fb053e00640 1 -- 172.21.15.37:0/3592587457 learned_addr learned my addr 172.21.15.37:0/3592587457 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:18:20.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.708+0000 7fb053e00640 1 --2- 172.21.15.37:0/3592587457 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556011d92330 0x556011db72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:20.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.709+0000 7fb053e00640 1 -- 172.21.15.37:0/3592587457 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556011d92330 msgr2=0x556011db72c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:20.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.709+0000 7fb053e00640 1 --2- 172.21.15.37:0/3592587457 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556011d92330 0x556011db72c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:20.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.709+0000 7fb053e00640 1 -- 172.21.15.37:0/3592587457 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556011d92c50 msgr2=0x556011d959d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:20.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.709+0000 7fb053e00640 1 --2- 172.21.15.37:0/3592587457 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556011d92c50 0x556011d959d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:20.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.709+0000 7fb053e00640 1 -- 172.21.15.37:0/3592587457 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556011d9fc70 con 0x556011d9d510 2024-09-11T23:18:20.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.709+0000 7fb04aa00640 1 --2- 172.21.15.37:0/3592587457 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556011d92c50 0x556011d959d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:18:20.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.709+0000 7fb053e00640 1 --2- 172.21.15.37:0/3592587457 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556011d9d510 0x556011d9aef0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb04c000f80 tx=0x7fb04c009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0c222a5efdcbf14 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:20.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.709+0000 7fb043e00640 1 -- 172.21.15.37:0/3592587457 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb04c004a80 con 0x556011d9d510 2024-09-11T23:18:20.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.709+0000 7fb043e00640 1 -- 172.21.15.37:0/3592587457 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb04c004c20 con 0x556011d9d510 2024-09-11T23:18:20.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.709+0000 7fb043e00640 1 -- 172.21.15.37:0/3592587457 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb04c005450 con 0x556011d9d510 2024-09-11T23:18:20.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.710+0000 7fb05d3da740 1 -- 172.21.15.37:0/3592587457 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556011d9d510 msgr2=0x556011d9aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:20.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.710+0000 7fb05d3da740 1 --2- 172.21.15.37:0/3592587457 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556011d9d510 0x556011d9aef0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb04c000f80 tx=0x7fb04c009ca0 comp rx=0 tx=0).stop 2024-09-11T23:18:20.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.710+0000 7fb05d3da740 1 -- 172.21.15.37:0/3592587457 shutdown_connections 2024-09-11T23:18:20.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.710+0000 7fb05d3da740 1 --2- 172.21.15.37:0/3592587457 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556011d92c50 0x556011d959d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:20.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.710+0000 7fb05d3da740 1 --2- 172.21.15.37:0/3592587457 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556011d9d510 0x556011d9aef0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:20.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.710+0000 7fb05d3da740 1 --2- 172.21.15.37:0/3592587457 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556011d92330 0x556011db72c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:20.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.710+0000 7fb05d3da740 1 -- 172.21.15.37:0/3592587457 >> 172.21.15.37:0/3592587457 conn(0x556011d8e8c0 msgr2=0x556011d9c6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:20.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.710+0000 7fb05d3da740 1 -- 172.21.15.37:0/3592587457 shutdown_connections 2024-09-11T23:18:20.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.710+0000 7fb05d3da740 1 -- 172.21.15.37:0/3592587457 wait complete. 2024-09-11T23:18:20.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.711+0000 7fb05d3da740 1 -- start start 2024-09-11T23:18:20.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.711+0000 7fb05d3da740 1 Processor -- start 2024-09-11T23:18:20.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.711+0000 7fb05d3da740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556011d92330 0x556011dc04a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:20.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.711+0000 7fb05d3da740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556011d92c50 0x556011dc09e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:20.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.711+0000 7fb05d3da740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556011d9d510 0x556011dbb270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:20.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.711+0000 7fb05d3da740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x556011db7ee0 con 0x556011d92330 2024-09-11T23:18:20.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.711+0000 7fb05d3da740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x556011db7810 con 0x556011d92c50 2024-09-11T23:18:20.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.711+0000 7fb05d3da740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x556011db85b0 con 0x556011d9d510 2024-09-11T23:18:20.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.711+0000 7fb05d3da740 10 client.0 _ll_register_callbacks cb 0x7fb03c004470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:18:20.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.712+0000 7fb053e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556011d92330 0x556011dc04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:20.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.712+0000 7fb053e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556011d92330 0x556011dc04a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60686/0 (socket says 172.21.15.37:60686) 2024-09-11T23:18:20.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.712+0000 7fb053e00640 1 -- 172.21.15.37:0/1869674264 learned_addr learned my addr 172.21.15.37:0/1869674264 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:18:20.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.712+0000 7fb04aa00640 1 --2- 172.21.15.37:0/1869674264 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556011d92c50 0x556011dc09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:20.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.712+0000 7fb053e00640 1 --2- 172.21.15.37:0/1869674264 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556011d9d510 0x556011dbb270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:20.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.712+0000 7fb04aa00640 1 -- 172.21.15.37:0/1869674264 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556011d9d510 msgr2=0x556011dbb270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:20.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.712+0000 7fb04aa00640 1 --2- 172.21.15.37:0/1869674264 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556011d9d510 0x556011dbb270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:20.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.712+0000 7fb04aa00640 1 -- 172.21.15.37:0/1869674264 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556011d92330 msgr2=0x556011dc04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:20.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.712+0000 7fb04aa00640 1 --2- 172.21.15.37:0/1869674264 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556011d92330 0x556011dc04a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:20.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.712+0000 7fb04aa00640 1 -- 172.21.15.37:0/1869674264 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556011dbb8b0 con 0x556011d92c50 2024-09-11T23:18:20.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.712+0000 7fb053e00640 1 --2- 172.21.15.37:0/1869674264 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556011d9d510 0x556011dbb270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:18:20.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.713+0000 7fb04aa00640 1 --2- 172.21.15.37:0/1869674264 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556011d92c50 0x556011dc09e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x556011d9bbd0 tx=0x7fb03c030990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e9fb815155e3968e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:20.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.713+0000 7fb041600640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-11T23:18:20.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.713+0000 7fb041600640 1 -- 172.21.15.37:0/1869674264 <== mon.2 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb03c049020 con 0x556011d92c50 2024-09-11T23:18:20.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.713+0000 7fb05d3da740 1 -- 172.21.15.37:0/1869674264 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb04c004c20 con 0x556011d92c50 2024-09-11T23:18:20.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.713+0000 7fb041600640 1 -- 172.21.15.37:0/1869674264 <== mon.2 v2:172.21.15.123:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9295+0+0 (secure 0 0 0) 0x7fb03c03d860 con 0x556011d92c50 2024-09-11T23:18:20.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.713+0000 7fb041600640 1 -- 172.21.15.37:0/1869674264 <== mon.2 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb03c041040 con 0x556011d92c50 2024-09-11T23:18:20.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.713+0000 7fb05d3da740 10 client.25016 fetch_fsmap learned FSMap version 28 2024-09-11T23:18:20.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.713+0000 7fb05d3da740 1 -- 172.21.15.37:0/1869674264 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x556011e21c40 con 0x556011d92c50 2024-09-11T23:18:20.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.713+0000 7fb041600640 1 -- 172.21.15.37:0/1869674264 <== mon.2 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb04c004c20 con 0x556011d92c50 2024-09-11T23:18:20.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.714+0000 7fb041600640 1 -- 172.21.15.37:0/1869674264 <== mon.2 v2:172.21.15.123:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fb03c032580 con 0x556011d92c50 2024-09-11T23:18:20.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.714+0000 7fb05d3da740 10 client.25016 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T23:18:20.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.714+0000 7fb05d3da740 10 client.25016 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-11T23:18:20.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.714+0000 7fb05d3da740 20 client.25016 populate_metadata read hostname 'smithi037' 2024-09-11T23:18:20.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.714+0000 7fb05d3da740 1 --2- 172.21.15.37:0/1869674264 >> [v2:172.21.15.160:6836/2906597021,v1:172.21.15.160:6837/2906597021] conn(0x556011e26860 0x556011e25570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:20.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.714+0000 7fb05d3da740 4 client.25016 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T23:18:20.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.714+0000 7fb05d3da740 1 -- 172.21.15.37:0/1869674264 --> [v2:172.21.15.160:6836/2906597021,v1:172.21.15.160:6837/2906597021] -- command(tid 0: {"prefix": "status"}) -- 0x556011d8f470 con 0x556011e26860 2024-09-11T23:18:20.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.714+0000 7fb053e00640 1 --2- 172.21.15.37:0/1869674264 >> [v2:172.21.15.160:6836/2906597021,v1:172.21.15.160:6837/2906597021] conn(0x556011e26860 0x556011e25570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:20.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.715+0000 7fb053e00640 1 --2- 172.21.15.37:0/1869674264 >> [v2:172.21.15.160:6836/2906597021,v1:172.21.15.160:6837/2906597021] conn(0x556011e26860 0x556011e25570 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=77b12b0f42412400 server_cookie=96025a7910fc7764 in_seq=0 out_seq=0 2024-09-11T23:18:20.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.715+0000 7fb041600640 10 client.25016 ms_handle_connect on v2:172.21.15.160:6836/2906597021 2024-09-11T23:18:20.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.715+0000 7fb041600640 1 -- 172.21.15.37:0/1869674264 <== mds.2 v2:172.21.15.160:6836/2906597021 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x556011d8f470 con 0x556011e26860 2024-09-11T23:18:20.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.715+0000 7fb041600640 10 client.25016 handle_command_reply: tid=0 2024-09-11T23:18:20.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.715+0000 7fb05d3da740 1 client.25016 shutdown 2024-09-11T23:18:20.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.715+0000 7fb05d3da740 1 -- 172.21.15.37:0/1869674264 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556011d92c50 msgr2=0x556011dc09e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:20.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.715+0000 7fb05d3da740 1 --2- 172.21.15.37:0/1869674264 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556011d92c50 0x556011dc09e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x556011d9bbd0 tx=0x7fb03c030990 comp rx=0 tx=0).stop 2024-09-11T23:18:20.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.715+0000 7fb05d3da740 1 -- 172.21.15.37:0/1869674264 shutdown_connections 2024-09-11T23:18:20.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.715+0000 7fb05d3da740 1 --2- 172.21.15.37:0/1869674264 >> [v2:172.21.15.160:6836/2906597021,v1:172.21.15.160:6837/2906597021] conn(0x556011e26860 0x556011e25570 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:20.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.715+0000 7fb05d3da740 1 --2- 172.21.15.37:0/1869674264 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556011d92c50 0x556011dc09e0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:20.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.715+0000 7fb05d3da740 1 --2- 172.21.15.37:0/1869674264 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556011d9d510 0x556011dbb270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:20.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.715+0000 7fb05d3da740 1 --2- 172.21.15.37:0/1869674264 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556011d92330 0x556011dc04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:20.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.715+0000 7fb041600640 0 client.25016 ms_handle_reset on v2:172.21.15.160:6836/2906597021 2024-09-11T23:18:20.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.715+0000 7fb05d3da740 1 -- 172.21.15.37:0/1869674264 >> 172.21.15.37:0/1869674264 conn(0x556011d8e8c0 msgr2=0x556011db0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:20.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.715+0000 7fb05d3da740 1 -- 172.21.15.37:0/1869674264 shutdown_connections 2024-09-11T23:18:20.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.715+0000 7fb05d3da740 1 -- 172.21.15.37:0/1869674264 wait complete. 2024-09-11T23:18:20.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.716+0000 7fb05d3da740 20 client.25016 trim_cache size 0 max 16384 2024-09-11T23:18:20.721 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-11T23:18:20.721 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "8b03efce-7092-11ef-bcea-c7b262605968", 2024-09-11T23:18:20.721 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 2, 2024-09-11T23:18:20.721 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 24499, 2024-09-11T23:18:20.721 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2024-09-11T23:18:20.721 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2024-09-11T23:18:20.721 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2024-09-11T23:18:20.721 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 79.994255565000003, 2024-09-11T23:18:20.721 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 28, 2024-09-11T23:18:20.721 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 95, 2024-09-11T23:18:20.721 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 93, 2024-09-11T23:18:20.721 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 153.307229232 2024-09-11T23:18:20.722 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-11T23:18:20.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.716+0000 7fb05a800640 1 -- 172.21.15.37:0/129515962 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fb0380a2c10 msgr2=0x7fb0380a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:20.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.716+0000 7fb05a800640 1 --2- 172.21.15.37:0/129515962 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fb0380a2c10 0x7fb0380a50d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fb0440a4150 tx=0x7fb0440d5530 comp rx=0 tx=0).stop 2024-09-11T23:18:20.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.716+0000 7fb05a800640 1 -- 172.21.15.37:0/129515962 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb054103ff0 msgr2=0x7fb05419a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:20.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.716+0000 7fb05a800640 1 --2- 172.21.15.37:0/129515962 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb054103ff0 0x7fb05419a620 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb04400e790 tx=0x7fb04400ec50 comp rx=0 tx=0).stop 2024-09-11T23:18:20.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.716+0000 7fb05a800640 1 -- 172.21.15.37:0/129515962 shutdown_connections 2024-09-11T23:18:20.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.716+0000 7fb05a800640 1 --2- 172.21.15.37:0/129515962 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fb0380a2c10 0x7fb0380a50d0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:20.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.716+0000 7fb05a800640 1 --2- 172.21.15.37:0/129515962 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb054109120 0x7fb05419eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:20.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.716+0000 7fb05a800640 1 --2- 172.21.15.37:0/129515962 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0541049a0 0x7fb05419ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:20.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.716+0000 7fb05a800640 1 --2- 172.21.15.37:0/129515962 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb054103ff0 0x7fb05419a620 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:20.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.716+0000 7fb05a800640 1 -- 172.21.15.37:0/129515962 >> 172.21.15.37:0/129515962 conn(0x7fb0540ffa90 msgr2=0x7fb054100d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:20.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.716+0000 7fb05a800640 1 -- 172.21.15.37:0/129515962 shutdown_connections 2024-09-11T23:18:20.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:20.716+0000 7fb05a800640 1 -- 172.21.15.37:0/129515962 wait complete. 2024-09-11T23:18:21.480 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:18:21 smithi037 ceph-mon[30630]: pgmap v369: 129 pgs: 129 active+clean; 646 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2024-09-11T23:18:21.518 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph tell mds.i status 2024-09-11T23:18:21.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:18:21 smithi160 ceph-mon[35055]: pgmap v369: 129 pgs: 129 active+clean; 646 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2024-09-11T23:18:21.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:18:21 smithi123 ceph-mon[35438]: pgmap v369: 129 pgs: 129 active+clean; 646 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2024-09-11T23:18:21.896 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:18:22.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.474+0000 7faad5e00640 1 -- 172.21.15.37:0/3204335089 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faad0112870 msgr2=0x7faad0114c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:22.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.474+0000 7faad5e00640 1 --2- 172.21.15.37:0/3204335089 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faad0112870 0x7faad0114c60 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7faac8009ca0 tx=0x7faac802a8c0 comp rx=0 tx=0).stop 2024-09-11T23:18:22.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.474+0000 7faad5e00640 1 -- 172.21.15.37:0/3204335089 shutdown_connections 2024-09-11T23:18:22.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.474+0000 7faad5e00640 1 --2- 172.21.15.37:0/3204335089 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faad0112870 0x7faad0114c60 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:22.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.474+0000 7faad5e00640 1 --2- 172.21.15.37:0/3204335089 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faad0077040 0x7faad0112330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:22.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.474+0000 7faad5e00640 1 --2- 172.21.15.37:0/3204335089 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faad0076720 0x7faad0076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:22.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.474+0000 7faad5e00640 1 -- 172.21.15.37:0/3204335089 >> 172.21.15.37:0/3204335089 conn(0x7faad00ff910 msgr2=0x7faad0101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:22.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.474+0000 7faad5e00640 1 -- 172.21.15.37:0/3204335089 shutdown_connections 2024-09-11T23:18:22.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.474+0000 7faad5e00640 1 -- 172.21.15.37:0/3204335089 wait complete. 2024-09-11T23:18:22.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.475+0000 7faad5e00640 1 Processor -- start 2024-09-11T23:18:22.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.475+0000 7faad5e00640 1 -- start start 2024-09-11T23:18:22.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.476+0000 7faad5e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faad0076720 0x7faad01a45d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:22.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.476+0000 7faad5e00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faad0077040 0x7faad01a4b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:22.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.476+0000 7faad5e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faad0112870 0x7faad019e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:22.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.476+0000 7faad5e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7faad01183b0 con 0x7faad0076720 2024-09-11T23:18:22.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.476+0000 7faad5e00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7faad0118230 con 0x7faad0112870 2024-09-11T23:18:22.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.476+0000 7faad5e00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7faad0118530 con 0x7faad0077040 2024-09-11T23:18:22.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.476+0000 7faad4a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faad0076720 0x7faad01a45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:22.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.476+0000 7faacfe00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faad0077040 0x7faad01a4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:22.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.476+0000 7faacfe00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faad0077040 0x7faad01a4b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.37:37084/0 (socket says 172.21.15.37:37084) 2024-09-11T23:18:22.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.476+0000 7faacfe00640 1 -- 172.21.15.37:0/2839562195 learned_addr learned my addr 172.21.15.37:0/2839562195 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:18:22.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.476+0000 7faad5400640 1 --2- 172.21.15.37:0/2839562195 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faad0112870 0x7faad019e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:22.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.476+0000 7faad4a00640 1 -- 172.21.15.37:0/2839562195 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faad0077040 msgr2=0x7faad01a4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:22.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.476+0000 7faad4a00640 1 --2- 172.21.15.37:0/2839562195 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faad0077040 0x7faad01a4b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:22.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.476+0000 7faad4a00640 1 -- 172.21.15.37:0/2839562195 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faad0112870 msgr2=0x7faad019e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:22.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.476+0000 7faad4a00640 1 --2- 172.21.15.37:0/2839562195 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faad0112870 0x7faad019e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:22.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.477+0000 7faad4a00640 1 -- 172.21.15.37:0/2839562195 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faad019ef10 con 0x7faad0076720 2024-09-11T23:18:22.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.477+0000 7faacfe00640 1 --2- 172.21.15.37:0/2839562195 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faad0077040 0x7faad01a4b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:18:22.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.477+0000 7faad5400640 1 --2- 172.21.15.37:0/2839562195 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faad0112870 0x7faad019e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:18:22.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.477+0000 7faad4a00640 1 --2- 172.21.15.37:0/2839562195 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faad0076720 0x7faad01a45d0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7faac400e9f0 tx=0x7faac400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:22.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.477+0000 7faacd600640 1 -- 172.21.15.37:0/2839562195 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faac400ccc0 con 0x7faad0076720 2024-09-11T23:18:22.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.477+0000 7faacd600640 1 -- 172.21.15.37:0/2839562195 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faac4010910 con 0x7faad0076720 2024-09-11T23:18:22.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.477+0000 7faad5e00640 1 -- 172.21.15.37:0/2839562195 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faad019f200 con 0x7faad0076720 2024-09-11T23:18:22.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.477+0000 7faacd600640 1 -- 172.21.15.37:0/2839562195 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faac4018960 con 0x7faad0076720 2024-09-11T23:18:22.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.477+0000 7faad5e00640 1 -- 172.21.15.37:0/2839562195 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faad01ab550 con 0x7faad0076720 2024-09-11T23:18:22.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.481+0000 7faacd600640 1 -- 172.21.15.37:0/2839562195 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7faac4010ac0 con 0x7faad0076720 2024-09-11T23:18:22.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.481+0000 7faad9fc7740 1 Processor -- start 2024-09-11T23:18:22.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.481+0000 7faad9fc7740 1 -- start start 2024-09-11T23:18:22.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.481+0000 7faad9fc7740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5630e654f4e0 0x5630e654f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:22.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.481+0000 7faad9fc7740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5630e654fe00 0x5630e655a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:22.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.481+0000 7faad9fc7740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630e655a6c0 0x5630e655cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:22.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.481+0000 7faad9fc7740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5630e64b50b0 con 0x5630e655a6c0 2024-09-11T23:18:22.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.481+0000 7faad9fc7740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5630e645cab0 con 0x5630e654f4e0 2024-09-11T23:18:22.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.481+0000 7faad9fc7740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x5630e64b1070 con 0x5630e654fe00 2024-09-11T23:18:22.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.482+0000 7faacfe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630e655a6c0 0x5630e655cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:22.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.482+0000 7faacfe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630e655a6c0 0x5630e655cab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60722/0 (socket says 172.21.15.37:60722) 2024-09-11T23:18:22.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.482+0000 7faacfe00640 1 -- 172.21.15.37:0/43012764 learned_addr learned my addr 172.21.15.37:0/43012764 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:18:22.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.482+0000 7faad5400640 1 --2- 172.21.15.37:0/43012764 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5630e654f4e0 0x5630e654f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:22.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.482+0000 7faad4a00640 1 --2- 172.21.15.37:0/43012764 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5630e654fe00 0x5630e655a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:22.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.482+0000 7faacfe00640 1 -- 172.21.15.37:0/43012764 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5630e654fe00 msgr2=0x5630e655a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:22.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.482+0000 7faacfe00640 1 --2- 172.21.15.37:0/43012764 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5630e654fe00 0x5630e655a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:22.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.482+0000 7faacfe00640 1 -- 172.21.15.37:0/43012764 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5630e654f4e0 msgr2=0x5630e654f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:22.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.482+0000 7faacfe00640 1 --2- 172.21.15.37:0/43012764 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5630e654f4e0 0x5630e654f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:22.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.482+0000 7faacfe00640 1 -- 172.21.15.37:0/43012764 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630e64694a0 con 0x5630e655a6c0 2024-09-11T23:18:22.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.483+0000 7faacd600640 1 --2- 172.21.15.37:0/2839562195 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7faab80a2c00 0x7faab80a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:22.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.483+0000 7faacfe00640 1 --2- 172.21.15.37:0/43012764 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630e655a6c0 0x5630e655cab0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7faabc0104d0 tx=0x7faabc0108d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd5c7ebe119aedff server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:22.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.483+0000 7faacd600640 1 -- 172.21.15.37:0/2839562195 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9295+0+0 (secure 0 0 0) 0x7faac40cf860 con 0x7faad0076720 2024-09-11T23:18:22.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.483+0000 7faad5400640 1 --2- 172.21.15.37:0/2839562195 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7faab80a2c00 0x7faab80a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:22.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.483+0000 7faac1c00640 1 -- 172.21.15.37:0/43012764 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faabc011820 con 0x5630e655a6c0 2024-09-11T23:18:22.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.483+0000 7faac1c00640 1 -- 172.21.15.37:0/43012764 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faabc01c480 con 0x5630e655a6c0 2024-09-11T23:18:22.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.483+0000 7faac1c00640 1 -- 172.21.15.37:0/43012764 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faabc01a5e0 con 0x5630e655a6c0 2024-09-11T23:18:22.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.484+0000 7faad9fc7740 1 -- 172.21.15.37:0/43012764 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630e655a6c0 msgr2=0x5630e655cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:22.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.484+0000 7faad5400640 1 --2- 172.21.15.37:0/2839562195 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7faab80a2c00 0x7faab80a50c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7faac8006010 tx=0x7faac8009960 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:22.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.484+0000 7faad9fc7740 1 --2- 172.21.15.37:0/43012764 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630e655a6c0 0x5630e655cab0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7faabc0104d0 tx=0x7faabc0108d0 comp rx=0 tx=0).stop 2024-09-11T23:18:22.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.484+0000 7faad9fc7740 1 -- 172.21.15.37:0/43012764 shutdown_connections 2024-09-11T23:18:22.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.484+0000 7faad9fc7740 1 --2- 172.21.15.37:0/43012764 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630e655a6c0 0x5630e655cab0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:22.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.484+0000 7faad9fc7740 1 --2- 172.21.15.37:0/43012764 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5630e654fe00 0x5630e655a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:22.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.484+0000 7faad9fc7740 1 --2- 172.21.15.37:0/43012764 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5630e654f4e0 0x5630e654f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:22.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.484+0000 7faad9fc7740 1 -- 172.21.15.37:0/43012764 >> 172.21.15.37:0/43012764 conn(0x5630e654ba70 msgr2=0x5630e654be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:22.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.484+0000 7faad9fc7740 1 -- 172.21.15.37:0/43012764 shutdown_connections 2024-09-11T23:18:22.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.484+0000 7faad9fc7740 1 -- 172.21.15.37:0/43012764 wait complete. 2024-09-11T23:18:22.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.485+0000 7faad9fc7740 1 -- start start 2024-09-11T23:18:22.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.485+0000 7faad9fc7740 1 Processor -- start 2024-09-11T23:18:22.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.485+0000 7faad9fc7740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5630e654f4e0 0x5630e65575a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:22.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.485+0000 7faad9fc7740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5630e654fe00 0x5630e6557ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:22.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.485+0000 7faad9fc7740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630e655a6c0 0x5630e6558020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:22.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.485+0000 7faad9fc7740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5630e655d330 con 0x5630e655a6c0 2024-09-11T23:18:22.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.485+0000 7faad9fc7740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5630e643d920 con 0x5630e654fe00 2024-09-11T23:18:22.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.485+0000 7faad9fc7740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x5630e655d4b0 con 0x5630e654f4e0 2024-09-11T23:18:22.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.485+0000 7faad9fc7740 10 client.0 _ll_register_callbacks cb 0x5630e64618a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:18:22.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.486+0000 7faad4a00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5630e654f4e0 0x5630e65575a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:22.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.486+0000 7faad5400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630e655a6c0 0x5630e6558020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:22.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.486+0000 7faacfe00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5630e654fe00 0x5630e6557ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:22.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.486+0000 7faad4a00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5630e654f4e0 0x5630e65575a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.37:37104/0 (socket says 172.21.15.37:37104) 2024-09-11T23:18:22.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.486+0000 7faad4a00640 1 -- 172.21.15.37:0/4057688148 learned_addr learned my addr 172.21.15.37:0/4057688148 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:18:22.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.486+0000 7faad4a00640 1 -- 172.21.15.37:0/4057688148 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5630e654fe00 msgr2=0x5630e6557ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:22.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.486+0000 7faad4a00640 1 --2- 172.21.15.37:0/4057688148 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5630e654fe00 0x5630e6557ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:22.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.486+0000 7faad4a00640 1 -- 172.21.15.37:0/4057688148 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630e655a6c0 msgr2=0x5630e6558020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:22.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.486+0000 7faad4a00640 1 --2- 172.21.15.37:0/4057688148 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630e655a6c0 0x5630e6558020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:22.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.486+0000 7faad4a00640 1 -- 172.21.15.37:0/4057688148 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630e62262b0 con 0x5630e654f4e0 2024-09-11T23:18:22.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.486+0000 7faacfe00640 1 --2- 172.21.15.37:0/4057688148 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5630e654fe00 0x5630e6557ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:18:22.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.486+0000 7faad4a00640 1 --2- 172.21.15.37:0/4057688148 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5630e654f4e0 0x5630e65575a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7faac409bbd0 tx=0x7faac4097fa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=105dd2193da1d8aa server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:22.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.486+0000 7faab6000640 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2024-09-11T23:18:22.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.487+0000 7faab6000640 1 -- 172.21.15.37:0/4057688148 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faac409c340 con 0x5630e654f4e0 2024-09-11T23:18:22.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.487+0000 7faab6000640 1 -- 172.21.15.37:0/4057688148 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9295+0+0 (secure 0 0 0) 0x7faac409b090 con 0x5630e654f4e0 2024-09-11T23:18:22.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.487+0000 7faad9fc7740 1 -- 172.21.15.37:0/4057688148 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faabc01c480 con 0x5630e654f4e0 2024-09-11T23:18:22.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.487+0000 7faab6000640 1 -- 172.21.15.37:0/4057688148 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7faac409bc40 con 0x5630e654f4e0 2024-09-11T23:18:22.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.487+0000 7faad9fc7740 10 client.25030 fetch_fsmap learned FSMap version 28 2024-09-11T23:18:22.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.487+0000 7faad9fc7740 1 -- 172.21.15.37:0/4057688148 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5630e6569010 con 0x5630e654f4e0 2024-09-11T23:18:22.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.487+0000 7faab6000640 1 -- 172.21.15.37:0/4057688148 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faabc01c480 con 0x5630e654f4e0 2024-09-11T23:18:22.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.487+0000 7faab6000640 1 -- 172.21.15.37:0/4057688148 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7faac4018b90 con 0x5630e654f4e0 2024-09-11T23:18:22.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.487+0000 7faad9fc7740 10 client.25030 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T23:18:22.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.487+0000 7faad9fc7740 10 client.25030 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-11T23:18:22.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.488+0000 7faad9fc7740 20 client.25030 populate_metadata read hostname 'smithi037' 2024-09-11T23:18:22.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.488+0000 7faad9fc7740 1 --2- 172.21.15.37:0/4057688148 >> [v2:172.21.15.160:6838/2041625862,v1:172.21.15.160:6839/2041625862] conn(0x5630e656b640 0x5630e656cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:22.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.488+0000 7faad9fc7740 4 client.25030 mds_command: new command op to 24520 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T23:18:22.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.488+0000 7faad9fc7740 1 -- 172.21.15.37:0/4057688148 --> [v2:172.21.15.160:6838/2041625862,v1:172.21.15.160:6839/2041625862] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5630e64c2620 con 0x5630e656b640 2024-09-11T23:18:22.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.488+0000 7faacfe00640 1 --2- 172.21.15.37:0/4057688148 >> [v2:172.21.15.160:6838/2041625862,v1:172.21.15.160:6839/2041625862] conn(0x5630e656b640 0x5630e656cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:22.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.488+0000 7faacfe00640 1 --2- 172.21.15.37:0/4057688148 >> [v2:172.21.15.160:6838/2041625862,v1:172.21.15.160:6839/2041625862] conn(0x5630e656b640 0x5630e656cab0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9c3a08a95b37a94a server_cookie=8f3da306f240137f in_seq=0 out_seq=0 2024-09-11T23:18:22.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.488+0000 7faab6000640 10 client.25030 ms_handle_connect on v2:172.21.15.160:6838/2041625862 2024-09-11T23:18:22.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.490+0000 7faab6000640 1 -- 172.21.15.37:0/4057688148 <== mds.1 v2:172.21.15.160:6838/2041625862 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5630e64c2620 con 0x5630e656b640 2024-09-11T23:18:22.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.490+0000 7faab6000640 10 client.25030 handle_command_reply: tid=0 2024-09-11T23:18:22.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.490+0000 7faad9fc7740 1 client.25030 shutdown 2024-09-11T23:18:22.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.490+0000 7faad9fc7740 1 -- 172.21.15.37:0/4057688148 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5630e654f4e0 msgr2=0x5630e65575a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:22.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.490+0000 7faad9fc7740 1 --2- 172.21.15.37:0/4057688148 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5630e654f4e0 0x5630e65575a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7faac409bbd0 tx=0x7faac4097fa0 comp rx=0 tx=0).stop 2024-09-11T23:18:22.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.490+0000 7faad9fc7740 1 -- 172.21.15.37:0/4057688148 shutdown_connections 2024-09-11T23:18:22.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.490+0000 7faad9fc7740 1 --2- 172.21.15.37:0/4057688148 >> [v2:172.21.15.160:6838/2041625862,v1:172.21.15.160:6839/2041625862] conn(0x5630e656b640 0x5630e656cab0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:22.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.490+0000 7faad9fc7740 1 --2- 172.21.15.37:0/4057688148 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5630e654fe00 0x5630e6557ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:22.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.490+0000 7faad9fc7740 1 --2- 172.21.15.37:0/4057688148 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630e655a6c0 0x5630e6558020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:22.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.490+0000 7faad9fc7740 1 --2- 172.21.15.37:0/4057688148 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5630e654f4e0 0x5630e65575a0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:22.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.490+0000 7faab6000640 0 client.25030 ms_handle_reset on v2:172.21.15.160:6838/2041625862 2024-09-11T23:18:22.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.490+0000 7faad9fc7740 1 -- 172.21.15.37:0/4057688148 >> 172.21.15.37:0/4057688148 conn(0x5630e654ba70 msgr2=0x5630e6551750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:22.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.490+0000 7faad9fc7740 1 -- 172.21.15.37:0/4057688148 shutdown_connections 2024-09-11T23:18:22.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.490+0000 7faad9fc7740 1 -- 172.21.15.37:0/4057688148 wait complete. 2024-09-11T23:18:22.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.490+0000 7faad9fc7740 20 client.25030 trim_cache size 0 max 16384 2024-09-11T23:18:22.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.509+0000 7faad9fc7740 1 Processor -- start 2024-09-11T23:18:22.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.509+0000 7faad9fc7740 1 -- start start 2024-09-11T23:18:22.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.510+0000 7faad9fc7740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5630e654f4e0 0x5630e656cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:22.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.510+0000 7faad9fc7740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5630e654fe00 0x5630e6557e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:22.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.510+0000 7faad9fc7740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630e655a6c0 0x5630e6554800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:22.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.510+0000 7faad9fc7740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5630e656adf0 con 0x5630e655a6c0 2024-09-11T23:18:22.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.510+0000 7faad9fc7740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5630e656b4c0 con 0x5630e654f4e0 2024-09-11T23:18:22.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.510+0000 7faad9fc7740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x5630e656bb90 con 0x5630e654fe00 2024-09-11T23:18:22.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.510+0000 7faacfe00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5630e654fe00 0x5630e6557e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:22.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.510+0000 7faad5400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630e655a6c0 0x5630e6554800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:22.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.510+0000 7faad4a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5630e654f4e0 0x5630e656cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:22.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.510+0000 7faad5400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630e655a6c0 0x5630e6554800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60750/0 (socket says 172.21.15.37:60750) 2024-09-11T23:18:22.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.510+0000 7faad4a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5630e654f4e0 0x5630e656cab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.37:41440/0 (socket says 172.21.15.37:41440) 2024-09-11T23:18:22.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.510+0000 7faad5400640 1 -- 172.21.15.37:0/2940428689 learned_addr learned my addr 172.21.15.37:0/2940428689 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:18:22.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.510+0000 7faacfe00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5630e654fe00 0x5630e6557e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.37:37110/0 (socket says 172.21.15.37:37110) 2024-09-11T23:18:22.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.510+0000 7faad4a00640 1 -- 172.21.15.37:0/2940428689 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5630e654fe00 msgr2=0x5630e6557e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:22.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.510+0000 7faad4a00640 1 --2- 172.21.15.37:0/2940428689 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5630e654fe00 0x5630e6557e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:22.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.510+0000 7faad4a00640 1 -- 172.21.15.37:0/2940428689 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630e655a6c0 msgr2=0x5630e6554800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:22.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.510+0000 7faad4a00640 1 --2- 172.21.15.37:0/2940428689 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630e655a6c0 0x5630e6554800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:22.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.511+0000 7faad4a00640 1 -- 172.21.15.37:0/2940428689 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630e654c740 con 0x5630e654f4e0 2024-09-11T23:18:22.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.511+0000 7faad4a00640 1 --2- 172.21.15.37:0/2940428689 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5630e654f4e0 0x5630e656cab0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7faac400cf10 tx=0x7faac4098010 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e86441397a5f07a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:22.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.511+0000 7faac1200640 1 -- 172.21.15.37:0/2940428689 <== mon.2 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faac409b780 con 0x5630e654f4e0 2024-09-11T23:18:22.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.511+0000 7faac1200640 1 -- 172.21.15.37:0/2940428689 <== mon.2 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faac40d5030 con 0x5630e654f4e0 2024-09-11T23:18:22.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.511+0000 7faac1200640 1 -- 172.21.15.37:0/2940428689 <== mon.2 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faac4018d20 con 0x5630e654f4e0 2024-09-11T23:18:22.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.512+0000 7faad9fc7740 1 -- 172.21.15.37:0/2940428689 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5630e654f4e0 msgr2=0x5630e656cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:22.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.512+0000 7faad9fc7740 1 --2- 172.21.15.37:0/2940428689 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5630e654f4e0 0x5630e656cab0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7faac400cf10 tx=0x7faac4098010 comp rx=0 tx=0).stop 2024-09-11T23:18:22.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.512+0000 7faad9fc7740 1 -- 172.21.15.37:0/2940428689 shutdown_connections 2024-09-11T23:18:22.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.512+0000 7faad9fc7740 1 --2- 172.21.15.37:0/2940428689 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630e655a6c0 0x5630e6554800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:22.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.512+0000 7faad9fc7740 1 --2- 172.21.15.37:0/2940428689 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5630e654fe00 0x5630e6557e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:22.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.512+0000 7faad9fc7740 1 --2- 172.21.15.37:0/2940428689 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5630e654f4e0 0x5630e656cab0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:22.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.512+0000 7faad9fc7740 1 -- 172.21.15.37:0/2940428689 >> 172.21.15.37:0/2940428689 conn(0x5630e654ba70 msgr2=0x5630e6555e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:22.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.512+0000 7faad9fc7740 1 -- 172.21.15.37:0/2940428689 shutdown_connections 2024-09-11T23:18:22.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.512+0000 7faad9fc7740 1 -- 172.21.15.37:0/2940428689 wait complete. 2024-09-11T23:18:22.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.512+0000 7faad9fc7740 1 -- start start 2024-09-11T23:18:22.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.512+0000 7faad9fc7740 1 Processor -- start 2024-09-11T23:18:22.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.513+0000 7faad9fc7740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5630e654f4e0 0x5630e65751b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:22.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.513+0000 7faad9fc7740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5630e654fe00 0x5630e656e530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:22.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.513+0000 7faad9fc7740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630e655a6c0 0x5630e656ea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:22.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.513+0000 7faad9fc7740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5630e656c930 con 0x5630e655a6c0 2024-09-11T23:18:22.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.513+0000 7faad9fc7740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5630e656c260 con 0x5630e654fe00 2024-09-11T23:18:22.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.513+0000 7faad9fc7740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x5630e656d000 con 0x5630e654f4e0 2024-09-11T23:18:22.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.513+0000 7faad9fc7740 10 client.0 _ll_register_callbacks cb 0x7faac400ce60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:18:22.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.513+0000 7faad4a00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5630e654f4e0 0x5630e65751b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:22.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.513+0000 7faad5400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630e655a6c0 0x5630e656ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:22.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.513+0000 7faacfe00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5630e654fe00 0x5630e656e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:22.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.513+0000 7faad4a00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5630e654f4e0 0x5630e65751b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.37:37120/0 (socket says 172.21.15.37:37120) 2024-09-11T23:18:22.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.513+0000 7faacfe00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5630e654fe00 0x5630e656e530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.37:41448/0 (socket says 172.21.15.37:41448) 2024-09-11T23:18:22.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.513+0000 7faad5400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630e655a6c0 0x5630e656ea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60756/0 (socket says 172.21.15.37:60756) 2024-09-11T23:18:22.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.513+0000 7faad4a00640 1 -- 172.21.15.37:0/1356577473 learned_addr learned my addr 172.21.15.37:0/1356577473 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:18:22.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.514+0000 7faad5400640 1 -- 172.21.15.37:0/1356577473 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5630e654f4e0 msgr2=0x5630e65751b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:22.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.514+0000 7faad5400640 1 --2- 172.21.15.37:0/1356577473 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5630e654f4e0 0x5630e65751b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:22.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.514+0000 7faad5400640 1 -- 172.21.15.37:0/1356577473 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5630e654fe00 msgr2=0x5630e656e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:22.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.514+0000 7faad5400640 1 --2- 172.21.15.37:0/1356577473 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5630e654fe00 0x5630e656e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:22.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.514+0000 7faad5400640 1 -- 172.21.15.37:0/1356577473 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630e656efb0 con 0x5630e655a6c0 2024-09-11T23:18:22.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.514+0000 7faad5400640 1 --2- 172.21.15.37:0/1356577473 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630e655a6c0 0x5630e656ea70 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x5630e6567310 tx=0x7faac802a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a172bcd2e1ccff24 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:22.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.514+0000 7faab6000640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-11T23:18:22.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.514+0000 7faab6000640 1 -- 172.21.15.37:0/1356577473 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faac8058060 con 0x5630e655a6c0 2024-09-11T23:18:22.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.514+0000 7faab6000640 1 -- 172.21.15.37:0/1356577473 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9295+0+0 (secure 0 0 0) 0x7faac8004250 con 0x5630e655a6c0 2024-09-11T23:18:22.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.514+0000 7faad9fc7740 1 -- 172.21.15.37:0/1356577473 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faac40d5030 con 0x5630e655a6c0 2024-09-11T23:18:22.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.515+0000 7faab6000640 1 -- 172.21.15.37:0/1356577473 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7faac80319a0 con 0x5630e655a6c0 2024-09-11T23:18:22.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.515+0000 7faad9fc7740 10 client.15024 fetch_fsmap learned FSMap version 28 2024-09-11T23:18:22.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.515+0000 7faad9fc7740 1 -- 172.21.15.37:0/1356577473 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5630e65739c0 con 0x5630e655a6c0 2024-09-11T23:18:22.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.515+0000 7faab6000640 1 -- 172.21.15.37:0/1356577473 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faac40d5030 con 0x5630e655a6c0 2024-09-11T23:18:22.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.515+0000 7faab6000640 1 -- 172.21.15.37:0/1356577473 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7faac8052070 con 0x5630e655a6c0 2024-09-11T23:18:22.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.515+0000 7faad9fc7740 10 client.15024 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T23:18:22.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.515+0000 7faad9fc7740 10 client.15024 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-11T23:18:22.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.515+0000 7faad9fc7740 20 client.15024 populate_metadata read hostname 'smithi037' 2024-09-11T23:18:22.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.515+0000 7faad9fc7740 1 --2- 172.21.15.37:0/1356577473 >> [v2:172.21.15.160:6838/2041625862,v1:172.21.15.160:6839/2041625862] conn(0x5630e65da5e0 0x5630e65d92f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:22.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.515+0000 7faad9fc7740 4 client.15024 mds_command: new command op to 24520 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T23:18:22.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.515+0000 7faad9fc7740 1 -- 172.21.15.37:0/1356577473 --> [v2:172.21.15.160:6838/2041625862,v1:172.21.15.160:6839/2041625862] -- command(tid 0: {"prefix": "status"}) -- 0x5630e64bcb30 con 0x5630e65da5e0 2024-09-11T23:18:22.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.516+0000 7faad4a00640 1 --2- 172.21.15.37:0/1356577473 >> [v2:172.21.15.160:6838/2041625862,v1:172.21.15.160:6839/2041625862] conn(0x5630e65da5e0 0x5630e65d92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:22.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.516+0000 7faad4a00640 1 --2- 172.21.15.37:0/1356577473 >> [v2:172.21.15.160:6838/2041625862,v1:172.21.15.160:6839/2041625862] conn(0x5630e65da5e0 0x5630e65d92f0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8c3eff62c6e7955f server_cookie=7d8787b823a26dd7 in_seq=0 out_seq=0 2024-09-11T23:18:22.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.516+0000 7faab6000640 10 client.15024 ms_handle_connect on v2:172.21.15.160:6838/2041625862 2024-09-11T23:18:22.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.516+0000 7faab6000640 1 -- 172.21.15.37:0/1356577473 <== mds.1 v2:172.21.15.160:6838/2041625862 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x5630e64bcb30 con 0x5630e65da5e0 2024-09-11T23:18:22.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.516+0000 7faab6000640 10 client.15024 handle_command_reply: tid=0 2024-09-11T23:18:22.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.516+0000 7faad9fc7740 1 client.15024 shutdown 2024-09-11T23:18:22.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.517+0000 7faad9fc7740 1 -- 172.21.15.37:0/1356577473 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630e655a6c0 msgr2=0x5630e656ea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:22.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.517+0000 7faad9fc7740 1 --2- 172.21.15.37:0/1356577473 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630e655a6c0 0x5630e656ea70 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x5630e6567310 tx=0x7faac802a8c0 comp rx=0 tx=0).stop 2024-09-11T23:18:22.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.517+0000 7faad9fc7740 1 -- 172.21.15.37:0/1356577473 shutdown_connections 2024-09-11T23:18:22.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.517+0000 7faad9fc7740 1 --2- 172.21.15.37:0/1356577473 >> [v2:172.21.15.160:6838/2041625862,v1:172.21.15.160:6839/2041625862] conn(0x5630e65da5e0 0x5630e65d92f0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:22.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.517+0000 7faad9fc7740 1 --2- 172.21.15.37:0/1356577473 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5630e654fe00 0x5630e656e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:22.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.517+0000 7faad9fc7740 1 --2- 172.21.15.37:0/1356577473 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630e655a6c0 0x5630e656ea70 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:22.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.517+0000 7faad9fc7740 1 --2- 172.21.15.37:0/1356577473 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5630e654f4e0 0x5630e65751b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:22.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.517+0000 7faab6000640 0 client.15024 ms_handle_reset on v2:172.21.15.160:6838/2041625862 2024-09-11T23:18:22.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.517+0000 7faad9fc7740 1 -- 172.21.15.37:0/1356577473 >> 172.21.15.37:0/1356577473 conn(0x5630e654ba70 msgr2=0x5630e654abd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:22.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.517+0000 7faad9fc7740 1 -- 172.21.15.37:0/1356577473 shutdown_connections 2024-09-11T23:18:22.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.517+0000 7faad9fc7740 1 -- 172.21.15.37:0/1356577473 wait complete. 2024-09-11T23:18:22.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.517+0000 7faad9fc7740 20 client.15024 trim_cache size 0 max 16384 2024-09-11T23:18:22.521 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-11T23:18:22.521 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "8b03efce-7092-11ef-bcea-c7b262605968", 2024-09-11T23:18:22.521 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 1, 2024-09-11T23:18:22.521 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 24520, 2024-09-11T23:18:22.521 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2024-09-11T23:18:22.521 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2024-09-11T23:18:22.521 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2024-09-11T23:18:22.521 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 82.807680622999996, 2024-09-11T23:18:22.521 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 28, 2024-09-11T23:18:22.522 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 95, 2024-09-11T23:18:22.522 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 93, 2024-09-11T23:18:22.522 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 149.710649988 2024-09-11T23:18:22.522 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-11T23:18:22.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.518+0000 7faad5e00640 1 -- 172.21.15.37:0/2839562195 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7faab80a2c00 msgr2=0x7faab80a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:22.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.518+0000 7faad5e00640 1 --2- 172.21.15.37:0/2839562195 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7faab80a2c00 0x7faab80a50c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7faac8006010 tx=0x7faac8009960 comp rx=0 tx=0).stop 2024-09-11T23:18:22.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.518+0000 7faad5e00640 1 -- 172.21.15.37:0/2839562195 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faad0076720 msgr2=0x7faad01a45d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:22.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.518+0000 7faad5e00640 1 --2- 172.21.15.37:0/2839562195 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faad0076720 0x7faad01a45d0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7faac400e9f0 tx=0x7faac400eeb0 comp rx=0 tx=0).stop 2024-09-11T23:18:22.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.518+0000 7faad5e00640 1 -- 172.21.15.37:0/2839562195 shutdown_connections 2024-09-11T23:18:22.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.518+0000 7faad5e00640 1 --2- 172.21.15.37:0/2839562195 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7faab80a2c00 0x7faab80a50c0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:22.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.518+0000 7faad5e00640 1 --2- 172.21.15.37:0/2839562195 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faad0112870 0x7faad019e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:22.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.518+0000 7faad5e00640 1 --2- 172.21.15.37:0/2839562195 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faad0077040 0x7faad01a4b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:22.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.518+0000 7faad5e00640 1 --2- 172.21.15.37:0/2839562195 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faad0076720 0x7faad01a45d0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:22.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.518+0000 7faad5e00640 1 -- 172.21.15.37:0/2839562195 >> 172.21.15.37:0/2839562195 conn(0x7faad00ff910 msgr2=0x7faad0101d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:22.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.518+0000 7faad5e00640 1 -- 172.21.15.37:0/2839562195 shutdown_connections 2024-09-11T23:18:22.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:22.518+0000 7faad5e00640 1 -- 172.21.15.37:0/2839562195 wait complete. 2024-09-11T23:18:23.291 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph tell mds.b status 2024-09-11T23:18:23.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:18:23 smithi037 ceph-mon[30630]: pgmap v370: 129 pgs: 129 active+clean; 646 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-09-11T23:18:23.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:18:23 smithi037 ceph-mon[30630]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-11T23:18:23.677 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:18:23.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:18:23 smithi160 ceph-mon[35055]: pgmap v370: 129 pgs: 129 active+clean; 646 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-09-11T23:18:23.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:18:23 smithi160 ceph-mon[35055]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-11T23:18:23.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:18:23 smithi123 ceph-mon[35438]: pgmap v370: 129 pgs: 129 active+clean; 646 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-09-11T23:18:23.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:18:23 smithi123 ceph-mon[35438]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-11T23:18:24.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.275+0000 7fe1fd400640 1 -- 172.21.15.37:0/2753881214 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1f8108f60 msgr2=0x7fe1f8110ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:24.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.275+0000 7fe1fd400640 1 --2- 172.21.15.37:0/2753881214 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1f8108f60 0x7fe1f8110ae0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fe1f0009ca0 tx=0x7fe1f002a8c0 comp rx=0 tx=0).stop 2024-09-11T23:18:24.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.275+0000 7fe1fd400640 1 -- 172.21.15.37:0/2753881214 shutdown_connections 2024-09-11T23:18:24.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.275+0000 7fe1fd400640 1 --2- 172.21.15.37:0/2753881214 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe1f81047e0 0x7fe1f8108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:24.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.275+0000 7fe1fd400640 1 --2- 172.21.15.37:0/2753881214 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1f8108f60 0x7fe1f8110ae0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:24.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.275+0000 7fe1fd400640 1 --2- 172.21.15.37:0/2753881214 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe1f8103e30 0x7fe1f8104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:24.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.275+0000 7fe1fd400640 1 -- 172.21.15.37:0/2753881214 >> 172.21.15.37:0/2753881214 conn(0x7fe1f80ff910 msgr2=0x7fe1f8101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:24.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.275+0000 7fe1fd400640 1 -- 172.21.15.37:0/2753881214 shutdown_connections 2024-09-11T23:18:24.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.275+0000 7fe1fd400640 1 -- 172.21.15.37:0/2753881214 wait complete. 2024-09-11T23:18:24.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.276+0000 7fe1fd400640 1 Processor -- start 2024-09-11T23:18:24.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.276+0000 7fe1fd400640 1 -- start start 2024-09-11T23:18:24.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.276+0000 7fe1fd400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe1f8103e30 0x7fe1f819a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:24.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.276+0000 7fe1fd400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1f81047e0 0x7fe1f819aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:24.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.276+0000 7fe1fd400640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe1f8108f60 0x7fe1f819ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:24.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.277+0000 7fe1fd400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe1f8114010 con 0x7fe1f81047e0 2024-09-11T23:18:24.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.277+0000 7fe1fd400640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe1f8113e90 con 0x7fe1f8103e30 2024-09-11T23:18:24.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.277+0000 7fe1fd400640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fe1f8114190 con 0x7fe1f8108f60 2024-09-11T23:18:24.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.277+0000 7fe1efe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1f81047e0 0x7fe1f819aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:24.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.277+0000 7fe1efe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1f81047e0 0x7fe1f819aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60772/0 (socket says 172.21.15.37:60772) 2024-09-11T23:18:24.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.277+0000 7fe1efe00640 1 -- 172.21.15.37:0/886577329 learned_addr learned my addr 172.21.15.37:0/886577329 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:18:24.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.277+0000 7fe1f7e00640 1 --2- 172.21.15.37:0/886577329 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe1f8103e30 0x7fe1f819a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:24.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.277+0000 7fe1fca00640 1 --2- 172.21.15.37:0/886577329 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe1f8108f60 0x7fe1f819ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:24.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.277+0000 7fe1efe00640 1 -- 172.21.15.37:0/886577329 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe1f8108f60 msgr2=0x7fe1f819ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:24.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.277+0000 7fe1efe00640 1 --2- 172.21.15.37:0/886577329 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe1f8108f60 0x7fe1f819ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:24.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.277+0000 7fe1efe00640 1 -- 172.21.15.37:0/886577329 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe1f8103e30 msgr2=0x7fe1f819a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:24.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.277+0000 7fe1efe00640 1 --2- 172.21.15.37:0/886577329 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe1f8103e30 0x7fe1f819a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:24.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.277+0000 7fe1efe00640 1 -- 172.21.15.37:0/886577329 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1f819f4e0 con 0x7fe1f81047e0 2024-09-11T23:18:24.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.278+0000 7fe1efe00640 1 --2- 172.21.15.37:0/886577329 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1f81047e0 0x7fe1f819aa70 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fe1e000d950 tx=0x7fe1e000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:24.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.278+0000 7fe1f5600640 1 -- 172.21.15.37:0/886577329 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1e0017070 con 0x7fe1f81047e0 2024-09-11T23:18:24.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.278+0000 7fe1f5600640 1 -- 172.21.15.37:0/886577329 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe1e0009c30 con 0x7fe1f81047e0 2024-09-11T23:18:24.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.278+0000 7fe1f5600640 1 -- 172.21.15.37:0/886577329 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1e000f6b0 con 0x7fe1f81047e0 2024-09-11T23:18:24.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.278+0000 7fe1fd400640 1 -- 172.21.15.37:0/886577329 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1f819f7d0 con 0x7fe1f81047e0 2024-09-11T23:18:24.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.278+0000 7fe1fd400640 1 -- 172.21.15.37:0/886577329 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1f81a70b0 con 0x7fe1f81047e0 2024-09-11T23:18:24.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.281+0000 7fe20140d740 1 Processor -- start 2024-09-11T23:18:24.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.281+0000 7fe1f5600640 1 -- 172.21.15.37:0/886577329 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fe1e00109d0 con 0x7fe1f81047e0 2024-09-11T23:18:24.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.281+0000 7fe20140d740 1 -- start start 2024-09-11T23:18:24.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.282+0000 7fe20140d740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556b1dbd04e0 0x556b1dbd08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:24.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.282+0000 7fe20140d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556b1dbd0e00 0x556b1dbdb180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:24.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.282+0000 7fe20140d740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556b1dbdb6c0 0x556b1dbddab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:24.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.282+0000 7fe20140d740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x556b1db360b0 con 0x556b1dbd0e00 2024-09-11T23:18:24.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.282+0000 7fe20140d740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x556b1daddab0 con 0x556b1dbd04e0 2024-09-11T23:18:24.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.282+0000 7fe20140d740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x556b1db32070 con 0x556b1dbdb6c0 2024-09-11T23:18:24.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.282+0000 7fe1f7e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556b1dbd0e00 0x556b1dbdb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:24.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.282+0000 7fe1fca00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556b1dbd04e0 0x556b1dbd08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:24.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.282+0000 7fe1f7e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556b1dbd0e00 0x556b1dbdb180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60780/0 (socket says 172.21.15.37:60780) 2024-09-11T23:18:24.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.282+0000 7fe1f7e00640 1 -- 172.21.15.37:0/2270267094 learned_addr learned my addr 172.21.15.37:0/2270267094 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:18:24.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.282+0000 7fe1efe00640 1 --2- 172.21.15.37:0/2270267094 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556b1dbdb6c0 0x556b1dbddab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:24.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.283+0000 7fe1fca00640 1 -- 172.21.15.37:0/2270267094 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556b1dbdb6c0 msgr2=0x556b1dbddab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:24.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.283+0000 7fe1fca00640 1 --2- 172.21.15.37:0/2270267094 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556b1dbdb6c0 0x556b1dbddab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:24.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.283+0000 7fe1fca00640 1 -- 172.21.15.37:0/2270267094 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556b1dbd0e00 msgr2=0x556b1dbdb180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:24.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.283+0000 7fe1fca00640 1 --2- 172.21.15.37:0/2270267094 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556b1dbd0e00 0x556b1dbdb180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:24.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.283+0000 7fe1fca00640 1 -- 172.21.15.37:0/2270267094 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b1daea4a0 con 0x556b1dbd04e0 2024-09-11T23:18:24.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.283+0000 7fe1f7e00640 1 --2- 172.21.15.37:0/2270267094 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556b1dbd0e00 0x556b1dbdb180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:18:24.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.283+0000 7fe1fca00640 1 --2- 172.21.15.37:0/2270267094 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556b1dbd04e0 0x556b1dbd08c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe1f0005e30 tx=0x7fe1f002f3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e51080fca8ca3b96 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:24.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.283+0000 7fe1f5600640 1 --2- 172.21.15.37:0/886577329 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fe1dc0a2c00 0x7fe1dc0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:24.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.283+0000 7fe1f5600640 1 -- 172.21.15.37:0/886577329 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9295+0+0 (secure 0 0 0) 0x7fe1e00cef60 con 0x7fe1f81047e0 2024-09-11T23:18:24.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.283+0000 7fe1ed200640 1 -- 172.21.15.37:0/2270267094 <== mon.2 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1f0003970 con 0x556b1dbd04e0 2024-09-11T23:18:24.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.284+0000 7fe1ed200640 1 -- 172.21.15.37:0/2270267094 <== mon.2 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe1f0036030 con 0x556b1dbd04e0 2024-09-11T23:18:24.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.284+0000 7fe1f7e00640 1 --2- 172.21.15.37:0/886577329 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fe1dc0a2c00 0x7fe1dc0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:24.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.284+0000 7fe1ed200640 1 -- 172.21.15.37:0/2270267094 <== mon.2 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1f0004330 con 0x556b1dbd04e0 2024-09-11T23:18:24.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.284+0000 7fe20140d740 1 -- 172.21.15.37:0/2270267094 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556b1dbd04e0 msgr2=0x556b1dbd08c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:24.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.284+0000 7fe20140d740 1 --2- 172.21.15.37:0/2270267094 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556b1dbd04e0 0x556b1dbd08c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe1f0005e30 tx=0x7fe1f002f3c0 comp rx=0 tx=0).stop 2024-09-11T23:18:24.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.284+0000 7fe1f7e00640 1 --2- 172.21.15.37:0/886577329 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fe1dc0a2c00 0x7fe1dc0a50c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x556b1dbcd8d0 tx=0x7fe1e8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:24.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.284+0000 7fe20140d740 1 -- 172.21.15.37:0/2270267094 shutdown_connections 2024-09-11T23:18:24.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.284+0000 7fe20140d740 1 --2- 172.21.15.37:0/2270267094 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556b1dbdb6c0 0x556b1dbddab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:24.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.285+0000 7fe20140d740 1 --2- 172.21.15.37:0/2270267094 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556b1dbd0e00 0x556b1dbdb180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:24.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.285+0000 7fe20140d740 1 --2- 172.21.15.37:0/2270267094 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556b1dbd04e0 0x556b1dbd08c0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:24.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.285+0000 7fe20140d740 1 -- 172.21.15.37:0/2270267094 >> 172.21.15.37:0/2270267094 conn(0x556b1dbcca70 msgr2=0x556b1dbcce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:24.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.285+0000 7fe20140d740 1 -- 172.21.15.37:0/2270267094 shutdown_connections 2024-09-11T23:18:24.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.285+0000 7fe20140d740 1 -- 172.21.15.37:0/2270267094 wait complete. 2024-09-11T23:18:24.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.285+0000 7fe20140d740 1 -- start start 2024-09-11T23:18:24.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.285+0000 7fe20140d740 1 Processor -- start 2024-09-11T23:18:24.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.286+0000 7fe20140d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556b1dbd04e0 0x556b1dbd85d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:24.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.286+0000 7fe20140d740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556b1dbd0e00 0x556b1dbd8b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:24.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.286+0000 7fe20140d740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556b1dbdb6c0 0x556b1dbd9050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:24.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.286+0000 7fe20140d740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x556b1dbde1b0 con 0x556b1dbd04e0 2024-09-11T23:18:24.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.286+0000 7fe20140d740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x556b1dabe920 con 0x556b1dbdb6c0 2024-09-11T23:18:24.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.286+0000 7fe20140d740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x556b1dbde330 con 0x556b1dbd0e00 2024-09-11T23:18:24.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.286+0000 7fe20140d740 10 client.0 _ll_register_callbacks cb 0x556b1dae28a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:18:24.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.286+0000 7fe1f7e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556b1dbd04e0 0x556b1dbd85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:24.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.287+0000 7fe1f7e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556b1dbd04e0 0x556b1dbd85d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60792/0 (socket says 172.21.15.37:60792) 2024-09-11T23:18:24.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.287+0000 7fe1f7e00640 1 -- 172.21.15.37:0/1115491363 learned_addr learned my addr 172.21.15.37:0/1115491363 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:18:24.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.287+0000 7fe1efe00640 1 --2- 172.21.15.37:0/1115491363 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556b1dbd0e00 0x556b1dbd8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:24.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.287+0000 7fe1fca00640 1 --2- 172.21.15.37:0/1115491363 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556b1dbdb6c0 0x556b1dbd9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:24.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.287+0000 7fe1efe00640 1 -- 172.21.15.37:0/1115491363 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556b1dbdb6c0 msgr2=0x556b1dbd9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:24.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.287+0000 7fe1efe00640 1 --2- 172.21.15.37:0/1115491363 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556b1dbdb6c0 0x556b1dbd9050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:24.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.287+0000 7fe1efe00640 1 -- 172.21.15.37:0/1115491363 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556b1dbd04e0 msgr2=0x556b1dbd85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:24.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.287+0000 7fe1efe00640 1 --2- 172.21.15.37:0/1115491363 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556b1dbd04e0 0x556b1dbd85d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:24.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.287+0000 7fe1efe00640 1 -- 172.21.15.37:0/1115491363 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b1d8a72b0 con 0x556b1dbd0e00 2024-09-11T23:18:24.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.287+0000 7fe1f7e00640 1 --2- 172.21.15.37:0/1115491363 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556b1dbd04e0 0x556b1dbd85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:18:24.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.287+0000 7fe1efe00640 1 --2- 172.21.15.37:0/1115491363 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556b1dbd0e00 0x556b1dbd8b10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe1e00cc5b0 tx=0x7fe1e0010d70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b5257ce20bc08654 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:24.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.287+0000 7fe1e5600640 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2024-09-11T23:18:24.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.288+0000 7fe1e5600640 1 -- 172.21.15.37:0/1115491363 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1e0020050 con 0x556b1dbd0e00 2024-09-11T23:18:24.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.288+0000 7fe20140d740 1 -- 172.21.15.37:0/1115491363 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe1f0036030 con 0x556b1dbd0e00 2024-09-11T23:18:24.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.288+0000 7fe1e5600640 1 -- 172.21.15.37:0/1115491363 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9295+0+0 (secure 0 0 0) 0x7fe1e009a840 con 0x556b1dbd0e00 2024-09-11T23:18:24.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.288+0000 7fe1e5600640 1 -- 172.21.15.37:0/1115491363 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe1e009af30 con 0x556b1dbd0e00 2024-09-11T23:18:24.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.288+0000 7fe20140d740 10 client.25048 fetch_fsmap learned FSMap version 28 2024-09-11T23:18:24.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.288+0000 7fe20140d740 1 -- 172.21.15.37:0/1115491363 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x556b1dbe9ee0 con 0x556b1dbd0e00 2024-09-11T23:18:24.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.288+0000 7fe1e5600640 1 -- 172.21.15.37:0/1115491363 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe1f0036030 con 0x556b1dbd0e00 2024-09-11T23:18:24.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.288+0000 7fe1e5600640 1 -- 172.21.15.37:0/1115491363 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fe1e009f170 con 0x556b1dbd0e00 2024-09-11T23:18:24.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.289+0000 7fe20140d740 10 client.25048 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T23:18:24.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.289+0000 7fe20140d740 10 client.25048 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-11T23:18:24.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.289+0000 7fe20140d740 20 client.25048 populate_metadata read hostname 'smithi037' 2024-09-11T23:18:24.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.289+0000 7fe20140d740 1 --2- 172.21.15.37:0/1115491363 >> [v2:172.21.15.123:6838/3077076065,v1:172.21.15.123:6839/3077076065] conn(0x556b1dbec4c0 0x556b1dbed930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:24.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.289+0000 7fe20140d740 4 client.25048 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T23:18:24.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.289+0000 7fe20140d740 1 -- 172.21.15.37:0/1115491363 --> [v2:172.21.15.123:6838/3077076065,v1:172.21.15.123:6839/3077076065] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556b1db43620 con 0x556b1dbec4c0 2024-09-11T23:18:24.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.289+0000 7fe1f7e00640 1 --2- 172.21.15.37:0/1115491363 >> [v2:172.21.15.123:6838/3077076065,v1:172.21.15.123:6839/3077076065] conn(0x556b1dbec4c0 0x556b1dbed930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:24.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.290+0000 7fe1f7e00640 1 --2- 172.21.15.37:0/1115491363 >> [v2:172.21.15.123:6838/3077076065,v1:172.21.15.123:6839/3077076065] conn(0x556b1dbec4c0 0x556b1dbed930 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3cb22639350f3aae server_cookie=6dd3d934a7645f93 in_seq=0 out_seq=0 2024-09-11T23:18:24.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.290+0000 7fe1e5600640 10 client.25048 ms_handle_connect on v2:172.21.15.123:6838/3077076065 2024-09-11T23:18:24.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.290+0000 7fe1e5600640 1 -- 172.21.15.37:0/1115491363 <== mds.0 v2:172.21.15.123:6838/3077076065 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556b1db43620 con 0x556b1dbec4c0 2024-09-11T23:18:24.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.290+0000 7fe1e5600640 10 client.25048 handle_command_reply: tid=0 2024-09-11T23:18:24.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.291+0000 7fe20140d740 1 client.25048 shutdown 2024-09-11T23:18:24.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.291+0000 7fe20140d740 1 -- 172.21.15.37:0/1115491363 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556b1dbd0e00 msgr2=0x556b1dbd8b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:24.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.291+0000 7fe20140d740 1 --2- 172.21.15.37:0/1115491363 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556b1dbd0e00 0x556b1dbd8b10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe1e00cc5b0 tx=0x7fe1e0010d70 comp rx=0 tx=0).stop 2024-09-11T23:18:24.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.291+0000 7fe20140d740 1 -- 172.21.15.37:0/1115491363 shutdown_connections 2024-09-11T23:18:24.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.291+0000 7fe20140d740 1 --2- 172.21.15.37:0/1115491363 >> [v2:172.21.15.123:6838/3077076065,v1:172.21.15.123:6839/3077076065] conn(0x556b1dbec4c0 0x556b1dbed930 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:24.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.291+0000 7fe20140d740 1 --2- 172.21.15.37:0/1115491363 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556b1dbdb6c0 0x556b1dbd9050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:24.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.291+0000 7fe20140d740 1 --2- 172.21.15.37:0/1115491363 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556b1dbd0e00 0x556b1dbd8b10 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:24.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.291+0000 7fe20140d740 1 --2- 172.21.15.37:0/1115491363 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556b1dbd04e0 0x556b1dbd85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:24.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.291+0000 7fe20140d740 1 -- 172.21.15.37:0/1115491363 >> 172.21.15.37:0/1115491363 conn(0x556b1dbcca70 msgr2=0x556b1dbcbbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:24.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.291+0000 7fe1e5600640 0 client.25048 ms_handle_reset on v2:172.21.15.123:6838/3077076065 2024-09-11T23:18:24.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.291+0000 7fe20140d740 1 -- 172.21.15.37:0/1115491363 shutdown_connections 2024-09-11T23:18:24.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.291+0000 7fe20140d740 1 -- 172.21.15.37:0/1115491363 wait complete. 2024-09-11T23:18:24.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.291+0000 7fe20140d740 20 client.25048 trim_cache size 0 max 16384 2024-09-11T23:18:24.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.310+0000 7fe20140d740 1 Processor -- start 2024-09-11T23:18:24.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.310+0000 7fe20140d740 1 -- start start 2024-09-11T23:18:24.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.311+0000 7fe20140d740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556b1dbd04e0 0x556b1dbd2f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:24.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.311+0000 7fe20140d740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556b1dbd0e00 0x556b1dbd58d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:24.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.311+0000 7fe20140d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556b1dbdb6c0 0x556b1dbd5e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:24.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.311+0000 7fe20140d740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x556b1dbebc70 con 0x556b1dbdb6c0 2024-09-11T23:18:24.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.311+0000 7fe20140d740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x556b1dbec340 con 0x556b1dbd0e00 2024-09-11T23:18:24.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.311+0000 7fe20140d740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x556b1dbeca10 con 0x556b1dbd04e0 2024-09-11T23:18:24.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.311+0000 7fe1f7e00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556b1dbd04e0 0x556b1dbd2f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:24.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.311+0000 7fe1f7e00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556b1dbd04e0 0x556b1dbd2f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.37:37158/0 (socket says 172.21.15.37:37158) 2024-09-11T23:18:24.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.311+0000 7fe1f7e00640 1 -- 172.21.15.37:0/2602234433 learned_addr learned my addr 172.21.15.37:0/2602234433 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:18:24.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.311+0000 7fe1fca00640 1 --2- 172.21.15.37:0/2602234433 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556b1dbdb6c0 0x556b1dbd5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:24.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.311+0000 7fe1efe00640 1 --2- 172.21.15.37:0/2602234433 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556b1dbd0e00 0x556b1dbd58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:24.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.311+0000 7fe1f7e00640 1 -- 172.21.15.37:0/2602234433 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556b1dbd0e00 msgr2=0x556b1dbd58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:24.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.311+0000 7fe1f7e00640 1 --2- 172.21.15.37:0/2602234433 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556b1dbd0e00 0x556b1dbd58d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:24.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.311+0000 7fe1f7e00640 1 -- 172.21.15.37:0/2602234433 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556b1dbdb6c0 msgr2=0x556b1dbd5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:24.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.311+0000 7fe1f7e00640 1 --2- 172.21.15.37:0/2602234433 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556b1dbdb6c0 0x556b1dbd5e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:24.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.311+0000 7fe1f7e00640 1 -- 172.21.15.37:0/2602234433 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b1dbdaf40 con 0x556b1dbd04e0 2024-09-11T23:18:24.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.312+0000 7fe1f7e00640 1 --2- 172.21.15.37:0/2602234433 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556b1dbd04e0 0x556b1dbd2f90 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x556b1dbd9a60 tx=0x7fe1e8012f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f864e7216f74c51c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:24.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.312+0000 7fe1e7e00640 1 -- 172.21.15.37:0/2602234433 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1e800fd30 con 0x556b1dbd04e0 2024-09-11T23:18:24.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.312+0000 7fe1e7e00640 1 -- 172.21.15.37:0/2602234433 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe1e801dd20 con 0x556b1dbd04e0 2024-09-11T23:18:24.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.312+0000 7fe1e7e00640 1 -- 172.21.15.37:0/2602234433 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1e80049e0 con 0x556b1dbd04e0 2024-09-11T23:18:24.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.313+0000 7fe20140d740 1 -- 172.21.15.37:0/2602234433 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556b1dbd04e0 msgr2=0x556b1dbd2f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:24.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.313+0000 7fe20140d740 1 --2- 172.21.15.37:0/2602234433 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556b1dbd04e0 0x556b1dbd2f90 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x556b1dbd9a60 tx=0x7fe1e8012f90 comp rx=0 tx=0).stop 2024-09-11T23:18:24.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.313+0000 7fe20140d740 1 -- 172.21.15.37:0/2602234433 shutdown_connections 2024-09-11T23:18:24.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.313+0000 7fe20140d740 1 --2- 172.21.15.37:0/2602234433 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556b1dbd0e00 0x556b1dbd58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:24.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.313+0000 7fe20140d740 1 --2- 172.21.15.37:0/2602234433 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556b1dbdb6c0 0x556b1dbd5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:24.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.313+0000 7fe20140d740 1 --2- 172.21.15.37:0/2602234433 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556b1dbd04e0 0x556b1dbd2f90 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:24.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.313+0000 7fe20140d740 1 -- 172.21.15.37:0/2602234433 >> 172.21.15.37:0/2602234433 conn(0x556b1dbcca70 msgr2=0x556b1dbd6f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:24.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.313+0000 7fe20140d740 1 -- 172.21.15.37:0/2602234433 shutdown_connections 2024-09-11T23:18:24.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.313+0000 7fe20140d740 1 -- 172.21.15.37:0/2602234433 wait complete. 2024-09-11T23:18:24.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.314+0000 7fe20140d740 1 -- start start 2024-09-11T23:18:24.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.314+0000 7fe20140d740 1 Processor -- start 2024-09-11T23:18:24.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.314+0000 7fe20140d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556b1dbd04e0 0x556b1dbf0b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:24.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.314+0000 7fe20140d740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556b1dbd0e00 0x556b1dbf1070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:24.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.314+0000 7fe20140d740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556b1dbdb6c0 0x556b1dbf59a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:24.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.314+0000 7fe20140d740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x556b1dbed7b0 con 0x556b1dbd04e0 2024-09-11T23:18:24.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.314+0000 7fe20140d740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x556b1dbed0e0 con 0x556b1dbdb6c0 2024-09-11T23:18:24.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.314+0000 7fe20140d740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x556b1dbede80 con 0x556b1dbd0e00 2024-09-11T23:18:24.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.315+0000 7fe20140d740 10 client.0 _ll_register_callbacks cb 0x7fe1e00d2690 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:18:24.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.315+0000 7fe1f7e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556b1dbd04e0 0x556b1dbf0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:24.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.315+0000 7fe1f7e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556b1dbd04e0 0x556b1dbf0b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60816/0 (socket says 172.21.15.37:60816) 2024-09-11T23:18:24.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.315+0000 7fe1f7e00640 1 -- 172.21.15.37:0/4047442645 learned_addr learned my addr 172.21.15.37:0/4047442645 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:18:24.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.315+0000 7fe1efe00640 1 --2- 172.21.15.37:0/4047442645 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556b1dbd0e00 0x556b1dbf1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:24.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.315+0000 7fe1fca00640 1 --2- 172.21.15.37:0/4047442645 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556b1dbdb6c0 0x556b1dbf59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:24.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.315+0000 7fe1f7e00640 1 -- 172.21.15.37:0/4047442645 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556b1dbd0e00 msgr2=0x556b1dbf1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:24.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.315+0000 7fe1f7e00640 1 --2- 172.21.15.37:0/4047442645 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556b1dbd0e00 0x556b1dbf1070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:24.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.315+0000 7fe1f7e00640 1 -- 172.21.15.37:0/4047442645 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556b1dbdb6c0 msgr2=0x556b1dbf59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:24.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.315+0000 7fe1f7e00640 1 --2- 172.21.15.37:0/4047442645 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556b1dbdb6c0 0x556b1dbf59a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:24.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.315+0000 7fe1f7e00640 1 -- 172.21.15.37:0/4047442645 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b1dbf5f60 con 0x556b1dbd04e0 2024-09-11T23:18:24.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.316+0000 7fe1f7e00640 1 --2- 172.21.15.37:0/4047442645 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556b1dbd04e0 0x556b1dbf0b30 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe1e8009d40 tx=0x7fe1e8009d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c0faeac82ed1ea server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:24.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.316+0000 7fe1e5600640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-11T23:18:24.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.316+0000 7fe1e5600640 1 -- 172.21.15.37:0/4047442645 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1e8042060 con 0x556b1dbd04e0 2024-09-11T23:18:24.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.316+0000 7fe20140d740 1 -- 172.21.15.37:0/4047442645 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe1e801dd20 con 0x556b1dbd04e0 2024-09-11T23:18:24.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.316+0000 7fe1e5600640 1 -- 172.21.15.37:0/4047442645 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9295+0+0 (secure 0 0 0) 0x7fe1e800fd30 con 0x556b1dbd04e0 2024-09-11T23:18:24.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.316+0000 7fe1e5600640 1 -- 172.21.15.37:0/4047442645 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe1e801d840 con 0x556b1dbd04e0 2024-09-11T23:18:24.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.317+0000 7fe20140d740 10 client.15042 fetch_fsmap learned FSMap version 28 2024-09-11T23:18:24.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.317+0000 7fe20140d740 1 -- 172.21.15.37:0/4047442645 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x556b1dc57490 con 0x556b1dbd04e0 2024-09-11T23:18:24.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.317+0000 7fe1e5600640 1 -- 172.21.15.37:0/4047442645 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe1e801dd20 con 0x556b1dbd04e0 2024-09-11T23:18:24.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.317+0000 7fe1e5600640 1 -- 172.21.15.37:0/4047442645 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fe1e802a420 con 0x556b1dbd04e0 2024-09-11T23:18:24.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.317+0000 7fe20140d740 10 client.15042 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T23:18:24.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.317+0000 7fe20140d740 10 client.15042 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-11T23:18:24.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.317+0000 7fe20140d740 20 client.15042 populate_metadata read hostname 'smithi037' 2024-09-11T23:18:24.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.317+0000 7fe20140d740 1 --2- 172.21.15.37:0/4047442645 >> [v2:172.21.15.123:6838/3077076065,v1:172.21.15.123:6839/3077076065] conn(0x556b1dc5bbc0 0x556b1dc5a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:24.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.317+0000 7fe20140d740 4 client.15042 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T23:18:24.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.317+0000 7fe20140d740 1 -- 172.21.15.37:0/4047442645 --> [v2:172.21.15.123:6838/3077076065,v1:172.21.15.123:6839/3077076065] -- command(tid 0: {"prefix": "status"}) -- 0x556b1db3db30 con 0x556b1dc5bbc0 2024-09-11T23:18:24.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.318+0000 7fe1efe00640 1 --2- 172.21.15.37:0/4047442645 >> [v2:172.21.15.123:6838/3077076065,v1:172.21.15.123:6839/3077076065] conn(0x556b1dc5bbc0 0x556b1dc5a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:24.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.318+0000 7fe1efe00640 1 --2- 172.21.15.37:0/4047442645 >> [v2:172.21.15.123:6838/3077076065,v1:172.21.15.123:6839/3077076065] conn(0x556b1dc5bbc0 0x556b1dc5a8d0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=181d422a71513a2c server_cookie=dfe4d2da500e38cf in_seq=0 out_seq=0 2024-09-11T23:18:24.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.318+0000 7fe1e5600640 10 client.15042 ms_handle_connect on v2:172.21.15.123:6838/3077076065 2024-09-11T23:18:24.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.318+0000 7fe1e5600640 1 -- 172.21.15.37:0/4047442645 <== mds.0 v2:172.21.15.123:6838/3077076065 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x556b1db3db30 con 0x556b1dc5bbc0 2024-09-11T23:18:24.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.318+0000 7fe1e5600640 10 client.15042 handle_command_reply: tid=0 2024-09-11T23:18:24.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.318+0000 7fe20140d740 1 client.15042 shutdown 2024-09-11T23:18:24.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.319+0000 7fe20140d740 1 -- 172.21.15.37:0/4047442645 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556b1dbd04e0 msgr2=0x556b1dbf0b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:24.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.319+0000 7fe20140d740 1 --2- 172.21.15.37:0/4047442645 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556b1dbd04e0 0x556b1dbf0b30 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe1e8009d40 tx=0x7fe1e8009d70 comp rx=0 tx=0).stop 2024-09-11T23:18:24.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.319+0000 7fe20140d740 1 -- 172.21.15.37:0/4047442645 shutdown_connections 2024-09-11T23:18:24.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.319+0000 7fe20140d740 1 --2- 172.21.15.37:0/4047442645 >> [v2:172.21.15.123:6838/3077076065,v1:172.21.15.123:6839/3077076065] conn(0x556b1dc5bbc0 0x556b1dc5a8d0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:24.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.319+0000 7fe20140d740 1 --2- 172.21.15.37:0/4047442645 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556b1dbdb6c0 0x556b1dbf59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:24.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.319+0000 7fe20140d740 1 --2- 172.21.15.37:0/4047442645 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556b1dbd0e00 0x556b1dbf1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:24.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.319+0000 7fe20140d740 1 --2- 172.21.15.37:0/4047442645 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556b1dbd04e0 0x556b1dbf0b30 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:24.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.319+0000 7fe1e5600640 0 client.15042 ms_handle_reset on v2:172.21.15.123:6838/3077076065 2024-09-11T23:18:24.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.319+0000 7fe20140d740 1 -- 172.21.15.37:0/4047442645 >> 172.21.15.37:0/4047442645 conn(0x556b1dbcca70 msgr2=0x556b1dbcbbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:24.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.319+0000 7fe20140d740 1 -- 172.21.15.37:0/4047442645 shutdown_connections 2024-09-11T23:18:24.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.319+0000 7fe20140d740 1 -- 172.21.15.37:0/4047442645 wait complete. 2024-09-11T23:18:24.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.319+0000 7fe20140d740 20 client.15042 trim_cache size 0 max 16384 2024-09-11T23:18:24.326 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-11T23:18:24.326 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "8b03efce-7092-11ef-bcea-c7b262605968", 2024-09-11T23:18:24.326 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 0, 2024-09-11T23:18:24.326 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 24533, 2024-09-11T23:18:24.326 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2024-09-11T23:18:24.326 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2024-09-11T23:18:24.326 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2024-09-11T23:18:24.326 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 126.842440455, 2024-09-11T23:18:24.326 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 28, 2024-09-11T23:18:24.326 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 95, 2024-09-11T23:18:24.327 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 93, 2024-09-11T23:18:24.327 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 141.924573431 2024-09-11T23:18:24.327 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-11T23:18:24.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.320+0000 7fe1fd400640 1 -- 172.21.15.37:0/886577329 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fe1dc0a2c00 msgr2=0x7fe1dc0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:24.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.320+0000 7fe1fd400640 1 --2- 172.21.15.37:0/886577329 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fe1dc0a2c00 0x7fe1dc0a50c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x556b1dbcd8d0 tx=0x7fe1e8005f90 comp rx=0 tx=0).stop 2024-09-11T23:18:24.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.320+0000 7fe1fd400640 1 -- 172.21.15.37:0/886577329 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1f81047e0 msgr2=0x7fe1f819aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:24.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.320+0000 7fe1fd400640 1 --2- 172.21.15.37:0/886577329 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1f81047e0 0x7fe1f819aa70 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fe1e000d950 tx=0x7fe1e000de10 comp rx=0 tx=0).stop 2024-09-11T23:18:24.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.320+0000 7fe1fd400640 1 -- 172.21.15.37:0/886577329 shutdown_connections 2024-09-11T23:18:24.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.320+0000 7fe1fd400640 1 --2- 172.21.15.37:0/886577329 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fe1dc0a2c00 0x7fe1dc0a50c0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:24.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.320+0000 7fe1fd400640 1 --2- 172.21.15.37:0/886577329 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe1f8108f60 0x7fe1f819ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:24.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.320+0000 7fe1fd400640 1 --2- 172.21.15.37:0/886577329 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1f81047e0 0x7fe1f819aa70 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:24.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.320+0000 7fe1fd400640 1 --2- 172.21.15.37:0/886577329 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe1f8103e30 0x7fe1f819a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:24.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.320+0000 7fe1fd400640 1 -- 172.21.15.37:0/886577329 >> 172.21.15.37:0/886577329 conn(0x7fe1f80ff910 msgr2=0x7fe1f8101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:24.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.321+0000 7fe1fd400640 1 -- 172.21.15.37:0/886577329 shutdown_connections 2024-09-11T23:18:24.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:24.321+0000 7fe1fd400640 1 -- 172.21.15.37:0/886577329 wait complete. 2024-09-11T23:18:25.036 INFO:tasks.cephadm:Setup complete, yielding 2024-09-11T23:18:25.036 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-11T23:18:25.046 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi037.front.sepia.ceph.com 2024-09-11T23:18:25.046 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- bash -c 'ceph orch status' 2024-09-11T23:18:25.425 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:18:25.583 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:18:25 smithi037 ceph-mon[30630]: pgmap v371: 129 pgs: 129 active+clean; 646 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 9 op/s 2024-09-11T23:18:25.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:18:25 smithi160 ceph-mon[35055]: pgmap v371: 129 pgs: 129 active+clean; 646 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 9 op/s 2024-09-11T23:18:25.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:18:25 smithi123 ceph-mon[35438]: pgmap v371: 129 pgs: 129 active+clean; 646 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 9 op/s 2024-09-11T23:18:25.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:25.977+0000 7f9d7a800640 1 -- 172.21.15.37:0/3522375813 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d741037c0 msgr2=0x7f9d7410a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:25.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:25.977+0000 7f9d7a800640 1 --2- 172.21.15.37:0/3522375813 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d741037c0 0x7f9d7410a050 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f9d6c009ca0 tx=0x7f9d6c02a8c0 comp rx=0 tx=0).stop 2024-09-11T23:18:25.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:25.977+0000 7f9d7a800640 1 -- 172.21.15.37:0/3522375813 shutdown_connections 2024-09-11T23:18:25.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:25.977+0000 7f9d7a800640 1 --2- 172.21.15.37:0/3522375813 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d741037c0 0x7f9d7410a050 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:25.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:25.977+0000 7f9d7a800640 1 --2- 172.21.15.37:0/3522375813 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9d74102e00 0x7f9d74103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:25.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:25.977+0000 7f9d7a800640 1 --2- 172.21.15.37:0/3522375813 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9d74101c00 0x7f9d74102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:25.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:25.977+0000 7f9d7a800640 1 -- 172.21.15.37:0/3522375813 >> 172.21.15.37:0/3522375813 conn(0x7f9d740fd390 msgr2=0x7f9d740ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:25.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:25.977+0000 7f9d7a800640 1 -- 172.21.15.37:0/3522375813 shutdown_connections 2024-09-11T23:18:25.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:25.977+0000 7f9d7a800640 1 -- 172.21.15.37:0/3522375813 wait complete. 2024-09-11T23:18:25.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:25.978+0000 7f9d7a800640 1 Processor -- start 2024-09-11T23:18:25.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:25.978+0000 7f9d7a800640 1 -- start start 2024-09-11T23:18:25.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:25.978+0000 7f9d7a800640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9d74101c00 0x7f9d7419a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:25.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:25.978+0000 7f9d7a800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d74102e00 0x7f9d7419a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:25.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:25.978+0000 7f9d7a800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9d741037c0 0x7f9d741a1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:25.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:25.978+0000 7f9d7a800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9d7410d8b0 con 0x7f9d74102e00 2024-09-11T23:18:25.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:25.978+0000 7f9d7a800640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f9d7410d730 con 0x7f9d741037c0 2024-09-11T23:18:25.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:25.978+0000 7f9d7a800640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f9d7410da30 con 0x7f9d74101c00 2024-09-11T23:18:25.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:25.979+0000 7f9d72a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d74102e00 0x7f9d7419a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:25.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:25.979+0000 7f9d72a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d74102e00 0x7f9d7419a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60840/0 (socket says 172.21.15.37:60840) 2024-09-11T23:18:25.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:25.979+0000 7f9d72a00640 1 -- 172.21.15.37:0/2209791884 learned_addr learned my addr 172.21.15.37:0/2209791884 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:18:25.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:25.979+0000 7f9d73400640 1 --2- 172.21.15.37:0/2209791884 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9d74101c00 0x7f9d7419a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:25.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:25.979+0000 7f9d73e00640 1 --2- 172.21.15.37:0/2209791884 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9d741037c0 0x7f9d741a1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:25.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:25.979+0000 7f9d72a00640 1 -- 172.21.15.37:0/2209791884 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9d74101c00 msgr2=0x7f9d7419a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:25.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:25.979+0000 7f9d72a00640 1 --2- 172.21.15.37:0/2209791884 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9d74101c00 0x7f9d7419a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:25.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:25.979+0000 7f9d72a00640 1 -- 172.21.15.37:0/2209791884 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9d741037c0 msgr2=0x7f9d741a1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:25.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:25.979+0000 7f9d72a00640 1 --2- 172.21.15.37:0/2209791884 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9d741037c0 0x7f9d741a1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:25.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:25.979+0000 7f9d72a00640 1 -- 172.21.15.37:0/2209791884 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d741a1ca0 con 0x7f9d74102e00 2024-09-11T23:18:25.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:25.979+0000 7f9d73400640 1 --2- 172.21.15.37:0/2209791884 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9d74101c00 0x7f9d7419a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:18:25.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:25.979+0000 7f9d73e00640 1 --2- 172.21.15.37:0/2209791884 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9d741037c0 0x7f9d741a1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:18:25.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:25.979+0000 7f9d72a00640 1 --2- 172.21.15.37:0/2209791884 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d74102e00 0x7f9d7419a5b0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f9d6000d950 tx=0x7f9d6000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:25.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:25.980+0000 7f9d6be00640 1 -- 172.21.15.37:0/2209791884 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d60017070 con 0x7f9d74102e00 2024-09-11T23:18:25.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:25.980+0000 7f9d6be00640 1 -- 172.21.15.37:0/2209791884 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d60009c30 con 0x7f9d74102e00 2024-09-11T23:18:25.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:25.980+0000 7f9d7a800640 1 -- 172.21.15.37:0/2209791884 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d741a1f90 con 0x7f9d74102e00 2024-09-11T23:18:25.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:25.980+0000 7f9d6be00640 1 -- 172.21.15.37:0/2209791884 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d6000f6b0 con 0x7f9d74102e00 2024-09-11T23:18:25.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:25.980+0000 7f9d7a800640 1 -- 172.21.15.37:0/2209791884 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d741a2490 con 0x7f9d74102e00 2024-09-11T23:18:25.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:25.981+0000 7f9d7a800640 1 -- 172.21.15.37:0/2209791884 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d741a26c0 con 0x7f9d74102e00 2024-09-11T23:18:25.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:25.983+0000 7f9d6be00640 1 -- 172.21.15.37:0/2209791884 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f9d600109d0 con 0x7f9d74102e00 2024-09-11T23:18:25.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:25.985+0000 7f9d6be00640 1 --2- 172.21.15.37:0/2209791884 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f9d580a2c30 0x7f9d580a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:25.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:25.985+0000 7f9d6be00640 1 -- 172.21.15.37:0/2209791884 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9295+0+0 (secure 0 0 0) 0x7f9d600cf0f0 con 0x7f9d74102e00 2024-09-11T23:18:25.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:25.985+0000 7f9d73400640 1 --2- 172.21.15.37:0/2209791884 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f9d580a2c30 0x7f9d580a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:25.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:25.986+0000 7f9d73400640 1 --2- 172.21.15.37:0/2209791884 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f9d580a2c30 0x7f9d580a50f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f9d74102c60 tx=0x7f9d64005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:25.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:25.989+0000 7f9d6be00640 1 -- 172.21.15.37:0/2209791884 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9d6009bbd0 con 0x7f9d74102e00 2024-09-11T23:18:26.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:26.191+0000 7f9d7a800640 1 -- 172.21.15.37:0/2209791884 --> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f9d74075b40 con 0x7f9d580a2c30 2024-09-11T23:18:26.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:26.192+0000 7f9d6be00640 1 -- 172.21.15.37:0/2209791884 <== mgr.14150 v2:172.21.15.37:6800/31543269 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f9d74075b40 con 0x7f9d580a2c30 2024-09-11T23:18:26.192 INFO:teuthology.orchestra.run.smithi037.stdout:Backend: cephadm 2024-09-11T23:18:26.193 INFO:teuthology.orchestra.run.smithi037.stdout:Available: Yes 2024-09-11T23:18:26.193 INFO:teuthology.orchestra.run.smithi037.stdout:Paused: No 2024-09-11T23:18:26.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:26.195+0000 7f9d7a800640 1 -- 172.21.15.37:0/2209791884 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f9d580a2c30 msgr2=0x7f9d580a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:26.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:26.195+0000 7f9d7a800640 1 --2- 172.21.15.37:0/2209791884 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f9d580a2c30 0x7f9d580a50f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f9d74102c60 tx=0x7f9d64005f90 comp rx=0 tx=0).stop 2024-09-11T23:18:26.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:26.195+0000 7f9d7a800640 1 -- 172.21.15.37:0/2209791884 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d74102e00 msgr2=0x7f9d7419a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:26.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:26.195+0000 7f9d7a800640 1 --2- 172.21.15.37:0/2209791884 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d74102e00 0x7f9d7419a5b0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f9d6000d950 tx=0x7f9d6000de10 comp rx=0 tx=0).stop 2024-09-11T23:18:26.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:26.195+0000 7f9d7a800640 1 -- 172.21.15.37:0/2209791884 shutdown_connections 2024-09-11T23:18:26.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:26.195+0000 7f9d7a800640 1 --2- 172.21.15.37:0/2209791884 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f9d580a2c30 0x7f9d580a50f0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:26.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:26.195+0000 7f9d7a800640 1 --2- 172.21.15.37:0/2209791884 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9d741037c0 0x7f9d741a1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:26.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:26.195+0000 7f9d7a800640 1 --2- 172.21.15.37:0/2209791884 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d74102e00 0x7f9d7419a5b0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:26.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:26.195+0000 7f9d7a800640 1 --2- 172.21.15.37:0/2209791884 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9d74101c00 0x7f9d7419a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:26.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:26.195+0000 7f9d7a800640 1 -- 172.21.15.37:0/2209791884 >> 172.21.15.37:0/2209791884 conn(0x7f9d740fd390 msgr2=0x7f9d74074420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:26.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:26.195+0000 7f9d7a800640 1 -- 172.21.15.37:0/2209791884 shutdown_connections 2024-09-11T23:18:26.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:26.195+0000 7f9d7a800640 1 -- 172.21.15.37:0/2209791884 wait complete. 2024-09-11T23:18:27.026 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-11T23:18:27.404 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:18:27.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:18:27 smithi160 ceph-mon[35055]: pgmap v372: 129 pgs: 129 active+clean; 647 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 767 B/s wr, 12 op/s 2024-09-11T23:18:27.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:18:27 smithi160 ceph-mon[35055]: from='client.15048 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:18:27.692 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:18:27 smithi037 ceph-mon[30630]: pgmap v372: 129 pgs: 129 active+clean; 647 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 767 B/s wr, 12 op/s 2024-09-11T23:18:27.692 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:18:27 smithi037 ceph-mon[30630]: from='client.15048 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:18:27.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:18:27 smithi123 ceph-mon[35438]: pgmap v372: 129 pgs: 129 active+clean; 647 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 767 B/s wr, 12 op/s 2024-09-11T23:18:27.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:18:27 smithi123 ceph-mon[35438]: from='client.15048 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:18:27.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:27.977+0000 7fe82d800640 1 -- 172.21.15.37:0/1527628236 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe828103e00 msgr2=0x7fe828104200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:27.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:27.977+0000 7fe82d800640 1 --2- 172.21.15.37:0/1527628236 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe828103e00 0x7fe828104200 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe818009900 tx=0x7fe81802a400 comp rx=0 tx=0).stop 2024-09-11T23:18:27.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:27.977+0000 7fe82d800640 1 -- 172.21.15.37:0/1527628236 shutdown_connections 2024-09-11T23:18:27.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:27.977+0000 7fe82d800640 1 --2- 172.21.15.37:0/1527628236 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe828104f60 0x7fe8281053e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:27.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:27.977+0000 7fe82d800640 1 --2- 172.21.15.37:0/1527628236 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe828105920 0x7fe82810c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:27.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:27.977+0000 7fe82d800640 1 --2- 172.21.15.37:0/1527628236 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe828103e00 0x7fe828104200 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:27.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:27.977+0000 7fe82d800640 1 -- 172.21.15.37:0/1527628236 >> 172.21.15.37:0/1527628236 conn(0x7fe8280ff5b0 msgr2=0x7fe8281019d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:27.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:27.977+0000 7fe82d800640 1 -- 172.21.15.37:0/1527628236 shutdown_connections 2024-09-11T23:18:27.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:27.978+0000 7fe82d800640 1 -- 172.21.15.37:0/1527628236 wait complete. 2024-09-11T23:18:27.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:27.979+0000 7fe82d800640 1 Processor -- start 2024-09-11T23:18:27.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:27.979+0000 7fe82d800640 1 -- start start 2024-09-11T23:18:27.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:27.980+0000 7fe82d800640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe828103e00 0x7fe82819a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:27.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:27.980+0000 7fe82d800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe828104f60 0x7fe82819a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:27.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:27.980+0000 7fe82d800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe828105920 0x7fe8281a16a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:27.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:27.980+0000 7fe82d800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe82810fa90 con 0x7fe828105920 2024-09-11T23:18:27.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:27.980+0000 7fe82d800640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe82810f910 con 0x7fe828104f60 2024-09-11T23:18:27.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:27.980+0000 7fe82d800640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fe82810fc10 con 0x7fe828103e00 2024-09-11T23:18:27.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:27.980+0000 7fe827400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe828105920 0x7fe8281a16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:27.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:27.980+0000 7fe826a00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe828103e00 0x7fe82819a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:27.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:27.980+0000 7fe826000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe828104f60 0x7fe82819a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:27.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:27.980+0000 7fe827400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe828105920 0x7fe8281a16a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60856/0 (socket says 172.21.15.37:60856) 2024-09-11T23:18:27.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:27.980+0000 7fe827400640 1 -- 172.21.15.37:0/2459624080 learned_addr learned my addr 172.21.15.37:0/2459624080 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:18:27.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:27.980+0000 7fe826a00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe828103e00 0x7fe82819a0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.37:37192/0 (socket says 172.21.15.37:37192) 2024-09-11T23:18:27.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:27.980+0000 7fe827400640 1 -- 172.21.15.37:0/2459624080 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe828103e00 msgr2=0x7fe82819a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:27.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:27.981+0000 7fe827400640 1 --2- 172.21.15.37:0/2459624080 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe828103e00 0x7fe82819a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:27.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:27.981+0000 7fe827400640 1 -- 172.21.15.37:0/2459624080 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe828104f60 msgr2=0x7fe82819a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:27.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:27.981+0000 7fe827400640 1 --2- 172.21.15.37:0/2459624080 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe828104f60 0x7fe82819a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:27.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:27.981+0000 7fe827400640 1 -- 172.21.15.37:0/2459624080 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8281a1d10 con 0x7fe828105920 2024-09-11T23:18:27.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:27.981+0000 7fe826000640 1 --2- 172.21.15.37:0/2459624080 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe828104f60 0x7fe82819a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:18:27.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:27.981+0000 7fe827400640 1 --2- 172.21.15.37:0/2459624080 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe828105920 0x7fe8281a16a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fe82000eb10 tx=0x7fe82000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:27.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:27.981+0000 7fe81f400640 1 -- 172.21.15.37:0/2459624080 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe820004b20 con 0x7fe828105920 2024-09-11T23:18:27.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:27.981+0000 7fe81f400640 1 -- 172.21.15.37:0/2459624080 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe820004cc0 con 0x7fe828105920 2024-09-11T23:18:27.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:27.981+0000 7fe82d800640 1 -- 172.21.15.37:0/2459624080 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8281a1fa0 con 0x7fe828105920 2024-09-11T23:18:27.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:27.981+0000 7fe81f400640 1 -- 172.21.15.37:0/2459624080 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe820010760 con 0x7fe828105920 2024-09-11T23:18:27.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:27.981+0000 7fe82d800640 1 -- 172.21.15.37:0/2459624080 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8281a2460 con 0x7fe828105920 2024-09-11T23:18:27.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:27.982+0000 7fe82d800640 1 -- 172.21.15.37:0/2459624080 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe82810b1a0 con 0x7fe828105920 2024-09-11T23:18:27.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:27.984+0000 7fe81f400640 1 -- 172.21.15.37:0/2459624080 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fe820005020 con 0x7fe828105920 2024-09-11T23:18:27.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:27.986+0000 7fe81f400640 1 --2- 172.21.15.37:0/2459624080 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fe80c0a2bb0 0x7fe80c0a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:27.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:27.987+0000 7fe81f400640 1 -- 172.21.15.37:0/2459624080 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9295+0+0 (secure 0 0 0) 0x7fe8200cfa00 con 0x7fe828105920 2024-09-11T23:18:27.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:27.987+0000 7fe826a00640 1 --2- 172.21.15.37:0/2459624080 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fe80c0a2bb0 0x7fe80c0a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:27.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:27.987+0000 7fe826a00640 1 --2- 172.21.15.37:0/2459624080 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fe80c0a2bb0 0x7fe80c0a5070 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe8180314e0 tx=0x7fe818000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:27.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:27.990+0000 7fe81f400640 1 -- 172.21.15.37:0/2459624080 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe82009c4e0 con 0x7fe828105920 2024-09-11T23:18:28.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:28.183+0000 7fe82d800640 1 -- 172.21.15.37:0/2459624080 --> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fe828062630 con 0x7fe80c0a2bb0 2024-09-11T23:18:28.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:28.195+0000 7fe81f400640 1 -- 172.21.15.37:0/2459624080 <== mgr.14150 v2:172.21.15.37:6800/31543269 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4092 (secure 0 0 0) 0x7fe828062630 con 0x7fe80c0a2bb0 2024-09-11T23:18:28.195 INFO:teuthology.orchestra.run.smithi037.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-11T23:18:28.195 INFO:teuthology.orchestra.run.smithi037.stdout:mds.a smithi037 running (2m) 9s ago 2m 16.5M - 19.1.1-298-gb53b6d3e 54467abc55f8 11b888c7cda1 2024-09-11T23:18:28.196 INFO:teuthology.orchestra.run.smithi037.stdout:mds.b smithi123 running (2m) 12s ago 2m 25.7M - 19.1.1-298-gb53b6d3e 54467abc55f8 aded3ef33681 2024-09-11T23:18:28.196 INFO:teuthology.orchestra.run.smithi037.stdout:mds.c smithi160 running (2m) 12s ago 2m 18.9M - 19.1.1-298-gb53b6d3e 54467abc55f8 f2e7795edd73 2024-09-11T23:18:28.196 INFO:teuthology.orchestra.run.smithi037.stdout:mds.d smithi037 running (2m) 9s ago 2m 13.0M - 19.1.1-298-gb53b6d3e 54467abc55f8 a5ddc41a5961 2024-09-11T23:18:28.196 INFO:teuthology.orchestra.run.smithi037.stdout:mds.e smithi123 running (2m) 12s ago 2m 21.0M - 19.1.1-298-gb53b6d3e 54467abc55f8 d4249ad555eb 2024-09-11T23:18:28.196 INFO:teuthology.orchestra.run.smithi037.stdout:mds.f smithi160 running (2m) 12s ago 2m 18.1M - 19.1.1-298-gb53b6d3e 54467abc55f8 85da6bde1dd5 2024-09-11T23:18:28.196 INFO:teuthology.orchestra.run.smithi037.stdout:mds.g smithi037 running (2m) 9s ago 2m 16.6M - 19.1.1-298-gb53b6d3e 54467abc55f8 22f2d21f19d9 2024-09-11T23:18:28.196 INFO:teuthology.orchestra.run.smithi037.stdout:mds.h smithi123 running (2m) 12s ago 2m 17.7M - 19.1.1-298-gb53b6d3e 54467abc55f8 256404eb79bd 2024-09-11T23:18:28.196 INFO:teuthology.orchestra.run.smithi037.stdout:mds.i smithi160 running (2m) 12s ago 2m 18.7M - 19.1.1-298-gb53b6d3e 54467abc55f8 cf017f203c3f 2024-09-11T23:18:28.196 INFO:teuthology.orchestra.run.smithi037.stdout:mds.j smithi037 running (2m) 9s ago 2m 13.2M - 19.1.1-298-gb53b6d3e 54467abc55f8 9ead93e0f5a3 2024-09-11T23:18:28.196 INFO:teuthology.orchestra.run.smithi037.stdout:mds.k smithi123 running (2m) 12s ago 2m 19.8M - 19.1.1-298-gb53b6d3e 54467abc55f8 1b47a29b3f6b 2024-09-11T23:18:28.196 INFO:teuthology.orchestra.run.smithi037.stdout:mds.l smithi160 running (2m) 12s ago 2m 20.0M - 19.1.1-298-gb53b6d3e 54467abc55f8 961c574cf335 2024-09-11T23:18:28.196 INFO:teuthology.orchestra.run.smithi037.stdout:mgr.x smithi037 *:9283,8765 running (10m) 9s ago 10m 510M - 19.1.1-298-gb53b6d3e 54467abc55f8 a37b4620cc88 2024-09-11T23:18:28.196 INFO:teuthology.orchestra.run.smithi037.stdout:mgr.y smithi123 *:8443,8765 running (8m) 12s ago 8m 443M - 19.1.1-298-gb53b6d3e 54467abc55f8 fd87b2de8d11 2024-09-11T23:18:28.197 INFO:teuthology.orchestra.run.smithi037.stdout:mgr.z smithi160 *:8443,8765 running (8m) 12s ago 8m 442M - 19.1.1-298-gb53b6d3e 54467abc55f8 16f8fc961ace 2024-09-11T23:18:28.197 INFO:teuthology.orchestra.run.smithi037.stdout:mon.a smithi037 running (10m) 9s ago 10m 50.5M 2048M 19.1.1-298-gb53b6d3e 54467abc55f8 c2d2d08e1b75 2024-09-11T23:18:28.197 INFO:teuthology.orchestra.run.smithi037.stdout:mon.b smithi123 running (8m) 12s ago 8m 41.9M 2048M 19.1.1-298-gb53b6d3e 54467abc55f8 4d3bb55dfca2 2024-09-11T23:18:28.197 INFO:teuthology.orchestra.run.smithi037.stdout:mon.c smithi160 running (8m) 12s ago 8m 41.5M 2048M 19.1.1-298-gb53b6d3e 54467abc55f8 4bff42e76a97 2024-09-11T23:18:28.197 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0 smithi037 running (8m) 9s ago 8m 53.1M 4273M 19.1.1-298-gb53b6d3e 54467abc55f8 dd609e582594 2024-09-11T23:18:28.197 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1 smithi123 running (7m) 12s ago 7m 47.9M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 431e33f0dc4e 2024-09-11T23:18:28.197 INFO:teuthology.orchestra.run.smithi037.stdout:osd.2 smithi160 running (7m) 12s ago 7m 54.2M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 b49b97d77fa7 2024-09-11T23:18:28.197 INFO:teuthology.orchestra.run.smithi037.stdout:osd.3 smithi037 running (6m) 9s ago 6m 43.8M 4273M 19.1.1-298-gb53b6d3e 54467abc55f8 1527a4b0cf86 2024-09-11T23:18:28.197 INFO:teuthology.orchestra.run.smithi037.stdout:osd.4 smithi123 running (6m) 12s ago 6m 51.8M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 ecf7680b27e3 2024-09-11T23:18:28.197 INFO:teuthology.orchestra.run.smithi037.stdout:osd.5 smithi160 running (6m) 12s ago 6m 46.7M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 4780d0b7d74b 2024-09-11T23:18:28.198 INFO:teuthology.orchestra.run.smithi037.stdout:osd.6 smithi037 running (5m) 9s ago 5m 49.6M 4273M 19.1.1-298-gb53b6d3e 54467abc55f8 e1a6ed77222a 2024-09-11T23:18:28.198 INFO:teuthology.orchestra.run.smithi037.stdout:osd.7 smithi123 running (5m) 12s ago 5m 53.5M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 3e7e055d93ab 2024-09-11T23:18:28.198 INFO:teuthology.orchestra.run.smithi037.stdout:osd.8 smithi160 running (4m) 12s ago 4m 51.6M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 9d9bfb862389 2024-09-11T23:18:28.198 INFO:teuthology.orchestra.run.smithi037.stdout:osd.9 smithi037 running (4m) 9s ago 4m 41.4M 4273M 19.1.1-298-gb53b6d3e 54467abc55f8 1bc3ec3f10d2 2024-09-11T23:18:28.198 INFO:teuthology.orchestra.run.smithi037.stdout:osd.10 smithi123 running (3m) 12s ago 3m 46.3M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 6e09bb0b261c 2024-09-11T23:18:28.198 INFO:teuthology.orchestra.run.smithi037.stdout:osd.11 smithi160 running (3m) 12s ago 3m 42.3M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 5cc5efb62767 2024-09-11T23:18:28.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:28.197+0000 7fe82d800640 1 -- 172.21.15.37:0/2459624080 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fe80c0a2bb0 msgr2=0x7fe80c0a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:28.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:28.197+0000 7fe82d800640 1 --2- 172.21.15.37:0/2459624080 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fe80c0a2bb0 0x7fe80c0a5070 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe8180314e0 tx=0x7fe818000bc0 comp rx=0 tx=0).stop 2024-09-11T23:18:28.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:28.197+0000 7fe82d800640 1 -- 172.21.15.37:0/2459624080 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe828105920 msgr2=0x7fe8281a16a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:28.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:28.197+0000 7fe82d800640 1 --2- 172.21.15.37:0/2459624080 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe828105920 0x7fe8281a16a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fe82000eb10 tx=0x7fe82000c2d0 comp rx=0 tx=0).stop 2024-09-11T23:18:28.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:28.198+0000 7fe82d800640 1 -- 172.21.15.37:0/2459624080 shutdown_connections 2024-09-11T23:18:28.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:28.198+0000 7fe82d800640 1 --2- 172.21.15.37:0/2459624080 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fe80c0a2bb0 0x7fe80c0a5070 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:28.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:28.198+0000 7fe82d800640 1 --2- 172.21.15.37:0/2459624080 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe828104f60 0x7fe82819a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:28.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:28.198+0000 7fe82d800640 1 --2- 172.21.15.37:0/2459624080 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe828105920 0x7fe8281a16a0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:28.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:28.198+0000 7fe82d800640 1 --2- 172.21.15.37:0/2459624080 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe828103e00 0x7fe82819a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:28.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:28.198+0000 7fe82d800640 1 -- 172.21.15.37:0/2459624080 >> 172.21.15.37:0/2459624080 conn(0x7fe8280ff5b0 msgr2=0x7fe828108370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:28.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:28.198+0000 7fe82d800640 1 -- 172.21.15.37:0/2459624080 shutdown_connections 2024-09-11T23:18:28.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:28.198+0000 7fe82d800640 1 -- 172.21.15.37:0/2459624080 wait complete. 2024-09-11T23:18:28.990 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-11T23:18:29.382 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:18:29.672 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:18:29 smithi037 ceph-mon[30630]: pgmap v373: 129 pgs: 129 active+clean; 647 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 767 B/s wr, 9 op/s 2024-09-11T23:18:29.672 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:18:29 smithi037 ceph-mon[30630]: from='client.15054 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:18:29.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:18:29 smithi160 ceph-mon[35055]: pgmap v373: 129 pgs: 129 active+clean; 647 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 767 B/s wr, 9 op/s 2024-09-11T23:18:29.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:18:29 smithi160 ceph-mon[35055]: from='client.15054 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:18:29.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:18:29 smithi123 ceph-mon[35438]: pgmap v373: 129 pgs: 129 active+clean; 647 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 767 B/s wr, 9 op/s 2024-09-11T23:18:29.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:18:29 smithi123 ceph-mon[35438]: from='client.15054 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:18:29.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:29.953+0000 7f66b6000640 1 -- 172.21.15.37:0/2159885373 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66b0101a40 msgr2=0x7f66b0101e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:29.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:29.953+0000 7f66b6000640 1 --2- 172.21.15.37:0/2159885373 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66b0101a40 0x7f66b0101e40 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f66a4009860 tx=0x7f66a402a340 comp rx=0 tx=0).stop 2024-09-11T23:18:29.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:29.953+0000 7f66b6000640 1 -- 172.21.15.37:0/2159885373 shutdown_connections 2024-09-11T23:18:29.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:29.953+0000 7f66b6000640 1 --2- 172.21.15.37:0/2159885373 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f66b0103600 0x7f66b0109e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:29.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:29.953+0000 7f66b6000640 1 --2- 172.21.15.37:0/2159885373 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f66b0102c40 0x7f66b01030c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:29.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:29.953+0000 7f66b6000640 1 --2- 172.21.15.37:0/2159885373 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66b0101a40 0x7f66b0101e40 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:29.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:29.953+0000 7f66b6000640 1 -- 172.21.15.37:0/2159885373 >> 172.21.15.37:0/2159885373 conn(0x7f66b00fd1f0 msgr2=0x7f66b00ff610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:29.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:29.954+0000 7f66b6000640 1 -- 172.21.15.37:0/2159885373 shutdown_connections 2024-09-11T23:18:29.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:29.954+0000 7f66b6000640 1 -- 172.21.15.37:0/2159885373 wait complete. 2024-09-11T23:18:29.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:29.954+0000 7f66b6000640 1 Processor -- start 2024-09-11T23:18:29.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:29.955+0000 7f66b6000640 1 -- start start 2024-09-11T23:18:29.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:29.955+0000 7f66b6000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66b0101a40 0x7f66b0075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:29.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:29.955+0000 7f66b6000640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f66b0102c40 0x7f66b00745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:29.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:29.955+0000 7f66b6000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f66b0103600 0x7f66b0074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:29.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:29.955+0000 7f66b6000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f66b010d6a0 con 0x7f66b0103600 2024-09-11T23:18:29.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:29.955+0000 7f66b6000640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f66b010d520 con 0x7f66b0101a40 2024-09-11T23:18:29.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:29.955+0000 7f66b6000640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f66b010d820 con 0x7f66b0102c40 2024-09-11T23:18:29.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:29.955+0000 7f66b5600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f66b0103600 0x7f66b0074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:29.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:29.955+0000 7f66b4c00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66b0101a40 0x7f66b0075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:29.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:29.955+0000 7f66b5600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f66b0103600 0x7f66b0074b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49458/0 (socket says 172.21.15.37:49458) 2024-09-11T23:18:29.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:29.955+0000 7f66b5600640 1 -- 172.21.15.37:0/2369875452 learned_addr learned my addr 172.21.15.37:0/2369875452 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:18:29.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:29.955+0000 7f66afe00640 1 --2- 172.21.15.37:0/2369875452 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f66b0102c40 0x7f66b00745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:29.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:29.956+0000 7f66b4c00640 1 -- 172.21.15.37:0/2369875452 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f66b0102c40 msgr2=0x7f66b00745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:29.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:29.956+0000 7f66b4c00640 1 --2- 172.21.15.37:0/2369875452 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f66b0102c40 0x7f66b00745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:29.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:29.956+0000 7f66b4c00640 1 -- 172.21.15.37:0/2369875452 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f66b0103600 msgr2=0x7f66b0074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:29.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:29.956+0000 7f66b4c00640 1 --2- 172.21.15.37:0/2369875452 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f66b0103600 0x7f66b0074b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:29.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:29.956+0000 7f66b4c00640 1 -- 172.21.15.37:0/2369875452 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66b00753e0 con 0x7f66b0101a40 2024-09-11T23:18:29.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:29.956+0000 7f66b4c00640 1 --2- 172.21.15.37:0/2369875452 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66b0101a40 0x7f66b0075f90 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f66a402a860 tx=0x7f66a4033d90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:29.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:29.957+0000 7f66ad600640 1 -- 172.21.15.37:0/2369875452 <== mon.2 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66a4037040 con 0x7f66b0101a40 2024-09-11T23:18:29.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:29.957+0000 7f66b6000640 1 -- 172.21.15.37:0/2369875452 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66b01a1e60 con 0x7f66b0101a40 2024-09-11T23:18:29.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:29.957+0000 7f66ad600640 1 -- 172.21.15.37:0/2369875452 <== mon.2 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f66a4030850 con 0x7f66b0101a40 2024-09-11T23:18:29.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:29.957+0000 7f66ad600640 1 -- 172.21.15.37:0/2369875452 <== mon.2 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66a4004920 con 0x7f66b0101a40 2024-09-11T23:18:29.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:29.957+0000 7f66b6000640 1 -- 172.21.15.37:0/2369875452 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66b01a2250 con 0x7f66b0101a40 2024-09-11T23:18:29.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:29.958+0000 7f66b6000640 1 -- 172.21.15.37:0/2369875452 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66b0101e40 con 0x7f66b0101a40 2024-09-11T23:18:29.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:29.960+0000 7f66ad600640 1 -- 172.21.15.37:0/2369875452 <== mon.2 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f66a4004050 con 0x7f66b0101a40 2024-09-11T23:18:29.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:29.961+0000 7f66ad600640 1 --2- 172.21.15.37:0/2369875452 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f66980a2c00 0x7f66980a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:29.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:29.961+0000 7f66ad600640 1 -- 172.21.15.37:0/2369875452 <== mon.2 v2:172.21.15.123:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9295+0+0 (secure 0 0 0) 0x7f66a40ef1f0 con 0x7f66b0101a40 2024-09-11T23:18:29.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:29.962+0000 7f66afe00640 1 --2- 172.21.15.37:0/2369875452 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f66980a2c00 0x7f66980a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:29.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:29.962+0000 7f66afe00640 1 --2- 172.21.15.37:0/2369875452 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f66980a2c00 0x7f66980a50c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f66b0075d10 tx=0x7f669c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:29.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:29.964+0000 7f66ad600640 1 -- 172.21.15.37:0/2369875452 <== mon.2 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f66a40bbcd0 con 0x7f66b0101a40 2024-09-11T23:18:30.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:30.158+0000 7f66b6000640 1 -- 172.21.15.37:0/2369875452 --> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f66b0062630 con 0x7f66980a2c00 2024-09-11T23:18:30.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:30.164+0000 7f66ad600640 1 -- 172.21.15.37:0/2369875452 <== mgr.14150 v2:172.21.15.37:6800/31543269 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7f66b0062630 con 0x7f66980a2c00 2024-09-11T23:18:30.164 INFO:teuthology.orchestra.run.smithi037.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-11T23:18:30.164 INFO:teuthology.orchestra.run.smithi037.stdout:mds.all 12/12 14s ago 3m smithi037=a;smithi037=d;smithi037=g;smithi037=j;smithi123=b;smithi123=e;smithi123=h;smithi123=k;smithi160=c;smithi160=f;smithi160=i;smithi160=l;count:12 2024-09-11T23:18:30.165 INFO:teuthology.orchestra.run.smithi037.stdout:mgr 3/3 14s ago 8m smithi037=x;smithi123=y;smithi160=z;count:3 2024-09-11T23:18:30.165 INFO:teuthology.orchestra.run.smithi037.stdout:mon 3/3 14s ago 9m smithi037:172.21.15.37=a;smithi123:172.21.15.123=b;smithi160:172.21.15.160=c;count:3 2024-09-11T23:18:30.165 INFO:teuthology.orchestra.run.smithi037.stdout:osd 12 14s ago - 2024-09-11T23:18:30.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:30.167+0000 7f66b6000640 1 -- 172.21.15.37:0/2369875452 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f66980a2c00 msgr2=0x7f66980a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:30.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:30.167+0000 7f66b6000640 1 --2- 172.21.15.37:0/2369875452 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f66980a2c00 0x7f66980a50c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f66b0075d10 tx=0x7f669c005f90 comp rx=0 tx=0).stop 2024-09-11T23:18:30.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:30.167+0000 7f66b6000640 1 -- 172.21.15.37:0/2369875452 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66b0101a40 msgr2=0x7f66b0075f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:30.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:30.167+0000 7f66b6000640 1 --2- 172.21.15.37:0/2369875452 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66b0101a40 0x7f66b0075f90 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f66a402a860 tx=0x7f66a4033d90 comp rx=0 tx=0).stop 2024-09-11T23:18:30.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:30.167+0000 7f66b6000640 1 -- 172.21.15.37:0/2369875452 shutdown_connections 2024-09-11T23:18:30.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:30.167+0000 7f66b6000640 1 --2- 172.21.15.37:0/2369875452 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f66980a2c00 0x7f66980a50c0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:30.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:30.167+0000 7f66b6000640 1 --2- 172.21.15.37:0/2369875452 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f66b0103600 0x7f66b0074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:30.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:30.167+0000 7f66b6000640 1 --2- 172.21.15.37:0/2369875452 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f66b0102c40 0x7f66b00745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:30.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:30.167+0000 7f66b6000640 1 --2- 172.21.15.37:0/2369875452 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66b0101a40 0x7f66b0075f90 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:30.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:30.167+0000 7f66b6000640 1 -- 172.21.15.37:0/2369875452 >> 172.21.15.37:0/2369875452 conn(0x7f66b00fd1f0 msgr2=0x7f66b0106050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:30.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:30.167+0000 7f66b6000640 1 -- 172.21.15.37:0/2369875452 shutdown_connections 2024-09-11T23:18:30.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:30.167+0000 7f66b6000640 1 -- 172.21.15.37:0/2369875452 wait complete. 2024-09-11T23:18:30.957 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-11T23:18:31.335 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:18:31.626 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:18:31 smithi037 ceph-mon[30630]: pgmap v374: 129 pgs: 129 active+clean; 647 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 767 B/s wr, 11 op/s 2024-09-11T23:18:31.627 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:18:31 smithi037 ceph-mon[30630]: from='client.25070 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:18:31.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:18:31 smithi160 ceph-mon[35055]: pgmap v374: 129 pgs: 129 active+clean; 647 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 767 B/s wr, 11 op/s 2024-09-11T23:18:31.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:18:31 smithi160 ceph-mon[35055]: from='client.25070 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:18:31.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:18:31 smithi123 ceph-mon[35438]: pgmap v374: 129 pgs: 129 active+clean; 647 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 767 B/s wr, 11 op/s 2024-09-11T23:18:31.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:18:31 smithi123 ceph-mon[35438]: from='client.25070 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:18:31.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:31.882+0000 7f58ba800640 1 -- 172.21.15.37:0/2731286280 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58b4076ba0 msgr2=0x7f58b4076fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:31.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:31.882+0000 7f58ba800640 1 --2- 172.21.15.37:0/2731286280 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58b4076ba0 0x7f58b4076fa0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f58a4009900 tx=0x7f58a402a410 comp rx=0 tx=0).stop 2024-09-11T23:18:31.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:31.882+0000 7f58ba800640 1 -- 172.21.15.37:0/2731286280 shutdown_connections 2024-09-11T23:18:31.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:31.882+0000 7f58ba800640 1 --2- 172.21.15.37:0/2731286280 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f58b4077df0 0x7f58b4078250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:31.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:31.882+0000 7f58ba800640 1 --2- 172.21.15.37:0/2731286280 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f58b4078790 0x7f58b4079030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:31.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:31.882+0000 7f58ba800640 1 --2- 172.21.15.37:0/2731286280 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58b4076ba0 0x7f58b4076fa0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:31.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:31.882+0000 7f58ba800640 1 -- 172.21.15.37:0/2731286280 >> 172.21.15.37:0/2731286280 conn(0x7f58b40ff5b0 msgr2=0x7f58b41019d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:31.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:31.883+0000 7f58ba800640 1 -- 172.21.15.37:0/2731286280 shutdown_connections 2024-09-11T23:18:31.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:31.883+0000 7f58ba800640 1 -- 172.21.15.37:0/2731286280 wait complete. 2024-09-11T23:18:31.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:31.884+0000 7f58ba800640 1 Processor -- start 2024-09-11T23:18:31.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:31.884+0000 7f58ba800640 1 -- start start 2024-09-11T23:18:31.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:31.885+0000 7f58ba800640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f58b4076ba0 0x7f58b419e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:31.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:31.885+0000 7f58ba800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f58b4077df0 0x7f58b419e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:31.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:31.885+0000 7f58ba800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58b4078790 0x7f58b41a5a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:31.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:31.885+0000 7f58ba800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f58b4113ea0 con 0x7f58b4078790 2024-09-11T23:18:31.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:31.885+0000 7f58ba800640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f58b4113d20 con 0x7f58b4077df0 2024-09-11T23:18:31.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:31.885+0000 7f58ba800640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f58b4114020 con 0x7f58b4076ba0 2024-09-11T23:18:31.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:31.885+0000 7f58b3e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58b4078790 0x7f58b41a5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:31.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:31.885+0000 7f58abe00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f58b4077df0 0x7f58b419e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:31.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:31.885+0000 7f58b3400640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f58b4076ba0 0x7f58b419e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:31.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:31.885+0000 7f58b3e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58b4078790 0x7f58b41a5a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49470/0 (socket says 172.21.15.37:49470) 2024-09-11T23:18:31.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:31.885+0000 7f58b3e00640 1 -- 172.21.15.37:0/532554126 learned_addr learned my addr 172.21.15.37:0/532554126 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:18:31.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:31.885+0000 7f58b3e00640 1 -- 172.21.15.37:0/532554126 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f58b4076ba0 msgr2=0x7f58b419e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:31.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:31.885+0000 7f58b3e00640 1 --2- 172.21.15.37:0/532554126 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f58b4076ba0 0x7f58b419e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:31.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:31.885+0000 7f58b3e00640 1 -- 172.21.15.37:0/532554126 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f58b4077df0 msgr2=0x7f58b419e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:31.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:31.885+0000 7f58b3e00640 1 --2- 172.21.15.37:0/532554126 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f58b4077df0 0x7f58b419e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:31.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:31.885+0000 7f58b3e00640 1 -- 172.21.15.37:0/532554126 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58b41a60e0 con 0x7f58b4078790 2024-09-11T23:18:31.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:31.886+0000 7f58b3e00640 1 --2- 172.21.15.37:0/532554126 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58b4078790 0x7f58b41a5a70 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f58ac00eb10 tx=0x7f58ac00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:31.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:31.886+0000 7f58b0c00640 1 -- 172.21.15.37:0/532554126 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58ac004b20 con 0x7f58b4078790 2024-09-11T23:18:31.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:31.886+0000 7f58b0c00640 1 -- 172.21.15.37:0/532554126 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f58ac004cc0 con 0x7f58b4078790 2024-09-11T23:18:31.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:31.886+0000 7f58b0c00640 1 -- 172.21.15.37:0/532554126 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58ac010760 con 0x7f58b4078790 2024-09-11T23:18:31.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:31.886+0000 7f58ba800640 1 -- 172.21.15.37:0/532554126 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58b41a63d0 con 0x7f58b4078790 2024-09-11T23:18:31.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:31.886+0000 7f58ba800640 1 -- 172.21.15.37:0/532554126 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58b41a6910 con 0x7f58b4078790 2024-09-11T23:18:31.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:31.887+0000 7f58ba800640 1 -- 172.21.15.37:0/532554126 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58b4110780 con 0x7f58b4078790 2024-09-11T23:18:31.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:31.889+0000 7f58b0c00640 1 -- 172.21.15.37:0/532554126 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f58ac005020 con 0x7f58b4078790 2024-09-11T23:18:31.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:31.890+0000 7f58b0c00640 1 --2- 172.21.15.37:0/532554126 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f58980a2c30 0x7f58980a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:31.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:31.891+0000 7f58b0c00640 1 -- 172.21.15.37:0/532554126 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9295+0+0 (secure 0 0 0) 0x7f58ac0cf9a0 con 0x7f58b4078790 2024-09-11T23:18:31.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:31.891+0000 7f58b3400640 1 --2- 172.21.15.37:0/532554126 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f58980a2c30 0x7f58980a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:31.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:31.891+0000 7f58b3400640 1 --2- 172.21.15.37:0/532554126 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f58980a2c30 0x7f58980a50f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f58a40314e0 tx=0x7f58a4000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:31.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:31.895+0000 7f58b0c00640 1 -- 172.21.15.37:0/532554126 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f58ac09c480 con 0x7f58b4078790 2024-09-11T23:18:32.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:32.087+0000 7f58ba800640 1 -- 172.21.15.37:0/532554126 --> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f58b4062630 con 0x7f58980a2c30 2024-09-11T23:18:32.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:32.088+0000 7f58b0c00640 1 -- 172.21.15.37:0/532554126 <== mgr.14150 v2:172.21.15.37:6800/31543269 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7f58b4062630 con 0x7f58980a2c30 2024-09-11T23:18:32.088 INFO:teuthology.orchestra.run.smithi037.stdout:HOST ADDR LABELS STATUS 2024-09-11T23:18:32.088 INFO:teuthology.orchestra.run.smithi037.stdout:smithi037 172.21.15.37 2024-09-11T23:18:32.088 INFO:teuthology.orchestra.run.smithi037.stdout:smithi123 172.21.15.123 2024-09-11T23:18:32.088 INFO:teuthology.orchestra.run.smithi037.stdout:smithi160 172.21.15.160 2024-09-11T23:18:32.088 INFO:teuthology.orchestra.run.smithi037.stdout:3 hosts in cluster 2024-09-11T23:18:32.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:32.091+0000 7f58ba800640 1 -- 172.21.15.37:0/532554126 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f58980a2c30 msgr2=0x7f58980a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:32.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:32.091+0000 7f58ba800640 1 --2- 172.21.15.37:0/532554126 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f58980a2c30 0x7f58980a50f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f58a40314e0 tx=0x7f58a4000bc0 comp rx=0 tx=0).stop 2024-09-11T23:18:32.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:32.091+0000 7f58ba800640 1 -- 172.21.15.37:0/532554126 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58b4078790 msgr2=0x7f58b41a5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:32.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:32.091+0000 7f58ba800640 1 --2- 172.21.15.37:0/532554126 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58b4078790 0x7f58b41a5a70 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f58ac00eb10 tx=0x7f58ac00c2d0 comp rx=0 tx=0).stop 2024-09-11T23:18:32.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:32.091+0000 7f58ba800640 1 -- 172.21.15.37:0/532554126 shutdown_connections 2024-09-11T23:18:32.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:32.091+0000 7f58ba800640 1 --2- 172.21.15.37:0/532554126 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f58980a2c30 0x7f58980a50f0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:32.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:32.091+0000 7f58ba800640 1 --2- 172.21.15.37:0/532554126 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f58b4077df0 0x7f58b419e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:32.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:32.091+0000 7f58ba800640 1 --2- 172.21.15.37:0/532554126 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58b4078790 0x7f58b41a5a70 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:32.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:32.091+0000 7f58ba800640 1 --2- 172.21.15.37:0/532554126 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f58b4076ba0 0x7f58b419e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:32.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:32.091+0000 7f58ba800640 1 -- 172.21.15.37:0/532554126 >> 172.21.15.37:0/532554126 conn(0x7f58b40ff5b0 msgr2=0x7f58b4101040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:32.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:32.091+0000 7f58ba800640 1 -- 172.21.15.37:0/532554126 shutdown_connections 2024-09-11T23:18:32.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:32.091+0000 7f58ba800640 1 -- 172.21.15.37:0/532554126 wait complete. 2024-09-11T23:18:32.802 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-11T23:18:33.183 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:18:33.632 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:18:33 smithi037 ceph-mon[30630]: pgmap v375: 129 pgs: 129 active+clean; 647 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 767 B/s wr, 11 op/s 2024-09-11T23:18:33.632 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:18:33 smithi037 ceph-mon[30630]: from='client.15066 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:18:33.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:18:33 smithi160 ceph-mon[35055]: pgmap v375: 129 pgs: 129 active+clean; 647 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 767 B/s wr, 11 op/s 2024-09-11T23:18:33.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:18:33 smithi160 ceph-mon[35055]: from='client.15066 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:18:33.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:33.747+0000 7ff03d800640 1 -- 172.21.15.37:0/2244886828 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff038076ba0 msgr2=0x7ff038076fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:33.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:33.747+0000 7ff03d800640 1 --2- 172.21.15.37:0/2244886828 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff038076ba0 0x7ff038076fa0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ff028009900 tx=0x7ff02802a410 comp rx=0 tx=0).stop 2024-09-11T23:18:33.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:33.747+0000 7ff03d800640 1 -- 172.21.15.37:0/2244886828 shutdown_connections 2024-09-11T23:18:33.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:33.747+0000 7ff03d800640 1 --2- 172.21.15.37:0/2244886828 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff038077df0 0x7ff038078250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:33.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:33.747+0000 7ff03d800640 1 --2- 172.21.15.37:0/2244886828 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff038078790 0x7ff038079030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:33.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:33.747+0000 7ff03d800640 1 --2- 172.21.15.37:0/2244886828 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff038076ba0 0x7ff038076fa0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:33.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:33.747+0000 7ff03d800640 1 -- 172.21.15.37:0/2244886828 >> 172.21.15.37:0/2244886828 conn(0x7ff0380ff5b0 msgr2=0x7ff0381019d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:33.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:33.747+0000 7ff03d800640 1 -- 172.21.15.37:0/2244886828 shutdown_connections 2024-09-11T23:18:33.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:33.748+0000 7ff03d800640 1 -- 172.21.15.37:0/2244886828 wait complete. 2024-09-11T23:18:33.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:33.749+0000 7ff03d800640 1 Processor -- start 2024-09-11T23:18:33.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:33.749+0000 7ff03d800640 1 -- start start 2024-09-11T23:18:33.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:33.750+0000 7ff03d800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff038076ba0 0x7ff03819e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:33.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:33.750+0000 7ff03d800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff038077df0 0x7ff03819ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:33.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:33.750+0000 7ff03d800640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff038078790 0x7ff0381a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:33.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:33.750+0000 7ff03d800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff038113ea0 con 0x7ff038077df0 2024-09-11T23:18:33.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:33.750+0000 7ff03d800640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7ff038113d20 con 0x7ff038076ba0 2024-09-11T23:18:33.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:33.750+0000 7ff03d800640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7ff038114020 con 0x7ff038078790 2024-09-11T23:18:33.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:33.750+0000 7ff02e000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff038077df0 0x7ff03819ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:33.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:33.750+0000 7ff036a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff038076ba0 0x7ff03819e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:33.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:33.750+0000 7ff02e000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff038077df0 0x7ff03819ea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49490/0 (socket says 172.21.15.37:49490) 2024-09-11T23:18:33.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:33.750+0000 7ff02e000640 1 -- 172.21.15.37:0/1349148675 learned_addr learned my addr 172.21.15.37:0/1349148675 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:18:33.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:33.750+0000 7ff036a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff038076ba0 0x7ff03819e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.37:59896/0 (socket says 172.21.15.37:59896) 2024-09-11T23:18:33.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:33.750+0000 7ff037400640 1 --2- 172.21.15.37:0/1349148675 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff038078790 0x7ff0381a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:33.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:18:33 smithi123 ceph-mon[35438]: pgmap v375: 129 pgs: 129 active+clean; 647 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 767 B/s wr, 11 op/s 2024-09-11T23:18:33.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:18:33 smithi123 ceph-mon[35438]: from='client.15066 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:18:33.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:33.750+0000 7ff036a00640 1 -- 172.21.15.37:0/1349148675 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff038078790 msgr2=0x7ff0381a5ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:33.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:33.751+0000 7ff036a00640 1 --2- 172.21.15.37:0/1349148675 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff038078790 0x7ff0381a5ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:33.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:33.751+0000 7ff036a00640 1 -- 172.21.15.37:0/1349148675 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff038077df0 msgr2=0x7ff03819ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:33.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:33.751+0000 7ff036a00640 1 --2- 172.21.15.37:0/1349148675 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff038077df0 0x7ff03819ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:33.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:33.751+0000 7ff036a00640 1 -- 172.21.15.37:0/1349148675 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0381a6140 con 0x7ff038076ba0 2024-09-11T23:18:33.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:33.751+0000 7ff02e000640 1 --2- 172.21.15.37:0/1349148675 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff038077df0 0x7ff03819ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:18:33.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:33.751+0000 7ff036a00640 1 --2- 172.21.15.37:0/1349148675 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff038076ba0 0x7ff03819e510 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff028031440 tx=0x7ff028031b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:33.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:33.751+0000 7ff02fe00640 1 -- 172.21.15.37:0/1349148675 <== mon.2 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff02803f070 con 0x7ff038076ba0 2024-09-11T23:18:33.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:33.751+0000 7ff03d800640 1 -- 172.21.15.37:0/1349148675 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0381a63d0 con 0x7ff038076ba0 2024-09-11T23:18:33.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:33.751+0000 7ff02fe00640 1 -- 172.21.15.37:0/1349148675 <== mon.2 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff028003cd0 con 0x7ff038076ba0 2024-09-11T23:18:33.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:33.751+0000 7ff02fe00640 1 -- 172.21.15.37:0/1349148675 <== mon.2 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff028035070 con 0x7ff038076ba0 2024-09-11T23:18:33.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:33.751+0000 7ff03d800640 1 -- 172.21.15.37:0/1349148675 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0381a6900 con 0x7ff038076ba0 2024-09-11T23:18:33.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:33.752+0000 7ff03d800640 1 -- 172.21.15.37:0/1349148675 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff038110780 con 0x7ff038076ba0 2024-09-11T23:18:33.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:33.754+0000 7ff02fe00640 1 -- 172.21.15.37:0/1349148675 <== mon.2 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7ff02803b560 con 0x7ff038076ba0 2024-09-11T23:18:33.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:33.756+0000 7ff02fe00640 1 --2- 172.21.15.37:0/1349148675 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7ff01c0a2c30 0x7ff01c0a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:33.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:33.756+0000 7ff02fe00640 1 -- 172.21.15.37:0/1349148675 <== mon.2 v2:172.21.15.123:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9295+0+0 (secure 0 0 0) 0x7ff02803be00 con 0x7ff038076ba0 2024-09-11T23:18:33.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:33.756+0000 7ff02e000640 1 --2- 172.21.15.37:0/1349148675 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7ff01c0a2c30 0x7ff01c0a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:33.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:33.756+0000 7ff02e000640 1 --2- 172.21.15.37:0/1349148675 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7ff01c0a2c30 0x7ff01c0a50f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ff03819fa30 tx=0x7ff020005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:33.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:33.758+0000 7ff02fe00640 1 -- 172.21.15.37:0/1349148675 <== mon.2 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff0280bc000 con 0x7ff038076ba0 2024-09-11T23:18:33.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:33.950+0000 7ff03d800640 1 -- 172.21.15.37:0/1349148675 --> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7ff038062630 con 0x7ff01c0a2c30 2024-09-11T23:18:33.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:33.951+0000 7ff02fe00640 1 -- 172.21.15.37:0/1349148675 <== mgr.14150 v2:172.21.15.37:6800/31543269 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7ff038062630 con 0x7ff01c0a2c30 2024-09-11T23:18:33.951 INFO:teuthology.orchestra.run.smithi037.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-11T23:18:33.952 INFO:teuthology.orchestra.run.smithi037.stdout:smithi037 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT5331005T400BGN 372G No 4m ago Has a FileSystem, LVM detected 2024-09-11T23:18:33.952 INFO:teuthology.orchestra.run.smithi037.stdout:smithi123 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400YK400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-09-11T23:18:33.952 INFO:teuthology.orchestra.run.smithi037.stdout:smithi160 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT623300JY400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-09-11T23:18:33.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:33.955+0000 7ff03d800640 1 -- 172.21.15.37:0/1349148675 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7ff01c0a2c30 msgr2=0x7ff01c0a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:33.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:33.955+0000 7ff03d800640 1 --2- 172.21.15.37:0/1349148675 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7ff01c0a2c30 0x7ff01c0a50f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ff03819fa30 tx=0x7ff020005f90 comp rx=0 tx=0).stop 2024-09-11T23:18:33.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:33.955+0000 7ff03d800640 1 -- 172.21.15.37:0/1349148675 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff038076ba0 msgr2=0x7ff03819e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:33.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:33.955+0000 7ff03d800640 1 --2- 172.21.15.37:0/1349148675 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff038076ba0 0x7ff03819e510 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff028031440 tx=0x7ff028031b60 comp rx=0 tx=0).stop 2024-09-11T23:18:33.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:33.955+0000 7ff03d800640 1 -- 172.21.15.37:0/1349148675 shutdown_connections 2024-09-11T23:18:33.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:33.955+0000 7ff03d800640 1 --2- 172.21.15.37:0/1349148675 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7ff01c0a2c30 0x7ff01c0a50f0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:33.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:33.955+0000 7ff03d800640 1 --2- 172.21.15.37:0/1349148675 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff038078790 0x7ff0381a5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:33.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:33.955+0000 7ff03d800640 1 --2- 172.21.15.37:0/1349148675 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff038077df0 0x7ff03819ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:33.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:33.955+0000 7ff03d800640 1 --2- 172.21.15.37:0/1349148675 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff038076ba0 0x7ff03819e510 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:33.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:33.955+0000 7ff03d800640 1 -- 172.21.15.37:0/1349148675 >> 172.21.15.37:0/1349148675 conn(0x7ff0380ff5b0 msgr2=0x7ff038101040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:33.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:33.956+0000 7ff03d800640 1 -- 172.21.15.37:0/1349148675 shutdown_connections 2024-09-11T23:18:33.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:33.956+0000 7ff03d800640 1 -- 172.21.15.37:0/1349148675 wait complete. 2024-09-11T23:18:34.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:18:34 smithi037 ceph-mon[30630]: from='client.25082 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:18:34.657 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-11T23:18:34.666 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi037.front.sepia.ceph.com 2024-09-11T23:18:34.666 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-11T23:18:34.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:18:34 smithi160 ceph-mon[35055]: from='client.25082 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:18:34.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:18:34 smithi123 ceph-mon[35438]: from='client.25082 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:18:35.043 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:18:35.507 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:18:35 smithi037 ceph-mon[30630]: pgmap v376: 129 pgs: 129 active+clean; 647 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 767 B/s wr, 10 op/s 2024-09-11T23:18:35.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:35.622+0000 7f6446400640 1 -- 172.21.15.37:0/1310577573 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6440104f60 msgr2=0x7f64401053e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:35.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:35.622+0000 7f6446400640 1 --2- 172.21.15.37:0/1310577573 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6440104f60 0x7f64401053e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f6428009900 tx=0x7f642802a3f0 comp rx=0 tx=0).stop 2024-09-11T23:18:35.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:35.623+0000 7f6446400640 1 -- 172.21.15.37:0/1310577573 shutdown_connections 2024-09-11T23:18:35.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:35.623+0000 7f6446400640 1 --2- 172.21.15.37:0/1310577573 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6440105920 0x7f644010c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:35.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:35.623+0000 7f6446400640 1 --2- 172.21.15.37:0/1310577573 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6440104f60 0x7f64401053e0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:35.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:35.623+0000 7f6446400640 1 --2- 172.21.15.37:0/1310577573 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6440103e00 0x7f6440104200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:35.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:35.623+0000 7f6446400640 1 -- 172.21.15.37:0/1310577573 >> 172.21.15.37:0/1310577573 conn(0x7f64400ff5b0 msgr2=0x7f64401019d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:35.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:35.623+0000 7f6446400640 1 -- 172.21.15.37:0/1310577573 shutdown_connections 2024-09-11T23:18:35.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:35.623+0000 7f6446400640 1 -- 172.21.15.37:0/1310577573 wait complete. 2024-09-11T23:18:35.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:35.624+0000 7f6446400640 1 Processor -- start 2024-09-11T23:18:35.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:35.624+0000 7f6446400640 1 -- start start 2024-09-11T23:18:35.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:35.624+0000 7f6446400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6440103e00 0x7f644019a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:35.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:35.624+0000 7f6446400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6440104f60 0x7f644019a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:35.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:35.624+0000 7f6446400640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6440105920 0x7f64401a16f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:35.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:35.624+0000 7f6446400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f644010fb00 con 0x7f6440104f60 2024-09-11T23:18:35.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:35.624+0000 7f6446400640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f644010f980 con 0x7f6440103e00 2024-09-11T23:18:35.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:35.624+0000 7f6446400640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f644010fc80 con 0x7f6440105920 2024-09-11T23:18:35.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:35.624+0000 7f6437e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6440104f60 0x7f644019a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:35.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:35.624+0000 7f643f400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6440103e00 0x7f644019a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:35.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:35.624+0000 7f643f400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6440103e00 0x7f644019a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.37:59916/0 (socket says 172.21.15.37:59916) 2024-09-11T23:18:35.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:35.624+0000 7f643fe00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6440105920 0x7f64401a16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:35.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:35.624+0000 7f643f400640 1 -- 172.21.15.37:0/3762813246 learned_addr learned my addr 172.21.15.37:0/3762813246 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:18:35.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:35.625+0000 7f643f400640 1 -- 172.21.15.37:0/3762813246 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6440105920 msgr2=0x7f64401a16f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:35.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:35.625+0000 7f643f400640 1 --2- 172.21.15.37:0/3762813246 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6440105920 0x7f64401a16f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:35.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:35.625+0000 7f643f400640 1 -- 172.21.15.37:0/3762813246 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6440104f60 msgr2=0x7f644019a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:35.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:35.625+0000 7f643f400640 1 --2- 172.21.15.37:0/3762813246 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6440104f60 0x7f644019a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:35.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:35.625+0000 7f643f400640 1 -- 172.21.15.37:0/3762813246 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64401a1d60 con 0x7f6440103e00 2024-09-11T23:18:35.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:35.625+0000 7f6437e00640 1 --2- 172.21.15.37:0/3762813246 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6440104f60 0x7f644019a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:18:35.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:35.625+0000 7f643f400640 1 --2- 172.21.15.37:0/3762813246 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6440103e00 0x7f644019a130 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f643000d950 tx=0x7f643000de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:35.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:35.625+0000 7f643cc00640 1 -- 172.21.15.37:0/3762813246 <== mon.2 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6430017030 con 0x7f6440103e00 2024-09-11T23:18:35.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:35.626+0000 7f6446400640 1 -- 172.21.15.37:0/3762813246 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64401a1ff0 con 0x7f6440103e00 2024-09-11T23:18:35.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:35.626+0000 7f643cc00640 1 -- 172.21.15.37:0/3762813246 <== mon.2 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6430004020 con 0x7f6440103e00 2024-09-11T23:18:35.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:35.626+0000 7f643cc00640 1 -- 172.21.15.37:0/3762813246 <== mon.2 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64300047a0 con 0x7f6440103e00 2024-09-11T23:18:35.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:35.626+0000 7f6446400640 1 -- 172.21.15.37:0/3762813246 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64401a24f0 con 0x7f6440103e00 2024-09-11T23:18:35.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:35.627+0000 7f6446400640 1 -- 172.21.15.37:0/3762813246 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f644010b120 con 0x7f6440103e00 2024-09-11T23:18:35.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:35.629+0000 7f643cc00640 1 -- 172.21.15.37:0/3762813246 <== mon.2 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f64300041d0 con 0x7f6440103e00 2024-09-11T23:18:35.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:35.630+0000 7f643cc00640 1 --2- 172.21.15.37:0/3762813246 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f64240a2c30 0x7f64240a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:35.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:35.630+0000 7f643cc00640 1 -- 172.21.15.37:0/3762813246 <== mon.2 v2:172.21.15.123:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9295+0+0 (secure 0 0 0) 0x7f64300cedb0 con 0x7f6440103e00 2024-09-11T23:18:35.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:35.630+0000 7f6437e00640 1 --2- 172.21.15.37:0/3762813246 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f64240a2c30 0x7f64240a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:35.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:35.631+0000 7f6437e00640 1 --2- 172.21.15.37:0/3762813246 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f64240a2c30 0x7f64240a50f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f642802a9e0 tx=0x7f64280315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:35.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:35.634+0000 7f643cc00640 1 -- 172.21.15.37:0/3762813246 <== mon.2 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f64300d3070 con 0x7f6440103e00 2024-09-11T23:18:35.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:18:35 smithi160 ceph-mon[35055]: pgmap v376: 129 pgs: 129 active+clean; 647 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 767 B/s wr, 10 op/s 2024-09-11T23:18:35.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:18:35 smithi123 ceph-mon[35438]: pgmap v376: 129 pgs: 129 active+clean; 647 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 767 B/s wr, 10 op/s 2024-09-11T23:18:35.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:35.855+0000 7f6446400640 1 -- 172.21.15.37:0/3762813246 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f6440062e20 con 0x7f6440103e00 2024-09-11T23:18:35.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:35.857+0000 7f643cc00640 1 -- 172.21.15.37:0/3762813246 <== mon.2 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 28 v28) ==== 76+0+3138 (secure 0 0 0) 0x7f643009b890 con 0x7f6440103e00 2024-09-11T23:18:35.857 INFO:teuthology.orchestra.run.smithi037.stdout:e28 2024-09-11T23:18:35.857 INFO:teuthology.orchestra.run.smithi037.stdout:btime 2024-09-11T23:17:03:741210+0000 2024-09-11T23:18:35.857 INFO:teuthology.orchestra.run.smithi037.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-11T23:18:35.857 INFO:teuthology.orchestra.run.smithi037.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-11T23:18:35.857 INFO:teuthology.orchestra.run.smithi037.stdout:legacy client fscid: 1 2024-09-11T23:18:35.858 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:18:35.858 INFO:teuthology.orchestra.run.smithi037.stdout:Filesystem 'cephfs' (1) 2024-09-11T23:18:35.858 INFO:teuthology.orchestra.run.smithi037.stdout:fs_name cephfs 2024-09-11T23:18:35.858 INFO:teuthology.orchestra.run.smithi037.stdout:epoch 28 2024-09-11T23:18:35.858 INFO:teuthology.orchestra.run.smithi037.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-11T23:18:35.858 INFO:teuthology.orchestra.run.smithi037.stdout:created 2024-09-11T23:16:16.642956+0000 2024-09-11T23:18:35.858 INFO:teuthology.orchestra.run.smithi037.stdout:modified 2024-09-11T23:17:03.741190+0000 2024-09-11T23:18:35.858 INFO:teuthology.orchestra.run.smithi037.stdout:tableserver 0 2024-09-11T23:18:35.858 INFO:teuthology.orchestra.run.smithi037.stdout:root 0 2024-09-11T23:18:35.858 INFO:teuthology.orchestra.run.smithi037.stdout:session_timeout 300 2024-09-11T23:18:35.858 INFO:teuthology.orchestra.run.smithi037.stdout:session_autoclose 300 2024-09-11T23:18:35.858 INFO:teuthology.orchestra.run.smithi037.stdout:max_file_size 1099511627776 2024-09-11T23:18:35.858 INFO:teuthology.orchestra.run.smithi037.stdout:max_xattr_size 65536 2024-09-11T23:18:35.858 INFO:teuthology.orchestra.run.smithi037.stdout:required_client_features {} 2024-09-11T23:18:35.859 INFO:teuthology.orchestra.run.smithi037.stdout:last_failure 0 2024-09-11T23:18:35.859 INFO:teuthology.orchestra.run.smithi037.stdout:last_failure_osd_epoch 0 2024-09-11T23:18:35.859 INFO:teuthology.orchestra.run.smithi037.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-11T23:18:35.859 INFO:teuthology.orchestra.run.smithi037.stdout:max_mds 5 2024-09-11T23:18:35.859 INFO:teuthology.orchestra.run.smithi037.stdout:in 0,1,2,3,4 2024-09-11T23:18:35.859 INFO:teuthology.orchestra.run.smithi037.stdout:up {0=24533,1=24520,2=24499,3=24497,4=24493} 2024-09-11T23:18:35.859 INFO:teuthology.orchestra.run.smithi037.stdout:failed 2024-09-11T23:18:35.859 INFO:teuthology.orchestra.run.smithi037.stdout:damaged 2024-09-11T23:18:35.859 INFO:teuthology.orchestra.run.smithi037.stdout:stopped 2024-09-11T23:18:35.859 INFO:teuthology.orchestra.run.smithi037.stdout:data_pools [3,4] 2024-09-11T23:18:35.859 INFO:teuthology.orchestra.run.smithi037.stdout:metadata_pool 2 2024-09-11T23:18:35.859 INFO:teuthology.orchestra.run.smithi037.stdout:inline_data disabled 2024-09-11T23:18:35.859 INFO:teuthology.orchestra.run.smithi037.stdout:balancer 2024-09-11T23:18:35.860 INFO:teuthology.orchestra.run.smithi037.stdout:bal_rank_mask -1 2024-09-11T23:18:35.860 INFO:teuthology.orchestra.run.smithi037.stdout:standby_count_wanted 0 2024-09-11T23:18:35.860 INFO:teuthology.orchestra.run.smithi037.stdout:qdb_cluster leader: 24533 members: 24533,24520,24499,24497,24493 2024-09-11T23:18:35.860 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.b{0:24533} state up:active seq 5 addr [v2:172.21.15.123:6838/3077076065,v1:172.21.15.123:6839/3077076065] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T23:18:35.860 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.e{0:24476} state up:standby-replay seq 1 addr [v2:172.21.15.123:6834/3928690501,v1:172.21.15.123:6835/3928690501] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T23:18:35.860 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.i{1:24520} state up:active seq 18 addr [v2:172.21.15.160:6838/2041625862,v1:172.21.15.160:6839/2041625862] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T23:18:35.860 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.l{1:24448} state up:standby-replay seq 1 addr [v2:172.21.15.160:6832/1918127245,v1:172.21.15.160:6833/1918127245] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T23:18:35.860 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.c{2:24499} state up:active seq 20 addr [v2:172.21.15.160:6836/2906597021,v1:172.21.15.160:6837/2906597021] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T23:18:35.860 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.k{2:24440} state up:standby-replay seq 1 addr [v2:172.21.15.123:6832/3380294842,v1:172.21.15.123:6833/3380294842] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T23:18:35.860 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.h{3:24497} state up:active seq 19 addr [v2:172.21.15.123:6836/2168535476,v1:172.21.15.123:6837/2168535476] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T23:18:35.860 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.a{3:14511} state up:standby-replay seq 1 addr [v2:172.21.15.37:6840/209927476,v1:172.21.15.37:6841/209927476] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T23:18:35.860 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.f{4:24493} state up:active seq 21 addr [v2:172.21.15.160:6834/2316897035,v1:172.21.15.160:6835/2316897035] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T23:18:35.860 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.g{4:14499} state up:standby-replay seq 1 addr [v2:172.21.15.37:6838/1072030582,v1:172.21.15.37:6839/1072030582] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T23:18:35.860 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:18:35.861 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:18:35.861 INFO:teuthology.orchestra.run.smithi037.stdout:Standby daemons: 2024-09-11T23:18:35.861 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:18:35.861 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.j{-1:14448} state up:standby seq 1 addr [v2:172.21.15.37:6834/285120996,v1:172.21.15.37:6835/285120996] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T23:18:35.861 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.d{-1:14460} state up:standby seq 1 addr [v2:172.21.15.37:6836/3095283029,v1:172.21.15.37:6837/3095283029] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T23:18:35.861 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 28 2024-09-11T23:18:35.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:35.859+0000 7f6446400640 1 -- 172.21.15.37:0/3762813246 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f64240a2c30 msgr2=0x7f64240a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:35.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:35.859+0000 7f6446400640 1 --2- 172.21.15.37:0/3762813246 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f64240a2c30 0x7f64240a50f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f642802a9e0 tx=0x7f64280315b0 comp rx=0 tx=0).stop 2024-09-11T23:18:35.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:35.859+0000 7f6446400640 1 -- 172.21.15.37:0/3762813246 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6440103e00 msgr2=0x7f644019a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:35.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:35.859+0000 7f6446400640 1 --2- 172.21.15.37:0/3762813246 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6440103e00 0x7f644019a130 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f643000d950 tx=0x7f643000de10 comp rx=0 tx=0).stop 2024-09-11T23:18:35.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:35.859+0000 7f6446400640 1 -- 172.21.15.37:0/3762813246 shutdown_connections 2024-09-11T23:18:35.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:35.859+0000 7f6446400640 1 --2- 172.21.15.37:0/3762813246 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f64240a2c30 0x7f64240a50f0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:35.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:35.859+0000 7f6446400640 1 --2- 172.21.15.37:0/3762813246 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6440105920 0x7f64401a16f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:35.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:35.859+0000 7f6446400640 1 --2- 172.21.15.37:0/3762813246 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6440104f60 0x7f644019a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:35.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:35.859+0000 7f6446400640 1 --2- 172.21.15.37:0/3762813246 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6440103e00 0x7f644019a130 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:35.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:35.859+0000 7f6446400640 1 -- 172.21.15.37:0/3762813246 >> 172.21.15.37:0/3762813246 conn(0x7f64400ff5b0 msgr2=0x7f64401082f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:35.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:35.859+0000 7f6446400640 1 -- 172.21.15.37:0/3762813246 shutdown_connections 2024-09-11T23:18:35.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:35.859+0000 7f6446400640 1 -- 172.21.15.37:0/3762813246 wait complete. 2024-09-11T23:18:36.563 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:18:36 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/3762813246' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-11T23:18:36.601 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- bash -c 'ceph osd dump' 2024-09-11T23:18:36.652 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:18:36 smithi123 ceph-mon[35438]: from='client.? 172.21.15.37:0/3762813246' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-11T23:18:36.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:18:36 smithi160 ceph-mon[35055]: from='client.? 172.21.15.37:0/3762813246' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-11T23:18:36.977 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:18:37.425 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:18:37 smithi037 ceph-mon[30630]: pgmap v377: 129 pgs: 129 active+clean; 647 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 682 B/s wr, 12 op/s 2024-09-11T23:18:37.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:37.538+0000 7f9ef4c00640 1 -- 172.21.15.37:0/33704227 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ef0102e00 msgr2=0x7f9ef0103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:37.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:37.538+0000 7f9ef4c00640 1 --2- 172.21.15.37:0/33704227 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ef0102e00 0x7f9ef0103280 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f9edc009900 tx=0x7f9edc02a3f0 comp rx=0 tx=0).stop 2024-09-11T23:18:37.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:37.539+0000 7f9ef4c00640 1 -- 172.21.15.37:0/33704227 shutdown_connections 2024-09-11T23:18:37.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:37.539+0000 7f9ef4c00640 1 --2- 172.21.15.37:0/33704227 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9ef01037c0 0x7f9ef010a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:37.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:37.539+0000 7f9ef4c00640 1 --2- 172.21.15.37:0/33704227 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ef0102e00 0x7f9ef0103280 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:37.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:37.539+0000 7f9ef4c00640 1 --2- 172.21.15.37:0/33704227 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ef0101c00 0x7f9ef0102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:37.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:37.539+0000 7f9ef4c00640 1 -- 172.21.15.37:0/33704227 >> 172.21.15.37:0/33704227 conn(0x7f9ef00fd390 msgr2=0x7f9ef00ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:37.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:37.539+0000 7f9ef4c00640 1 -- 172.21.15.37:0/33704227 shutdown_connections 2024-09-11T23:18:37.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:37.539+0000 7f9ef4c00640 1 -- 172.21.15.37:0/33704227 wait complete. 2024-09-11T23:18:37.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:37.540+0000 7f9ef4c00640 1 Processor -- start 2024-09-11T23:18:37.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:37.540+0000 7f9ef4c00640 1 -- start start 2024-09-11T23:18:37.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:37.540+0000 7f9ef4c00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ef0101c00 0x7f9ef0197ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:37.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:37.540+0000 7f9ef4c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ef0102e00 0x7f9ef0198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:37.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:37.540+0000 7f9ef4c00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9ef01037c0 0x7f9ef019f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:37.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:37.540+0000 7f9ef4c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9ef010d8d0 con 0x7f9ef0102e00 2024-09-11T23:18:37.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:37.540+0000 7f9ef4c00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f9ef010d750 con 0x7f9ef0101c00 2024-09-11T23:18:37.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:37.540+0000 7f9ef4c00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f9ef010da50 con 0x7f9ef01037c0 2024-09-11T23:18:37.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:37.540+0000 7f9eed400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ef0102e00 0x7f9ef0198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:37.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:37.540+0000 7f9eed400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ef0102e00 0x7f9ef0198400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49526/0 (socket says 172.21.15.37:49526) 2024-09-11T23:18:37.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:37.540+0000 7f9eed400640 1 -- 172.21.15.37:0/3320147627 learned_addr learned my addr 172.21.15.37:0/3320147627 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:18:37.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:37.541+0000 7f9eee800640 1 --2- 172.21.15.37:0/3320147627 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9ef01037c0 0x7f9ef019f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:37.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:37.541+0000 7f9eede00640 1 --2- 172.21.15.37:0/3320147627 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ef0101c00 0x7f9ef0197ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:37.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:37.541+0000 7f9eed400640 1 -- 172.21.15.37:0/3320147627 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9ef01037c0 msgr2=0x7f9ef019f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:37.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:37.541+0000 7f9eed400640 1 --2- 172.21.15.37:0/3320147627 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9ef01037c0 0x7f9ef019f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:37.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:37.541+0000 7f9eed400640 1 -- 172.21.15.37:0/3320147627 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ef0101c00 msgr2=0x7f9ef0197ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:37.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:37.541+0000 7f9eed400640 1 --2- 172.21.15.37:0/3320147627 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ef0101c00 0x7f9ef0197ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:37.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:37.541+0000 7f9eed400640 1 -- 172.21.15.37:0/3320147627 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ef019faf0 con 0x7f9ef0102e00 2024-09-11T23:18:37.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:37.541+0000 7f9eed400640 1 --2- 172.21.15.37:0/3320147627 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ef0102e00 0x7f9ef0198400 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f9edc031440 tx=0x7f9edc032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:37.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:37.541+0000 7f9ee6a00640 1 -- 172.21.15.37:0/3320147627 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9edc03f030 con 0x7f9ef0102e00 2024-09-11T23:18:37.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:37.541+0000 7f9ee6a00640 1 -- 172.21.15.37:0/3320147627 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9edc003ce0 con 0x7f9ef0102e00 2024-09-11T23:18:37.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:37.541+0000 7f9ef4c00640 1 -- 172.21.15.37:0/3320147627 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ef019fd80 con 0x7f9ef0102e00 2024-09-11T23:18:37.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:37.542+0000 7f9ee6a00640 1 -- 172.21.15.37:0/3320147627 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9edc035070 con 0x7f9ef0102e00 2024-09-11T23:18:37.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:37.542+0000 7f9ef4c00640 1 -- 172.21.15.37:0/3320147627 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ef01a0250 con 0x7f9ef0102e00 2024-09-11T23:18:37.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:37.543+0000 7f9ef4c00640 1 -- 172.21.15.37:0/3320147627 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ef0108fb0 con 0x7f9ef0102e00 2024-09-11T23:18:37.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:37.545+0000 7f9ee6a00640 1 -- 172.21.15.37:0/3320147627 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f9edc042030 con 0x7f9ef0102e00 2024-09-11T23:18:37.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:37.547+0000 7f9ee6a00640 1 --2- 172.21.15.37:0/3320147627 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f9ed40a2c30 0x7f9ed40a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:37.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:37.547+0000 7f9ee6a00640 1 -- 172.21.15.37:0/3320147627 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9295+0+0 (secure 0 0 0) 0x7f9edc0efce0 con 0x7f9ef0102e00 2024-09-11T23:18:37.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:37.547+0000 7f9eede00640 1 --2- 172.21.15.37:0/3320147627 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f9ed40a2c30 0x7f9ed40a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:37.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:37.548+0000 7f9eede00640 1 --2- 172.21.15.37:0/3320147627 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f9ed40a2c30 0x7f9ed40a50f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f9ef0102c60 tx=0x7f9ee0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:37.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:37.549+0000 7f9ee6a00640 1 -- 172.21.15.37:0/3320147627 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9edc0bc170 con 0x7f9ef0102e00 2024-09-11T23:18:37.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:18:37 smithi160 ceph-mon[35055]: pgmap v377: 129 pgs: 129 active+clean; 647 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 682 B/s wr, 12 op/s 2024-09-11T23:18:37.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:37.734+0000 7f9ef4c00640 1 -- 172.21.15.37:0/3320147627 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7f9ef002da30 con 0x7f9ef0102e00 2024-09-11T23:18:37.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:37.735+0000 7f9ee6a00640 1 -- 172.21.15.37:0/3320147627 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v95) ==== 56+0+5774 (secure 0 0 0) 0x7f9edc0c0470 con 0x7f9ef0102e00 2024-09-11T23:18:37.736 INFO:teuthology.orchestra.run.smithi037.stdout:epoch 95 2024-09-11T23:18:37.736 INFO:teuthology.orchestra.run.smithi037.stdout:fsid 8b03efce-7092-11ef-bcea-c7b262605968 2024-09-11T23:18:37.736 INFO:teuthology.orchestra.run.smithi037.stdout:created 2024-09-11T23:07:59.386838+0000 2024-09-11T23:18:37.736 INFO:teuthology.orchestra.run.smithi037.stdout:modified 2024-09-11T23:17:53.878617+0000 2024-09-11T23:18:37.736 INFO:teuthology.orchestra.run.smithi037.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-11T23:18:37.736 INFO:teuthology.orchestra.run.smithi037.stdout:crush_version 27 2024-09-11T23:18:37.736 INFO:teuthology.orchestra.run.smithi037.stdout:full_ratio 0.95 2024-09-11T23:18:37.736 INFO:teuthology.orchestra.run.smithi037.stdout:backfillfull_ratio 0.9 2024-09-11T23:18:37.736 INFO:teuthology.orchestra.run.smithi037.stdout:nearfull_ratio 0.85 2024-09-11T23:18:37.736 INFO:teuthology.orchestra.run.smithi037.stdout:require_min_compat_client luminous 2024-09-11T23:18:37.736 INFO:teuthology.orchestra.run.smithi037.stdout:min_compat_client luminous 2024-09-11T23:18:37.737 INFO:teuthology.orchestra.run.smithi037.stdout:require_osd_release squid 2024-09-11T23:18:37.737 INFO:teuthology.orchestra.run.smithi037.stdout:stretch_mode_enabled false 2024-09-11T23:18:37.737 INFO:teuthology.orchestra.run.smithi037.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 22 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-09-11T23:18:37.737 INFO:teuthology.orchestra.run.smithi037.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 84 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-09-11T23:18:37.737 INFO:teuthology.orchestra.run.smithi037.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 84 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.05 application cephfs read_balance_score 1.50 2024-09-11T23:18:37.737 INFO:teuthology.orchestra.run.smithi037.stdout:pool 4 'cephfs_data_ec' erasure profile cephfs_data_ec size 4 min_size 3 crush_rule 1 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 91 flags hashpspool,ec_overwrites stripe_width 8192 pg_num_min 64 target_size_ratio 0.9 application cephfs 2024-09-11T23:18:37.737 INFO:teuthology.orchestra.run.smithi037.stdout:max_osd 12 2024-09-11T23:18:37.737 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0 up in weight 1 up_from 8 up_thru 94 down_at 0 last_clean_interval [0,0) [v2:172.21.15.37:6802/1678472768,v1:172.21.15.37:6803/1678472768] [v2:172.21.15.37:6804/1678472768,v1:172.21.15.37:6805/1678472768] exists,up f76ccb11-fe3b-4df1-9a71-e6ca50de80e4 2024-09-11T23:18:37.737 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1 up in weight 1 up_from 13 up_thru 92 down_at 0 last_clean_interval [0,0) [v2:172.21.15.123:6800/141504725,v1:172.21.15.123:6801/141504725] [v2:172.21.15.123:6802/141504725,v1:172.21.15.123:6803/141504725] exists,up 13d26eed-1160-4b15-b66b-66c89066c66f 2024-09-11T23:18:37.737 INFO:teuthology.orchestra.run.smithi037.stdout:osd.2 up in weight 1 up_from 18 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.160:6800/1866489133,v1:172.21.15.160:6801/1866489133] [v2:172.21.15.160:6802/1866489133,v1:172.21.15.160:6803/1866489133] exists,up 53daf4d5-2a43-4a89-bae9-f32b89b517f2 2024-09-11T23:18:37.738 INFO:teuthology.orchestra.run.smithi037.stdout:osd.3 up in weight 1 up_from 25 up_thru 94 down_at 0 last_clean_interval [0,0) [v2:172.21.15.37:6810/412656036,v1:172.21.15.37:6811/412656036] [v2:172.21.15.37:6812/412656036,v1:172.21.15.37:6813/412656036] exists,up 7c819225-964b-44f2-93e5-1d7585eb0b36 2024-09-11T23:18:37.738 INFO:teuthology.orchestra.run.smithi037.stdout:osd.4 up in weight 1 up_from 32 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.123:6808/3228822066,v1:172.21.15.123:6809/3228822066] [v2:172.21.15.123:6810/3228822066,v1:172.21.15.123:6811/3228822066] exists,up e5ab5638-8c7e-4433-8dd0-ba57e28f39b6 2024-09-11T23:18:37.738 INFO:teuthology.orchestra.run.smithi037.stdout:osd.5 up in weight 1 up_from 37 up_thru 92 down_at 0 last_clean_interval [0,0) [v2:172.21.15.160:6808/1618319675,v1:172.21.15.160:6809/1618319675] [v2:172.21.15.160:6810/1618319675,v1:172.21.15.160:6811/1618319675] exists,up 7f080d49-eec8-4cd9-b410-b2e84139292e 2024-09-11T23:18:37.738 INFO:teuthology.orchestra.run.smithi037.stdout:osd.6 up in weight 1 up_from 44 up_thru 94 down_at 0 last_clean_interval [0,0) [v2:172.21.15.37:6818/3541251299,v1:172.21.15.37:6819/3541251299] [v2:172.21.15.37:6820/3541251299,v1:172.21.15.37:6821/3541251299] exists,up d0881c4e-bd8d-4575-8c81-94d21825c227 2024-09-11T23:18:37.738 INFO:teuthology.orchestra.run.smithi037.stdout:osd.7 up in weight 1 up_from 49 up_thru 94 down_at 0 last_clean_interval [0,0) [v2:172.21.15.123:6816/4279933341,v1:172.21.15.123:6817/4279933341] [v2:172.21.15.123:6818/4279933341,v1:172.21.15.123:6819/4279933341] exists,up 04fbec2e-91b5-4a89-a4a3-472398c45288 2024-09-11T23:18:37.738 INFO:teuthology.orchestra.run.smithi037.stdout:osd.8 up in weight 1 up_from 56 up_thru 94 down_at 0 last_clean_interval [0,0) [v2:172.21.15.160:6816/740968584,v1:172.21.15.160:6817/740968584] [v2:172.21.15.160:6818/740968584,v1:172.21.15.160:6819/740968584] exists,up c77090a7-308e-4c6d-a56e-ce6f8e050ae5 2024-09-11T23:18:37.738 INFO:teuthology.orchestra.run.smithi037.stdout:osd.9 up in weight 1 up_from 64 up_thru 94 down_at 0 last_clean_interval [0,0) [v2:172.21.15.37:6826/692114850,v1:172.21.15.37:6827/692114850] [v2:172.21.15.37:6828/692114850,v1:172.21.15.37:6829/692114850] exists,up bcd19bd4-88bc-46f7-b48c-af9e3d17aa96 2024-09-11T23:18:37.738 INFO:teuthology.orchestra.run.smithi037.stdout:osd.10 up in weight 1 up_from 69 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.123:6824/471058996,v1:172.21.15.123:6825/471058996] [v2:172.21.15.123:6826/471058996,v1:172.21.15.123:6827/471058996] exists,up 9e956e6c-c28a-4a4c-b385-c458788858ed 2024-09-11T23:18:37.738 INFO:teuthology.orchestra.run.smithi037.stdout:osd.11 up in weight 1 up_from 76 up_thru 94 down_at 0 last_clean_interval [0,0) [v2:172.21.15.160:6824/3982315018,v1:172.21.15.160:6825/3982315018] [v2:172.21.15.160:6826/3982315018,v1:172.21.15.160:6827/3982315018] exists,up 0b5b3364-9a40-4cab-90d4-b7b1cba57bc8 2024-09-11T23:18:37.738 INFO:teuthology.orchestra.run.smithi037.stdout:pg_upmap_items 2.f [8,11] 2024-09-11T23:18:37.738 INFO:teuthology.orchestra.run.smithi037.stdout:pg_upmap_items 2.10 [2,1] 2024-09-11T23:18:37.738 INFO:teuthology.orchestra.run.smithi037.stdout:pg_upmap_items 2.16 [2,4] 2024-09-11T23:18:37.738 INFO:teuthology.orchestra.run.smithi037.stdout:pg_upmap_items 2.1f [7,11] 2024-09-11T23:18:37.739 INFO:teuthology.orchestra.run.smithi037.stdout:pg_upmap_items 3.0 [4,8] 2024-09-11T23:18:37.739 INFO:teuthology.orchestra.run.smithi037.stdout:pg_upmap_items 3.2 [3,9] 2024-09-11T23:18:37.739 INFO:teuthology.orchestra.run.smithi037.stdout:pg_upmap_items 3.6 [4,6] 2024-09-11T23:18:37.739 INFO:teuthology.orchestra.run.smithi037.stdout:pg_upmap_items 3.c [3,9] 2024-09-11T23:18:37.739 INFO:teuthology.orchestra.run.smithi037.stdout:pg_upmap_items 3.14 [4,7] 2024-09-11T23:18:37.739 INFO:teuthology.orchestra.run.smithi037.stdout:pg_upmap_items 3.17 [4,7] 2024-09-11T23:18:37.739 INFO:teuthology.orchestra.run.smithi037.stdout:pg_upmap_items 3.1a [5,6] 2024-09-11T23:18:37.739 INFO:teuthology.orchestra.run.smithi037.stdout:pg_upmap_items 3.30 [1,9] 2024-09-11T23:18:37.739 INFO:teuthology.orchestra.run.smithi037.stdout:pg_upmap_items 3.38 [5,8] 2024-09-11T23:18:37.739 INFO:teuthology.orchestra.run.smithi037.stdout:pg_upmap_items 4.5 [9,10] 2024-09-11T23:18:37.739 INFO:teuthology.orchestra.run.smithi037.stdout:pg_upmap_items 4.b [9,8] 2024-09-11T23:18:37.739 INFO:teuthology.orchestra.run.smithi037.stdout:pg_upmap_items 4.11 [5,8] 2024-09-11T23:18:37.739 INFO:teuthology.orchestra.run.smithi037.stdout:pg_upmap_items 4.16 [9,8] 2024-09-11T23:18:37.739 INFO:teuthology.orchestra.run.smithi037.stdout:blocklist 172.21.15.37:6801/2886800769 expires 2024-09-12T23:08:51.934167+0000 2024-09-11T23:18:37.740 INFO:teuthology.orchestra.run.smithi037.stdout:blocklist 172.21.15.37:0/1811301224 expires 2024-09-12T23:08:51.934167+0000 2024-09-11T23:18:37.740 INFO:teuthology.orchestra.run.smithi037.stdout:blocklist 172.21.15.37:0/513883980 expires 2024-09-12T23:08:51.934167+0000 2024-09-11T23:18:37.740 INFO:teuthology.orchestra.run.smithi037.stdout:blocklist 172.21.15.37:0/3698260188 expires 2024-09-12T23:08:23.793913+0000 2024-09-11T23:18:37.740 INFO:teuthology.orchestra.run.smithi037.stdout:blocklist 172.21.15.37:6800/2886800769 expires 2024-09-12T23:08:51.934167+0000 2024-09-11T23:18:37.740 INFO:teuthology.orchestra.run.smithi037.stdout:blocklist 172.21.15.37:0/4134736061 expires 2024-09-12T23:08:23.793913+0000 2024-09-11T23:18:37.740 INFO:teuthology.orchestra.run.smithi037.stdout:blocklist 172.21.15.37:0/3426758476 expires 2024-09-12T23:08:51.934167+0000 2024-09-11T23:18:37.740 INFO:teuthology.orchestra.run.smithi037.stdout:blocklist 172.21.15.37:0/2545840561 expires 2024-09-12T23:08:23.793913+0000 2024-09-11T23:18:37.740 INFO:teuthology.orchestra.run.smithi037.stdout:blocklist 172.21.15.37:6801/3447426643 expires 2024-09-12T23:08:23.793913+0000 2024-09-11T23:18:37.740 INFO:teuthology.orchestra.run.smithi037.stdout:blocklist 172.21.15.37:6800/3447426643 expires 2024-09-12T23:08:23.793913+0000 2024-09-11T23:18:37.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:37.738+0000 7f9ef4c00640 1 -- 172.21.15.37:0/3320147627 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f9ed40a2c30 msgr2=0x7f9ed40a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:37.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:37.738+0000 7f9ef4c00640 1 --2- 172.21.15.37:0/3320147627 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f9ed40a2c30 0x7f9ed40a50f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f9ef0102c60 tx=0x7f9ee0005f90 comp rx=0 tx=0).stop 2024-09-11T23:18:37.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:37.738+0000 7f9ef4c00640 1 -- 172.21.15.37:0/3320147627 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ef0102e00 msgr2=0x7f9ef0198400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:37.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:37.738+0000 7f9ef4c00640 1 --2- 172.21.15.37:0/3320147627 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ef0102e00 0x7f9ef0198400 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f9edc031440 tx=0x7f9edc032ce0 comp rx=0 tx=0).stop 2024-09-11T23:18:37.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:37.738+0000 7f9ef4c00640 1 -- 172.21.15.37:0/3320147627 shutdown_connections 2024-09-11T23:18:37.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:37.738+0000 7f9ef4c00640 1 --2- 172.21.15.37:0/3320147627 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f9ed40a2c30 0x7f9ed40a50f0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:37.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:37.738+0000 7f9ef4c00640 1 --2- 172.21.15.37:0/3320147627 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9ef01037c0 0x7f9ef019f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:37.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:37.738+0000 7f9ef4c00640 1 --2- 172.21.15.37:0/3320147627 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ef0102e00 0x7f9ef0198400 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:37.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:37.738+0000 7f9ef4c00640 1 --2- 172.21.15.37:0/3320147627 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ef0101c00 0x7f9ef0197ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:37.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:37.738+0000 7f9ef4c00640 1 -- 172.21.15.37:0/3320147627 >> 172.21.15.37:0/3320147627 conn(0x7f9ef00fd390 msgr2=0x7f9ef0106180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:37.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:37.738+0000 7f9ef4c00640 1 -- 172.21.15.37:0/3320147627 shutdown_connections 2024-09-11T23:18:37.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:37.738+0000 7f9ef4c00640 1 -- 172.21.15.37:0/3320147627 wait complete. 2024-09-11T23:18:37.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:18:37 smithi123 ceph-mon[35438]: pgmap v377: 129 pgs: 129 active+clean; 647 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 682 B/s wr, 12 op/s 2024-09-11T23:18:38.486 INFO:teuthology.run_tasks:Running task fs.ready... 2024-09-11T23:18:38.497 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T23:18:38.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:18:38 smithi160 ceph-mon[35055]: from='client.? 172.21.15.37:0/3320147627' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-11T23:18:38.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:18:38 smithi123 ceph-mon[35438]: from='client.? 172.21.15.37:0/3320147627' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-11T23:18:38.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:18:38 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/3320147627' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-11T23:18:38.873 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:18:39.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:39.414+0000 7f627fc00640 1 -- 172.21.15.37:0/1850767785 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6278077040 msgr2=0x7f62781124f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:39.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:39.414+0000 7f627fc00640 1 --2- 172.21.15.37:0/1850767785 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6278077040 0x7f62781124f0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f6264009900 tx=0x7f626402a3f0 comp rx=0 tx=0).stop 2024-09-11T23:18:39.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:39.414+0000 7f627fc00640 1 -- 172.21.15.37:0/1850767785 shutdown_connections 2024-09-11T23:18:39.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:39.414+0000 7f627fc00640 1 --2- 172.21.15.37:0/1850767785 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6278112a30 0x7f6278114e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:39.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:39.414+0000 7f627fc00640 1 --2- 172.21.15.37:0/1850767785 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6278077040 0x7f62781124f0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:39.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:39.414+0000 7f627fc00640 1 --2- 172.21.15.37:0/1850767785 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6278076720 0x7f6278076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:39.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:39.414+0000 7f627fc00640 1 -- 172.21.15.37:0/1850767785 >> 172.21.15.37:0/1850767785 conn(0x7f62780ffa90 msgr2=0x7f6278101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:39.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:39.415+0000 7f627fc00640 1 -- 172.21.15.37:0/1850767785 shutdown_connections 2024-09-11T23:18:39.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:39.415+0000 7f627fc00640 1 -- 172.21.15.37:0/1850767785 wait complete. 2024-09-11T23:18:39.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:39.416+0000 7f627fc00640 1 Processor -- start 2024-09-11T23:18:39.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:39.416+0000 7f627fc00640 1 -- start start 2024-09-11T23:18:39.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:39.416+0000 7f627fc00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6278076720 0x7f62781a46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:39.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:39.416+0000 7f627fc00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6278077040 0x7f62781a4c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:39.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:39.416+0000 7f627fc00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6278112a30 0x7f627819e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:39.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:39.416+0000 7f627fc00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f62781185f0 con 0x7f6278076720 2024-09-11T23:18:39.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:39.417+0000 7f627fc00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f6278118470 con 0x7f6278112a30 2024-09-11T23:18:39.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:39.417+0000 7f627fc00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f6278118770 con 0x7f6278077040 2024-09-11T23:18:39.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:39.417+0000 7f627d200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6278076720 0x7f62781a46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:39.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:39.417+0000 7f627d200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6278076720 0x7f62781a46e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58762/0 (socket says 172.21.15.37:58762) 2024-09-11T23:18:39.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:39.417+0000 7f627dc00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6278112a30 0x7f627819e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:39.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:39.417+0000 7f6277e00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6278077040 0x7f62781a4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:39.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:39.417+0000 7f627d200640 1 -- 172.21.15.37:0/1756957873 learned_addr learned my addr 172.21.15.37:0/1756957873 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:18:39.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:39.417+0000 7f627d200640 1 -- 172.21.15.37:0/1756957873 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6278077040 msgr2=0x7f62781a4c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:39.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:39.417+0000 7f627d200640 1 --2- 172.21.15.37:0/1756957873 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6278077040 0x7f62781a4c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:39.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:39.417+0000 7f627d200640 1 -- 172.21.15.37:0/1756957873 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6278112a30 msgr2=0x7f627819e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:39.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:39.417+0000 7f627d200640 1 --2- 172.21.15.37:0/1756957873 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6278112a30 0x7f627819e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:39.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:39.417+0000 7f627d200640 1 -- 172.21.15.37:0/1756957873 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f627819efd0 con 0x7f6278076720 2024-09-11T23:18:39.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:39.417+0000 7f627dc00640 1 --2- 172.21.15.37:0/1756957873 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6278112a30 0x7f627819e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:18:39.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:39.418+0000 7f627d200640 1 --2- 172.21.15.37:0/1756957873 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6278076720 0x7f62781a46e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f626c00e9f0 tx=0x7f626c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:39.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:39.418+0000 7f6275600640 1 -- 172.21.15.37:0/1756957873 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f626c00cd80 con 0x7f6278076720 2024-09-11T23:18:39.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:39.418+0000 7f627fc00640 1 -- 172.21.15.37:0/1756957873 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f627819f2c0 con 0x7f6278076720 2024-09-11T23:18:39.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:39.418+0000 7f6275600640 1 -- 172.21.15.37:0/1756957873 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f626c010910 con 0x7f6278076720 2024-09-11T23:18:39.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:39.418+0000 7f6275600640 1 -- 172.21.15.37:0/1756957873 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f626c0188f0 con 0x7f6278076720 2024-09-11T23:18:39.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:39.418+0000 7f627fc00640 1 -- 172.21.15.37:0/1756957873 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62781ab5b0 con 0x7f6278076720 2024-09-11T23:18:39.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:39.419+0000 7f627fc00640 1 -- 172.21.15.37:0/1756957873 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6278076b00 con 0x7f6278076720 2024-09-11T23:18:39.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:39.421+0000 7f6275600640 1 -- 172.21.15.37:0/1756957873 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f626c010ac0 con 0x7f6278076720 2024-09-11T23:18:39.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:39.422+0000 7f6275600640 1 --2- 172.21.15.37:0/1756957873 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f62600a2c00 0x7f62600a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:39.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:39.422+0000 7f6275600640 1 -- 172.21.15.37:0/1756957873 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9295+0+0 (secure 0 0 0) 0x7f626c0cf800 con 0x7f6278076720 2024-09-11T23:18:39.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:39.423+0000 7f6277e00640 1 --2- 172.21.15.37:0/1756957873 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f62600a2c00 0x7f62600a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:39.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:39.423+0000 7f6277e00640 1 --2- 172.21.15.37:0/1756957873 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f62600a2c00 0x7f62600a50c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f6264000c00 tx=0x7f6264005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:39.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:39.426+0000 7f6275600640 1 -- 172.21.15.37:0/1756957873 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f626c09bc90 con 0x7f6278076720 2024-09-11T23:18:39.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:18:39 smithi037 ceph-mon[30630]: pgmap v378: 129 pgs: 129 active+clean; 647 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-11T23:18:39.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:39.661+0000 7f627fc00640 1 -- 172.21.15.37:0/1756957873 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f627819fdd0 con 0x7f6278076720 2024-09-11T23:18:39.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:39.662+0000 7f6275600640 1 -- 172.21.15.37:0/1756957873 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11986 (secure 0 0 0) 0x7f626c09ff90 con 0x7f6278076720 2024-09-11T23:18:39.662 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:18:39.663 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":28,"btime":"2024-09-11T23:17:03:741210+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14448,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/285120996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":285120996},{"type":"v1","addr":"172.21.15.37:6835","nonce":285120996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14460,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/3095283029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":3095283029},{"type":"v1","addr":"172.21.15.37:6837","nonce":3095283029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T23:16:16.642956+0000","modified":"2024-09-11T23:17:03.741190+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24533,"mds_1":24520,"mds_2":24499,"mds_3":24497,"mds_4":24493},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14499":{"gid":14499,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6839/1072030582","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":1072030582},{"type":"v1","addr":"172.21.15.37:6839","nonce":1072030582}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14511":{"gid":14511,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6841/209927476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":209927476},{"type":"v1","addr":"172.21.15.37:6841","nonce":209927476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24440":{"gid":24440,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.123:6833/3380294842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":3380294842},{"type":"v1","addr":"172.21.15.123:6833","nonce":3380294842}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6833/1918127245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":1918127245},{"type":"v1","addr":"172.21.15.160:6833","nonce":1918127245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.123:6835/3928690501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":3928690501},{"type":"v1","addr":"172.21.15.123:6835","nonce":3928690501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":21,"addr":"172.21.15.160:6835/2316897035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":2316897035},{"type":"v1","addr":"172.21.15.160:6835","nonce":2316897035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"h","rank":3,"incarnation":24,"state":"up:active","state_seq":19,"addr":"172.21.15.123:6837/2168535476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":2168535476},{"type":"v1","addr":"172.21.15.123:6837","nonce":2168535476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":20,"addr":"172.21.15.160:6837/2906597021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":2906597021},{"type":"v1","addr":"172.21.15.160:6837","nonce":2906597021}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24520":{"gid":24520,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":18,"addr":"172.21.15.160:6839/2041625862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":2041625862},{"type":"v1","addr":"172.21.15.160:6839","nonce":2041625862}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24533":{"gid":24533,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.123:6839/3077076065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6838","nonce":3077076065},{"type":"v1","addr":"172.21.15.123:6839","nonce":3077076065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24533,"qdb_cluster":[24533,24520,24499,24497,24493]},"id":1}]} 2024-09-11T23:18:39.663 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 28 2024-09-11T23:18:39.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:39.665+0000 7f627fc00640 1 -- 172.21.15.37:0/1756957873 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f62600a2c00 msgr2=0x7f62600a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:39.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:39.665+0000 7f627fc00640 1 --2- 172.21.15.37:0/1756957873 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f62600a2c00 0x7f62600a50c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f6264000c00 tx=0x7f6264005b50 comp rx=0 tx=0).stop 2024-09-11T23:18:39.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:39.665+0000 7f627fc00640 1 -- 172.21.15.37:0/1756957873 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6278076720 msgr2=0x7f62781a46e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:39.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:39.665+0000 7f627fc00640 1 --2- 172.21.15.37:0/1756957873 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6278076720 0x7f62781a46e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f626c00e9f0 tx=0x7f626c00eeb0 comp rx=0 tx=0).stop 2024-09-11T23:18:39.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:39.665+0000 7f627fc00640 1 -- 172.21.15.37:0/1756957873 shutdown_connections 2024-09-11T23:18:39.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:39.665+0000 7f627fc00640 1 --2- 172.21.15.37:0/1756957873 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f62600a2c00 0x7f62600a50c0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:39.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:39.665+0000 7f627fc00640 1 --2- 172.21.15.37:0/1756957873 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6278112a30 0x7f627819e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:39.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:39.665+0000 7f627fc00640 1 --2- 172.21.15.37:0/1756957873 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6278077040 0x7f62781a4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:39.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:39.665+0000 7f627fc00640 1 --2- 172.21.15.37:0/1756957873 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6278076720 0x7f62781a46e0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:39.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:39.665+0000 7f627fc00640 1 -- 172.21.15.37:0/1756957873 >> 172.21.15.37:0/1756957873 conn(0x7f62780ffa90 msgr2=0x7f6278101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:39.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:39.665+0000 7f627fc00640 1 -- 172.21.15.37:0/1756957873 shutdown_connections 2024-09-11T23:18:39.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:39.665+0000 7f627fc00640 1 -- 172.21.15.37:0/1756957873 wait complete. 2024-09-11T23:18:39.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:18:39 smithi160 ceph-mon[35055]: pgmap v378: 129 pgs: 129 active+clean; 647 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-11T23:18:39.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:18:39 smithi123 ceph-mon[35438]: pgmap v378: 129 pgs: 129 active+clean; 647 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-11T23:18:40.378 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T23:18:40.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:18:40 smithi160 ceph-mon[35055]: from='client.? 172.21.15.37:0/1756957873' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:18:40.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:18:40 smithi123 ceph-mon[35438]: from='client.? 172.21.15.37:0/1756957873' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:18:40.757 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:18:40.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:18:40 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/1756957873' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:18:41.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:41.315+0000 7f435b800640 1 -- 172.21.15.37:0/3905468044 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4354104010 msgr2=0x7f43541043f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:41.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:41.315+0000 7f435b800640 1 --2- 172.21.15.37:0/3905468044 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4354104010 0x7f43541043f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f4348009900 tx=0x7f434802a3f0 comp rx=0 tx=0).stop 2024-09-11T23:18:41.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:41.315+0000 7f435b800640 1 -- 172.21.15.37:0/3905468044 shutdown_connections 2024-09-11T23:18:41.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:41.315+0000 7f435b800640 1 --2- 172.21.15.37:0/3905468044 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4354109140 0x7f4354110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:41.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:41.315+0000 7f435b800640 1 --2- 172.21.15.37:0/3905468044 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43541049c0 0x7f4354108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:41.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:41.315+0000 7f435b800640 1 --2- 172.21.15.37:0/3905468044 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4354104010 0x7f43541043f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:41.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:41.315+0000 7f435b800640 1 -- 172.21.15.37:0/3905468044 >> 172.21.15.37:0/3905468044 conn(0x7f43540ffa50 msgr2=0x7f4354101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:41.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:41.315+0000 7f435b800640 1 -- 172.21.15.37:0/3905468044 shutdown_connections 2024-09-11T23:18:41.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:41.315+0000 7f435b800640 1 -- 172.21.15.37:0/3905468044 wait complete. 2024-09-11T23:18:41.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:41.316+0000 7f435b800640 1 Processor -- start 2024-09-11T23:18:41.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:41.316+0000 7f435b800640 1 -- start start 2024-09-11T23:18:41.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:41.316+0000 7f435b800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4354104010 0x7f435419a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:41.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:41.316+0000 7f435b800640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f43541049c0 0x7f435419ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:41.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:41.316+0000 7f435b800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4354109140 0x7f435419ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:41.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:41.316+0000 7f435b800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f43541141c0 con 0x7f4354109140 2024-09-11T23:18:41.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:41.316+0000 7f435b800640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f4354114040 con 0x7f4354104010 2024-09-11T23:18:41.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:41.316+0000 7f435b800640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f4354114340 con 0x7f43541049c0 2024-09-11T23:18:41.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:41.316+0000 7f4358e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4354104010 0x7f435419a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:41.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:41.316+0000 7f4358e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4354104010 0x7f435419a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.37:60782/0 (socket says 172.21.15.37:60782) 2024-09-11T23:18:41.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:41.316+0000 7f4358e00640 1 -- 172.21.15.37:0/3048973558 learned_addr learned my addr 172.21.15.37:0/3048973558 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:18:41.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:41.316+0000 7f4359800640 1 --2- 172.21.15.37:0/3048973558 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4354109140 0x7f435419ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:41.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:41.317+0000 7f4353e00640 1 --2- 172.21.15.37:0/3048973558 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f43541049c0 0x7f435419ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:41.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:41.317+0000 7f4358e00640 1 -- 172.21.15.37:0/3048973558 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f43541049c0 msgr2=0x7f435419ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:41.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:41.317+0000 7f4358e00640 1 --2- 172.21.15.37:0/3048973558 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f43541049c0 0x7f435419ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:41.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:41.317+0000 7f4358e00640 1 -- 172.21.15.37:0/3048973558 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4354109140 msgr2=0x7f435419ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:41.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:41.317+0000 7f4358e00640 1 --2- 172.21.15.37:0/3048973558 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4354109140 0x7f435419ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:41.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:41.317+0000 7f4358e00640 1 -- 172.21.15.37:0/3048973558 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f435419f5e0 con 0x7f4354104010 2024-09-11T23:18:41.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:41.317+0000 7f4359800640 1 --2- 172.21.15.37:0/3048973558 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4354109140 0x7f435419ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:18:41.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:41.317+0000 7f4358e00640 1 --2- 172.21.15.37:0/3048973558 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4354104010 0x7f435419a630 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4348004770 tx=0x7f4348003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:41.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:41.318+0000 7f4351600640 1 -- 172.21.15.37:0/3048973558 <== mon.2 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f434803f070 con 0x7f4354104010 2024-09-11T23:18:41.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:41.318+0000 7f4351600640 1 -- 172.21.15.37:0/3048973558 <== mon.2 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4348031ca0 con 0x7f4354104010 2024-09-11T23:18:41.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:41.318+0000 7f4351600640 1 -- 172.21.15.37:0/3048973558 <== mon.2 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4348035030 con 0x7f4354104010 2024-09-11T23:18:41.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:41.318+0000 7f435b800640 1 -- 172.21.15.37:0/3048973558 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f435419f870 con 0x7f4354104010 2024-09-11T23:18:41.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:41.318+0000 7f435b800640 1 -- 172.21.15.37:0/3048973558 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43541a71b0 con 0x7f4354104010 2024-09-11T23:18:41.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:41.319+0000 7f435b800640 1 -- 172.21.15.37:0/3048973558 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43541043f0 con 0x7f4354104010 2024-09-11T23:18:41.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:41.321+0000 7f4351600640 1 -- 172.21.15.37:0/3048973558 <== mon.2 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f4348042070 con 0x7f4354104010 2024-09-11T23:18:41.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:41.322+0000 7f4351600640 1 --2- 172.21.15.37:0/3048973558 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f433c0a2c00 0x7f433c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:41.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:41.322+0000 7f4351600640 1 -- 172.21.15.37:0/3048973558 <== mon.2 v2:172.21.15.123:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9295+0+0 (secure 0 0 0) 0x7f43480efff0 con 0x7f4354104010 2024-09-11T23:18:41.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:41.323+0000 7f4353e00640 1 --2- 172.21.15.37:0/3048973558 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f433c0a2c00 0x7f433c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:41.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:41.323+0000 7f4353e00640 1 --2- 172.21.15.37:0/3048973558 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f433c0a2c00 0x7f433c0a50c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f43540ffe70 tx=0x7f4340005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:41.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:41.324+0000 7f4351600640 1 -- 172.21.15.37:0/3048973558 <== mon.2 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f43480bc540 con 0x7f4354104010 2024-09-11T23:18:41.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:41.545+0000 7f435b800640 1 -- 172.21.15.37:0/3048973558 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f435419b990 con 0x7f4354104010 2024-09-11T23:18:41.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:18:41 smithi037 ceph-mon[30630]: pgmap v379: 129 pgs: 129 active+clean; 647 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2024-09-11T23:18:41.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:41.546+0000 7f4351600640 1 -- 172.21.15.37:0/3048973558 <== mon.2 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11986 (secure 0 0 0) 0x7f43480c0840 con 0x7f4354104010 2024-09-11T23:18:41.571 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:18:41.572 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 28 2024-09-11T23:18:41.572 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":28,"btime":"2024-09-11T23:17:03:741210+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14448,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/285120996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":285120996},{"type":"v1","addr":"172.21.15.37:6835","nonce":285120996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14460,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/3095283029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":3095283029},{"type":"v1","addr":"172.21.15.37:6837","nonce":3095283029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T23:16:16.642956+0000","modified":"2024-09-11T23:17:03.741190+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24533,"mds_1":24520,"mds_2":24499,"mds_3":24497,"mds_4":24493},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14499":{"gid":14499,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6839/1072030582","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":1072030582},{"type":"v1","addr":"172.21.15.37:6839","nonce":1072030582}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14511":{"gid":14511,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6841/209927476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":209927476},{"type":"v1","addr":"172.21.15.37:6841","nonce":209927476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24440":{"gid":24440,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.123:6833/3380294842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":3380294842},{"type":"v1","addr":"172.21.15.123:6833","nonce":3380294842}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6833/1918127245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":1918127245},{"type":"v1","addr":"172.21.15.160:6833","nonce":1918127245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.123:6835/3928690501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":3928690501},{"type":"v1","addr":"172.21.15.123:6835","nonce":3928690501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":21,"addr":"172.21.15.160:6835/2316897035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":2316897035},{"type":"v1","addr":"172.21.15.160:6835","nonce":2316897035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"h","rank":3,"incarnation":24,"state":"up:active","state_seq":19,"addr":"172.21.15.123:6837/2168535476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":2168535476},{"type":"v1","addr":"172.21.15.123:6837","nonce":2168535476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":20,"addr":"172.21.15.160:6837/2906597021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":2906597021},{"type":"v1","addr":"172.21.15.160:6837","nonce":2906597021}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24520":{"gid":24520,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":18,"addr":"172.21.15.160:6839/2041625862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":2041625862},{"type":"v1","addr":"172.21.15.160:6839","nonce":2041625862}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24533":{"gid":24533,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.123:6839/3077076065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6838","nonce":3077076065},{"type":"v1","addr":"172.21.15.123:6839","nonce":3077076065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24533,"qdb_cluster":[24533,24520,24499,24497,24493]},"id":1}]} 2024-09-11T23:18:41.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:41.549+0000 7f435b800640 1 -- 172.21.15.37:0/3048973558 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f433c0a2c00 msgr2=0x7f433c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:41.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:41.549+0000 7f435b800640 1 --2- 172.21.15.37:0/3048973558 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f433c0a2c00 0x7f433c0a50c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f43540ffe70 tx=0x7f4340005f90 comp rx=0 tx=0).stop 2024-09-11T23:18:41.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:41.549+0000 7f435b800640 1 -- 172.21.15.37:0/3048973558 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4354104010 msgr2=0x7f435419a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:41.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:41.549+0000 7f435b800640 1 --2- 172.21.15.37:0/3048973558 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4354104010 0x7f435419a630 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4348004770 tx=0x7f4348003c10 comp rx=0 tx=0).stop 2024-09-11T23:18:41.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:41.549+0000 7f435b800640 1 -- 172.21.15.37:0/3048973558 shutdown_connections 2024-09-11T23:18:41.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:41.549+0000 7f435b800640 1 --2- 172.21.15.37:0/3048973558 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f433c0a2c00 0x7f433c0a50c0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:41.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:41.549+0000 7f435b800640 1 --2- 172.21.15.37:0/3048973558 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4354109140 0x7f435419ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:41.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:41.549+0000 7f435b800640 1 --2- 172.21.15.37:0/3048973558 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f43541049c0 0x7f435419ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:41.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:41.549+0000 7f435b800640 1 --2- 172.21.15.37:0/3048973558 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4354104010 0x7f435419a630 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:41.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:41.549+0000 7f435b800640 1 -- 172.21.15.37:0/3048973558 >> 172.21.15.37:0/3048973558 conn(0x7f43540ffa50 msgr2=0x7f4354100d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:41.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:41.549+0000 7f435b800640 1 -- 172.21.15.37:0/3048973558 shutdown_connections 2024-09-11T23:18:41.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:41.549+0000 7f435b800640 1 -- 172.21.15.37:0/3048973558 wait complete. 2024-09-11T23:18:41.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:18:41 smithi160 ceph-mon[35055]: pgmap v379: 129 pgs: 129 active+clean; 647 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2024-09-11T23:18:41.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:18:41 smithi123 ceph-mon[35438]: pgmap v379: 129 pgs: 129 active+clean; 647 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2024-09-11T23:18:42.314 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T23:18:42.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:18:42 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/3048973558' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:18:42.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:18:42 smithi160 ceph-mon[35055]: from='client.? 172.21.15.37:0/3048973558' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:18:42.713 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:18:42.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:18:42 smithi123 ceph-mon[35438]: from='client.? 172.21.15.37:0/3048973558' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:18:43.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:43.302+0000 7ff63fe00640 1 -- 172.21.15.37:0/3655000199 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff640108f60 msgr2=0x7ff640110ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:43.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:43.302+0000 7ff63fe00640 1 --2- 172.21.15.37:0/3655000199 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff640108f60 0x7ff640110ae0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff638009ca0 tx=0x7ff63802a8c0 comp rx=0 tx=0).stop 2024-09-11T23:18:43.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:43.302+0000 7ff63fe00640 1 -- 172.21.15.37:0/3655000199 shutdown_connections 2024-09-11T23:18:43.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:43.302+0000 7ff63fe00640 1 --2- 172.21.15.37:0/3655000199 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff640108f60 0x7ff640110ae0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:43.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:43.302+0000 7ff63fe00640 1 --2- 172.21.15.37:0/3655000199 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff6401047e0 0x7ff640108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:43.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:43.302+0000 7ff63fe00640 1 --2- 172.21.15.37:0/3655000199 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff640103e30 0x7ff640104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:43.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:43.302+0000 7ff63fe00640 1 -- 172.21.15.37:0/3655000199 >> 172.21.15.37:0/3655000199 conn(0x7ff6400ff910 msgr2=0x7ff640101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:43.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:43.302+0000 7ff63fe00640 1 -- 172.21.15.37:0/3655000199 shutdown_connections 2024-09-11T23:18:43.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:43.302+0000 7ff63fe00640 1 -- 172.21.15.37:0/3655000199 wait complete. 2024-09-11T23:18:43.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:43.303+0000 7ff63fe00640 1 Processor -- start 2024-09-11T23:18:43.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:43.303+0000 7ff63fe00640 1 -- start start 2024-09-11T23:18:43.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:43.304+0000 7ff63fe00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff640103e30 0x7ff64019a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:43.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:43.304+0000 7ff63fe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6401047e0 0x7ff64019a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:43.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:43.304+0000 7ff63fe00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff640108f60 0x7ff64019ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:43.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:43.304+0000 7ff63fe00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff640114010 con 0x7ff6401047e0 2024-09-11T23:18:43.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:43.304+0000 7ff63fe00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7ff640113e90 con 0x7ff640108f60 2024-09-11T23:18:43.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:43.304+0000 7ff63fe00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7ff640114190 con 0x7ff640103e30 2024-09-11T23:18:43.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:43.304+0000 7ff63ea00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff640103e30 0x7ff64019a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:43.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:43.304+0000 7ff636000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6401047e0 0x7ff64019a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:43.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:43.304+0000 7ff63ea00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff640103e30 0x7ff64019a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.37:54342/0 (socket says 172.21.15.37:54342) 2024-09-11T23:18:43.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:43.304+0000 7ff63ea00640 1 -- 172.21.15.37:0/3648721411 learned_addr learned my addr 172.21.15.37:0/3648721411 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:18:43.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:43.304+0000 7ff63f400640 1 --2- 172.21.15.37:0/3648721411 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff640108f60 0x7ff64019ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:43.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:43.305+0000 7ff636000640 1 -- 172.21.15.37:0/3648721411 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff640103e30 msgr2=0x7ff64019a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:43.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:43.305+0000 7ff636000640 1 --2- 172.21.15.37:0/3648721411 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff640103e30 0x7ff64019a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:43.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:43.305+0000 7ff636000640 1 -- 172.21.15.37:0/3648721411 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff640108f60 msgr2=0x7ff64019ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:43.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:43.305+0000 7ff636000640 1 --2- 172.21.15.37:0/3648721411 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff640108f60 0x7ff64019ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:43.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:43.305+0000 7ff636000640 1 -- 172.21.15.37:0/3648721411 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff64019f3c0 con 0x7ff6401047e0 2024-09-11T23:18:43.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:43.305+0000 7ff636000640 1 --2- 172.21.15.37:0/3648721411 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6401047e0 0x7ff64019a950 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff628005fd0 tx=0x7ff62800dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:43.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:43.305+0000 7ff644a00640 1 -- 172.21.15.37:0/3648721411 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff628009c30 con 0x7ff6401047e0 2024-09-11T23:18:43.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:43.305+0000 7ff644a00640 1 -- 172.21.15.37:0/3648721411 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff628009dd0 con 0x7ff6401047e0 2024-09-11T23:18:43.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:43.305+0000 7ff63fe00640 1 -- 172.21.15.37:0/3648721411 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff64019f6b0 con 0x7ff6401047e0 2024-09-11T23:18:43.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:43.305+0000 7ff644a00640 1 -- 172.21.15.37:0/3648721411 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff628010460 con 0x7ff6401047e0 2024-09-11T23:18:43.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:43.305+0000 7ff63fe00640 1 -- 172.21.15.37:0/3648721411 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6401a6f90 con 0x7ff6401047e0 2024-09-11T23:18:43.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:43.307+0000 7ff63fe00640 1 -- 172.21.15.37:0/3648721411 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff640105310 con 0x7ff6401047e0 2024-09-11T23:18:43.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:43.308+0000 7ff644a00640 1 -- 172.21.15.37:0/3648721411 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7ff628003f50 con 0x7ff6401047e0 2024-09-11T23:18:43.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:43.310+0000 7ff644a00640 1 --2- 172.21.15.37:0/3648721411 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7ff6240a2c00 0x7ff6240a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:43.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:43.311+0000 7ff644a00640 1 -- 172.21.15.37:0/3648721411 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9295+0+0 (secure 0 0 0) 0x7ff6280cf2b0 con 0x7ff6401047e0 2024-09-11T23:18:43.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:43.311+0000 7ff63ea00640 1 --2- 172.21.15.37:0/3648721411 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7ff6240a2c00 0x7ff6240a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:43.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:43.311+0000 7ff63ea00640 1 --2- 172.21.15.37:0/3648721411 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7ff6240a2c00 0x7ff6240a50c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ff6300095f0 tx=0x7ff630005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:43.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:43.315+0000 7ff644a00640 1 -- 172.21.15.37:0/3648721411 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff628017020 con 0x7ff6401047e0 2024-09-11T23:18:43.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:43.502+0000 7ff63fe00640 1 -- 172.21.15.37:0/3648721411 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff64010c1a0 con 0x7ff6401047e0 2024-09-11T23:18:43.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:43.504+0000 7ff644a00640 1 -- 172.21.15.37:0/3648721411 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) ==== 74+0+25054 (secure 0 0 0) 0x7ff62809b740 con 0x7ff6401047e0 2024-09-11T23:18:43.505 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:18:43.505 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":95,"fsid":"8b03efce-7092-11ef-bcea-c7b262605968","created":"2024-09-11T23:07:59.386838+0000","modified":"2024-09-11T23:17:53.878617+0000","last_up_change":"2024-09-11T23:15:16.985748+0000","last_in_change":"2024-09-11T23:14:54.154116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:11:16.547642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:16:11.075859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T23:16:14.019910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-11T23:16:22.041463+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f76ccb11-fe3b-4df1-9a71-e6ca50de80e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1678472768},{"type":"v1","addr":"172.21.15.37:6803","nonce":1678472768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1678472768},{"type":"v1","addr":"172.21.15.37:6805","nonce":1678472768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1678472768},{"type":"v1","addr":"172.21.15.37:6809","nonce":1678472768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1678472768},{"type":"v1","addr":"172.21.15.37:6807","nonce":1678472768}]},"public_addr":"172.21.15.37:6803/1678472768","cluster_addr":"172.21.15.37:6805/1678472768","heartbeat_back_addr":"172.21.15.37:6809/1678472768","heartbeat_front_addr":"172.21.15.37:6807/1678472768","state":["exists","up"]},{"osd":1,"uuid":"13d26eed-1160-4b15-b66b-66c89066c66f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":141504725},{"type":"v1","addr":"172.21.15.123:6801","nonce":141504725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":141504725},{"type":"v1","addr":"172.21.15.123:6803","nonce":141504725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":141504725},{"type":"v1","addr":"172.21.15.123:6807","nonce":141504725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":141504725},{"type":"v1","addr":"172.21.15.123:6805","nonce":141504725}]},"public_addr":"172.21.15.123:6801/141504725","cluster_addr":"172.21.15.123:6803/141504725","heartbeat_back_addr":"172.21.15.123:6807/141504725","heartbeat_front_addr":"172.21.15.123:6805/141504725","state":["exists","up"]},{"osd":2,"uuid":"53daf4d5-2a43-4a89-bae9-f32b89b517f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":1866489133},{"type":"v1","addr":"172.21.15.160:6801","nonce":1866489133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":1866489133},{"type":"v1","addr":"172.21.15.160:6803","nonce":1866489133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":1866489133},{"type":"v1","addr":"172.21.15.160:6807","nonce":1866489133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":1866489133},{"type":"v1","addr":"172.21.15.160:6805","nonce":1866489133}]},"public_addr":"172.21.15.160:6801/1866489133","cluster_addr":"172.21.15.160:6803/1866489133","heartbeat_back_addr":"172.21.15.160:6807/1866489133","heartbeat_front_addr":"172.21.15.160:6805/1866489133","state":["exists","up"]},{"osd":3,"uuid":"7c819225-964b-44f2-93e5-1d7585eb0b36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":412656036},{"type":"v1","addr":"172.21.15.37:6811","nonce":412656036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":412656036},{"type":"v1","addr":"172.21.15.37:6813","nonce":412656036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":412656036},{"type":"v1","addr":"172.21.15.37:6817","nonce":412656036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":412656036},{"type":"v1","addr":"172.21.15.37:6815","nonce":412656036}]},"public_addr":"172.21.15.37:6811/412656036","cluster_addr":"172.21.15.37:6813/412656036","heartbeat_back_addr":"172.21.15.37:6817/412656036","heartbeat_front_addr":"172.21.15.37:6815/412656036","state":["exists","up"]},{"osd":4,"uuid":"e5ab5638-8c7e-4433-8dd0-ba57e28f39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":3228822066},{"type":"v1","addr":"172.21.15.123:6809","nonce":3228822066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":3228822066},{"type":"v1","addr":"172.21.15.123:6811","nonce":3228822066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":3228822066},{"type":"v1","addr":"172.21.15.123:6815","nonce":3228822066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":3228822066},{"type":"v1","addr":"172.21.15.123:6813","nonce":3228822066}]},"public_addr":"172.21.15.123:6809/3228822066","cluster_addr":"172.21.15.123:6811/3228822066","heartbeat_back_addr":"172.21.15.123:6815/3228822066","heartbeat_front_addr":"172.21.15.123:6813/3228822066","state":["exists","up"]},{"osd":5,"uuid":"7f080d49-eec8-4cd9-b410-b2e84139292e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":1618319675},{"type":"v1","addr":"172.21.15.160:6809","nonce":1618319675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":1618319675},{"type":"v1","addr":"172.21.15.160:6811","nonce":1618319675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":1618319675},{"type":"v1","addr":"172.21.15.160:6815","nonce":1618319675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":1618319675},{"type":"v1","addr":"172.21.15.160:6813","nonce":1618319675}]},"public_addr":"172.21.15.160:6809/1618319675","cluster_addr":"172.21.15.160:6811/1618319675","heartbeat_back_addr":"172.21.15.160:6815/1618319675","heartbeat_front_addr":"172.21.15.160:6813/1618319675","state":["exists","up"]},{"osd":6,"uuid":"d0881c4e-bd8d-4575-8c81-94d21825c227","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3541251299},{"type":"v1","addr":"172.21.15.37:6819","nonce":3541251299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3541251299},{"type":"v1","addr":"172.21.15.37:6821","nonce":3541251299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":3541251299},{"type":"v1","addr":"172.21.15.37:6825","nonce":3541251299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3541251299},{"type":"v1","addr":"172.21.15.37:6823","nonce":3541251299}]},"public_addr":"172.21.15.37:6819/3541251299","cluster_addr":"172.21.15.37:6821/3541251299","heartbeat_back_addr":"172.21.15.37:6825/3541251299","heartbeat_front_addr":"172.21.15.37:6823/3541251299","state":["exists","up"]},{"osd":7,"uuid":"04fbec2e-91b5-4a89-a4a3-472398c45288","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":4279933341},{"type":"v1","addr":"172.21.15.123:6817","nonce":4279933341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":4279933341},{"type":"v1","addr":"172.21.15.123:6819","nonce":4279933341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":4279933341},{"type":"v1","addr":"172.21.15.123:6823","nonce":4279933341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":4279933341},{"type":"v1","addr":"172.21.15.123:6821","nonce":4279933341}]},"public_addr":"172.21.15.123:6817/4279933341","cluster_addr":"172.21.15.123:6819/4279933341","heartbeat_back_addr":"172.21.15.123:6823/4279933341","heartbeat_front_addr":"172.21.15.123:6821/4279933341","state":["exists","up"]},{"osd":8,"uuid":"c77090a7-308e-4c6d-a56e-ce6f8e050ae5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":740968584},{"type":"v1","addr":"172.21.15.160:6817","nonce":740968584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":740968584},{"type":"v1","addr":"172.21.15.160:6819","nonce":740968584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":740968584},{"type":"v1","addr":"172.21.15.160:6823","nonce":740968584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":740968584},{"type":"v1","addr":"172.21.15.160:6821","nonce":740968584}]},"public_addr":"172.21.15.160:6817/740968584","cluster_addr":"172.21.15.160:6819/740968584","heartbeat_back_addr":"172.21.15.160:6823/740968584","heartbeat_front_addr":"172.21.15.160:6821/740968584","state":["exists","up"]},{"osd":9,"uuid":"bcd19bd4-88bc-46f7-b48c-af9e3d17aa96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":692114850},{"type":"v1","addr":"172.21.15.37:6827","nonce":692114850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":692114850},{"type":"v1","addr":"172.21.15.37:6829","nonce":692114850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":692114850},{"type":"v1","addr":"172.21.15.37:6833","nonce":692114850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":692114850},{"type":"v1","addr":"172.21.15.37:6831","nonce":692114850}]},"public_addr":"172.21.15.37:6827/692114850","cluster_addr":"172.21.15.37:6829/692114850","heartbeat_back_addr":"172.21.15.37:6833/692114850","heartbeat_front_addr":"172.21.15.37:6831/692114850","state":["exists","up"]},{"osd":10,"uuid":"9e956e6c-c28a-4a4c-b385-c458788858ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":471058996},{"type":"v1","addr":"172.21.15.123:6825","nonce":471058996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":471058996},{"type":"v1","addr":"172.21.15.123:6827","nonce":471058996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":471058996},{"type":"v1","addr":"172.21.15.123:6831","nonce":471058996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":471058996},{"type":"v1","addr":"172.21.15.123:6829","nonce":471058996}]},"public_addr":"172.21.15.123:6825/471058996","cluster_addr":"172.21.15.123:6827/471058996","heartbeat_back_addr":"172.21.15.123:6831/471058996","heartbeat_front_addr":"172.21.15.123:6829/471058996","state":["exists","up"]},{"osd":11,"uuid":"0b5b3364-9a40-4cab-90d4-b7b1cba57bc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":3982315018},{"type":"v1","addr":"172.21.15.160:6825","nonce":3982315018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3982315018},{"type":"v1","addr":"172.21.15.160:6827","nonce":3982315018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3982315018},{"type":"v1","addr":"172.21.15.160:6831","nonce":3982315018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3982315018},{"type":"v1","addr":"172.21.15.160:6829","nonce":3982315018}]},"public_addr":"172.21.15.160:6825/3982315018","cluster_addr":"172.21.15.160:6827/3982315018","heartbeat_back_addr":"172.21.15.160:6831/3982315018","heartbeat_front_addr":"172.21.15.160:6829/3982315018","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:10:21.139833+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:10:47.004960+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:11:11.460263+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:11:40.849286+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:12:06.497448+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:12:32.043206+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:13:01.402019+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:13:27.993489+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:13:52.291643+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:23.840299+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:49.448254+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:15:15.310947+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":1}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":7}]},{"pgid":"3.17","mappings":[{"from":4,"to":7}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.30","mappings":[{"from":1,"to":9}]},{"pgid":"3.38","mappings":[{"from":5,"to":8}]},{"pgid":"4.5","mappings":[{"from":9,"to":10}]},{"pgid":"4.b","mappings":[{"from":9,"to":8}]},{"pgid":"4.11","mappings":[{"from":5,"to":8}]},{"pgid":"4.16","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:6801/2886800769":"2024-09-12T23:08:51.934167+0000","172.21.15.37:0/1811301224":"2024-09-12T23:08:51.934167+0000","172.21.15.37:0/513883980":"2024-09-12T23:08:51.934167+0000","172.21.15.37:0/3698260188":"2024-09-12T23:08:23.793913+0000","172.21.15.37:6800/2886800769":"2024-09-12T23:08:51.934167+0000","172.21.15.37:0/4134736061":"2024-09-12T23:08:23.793913+0000","172.21.15.37:0/3426758476":"2024-09-12T23:08:51.934167+0000","172.21.15.37:0/2545840561":"2024-09-12T23:08:23.793913+0000","172.21.15.37:6801/3447426643":"2024-09-12T23:08:23.793913+0000","172.21.15.37:6800/3447426643":"2024-09-12T23:08:23.793913+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:18:43.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:43.507+0000 7ff63fe00640 1 -- 172.21.15.37:0/3648721411 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7ff6240a2c00 msgr2=0x7ff6240a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:43.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:43.507+0000 7ff63fe00640 1 --2- 172.21.15.37:0/3648721411 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7ff6240a2c00 0x7ff6240a50c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ff6300095f0 tx=0x7ff630005f90 comp rx=0 tx=0).stop 2024-09-11T23:18:43.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:43.507+0000 7ff63fe00640 1 -- 172.21.15.37:0/3648721411 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6401047e0 msgr2=0x7ff64019a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:43.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:43.507+0000 7ff63fe00640 1 --2- 172.21.15.37:0/3648721411 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6401047e0 0x7ff64019a950 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff628005fd0 tx=0x7ff62800dde0 comp rx=0 tx=0).stop 2024-09-11T23:18:43.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:43.507+0000 7ff63fe00640 1 -- 172.21.15.37:0/3648721411 shutdown_connections 2024-09-11T23:18:43.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:43.507+0000 7ff63fe00640 1 --2- 172.21.15.37:0/3648721411 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7ff6240a2c00 0x7ff6240a50c0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:43.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:43.507+0000 7ff63fe00640 1 --2- 172.21.15.37:0/3648721411 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff640108f60 0x7ff64019ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:43.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:43.507+0000 7ff63fe00640 1 --2- 172.21.15.37:0/3648721411 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6401047e0 0x7ff64019a950 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:43.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:43.507+0000 7ff63fe00640 1 --2- 172.21.15.37:0/3648721411 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff640103e30 0x7ff64019a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:43.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:43.507+0000 7ff63fe00640 1 -- 172.21.15.37:0/3648721411 >> 172.21.15.37:0/3648721411 conn(0x7ff6400ff910 msgr2=0x7ff640100be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:43.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:43.507+0000 7ff63fe00640 1 -- 172.21.15.37:0/3648721411 shutdown_connections 2024-09-11T23:18:43.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:43.507+0000 7ff63fe00640 1 -- 172.21.15.37:0/3648721411 wait complete. 2024-09-11T23:18:43.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:18:43 smithi160 ceph-mon[35055]: pgmap v380: 129 pgs: 129 active+clean; 647 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-11T23:18:43.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:18:43 smithi123 ceph-mon[35438]: pgmap v380: 129 pgs: 129 active+clean; 647 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-11T23:18:43.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:18:43 smithi037 ceph-mon[30630]: pgmap v380: 129 pgs: 129 active+clean; 647 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-11T23:18:44.256 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 28, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-11T23:16:16.642956+0000', 'modified': '2024-09-11T23:17:03.741190+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24533, 'mds_1': 24520, 'mds_2': 24499, 'mds_3': 24497, 'mds_4': 24493}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14499': {'gid': 14499, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.37:6839/1072030582', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.37:6838', 'nonce': 1072030582}, {'type': 'v1', 'addr': '172.21.15.37:6839', 'nonce': 1072030582}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14511': {'gid': 14511, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.37:6841/209927476', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.37:6840', 'nonce': 209927476}, {'type': 'v1', 'addr': '172.21.15.37:6841', 'nonce': 209927476}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24440': {'gid': 24440, 'name': 'k', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.123:6833/3380294842', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.123:6832', 'nonce': 3380294842}, {'type': 'v1', 'addr': '172.21.15.123:6833', 'nonce': 3380294842}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24448': {'gid': 24448, 'name': 'l', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.160:6833/1918127245', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.160:6832', 'nonce': 1918127245}, {'type': 'v1', 'addr': '172.21.15.160:6833', 'nonce': 1918127245}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24476': {'gid': 24476, 'name': 'e', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.123:6835/3928690501', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.123:6834', 'nonce': 3928690501}, {'type': 'v1', 'addr': '172.21.15.123:6835', 'nonce': 3928690501}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24493': {'gid': 24493, 'name': 'f', 'rank': 4, 'incarnation': 26, 'state': 'up:active', 'state_seq': 21, 'addr': '172.21.15.160:6835/2316897035', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.160:6834', 'nonce': 2316897035}, {'type': 'v1', 'addr': '172.21.15.160:6835', 'nonce': 2316897035}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24497': {'gid': 24497, 'name': 'h', 'rank': 3, 'incarnation': 24, 'state': 'up:active', 'state_seq': 19, 'addr': '172.21.15.123:6837/2168535476', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.123:6836', 'nonce': 2168535476}, {'type': 'v1', 'addr': '172.21.15.123:6837', 'nonce': 2168535476}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24499': {'gid': 24499, 'name': 'c', 'rank': 2, 'incarnation': 22, 'state': 'up:active', 'state_seq': 20, 'addr': '172.21.15.160:6837/2906597021', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.160:6836', 'nonce': 2906597021}, {'type': 'v1', 'addr': '172.21.15.160:6837', 'nonce': 2906597021}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24520': {'gid': 24520, 'name': 'i', 'rank': 1, 'incarnation': 20, 'state': 'up:active', 'state_seq': 18, 'addr': '172.21.15.160:6839/2041625862', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.160:6838', 'nonce': 2041625862}, {'type': 'v1', 'addr': '172.21.15.160:6839', 'nonce': 2041625862}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24533': {'gid': 24533, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.123:6839/3077076065', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.123:6838', 'nonce': 3077076065}, {'type': 'v1', 'addr': '172.21.15.123:6839', 'nonce': 3077076065}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24533, 'qdb_cluster': [24533, 24520, 24499, 24497, 24493]} 2024-09-11T23:18:44.256 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-09-11T23:18:44.257 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph tell mds.f status 2024-09-11T23:18:44.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:18:44 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/3648721411' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:18:44.639 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:18:44.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:18:44 smithi160 ceph-mon[35055]: from='client.? 172.21.15.37:0/3648721411' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:18:44.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:18:44 smithi123 ceph-mon[35438]: from='client.? 172.21.15.37:0/3648721411' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:18:45.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.186+0000 7f3f1da00640 1 -- 172.21.15.37:0/336955096 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f1810bfc0 msgr2=0x7f3f1810e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:45.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.186+0000 7f3f1da00640 1 --2- 172.21.15.37:0/336955096 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f1810bfc0 0x7f3f1810e460 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f3f10009ca0 tx=0x7f3f1002a950 comp rx=0 tx=0).stop 2024-09-11T23:18:45.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.186+0000 7f3f1da00640 1 -- 172.21.15.37:0/336955096 shutdown_connections 2024-09-11T23:18:45.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.186+0000 7f3f1da00640 1 --2- 172.21.15.37:0/336955096 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3f181034b0 0x7f3f1810b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:45.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.186+0000 7f3f1da00640 1 --2- 172.21.15.37:0/336955096 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f1810bfc0 0x7f3f1810e460 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:45.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.186+0000 7f3f1da00640 1 --2- 172.21.15.37:0/336955096 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3f18102b90 0x7f3f18102f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:45.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.186+0000 7f3f1da00640 1 -- 172.21.15.37:0/336955096 >> 172.21.15.37:0/336955096 conn(0x7f3f180fc610 msgr2=0x7f3f180fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:45.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.186+0000 7f3f1da00640 1 -- 172.21.15.37:0/336955096 shutdown_connections 2024-09-11T23:18:45.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.186+0000 7f3f1da00640 1 -- 172.21.15.37:0/336955096 wait complete. 2024-09-11T23:18:45.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.187+0000 7f3f1da00640 1 Processor -- start 2024-09-11T23:18:45.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.187+0000 7f3f1da00640 1 -- start start 2024-09-11T23:18:45.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.187+0000 7f3f1da00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3f18102b90 0x7f3f181007f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:45.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.187+0000 7f3f1da00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f181034b0 0x7f3f18100d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:45.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.187+0000 7f3f1da00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3f1810bfc0 0x7f3f18101270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:45.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.187+0000 7f3f1da00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3f18111dc0 con 0x7f3f181034b0 2024-09-11T23:18:45.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.187+0000 7f3f1da00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f3f18111c40 con 0x7f3f18102b90 2024-09-11T23:18:45.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.187+0000 7f3f1da00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f3f18111f40 con 0x7f3f1810bfc0 2024-09-11T23:18:45.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.188+0000 7f3f17400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f181034b0 0x7f3f18100d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:45.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.188+0000 7f3f17400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f181034b0 0x7f3f18100d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58804/0 (socket says 172.21.15.37:58804) 2024-09-11T23:18:45.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.188+0000 7f3f17400640 1 -- 172.21.15.37:0/215417832 learned_addr learned my addr 172.21.15.37:0/215417832 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:18:45.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.188+0000 7f3f17e00640 1 --2- 172.21.15.37:0/215417832 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3f18102b90 0x7f3f181007f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:45.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.188+0000 7f3f1d000640 1 --2- 172.21.15.37:0/215417832 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3f1810bfc0 0x7f3f18101270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:45.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.188+0000 7f3f17400640 1 -- 172.21.15.37:0/215417832 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3f1810bfc0 msgr2=0x7f3f18101270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:45.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.188+0000 7f3f17400640 1 --2- 172.21.15.37:0/215417832 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3f1810bfc0 0x7f3f18101270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:45.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.188+0000 7f3f17400640 1 -- 172.21.15.37:0/215417832 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3f18102b90 msgr2=0x7f3f181007f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:45.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.188+0000 7f3f17400640 1 --2- 172.21.15.37:0/215417832 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3f18102b90 0x7f3f181007f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:45.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.188+0000 7f3f17400640 1 -- 172.21.15.37:0/215417832 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f181a6710 con 0x7f3f181034b0 2024-09-11T23:18:45.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.188+0000 7f3f17e00640 1 --2- 172.21.15.37:0/215417832 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3f18102b90 0x7f3f181007f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:18:45.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.188+0000 7f3f17400640 1 --2- 172.21.15.37:0/215417832 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f181034b0 0x7f3f18100d30 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f3f0400e9f0 tx=0x7f3f0400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:45.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.189+0000 7f3f14c00640 1 -- 172.21.15.37:0/215417832 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f0400cd80 con 0x7f3f181034b0 2024-09-11T23:18:45.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.189+0000 7f3f14c00640 1 -- 172.21.15.37:0/215417832 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3f040035f0 con 0x7f3f181034b0 2024-09-11T23:18:45.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.189+0000 7f3f14c00640 1 -- 172.21.15.37:0/215417832 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f04010670 con 0x7f3f181034b0 2024-09-11T23:18:45.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.189+0000 7f3f1da00640 1 -- 172.21.15.37:0/215417832 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f181a6a00 con 0x7f3f181034b0 2024-09-11T23:18:45.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.189+0000 7f3f1da00640 1 -- 172.21.15.37:0/215417832 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f181a6f40 con 0x7f3f181034b0 2024-09-11T23:18:45.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.193+0000 7f3f219e3740 1 Processor -- start 2024-09-11T23:18:45.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.194+0000 7f3f219e3740 1 -- start start 2024-09-11T23:18:45.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.194+0000 7f3f219e3740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fb025054e0 0x55fb025058c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:45.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.194+0000 7f3f219e3740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fb02505e00 0x55fb02510180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:45.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.194+0000 7f3f219e3740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fb025106c0 0x55fb02512ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:45.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.194+0000 7f3f219e3740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55fb0246b0b0 con 0x55fb025106c0 2024-09-11T23:18:45.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.194+0000 7f3f219e3740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55fb02412ab0 con 0x55fb02505e00 2024-09-11T23:18:45.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.194+0000 7f3f219e3740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55fb02467070 con 0x55fb025054e0 2024-09-11T23:18:45.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.194+0000 7f3f14c00640 1 -- 172.21.15.37:0/215417832 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f3f040037a0 con 0x7f3f181034b0 2024-09-11T23:18:45.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.194+0000 7f3f17e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fb02505e00 0x55fb02510180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:45.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.194+0000 7f3f1d000640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fb025054e0 0x55fb025058c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:45.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.195+0000 7f3f1d000640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fb025054e0 0x55fb025058c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.37:54364/0 (socket says 172.21.15.37:54364) 2024-09-11T23:18:45.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.195+0000 7f3f17e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fb02505e00 0x55fb02510180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.37:60826/0 (socket says 172.21.15.37:60826) 2024-09-11T23:18:45.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.195+0000 7f3f17e00640 1 -- 172.21.15.37:0/1337762536 learned_addr learned my addr 172.21.15.37:0/1337762536 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:18:45.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.195+0000 7f3f17400640 1 --2- 172.21.15.37:0/1337762536 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fb025106c0 0x55fb02512ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:45.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.195+0000 7f3f17e00640 1 -- 172.21.15.37:0/1337762536 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fb025054e0 msgr2=0x55fb025058c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:45.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.195+0000 7f3f17e00640 1 --2- 172.21.15.37:0/1337762536 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fb025054e0 0x55fb025058c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:45.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.195+0000 7f3f17e00640 1 -- 172.21.15.37:0/1337762536 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fb025106c0 msgr2=0x55fb02512ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:45.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.195+0000 7f3f17e00640 1 --2- 172.21.15.37:0/1337762536 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fb025106c0 0x55fb02512ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:45.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.195+0000 7f3f17e00640 1 -- 172.21.15.37:0/1337762536 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb0241f4a0 con 0x55fb02505e00 2024-09-11T23:18:45.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.195+0000 7f3f1d000640 1 --2- 172.21.15.37:0/1337762536 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fb025054e0 0x55fb025058c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:18:45.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.195+0000 7f3f17e00640 1 --2- 172.21.15.37:0/1337762536 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fb02505e00 0x55fb02510180 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3f08009d40 tx=0x7f3f080117b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=66236911a5020492 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:45.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.196+0000 7f3f0d600640 1 -- 172.21.15.37:0/1337762536 <== mon.2 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f08012650 con 0x55fb02505e00 2024-09-11T23:18:45.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.196+0000 7f3f0d600640 1 -- 172.21.15.37:0/1337762536 <== mon.2 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3f08009e30 con 0x55fb02505e00 2024-09-11T23:18:45.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.196+0000 7f3f0d600640 1 -- 172.21.15.37:0/1337762536 <== mon.2 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f0800fca0 con 0x55fb02505e00 2024-09-11T23:18:45.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.196+0000 7f3f14c00640 1 --2- 172.21.15.37:0/215417832 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f3efc0a2b80 0x7f3efc0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:45.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.196+0000 7f3f14c00640 1 -- 172.21.15.37:0/215417832 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9295+0+0 (secure 0 0 0) 0x7f3f040cf7f0 con 0x7f3f181034b0 2024-09-11T23:18:45.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.196+0000 7f3f1d000640 1 --2- 172.21.15.37:0/215417832 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f3efc0a2b80 0x7f3efc0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:45.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.197+0000 7f3f219e3740 1 -- 172.21.15.37:0/1337762536 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fb02505e00 msgr2=0x55fb02510180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:45.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.197+0000 7f3f219e3740 1 --2- 172.21.15.37:0/1337762536 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fb02505e00 0x55fb02510180 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3f08009d40 tx=0x7f3f080117b0 comp rx=0 tx=0).stop 2024-09-11T23:18:45.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.197+0000 7f3f219e3740 1 -- 172.21.15.37:0/1337762536 shutdown_connections 2024-09-11T23:18:45.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.197+0000 7f3f219e3740 1 --2- 172.21.15.37:0/1337762536 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fb02505e00 0x55fb02510180 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:45.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.197+0000 7f3f219e3740 1 --2- 172.21.15.37:0/1337762536 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fb025106c0 0x55fb02512ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:45.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.197+0000 7f3f219e3740 1 --2- 172.21.15.37:0/1337762536 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fb025054e0 0x55fb025058c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:45.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.197+0000 7f3f219e3740 1 -- 172.21.15.37:0/1337762536 >> 172.21.15.37:0/1337762536 conn(0x55fb02501a70 msgr2=0x55fb02501e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:45.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.197+0000 7f3f219e3740 1 -- 172.21.15.37:0/1337762536 shutdown_connections 2024-09-11T23:18:45.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.197+0000 7f3f219e3740 1 -- 172.21.15.37:0/1337762536 wait complete. 2024-09-11T23:18:45.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.197+0000 7f3f1d000640 1 --2- 172.21.15.37:0/215417832 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f3efc0a2b80 0x7f3efc0a5040 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f3f10030040 tx=0x7f3f10005c50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:45.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.198+0000 7f3f219e3740 1 -- start start 2024-09-11T23:18:45.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.198+0000 7f3f219e3740 1 Processor -- start 2024-09-11T23:18:45.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.198+0000 7f3f219e3740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fb025054e0 0x55fb0250d500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:45.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.198+0000 7f3f219e3740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fb02505e00 0x55fb0250da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:45.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.198+0000 7f3f219e3740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fb025106c0 0x55fb0250df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:45.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.198+0000 7f3f219e3740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55fb02513330 con 0x55fb02505e00 2024-09-11T23:18:45.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.198+0000 7f3f219e3740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55fb023f3920 con 0x55fb025106c0 2024-09-11T23:18:45.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.198+0000 7f3f219e3740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55fb025134b0 con 0x55fb025054e0 2024-09-11T23:18:45.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.198+0000 7f3f219e3740 10 client.0 _ll_register_callbacks cb 0x55fb024178a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:18:45.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.199+0000 7f3f1d000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fb025106c0 0x55fb0250df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:45.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.199+0000 7f3f1d000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fb025106c0 0x55fb0250df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.37:60832/0 (socket says 172.21.15.37:60832) 2024-09-11T23:18:45.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.199+0000 7f3f1d000640 1 -- 172.21.15.37:0/1124237953 learned_addr learned my addr 172.21.15.37:0/1124237953 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:18:45.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.199+0000 7f3f17e00640 1 --2- 172.21.15.37:0/1124237953 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fb025054e0 0x55fb0250d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:45.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.199+0000 7f3f17400640 1 --2- 172.21.15.37:0/1124237953 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fb02505e00 0x55fb0250da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:45.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.199+0000 7f3f1d000640 1 -- 172.21.15.37:0/1124237953 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fb025054e0 msgr2=0x55fb0250d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:45.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.199+0000 7f3f1d000640 1 --2- 172.21.15.37:0/1124237953 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fb025054e0 0x55fb0250d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:45.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.199+0000 7f3f1d000640 1 -- 172.21.15.37:0/1124237953 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fb02505e00 msgr2=0x55fb0250da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:45.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.199+0000 7f3f1d000640 1 --2- 172.21.15.37:0/1124237953 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fb02505e00 0x55fb0250da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:45.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.199+0000 7f3f1d000640 1 -- 172.21.15.37:0/1124237953 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb021dc2b0 con 0x55fb025106c0 2024-09-11T23:18:45.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.199+0000 7f3f17e00640 1 --2- 172.21.15.37:0/1124237953 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fb025054e0 0x55fb0250d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:18:45.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.199+0000 7f3f1d000640 1 --2- 172.21.15.37:0/1124237953 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fb025106c0 0x55fb0250df80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3f10035000 tx=0x7f3f100095c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=41d3480aa4f17ca7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:45.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.199+0000 7f3f02000640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-11T23:18:45.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.200+0000 7f3f02000640 1 -- 172.21.15.37:0/1124237953 <== mon.2 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f10056060 con 0x55fb025106c0 2024-09-11T23:18:45.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.200+0000 7f3f219e3740 1 -- 172.21.15.37:0/1124237953 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3f08009e30 con 0x55fb025106c0 2024-09-11T23:18:45.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.200+0000 7f3f02000640 1 -- 172.21.15.37:0/1124237953 <== mon.2 v2:172.21.15.123:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9295+0+0 (secure 0 0 0) 0x7f3f10004000 con 0x55fb025106c0 2024-09-11T23:18:45.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.200+0000 7f3f02000640 1 -- 172.21.15.37:0/1124237953 <== mon.2 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3f1005d050 con 0x55fb025106c0 2024-09-11T23:18:45.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.200+0000 7f3f219e3740 10 client.25124 fetch_fsmap learned FSMap version 28 2024-09-11T23:18:45.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.200+0000 7f3f219e3740 1 -- 172.21.15.37:0/1124237953 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55fb0251ef80 con 0x55fb025106c0 2024-09-11T23:18:45.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.200+0000 7f3f02000640 1 -- 172.21.15.37:0/1124237953 <== mon.2 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3f08009e30 con 0x55fb025106c0 2024-09-11T23:18:45.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.201+0000 7f3f02000640 1 -- 172.21.15.37:0/1124237953 <== mon.2 v2:172.21.15.123:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f3f100308e0 con 0x55fb025106c0 2024-09-11T23:18:45.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.201+0000 7f3f219e3740 10 client.25124 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T23:18:45.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.201+0000 7f3f219e3740 10 client.25124 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-11T23:18:45.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.201+0000 7f3f219e3740 20 client.25124 populate_metadata read hostname 'smithi037' 2024-09-11T23:18:45.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.201+0000 7f3f219e3740 1 --2- 172.21.15.37:0/1124237953 >> [v2:172.21.15.160:6834/2316897035,v1:172.21.15.160:6835/2316897035] conn(0x55fb02521560 0x55fb025229d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:45.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.201+0000 7f3f219e3740 4 client.25124 mds_command: new command op to 24493 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T23:18:45.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.201+0000 7f3f219e3740 1 -- 172.21.15.37:0/1124237953 --> [v2:172.21.15.160:6834/2316897035,v1:172.21.15.160:6835/2316897035] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fb02478620 con 0x55fb02521560 2024-09-11T23:18:45.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.201+0000 7f3f17e00640 1 --2- 172.21.15.37:0/1124237953 >> [v2:172.21.15.160:6834/2316897035,v1:172.21.15.160:6835/2316897035] conn(0x55fb02521560 0x55fb025229d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:45.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.202+0000 7f3f17e00640 1 --2- 172.21.15.37:0/1124237953 >> [v2:172.21.15.160:6834/2316897035,v1:172.21.15.160:6835/2316897035] conn(0x55fb02521560 0x55fb025229d0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=6ffa56d5f8ce56f7 server_cookie=93970e08f5db0c89 in_seq=0 out_seq=0 2024-09-11T23:18:45.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.202+0000 7f3f02000640 10 client.25124 ms_handle_connect on v2:172.21.15.160:6834/2316897035 2024-09-11T23:18:45.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.203+0000 7f3f02000640 1 -- 172.21.15.37:0/1124237953 <== mds.4 v2:172.21.15.160:6834/2316897035 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fb02478620 con 0x55fb02521560 2024-09-11T23:18:45.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.203+0000 7f3f02000640 10 client.25124 handle_command_reply: tid=0 2024-09-11T23:18:45.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.203+0000 7f3f219e3740 1 client.25124 shutdown 2024-09-11T23:18:45.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.203+0000 7f3f219e3740 1 -- 172.21.15.37:0/1124237953 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fb025106c0 msgr2=0x55fb0250df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:45.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.203+0000 7f3f219e3740 1 --2- 172.21.15.37:0/1124237953 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fb025106c0 0x55fb0250df80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3f10035000 tx=0x7f3f100095c0 comp rx=0 tx=0).stop 2024-09-11T23:18:45.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.203+0000 7f3f219e3740 1 -- 172.21.15.37:0/1124237953 shutdown_connections 2024-09-11T23:18:45.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.203+0000 7f3f219e3740 1 --2- 172.21.15.37:0/1124237953 >> [v2:172.21.15.160:6834/2316897035,v1:172.21.15.160:6835/2316897035] conn(0x55fb02521560 0x55fb025229d0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:45.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.203+0000 7f3f219e3740 1 --2- 172.21.15.37:0/1124237953 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fb025106c0 0x55fb0250df80 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:45.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.203+0000 7f3f219e3740 1 --2- 172.21.15.37:0/1124237953 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fb02505e00 0x55fb0250da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:45.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.203+0000 7f3f02000640 0 client.25124 ms_handle_reset on v2:172.21.15.160:6834/2316897035 2024-09-11T23:18:45.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.203+0000 7f3f219e3740 1 --2- 172.21.15.37:0/1124237953 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fb025054e0 0x55fb0250d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:45.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.203+0000 7f3f219e3740 1 -- 172.21.15.37:0/1124237953 >> 172.21.15.37:0/1124237953 conn(0x55fb02501a70 msgr2=0x55fb02500bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:45.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.203+0000 7f3f219e3740 1 -- 172.21.15.37:0/1124237953 shutdown_connections 2024-09-11T23:18:45.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.203+0000 7f3f219e3740 1 -- 172.21.15.37:0/1124237953 wait complete. 2024-09-11T23:18:45.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.204+0000 7f3f219e3740 20 client.25124 trim_cache size 0 max 16384 2024-09-11T23:18:45.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.222+0000 7f3f219e3740 1 Processor -- start 2024-09-11T23:18:45.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.222+0000 7f3f219e3740 1 -- start start 2024-09-11T23:18:45.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.223+0000 7f3f219e3740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fb025054e0 0x55fb02507f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:45.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.223+0000 7f3f219e3740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fb02505e00 0x55fb0250cde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:45.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.223+0000 7f3f219e3740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fb025106c0 0x55fb02508800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:45.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.223+0000 7f3f219e3740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55fb02520d10 con 0x55fb025106c0 2024-09-11T23:18:45.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.223+0000 7f3f219e3740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55fb025213e0 con 0x55fb025054e0 2024-09-11T23:18:45.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.223+0000 7f3f219e3740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55fb02521ab0 con 0x55fb02505e00 2024-09-11T23:18:45.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.223+0000 7f3f1d000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fb025106c0 0x55fb02508800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:45.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.223+0000 7f3f17e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fb025054e0 0x55fb02507f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:45.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.223+0000 7f3f1d000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fb025106c0 0x55fb02508800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58822/0 (socket says 172.21.15.37:58822) 2024-09-11T23:18:45.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.223+0000 7f3f1d000640 1 -- 172.21.15.37:0/2029037693 learned_addr learned my addr 172.21.15.37:0/2029037693 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:18:45.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.223+0000 7f3f17400640 1 --2- 172.21.15.37:0/2029037693 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fb02505e00 0x55fb0250cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:45.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.224+0000 7f3f1d000640 1 -- 172.21.15.37:0/2029037693 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fb02505e00 msgr2=0x55fb0250cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:45.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.224+0000 7f3f1d000640 1 --2- 172.21.15.37:0/2029037693 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fb02505e00 0x55fb0250cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:45.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.224+0000 7f3f1d000640 1 -- 172.21.15.37:0/2029037693 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fb025054e0 msgr2=0x55fb02507f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:45.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.224+0000 7f3f1d000640 1 --2- 172.21.15.37:0/2029037693 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fb025054e0 0x55fb02507f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:45.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.224+0000 7f3f1d000640 1 -- 172.21.15.37:0/2029037693 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb0250ba50 con 0x55fb025106c0 2024-09-11T23:18:45.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.224+0000 7f3f17400640 1 --2- 172.21.15.37:0/2029037693 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fb02505e00 0x55fb0250cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:18:45.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.224+0000 7f3f17e00640 1 --2- 172.21.15.37:0/2029037693 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fb025054e0 0x55fb02507f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:18:45.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.224+0000 7f3f1d000640 1 --2- 172.21.15.37:0/2029037693 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fb025106c0 0x55fb02508800 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f3f1002ae70 tx=0x7f3f1003a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0082a6b5014ab74 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:45.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.224+0000 7f3f0cc00640 1 -- 172.21.15.37:0/2029037693 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f10056070 con 0x55fb025106c0 2024-09-11T23:18:45.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.224+0000 7f3f0cc00640 1 -- 172.21.15.37:0/2029037693 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3f10030920 con 0x55fb025106c0 2024-09-11T23:18:45.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.224+0000 7f3f0cc00640 1 -- 172.21.15.37:0/2029037693 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f10034040 con 0x55fb025106c0 2024-09-11T23:18:45.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.225+0000 7f3f219e3740 1 -- 172.21.15.37:0/2029037693 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fb025106c0 msgr2=0x55fb02508800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:45.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.225+0000 7f3f219e3740 1 --2- 172.21.15.37:0/2029037693 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fb025106c0 0x55fb02508800 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f3f1002ae70 tx=0x7f3f1003a5c0 comp rx=0 tx=0).stop 2024-09-11T23:18:45.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.225+0000 7f3f219e3740 1 -- 172.21.15.37:0/2029037693 shutdown_connections 2024-09-11T23:18:45.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.225+0000 7f3f219e3740 1 --2- 172.21.15.37:0/2029037693 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fb025106c0 0x55fb02508800 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:45.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.225+0000 7f3f219e3740 1 --2- 172.21.15.37:0/2029037693 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fb02505e00 0x55fb0250cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:45.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.225+0000 7f3f219e3740 1 --2- 172.21.15.37:0/2029037693 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fb025054e0 0x55fb02507f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:45.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.225+0000 7f3f219e3740 1 -- 172.21.15.37:0/2029037693 >> 172.21.15.37:0/2029037693 conn(0x55fb02501a70 msgr2=0x55fb0250f580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:45.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.225+0000 7f3f219e3740 1 -- 172.21.15.37:0/2029037693 shutdown_connections 2024-09-11T23:18:45.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.225+0000 7f3f219e3740 1 -- 172.21.15.37:0/2029037693 wait complete. 2024-09-11T23:18:45.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.225+0000 7f3f219e3740 1 -- start start 2024-09-11T23:18:45.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.226+0000 7f3f219e3740 1 Processor -- start 2024-09-11T23:18:45.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.226+0000 7f3f219e3740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fb025054e0 0x55fb02524a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:45.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.226+0000 7f3f219e3740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fb02505e00 0x55fb02524f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:45.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.226+0000 7f3f219e3740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fb025106c0 0x55fb025254c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:45.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.226+0000 7f3f219e3740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55fb02522850 con 0x55fb025054e0 2024-09-11T23:18:45.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.226+0000 7f3f219e3740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55fb02522180 con 0x55fb02505e00 2024-09-11T23:18:45.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.226+0000 7f3f219e3740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55fb02522f20 con 0x55fb025106c0 2024-09-11T23:18:45.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.226+0000 7f3f219e3740 10 client.0 _ll_register_callbacks cb 0x7f3f1002fec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:18:45.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.226+0000 7f3f17e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fb025054e0 0x55fb02524a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:45.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.227+0000 7f3f17e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fb025054e0 0x55fb02524a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58824/0 (socket says 172.21.15.37:58824) 2024-09-11T23:18:45.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.227+0000 7f3f17e00640 1 -- 172.21.15.37:0/448993085 learned_addr learned my addr 172.21.15.37:0/448993085 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:18:45.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.227+0000 7f3f1d000640 1 --2- 172.21.15.37:0/448993085 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fb025106c0 0x55fb025254c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:45.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.227+0000 7f3f17400640 1 --2- 172.21.15.37:0/448993085 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fb02505e00 0x55fb02524f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:45.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.227+0000 7f3f17e00640 1 -- 172.21.15.37:0/448993085 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fb025106c0 msgr2=0x55fb025254c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:45.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.227+0000 7f3f17e00640 1 --2- 172.21.15.37:0/448993085 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fb025106c0 0x55fb025254c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:45.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.227+0000 7f3f17e00640 1 -- 172.21.15.37:0/448993085 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fb02505e00 msgr2=0x55fb02524f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:45.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.227+0000 7f3f17e00640 1 --2- 172.21.15.37:0/448993085 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fb02505e00 0x55fb02524f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:45.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.227+0000 7f3f17e00640 1 -- 172.21.15.37:0/448993085 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb02529260 con 0x55fb025054e0 2024-09-11T23:18:45.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.227+0000 7f3f1d000640 1 --2- 172.21.15.37:0/448993085 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fb025106c0 0x55fb025254c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:18:45.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.227+0000 7f3f17400640 1 --2- 172.21.15.37:0/448993085 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fb02505e00 0x55fb02524f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:18:45.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.227+0000 7f3f17e00640 1 --2- 172.21.15.37:0/448993085 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fb025054e0 0x55fb02524a40 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f3f08009a50 tx=0x7f3f08011d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb08eb1720e3c856 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:45.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.227+0000 7f3f02000640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-11T23:18:45.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.228+0000 7f3f02000640 1 -- 172.21.15.37:0/448993085 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f080096e0 con 0x55fb025054e0 2024-09-11T23:18:45.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.228+0000 7f3f02000640 1 -- 172.21.15.37:0/448993085 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9295+0+0 (secure 0 0 0) 0x7f3f0802c070 con 0x55fb025054e0 2024-09-11T23:18:45.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.228+0000 7f3f219e3740 1 -- 172.21.15.37:0/448993085 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3f10030920 con 0x55fb025054e0 2024-09-11T23:18:45.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.228+0000 7f3f02000640 1 -- 172.21.15.37:0/448993085 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3f0803b050 con 0x55fb025054e0 2024-09-11T23:18:45.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.228+0000 7f3f219e3740 10 client.15120 fetch_fsmap learned FSMap version 28 2024-09-11T23:18:45.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.228+0000 7f3f219e3740 1 -- 172.21.15.37:0/448993085 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55fb0258bf90 con 0x55fb025054e0 2024-09-11T23:18:45.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.228+0000 7f3f02000640 1 -- 172.21.15.37:0/448993085 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3f10030920 con 0x55fb025054e0 2024-09-11T23:18:45.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.229+0000 7f3f02000640 1 -- 172.21.15.37:0/448993085 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f3f08004930 con 0x55fb025054e0 2024-09-11T23:18:45.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.229+0000 7f3f219e3740 10 client.15120 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T23:18:45.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.229+0000 7f3f219e3740 10 client.15120 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-11T23:18:45.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.229+0000 7f3f219e3740 20 client.15120 populate_metadata read hostname 'smithi037' 2024-09-11T23:18:45.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.229+0000 7f3f219e3740 1 --2- 172.21.15.37:0/448993085 >> [v2:172.21.15.160:6834/2316897035,v1:172.21.15.160:6835/2316897035] conn(0x55fb02590930 0x55fb0258f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:45.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.229+0000 7f3f219e3740 4 client.15120 mds_command: new command op to 24493 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T23:18:45.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.229+0000 7f3f219e3740 1 -- 172.21.15.37:0/448993085 --> [v2:172.21.15.160:6834/2316897035,v1:172.21.15.160:6835/2316897035] -- command(tid 0: {"prefix": "status"}) -- 0x55fb02472b30 con 0x55fb02590930 2024-09-11T23:18:45.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.229+0000 7f3f17400640 1 --2- 172.21.15.37:0/448993085 >> [v2:172.21.15.160:6834/2316897035,v1:172.21.15.160:6835/2316897035] conn(0x55fb02590930 0x55fb0258f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:45.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.230+0000 7f3f17400640 1 --2- 172.21.15.37:0/448993085 >> [v2:172.21.15.160:6834/2316897035,v1:172.21.15.160:6835/2316897035] conn(0x55fb02590930 0x55fb0258f640 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=4faaa5ae5a1d8842 server_cookie=2efe2659a31a681 in_seq=0 out_seq=0 2024-09-11T23:18:45.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.230+0000 7f3f02000640 10 client.15120 ms_handle_connect on v2:172.21.15.160:6834/2316897035 2024-09-11T23:18:45.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.230+0000 7f3f02000640 1 -- 172.21.15.37:0/448993085 <== mds.4 v2:172.21.15.160:6834/2316897035 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55fb02472b30 con 0x55fb02590930 2024-09-11T23:18:45.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.230+0000 7f3f02000640 10 client.15120 handle_command_reply: tid=0 2024-09-11T23:18:45.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.230+0000 7f3f219e3740 1 client.15120 shutdown 2024-09-11T23:18:45.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.230+0000 7f3f219e3740 1 -- 172.21.15.37:0/448993085 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fb025054e0 msgr2=0x55fb02524a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:45.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.230+0000 7f3f219e3740 1 --2- 172.21.15.37:0/448993085 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fb025054e0 0x55fb02524a40 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f3f08009a50 tx=0x7f3f08011d60 comp rx=0 tx=0).stop 2024-09-11T23:18:45.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.230+0000 7f3f219e3740 1 -- 172.21.15.37:0/448993085 shutdown_connections 2024-09-11T23:18:45.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.230+0000 7f3f219e3740 1 --2- 172.21.15.37:0/448993085 >> [v2:172.21.15.160:6834/2316897035,v1:172.21.15.160:6835/2316897035] conn(0x55fb02590930 0x55fb0258f640 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:45.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.230+0000 7f3f219e3740 1 --2- 172.21.15.37:0/448993085 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fb02505e00 0x55fb02524f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:45.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.230+0000 7f3f219e3740 1 --2- 172.21.15.37:0/448993085 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fb025106c0 0x55fb025254c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:45.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.230+0000 7f3f219e3740 1 --2- 172.21.15.37:0/448993085 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fb025054e0 0x55fb02524a40 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:45.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.230+0000 7f3f219e3740 1 -- 172.21.15.37:0/448993085 >> 172.21.15.37:0/448993085 conn(0x55fb02501a70 msgr2=0x55fb0251b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:45.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.230+0000 7f3f02000640 0 client.15120 ms_handle_reset on v2:172.21.15.160:6834/2316897035 2024-09-11T23:18:45.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.230+0000 7f3f219e3740 1 -- 172.21.15.37:0/448993085 shutdown_connections 2024-09-11T23:18:45.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.230+0000 7f3f219e3740 1 -- 172.21.15.37:0/448993085 wait complete. 2024-09-11T23:18:45.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.231+0000 7f3f219e3740 20 client.15120 trim_cache size 0 max 16384 2024-09-11T23:18:45.234 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-11T23:18:45.235 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "8b03efce-7092-11ef-bcea-c7b262605968", 2024-09-11T23:18:45.235 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 4, 2024-09-11T23:18:45.235 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 24493, 2024-09-11T23:18:45.235 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2024-09-11T23:18:45.235 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2024-09-11T23:18:45.235 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2024-09-11T23:18:45.235 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 102.49476724199999, 2024-09-11T23:18:45.235 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 28, 2024-09-11T23:18:45.235 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 95, 2024-09-11T23:18:45.235 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 93, 2024-09-11T23:18:45.235 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 180.47839307999999 2024-09-11T23:18:45.235 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-11T23:18:45.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.231+0000 7f3f1da00640 1 -- 172.21.15.37:0/215417832 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f3efc0a2b80 msgr2=0x7f3efc0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:45.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.231+0000 7f3f1da00640 1 --2- 172.21.15.37:0/215417832 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f3efc0a2b80 0x7f3efc0a5040 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f3f10030040 tx=0x7f3f10005c50 comp rx=0 tx=0).stop 2024-09-11T23:18:45.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.231+0000 7f3f1da00640 1 -- 172.21.15.37:0/215417832 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f181034b0 msgr2=0x7f3f18100d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:45.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.231+0000 7f3f1da00640 1 --2- 172.21.15.37:0/215417832 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f181034b0 0x7f3f18100d30 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f3f0400e9f0 tx=0x7f3f0400eeb0 comp rx=0 tx=0).stop 2024-09-11T23:18:45.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.231+0000 7f3f1da00640 1 -- 172.21.15.37:0/215417832 shutdown_connections 2024-09-11T23:18:45.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.231+0000 7f3f1da00640 1 --2- 172.21.15.37:0/215417832 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f3efc0a2b80 0x7f3efc0a5040 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:45.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.231+0000 7f3f1da00640 1 --2- 172.21.15.37:0/215417832 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3f1810bfc0 0x7f3f18101270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:45.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.231+0000 7f3f1da00640 1 --2- 172.21.15.37:0/215417832 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f181034b0 0x7f3f18100d30 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:45.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.231+0000 7f3f1da00640 1 --2- 172.21.15.37:0/215417832 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3f18102b90 0x7f3f181007f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:45.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.231+0000 7f3f1da00640 1 -- 172.21.15.37:0/215417832 >> 172.21.15.37:0/215417832 conn(0x7f3f180fc610 msgr2=0x7f3f180fd2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:45.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.232+0000 7f3f1da00640 1 -- 172.21.15.37:0/215417832 shutdown_connections 2024-09-11T23:18:45.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:45.232+0000 7f3f1da00640 1 -- 172.21.15.37:0/215417832 wait complete. 2024-09-11T23:18:45.647 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:18:45 smithi037 ceph-mon[30630]: pgmap v381: 129 pgs: 129 active+clean; 647 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-11T23:18:45.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:18:45 smithi160 ceph-mon[35055]: pgmap v381: 129 pgs: 129 active+clean; 647 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-11T23:18:45.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:18:45 smithi123 ceph-mon[35438]: pgmap v381: 129 pgs: 129 active+clean; 647 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-11T23:18:45.996 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph tell mds.h status 2024-09-11T23:18:46.372 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:18:46.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.919+0000 7f10b1c00640 1 -- 172.21.15.37:0/3473258986 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10ac112a50 msgr2=0x7f10ac114e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:46.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.919+0000 7f10b1c00640 1 --2- 172.21.15.37:0/3473258986 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10ac112a50 0x7f10ac114e40 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f10a4009ca0 tx=0x7f10a402a8c0 comp rx=0 tx=0).stop 2024-09-11T23:18:46.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.919+0000 7f10b1c00640 1 -- 172.21.15.37:0/3473258986 shutdown_connections 2024-09-11T23:18:46.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.919+0000 7f10b1c00640 1 --2- 172.21.15.37:0/3473258986 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f10ac077040 0x7f10ac112510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:46.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.919+0000 7f10b1c00640 1 --2- 172.21.15.37:0/3473258986 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10ac112a50 0x7f10ac114e40 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:46.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.919+0000 7f10b1c00640 1 --2- 172.21.15.37:0/3473258986 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f10ac076720 0x7f10ac076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:46.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.919+0000 7f10b1c00640 1 -- 172.21.15.37:0/3473258986 >> 172.21.15.37:0/3473258986 conn(0x7f10ac0ffa50 msgr2=0x7f10ac101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:46.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.919+0000 7f10b1c00640 1 -- 172.21.15.37:0/3473258986 shutdown_connections 2024-09-11T23:18:46.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.919+0000 7f10b1c00640 1 -- 172.21.15.37:0/3473258986 wait complete. 2024-09-11T23:18:46.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.920+0000 7f10b1c00640 1 Processor -- start 2024-09-11T23:18:46.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.920+0000 7f10b1c00640 1 -- start start 2024-09-11T23:18:46.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.921+0000 7f10b1c00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f10ac076720 0x7f10ac1a47a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:46.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.921+0000 7f10b1c00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f10ac077040 0x7f10ac1a4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:46.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.921+0000 7f10b1c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10ac112a50 0x7f10ac19e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:46.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.921+0000 7f10b1c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f10ac118590 con 0x7f10ac112a50 2024-09-11T23:18:46.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.921+0000 7f10b1c00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f10ac118410 con 0x7f10ac077040 2024-09-11T23:18:46.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.921+0000 7f10b1c00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f10ac118710 con 0x7f10ac076720 2024-09-11T23:18:46.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.921+0000 7f10aa000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f10ac077040 0x7f10ac1a4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:46.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.921+0000 7f10ab400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10ac112a50 0x7f10ac19e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:46.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.921+0000 7f10aa000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f10ac077040 0x7f10ac1a4ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.37:60870/0 (socket says 172.21.15.37:60870) 2024-09-11T23:18:46.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.921+0000 7f10aa000640 1 -- 172.21.15.37:0/4019371828 learned_addr learned my addr 172.21.15.37:0/4019371828 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:18:46.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.921+0000 7f10aaa00640 1 --2- 172.21.15.37:0/4019371828 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f10ac076720 0x7f10ac1a47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:46.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.921+0000 7f10aa000640 1 -- 172.21.15.37:0/4019371828 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f10ac076720 msgr2=0x7f10ac1a47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:46.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.921+0000 7f10aa000640 1 --2- 172.21.15.37:0/4019371828 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f10ac076720 0x7f10ac1a47a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:46.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.921+0000 7f10aa000640 1 -- 172.21.15.37:0/4019371828 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10ac112a50 msgr2=0x7f10ac19e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:46.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.921+0000 7f10aa000640 1 --2- 172.21.15.37:0/4019371828 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10ac112a50 0x7f10ac19e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:46.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.922+0000 7f10aa000640 1 -- 172.21.15.37:0/4019371828 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10ac19f090 con 0x7f10ac077040 2024-09-11T23:18:46.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.922+0000 7f10aa000640 1 --2- 172.21.15.37:0/4019371828 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f10ac077040 0x7f10ac1a4ce0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f109800ea60 tx=0x7f109800ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:46.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.922+0000 7f10a3400640 1 -- 172.21.15.37:0/4019371828 <== mon.2 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f109800cde0 con 0x7f10ac077040 2024-09-11T23:18:46.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.922+0000 7f10b1c00640 1 -- 172.21.15.37:0/4019371828 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10ac19f380 con 0x7f10ac077040 2024-09-11T23:18:46.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.922+0000 7f10a3400640 1 -- 172.21.15.37:0/4019371828 <== mon.2 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f10980035f0 con 0x7f10ac077040 2024-09-11T23:18:46.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.922+0000 7f10a3400640 1 -- 172.21.15.37:0/4019371828 <== mon.2 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1098010670 con 0x7f10ac077040 2024-09-11T23:18:46.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.922+0000 7f10b1c00640 1 -- 172.21.15.37:0/4019371828 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10ac1ab670 con 0x7f10ac077040 2024-09-11T23:18:46.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.925+0000 7f10b466c740 1 Processor -- start 2024-09-11T23:18:46.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.926+0000 7f10b466c740 1 -- start start 2024-09-11T23:18:46.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.926+0000 7f10a3400640 1 -- 172.21.15.37:0/4019371828 <== mon.2 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f10980037a0 con 0x7f10ac077040 2024-09-11T23:18:46.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.926+0000 7f10b466c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56266fd1e330 0x56266fd1e710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:46.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.926+0000 7f10b466c740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56266fd1ec50 0x56266fd28fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:46.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.926+0000 7f10b466c740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56266fd29510 0x56266fd2b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:46.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.926+0000 7f10b466c740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56266fc840b0 con 0x56266fd1e330 2024-09-11T23:18:46.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.926+0000 7f10b466c740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x56266fc2bab0 con 0x56266fd29510 2024-09-11T23:18:46.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.926+0000 7f10b466c740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x56266fc80070 con 0x56266fd1ec50 2024-09-11T23:18:46.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.926+0000 7f10ab400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56266fd1e330 0x56266fd1e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:46.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.926+0000 7f10aaa00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56266fd1ec50 0x56266fd28fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:46.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.926+0000 7f10ab400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56266fd1e330 0x56266fd1e710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58860/0 (socket says 172.21.15.37:58860) 2024-09-11T23:18:46.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.926+0000 7f10ab400640 1 -- 172.21.15.37:0/123810010 learned_addr learned my addr 172.21.15.37:0/123810010 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:18:46.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.927+0000 7f10aa000640 1 --2- 172.21.15.37:0/123810010 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56266fd29510 0x56266fd2b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:46.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.927+0000 7f10aaa00640 1 -- 172.21.15.37:0/123810010 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56266fd29510 msgr2=0x56266fd2b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:46.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.927+0000 7f10aaa00640 1 --2- 172.21.15.37:0/123810010 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56266fd29510 0x56266fd2b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:46.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.927+0000 7f10aaa00640 1 -- 172.21.15.37:0/123810010 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56266fd1e330 msgr2=0x56266fd1e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:46.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.927+0000 7f10aaa00640 1 --2- 172.21.15.37:0/123810010 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56266fd1e330 0x56266fd1e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:46.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.927+0000 7f10aaa00640 1 -- 172.21.15.37:0/123810010 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56266fc384a0 con 0x56266fd1ec50 2024-09-11T23:18:46.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.927+0000 7f10aaa00640 1 --2- 172.21.15.37:0/123810010 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56266fd1ec50 0x56266fd28fd0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f109c00bbc0 tx=0x7f109c0107a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ecaddbece1cf9e6b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:46.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.927+0000 7f1097e00640 1 -- 172.21.15.37:0/123810010 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f109c004030 con 0x56266fd1ec50 2024-09-11T23:18:46.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.927+0000 7f1097e00640 1 -- 172.21.15.37:0/123810010 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f109c0041d0 con 0x56266fd1ec50 2024-09-11T23:18:46.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.927+0000 7f1097e00640 1 -- 172.21.15.37:0/123810010 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f109c0116a0 con 0x56266fd1ec50 2024-09-11T23:18:46.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.928+0000 7f10a3400640 1 --2- 172.21.15.37:0/4019371828 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f10900a2b80 0x7f10900a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:46.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.928+0000 7f10a3400640 1 -- 172.21.15.37:0/4019371828 <== mon.2 v2:172.21.15.123:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9295+0+0 (secure 0 0 0) 0x7f10980cf710 con 0x7f10ac077040 2024-09-11T23:18:46.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.928+0000 7f10ab400640 1 --2- 172.21.15.37:0/4019371828 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f10900a2b80 0x7f10900a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:46.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.928+0000 7f10b466c740 1 -- 172.21.15.37:0/123810010 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56266fd1ec50 msgr2=0x56266fd28fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:46.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.928+0000 7f10b466c740 1 --2- 172.21.15.37:0/123810010 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56266fd1ec50 0x56266fd28fd0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f109c00bbc0 tx=0x7f109c0107a0 comp rx=0 tx=0).stop 2024-09-11T23:18:46.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.928+0000 7f10b466c740 1 -- 172.21.15.37:0/123810010 shutdown_connections 2024-09-11T23:18:46.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.928+0000 7f10b466c740 1 --2- 172.21.15.37:0/123810010 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56266fd29510 0x56266fd2b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:46.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.928+0000 7f10b466c740 1 --2- 172.21.15.37:0/123810010 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56266fd1ec50 0x56266fd28fd0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:46.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.928+0000 7f10b466c740 1 --2- 172.21.15.37:0/123810010 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56266fd1e330 0x56266fd1e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:46.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.928+0000 7f10b466c740 1 -- 172.21.15.37:0/123810010 >> 172.21.15.37:0/123810010 conn(0x56266fd1a8c0 msgr2=0x56266fd1aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:46.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.929+0000 7f10b466c740 1 -- 172.21.15.37:0/123810010 shutdown_connections 2024-09-11T23:18:46.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.929+0000 7f10ab400640 1 --2- 172.21.15.37:0/4019371828 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f10900a2b80 0x7f10900a5040 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f10a4004af0 tx=0x7f10a4004a80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:46.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.929+0000 7f10b466c740 1 -- 172.21.15.37:0/123810010 wait complete. 2024-09-11T23:18:46.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.929+0000 7f10b466c740 1 -- start start 2024-09-11T23:18:46.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.929+0000 7f10b466c740 1 Processor -- start 2024-09-11T23:18:46.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.930+0000 7f10b466c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56266fd1e330 0x56266fd26530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:46.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.930+0000 7f10b466c740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56266fd1ec50 0x56266fd26a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:46.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.930+0000 7f10b466c740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56266fd29510 0x56266fd26fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:46.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.930+0000 7f10b466c740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56266fd2c060 con 0x56266fd1e330 2024-09-11T23:18:46.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.930+0000 7f10b466c740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x56266fc0c920 con 0x56266fd29510 2024-09-11T23:18:46.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.930+0000 7f10b466c740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x56266fd2c1e0 con 0x56266fd1ec50 2024-09-11T23:18:46.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.930+0000 7f10b466c740 10 client.0 _ll_register_callbacks cb 0x56266fc308a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:18:46.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.930+0000 7f10aa000640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56266fd1ec50 0x56266fd26a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:46.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.930+0000 7f10aaa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56266fd1e330 0x56266fd26530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:46.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.930+0000 7f10aa000640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56266fd1ec50 0x56266fd26a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.37:54430/0 (socket says 172.21.15.37:54430) 2024-09-11T23:18:46.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.930+0000 7f10aa000640 1 -- 172.21.15.37:0/1425930594 learned_addr learned my addr 172.21.15.37:0/1425930594 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:18:46.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.930+0000 7f10ab400640 1 --2- 172.21.15.37:0/1425930594 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56266fd29510 0x56266fd26fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:46.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.931+0000 7f10aa000640 1 -- 172.21.15.37:0/1425930594 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56266fd29510 msgr2=0x56266fd26fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:46.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.931+0000 7f10aa000640 1 --2- 172.21.15.37:0/1425930594 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56266fd29510 0x56266fd26fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:46.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.931+0000 7f10aa000640 1 -- 172.21.15.37:0/1425930594 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56266fd1e330 msgr2=0x56266fd26530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:46.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.931+0000 7f10aa000640 1 --2- 172.21.15.37:0/1425930594 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56266fd1e330 0x56266fd26530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:46.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.931+0000 7f10aa000640 1 -- 172.21.15.37:0/1425930594 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56266f9f52b0 con 0x56266fd1ec50 2024-09-11T23:18:46.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.931+0000 7f10aaa00640 1 --2- 172.21.15.37:0/1425930594 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56266fd1e330 0x56266fd26530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:18:46.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.931+0000 7f10aa000640 1 --2- 172.21.15.37:0/1425930594 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56266fd1ec50 0x56266fd26a70 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f109809ba80 tx=0x7f109809b630 comp rx=0 tx=0).ready entity=mon.1 client_cookie=14c15fd473efc7de server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:46.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.931+0000 7f1094c00640 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2024-09-11T23:18:46.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.931+0000 7f1094c00640 1 -- 172.21.15.37:0/1425930594 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f109809baf0 con 0x56266fd1ec50 2024-09-11T23:18:46.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.931+0000 7f10b466c740 1 -- 172.21.15.37:0/1425930594 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f109c0041d0 con 0x56266fd1ec50 2024-09-11T23:18:46.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.931+0000 7f1094c00640 1 -- 172.21.15.37:0/1425930594 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9295+0+0 (secure 0 0 0) 0x7f1098098160 con 0x56266fd1ec50 2024-09-11T23:18:46.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.931+0000 7f1094c00640 1 -- 172.21.15.37:0/1425930594 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f10980b9050 con 0x56266fd1ec50 2024-09-11T23:18:46.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.931+0000 7f10b466c740 10 client.25144 fetch_fsmap learned FSMap version 28 2024-09-11T23:18:46.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.931+0000 7f10b466c740 1 -- 172.21.15.37:0/1425930594 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56266fd37e60 con 0x56266fd1ec50 2024-09-11T23:18:46.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.932+0000 7f1094c00640 1 -- 172.21.15.37:0/1425930594 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f109c0041d0 con 0x56266fd1ec50 2024-09-11T23:18:46.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.932+0000 7f1094c00640 1 -- 172.21.15.37:0/1425930594 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f10980ba240 con 0x56266fd1ec50 2024-09-11T23:18:46.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.932+0000 7f10b466c740 10 client.25144 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T23:18:46.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.932+0000 7f10b466c740 10 client.25144 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-11T23:18:46.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.932+0000 7f10b466c740 20 client.25144 populate_metadata read hostname 'smithi037' 2024-09-11T23:18:46.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.932+0000 7f10b466c740 1 --2- 172.21.15.37:0/1425930594 >> [v2:172.21.15.123:6836/2168535476,v1:172.21.15.123:6837/2168535476] conn(0x56266fd3a3c0 0x56266fd3b830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:46.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.932+0000 7f10b466c740 4 client.25144 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T23:18:46.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.932+0000 7f10b466c740 1 -- 172.21.15.37:0/1425930594 --> [v2:172.21.15.123:6836/2168535476,v1:172.21.15.123:6837/2168535476] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56266fc91620 con 0x56266fd3a3c0 2024-09-11T23:18:46.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.932+0000 7f10aaa00640 1 --2- 172.21.15.37:0/1425930594 >> [v2:172.21.15.123:6836/2168535476,v1:172.21.15.123:6837/2168535476] conn(0x56266fd3a3c0 0x56266fd3b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:46.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.933+0000 7f10aaa00640 1 --2- 172.21.15.37:0/1425930594 >> [v2:172.21.15.123:6836/2168535476,v1:172.21.15.123:6837/2168535476] conn(0x56266fd3a3c0 0x56266fd3b830 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=c8d49262545dd4d1 server_cookie=ee9b6c4b815bb736 in_seq=0 out_seq=0 2024-09-11T23:18:46.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.933+0000 7f1094c00640 10 client.25144 ms_handle_connect on v2:172.21.15.123:6836/2168535476 2024-09-11T23:18:46.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.934+0000 7f1094c00640 1 -- 172.21.15.37:0/1425930594 <== mds.3 v2:172.21.15.123:6836/2168535476 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56266fc91620 con 0x56266fd3a3c0 2024-09-11T23:18:46.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.934+0000 7f1094c00640 10 client.25144 handle_command_reply: tid=0 2024-09-11T23:18:46.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.934+0000 7f10b466c740 1 client.25144 shutdown 2024-09-11T23:18:46.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.934+0000 7f10b466c740 1 -- 172.21.15.37:0/1425930594 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56266fd1ec50 msgr2=0x56266fd26a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:46.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.934+0000 7f10b466c740 1 --2- 172.21.15.37:0/1425930594 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56266fd1ec50 0x56266fd26a70 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f109809ba80 tx=0x7f109809b630 comp rx=0 tx=0).stop 2024-09-11T23:18:46.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.934+0000 7f10b466c740 1 -- 172.21.15.37:0/1425930594 shutdown_connections 2024-09-11T23:18:46.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.934+0000 7f10b466c740 1 --2- 172.21.15.37:0/1425930594 >> [v2:172.21.15.123:6836/2168535476,v1:172.21.15.123:6837/2168535476] conn(0x56266fd3a3c0 0x56266fd3b830 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:46.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.934+0000 7f10b466c740 1 --2- 172.21.15.37:0/1425930594 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56266fd29510 0x56266fd26fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:46.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.934+0000 7f10b466c740 1 --2- 172.21.15.37:0/1425930594 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56266fd1ec50 0x56266fd26a70 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:46.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.934+0000 7f10b466c740 1 --2- 172.21.15.37:0/1425930594 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56266fd1e330 0x56266fd26530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:46.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.934+0000 7f1094c00640 0 client.25144 ms_handle_reset on v2:172.21.15.123:6836/2168535476 2024-09-11T23:18:46.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.934+0000 7f10b466c740 1 -- 172.21.15.37:0/1425930594 >> 172.21.15.37:0/1425930594 conn(0x56266fd1a8c0 msgr2=0x56266fd205f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:46.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.934+0000 7f10b466c740 1 -- 172.21.15.37:0/1425930594 shutdown_connections 2024-09-11T23:18:46.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.934+0000 7f10b466c740 1 -- 172.21.15.37:0/1425930594 wait complete. 2024-09-11T23:18:46.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.934+0000 7f10b466c740 20 client.25144 trim_cache size 0 max 16384 2024-09-11T23:18:46.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.953+0000 7f10b466c740 1 Processor -- start 2024-09-11T23:18:46.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.953+0000 7f10b466c740 1 -- start start 2024-09-11T23:18:46.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.953+0000 7f10b466c740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56266fd1e330 0x56266fd20d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:46.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.953+0000 7f10b466c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56266fd1ec50 0x56266fd284a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:46.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.953+0000 7f10b466c740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56266fd29510 0x56266fd26e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:46.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.953+0000 7f10b466c740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56266fd39b70 con 0x56266fd1ec50 2024-09-11T23:18:46.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.953+0000 7f10b466c740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x56266fd3a240 con 0x56266fd1e330 2024-09-11T23:18:46.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.953+0000 7f10b466c740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x56266fd3a910 con 0x56266fd29510 2024-09-11T23:18:46.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.954+0000 7f10aa000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56266fd1ec50 0x56266fd284a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:46.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.954+0000 7f10aaa00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56266fd1e330 0x56266fd20d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:46.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.954+0000 7f10ab400640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56266fd29510 0x56266fd26e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:46.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.954+0000 7f10aa000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56266fd1ec50 0x56266fd284a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58876/0 (socket says 172.21.15.37:58876) 2024-09-11T23:18:46.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.954+0000 7f10aa000640 1 -- 172.21.15.37:0/3426238382 learned_addr learned my addr 172.21.15.37:0/3426238382 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:18:46.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.954+0000 7f10aa000640 1 -- 172.21.15.37:0/3426238382 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56266fd29510 msgr2=0x56266fd26e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:46.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.954+0000 7f10aa000640 1 --2- 172.21.15.37:0/3426238382 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56266fd29510 0x56266fd26e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:46.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.954+0000 7f10aa000640 1 -- 172.21.15.37:0/3426238382 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56266fd1e330 msgr2=0x56266fd20d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:46.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.954+0000 7f10aa000640 1 --2- 172.21.15.37:0/3426238382 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56266fd1e330 0x56266fd20d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:46.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.954+0000 7f10aa000640 1 -- 172.21.15.37:0/3426238382 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56266fd24a80 con 0x56266fd1ec50 2024-09-11T23:18:46.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.954+0000 7f10aaa00640 1 --2- 172.21.15.37:0/3426238382 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56266fd1e330 0x56266fd20d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:18:46.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.955+0000 7f10ab400640 1 --2- 172.21.15.37:0/3426238382 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56266fd29510 0x56266fd26e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:18:46.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.955+0000 7f10aa000640 1 --2- 172.21.15.37:0/3426238382 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56266fd1ec50 0x56266fd284a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f1098097f50 tx=0x7f10980cf990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9dba2479d8a8ca6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:46.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.955+0000 7f1097400640 1 -- 172.21.15.37:0/3426238382 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f109809baf0 con 0x56266fd1ec50 2024-09-11T23:18:46.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.955+0000 7f1097400640 1 -- 172.21.15.37:0/3426238382 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f109809fea0 con 0x56266fd1ec50 2024-09-11T23:18:46.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.955+0000 7f1097400640 1 -- 172.21.15.37:0/3426238382 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f109809b450 con 0x56266fd1ec50 2024-09-11T23:18:46.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.956+0000 7f10b466c740 1 -- 172.21.15.37:0/3426238382 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56266fd1ec50 msgr2=0x56266fd284a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:46.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.956+0000 7f10b466c740 1 --2- 172.21.15.37:0/3426238382 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56266fd1ec50 0x56266fd284a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f1098097f50 tx=0x7f10980cf990 comp rx=0 tx=0).stop 2024-09-11T23:18:46.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.956+0000 7f10b466c740 1 -- 172.21.15.37:0/3426238382 shutdown_connections 2024-09-11T23:18:46.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.956+0000 7f10b466c740 1 --2- 172.21.15.37:0/3426238382 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56266fd29510 0x56266fd26e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:46.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.956+0000 7f10b466c740 1 --2- 172.21.15.37:0/3426238382 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56266fd1ec50 0x56266fd284a0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:46.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.956+0000 7f10b466c740 1 --2- 172.21.15.37:0/3426238382 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56266fd1e330 0x56266fd20d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:46.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.956+0000 7f10b466c740 1 -- 172.21.15.37:0/3426238382 >> 172.21.15.37:0/3426238382 conn(0x56266fd1a8c0 msgr2=0x56266fd27d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:46.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.956+0000 7f10b466c740 1 -- 172.21.15.37:0/3426238382 shutdown_connections 2024-09-11T23:18:46.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.956+0000 7f10b466c740 1 -- 172.21.15.37:0/3426238382 wait complete. 2024-09-11T23:18:46.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.956+0000 7f10b466c740 1 -- start start 2024-09-11T23:18:46.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.956+0000 7f10b466c740 1 Processor -- start 2024-09-11T23:18:46.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.957+0000 7f10b466c740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56266fd1e330 0x56266fd43c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:46.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.957+0000 7f10b466c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56266fd1ec50 0x56266fd441b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:46.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.957+0000 7f10b466c740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56266fd29510 0x56266fd3ea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:46.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.957+0000 7f10b466c740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56266fd3b6b0 con 0x56266fd1ec50 2024-09-11T23:18:46.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.957+0000 7f10b466c740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x56266fd3afe0 con 0x56266fd1e330 2024-09-11T23:18:46.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.957+0000 7f10b466c740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x56266fd3bd80 con 0x56266fd29510 2024-09-11T23:18:46.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.957+0000 7f10b466c740 10 client.0 _ll_register_callbacks cb 0x7f109809b8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:18:46.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.957+0000 7f10aa000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56266fd1ec50 0x56266fd441b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:46.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.957+0000 7f10ab400640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56266fd29510 0x56266fd3ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:46.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.957+0000 7f10aa000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56266fd1ec50 0x56266fd441b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58890/0 (socket says 172.21.15.37:58890) 2024-09-11T23:18:46.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.957+0000 7f10aa000640 1 -- 172.21.15.37:0/2607087026 learned_addr learned my addr 172.21.15.37:0/2607087026 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:18:46.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.957+0000 7f10aaa00640 1 --2- 172.21.15.37:0/2607087026 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56266fd1e330 0x56266fd43c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:46.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.958+0000 7f10aa000640 1 -- 172.21.15.37:0/2607087026 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56266fd29510 msgr2=0x56266fd3ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:46.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.958+0000 7f10aa000640 1 --2- 172.21.15.37:0/2607087026 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56266fd29510 0x56266fd3ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:46.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.958+0000 7f10aa000640 1 -- 172.21.15.37:0/2607087026 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56266fd1e330 msgr2=0x56266fd43c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:46.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.958+0000 7f10aa000640 1 --2- 172.21.15.37:0/2607087026 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56266fd1e330 0x56266fd43c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:46.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.958+0000 7f10aa000640 1 -- 172.21.15.37:0/2607087026 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56266fd3f250 con 0x56266fd1ec50 2024-09-11T23:18:46.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.958+0000 7f10aa000640 1 --2- 172.21.15.37:0/2607087026 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56266fd1ec50 0x56266fd441b0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f10980ba680 tx=0x7f1098003d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94c7d5e1c438dd7c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:46.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.958+0000 7f1094c00640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-11T23:18:46.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.958+0000 7f1094c00640 1 -- 172.21.15.37:0/2607087026 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f109807f060 con 0x56266fd1ec50 2024-09-11T23:18:46.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.958+0000 7f1094c00640 1 -- 172.21.15.37:0/2607087026 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9295+0+0 (secure 0 0 0) 0x7f10980ba240 con 0x56266fd1ec50 2024-09-11T23:18:46.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.958+0000 7f10b466c740 1 -- 172.21.15.37:0/2607087026 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f109809fea0 con 0x56266fd1ec50 2024-09-11T23:18:46.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.958+0000 7f1094c00640 1 -- 172.21.15.37:0/2607087026 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f10980a4760 con 0x56266fd1ec50 2024-09-11T23:18:46.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.958+0000 7f10b466c740 10 client.15138 fetch_fsmap learned FSMap version 28 2024-09-11T23:18:46.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.958+0000 7f10b466c740 1 -- 172.21.15.37:0/2607087026 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56266fda5570 con 0x56266fd1ec50 2024-09-11T23:18:46.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.959+0000 7f1094c00640 1 -- 172.21.15.37:0/2607087026 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f109809fea0 con 0x56266fd1ec50 2024-09-11T23:18:46.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.959+0000 7f1094c00640 1 -- 172.21.15.37:0/2607087026 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f1098097a30 con 0x56266fd1ec50 2024-09-11T23:18:46.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.959+0000 7f10b466c740 10 client.15138 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T23:18:46.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.959+0000 7f10b466c740 10 client.15138 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-11T23:18:46.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.959+0000 7f10b466c740 20 client.15138 populate_metadata read hostname 'smithi037' 2024-09-11T23:18:46.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.959+0000 7f10b466c740 1 --2- 172.21.15.37:0/2607087026 >> [v2:172.21.15.123:6836/2168535476,v1:172.21.15.123:6837/2168535476] conn(0x56266fda9c20 0x56266fda8930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:46.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.959+0000 7f10b466c740 4 client.15138 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T23:18:46.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.959+0000 7f10b466c740 1 -- 172.21.15.37:0/2607087026 --> [v2:172.21.15.123:6836/2168535476,v1:172.21.15.123:6837/2168535476] -- command(tid 0: {"prefix": "status"}) -- 0x56266fc8bb30 con 0x56266fda9c20 2024-09-11T23:18:46.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.959+0000 7f10aaa00640 1 --2- 172.21.15.37:0/2607087026 >> [v2:172.21.15.123:6836/2168535476,v1:172.21.15.123:6837/2168535476] conn(0x56266fda9c20 0x56266fda8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:46.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.960+0000 7f10aaa00640 1 --2- 172.21.15.37:0/2607087026 >> [v2:172.21.15.123:6836/2168535476,v1:172.21.15.123:6837/2168535476] conn(0x56266fda9c20 0x56266fda8930 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=8e02e9238a26ebf9 server_cookie=70b7324dd3b43069 in_seq=0 out_seq=0 2024-09-11T23:18:46.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.960+0000 7f1094c00640 10 client.15138 ms_handle_connect on v2:172.21.15.123:6836/2168535476 2024-09-11T23:18:46.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.960+0000 7f1094c00640 1 -- 172.21.15.37:0/2607087026 <== mds.3 v2:172.21.15.123:6836/2168535476 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x56266fc8bb30 con 0x56266fda9c20 2024-09-11T23:18:46.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.960+0000 7f1094c00640 10 client.15138 handle_command_reply: tid=0 2024-09-11T23:18:46.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.960+0000 7f10b466c740 1 client.15138 shutdown 2024-09-11T23:18:46.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.960+0000 7f10b466c740 1 -- 172.21.15.37:0/2607087026 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56266fd1ec50 msgr2=0x56266fd441b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:46.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.960+0000 7f10b466c740 1 --2- 172.21.15.37:0/2607087026 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56266fd1ec50 0x56266fd441b0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f10980ba680 tx=0x7f1098003d60 comp rx=0 tx=0).stop 2024-09-11T23:18:46.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.960+0000 7f10b466c740 1 -- 172.21.15.37:0/2607087026 shutdown_connections 2024-09-11T23:18:46.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.960+0000 7f10b466c740 1 --2- 172.21.15.37:0/2607087026 >> [v2:172.21.15.123:6836/2168535476,v1:172.21.15.123:6837/2168535476] conn(0x56266fda9c20 0x56266fda8930 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:46.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.960+0000 7f10b466c740 1 --2- 172.21.15.37:0/2607087026 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56266fd29510 0x56266fd3ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:46.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.960+0000 7f10b466c740 1 --2- 172.21.15.37:0/2607087026 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56266fd1ec50 0x56266fd441b0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:46.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.960+0000 7f10b466c740 1 --2- 172.21.15.37:0/2607087026 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56266fd1e330 0x56266fd43c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:46.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.961+0000 7f10b466c740 1 -- 172.21.15.37:0/2607087026 >> 172.21.15.37:0/2607087026 conn(0x56266fd1a8c0 msgr2=0x56266fd34c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:46.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.961+0000 7f1094c00640 0 client.15138 ms_handle_reset on v2:172.21.15.123:6836/2168535476 2024-09-11T23:18:46.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.961+0000 7f10b466c740 1 -- 172.21.15.37:0/2607087026 shutdown_connections 2024-09-11T23:18:46.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.961+0000 7f10b466c740 1 -- 172.21.15.37:0/2607087026 wait complete. 2024-09-11T23:18:46.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.961+0000 7f10b466c740 20 client.15138 trim_cache size 0 max 16384 2024-09-11T23:18:46.965 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-11T23:18:46.965 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "8b03efce-7092-11ef-bcea-c7b262605968", 2024-09-11T23:18:46.965 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 3, 2024-09-11T23:18:46.965 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 24497, 2024-09-11T23:18:46.965 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2024-09-11T23:18:46.965 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2024-09-11T23:18:46.965 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2024-09-11T23:18:46.966 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 105.23369560499999, 2024-09-11T23:18:46.966 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 28, 2024-09-11T23:18:46.966 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 95, 2024-09-11T23:18:46.966 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 93, 2024-09-11T23:18:46.966 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 176.84524001299999 2024-09-11T23:18:46.966 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-11T23:18:46.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.961+0000 7f10b1c00640 1 -- 172.21.15.37:0/4019371828 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f10900a2b80 msgr2=0x7f10900a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:46.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.961+0000 7f10b1c00640 1 --2- 172.21.15.37:0/4019371828 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f10900a2b80 0x7f10900a5040 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f10a4004af0 tx=0x7f10a4004a80 comp rx=0 tx=0).stop 2024-09-11T23:18:46.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.961+0000 7f10b1c00640 1 -- 172.21.15.37:0/4019371828 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f10ac077040 msgr2=0x7f10ac1a4ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:46.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.961+0000 7f10b1c00640 1 --2- 172.21.15.37:0/4019371828 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f10ac077040 0x7f10ac1a4ce0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f109800ea60 tx=0x7f109800ef20 comp rx=0 tx=0).stop 2024-09-11T23:18:46.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.962+0000 7f10b1c00640 1 -- 172.21.15.37:0/4019371828 shutdown_connections 2024-09-11T23:18:46.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.962+0000 7f10b1c00640 1 --2- 172.21.15.37:0/4019371828 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f10900a2b80 0x7f10900a5040 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:46.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.962+0000 7f10b1c00640 1 --2- 172.21.15.37:0/4019371828 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f10ac077040 0x7f10ac1a4ce0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:46.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.962+0000 7f10b1c00640 1 --2- 172.21.15.37:0/4019371828 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10ac112a50 0x7f10ac19e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:46.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.962+0000 7f10b1c00640 1 --2- 172.21.15.37:0/4019371828 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f10ac076720 0x7f10ac1a47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:46.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.962+0000 7f10b1c00640 1 -- 172.21.15.37:0/4019371828 >> 172.21.15.37:0/4019371828 conn(0x7f10ac0ffa50 msgr2=0x7f10ac101e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:46.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.962+0000 7f10b1c00640 1 -- 172.21.15.37:0/4019371828 shutdown_connections 2024-09-11T23:18:46.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:46.962+0000 7f10b1c00640 1 -- 172.21.15.37:0/4019371828 wait complete. 2024-09-11T23:18:47.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:18:47 smithi160 ceph-mon[35055]: pgmap v382: 129 pgs: 129 active+clean; 647 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-09-11T23:18:47.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:18:47 smithi123 ceph-mon[35438]: pgmap v382: 129 pgs: 129 active+clean; 647 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-09-11T23:18:47.803 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:18:47 smithi037 ceph-mon[30630]: pgmap v382: 129 pgs: 129 active+clean; 647 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-09-11T23:18:47.842 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph tell mds.c status 2024-09-11T23:18:48.222 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:18:48.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.793+0000 7f376e000640 1 -- 172.21.15.37:0/979129186 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3768109120 msgr2=0x7f3768110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:48.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.793+0000 7f376e000640 1 --2- 172.21.15.37:0/979129186 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3768109120 0x7f3768110ca0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3760009ca0 tx=0x7f376002a8c0 comp rx=0 tx=0).stop 2024-09-11T23:18:48.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.793+0000 7f376e000640 1 -- 172.21.15.37:0/979129186 shutdown_connections 2024-09-11T23:18:48.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.793+0000 7f376e000640 1 --2- 172.21.15.37:0/979129186 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3768109120 0x7f3768110ca0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:48.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.793+0000 7f376e000640 1 --2- 172.21.15.37:0/979129186 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f37681049a0 0x7f37681089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:48.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.793+0000 7f376e000640 1 --2- 172.21.15.37:0/979129186 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3768103ff0 0x7f37681043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:48.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.793+0000 7f376e000640 1 -- 172.21.15.37:0/979129186 >> 172.21.15.37:0/979129186 conn(0x7f37680ffa90 msgr2=0x7f3768101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:48.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.793+0000 7f376e000640 1 -- 172.21.15.37:0/979129186 shutdown_connections 2024-09-11T23:18:48.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.793+0000 7f376e000640 1 -- 172.21.15.37:0/979129186 wait complete. 2024-09-11T23:18:48.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.794+0000 7f376e000640 1 Processor -- start 2024-09-11T23:18:48.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.795+0000 7f376e000640 1 -- start start 2024-09-11T23:18:48.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.795+0000 7f376e000640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3768103ff0 0x7f376819a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:48.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.795+0000 7f376e000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37681049a0 0x7f376819ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:48.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.795+0000 7f376e000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3768109120 0x7f376819eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:48.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.795+0000 7f376e000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f37681141a0 con 0x7f3768109120 2024-09-11T23:18:48.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.795+0000 7f376e000640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f3768114020 con 0x7f37681049a0 2024-09-11T23:18:48.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.795+0000 7f376e000640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f3768114320 con 0x7f3768103ff0 2024-09-11T23:18:48.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.795+0000 7f3767400640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3768103ff0 0x7f376819a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:48.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.795+0000 7f3767e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3768109120 0x7f376819eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:48.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.795+0000 7f3767400640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3768103ff0 0x7f376819a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.37:54460/0 (socket says 172.21.15.37:54460) 2024-09-11T23:18:48.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.795+0000 7f3767400640 1 -- 172.21.15.37:0/1174415808 learned_addr learned my addr 172.21.15.37:0/1174415808 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:18:48.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.795+0000 7f3766a00640 1 --2- 172.21.15.37:0/1174415808 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37681049a0 0x7f376819ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:48.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.796+0000 7f3767400640 1 -- 172.21.15.37:0/1174415808 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37681049a0 msgr2=0x7f376819ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:48.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.796+0000 7f3767400640 1 --2- 172.21.15.37:0/1174415808 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37681049a0 0x7f376819ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:48.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.796+0000 7f3767400640 1 -- 172.21.15.37:0/1174415808 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3768109120 msgr2=0x7f376819eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:48.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.796+0000 7f3767400640 1 --2- 172.21.15.37:0/1174415808 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3768109120 0x7f376819eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:48.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.796+0000 7f3767400640 1 -- 172.21.15.37:0/1174415808 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f376819f5d0 con 0x7f3768103ff0 2024-09-11T23:18:48.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.796+0000 7f3767e00640 1 --2- 172.21.15.37:0/1174415808 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3768109120 0x7f376819eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:18:48.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.796+0000 7f3767400640 1 --2- 172.21.15.37:0/1174415808 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3768103ff0 0x7f376819a620 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f375800ea60 tx=0x7f375800ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:48.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.796+0000 7f375fe00640 1 -- 172.21.15.37:0/1174415808 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f375800cde0 con 0x7f3768103ff0 2024-09-11T23:18:48.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.797+0000 7f376e000640 1 -- 172.21.15.37:0/1174415808 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f376819f8c0 con 0x7f3768103ff0 2024-09-11T23:18:48.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.797+0000 7f375fe00640 1 -- 172.21.15.37:0/1174415808 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f37580035f0 con 0x7f3768103ff0 2024-09-11T23:18:48.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.797+0000 7f375fe00640 1 -- 172.21.15.37:0/1174415808 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3758010670 con 0x7f3768103ff0 2024-09-11T23:18:48.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.797+0000 7f376e000640 1 -- 172.21.15.37:0/1174415808 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37681a71a0 con 0x7f3768103ff0 2024-09-11T23:18:48.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.801+0000 7f3770bd0740 1 Processor -- start 2024-09-11T23:18:48.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.801+0000 7f3770bd0740 1 -- start start 2024-09-11T23:18:48.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.801+0000 7f375fe00640 1 -- 172.21.15.37:0/1174415808 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f37580037a0 con 0x7f3768103ff0 2024-09-11T23:18:48.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.802+0000 7f3770bd0740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55dd5713a330 0x55dd5713a710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:48.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.802+0000 7f3770bd0740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55dd5713ac50 0x55dd57144fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:48.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.802+0000 7f3770bd0740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dd57145510 0x55dd57147900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:48.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.802+0000 7f3770bd0740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55dd570a00b0 con 0x55dd57145510 2024-09-11T23:18:48.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.802+0000 7f3770bd0740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55dd57047ab0 con 0x55dd5713a330 2024-09-11T23:18:48.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.802+0000 7f3770bd0740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55dd5709c070 con 0x55dd5713ac50 2024-09-11T23:18:48.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.802+0000 7f3767e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55dd5713a330 0x55dd5713a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:48.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.802+0000 7f3767e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55dd5713a330 0x55dd5713a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.37:60934/0 (socket says 172.21.15.37:60934) 2024-09-11T23:18:48.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.802+0000 7f3767e00640 1 -- 172.21.15.37:0/3622678884 learned_addr learned my addr 172.21.15.37:0/3622678884 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:18:48.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.802+0000 7f3767400640 1 --2- 172.21.15.37:0/3622678884 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55dd5713ac50 0x55dd57144fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:48.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.802+0000 7f3766a00640 1 --2- 172.21.15.37:0/3622678884 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dd57145510 0x55dd57147900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:48.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.802+0000 7f3767e00640 1 -- 172.21.15.37:0/3622678884 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55dd5713ac50 msgr2=0x55dd57144fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:48.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.802+0000 7f3767e00640 1 --2- 172.21.15.37:0/3622678884 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55dd5713ac50 0x55dd57144fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:48.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.803+0000 7f3767e00640 1 -- 172.21.15.37:0/3622678884 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dd57145510 msgr2=0x55dd57147900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:48.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.803+0000 7f3767e00640 1 --2- 172.21.15.37:0/3622678884 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dd57145510 0x55dd57147900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:48.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.803+0000 7f3767e00640 1 -- 172.21.15.37:0/3622678884 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd570544a0 con 0x55dd5713a330 2024-09-11T23:18:48.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.803+0000 7f3767400640 1 --2- 172.21.15.37:0/3622678884 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55dd5713ac50 0x55dd57144fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:18:48.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.803+0000 7f3766a00640 1 --2- 172.21.15.37:0/3622678884 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dd57145510 0x55dd57147900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:18:48.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.803+0000 7f3767e00640 1 --2- 172.21.15.37:0/3622678884 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55dd5713a330 0x55dd5713a710 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3760009ca0 tx=0x7f3760033000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8fa282a9add8e05f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:48.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.803+0000 7f375fe00640 1 --2- 172.21.15.37:0/1174415808 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f374c0a2b80 0x7f374c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:48.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.803+0000 7f375fe00640 1 -- 172.21.15.37:0/1174415808 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9295+0+0 (secure 0 0 0) 0x7f37580cf710 con 0x7f3768103ff0 2024-09-11T23:18:48.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.803+0000 7f3753e00640 1 -- 172.21.15.37:0/3622678884 <== mon.2 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3760003b70 con 0x55dd5713a330 2024-09-11T23:18:48.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.804+0000 7f3753e00640 1 -- 172.21.15.37:0/3622678884 <== mon.2 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3760036040 con 0x55dd5713a330 2024-09-11T23:18:48.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.804+0000 7f3767400640 1 --2- 172.21.15.37:0/1174415808 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f374c0a2b80 0x7f374c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:48.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.804+0000 7f3753e00640 1 -- 172.21.15.37:0/3622678884 <== mon.2 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3760004500 con 0x55dd5713a330 2024-09-11T23:18:48.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.804+0000 7f3770bd0740 1 -- 172.21.15.37:0/3622678884 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55dd5713a330 msgr2=0x55dd5713a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:48.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.804+0000 7f3767400640 1 --2- 172.21.15.37:0/1174415808 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f374c0a2b80 0x7f374c0a5040 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f37580cd160 tx=0x7f37580d5550 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:48.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.804+0000 7f3770bd0740 1 --2- 172.21.15.37:0/3622678884 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55dd5713a330 0x55dd5713a710 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3760009ca0 tx=0x7f3760033000 comp rx=0 tx=0).stop 2024-09-11T23:18:48.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.805+0000 7f3770bd0740 1 -- 172.21.15.37:0/3622678884 shutdown_connections 2024-09-11T23:18:48.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.805+0000 7f3770bd0740 1 --2- 172.21.15.37:0/3622678884 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dd57145510 0x55dd57147900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:48.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.805+0000 7f3770bd0740 1 --2- 172.21.15.37:0/3622678884 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55dd5713ac50 0x55dd57144fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:48.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.805+0000 7f3770bd0740 1 --2- 172.21.15.37:0/3622678884 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55dd5713a330 0x55dd5713a710 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:48.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.805+0000 7f3770bd0740 1 -- 172.21.15.37:0/3622678884 >> 172.21.15.37:0/3622678884 conn(0x55dd571368c0 msgr2=0x55dd57136ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:48.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.805+0000 7f3770bd0740 1 -- 172.21.15.37:0/3622678884 shutdown_connections 2024-09-11T23:18:48.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.805+0000 7f3770bd0740 1 -- 172.21.15.37:0/3622678884 wait complete. 2024-09-11T23:18:48.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.805+0000 7f3770bd0740 1 -- start start 2024-09-11T23:18:48.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.805+0000 7f3770bd0740 1 Processor -- start 2024-09-11T23:18:48.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.806+0000 7f3770bd0740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55dd5713a330 0x55dd571424b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:48.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.806+0000 7f3770bd0740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dd5713ac50 0x55dd571429f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:48.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.806+0000 7f3770bd0740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55dd57145510 0x55dd57142f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:48.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.806+0000 7f3770bd0740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55dd57148000 con 0x55dd5713ac50 2024-09-11T23:18:48.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.806+0000 7f3770bd0740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55dd57028920 con 0x55dd5713a330 2024-09-11T23:18:48.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.806+0000 7f3770bd0740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55dd57148180 con 0x55dd57145510 2024-09-11T23:18:48.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.806+0000 7f3770bd0740 10 client.0 _ll_register_callbacks cb 0x55dd5704c8a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:18:48.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.806+0000 7f3767e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55dd5713a330 0x55dd571424b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:48.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.806+0000 7f3766a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dd5713ac50 0x55dd571429f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:48.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.806+0000 7f3767e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55dd5713a330 0x55dd571424b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.37:60948/0 (socket says 172.21.15.37:60948) 2024-09-11T23:18:48.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.806+0000 7f3767e00640 1 -- 172.21.15.37:0/2334631354 learned_addr learned my addr 172.21.15.37:0/2334631354 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:18:48.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.806+0000 7f3767e00640 1 --2- 172.21.15.37:0/2334631354 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55dd57145510 0x55dd57142f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:48.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.807+0000 7f3766a00640 1 -- 172.21.15.37:0/2334631354 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55dd57145510 msgr2=0x55dd57142f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:48.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.807+0000 7f3766a00640 1 --2- 172.21.15.37:0/2334631354 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55dd57145510 0x55dd57142f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:48.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.807+0000 7f3766a00640 1 -- 172.21.15.37:0/2334631354 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55dd5713a330 msgr2=0x55dd571424b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:48.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.807+0000 7f3766a00640 1 --2- 172.21.15.37:0/2334631354 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55dd5713a330 0x55dd571424b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:48.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.807+0000 7f3766a00640 1 -- 172.21.15.37:0/2334631354 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dd56e112b0 con 0x55dd5713ac50 2024-09-11T23:18:48.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.807+0000 7f3766a00640 1 --2- 172.21.15.37:0/2334631354 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dd5713ac50 0x55dd571429f0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f376810ab20 tx=0x7f3754012aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a0d8bf7f68aba10 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:48.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.807+0000 7f3750c00640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-11T23:18:48.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.808+0000 7f3750c00640 1 -- 172.21.15.37:0/2334631354 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3754004050 con 0x55dd5713ac50 2024-09-11T23:18:48.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.808+0000 7f3770bd0740 1 -- 172.21.15.37:0/2334631354 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3760036040 con 0x55dd5713ac50 2024-09-11T23:18:48.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.808+0000 7f3750c00640 1 -- 172.21.15.37:0/2334631354 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9295+0+0 (secure 0 0 0) 0x7f37540041f0 con 0x55dd5713ac50 2024-09-11T23:18:48.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.808+0000 7f3750c00640 1 -- 172.21.15.37:0/2334631354 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3754024050 con 0x55dd5713ac50 2024-09-11T23:18:48.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.808+0000 7f3770bd0740 10 client.15150 fetch_fsmap learned FSMap version 28 2024-09-11T23:18:48.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.808+0000 7f3770bd0740 1 -- 172.21.15.37:0/2334631354 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55dd57153cf0 con 0x55dd5713ac50 2024-09-11T23:18:48.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.808+0000 7f3750c00640 1 -- 172.21.15.37:0/2334631354 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3760036040 con 0x55dd5713ac50 2024-09-11T23:18:48.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.808+0000 7f3750c00640 1 -- 172.21.15.37:0/2334631354 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f375400f7a0 con 0x55dd5713ac50 2024-09-11T23:18:48.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.809+0000 7f3770bd0740 10 client.15150 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T23:18:48.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.809+0000 7f3770bd0740 10 client.15150 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-11T23:18:48.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.809+0000 7f3770bd0740 20 client.15150 populate_metadata read hostname 'smithi037' 2024-09-11T23:18:48.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.809+0000 7f3770bd0740 1 --2- 172.21.15.37:0/2334631354 >> [v2:172.21.15.160:6836/2906597021,v1:172.21.15.160:6837/2906597021] conn(0x55dd571562f0 0x55dd57157760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:48.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.809+0000 7f3770bd0740 4 client.15150 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T23:18:48.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.809+0000 7f3770bd0740 1 -- 172.21.15.37:0/2334631354 --> [v2:172.21.15.160:6836/2906597021,v1:172.21.15.160:6837/2906597021] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dd570ad620 con 0x55dd571562f0 2024-09-11T23:18:48.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.809+0000 7f3767e00640 1 --2- 172.21.15.37:0/2334631354 >> [v2:172.21.15.160:6836/2906597021,v1:172.21.15.160:6837/2906597021] conn(0x55dd571562f0 0x55dd57157760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:48.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.810+0000 7f3767e00640 1 --2- 172.21.15.37:0/2334631354 >> [v2:172.21.15.160:6836/2906597021,v1:172.21.15.160:6837/2906597021] conn(0x55dd571562f0 0x55dd57157760 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b74f099b6ec622ab server_cookie=f7b9034cc82f2b7f in_seq=0 out_seq=0 2024-09-11T23:18:48.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.810+0000 7f3750c00640 10 client.15150 ms_handle_connect on v2:172.21.15.160:6836/2906597021 2024-09-11T23:18:48.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.810+0000 7f3750c00640 1 -- 172.21.15.37:0/2334631354 <== mds.2 v2:172.21.15.160:6836/2906597021 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55dd570ad620 con 0x55dd571562f0 2024-09-11T23:18:48.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.810+0000 7f3750c00640 10 client.15150 handle_command_reply: tid=0 2024-09-11T23:18:48.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.811+0000 7f3770bd0740 1 client.15150 shutdown 2024-09-11T23:18:48.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.811+0000 7f3770bd0740 1 -- 172.21.15.37:0/2334631354 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dd5713ac50 msgr2=0x55dd571429f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:48.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.811+0000 7f3770bd0740 1 --2- 172.21.15.37:0/2334631354 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dd5713ac50 0x55dd571429f0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f376810ab20 tx=0x7f3754012aa0 comp rx=0 tx=0).stop 2024-09-11T23:18:48.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.811+0000 7f3770bd0740 1 -- 172.21.15.37:0/2334631354 shutdown_connections 2024-09-11T23:18:48.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.811+0000 7f3770bd0740 1 --2- 172.21.15.37:0/2334631354 >> [v2:172.21.15.160:6836/2906597021,v1:172.21.15.160:6837/2906597021] conn(0x55dd571562f0 0x55dd57157760 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:48.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.811+0000 7f3770bd0740 1 --2- 172.21.15.37:0/2334631354 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55dd57145510 0x55dd57142f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:48.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.811+0000 7f3770bd0740 1 --2- 172.21.15.37:0/2334631354 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dd5713ac50 0x55dd571429f0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:48.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.811+0000 7f3770bd0740 1 --2- 172.21.15.37:0/2334631354 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55dd5713a330 0x55dd571424b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:48.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.811+0000 7f3770bd0740 1 -- 172.21.15.37:0/2334631354 >> 172.21.15.37:0/2334631354 conn(0x55dd571368c0 msgr2=0x55dd5713c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:48.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.811+0000 7f3750c00640 0 client.15150 ms_handle_reset on v2:172.21.15.160:6836/2906597021 2024-09-11T23:18:48.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.811+0000 7f3770bd0740 1 -- 172.21.15.37:0/2334631354 shutdown_connections 2024-09-11T23:18:48.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.811+0000 7f3770bd0740 1 -- 172.21.15.37:0/2334631354 wait complete. 2024-09-11T23:18:48.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.811+0000 7f3770bd0740 20 client.15150 trim_cache size 0 max 16384 2024-09-11T23:18:48.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.830+0000 7f3770bd0740 1 Processor -- start 2024-09-11T23:18:48.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.831+0000 7f3770bd0740 1 -- start start 2024-09-11T23:18:48.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.831+0000 7f3770bd0740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55dd5713a330 0x55dd57157760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:48.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.831+0000 7f3770bd0740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dd5713ac50 0x55dd57136ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:48.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.831+0000 7f3770bd0740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55dd57145510 0x55dd571371e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:48.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.831+0000 7f3770bd0740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55dd57155aa0 con 0x55dd5713ac50 2024-09-11T23:18:48.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.831+0000 7f3770bd0740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55dd57156170 con 0x55dd5713a330 2024-09-11T23:18:48.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.831+0000 7f3770bd0740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55dd57156840 con 0x55dd57145510 2024-09-11T23:18:48.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.831+0000 7f3766a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dd5713ac50 0x55dd57136ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:48.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.831+0000 7f3766a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dd5713ac50 0x55dd57136ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58944/0 (socket says 172.21.15.37:58944) 2024-09-11T23:18:48.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.831+0000 7f3766a00640 1 -- 172.21.15.37:0/239910102 learned_addr learned my addr 172.21.15.37:0/239910102 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:18:48.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.831+0000 7f3767e00640 1 --2- 172.21.15.37:0/239910102 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55dd5713a330 0x55dd57157760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:48.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.831+0000 7f3767e00640 1 --2- 172.21.15.37:0/239910102 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55dd57145510 0x55dd571371e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:48.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.832+0000 7f3766a00640 1 -- 172.21.15.37:0/239910102 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55dd57145510 msgr2=0x55dd571371e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:48.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.832+0000 7f3766a00640 1 --2- 172.21.15.37:0/239910102 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55dd57145510 0x55dd571371e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:48.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.832+0000 7f3766a00640 1 -- 172.21.15.37:0/239910102 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55dd5713a330 msgr2=0x55dd57157760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:48.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.832+0000 7f3766a00640 1 --2- 172.21.15.37:0/239910102 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55dd5713a330 0x55dd57157760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:48.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.832+0000 7f3766a00640 1 -- 172.21.15.37:0/239910102 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd5713a160 con 0x55dd5713ac50 2024-09-11T23:18:48.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.832+0000 7f3766a00640 1 --2- 172.21.15.37:0/239910102 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dd5713ac50 0x55dd57136ca0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f375400fb90 tx=0x7f375400fe80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f4e52eba1131dfc server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:48.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.832+0000 7f3753400640 1 -- 172.21.15.37:0/239910102 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3754009e60 con 0x55dd5713ac50 2024-09-11T23:18:48.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.832+0000 7f3753400640 1 -- 172.21.15.37:0/239910102 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f37540050b0 con 0x55dd5713ac50 2024-09-11T23:18:48.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.832+0000 7f3753400640 1 -- 172.21.15.37:0/239910102 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3754003970 con 0x55dd5713ac50 2024-09-11T23:18:48.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.833+0000 7f3770bd0740 1 -- 172.21.15.37:0/239910102 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dd5713ac50 msgr2=0x55dd57136ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:48.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.833+0000 7f3770bd0740 1 --2- 172.21.15.37:0/239910102 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dd5713ac50 0x55dd57136ca0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f375400fb90 tx=0x7f375400fe80 comp rx=0 tx=0).stop 2024-09-11T23:18:48.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.833+0000 7f3770bd0740 1 -- 172.21.15.37:0/239910102 shutdown_connections 2024-09-11T23:18:48.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.833+0000 7f3770bd0740 1 --2- 172.21.15.37:0/239910102 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55dd57145510 0x55dd571371e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:48.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.833+0000 7f3770bd0740 1 --2- 172.21.15.37:0/239910102 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dd5713ac50 0x55dd57136ca0 secure :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f375400fb90 tx=0x7f375400fe80 comp rx=0 tx=0).stop 2024-09-11T23:18:48.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.833+0000 7f3770bd0740 1 --2- 172.21.15.37:0/239910102 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55dd5713a330 0x55dd57157760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:48.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.833+0000 7f3770bd0740 1 -- 172.21.15.37:0/239910102 >> 172.21.15.37:0/239910102 conn(0x55dd571368c0 msgr2=0x55dd57131640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:48.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.833+0000 7f3770bd0740 1 -- 172.21.15.37:0/239910102 shutdown_connections 2024-09-11T23:18:48.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.833+0000 7f3770bd0740 1 -- 172.21.15.37:0/239910102 wait complete. 2024-09-11T23:18:48.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.834+0000 7f3770bd0740 1 -- start start 2024-09-11T23:18:48.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.834+0000 7f3770bd0740 1 Processor -- start 2024-09-11T23:18:48.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.834+0000 7f3770bd0740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55dd5713a330 0x55dd5713ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:48.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.834+0000 7f3770bd0740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55dd57145510 0x55dd5713f200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:48.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.834+0000 7f3770bd0740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dd5715ea20 0x55dd5715ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:48.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.834+0000 7f3770bd0740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55dd571575e0 con 0x55dd5715ea20 2024-09-11T23:18:48.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.834+0000 7f3770bd0740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55dd57156f10 con 0x55dd5713a330 2024-09-11T23:18:48.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.834+0000 7f3770bd0740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55dd57157cb0 con 0x55dd57145510 2024-09-11T23:18:48.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.834+0000 7f3770bd0740 10 client.0 _ll_register_callbacks cb 0x7f3754009cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:18:48.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.835+0000 7f3767e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55dd5713a330 0x55dd5713ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:48.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.835+0000 7f3767e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55dd5713a330 0x55dd5713ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.37:60956/0 (socket says 172.21.15.37:60956) 2024-09-11T23:18:48.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.835+0000 7f3767e00640 1 -- 172.21.15.37:0/780610443 learned_addr learned my addr 172.21.15.37:0/780610443 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:18:48.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.835+0000 7f3766a00640 1 --2- 172.21.15.37:0/780610443 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55dd57145510 0x55dd5713f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:48.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.835+0000 7f3767e00640 1 --2- 172.21.15.37:0/780610443 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dd5715ea20 0x55dd5715ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:48.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.835+0000 7f3767e00640 1 -- 172.21.15.37:0/780610443 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55dd57145510 msgr2=0x55dd5713f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:48.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.835+0000 7f3767e00640 1 --2- 172.21.15.37:0/780610443 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55dd57145510 0x55dd5713f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:48.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.835+0000 7f3767e00640 1 -- 172.21.15.37:0/780610443 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dd5715ea20 msgr2=0x55dd5715ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:48.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.835+0000 7f3767e00640 1 --2- 172.21.15.37:0/780610443 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dd5715ea20 0x55dd5715ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:48.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.835+0000 7f3767e00640 1 -- 172.21.15.37:0/780610443 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dd5715f3c0 con 0x55dd5713a330 2024-09-11T23:18:48.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.835+0000 7f3767e00640 1 --2- 172.21.15.37:0/780610443 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55dd5713a330 0x55dd5713ecc0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3760009ca0 tx=0x7f3760033000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3bfd1c55dcaaf3b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:48.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.835+0000 7f3750c00640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-11T23:18:48.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.836+0000 7f3750c00640 1 -- 172.21.15.37:0/780610443 <== mon.2 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3760031560 con 0x55dd5713a330 2024-09-11T23:18:48.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.836+0000 7f3770bd0740 1 -- 172.21.15.37:0/780610443 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f37540050b0 con 0x55dd5713a330 2024-09-11T23:18:48.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.836+0000 7f3750c00640 1 -- 172.21.15.37:0/780610443 <== mon.2 v2:172.21.15.123:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9295+0+0 (secure 0 0 0) 0x7f3760031700 con 0x55dd5713a330 2024-09-11T23:18:48.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.836+0000 7f3750c00640 1 -- 172.21.15.37:0/780610443 <== mon.2 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3760031900 con 0x55dd5713a330 2024-09-11T23:18:48.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.836+0000 7f3770bd0740 10 client.25166 fetch_fsmap learned FSMap version 28 2024-09-11T23:18:48.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.836+0000 7f3770bd0740 1 -- 172.21.15.37:0/780610443 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55dd571606c0 con 0x55dd5713a330 2024-09-11T23:18:48.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.836+0000 7f3750c00640 1 -- 172.21.15.37:0/780610443 <== mon.2 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f37540050b0 con 0x55dd5713a330 2024-09-11T23:18:48.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.836+0000 7f3750c00640 1 -- 172.21.15.37:0/780610443 <== mon.2 v2:172.21.15.123:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f3760051040 con 0x55dd5713a330 2024-09-11T23:18:48.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.836+0000 7f3770bd0740 10 client.25166 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T23:18:48.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.837+0000 7f3770bd0740 10 client.25166 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-11T23:18:48.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.837+0000 7f3770bd0740 20 client.25166 populate_metadata read hostname 'smithi037' 2024-09-11T23:18:48.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.837+0000 7f3770bd0740 1 --2- 172.21.15.37:0/780610443 >> [v2:172.21.15.160:6836/2906597021,v1:172.21.15.160:6837/2906597021] conn(0x55dd571c4e90 0x55dd571c3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:48.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.837+0000 7f3770bd0740 4 client.25166 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T23:18:48.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.837+0000 7f3770bd0740 1 -- 172.21.15.37:0/780610443 --> [v2:172.21.15.160:6836/2906597021,v1:172.21.15.160:6837/2906597021] -- command(tid 0: {"prefix": "status"}) -- 0x55dd570a7b30 con 0x55dd571c4e90 2024-09-11T23:18:48.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.837+0000 7f3766a00640 1 --2- 172.21.15.37:0/780610443 >> [v2:172.21.15.160:6836/2906597021,v1:172.21.15.160:6837/2906597021] conn(0x55dd571c4e90 0x55dd571c3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:48.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.838+0000 7f3766a00640 1 --2- 172.21.15.37:0/780610443 >> [v2:172.21.15.160:6836/2906597021,v1:172.21.15.160:6837/2906597021] conn(0x55dd571c4e90 0x55dd571c3ba0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=be33fd1015896890 server_cookie=d536fa6e440e5aa3 in_seq=0 out_seq=0 2024-09-11T23:18:48.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.838+0000 7f3750c00640 10 client.25166 ms_handle_connect on v2:172.21.15.160:6836/2906597021 2024-09-11T23:18:48.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.838+0000 7f3750c00640 1 -- 172.21.15.37:0/780610443 <== mds.2 v2:172.21.15.160:6836/2906597021 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x55dd570a7b30 con 0x55dd571c4e90 2024-09-11T23:18:48.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.838+0000 7f3750c00640 10 client.25166 handle_command_reply: tid=0 2024-09-11T23:18:48.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.838+0000 7f3770bd0740 1 client.25166 shutdown 2024-09-11T23:18:48.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.838+0000 7f3770bd0740 1 -- 172.21.15.37:0/780610443 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55dd5713a330 msgr2=0x55dd5713ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:48.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.838+0000 7f3770bd0740 1 --2- 172.21.15.37:0/780610443 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55dd5713a330 0x55dd5713ecc0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3760009ca0 tx=0x7f3760033000 comp rx=0 tx=0).stop 2024-09-11T23:18:48.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.838+0000 7f3770bd0740 1 -- 172.21.15.37:0/780610443 shutdown_connections 2024-09-11T23:18:48.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.838+0000 7f3770bd0740 1 --2- 172.21.15.37:0/780610443 >> [v2:172.21.15.160:6836/2906597021,v1:172.21.15.160:6837/2906597021] conn(0x55dd571c4e90 0x55dd571c3ba0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:48.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.838+0000 7f3770bd0740 1 --2- 172.21.15.37:0/780610443 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dd5715ea20 0x55dd5715ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:48.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.838+0000 7f3770bd0740 1 --2- 172.21.15.37:0/780610443 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55dd57145510 0x55dd5713f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:48.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.838+0000 7f3770bd0740 1 --2- 172.21.15.37:0/780610443 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55dd5713a330 0x55dd5713ecc0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:48.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.838+0000 7f3750c00640 0 client.25166 ms_handle_reset on v2:172.21.15.160:6836/2906597021 2024-09-11T23:18:48.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.838+0000 7f3770bd0740 1 -- 172.21.15.37:0/780610443 >> 172.21.15.37:0/780610443 conn(0x55dd571368c0 msgr2=0x55dd57136ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:48.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.838+0000 7f3770bd0740 1 -- 172.21.15.37:0/780610443 shutdown_connections 2024-09-11T23:18:48.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.838+0000 7f3770bd0740 1 -- 172.21.15.37:0/780610443 wait complete. 2024-09-11T23:18:48.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.838+0000 7f3770bd0740 20 client.25166 trim_cache size 0 max 16384 2024-09-11T23:18:48.843 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-11T23:18:48.843 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "8b03efce-7092-11ef-bcea-c7b262605968", 2024-09-11T23:18:48.843 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 2, 2024-09-11T23:18:48.843 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 24499, 2024-09-11T23:18:48.843 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2024-09-11T23:18:48.843 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2024-09-11T23:18:48.843 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2024-09-11T23:18:48.844 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 108.11720085, 2024-09-11T23:18:48.844 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 28, 2024-09-11T23:18:48.844 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 95, 2024-09-11T23:18:48.844 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 93, 2024-09-11T23:18:48.844 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 181.43020455600001 2024-09-11T23:18:48.844 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-11T23:18:48.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.839+0000 7f376e000640 1 -- 172.21.15.37:0/1174415808 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f374c0a2b80 msgr2=0x7f374c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:48.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.839+0000 7f376e000640 1 --2- 172.21.15.37:0/1174415808 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f374c0a2b80 0x7f374c0a5040 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f37580cd160 tx=0x7f37580d5550 comp rx=0 tx=0).stop 2024-09-11T23:18:48.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.839+0000 7f376e000640 1 -- 172.21.15.37:0/1174415808 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3768103ff0 msgr2=0x7f376819a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:48.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.839+0000 7f376e000640 1 --2- 172.21.15.37:0/1174415808 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3768103ff0 0x7f376819a620 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f375800ea60 tx=0x7f375800ef20 comp rx=0 tx=0).stop 2024-09-11T23:18:48.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.839+0000 7f376e000640 1 -- 172.21.15.37:0/1174415808 shutdown_connections 2024-09-11T23:18:48.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.839+0000 7f376e000640 1 --2- 172.21.15.37:0/1174415808 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f374c0a2b80 0x7f374c0a5040 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:48.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.839+0000 7f376e000640 1 --2- 172.21.15.37:0/1174415808 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37681049a0 0x7f376819ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:48.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.839+0000 7f376e000640 1 --2- 172.21.15.37:0/1174415808 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3768109120 0x7f376819eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:48.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.839+0000 7f376e000640 1 --2- 172.21.15.37:0/1174415808 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3768103ff0 0x7f376819a620 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:48.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.839+0000 7f376e000640 1 -- 172.21.15.37:0/1174415808 >> 172.21.15.37:0/1174415808 conn(0x7f37680ffa90 msgr2=0x7f3768101ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:48.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.839+0000 7f376e000640 1 -- 172.21.15.37:0/1174415808 shutdown_connections 2024-09-11T23:18:48.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:48.839+0000 7f376e000640 1 -- 172.21.15.37:0/1174415808 wait complete. 2024-09-11T23:18:49.524 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:18:49 smithi037 ceph-mon[30630]: pgmap v383: 129 pgs: 129 active+clean; 647 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-11T23:18:49.634 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph tell mds.i status 2024-09-11T23:18:49.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:18:49 smithi160 ceph-mon[35055]: pgmap v383: 129 pgs: 129 active+clean; 647 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-11T23:18:49.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:18:49 smithi123 ceph-mon[35438]: pgmap v383: 129 pgs: 129 active+clean; 647 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-11T23:18:50.014 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:18:50.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.573+0000 7f8462a00640 1 -- 172.21.15.37:0/4204830435 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f845c101de0 msgr2=0x7f845c1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:50.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.573+0000 7f8462a00640 1 --2- 172.21.15.37:0/4204830435 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f845c101de0 0x7f845c1021c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f844c009900 tx=0x7f844c02a3f0 comp rx=0 tx=0).stop 2024-09-11T23:18:50.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.573+0000 7f8462a00640 1 -- 172.21.15.37:0/4204830435 shutdown_connections 2024-09-11T23:18:50.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.573+0000 7f8462a00640 1 --2- 172.21.15.37:0/4204830435 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f845c106f10 0x7f845c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:50.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.573+0000 7f8462a00640 1 --2- 172.21.15.37:0/4204830435 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f845c102790 0x7f845c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:50.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.573+0000 7f8462a00640 1 --2- 172.21.15.37:0/4204830435 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f845c101de0 0x7f845c1021c0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:50.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.573+0000 7f8462a00640 1 -- 172.21.15.37:0/4204830435 >> 172.21.15.37:0/4204830435 conn(0x7f845c0fd8c0 msgr2=0x7f845c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:50.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.573+0000 7f8462a00640 1 -- 172.21.15.37:0/4204830435 shutdown_connections 2024-09-11T23:18:50.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.573+0000 7f8462a00640 1 -- 172.21.15.37:0/4204830435 wait complete. 2024-09-11T23:18:50.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.574+0000 7f8462a00640 1 Processor -- start 2024-09-11T23:18:50.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.574+0000 7f8462a00640 1 -- start start 2024-09-11T23:18:50.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.575+0000 7f8462a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f845c101de0 0x7f845c19a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:50.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.575+0000 7f8462a00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f845c102790 0x7f845c19ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:50.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.575+0000 7f8462a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f845c106f10 0x7f845c19ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:50.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.575+0000 7f8462a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f845c075320 con 0x7f845c106f10 2024-09-11T23:18:50.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.575+0000 7f8462a00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f845c0751a0 con 0x7f845c101de0 2024-09-11T23:18:50.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.575+0000 7f8462a00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f845c0754a0 con 0x7f845c102790 2024-09-11T23:18:50.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.575+0000 7f845be00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f845c101de0 0x7f845c19a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:50.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.575+0000 7f845be00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f845c101de0 0x7f845c19a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.37:58510/0 (socket says 172.21.15.37:58510) 2024-09-11T23:18:50.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.575+0000 7f845be00640 1 -- 172.21.15.37:0/744834850 learned_addr learned my addr 172.21.15.37:0/744834850 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:18:50.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.575+0000 7f8460a00640 1 --2- 172.21.15.37:0/744834850 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f845c106f10 0x7f845c19ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:50.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.575+0000 7f845b400640 1 --2- 172.21.15.37:0/744834850 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f845c102790 0x7f845c19ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:50.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.575+0000 7f845be00640 1 -- 172.21.15.37:0/744834850 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f845c102790 msgr2=0x7f845c19ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:50.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.575+0000 7f845be00640 1 --2- 172.21.15.37:0/744834850 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f845c102790 0x7f845c19ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:50.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.575+0000 7f845be00640 1 -- 172.21.15.37:0/744834850 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f845c106f10 msgr2=0x7f845c19ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:50.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.575+0000 7f845be00640 1 --2- 172.21.15.37:0/744834850 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f845c106f10 0x7f845c19ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:50.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.576+0000 7f845be00640 1 -- 172.21.15.37:0/744834850 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f845c19f5e0 con 0x7f845c101de0 2024-09-11T23:18:50.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.576+0000 7f845be00640 1 --2- 172.21.15.37:0/744834850 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f845c101de0 0x7f845c19a630 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f844c004770 tx=0x7f844c003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:50.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.576+0000 7f8458c00640 1 -- 172.21.15.37:0/744834850 <== mon.2 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f844c03f070 con 0x7f845c101de0 2024-09-11T23:18:50.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.576+0000 7f8462a00640 1 -- 172.21.15.37:0/744834850 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f845c19f870 con 0x7f845c101de0 2024-09-11T23:18:50.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.576+0000 7f8458c00640 1 -- 172.21.15.37:0/744834850 <== mon.2 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f844c031ca0 con 0x7f845c101de0 2024-09-11T23:18:50.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.576+0000 7f8458c00640 1 -- 172.21.15.37:0/744834850 <== mon.2 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f844c035030 con 0x7f845c101de0 2024-09-11T23:18:50.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.576+0000 7f8462a00640 1 -- 172.21.15.37:0/744834850 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f845c1a71b0 con 0x7f845c101de0 2024-09-11T23:18:50.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.579+0000 7f8465421740 1 Processor -- start 2024-09-11T23:18:50.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.579+0000 7f8458c00640 1 -- 172.21.15.37:0/744834850 <== mon.2 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f844c042070 con 0x7f845c101de0 2024-09-11T23:18:50.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.580+0000 7f8465421740 1 -- start start 2024-09-11T23:18:50.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.580+0000 7f8465421740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d5f5323330 0x55d5f5323710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:50.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.580+0000 7f8465421740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d5f5323c50 0x55d5f532dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:50.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.580+0000 7f8465421740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d5f532e510 0x55d5f5330900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:50.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.580+0000 7f8465421740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55d5f52890b0 con 0x55d5f5323c50 2024-09-11T23:18:50.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.580+0000 7f8465421740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55d5f5230ab0 con 0x55d5f5323330 2024-09-11T23:18:50.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.580+0000 7f8465421740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55d5f5285070 con 0x55d5f532e510 2024-09-11T23:18:50.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.580+0000 7f845be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d5f5323c50 0x55d5f532dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:50.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.580+0000 7f8460a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d5f5323330 0x55d5f5323710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:50.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.580+0000 7f8460a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d5f5323330 0x55d5f5323710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.37:58514/0 (socket says 172.21.15.37:58514) 2024-09-11T23:18:50.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.580+0000 7f8460a00640 1 -- 172.21.15.37:0/3391792306 learned_addr learned my addr 172.21.15.37:0/3391792306 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:18:50.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.580+0000 7f845b400640 1 --2- 172.21.15.37:0/3391792306 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d5f532e510 0x55d5f5330900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:50.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.581+0000 7f8460a00640 1 -- 172.21.15.37:0/3391792306 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d5f532e510 msgr2=0x55d5f5330900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:50.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.581+0000 7f8460a00640 1 --2- 172.21.15.37:0/3391792306 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d5f532e510 0x55d5f5330900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:50.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.581+0000 7f8460a00640 1 -- 172.21.15.37:0/3391792306 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d5f5323c50 msgr2=0x55d5f532dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:50.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.581+0000 7f8460a00640 1 --2- 172.21.15.37:0/3391792306 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d5f5323c50 0x55d5f532dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:50.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.581+0000 7f8460a00640 1 -- 172.21.15.37:0/3391792306 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5f523d4a0 con 0x55d5f5323330 2024-09-11T23:18:50.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.581+0000 7f8460a00640 1 --2- 172.21.15.37:0/3391792306 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d5f5323330 0x55d5f5323710 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f8454009f50 tx=0x7f84540118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=356138a52e17ca65 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:50.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.581+0000 7f8458c00640 1 --2- 172.21.15.37:0/744834850 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f84400a2b80 0x7f84400a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:50.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.581+0000 7f8458c00640 1 -- 172.21.15.37:0/744834850 <== mon.2 v2:172.21.15.123:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9295+0+0 (secure 0 0 0) 0x7f844c0efa40 con 0x7f845c101de0 2024-09-11T23:18:50.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.581+0000 7f8451200640 1 -- 172.21.15.37:0/3391792306 <== mon.2 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8454004d20 con 0x55d5f5323330 2024-09-11T23:18:50.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.581+0000 7f8451200640 1 -- 172.21.15.37:0/3391792306 <== mon.2 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8454004050 con 0x55d5f5323330 2024-09-11T23:18:50.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.582+0000 7f845be00640 1 --2- 172.21.15.37:0/744834850 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f84400a2b80 0x7f84400a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:50.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.582+0000 7f8451200640 1 -- 172.21.15.37:0/3391792306 <== mon.2 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8454005280 con 0x55d5f5323330 2024-09-11T23:18:50.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.582+0000 7f8465421740 1 -- 172.21.15.37:0/3391792306 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d5f5323330 msgr2=0x55d5f5323710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:50.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.582+0000 7f845be00640 1 --2- 172.21.15.37:0/744834850 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f84400a2b80 0x7f84400a5040 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f844c0ed490 tx=0x7f844c0f34c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:50.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.582+0000 7f8465421740 1 --2- 172.21.15.37:0/3391792306 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d5f5323330 0x55d5f5323710 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f8454009f50 tx=0x7f84540118d0 comp rx=0 tx=0).stop 2024-09-11T23:18:50.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.583+0000 7f8465421740 1 -- 172.21.15.37:0/3391792306 shutdown_connections 2024-09-11T23:18:50.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.583+0000 7f8465421740 1 --2- 172.21.15.37:0/3391792306 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d5f532e510 0x55d5f5330900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:50.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.583+0000 7f8465421740 1 --2- 172.21.15.37:0/3391792306 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d5f5323c50 0x55d5f532dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:50.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.583+0000 7f8465421740 1 --2- 172.21.15.37:0/3391792306 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d5f5323330 0x55d5f5323710 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:50.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.583+0000 7f8465421740 1 -- 172.21.15.37:0/3391792306 >> 172.21.15.37:0/3391792306 conn(0x55d5f531f8c0 msgr2=0x55d5f531fca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:50.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.583+0000 7f8465421740 1 -- 172.21.15.37:0/3391792306 shutdown_connections 2024-09-11T23:18:50.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.583+0000 7f8465421740 1 -- 172.21.15.37:0/3391792306 wait complete. 2024-09-11T23:18:50.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.583+0000 7f8465421740 1 -- start start 2024-09-11T23:18:50.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.583+0000 7f8465421740 1 Processor -- start 2024-09-11T23:18:50.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.584+0000 7f8465421740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d5f5323330 0x55d5f532b640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:50.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.584+0000 7f8465421740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d5f5323c50 0x55d5f532bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:50.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.584+0000 7f8465421740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d5f532e510 0x55d5f532c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:50.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.584+0000 7f8465421740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55d5f5331060 con 0x55d5f5323c50 2024-09-11T23:18:50.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.584+0000 7f8465421740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55d5f5211920 con 0x55d5f532e510 2024-09-11T23:18:50.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.584+0000 7f8465421740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55d5f53311e0 con 0x55d5f5323330 2024-09-11T23:18:50.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.584+0000 7f8465421740 10 client.0 _ll_register_callbacks cb 0x55d5f52358a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:18:50.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.584+0000 7f8460a00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d5f5323330 0x55d5f532b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:50.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.584+0000 7f8460a00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d5f5323330 0x55d5f532b640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.37:56348/0 (socket says 172.21.15.37:56348) 2024-09-11T23:18:50.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.584+0000 7f8460a00640 1 -- 172.21.15.37:0/367957242 learned_addr learned my addr 172.21.15.37:0/367957242 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:18:50.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.584+0000 7f845b400640 1 --2- 172.21.15.37:0/367957242 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d5f5323c50 0x55d5f532bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:50.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.584+0000 7f8460a00640 1 --2- 172.21.15.37:0/367957242 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d5f532e510 0x55d5f532c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:50.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.585+0000 7f845b400640 1 -- 172.21.15.37:0/367957242 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d5f5323330 msgr2=0x55d5f532b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:50.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.585+0000 7f845b400640 1 --2- 172.21.15.37:0/367957242 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d5f5323330 0x55d5f532b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:50.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.585+0000 7f845b400640 1 -- 172.21.15.37:0/367957242 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d5f532e510 msgr2=0x55d5f532c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:50.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.585+0000 7f845b400640 1 --2- 172.21.15.37:0/367957242 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d5f532e510 0x55d5f532c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:50.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.585+0000 7f845b400640 1 -- 172.21.15.37:0/367957242 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d5f4ffa2b0 con 0x55d5f5323c50 2024-09-11T23:18:50.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.585+0000 7f845b400640 1 --2- 172.21.15.37:0/367957242 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d5f5323c50 0x55d5f532bb80 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f845c106820 tx=0x7f8448012b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e2088405b22d1e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:50.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.585+0000 7f8445600640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-11T23:18:50.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.585+0000 7f8445600640 1 -- 172.21.15.37:0/367957242 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8448004020 con 0x55d5f5323c50 2024-09-11T23:18:50.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.585+0000 7f8465421740 1 -- 172.21.15.37:0/367957242 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8454004050 con 0x55d5f5323c50 2024-09-11T23:18:50.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.585+0000 7f8445600640 1 -- 172.21.15.37:0/367957242 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9295+0+0 (secure 0 0 0) 0x7f84480041c0 con 0x55d5f5323c50 2024-09-11T23:18:50.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.586+0000 7f8445600640 1 -- 172.21.15.37:0/367957242 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f8448025050 con 0x55d5f5323c50 2024-09-11T23:18:50.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.586+0000 7f8465421740 10 client.15168 fetch_fsmap learned FSMap version 28 2024-09-11T23:18:50.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.586+0000 7f8465421740 1 -- 172.21.15.37:0/367957242 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d5f5345700 con 0x55d5f5323c50 2024-09-11T23:18:50.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.586+0000 7f8445600640 1 -- 172.21.15.37:0/367957242 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8454004050 con 0x55d5f5323c50 2024-09-11T23:18:50.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.586+0000 7f8445600640 1 -- 172.21.15.37:0/367957242 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f8448003a60 con 0x55d5f5323c50 2024-09-11T23:18:50.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.586+0000 7f8465421740 10 client.15168 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T23:18:50.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.586+0000 7f8465421740 10 client.15168 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-11T23:18:50.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.586+0000 7f8465421740 20 client.15168 populate_metadata read hostname 'smithi037' 2024-09-11T23:18:50.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.586+0000 7f8465421740 1 --2- 172.21.15.37:0/367957242 >> [v2:172.21.15.160:6838/2041625862,v1:172.21.15.160:6839/2041625862] conn(0x55d5f5347d00 0x55d5f5349170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:50.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.586+0000 7f8465421740 4 client.15168 mds_command: new command op to 24520 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T23:18:50.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.586+0000 7f8465421740 1 -- 172.21.15.37:0/367957242 --> [v2:172.21.15.160:6838/2041625862,v1:172.21.15.160:6839/2041625862] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d5f5296620 con 0x55d5f5347d00 2024-09-11T23:18:50.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.587+0000 7f8460a00640 1 --2- 172.21.15.37:0/367957242 >> [v2:172.21.15.160:6838/2041625862,v1:172.21.15.160:6839/2041625862] conn(0x55d5f5347d00 0x55d5f5349170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:50.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.587+0000 7f8460a00640 1 --2- 172.21.15.37:0/367957242 >> [v2:172.21.15.160:6838/2041625862,v1:172.21.15.160:6839/2041625862] conn(0x55d5f5347d00 0x55d5f5349170 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ab26a165bdc45496 server_cookie=7c9a7893105c1d32 in_seq=0 out_seq=0 2024-09-11T23:18:50.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.587+0000 7f8445600640 10 client.15168 ms_handle_connect on v2:172.21.15.160:6838/2041625862 2024-09-11T23:18:50.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.588+0000 7f8445600640 1 -- 172.21.15.37:0/367957242 <== mds.1 v2:172.21.15.160:6838/2041625862 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d5f5296620 con 0x55d5f5347d00 2024-09-11T23:18:50.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.588+0000 7f8445600640 10 client.15168 handle_command_reply: tid=0 2024-09-11T23:18:50.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.588+0000 7f8465421740 1 client.15168 shutdown 2024-09-11T23:18:50.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.589+0000 7f8465421740 1 -- 172.21.15.37:0/367957242 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d5f5323c50 msgr2=0x55d5f532bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:50.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.589+0000 7f8465421740 1 --2- 172.21.15.37:0/367957242 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d5f5323c50 0x55d5f532bb80 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f845c106820 tx=0x7f8448012b60 comp rx=0 tx=0).stop 2024-09-11T23:18:50.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.589+0000 7f8465421740 1 -- 172.21.15.37:0/367957242 shutdown_connections 2024-09-11T23:18:50.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.589+0000 7f8465421740 1 --2- 172.21.15.37:0/367957242 >> [v2:172.21.15.160:6838/2041625862,v1:172.21.15.160:6839/2041625862] conn(0x55d5f5347d00 0x55d5f5349170 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:50.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.589+0000 7f8465421740 1 --2- 172.21.15.37:0/367957242 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d5f532e510 0x55d5f532c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:50.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.589+0000 7f8465421740 1 --2- 172.21.15.37:0/367957242 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d5f5323c50 0x55d5f532bb80 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:50.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.589+0000 7f8465421740 1 --2- 172.21.15.37:0/367957242 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d5f5323330 0x55d5f532b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:50.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.589+0000 7f8445600640 0 client.15168 ms_handle_reset on v2:172.21.15.160:6838/2041625862 2024-09-11T23:18:50.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.589+0000 7f8465421740 1 -- 172.21.15.37:0/367957242 >> 172.21.15.37:0/367957242 conn(0x55d5f531f8c0 msgr2=0x55d5f53255f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:50.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.589+0000 7f8465421740 1 -- 172.21.15.37:0/367957242 shutdown_connections 2024-09-11T23:18:50.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.589+0000 7f8465421740 1 -- 172.21.15.37:0/367957242 wait complete. 2024-09-11T23:18:50.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.589+0000 7f8465421740 20 client.15168 trim_cache size 0 max 16384 2024-09-11T23:18:50.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.607+0000 7f8465421740 1 Processor -- start 2024-09-11T23:18:50.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.608+0000 7f8465421740 1 -- start start 2024-09-11T23:18:50.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.608+0000 7f8465421740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d5f5323330 0x55d5f532a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:50.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.608+0000 7f8465421740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d5f5323c50 0x55d5f532bf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:50.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.608+0000 7f8465421740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d5f532e510 0x55d5f5328900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:50.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.608+0000 7f8465421740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55d5f53474b0 con 0x55d5f532e510 2024-09-11T23:18:50.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.608+0000 7f8465421740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55d5f5347b80 con 0x55d5f5323330 2024-09-11T23:18:50.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.608+0000 7f8465421740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55d5f5348250 con 0x55d5f5323c50 2024-09-11T23:18:50.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.608+0000 7f8460a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d5f5323330 0x55d5f532a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:50.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.608+0000 7f845b400640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d5f5323c50 0x55d5f532bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:50.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.608+0000 7f8460a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d5f5323330 0x55d5f532a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.37:58540/0 (socket says 172.21.15.37:58540) 2024-09-11T23:18:50.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.608+0000 7f8460a00640 1 -- 172.21.15.37:0/3521444744 learned_addr learned my addr 172.21.15.37:0/3521444744 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:18:50.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.608+0000 7f8460a00640 1 --2- 172.21.15.37:0/3521444744 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d5f532e510 0x55d5f5328900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:50.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.609+0000 7f845b400640 1 -- 172.21.15.37:0/3521444744 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d5f5323330 msgr2=0x55d5f532a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:50.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.609+0000 7f845b400640 1 --2- 172.21.15.37:0/3521444744 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d5f5323330 0x55d5f532a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:50.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.609+0000 7f845b400640 1 -- 172.21.15.37:0/3521444744 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d5f532e510 msgr2=0x55d5f5328900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:50.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.609+0000 7f845b400640 1 --2- 172.21.15.37:0/3521444744 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d5f532e510 0x55d5f5328900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:50.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.609+0000 7f845b400640 1 -- 172.21.15.37:0/3521444744 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5f5330c70 con 0x55d5f5323c50 2024-09-11T23:18:50.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.609+0000 7f8460a00640 1 --2- 172.21.15.37:0/3521444744 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d5f5323330 0x55d5f532a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:18:50.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.609+0000 7f845b400640 1 --2- 172.21.15.37:0/3521444744 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d5f5323c50 0x55d5f532bf10 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8448000c00 tx=0x7f8448009fb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fbcf6edc6fb4b5ab server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:50.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.609+0000 7f8447e00640 1 -- 172.21.15.37:0/3521444744 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f844801c530 con 0x55d5f5323c50 2024-09-11T23:18:50.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.609+0000 7f8447e00640 1 -- 172.21.15.37:0/3521444744 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f844801cdf0 con 0x55d5f5323c50 2024-09-11T23:18:50.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.609+0000 7f8447e00640 1 -- 172.21.15.37:0/3521444744 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84480035f0 con 0x55d5f5323c50 2024-09-11T23:18:50.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.610+0000 7f8465421740 1 -- 172.21.15.37:0/3521444744 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d5f5323c50 msgr2=0x55d5f532bf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:50.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.610+0000 7f8465421740 1 --2- 172.21.15.37:0/3521444744 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d5f5323c50 0x55d5f532bf10 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8448000c00 tx=0x7f8448009fb0 comp rx=0 tx=0).stop 2024-09-11T23:18:50.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.610+0000 7f8465421740 1 -- 172.21.15.37:0/3521444744 shutdown_connections 2024-09-11T23:18:50.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.610+0000 7f8465421740 1 --2- 172.21.15.37:0/3521444744 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d5f532e510 0x55d5f5328900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:50.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.610+0000 7f8465421740 1 --2- 172.21.15.37:0/3521444744 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d5f5323c50 0x55d5f532bf10 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:50.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.610+0000 7f8465421740 1 --2- 172.21.15.37:0/3521444744 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d5f5323330 0x55d5f532a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:50.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.610+0000 7f8465421740 1 -- 172.21.15.37:0/3521444744 >> 172.21.15.37:0/3521444744 conn(0x55d5f531f8c0 msgr2=0x55d5f5329f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:50.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.610+0000 7f8465421740 1 -- 172.21.15.37:0/3521444744 shutdown_connections 2024-09-11T23:18:50.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.610+0000 7f8465421740 1 -- 172.21.15.37:0/3521444744 wait complete. 2024-09-11T23:18:50.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.611+0000 7f8465421740 1 -- start start 2024-09-11T23:18:50.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.611+0000 7f8465421740 1 Processor -- start 2024-09-11T23:18:50.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.611+0000 7f8465421740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d5f5323330 0x55d5f5328790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:50.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.611+0000 7f8465421740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d5f5323c50 0x55d5f5328cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:50.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.611+0000 7f8465421740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d5f532e510 0x55d5f5329210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:50.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.611+0000 7f8465421740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55d5f5348ff0 con 0x55d5f5323c50 2024-09-11T23:18:50.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.611+0000 7f8465421740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55d5f5348920 con 0x55d5f532e510 2024-09-11T23:18:50.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.611+0000 7f8465421740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55d5f53496c0 con 0x55d5f5323330 2024-09-11T23:18:50.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.611+0000 7f8465421740 10 client.0 _ll_register_callbacks cb 0x7f8448009e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:18:50.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.612+0000 7f845b400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d5f5323c50 0x55d5f5328cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:50.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.612+0000 7f8460a00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d5f5323330 0x55d5f5328790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:50.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.612+0000 7f845b400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d5f5323c50 0x55d5f5328cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35822/0 (socket says 172.21.15.37:35822) 2024-09-11T23:18:50.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.612+0000 7f845b400640 1 -- 172.21.15.37:0/2346961364 learned_addr learned my addr 172.21.15.37:0/2346961364 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:18:50.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.612+0000 7f8460a00640 1 --2- 172.21.15.37:0/2346961364 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d5f532e510 0x55d5f5329210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:50.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.612+0000 7f845b400640 1 -- 172.21.15.37:0/2346961364 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d5f5323330 msgr2=0x55d5f5328790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:50.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.612+0000 7f845b400640 1 --2- 172.21.15.37:0/2346961364 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d5f5323330 0x55d5f5328790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:50.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.612+0000 7f845b400640 1 -- 172.21.15.37:0/2346961364 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d5f532e510 msgr2=0x55d5f5329210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:50.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.612+0000 7f845b400640 1 --2- 172.21.15.37:0/2346961364 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d5f532e510 0x55d5f5329210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:50.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.612+0000 7f845b400640 1 -- 172.21.15.37:0/2346961364 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d5f534fa90 con 0x55d5f5323c50 2024-09-11T23:18:50.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.612+0000 7f845b400640 1 --2- 172.21.15.37:0/2346961364 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d5f5323c50 0x55d5f5328cd0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f84480092e0 tx=0x7f844800fb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29d1e980812aeed7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:50.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.612+0000 7f8445600640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-11T23:18:50.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.613+0000 7f8445600640 1 -- 172.21.15.37:0/2346961364 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8448003800 con 0x55d5f5323c50 2024-09-11T23:18:50.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.613+0000 7f8445600640 1 -- 172.21.15.37:0/2346961364 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9295+0+0 (secure 0 0 0) 0x7f84480039a0 con 0x55d5f5323c50 2024-09-11T23:18:50.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.613+0000 7f8465421740 1 -- 172.21.15.37:0/2346961364 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f844801cdf0 con 0x55d5f5323c50 2024-09-11T23:18:50.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.613+0000 7f8445600640 1 -- 172.21.15.37:0/2346961364 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f844803f050 con 0x55d5f5323c50 2024-09-11T23:18:50.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.613+0000 7f8465421740 10 client.15174 fetch_fsmap learned FSMap version 28 2024-09-11T23:18:50.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.613+0000 7f8465421740 1 -- 172.21.15.37:0/2346961364 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d5f53b2790 con 0x55d5f5323c50 2024-09-11T23:18:50.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.613+0000 7f8445600640 1 -- 172.21.15.37:0/2346961364 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f844801cdf0 con 0x55d5f5323c50 2024-09-11T23:18:50.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.613+0000 7f8445600640 1 -- 172.21.15.37:0/2346961364 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f844803a030 con 0x55d5f5323c50 2024-09-11T23:18:50.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.614+0000 7f8465421740 10 client.15174 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T23:18:50.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.614+0000 7f8465421740 10 client.15174 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-11T23:18:50.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.614+0000 7f8465421740 20 client.15174 populate_metadata read hostname 'smithi037' 2024-09-11T23:18:50.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.614+0000 7f8465421740 1 --2- 172.21.15.37:0/2346961364 >> [v2:172.21.15.160:6838/2041625862,v1:172.21.15.160:6839/2041625862] conn(0x55d5f53b4870 0x55d5f53b5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:50.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.614+0000 7f8465421740 4 client.15174 mds_command: new command op to 24520 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T23:18:50.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.614+0000 7f8465421740 1 -- 172.21.15.37:0/2346961364 --> [v2:172.21.15.160:6838/2041625862,v1:172.21.15.160:6839/2041625862] -- command(tid 0: {"prefix": "status"}) -- 0x55d5f5290b30 con 0x55d5f53b4870 2024-09-11T23:18:50.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.614+0000 7f8460a00640 1 --2- 172.21.15.37:0/2346961364 >> [v2:172.21.15.160:6838/2041625862,v1:172.21.15.160:6839/2041625862] conn(0x55d5f53b4870 0x55d5f53b5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:50.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.615+0000 7f8460a00640 1 --2- 172.21.15.37:0/2346961364 >> [v2:172.21.15.160:6838/2041625862,v1:172.21.15.160:6839/2041625862] conn(0x55d5f53b4870 0x55d5f53b5ce0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b25421cd19a0705e server_cookie=3955a6b0e70f8046 in_seq=0 out_seq=0 2024-09-11T23:18:50.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.615+0000 7f8445600640 10 client.15174 ms_handle_connect on v2:172.21.15.160:6838/2041625862 2024-09-11T23:18:50.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.615+0000 7f8445600640 1 -- 172.21.15.37:0/2346961364 <== mds.1 v2:172.21.15.160:6838/2041625862 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x55d5f5290b30 con 0x55d5f53b4870 2024-09-11T23:18:50.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.615+0000 7f8445600640 10 client.15174 handle_command_reply: tid=0 2024-09-11T23:18:50.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.615+0000 7f8465421740 1 client.15174 shutdown 2024-09-11T23:18:50.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.615+0000 7f8465421740 1 -- 172.21.15.37:0/2346961364 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d5f5323c50 msgr2=0x55d5f5328cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:50.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.615+0000 7f8465421740 1 --2- 172.21.15.37:0/2346961364 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d5f5323c50 0x55d5f5328cd0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f84480092e0 tx=0x7f844800fb30 comp rx=0 tx=0).stop 2024-09-11T23:18:50.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.615+0000 7f8465421740 1 -- 172.21.15.37:0/2346961364 shutdown_connections 2024-09-11T23:18:50.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.615+0000 7f8465421740 1 --2- 172.21.15.37:0/2346961364 >> [v2:172.21.15.160:6838/2041625862,v1:172.21.15.160:6839/2041625862] conn(0x55d5f53b4870 0x55d5f53b5ce0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:50.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.615+0000 7f8465421740 1 --2- 172.21.15.37:0/2346961364 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d5f532e510 0x55d5f5329210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:50.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.615+0000 7f8465421740 1 --2- 172.21.15.37:0/2346961364 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d5f5323c50 0x55d5f5328cd0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:50.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.615+0000 7f8465421740 1 --2- 172.21.15.37:0/2346961364 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d5f5323330 0x55d5f5328790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:50.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.615+0000 7f8465421740 1 -- 172.21.15.37:0/2346961364 >> 172.21.15.37:0/2346961364 conn(0x55d5f531f8c0 msgr2=0x55d5f532a770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:50.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.615+0000 7f8445600640 0 client.15174 ms_handle_reset on v2:172.21.15.160:6838/2041625862 2024-09-11T23:18:50.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.615+0000 7f8465421740 1 -- 172.21.15.37:0/2346961364 shutdown_connections 2024-09-11T23:18:50.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.615+0000 7f8465421740 1 -- 172.21.15.37:0/2346961364 wait complete. 2024-09-11T23:18:50.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.616+0000 7f8465421740 20 client.15174 trim_cache size 0 max 16384 2024-09-11T23:18:50.620 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-11T23:18:50.621 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "8b03efce-7092-11ef-bcea-c7b262605968", 2024-09-11T23:18:50.621 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 1, 2024-09-11T23:18:50.621 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 24520, 2024-09-11T23:18:50.621 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2024-09-11T23:18:50.621 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2024-09-11T23:18:50.621 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2024-09-11T23:18:50.621 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 110.906062527, 2024-09-11T23:18:50.621 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 28, 2024-09-11T23:18:50.621 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 95, 2024-09-11T23:18:50.621 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 93, 2024-09-11T23:18:50.621 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 177.809041339 2024-09-11T23:18:50.621 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-11T23:18:50.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.616+0000 7f8462a00640 1 -- 172.21.15.37:0/744834850 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f84400a2b80 msgr2=0x7f84400a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:50.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.616+0000 7f8462a00640 1 --2- 172.21.15.37:0/744834850 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f84400a2b80 0x7f84400a5040 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f844c0ed490 tx=0x7f844c0f34c0 comp rx=0 tx=0).stop 2024-09-11T23:18:50.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.616+0000 7f8462a00640 1 -- 172.21.15.37:0/744834850 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f845c101de0 msgr2=0x7f845c19a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:50.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.616+0000 7f8462a00640 1 --2- 172.21.15.37:0/744834850 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f845c101de0 0x7f845c19a630 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f844c004770 tx=0x7f844c003c10 comp rx=0 tx=0).stop 2024-09-11T23:18:50.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.616+0000 7f8462a00640 1 -- 172.21.15.37:0/744834850 shutdown_connections 2024-09-11T23:18:50.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.616+0000 7f8462a00640 1 --2- 172.21.15.37:0/744834850 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f84400a2b80 0x7f84400a5040 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:50.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.616+0000 7f8462a00640 1 --2- 172.21.15.37:0/744834850 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f845c106f10 0x7f845c19ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:50.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.616+0000 7f8462a00640 1 --2- 172.21.15.37:0/744834850 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f845c102790 0x7f845c19ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:50.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.616+0000 7f8462a00640 1 --2- 172.21.15.37:0/744834850 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f845c101de0 0x7f845c19a630 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:50.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.616+0000 7f8462a00640 1 -- 172.21.15.37:0/744834850 >> 172.21.15.37:0/744834850 conn(0x7f845c0fd8c0 msgr2=0x7f845c0fe370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:50.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.617+0000 7f8462a00640 1 -- 172.21.15.37:0/744834850 shutdown_connections 2024-09-11T23:18:50.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:50.617+0000 7f8462a00640 1 -- 172.21.15.37:0/744834850 wait complete. 2024-09-11T23:18:51.446 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph tell mds.b status 2024-09-11T23:18:51.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:18:51 smithi160 ceph-mon[35055]: pgmap v384: 129 pgs: 129 active+clean; 647 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2024-09-11T23:18:51.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:18:51 smithi123 ceph-mon[35438]: pgmap v384: 129 pgs: 129 active+clean; 647 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2024-09-11T23:18:51.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:18:51 smithi037 ceph-mon[30630]: pgmap v384: 129 pgs: 129 active+clean; 647 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2024-09-11T23:18:51.825 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:18:52.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.415+0000 7f5e22600640 1 -- 172.21.15.37:0/1308396413 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e1c1047e0 msgr2=0x7f5e1c108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:52.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.415+0000 7f5e22600640 1 --2- 172.21.15.37:0/1308396413 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e1c1047e0 0x7f5e1c108830 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f5e04009900 tx=0x7f5e0402a410 comp rx=0 tx=0).stop 2024-09-11T23:18:52.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.415+0000 7f5e22600640 1 -- 172.21.15.37:0/1308396413 shutdown_connections 2024-09-11T23:18:52.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.415+0000 7f5e22600640 1 --2- 172.21.15.37:0/1308396413 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5e1c108f60 0x7f5e1c110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:52.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.415+0000 7f5e22600640 1 --2- 172.21.15.37:0/1308396413 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e1c1047e0 0x7f5e1c108830 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:52.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.415+0000 7f5e22600640 1 --2- 172.21.15.37:0/1308396413 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5e1c103e30 0x7f5e1c104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:52.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.415+0000 7f5e22600640 1 -- 172.21.15.37:0/1308396413 >> 172.21.15.37:0/1308396413 conn(0x7f5e1c0ff8d0 msgr2=0x7f5e1c101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:52.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.416+0000 7f5e22600640 1 -- 172.21.15.37:0/1308396413 shutdown_connections 2024-09-11T23:18:52.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.416+0000 7f5e22600640 1 -- 172.21.15.37:0/1308396413 wait complete. 2024-09-11T23:18:52.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.417+0000 7f5e22600640 1 Processor -- start 2024-09-11T23:18:52.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.417+0000 7f5e22600640 1 -- start start 2024-09-11T23:18:52.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.417+0000 7f5e22600640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5e1c103e30 0x7f5e1c19a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:52.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.417+0000 7f5e22600640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5e1c1047e0 0x7f5e1c19aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:52.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.417+0000 7f5e22600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e1c108f60 0x7f5e1c19eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:52.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.417+0000 7f5e22600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5e1c114010 con 0x7f5e1c108f60 2024-09-11T23:18:52.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.417+0000 7f5e22600640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f5e1c113e90 con 0x7f5e1c103e30 2024-09-11T23:18:52.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.417+0000 7f5e22600640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f5e1c114190 con 0x7f5e1c1047e0 2024-09-11T23:18:52.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.417+0000 7f5e21c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e1c108f60 0x7f5e1c19eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:52.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.417+0000 7f5e21c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e1c108f60 0x7f5e1c19eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35840/0 (socket says 172.21.15.37:35840) 2024-09-11T23:18:52.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.418+0000 7f5e21c00640 1 -- 172.21.15.37:0/3586424030 learned_addr learned my addr 172.21.15.37:0/3586424030 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:18:52.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.418+0000 7f5e21200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5e1c103e30 0x7f5e1c19a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:52.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.418+0000 7f5e13e00640 1 --2- 172.21.15.37:0/3586424030 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5e1c1047e0 0x7f5e1c19aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:52.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.418+0000 7f5e21c00640 1 -- 172.21.15.37:0/3586424030 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5e1c1047e0 msgr2=0x7f5e1c19aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:52.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.418+0000 7f5e21c00640 1 --2- 172.21.15.37:0/3586424030 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5e1c1047e0 0x7f5e1c19aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:52.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.418+0000 7f5e21c00640 1 -- 172.21.15.37:0/3586424030 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5e1c103e30 msgr2=0x7f5e1c19a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:52.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.418+0000 7f5e21c00640 1 --2- 172.21.15.37:0/3586424030 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5e1c103e30 0x7f5e1c19a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:52.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.418+0000 7f5e21c00640 1 -- 172.21.15.37:0/3586424030 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e1c19f480 con 0x7f5e1c108f60 2024-09-11T23:18:52.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.418+0000 7f5e21c00640 1 --2- 172.21.15.37:0/3586424030 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e1c108f60 0x7f5e1c19eda0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f5e1400eb10 tx=0x7f5e1400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:52.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.418+0000 7f5e1a000640 1 -- 172.21.15.37:0/3586424030 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e14004b20 con 0x7f5e1c108f60 2024-09-11T23:18:52.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.419+0000 7f5e1a000640 1 -- 172.21.15.37:0/3586424030 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5e14004cc0 con 0x7f5e1c108f60 2024-09-11T23:18:52.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.419+0000 7f5e1a000640 1 -- 172.21.15.37:0/3586424030 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e14010760 con 0x7f5e1c108f60 2024-09-11T23:18:52.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.419+0000 7f5e22600640 1 -- 172.21.15.37:0/3586424030 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e1c19f770 con 0x7f5e1c108f60 2024-09-11T23:18:52.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.419+0000 7f5e22600640 1 -- 172.21.15.37:0/3586424030 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e1c1a7050 con 0x7f5e1c108f60 2024-09-11T23:18:52.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.422+0000 7f5e2663c740 1 Processor -- start 2024-09-11T23:18:52.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.422+0000 7f5e1a000640 1 -- 172.21.15.37:0/3586424030 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f5e14005020 con 0x7f5e1c108f60 2024-09-11T23:18:52.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.422+0000 7f5e2663c740 1 -- start start 2024-09-11T23:18:52.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.422+0000 7f5e2663c740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f8528534e0 0x55f8528538c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:52.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.422+0000 7f5e2663c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f852853e00 0x55f85285e180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:52.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.422+0000 7f5e2663c740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f85285e6c0 0x55f852860ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:52.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.422+0000 7f5e2663c740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55f8527b90b0 con 0x55f852853e00 2024-09-11T23:18:52.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.422+0000 7f5e2663c740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55f852760ab0 con 0x55f85285e6c0 2024-09-11T23:18:52.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.422+0000 7f5e2663c740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55f8527b5070 con 0x55f8528534e0 2024-09-11T23:18:52.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.423+0000 7f5e21200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f852853e00 0x55f85285e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:52.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.423+0000 7f5e21200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f852853e00 0x55f85285e180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35844/0 (socket says 172.21.15.37:35844) 2024-09-11T23:18:52.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.423+0000 7f5e21200640 1 -- 172.21.15.37:0/3693009019 learned_addr learned my addr 172.21.15.37:0/3693009019 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:18:52.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.423+0000 7f5e13e00640 1 --2- 172.21.15.37:0/3693009019 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f8528534e0 0x55f8528538c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:52.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.423+0000 7f5e13e00640 1 --2- 172.21.15.37:0/3693009019 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f85285e6c0 0x55f852860ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:52.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.423+0000 7f5e21200640 1 -- 172.21.15.37:0/3693009019 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f8528534e0 msgr2=0x55f8528538c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:52.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.423+0000 7f5e21200640 1 --2- 172.21.15.37:0/3693009019 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f8528534e0 0x55f8528538c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:52.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.423+0000 7f5e21200640 1 -- 172.21.15.37:0/3693009019 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f85285e6c0 msgr2=0x55f852860ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:52.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.423+0000 7f5e21200640 1 --2- 172.21.15.37:0/3693009019 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f85285e6c0 0x55f852860ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:52.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.423+0000 7f5e21200640 1 -- 172.21.15.37:0/3693009019 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f85276d4a0 con 0x55f852853e00 2024-09-11T23:18:52.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.423+0000 7f5e13e00640 1 --2- 172.21.15.37:0/3693009019 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f85285e6c0 0x55f852860ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:18:52.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.423+0000 7f5e1a000640 1 --2- 172.21.15.37:0/3586424030 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f5e000a2c00 0x7f5e000a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:52.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.423+0000 7f5e21200640 1 --2- 172.21.15.37:0/3693009019 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f852853e00 0x55f85285e180 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f5e0c009d20 tx=0x7f5e0c011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2dbb9de63a3fe98 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:52.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.424+0000 7f5e1a000640 1 -- 172.21.15.37:0/3586424030 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9295+0+0 (secure 0 0 0) 0x7f5e140cf950 con 0x7f5e1c108f60 2024-09-11T23:18:52.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.424+0000 7f5e12000640 1 -- 172.21.15.37:0/3693009019 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e0c01e070 con 0x55f852853e00 2024-09-11T23:18:52.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.424+0000 7f5e13e00640 1 --2- 172.21.15.37:0/3586424030 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f5e000a2c00 0x7f5e000a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:52.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.424+0000 7f5e12000640 1 -- 172.21.15.37:0/3693009019 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5e0c019b10 con 0x55f852853e00 2024-09-11T23:18:52.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.424+0000 7f5e12000640 1 -- 172.21.15.37:0/3693009019 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e0c00eb40 con 0x55f852853e00 2024-09-11T23:18:52.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.425+0000 7f5e2663c740 1 -- 172.21.15.37:0/3693009019 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f852853e00 msgr2=0x55f85285e180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:52.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.425+0000 7f5e13e00640 1 --2- 172.21.15.37:0/3586424030 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f5e000a2c00 0x7f5e000a50c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f5e04000c00 tx=0x7f5e04009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:52.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.425+0000 7f5e2663c740 1 --2- 172.21.15.37:0/3693009019 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f852853e00 0x55f85285e180 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f5e0c009d20 tx=0x7f5e0c011810 comp rx=0 tx=0).stop 2024-09-11T23:18:52.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.425+0000 7f5e2663c740 1 -- 172.21.15.37:0/3693009019 shutdown_connections 2024-09-11T23:18:52.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.425+0000 7f5e2663c740 1 --2- 172.21.15.37:0/3693009019 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f85285e6c0 0x55f852860ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:52.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.425+0000 7f5e2663c740 1 --2- 172.21.15.37:0/3693009019 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f852853e00 0x55f85285e180 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:52.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.425+0000 7f5e2663c740 1 --2- 172.21.15.37:0/3693009019 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f8528534e0 0x55f8528538c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:52.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.425+0000 7f5e2663c740 1 -- 172.21.15.37:0/3693009019 >> 172.21.15.37:0/3693009019 conn(0x55f85284fa70 msgr2=0x55f85284fe50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:52.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.425+0000 7f5e2663c740 1 -- 172.21.15.37:0/3693009019 shutdown_connections 2024-09-11T23:18:52.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.425+0000 7f5e2663c740 1 -- 172.21.15.37:0/3693009019 wait complete. 2024-09-11T23:18:52.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.425+0000 7f5e2663c740 1 -- start start 2024-09-11T23:18:52.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.425+0000 7f5e2663c740 1 Processor -- start 2024-09-11T23:18:52.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.426+0000 7f5e2663c740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f8528534e0 0x55f85285b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:52.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.426+0000 7f5e2663c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f852853e00 0x55f85285ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:52.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.426+0000 7f5e2663c740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f85285e6c0 0x55f85285bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:52.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.426+0000 7f5e2663c740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55f852861330 con 0x55f852853e00 2024-09-11T23:18:52.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.426+0000 7f5e2663c740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55f852741920 con 0x55f85285e6c0 2024-09-11T23:18:52.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.426+0000 7f5e2663c740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55f8528614b0 con 0x55f8528534e0 2024-09-11T23:18:52.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.426+0000 7f5e2663c740 10 client.0 _ll_register_callbacks cb 0x55f8527658a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:18:52.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.426+0000 7f5e13e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f852853e00 0x55f85285ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:52.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.426+0000 7f5e21200640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f8528534e0 0x55f85285b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:52.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.426+0000 7f5e21200640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f8528534e0 0x55f85285b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.37:56422/0 (socket says 172.21.15.37:56422) 2024-09-11T23:18:52.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.426+0000 7f5e21200640 1 -- 172.21.15.37:0/3014729072 learned_addr learned my addr 172.21.15.37:0/3014729072 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:18:52.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.426+0000 7f5e13e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f852853e00 0x55f85285ba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35850/0 (socket says 172.21.15.37:35850) 2024-09-11T23:18:52.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.426+0000 7f5e21c00640 1 --2- 172.21.15.37:0/3014729072 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f85285e6c0 0x55f85285bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:52.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.427+0000 7f5e21200640 1 -- 172.21.15.37:0/3014729072 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f85285e6c0 msgr2=0x55f85285bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:52.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.427+0000 7f5e21200640 1 --2- 172.21.15.37:0/3014729072 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f85285e6c0 0x55f85285bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:52.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.427+0000 7f5e21200640 1 -- 172.21.15.37:0/3014729072 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f852853e00 msgr2=0x55f85285ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:52.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.427+0000 7f5e21200640 1 --2- 172.21.15.37:0/3014729072 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f852853e00 0x55f85285ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:52.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.427+0000 7f5e21200640 1 -- 172.21.15.37:0/3014729072 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f85252a2b0 con 0x55f8528534e0 2024-09-11T23:18:52.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.427+0000 7f5e21200640 1 --2- 172.21.15.37:0/3014729072 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f8528534e0 0x55f85285b550 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5e0c019660 tx=0x7f5e0c019690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4375501807e6babb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:52.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.427+0000 7f5e0aa00640 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2024-09-11T23:18:52.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.427+0000 7f5e0aa00640 1 -- 172.21.15.37:0/3014729072 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e0c027020 con 0x55f8528534e0 2024-09-11T23:18:52.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.428+0000 7f5e2663c740 1 -- 172.21.15.37:0/3014729072 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5e0c019b10 con 0x55f8528534e0 2024-09-11T23:18:52.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.428+0000 7f5e0aa00640 1 -- 172.21.15.37:0/3014729072 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9295+0+0 (secure 0 0 0) 0x7f5e0c005250 con 0x55f8528534e0 2024-09-11T23:18:52.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.428+0000 7f5e0aa00640 1 -- 172.21.15.37:0/3014729072 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5e0c032050 con 0x55f8528534e0 2024-09-11T23:18:52.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.428+0000 7f5e2663c740 10 client.25198 fetch_fsmap learned FSMap version 28 2024-09-11T23:18:52.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.428+0000 7f5e2663c740 1 -- 172.21.15.37:0/3014729072 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f85286cfd0 con 0x55f8528534e0 2024-09-11T23:18:52.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.428+0000 7f5e0aa00640 1 -- 172.21.15.37:0/3014729072 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5e0c019b10 con 0x55f8528534e0 2024-09-11T23:18:52.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.429+0000 7f5e0aa00640 1 -- 172.21.15.37:0/3014729072 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f5e0c0046c0 con 0x55f8528534e0 2024-09-11T23:18:52.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.429+0000 7f5e2663c740 10 client.25198 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T23:18:52.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.429+0000 7f5e2663c740 10 client.25198 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-11T23:18:52.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.429+0000 7f5e2663c740 20 client.25198 populate_metadata read hostname 'smithi037' 2024-09-11T23:18:52.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.429+0000 7f5e2663c740 1 --2- 172.21.15.37:0/3014729072 >> [v2:172.21.15.123:6838/3077076065,v1:172.21.15.123:6839/3077076065] conn(0x55f85286f3e0 0x55f852870850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:52.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.429+0000 7f5e2663c740 4 client.25198 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T23:18:52.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.429+0000 7f5e2663c740 1 -- 172.21.15.37:0/3014729072 --> [v2:172.21.15.123:6838/3077076065,v1:172.21.15.123:6839/3077076065] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f8527c6620 con 0x55f85286f3e0 2024-09-11T23:18:52.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.429+0000 7f5e13e00640 1 --2- 172.21.15.37:0/3014729072 >> [v2:172.21.15.123:6838/3077076065,v1:172.21.15.123:6839/3077076065] conn(0x55f85286f3e0 0x55f852870850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:52.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.430+0000 7f5e13e00640 1 --2- 172.21.15.37:0/3014729072 >> [v2:172.21.15.123:6838/3077076065,v1:172.21.15.123:6839/3077076065] conn(0x55f85286f3e0 0x55f852870850 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=83eaaa5ab703e084 server_cookie=7700e0985930b7e5 in_seq=0 out_seq=0 2024-09-11T23:18:52.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.430+0000 7f5e0aa00640 10 client.25198 ms_handle_connect on v2:172.21.15.123:6838/3077076065 2024-09-11T23:18:52.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.431+0000 7f5e0aa00640 1 -- 172.21.15.37:0/3014729072 <== mds.0 v2:172.21.15.123:6838/3077076065 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f8527c6620 con 0x55f85286f3e0 2024-09-11T23:18:52.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.431+0000 7f5e0aa00640 10 client.25198 handle_command_reply: tid=0 2024-09-11T23:18:52.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.431+0000 7f5e2663c740 1 client.25198 shutdown 2024-09-11T23:18:52.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.431+0000 7f5e2663c740 1 -- 172.21.15.37:0/3014729072 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f8528534e0 msgr2=0x55f85285b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:52.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.431+0000 7f5e2663c740 1 --2- 172.21.15.37:0/3014729072 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f8528534e0 0x55f85285b550 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5e0c019660 tx=0x7f5e0c019690 comp rx=0 tx=0).stop 2024-09-11T23:18:52.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.431+0000 7f5e2663c740 1 -- 172.21.15.37:0/3014729072 shutdown_connections 2024-09-11T23:18:52.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.431+0000 7f5e2663c740 1 --2- 172.21.15.37:0/3014729072 >> [v2:172.21.15.123:6838/3077076065,v1:172.21.15.123:6839/3077076065] conn(0x55f85286f3e0 0x55f852870850 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:52.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.431+0000 7f5e2663c740 1 --2- 172.21.15.37:0/3014729072 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f85285e6c0 0x55f85285bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:52.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.431+0000 7f5e2663c740 1 --2- 172.21.15.37:0/3014729072 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f852853e00 0x55f85285ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:52.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.431+0000 7f5e2663c740 1 --2- 172.21.15.37:0/3014729072 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f8528534e0 0x55f85285b550 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:52.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.431+0000 7f5e2663c740 1 -- 172.21.15.37:0/3014729072 >> 172.21.15.37:0/3014729072 conn(0x55f85284fa70 msgr2=0x55f852855750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:52.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.431+0000 7f5e0aa00640 0 client.25198 ms_handle_reset on v2:172.21.15.123:6838/3077076065 2024-09-11T23:18:52.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.431+0000 7f5e2663c740 1 -- 172.21.15.37:0/3014729072 shutdown_connections 2024-09-11T23:18:52.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.431+0000 7f5e2663c740 1 -- 172.21.15.37:0/3014729072 wait complete. 2024-09-11T23:18:52.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.431+0000 7f5e2663c740 20 client.25198 trim_cache size 0 max 16384 2024-09-11T23:18:52.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.450+0000 7f5e2663c740 1 Processor -- start 2024-09-11T23:18:52.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.450+0000 7f5e2663c740 1 -- start start 2024-09-11T23:18:52.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.450+0000 7f5e2663c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f85284fa70 0x55f852869e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:52.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.450+0000 7f5e2663c740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f8528534e0 0x55f85285bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:52.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.450+0000 7f5e2663c740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f852853e00 0x55f85285c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:52.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.451+0000 7f5e2663c740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55f85286eb90 con 0x55f85284fa70 2024-09-11T23:18:52.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.451+0000 7f5e2663c740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55f85286f260 con 0x55f852853e00 2024-09-11T23:18:52.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.451+0000 7f5e2663c740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55f85286f930 con 0x55f8528534e0 2024-09-11T23:18:52.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.451+0000 7f5e21200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f85284fa70 0x55f852869e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:52.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.451+0000 7f5e21200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f85284fa70 0x55f852869e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35864/0 (socket says 172.21.15.37:35864) 2024-09-11T23:18:52.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.451+0000 7f5e21200640 1 -- 172.21.15.37:0/83728618 learned_addr learned my addr 172.21.15.37:0/83728618 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:18:52.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.451+0000 7f5e21c00640 1 --2- 172.21.15.37:0/83728618 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f852853e00 0x55f85285c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:52.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.451+0000 7f5e13e00640 1 --2- 172.21.15.37:0/83728618 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f8528534e0 0x55f85285bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:52.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.451+0000 7f5e21200640 1 -- 172.21.15.37:0/83728618 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f8528534e0 msgr2=0x55f85285bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:52.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.451+0000 7f5e21200640 1 --2- 172.21.15.37:0/83728618 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f8528534e0 0x55f85285bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:52.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.451+0000 7f5e21200640 1 -- 172.21.15.37:0/83728618 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f852853e00 msgr2=0x55f85285c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:52.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.451+0000 7f5e21200640 1 --2- 172.21.15.37:0/83728618 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f852853e00 0x55f85285c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:52.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.451+0000 7f5e21200640 1 -- 172.21.15.37:0/83728618 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f85285a520 con 0x55f85284fa70 2024-09-11T23:18:52.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.451+0000 7f5e21c00640 1 --2- 172.21.15.37:0/83728618 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f852853e00 0x55f85285c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:18:52.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.451+0000 7f5e21200640 1 --2- 172.21.15.37:0/83728618 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f85284fa70 0x55f852869e10 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f5e0c0096a0 tx=0x7f5e0c0096d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=853f00d941a79df2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:52.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.452+0000 7f5e11600640 1 -- 172.21.15.37:0/83728618 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e0c015030 con 0x55f85284fa70 2024-09-11T23:18:52.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.452+0000 7f5e11600640 1 -- 172.21.15.37:0/83728618 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5e0c01f040 con 0x55f85284fa70 2024-09-11T23:18:52.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.452+0000 7f5e11600640 1 -- 172.21.15.37:0/83728618 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e0c027040 con 0x55f85284fa70 2024-09-11T23:18:52.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.452+0000 7f5e2663c740 1 -- 172.21.15.37:0/83728618 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f85284fa70 msgr2=0x55f852869e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:52.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.452+0000 7f5e2663c740 1 --2- 172.21.15.37:0/83728618 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f85284fa70 0x55f852869e10 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f5e0c0096a0 tx=0x7f5e0c0096d0 comp rx=0 tx=0).stop 2024-09-11T23:18:52.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.452+0000 7f5e2663c740 1 -- 172.21.15.37:0/83728618 shutdown_connections 2024-09-11T23:18:52.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.452+0000 7f5e2663c740 1 --2- 172.21.15.37:0/83728618 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f852853e00 0x55f85285c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:52.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.452+0000 7f5e2663c740 1 --2- 172.21.15.37:0/83728618 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f8528534e0 0x55f85285bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:52.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.452+0000 7f5e2663c740 1 --2- 172.21.15.37:0/83728618 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f85284fa70 0x55f852869e10 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:52.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.452+0000 7f5e2663c740 1 -- 172.21.15.37:0/83728618 >> 172.21.15.37:0/83728618 conn(0x55f85286e7b0 msgr2=0x55f852869700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:52.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.452+0000 7f5e2663c740 1 -- 172.21.15.37:0/83728618 shutdown_connections 2024-09-11T23:18:52.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.453+0000 7f5e2663c740 1 -- 172.21.15.37:0/83728618 wait complete. 2024-09-11T23:18:52.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.453+0000 7f5e2663c740 1 -- start start 2024-09-11T23:18:52.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.453+0000 7f5e2663c740 1 Processor -- start 2024-09-11T23:18:52.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.454+0000 7f5e2663c740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f85284fa70 0x55f8528736a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:52.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.454+0000 7f5e2663c740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f8528534e0 0x55f852873be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:52.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.454+0000 7f5e2663c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f852853e00 0x55f852874120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:52.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.454+0000 7f5e2663c740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55f8528706d0 con 0x55f852853e00 2024-09-11T23:18:52.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.454+0000 7f5e2663c740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55f852870000 con 0x55f8528534e0 2024-09-11T23:18:52.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.454+0000 7f5e2663c740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55f852870da0 con 0x55f85284fa70 2024-09-11T23:18:52.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.454+0000 7f5e2663c740 10 client.0 _ll_register_callbacks cb 0x7f5e0c009b70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:18:52.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.454+0000 7f5e13e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f8528534e0 0x55f852873be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:52.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.454+0000 7f5e21c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f852853e00 0x55f852874120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:52.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.454+0000 7f5e21200640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f85284fa70 0x55f8528736a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:52.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.454+0000 7f5e13e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f8528534e0 0x55f852873be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.37:58606/0 (socket says 172.21.15.37:58606) 2024-09-11T23:18:52.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.454+0000 7f5e13e00640 1 -- 172.21.15.37:0/3918688736 learned_addr learned my addr 172.21.15.37:0/3918688736 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:18:52.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.454+0000 7f5e21200640 1 -- 172.21.15.37:0/3918688736 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f8528534e0 msgr2=0x55f852873be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:52.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.454+0000 7f5e21200640 1 --2- 172.21.15.37:0/3918688736 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f8528534e0 0x55f852873be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:52.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.454+0000 7f5e21200640 1 -- 172.21.15.37:0/3918688736 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f852853e00 msgr2=0x55f852874120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:52.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.454+0000 7f5e21200640 1 --2- 172.21.15.37:0/3918688736 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f852853e00 0x55f852874120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:52.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.454+0000 7f5e21200640 1 -- 172.21.15.37:0/3918688736 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f852878960 con 0x55f85284fa70 2024-09-11T23:18:52.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.455+0000 7f5e21200640 1 --2- 172.21.15.37:0/3918688736 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f85284fa70 0x55f8528736a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5e0c004b30 tx=0x7f5e0c005e20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5e3ddcf765f5ed4f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:52.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.455+0000 7f5e0aa00640 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2024-09-11T23:18:52.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.455+0000 7f5e0aa00640 1 -- 172.21.15.37:0/3918688736 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e0c015030 con 0x55f85284fa70 2024-09-11T23:18:52.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.455+0000 7f5e2663c740 1 -- 172.21.15.37:0/3918688736 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5e0c01f040 con 0x55f85284fa70 2024-09-11T23:18:52.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.455+0000 7f5e0aa00640 1 -- 172.21.15.37:0/3918688736 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9295+0+0 (secure 0 0 0) 0x7f5e0c00e3b0 con 0x55f85284fa70 2024-09-11T23:18:52.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.455+0000 7f5e0aa00640 1 -- 172.21.15.37:0/3918688736 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5e0c045050 con 0x55f85284fa70 2024-09-11T23:18:52.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.455+0000 7f5e2663c740 10 client.25204 fetch_fsmap learned FSMap version 28 2024-09-11T23:18:52.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.455+0000 7f5e2663c740 1 -- 172.21.15.37:0/3918688736 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f8528d9ff0 con 0x55f85284fa70 2024-09-11T23:18:52.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.456+0000 7f5e0aa00640 1 -- 172.21.15.37:0/3918688736 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5e0c01f040 con 0x55f85284fa70 2024-09-11T23:18:52.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.456+0000 7f5e0aa00640 1 -- 172.21.15.37:0/3918688736 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f5e0c0043b0 con 0x55f85284fa70 2024-09-11T23:18:52.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.456+0000 7f5e2663c740 10 client.25204 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T23:18:52.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.456+0000 7f5e2663c740 10 client.25204 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-11T23:18:52.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.456+0000 7f5e2663c740 20 client.25204 populate_metadata read hostname 'smithi037' 2024-09-11T23:18:52.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.456+0000 7f5e2663c740 1 --2- 172.21.15.37:0/3918688736 >> [v2:172.21.15.123:6838/3077076065,v1:172.21.15.123:6839/3077076065] conn(0x55f85285e6c0 0x55f8528dd550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:52.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.456+0000 7f5e2663c740 4 client.25204 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T23:18:52.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.456+0000 7f5e2663c740 1 -- 172.21.15.37:0/3918688736 --> [v2:172.21.15.123:6838/3077076065,v1:172.21.15.123:6839/3077076065] -- command(tid 0: {"prefix": "status"}) -- 0x55f8527c0b30 con 0x55f85285e6c0 2024-09-11T23:18:52.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.456+0000 7f5e13e00640 1 --2- 172.21.15.37:0/3918688736 >> [v2:172.21.15.123:6838/3077076065,v1:172.21.15.123:6839/3077076065] conn(0x55f85285e6c0 0x55f8528dd550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:52.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.457+0000 7f5e13e00640 1 --2- 172.21.15.37:0/3918688736 >> [v2:172.21.15.123:6838/3077076065,v1:172.21.15.123:6839/3077076065] conn(0x55f85285e6c0 0x55f8528dd550 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fd281699312aeaaf server_cookie=f8128bf332fddf7c in_seq=0 out_seq=0 2024-09-11T23:18:52.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.457+0000 7f5e0aa00640 10 client.25204 ms_handle_connect on v2:172.21.15.123:6838/3077076065 2024-09-11T23:18:52.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.457+0000 7f5e0aa00640 1 -- 172.21.15.37:0/3918688736 <== mds.0 v2:172.21.15.123:6838/3077076065 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55f8527c0b30 con 0x55f85285e6c0 2024-09-11T23:18:52.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.457+0000 7f5e0aa00640 10 client.25204 handle_command_reply: tid=0 2024-09-11T23:18:52.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.457+0000 7f5e2663c740 1 client.25204 shutdown 2024-09-11T23:18:52.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.457+0000 7f5e2663c740 1 -- 172.21.15.37:0/3918688736 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f85284fa70 msgr2=0x55f8528736a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:52.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.457+0000 7f5e2663c740 1 --2- 172.21.15.37:0/3918688736 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f85284fa70 0x55f8528736a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5e0c004b30 tx=0x7f5e0c005e20 comp rx=0 tx=0).stop 2024-09-11T23:18:52.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.457+0000 7f5e2663c740 1 -- 172.21.15.37:0/3918688736 shutdown_connections 2024-09-11T23:18:52.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.457+0000 7f5e2663c740 1 --2- 172.21.15.37:0/3918688736 >> [v2:172.21.15.123:6838/3077076065,v1:172.21.15.123:6839/3077076065] conn(0x55f85285e6c0 0x55f8528dd550 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:52.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.457+0000 7f5e2663c740 1 --2- 172.21.15.37:0/3918688736 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f8528534e0 0x55f852873be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:52.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.457+0000 7f5e2663c740 1 --2- 172.21.15.37:0/3918688736 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f852853e00 0x55f852874120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:52.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.457+0000 7f5e2663c740 1 --2- 172.21.15.37:0/3918688736 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f85284fa70 0x55f8528736a0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:52.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.457+0000 7f5e2663c740 1 -- 172.21.15.37:0/3918688736 >> 172.21.15.37:0/3918688736 conn(0x55f85286e7b0 msgr2=0x55f85284ebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:52.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.457+0000 7f5e0aa00640 0 client.25204 ms_handle_reset on v2:172.21.15.123:6838/3077076065 2024-09-11T23:18:52.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.457+0000 7f5e2663c740 1 -- 172.21.15.37:0/3918688736 shutdown_connections 2024-09-11T23:18:52.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.457+0000 7f5e2663c740 1 -- 172.21.15.37:0/3918688736 wait complete. 2024-09-11T23:18:52.487 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-11T23:18:52.487 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "8b03efce-7092-11ef-bcea-c7b262605968", 2024-09-11T23:18:52.487 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 0, 2024-09-11T23:18:52.487 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 24533, 2024-09-11T23:18:52.488 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2024-09-11T23:18:52.488 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2024-09-11T23:18:52.488 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2024-09-11T23:18:52.488 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 154.98106015499999, 2024-09-11T23:18:52.488 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 28, 2024-09-11T23:18:52.488 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 95, 2024-09-11T23:18:52.488 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 93, 2024-09-11T23:18:52.488 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 170.063193579 2024-09-11T23:18:52.488 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-11T23:18:52.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.458+0000 7f5e2663c740 20 client.25204 trim_cache size 0 max 16384 2024-09-11T23:18:52.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.458+0000 7f5e22600640 1 -- 172.21.15.37:0/3586424030 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f5e000a2c00 msgr2=0x7f5e000a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:52.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.458+0000 7f5e22600640 1 --2- 172.21.15.37:0/3586424030 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f5e000a2c00 0x7f5e000a50c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f5e04000c00 tx=0x7f5e04009260 comp rx=0 tx=0).stop 2024-09-11T23:18:52.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.458+0000 7f5e22600640 1 -- 172.21.15.37:0/3586424030 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e1c108f60 msgr2=0x7f5e1c19eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:52.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.458+0000 7f5e22600640 1 --2- 172.21.15.37:0/3586424030 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e1c108f60 0x7f5e1c19eda0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f5e1400eb10 tx=0x7f5e1400c2d0 comp rx=0 tx=0).stop 2024-09-11T23:18:52.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.458+0000 7f5e22600640 1 -- 172.21.15.37:0/3586424030 shutdown_connections 2024-09-11T23:18:52.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.458+0000 7f5e22600640 1 --2- 172.21.15.37:0/3586424030 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f5e000a2c00 0x7f5e000a50c0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:52.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.458+0000 7f5e22600640 1 --2- 172.21.15.37:0/3586424030 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e1c108f60 0x7f5e1c19eda0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:52.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.458+0000 7f5e22600640 1 --2- 172.21.15.37:0/3586424030 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5e1c1047e0 0x7f5e1c19aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:52.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.458+0000 7f5e22600640 1 --2- 172.21.15.37:0/3586424030 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5e1c103e30 0x7f5e1c19a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:52.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.458+0000 7f5e22600640 1 -- 172.21.15.37:0/3586424030 >> 172.21.15.37:0/3586424030 conn(0x7f5e1c0ff8d0 msgr2=0x7f5e1c100bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:52.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.458+0000 7f5e22600640 1 -- 172.21.15.37:0/3586424030 shutdown_connections 2024-09-11T23:18:52.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:52.458+0000 7f5e22600640 1 -- 172.21.15.37:0/3586424030 wait complete. 2024-09-11T23:18:53.455 INFO:teuthology.run_tasks:Running task sequential... 2024-09-11T23:18:53.465 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-11T23:18:53.465 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-11T23:18:53.465 INFO:teuthology.task.print:Enabling mgr modules 2024-09-11T23:18:53.466 INFO:teuthology.run_tasks:Running task kclient... 2024-09-11T23:18:53.742 INFO:tasks.kclient:Mounting kernel clients... 2024-09-11T23:18:53.742 INFO:tasks.kclient:config is {'client.0': {}} 2024-09-11T23:18:53.742 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:18:53.742 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2024-09-11T23:18:53.744 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:18:53 smithi160 ceph-mon[35055]: pgmap v385: 129 pgs: 129 active+clean; 647 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-11T23:18:53.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:18:53 smithi123 ceph-mon[35438]: pgmap v385: 129 pgs: 129 active+clean; 647 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-11T23:18:53.780 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-09-11T23:18:53.780 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:18:53.781 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-11T23:18:53.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:18:53 smithi037 ceph-mon[30630]: pgmap v385: 129 pgs: 129 active+clean; 647 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-11T23:18:53.874 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:18:53.874 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link delete ceph-brx 2024-09-11T23:18:54.182 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=legacy', 'nowsync', 'context=system_u:object_r:postgresql_db_t:s0'], 'syntax': 'v1', 'mount_subvol_num': 1, 'mountpoint': '/tmp/cephfs'} 2024-09-11T23:18:54.182 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-11T23:18:54.182 INFO:tasks.cephfs.mount:using client_config["hostfs_mntpt"] = /tmp/cephfs 2024-09-11T23:18:54.182 INFO:tasks.cephfs.mount:hostfs_mntpt = /tmp/cephfs 2024-09-11T23:18:54.183 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph fs ls 2024-09-11T23:18:54.561 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:18:55.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:55.135+0000 7f1a53000640 1 -- 172.21.15.37:0/2531624256 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a4c103ff0 msgr2=0x7f1a4c1043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:55.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:55.135+0000 7f1a53000640 1 --2- 172.21.15.37:0/2531624256 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a4c103ff0 0x7f1a4c1043d0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c009900 tx=0x7f1a3c02a3f0 comp rx=0 tx=0).stop 2024-09-11T23:18:55.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:55.135+0000 7f1a53000640 1 -- 172.21.15.37:0/2531624256 shutdown_connections 2024-09-11T23:18:55.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:55.135+0000 7f1a53000640 1 --2- 172.21.15.37:0/2531624256 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1a4c109120 0x7f1a4c110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:55.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:55.135+0000 7f1a53000640 1 --2- 172.21.15.37:0/2531624256 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1a4c1049a0 0x7f1a4c1089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:55.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:55.135+0000 7f1a53000640 1 --2- 172.21.15.37:0/2531624256 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a4c103ff0 0x7f1a4c1043d0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:55.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:55.135+0000 7f1a53000640 1 -- 172.21.15.37:0/2531624256 >> 172.21.15.37:0/2531624256 conn(0x7f1a4c0ffa90 msgr2=0x7f1a4c101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:55.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:55.136+0000 7f1a53000640 1 -- 172.21.15.37:0/2531624256 shutdown_connections 2024-09-11T23:18:55.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:55.136+0000 7f1a53000640 1 -- 172.21.15.37:0/2531624256 wait complete. 2024-09-11T23:18:55.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:55.137+0000 7f1a53000640 1 Processor -- start 2024-09-11T23:18:55.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:55.137+0000 7f1a53000640 1 -- start start 2024-09-11T23:18:55.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:55.137+0000 7f1a53000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a4c103ff0 0x7f1a4c19a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:55.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:55.137+0000 7f1a53000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1a4c1049a0 0x7f1a4c19ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:55.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:55.137+0000 7f1a53000640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1a4c109120 0x7f1a4c19eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:55.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:55.137+0000 7f1a53000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1a4c114190 con 0x7f1a4c103ff0 2024-09-11T23:18:55.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:55.137+0000 7f1a53000640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f1a4c114010 con 0x7f1a4c1049a0 2024-09-11T23:18:55.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:55.137+0000 7f1a53000640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f1a4c114310 con 0x7f1a4c109120 2024-09-11T23:18:55.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:55.138+0000 7f1a4be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a4c103ff0 0x7f1a4c19a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:55.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:55.138+0000 7f1a4be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a4c103ff0 0x7f1a4c19a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35882/0 (socket says 172.21.15.37:35882) 2024-09-11T23:18:55.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:55.138+0000 7f1a4be00640 1 -- 172.21.15.37:0/2786492005 learned_addr learned my addr 172.21.15.37:0/2786492005 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:18:55.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:55.138+0000 7f1a4b400640 1 --2- 172.21.15.37:0/2786492005 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1a4c1049a0 0x7f1a4c19ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:55.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:55.138+0000 7f1a51000640 1 --2- 172.21.15.37:0/2786492005 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1a4c109120 0x7f1a4c19eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:55.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:55.138+0000 7f1a4be00640 1 -- 172.21.15.37:0/2786492005 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1a4c109120 msgr2=0x7f1a4c19eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:55.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:55.138+0000 7f1a4be00640 1 --2- 172.21.15.37:0/2786492005 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1a4c109120 0x7f1a4c19eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:55.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:55.138+0000 7f1a4be00640 1 -- 172.21.15.37:0/2786492005 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1a4c1049a0 msgr2=0x7f1a4c19ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:55.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:55.138+0000 7f1a4be00640 1 --2- 172.21.15.37:0/2786492005 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1a4c1049a0 0x7f1a4c19ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:55.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:55.138+0000 7f1a4be00640 1 -- 172.21.15.37:0/2786492005 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a4c19f5c0 con 0x7f1a4c103ff0 2024-09-11T23:18:55.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:55.139+0000 7f1a4be00640 1 --2- 172.21.15.37:0/2786492005 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a4c103ff0 0x7f1a4c19a610 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c004770 tx=0x7f1a3c003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:55.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:55.139+0000 7f1a48c00640 1 -- 172.21.15.37:0/2786492005 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a3c03f070 con 0x7f1a4c103ff0 2024-09-11T23:18:55.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:55.139+0000 7f1a48c00640 1 -- 172.21.15.37:0/2786492005 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1a3c031ca0 con 0x7f1a4c103ff0 2024-09-11T23:18:55.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:55.139+0000 7f1a53000640 1 -- 172.21.15.37:0/2786492005 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a4c19f850 con 0x7f1a4c103ff0 2024-09-11T23:18:55.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:55.139+0000 7f1a48c00640 1 -- 172.21.15.37:0/2786492005 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a3c035030 con 0x7f1a4c103ff0 2024-09-11T23:18:55.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:55.139+0000 7f1a53000640 1 -- 172.21.15.37:0/2786492005 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a4c1a7190 con 0x7f1a4c103ff0 2024-09-11T23:18:55.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:55.140+0000 7f1a53000640 1 -- 172.21.15.37:0/2786492005 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a4c1043d0 con 0x7f1a4c103ff0 2024-09-11T23:18:55.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:55.142+0000 7f1a48c00640 1 -- 172.21.15.37:0/2786492005 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f1a3c042070 con 0x7f1a4c103ff0 2024-09-11T23:18:55.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:55.143+0000 7f1a48c00640 1 --2- 172.21.15.37:0/2786492005 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f1a300a2c00 0x7f1a300a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:55.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:55.144+0000 7f1a48c00640 1 -- 172.21.15.37:0/2786492005 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9295+0+0 (secure 0 0 0) 0x7f1a3c0efa10 con 0x7f1a4c103ff0 2024-09-11T23:18:55.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:55.144+0000 7f1a4b400640 1 --2- 172.21.15.37:0/2786492005 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f1a300a2c00 0x7f1a300a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:55.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:55.144+0000 7f1a4b400640 1 --2- 172.21.15.37:0/2786492005 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f1a300a2c00 0x7f1a300a50c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c0fff20 tx=0x7f1a38005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:55.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:55.148+0000 7f1a48c00640 1 -- 172.21.15.37:0/2786492005 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1a3c0bc4f0 con 0x7f1a4c103ff0 2024-09-11T23:18:55.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:55.373+0000 7f1a53000640 1 -- 172.21.15.37:0/2786492005 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f1a4c10c300 con 0x7f1a4c103ff0 2024-09-11T23:18:55.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:55.374+0000 7f1a48c00640 1 -- 172.21.15.37:0/2786492005 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v28) ==== 53+0+88 (secure 0 0 0) 0x7f1a3c0bbdf0 con 0x7f1a4c103ff0 2024-09-11T23:18:55.375 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-11T23:18:55.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:55.376+0000 7f1a53000640 1 -- 172.21.15.37:0/2786492005 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f1a300a2c00 msgr2=0x7f1a300a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:55.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:55.376+0000 7f1a53000640 1 --2- 172.21.15.37:0/2786492005 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f1a300a2c00 0x7f1a300a50c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c0fff20 tx=0x7f1a38005f90 comp rx=0 tx=0).stop 2024-09-11T23:18:55.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:55.376+0000 7f1a53000640 1 -- 172.21.15.37:0/2786492005 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a4c103ff0 msgr2=0x7f1a4c19a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:55.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:55.376+0000 7f1a53000640 1 --2- 172.21.15.37:0/2786492005 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a4c103ff0 0x7f1a4c19a610 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c004770 tx=0x7f1a3c003c10 comp rx=0 tx=0).stop 2024-09-11T23:18:55.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:55.376+0000 7f1a53000640 1 -- 172.21.15.37:0/2786492005 shutdown_connections 2024-09-11T23:18:55.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:55.376+0000 7f1a53000640 1 --2- 172.21.15.37:0/2786492005 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f1a300a2c00 0x7f1a300a50c0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:55.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:55.376+0000 7f1a53000640 1 --2- 172.21.15.37:0/2786492005 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1a4c1049a0 0x7f1a4c19ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:55.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:55.376+0000 7f1a53000640 1 --2- 172.21.15.37:0/2786492005 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1a4c109120 0x7f1a4c19eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:55.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:55.376+0000 7f1a53000640 1 --2- 172.21.15.37:0/2786492005 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a4c103ff0 0x7f1a4c19a610 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:55.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:55.376+0000 7f1a53000640 1 -- 172.21.15.37:0/2786492005 >> 172.21.15.37:0/2786492005 conn(0x7f1a4c0ffa90 msgr2=0x7f1a4c100d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:55.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:55.376+0000 7f1a53000640 1 -- 172.21.15.37:0/2786492005 shutdown_connections 2024-09-11T23:18:55.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:55.376+0000 7f1a53000640 1 -- 172.21.15.37:0/2786492005 wait complete. 2024-09-11T23:18:55.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:18:55 smithi160 ceph-mon[35055]: pgmap v386: 129 pgs: 129 active+clean; 647 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-11T23:18:55.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:18:55 smithi160 ceph-mon[35055]: from='client.? 172.21.15.37:0/2786492005' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-11T23:18:55.723 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:18:55 smithi037 ceph-mon[30630]: pgmap v386: 129 pgs: 129 active+clean; 647 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-11T23:18:55.723 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:18:55 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/2786492005' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-11T23:18:55.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:18:55 smithi123 ceph-mon[35438]: pgmap v386: 129 pgs: 129 active+clean; 647 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-11T23:18:55.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:18:55 smithi123 ceph-mon[35438]: from='client.? 172.21.15.37:0/2786492005' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-11T23:18:56.098 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-11T23:18:56.099 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-11T23:18:56.099 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi037.front.sepia.ceph.com 2024-09-11T23:18:56.099 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-11T23:18:56.099 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /tmp/cephfs 2024-09-11T23:18:56.099 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-11T23:18:56.099 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-11T23:18:56.099 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-11T23:18:56.099 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/tmp/cephfs' 2024-09-11T23:18:56.099 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:18:56.100 DEBUG:teuthology.orchestra.run.smithi037:> ip addr 2024-09-11T23:18:56.136 INFO:teuthology.orchestra.run.smithi037.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T23:18:56.136 INFO:teuthology.orchestra.run.smithi037.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T23:18:56.136 INFO:teuthology.orchestra.run.smithi037.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T23:18:56.136 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:18:56.136 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 ::1/128 scope host 2024-09-11T23:18:56.136 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:18:56.136 INFO:teuthology.orchestra.run.smithi037.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T23:18:56.136 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:18 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:18:56.136 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f0 2024-09-11T23:18:56.136 INFO:teuthology.orchestra.run.smithi037.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T23:18:56.137 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:19 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:18:56.137 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f1 2024-09-11T23:18:56.137 INFO:teuthology.orchestra.run.smithi037.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-11T23:18:56.137 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:94 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:18:56.137 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f0 2024-09-11T23:18:56.137 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.21.15.37/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-11T23:18:56.137 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft 42040sec preferred_lft 42040sec 2024-09-11T23:18:56.137 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::ec4:7aff:fe88:7794/64 scope link 2024-09-11T23:18:56.137 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:18:56.137 INFO:teuthology.orchestra.run.smithi037.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T23:18:56.137 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:95 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:18:56.137 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f1 2024-09-11T23:18:56.138 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-11T23:18:56.138 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:18:56.139 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2024-09-11T23:18:56.139 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link add name ceph-brx type bridge 2024-09-11T23:18:56.139 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip addr flush dev ceph-brx 2024-09-11T23:18:56.139 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set ceph-brx up 2024-09-11T23:18:56.139 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-11T23:18:56.139 DEBUG:teuthology.orchestra.run.smithi037:> ') 2024-09-11T23:18:56.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:56 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:18:56.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:18:56.369 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:18:56.369 DEBUG:teuthology.orchestra.run.smithi037:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-11T23:18:56.424 INFO:teuthology.orchestra.run.smithi037.stdout:1 2024-09-11T23:18:56.428 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:18:56.428 DEBUG:teuthology.orchestra.run.smithi037:> route 2024-09-11T23:18:56.465 INFO:teuthology.orchestra.run.smithi037.stdout:Kernel IP routing table 2024-09-11T23:18:56.465 INFO:teuthology.orchestra.run.smithi037.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-11T23:18:56.465 INFO:teuthology.orchestra.run.smithi037.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-11T23:18:56.465 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-11T23:18:56.465 INFO:teuthology.orchestra.run.smithi037.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-11T23:18:56.465 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:18:56.465 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2024-09-11T23:18:56.466 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-11T23:18:56.466 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-11T23:18:56.466 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-11T23:18:56.466 DEBUG:teuthology.orchestra.run.smithi037:> ') 2024-09-11T23:18:56.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:56 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:18:56.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:18:56.666 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:18:56.666 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2024-09-11T23:18:56.702 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:18:56.702 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list-id 2024-09-11T23:18:56.777 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:18:56.778 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2024-09-11T23:18:56.778 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns add ceph-ns--tmp-cephfs 2024-09-11T23:18:56.778 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns set ceph-ns--tmp-cephfs 0 2024-09-11T23:18:56.778 DEBUG:teuthology.orchestra.run.smithi037:> ') 2024-09-11T23:18:56.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:56 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:18:56.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:18:56.955 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--tmp-cephfs' with 192.168.0.1/16 2024-09-11T23:18:56.956 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:18:56.956 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2024-09-11T23:18:56.956 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link add veth0 netns ceph-ns--tmp-cephfs type veth peer name brx.0 2024-09-11T23:18:56.956 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--tmp-cephfs ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-11T23:18:56.956 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--tmp-cephfs ip link set veth0 up 2024-09-11T23:18:56.956 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--tmp-cephfs ip link set lo up 2024-09-11T23:18:56.956 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--tmp-cephfs ip route add default via 192.168.255.254 2024-09-11T23:18:56.956 DEBUG:teuthology.orchestra.run.smithi037:> ') 2024-09-11T23:18:57.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:57 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:18:57.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:18:57.176 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:18:57.176 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2024-09-11T23:18:57.177 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set brx.0 up 2024-09-11T23:18:57.177 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set dev brx.0 master ceph-brx 2024-09-11T23:18:57.177 DEBUG:teuthology.orchestra.run.smithi037:> ') 2024-09-11T23:18:57.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:57 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:18:57.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:18:57.343 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:18:57.343 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -v /tmp/cephfs 2024-09-11T23:18:57.378 INFO:teuthology.orchestra.run.smithi037.stdout:mkdir: created directory '/tmp/cephfs' 2024-09-11T23:18:57.379 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:18:57.379 DEBUG:teuthology.orchestra.run.smithi037:> chmod 0000 /tmp/cephfs 2024-09-11T23:18:57.453 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-09-11T23:18:57.454 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-09-11T23:18:57.454 INFO:tasks.cephfs.kernel_mount:mounting using device: :/volumes/qa/sv_1/b1f76a95-28df-47ca-a4c2-c74e28a5ad7d 2024-09-11T23:18:57.454 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:18:57.454 DEBUG:teuthology.orchestra.run.smithi037:> sudo nsenter --net=/var/run/netns/ceph-ns--tmp-cephfs adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/volumes/qa/sv_1/b1f76a95-28df-47ca-a4c2-c74e28a5ad7d /tmp/cephfs -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,nowsync,context=system_u:object_r:postgresql_db_t:s0 2024-09-11T23:18:57.581 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,nowsync,context="system_u:object_r:postgresql_db_t:s0" 2024-09-11T23:18:57.581 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,nowsync,context="system_u:object_r:postgresql_db_t:s0"". 2024-09-11T23:18:57.582 INFO:teuthology.orchestra.run.smithi037.stdout:invalid new device string format 2024-09-11T23:18:57.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:18:57 smithi160 ceph-mon[35055]: pgmap v387: 129 pgs: 129 active+clean; 647 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-09-11T23:18:57.684 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:18:57 smithi037 ceph-mon[30630]: pgmap v387: 129 pgs: 129 active+clean; 647 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-09-11T23:18:57.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:18:57 smithi123 ceph-mon[35438]: pgmap v387: 129 pgs: 129 active+clean; 647 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-09-11T23:18:58.207 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,nowsync,context="system_u:object_r:postgresql_db_t:s0" 2024-09-11T23:18:58.207 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,nowsync,context="system_u:object_r:postgresql_db_t:s0"". 2024-09-11T23:18:58.207 INFO:teuthology.orchestra.run.smithi037.stdout:invalid new device string format 2024-09-11T23:18:58.207 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: resolved to: "172.21.15.37:6789,172.21.15.123:6789,172.21.15.160:6789" 2024-09-11T23:18:58.207 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.37:6789,172.21.15.123:6789,172.21.15.160:6789:/volumes/qa/sv_1/b1f76a95-28df-47ca-a4c2-c74e28a5ad7d 2024-09-11T23:18:58.207 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,nowsync,context="system_u:object_r:postgresql_db_t:s0",key=0,fsid=8b03efce-7092-11ef-bcea-c7b262605968" will pass to kernel 2024-09-11T23:18:58.212 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-11T23:18:58.212 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:18:58.213 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 1777 /tmp/cephfs 2024-09-11T23:18:58.275 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/cephfs && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-11T23:18:58.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:58 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T23:18:58.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:18:58.367 INFO:teuthology.orchestra.run.smithi037.stdout:client15201 2024-09-11T23:18:58.368 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-11T23:18:58.368 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:18:58.404 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/cephfs && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-11T23:18:58.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:58 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T23:18:58.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:18:58.535 INFO:teuthology.orchestra.run.smithi037.stdout:client15201 2024-09-11T23:18:58.535 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/cephfs && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-11T23:18:58.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:58 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T23:18:58.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:18:58.632 INFO:teuthology.orchestra.run.smithi037.stdout:client15201 2024-09-11T23:18:58.632 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/cephfs && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/8b03efce-7092-11ef-bcea-c7b262605968.client15201/status') 2024-09-11T23:18:58.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:58 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:18:58.733 INFO:teuthology.orchestra.run.smithi037.stdout:instance: client.15201 (3)192.168.0.1:0/2602652242 2024-09-11T23:18:58.734 INFO:teuthology.orchestra.run.smithi037.stdout:blocklisted: false 2024-09-11T23:18:58.734 INFO:teuthology.orchestra.run.smithi037.stderr:0+1 records in 2024-09-11T23:18:58.734 INFO:teuthology.orchestra.run.smithi037.stderr:0+1 records out 2024-09-11T23:18:58.734 INFO:teuthology.orchestra.run.smithi037.stderr:70 bytes copied, 6.1004e-05 s, 1.1 MB/s 2024-09-11T23:18:58.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:18:58.745 INFO:teuthology.run_tasks:Running task exec... 2024-09-11T23:18:58.754 INFO:teuthology.task.exec:Executing custom commands... 2024-09-11T23:18:58.755 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi037.front.sepia.ceph.com 2024-09-11T23:18:58.755 DEBUG:teuthology.orchestra.run.smithi037:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate false' 2024-09-11T23:18:58.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:58.910+0000 7f6ad3a00640 1 -- 172.21.15.37:0/945891253 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6acc103d60 msgr2=0x7f6acc104160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:58.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:58.910+0000 7f6ad3a00640 1 --2- 172.21.15.37:0/945891253 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6acc103d60 0x7f6acc104160 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f6ac0009900 tx=0x7f6ac002a3f0 comp rx=0 tx=0).stop 2024-09-11T23:18:58.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:58.910+0000 7f6ad3a00640 1 -- 172.21.15.37:0/945891253 shutdown_connections 2024-09-11T23:18:58.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:58.910+0000 7f6ad3a00640 1 --2- 172.21.15.37:0/945891253 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6acc104f50 0x7f6acc1053d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:58.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:58.910+0000 7f6ad3a00640 1 --2- 172.21.15.37:0/945891253 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6acc105910 0x7f6acc10c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:58.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:58.910+0000 7f6ad3a00640 1 --2- 172.21.15.37:0/945891253 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6acc103d60 0x7f6acc104160 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:58.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:58.910+0000 7f6ad3a00640 1 -- 172.21.15.37:0/945891253 >> 172.21.15.37:0/945891253 conn(0x7f6acc0ff4e0 msgr2=0x7f6acc101900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:58.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:58.910+0000 7f6ad3a00640 1 -- 172.21.15.37:0/945891253 shutdown_connections 2024-09-11T23:18:58.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:58.911+0000 7f6ad3a00640 1 -- 172.21.15.37:0/945891253 wait complete. 2024-09-11T23:18:58.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:58.911+0000 7f6ad3a00640 1 Processor -- start 2024-09-11T23:18:58.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:58.911+0000 7f6ad3a00640 1 -- start start 2024-09-11T23:18:58.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:58.912+0000 7f6ad3a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6acc103d60 0x7f6acc199fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:58.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:58.912+0000 7f6ad3a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6acc104f50 0x7f6acc19a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:58.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:58.912+0000 7f6ad3a00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6acc105910 0x7f6acc1a1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:58.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:58.912+0000 7f6ad3a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6acc10f9c0 con 0x7f6acc104f50 2024-09-11T23:18:58.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:58.912+0000 7f6ad3a00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f6acc10f840 con 0x7f6acc103d60 2024-09-11T23:18:58.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:58.912+0000 7f6ad3a00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f6acc10fb40 con 0x7f6acc105910 2024-09-11T23:18:58.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:58.912+0000 7f6ad1000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6acc103d60 0x7f6acc199fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:58.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:58.912+0000 7f6acbe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6acc104f50 0x7f6acc19a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:58.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:58.912+0000 7f6ad1000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6acc103d60 0x7f6acc199fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.37:58648/0 (socket says 172.21.15.37:58648) 2024-09-11T23:18:58.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:58.912+0000 7f6ad1000640 1 -- 172.21.15.37:0/1016442764 learned_addr learned my addr 172.21.15.37:0/1016442764 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:18:58.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:58.912+0000 7f6ad1a00640 1 --2- 172.21.15.37:0/1016442764 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6acc105910 0x7f6acc1a1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:58.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:58.912+0000 7f6ad1000640 1 -- 172.21.15.37:0/1016442764 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6acc105910 msgr2=0x7f6acc1a1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:58.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:58.912+0000 7f6ad1000640 1 --2- 172.21.15.37:0/1016442764 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6acc105910 0x7f6acc1a1590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:58.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:58.912+0000 7f6ad1000640 1 -- 172.21.15.37:0/1016442764 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6acc104f50 msgr2=0x7f6acc19a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:58.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:58.912+0000 7f6ad1000640 1 --2- 172.21.15.37:0/1016442764 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6acc104f50 0x7f6acc19a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:58.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:58.912+0000 7f6ad1000640 1 -- 172.21.15.37:0/1016442764 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6acc1a1c00 con 0x7f6acc103d60 2024-09-11T23:18:58.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:58.913+0000 7f6ad1000640 1 --2- 172.21.15.37:0/1016442764 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6acc103d60 0x7f6acc199fe0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6ac0031610 tx=0x7f6ac0004270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:58.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:58.913+0000 7f6ac9600640 1 -- 172.21.15.37:0/1016442764 <== mon.2 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ac003f030 con 0x7f6acc103d60 2024-09-11T23:18:58.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:58.913+0000 7f6ad3a00640 1 -- 172.21.15.37:0/1016442764 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6acc1a1e90 con 0x7f6acc103d60 2024-09-11T23:18:58.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:58.913+0000 7f6ac9600640 1 -- 172.21.15.37:0/1016442764 <== mon.2 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6ac0003ad0 con 0x7f6acc103d60 2024-09-11T23:18:58.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:58.913+0000 7f6ac9600640 1 -- 172.21.15.37:0/1016442764 <== mon.2 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ac0035070 con 0x7f6acc103d60 2024-09-11T23:18:58.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:58.913+0000 7f6ad3a00640 1 -- 172.21.15.37:0/1016442764 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6acc1a22f0 con 0x7f6acc103d60 2024-09-11T23:18:58.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:58.914+0000 7f6ad3a00640 1 -- 172.21.15.37:0/1016442764 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6acc10b0d0 con 0x7f6acc103d60 2024-09-11T23:18:58.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:58.917+0000 7f6ac9600640 1 -- 172.21.15.37:0/1016442764 <== mon.2 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f6ac0042030 con 0x7f6acc103d60 2024-09-11T23:18:58.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:58.918+0000 7f6ac9600640 1 --2- 172.21.15.37:0/1016442764 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f6ab40a2c30 0x7f6ab40a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:58.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:58.918+0000 7f6ac9600640 1 -- 172.21.15.37:0/1016442764 <== mon.2 v2:172.21.15.123:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9295+0+0 (secure 0 0 0) 0x7f6ac00efce0 con 0x7f6acc103d60 2024-09-11T23:18:58.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:58.918+0000 7f6acbe00640 1 --2- 172.21.15.37:0/1016442764 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f6ab40a2c30 0x7f6ab40a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:58.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:58.919+0000 7f6acbe00640 1 --2- 172.21.15.37:0/1016442764 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f6ab40a2c30 0x7f6ab40a50f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f6acc19b4f0 tx=0x7f6ab8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:58.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:58.920+0000 7f6ac9600640 1 -- 172.21.15.37:0/1016442764 <== mon.2 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6ac00bc170 con 0x7f6acc103d60 2024-09-11T23:18:59.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:59.146+0000 7f6ad3a00640 1 -- 172.21.15.37:0/1016442764 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} v 0) -- 0x7f6acc02d7c0 con 0x7f6acc103d60 2024-09-11T23:18:59.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:59.423+0000 7f6ac9600640 1 -- 172.21.15.37:0/1016442764 <== mon.2 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]=0 v29) ==== 118+0+0 (secure 0 0 0) 0x7f6ac00c0470 con 0x7f6acc103d60 2024-09-11T23:18:59.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:59.425+0000 7f6ad3a00640 1 -- 172.21.15.37:0/1016442764 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f6ab40a2c30 msgr2=0x7f6ab40a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:59.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:59.425+0000 7f6ad3a00640 1 --2- 172.21.15.37:0/1016442764 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f6ab40a2c30 0x7f6ab40a50f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f6acc19b4f0 tx=0x7f6ab8005f90 comp rx=0 tx=0).stop 2024-09-11T23:18:59.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:59.425+0000 7f6ad3a00640 1 -- 172.21.15.37:0/1016442764 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6acc103d60 msgr2=0x7f6acc199fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:59.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:59.425+0000 7f6ad3a00640 1 --2- 172.21.15.37:0/1016442764 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6acc103d60 0x7f6acc199fe0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6ac0031610 tx=0x7f6ac0004270 comp rx=0 tx=0).stop 2024-09-11T23:18:59.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:59.425+0000 7f6ad3a00640 1 -- 172.21.15.37:0/1016442764 shutdown_connections 2024-09-11T23:18:59.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:59.425+0000 7f6ad3a00640 1 --2- 172.21.15.37:0/1016442764 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f6ab40a2c30 0x7f6ab40a50f0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:59.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:59.425+0000 7f6ad3a00640 1 --2- 172.21.15.37:0/1016442764 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6acc105910 0x7f6acc1a1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:59.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:59.425+0000 7f6ad3a00640 1 --2- 172.21.15.37:0/1016442764 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6acc104f50 0x7f6acc19a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:59.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:59.425+0000 7f6ad3a00640 1 --2- 172.21.15.37:0/1016442764 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6acc103d60 0x7f6acc199fe0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:59.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:59.425+0000 7f6ad3a00640 1 -- 172.21.15.37:0/1016442764 >> 172.21.15.37:0/1016442764 conn(0x7f6acc0ff4e0 msgr2=0x7f6acc1082a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:59.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:59.425+0000 7f6ad3a00640 1 -- 172.21.15.37:0/1016442764 shutdown_connections 2024-09-11T23:18:59.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:59.425+0000 7f6ad3a00640 1 -- 172.21.15.37:0/1016442764 wait complete. 2024-09-11T23:18:59.444 DEBUG:teuthology.orchestra.run.smithi037:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs subvolumegroup pin cephfs qa random 0.10' 2024-09-11T23:18:59.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:59.602+0000 7f93c9e00640 1 -- 172.21.15.37:0/951256136 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f93c4104d60 msgr2=0x7f93c41051e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:59.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:59.602+0000 7f93c9e00640 1 --2- 172.21.15.37:0/951256136 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f93c4104d60 0x7f93c41051e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f93b0009900 tx=0x7f93b002a400 comp rx=0 tx=0).stop 2024-09-11T23:18:59.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:59.602+0000 7f93c9e00640 1 -- 172.21.15.37:0/951256136 shutdown_connections 2024-09-11T23:18:59.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:59.602+0000 7f93c9e00640 1 --2- 172.21.15.37:0/951256136 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f93c4104d60 0x7f93c41051e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:59.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:59.602+0000 7f93c9e00640 1 --2- 172.21.15.37:0/951256136 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93c4105720 0x7f93c410bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:59.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:59.602+0000 7f93c9e00640 1 --2- 172.21.15.37:0/951256136 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f93c4103b70 0x7f93c4103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:59.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:59.602+0000 7f93c9e00640 1 -- 172.21.15.37:0/951256136 >> 172.21.15.37:0/951256136 conn(0x7f93c40ff310 msgr2=0x7f93c4101730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:59.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:59.602+0000 7f93c9e00640 1 -- 172.21.15.37:0/951256136 shutdown_connections 2024-09-11T23:18:59.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:59.602+0000 7f93c9e00640 1 -- 172.21.15.37:0/951256136 wait complete. 2024-09-11T23:18:59.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:59.603+0000 7f93c9e00640 1 Processor -- start 2024-09-11T23:18:59.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:59.603+0000 7f93c9e00640 1 -- start start 2024-09-11T23:18:59.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:59.603+0000 7f93c9e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93c4103b70 0x7f93c4199ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:59.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:59.603+0000 7f93c9e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f93c4104d60 0x7f93c419a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:59.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:59.603+0000 7f93c9e00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f93c4105720 0x7f93c41a1450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:59.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:59.603+0000 7f93c9e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f93c410f840 con 0x7f93c4103b70 2024-09-11T23:18:59.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:59.603+0000 7f93c9e00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f93c410f6c0 con 0x7f93c4104d60 2024-09-11T23:18:59.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:59.603+0000 7f93c9e00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f93c410f9c0 con 0x7f93c4105720 2024-09-11T23:18:59.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:59.603+0000 7f93c8a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93c4103b70 0x7f93c4199ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:59.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:59.603+0000 7f93c8a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93c4103b70 0x7f93c4199ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44686/0 (socket says 172.21.15.37:44686) 2024-09-11T23:18:59.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:59.603+0000 7f93c8a00640 1 -- 172.21.15.37:0/3433075622 learned_addr learned my addr 172.21.15.37:0/3433075622 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:18:59.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:59.603+0000 7f93c3e00640 1 --2- 172.21.15.37:0/3433075622 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f93c4104d60 0x7f93c419a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:59.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:59.603+0000 7f93c9400640 1 --2- 172.21.15.37:0/3433075622 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f93c4105720 0x7f93c41a1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:59.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:59.604+0000 7f93c8a00640 1 -- 172.21.15.37:0/3433075622 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f93c4105720 msgr2=0x7f93c41a1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:59.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:59.604+0000 7f93c8a00640 1 --2- 172.21.15.37:0/3433075622 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f93c4105720 0x7f93c41a1450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:59.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:59.604+0000 7f93c8a00640 1 -- 172.21.15.37:0/3433075622 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f93c4104d60 msgr2=0x7f93c419a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:59.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:59.604+0000 7f93c8a00640 1 --2- 172.21.15.37:0/3433075622 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f93c4104d60 0x7f93c419a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:59.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:59.604+0000 7f93c8a00640 1 -- 172.21.15.37:0/3433075622 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93c41a1ac0 con 0x7f93c4103b70 2024-09-11T23:18:59.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:59.604+0000 7f93c8a00640 1 --2- 172.21.15.37:0/3433075622 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93c4103b70 0x7f93c4199ea0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f93b800e9c0 tx=0x7f93b800edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:59.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:59.604+0000 7f93c1600640 1 -- 172.21.15.37:0/3433075622 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93b800ccc0 con 0x7f93c4103b70 2024-09-11T23:18:59.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:59.604+0000 7f93c9e00640 1 -- 172.21.15.37:0/3433075622 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93c41a1db0 con 0x7f93c4103b70 2024-09-11T23:18:59.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:59.604+0000 7f93c1600640 1 -- 172.21.15.37:0/3433075622 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f93b80035f0 con 0x7f93c4103b70 2024-09-11T23:18:59.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:59.604+0000 7f93c1600640 1 -- 172.21.15.37:0/3433075622 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93b800ce60 con 0x7f93c4103b70 2024-09-11T23:18:59.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:59.604+0000 7f93c9e00640 1 -- 172.21.15.37:0/3433075622 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93c41a21c0 con 0x7f93c4103b70 2024-09-11T23:18:59.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:59.606+0000 7f93c9e00640 1 -- 172.21.15.37:0/3433075622 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93c410af60 con 0x7f93c4103b70 2024-09-11T23:18:59.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:59.607+0000 7f93c1600640 1 -- 172.21.15.37:0/3433075622 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f93b80037a0 con 0x7f93c4103b70 2024-09-11T23:18:59.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:59.609+0000 7f93c1600640 1 --2- 172.21.15.37:0/3433075622 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f93ac0a2b80 0x7f93ac0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:59.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:59.609+0000 7f93c1600640 1 -- 172.21.15.37:0/3433075622 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9295+0+0 (secure 0 0 0) 0x7f93b80cf820 con 0x7f93c4103b70 2024-09-11T23:18:59.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:59.609+0000 7f93c3e00640 1 --2- 172.21.15.37:0/3433075622 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f93ac0a2b80 0x7f93ac0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:59.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:59.610+0000 7f93c3e00640 1 --2- 172.21.15.37:0/3433075622 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f93ac0a2b80 0x7f93ac0a5040 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f93b0031440 tx=0x7f93b00315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:59.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:59.613+0000 7f93c1600640 1 -- 172.21.15.37:0/3433075622 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f93b809c300 con 0x7f93c4103b70 2024-09-11T23:18:59.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:18:59 smithi160 ceph-mon[35055]: pgmap v388: 129 pgs: 129 active+clean; 647 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-11T23:18:59.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:18:59 smithi160 ceph-mon[35055]: from='client.? 172.21.15.37:0/1016442764' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-09-11T23:18:59.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:18:59 smithi160 ceph-mon[35055]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-09-11T23:18:59.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:18:59 smithi123 ceph-mon[35438]: pgmap v388: 129 pgs: 129 active+clean; 647 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-11T23:18:59.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:18:59 smithi123 ceph-mon[35438]: from='client.? 172.21.15.37:0/1016442764' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-09-11T23:18:59.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:18:59 smithi123 ceph-mon[35438]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-09-11T23:18:59.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:18:59 smithi037 ceph-mon[30630]: pgmap v388: 129 pgs: 129 active+clean; 647 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-11T23:18:59.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:18:59 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/1016442764' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-09-11T23:18:59.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:18:59 smithi037 ceph-mon[30630]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-09-11T23:18:59.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:59.822+0000 7f93c9e00640 1 -- 172.21.15.37:0/3433075622 --> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}) -- 0x7f93c40626d0 con 0x7f93ac0a2b80 2024-09-11T23:18:59.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:59.844+0000 7f93c1600640 1 -- 172.21.15.37:0/3433075622 <== mgr.14150 v2:172.21.15.37:6800/31543269 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3 (secure 0 0 0) 0x7f93c40626d0 con 0x7f93ac0a2b80 2024-09-11T23:18:59.845 INFO:teuthology.orchestra.run.smithi037.stdout:{} 2024-09-11T23:18:59.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:59.846+0000 7f93c9e00640 1 -- 172.21.15.37:0/3433075622 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f93ac0a2b80 msgr2=0x7f93ac0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:59.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:59.846+0000 7f93c9e00640 1 --2- 172.21.15.37:0/3433075622 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f93ac0a2b80 0x7f93ac0a5040 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f93b0031440 tx=0x7f93b00315b0 comp rx=0 tx=0).stop 2024-09-11T23:18:59.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:59.846+0000 7f93c9e00640 1 -- 172.21.15.37:0/3433075622 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93c4103b70 msgr2=0x7f93c4199ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:59.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:59.846+0000 7f93c9e00640 1 --2- 172.21.15.37:0/3433075622 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93c4103b70 0x7f93c4199ea0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f93b800e9c0 tx=0x7f93b800edc0 comp rx=0 tx=0).stop 2024-09-11T23:18:59.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:59.846+0000 7f93c9e00640 1 -- 172.21.15.37:0/3433075622 shutdown_connections 2024-09-11T23:18:59.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:59.846+0000 7f93c9e00640 1 --2- 172.21.15.37:0/3433075622 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f93ac0a2b80 0x7f93ac0a5040 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:59.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:59.846+0000 7f93c9e00640 1 --2- 172.21.15.37:0/3433075622 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f93c4104d60 0x7f93c419a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:59.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:59.846+0000 7f93c9e00640 1 --2- 172.21.15.37:0/3433075622 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f93c4105720 0x7f93c41a1450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:59.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:59.846+0000 7f93c9e00640 1 --2- 172.21.15.37:0/3433075622 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93c4103b70 0x7f93c4199ea0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:59.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:59.846+0000 7f93c9e00640 1 -- 172.21.15.37:0/3433075622 >> 172.21.15.37:0/3433075622 conn(0x7f93c40ff310 msgr2=0x7f93c4108130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:59.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:59.846+0000 7f93c9e00640 1 -- 172.21.15.37:0/3433075622 shutdown_connections 2024-09-11T23:18:59.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:18:59.846+0000 7f93c9e00640 1 -- 172.21.15.37:0/3433075622 wait complete. 2024-09-11T23:18:59.863 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-11T23:18:59.874 INFO:teuthology.run_tasks:Running task exec... 2024-09-11T23:19:00.313 INFO:teuthology.task.exec:Executing custom commands... 2024-09-11T23:19:00.313 INFO:teuthology.task.exec:Running commands on role client.0 host ubuntu@smithi037.front.sepia.ceph.com 2024-09-11T23:19:00.313 DEBUG:teuthology.orchestra.run.smithi037:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -l /tmp/cephfs/ && sudo df -h /tmp/cephfs/' 2024-09-11T23:19:00.314 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:18:59 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: 2024-09-11T23:18:59.828+0000 7f5636200640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:19:00.314 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:18:59 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: 2024-09-11T23:18:59.828+0000 7f5636200640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:19:00.314 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:18:59 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: 2024-09-11T23:18:59.828+0000 7f5636200640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:19:00.315 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:18:59 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: 2024-09-11T23:18:59.828+0000 7f5636200640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:19:00.315 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:18:59 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: 2024-09-11T23:18:59.828+0000 7f5636200640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:19:00.391 INFO:teuthology.orchestra.run.smithi037.stdout:total 0 2024-09-11T23:19:00.419 INFO:teuthology.orchestra.run.smithi037.stdout:Filesystem Size Used Avail Use% Mounted on 2024-09-11T23:19:00.419 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:6789,172.21.15.123:6789,172.21.15.160:6789:/volumes/qa/sv_1/b1f76a95-28df-47ca-a4c2-c74e28a5ad7d 1.1T 376M 1.1T 1% /tmp/cephfs 2024-09-11T23:19:00.424 DEBUG:teuthology.orchestra.run.smithi037:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo mkdir -m 755 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres && sudo chown postgres:postgres /tmp/cephfs/postgres' 2024-09-11T23:19:00.539 DEBUG:teuthology.orchestra.run.smithi037:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- mkdir -m 700 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres/data' 2024-09-11T23:19:00.618 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:19:00 smithi037 ceph-mon[30630]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-09-11T23:19:00.618 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:19:00 smithi037 ceph-mon[30630]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-11T23:19:00.618 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:19:00 smithi037 ceph-mon[30630]: from='client.15213 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:19:00.622 DEBUG:teuthology.orchestra.run.smithi037:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo semanage fcontext -a -t postgresql_db_t "/tmp/cephfs/postgres(/.*)?"' 2024-09-11T23:19:00.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:19:00 smithi160 ceph-mon[35055]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-09-11T23:19:00.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:19:00 smithi160 ceph-mon[35055]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-11T23:19:00.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:19:00 smithi160 ceph-mon[35055]: from='client.15213 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:19:00.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:19:00 smithi123 ceph-mon[35438]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-09-11T23:19:00.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:19:00 smithi123 ceph-mon[35438]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-11T23:19:00.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:19:00 smithi123 ceph-mon[35438]: from='client.15213 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:19:01.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:19:01 smithi123 ceph-mon[35438]: pgmap v389: 129 pgs: 129 active+clean; 647 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 10 op/s 2024-09-11T23:19:01.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:19:01 smithi123 ceph-mon[35438]: mgrmap e19: x(active, since 10m), standbys: z, y 2024-09-11T23:19:01.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:19:01 smithi037 ceph-mon[30630]: pgmap v389: 129 pgs: 129 active+clean; 647 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 10 op/s 2024-09-11T23:19:01.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:19:01 smithi037 ceph-mon[30630]: mgrmap e19: x(active, since 10m), standbys: z, y 2024-09-11T23:19:01.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:19:01 smithi160 ceph-mon[35055]: pgmap v389: 129 pgs: 129 active+clean; 647 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 10 op/s 2024-09-11T23:19:01.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:19:01 smithi160 ceph-mon[35055]: mgrmap e19: x(active, since 10m), standbys: z, y 2024-09-11T23:19:02.825 DEBUG:teuthology.orchestra.run.smithi037:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo grep -i postgresql /etc/selinux/targeted/contexts/files/file_contexts.local' 2024-09-11T23:19:02.903 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres(/.*)? system_u:object_r:postgresql_db_t:s0 2024-09-11T23:19:02.908 DEBUG:teuthology.orchestra.run.smithi037:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo restorecon -R -v /tmp/cephfs/postgres' 2024-09-11T23:19:02.992 DEBUG:teuthology.orchestra.run.smithi037:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -lZaR /tmp/cephfs/postgres/' 2024-09-11T23:19:03.069 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/: 2024-09-11T23:19:03.070 INFO:teuthology.orchestra.run.smithi037.stdout:total 0 2024-09-11T23:19:03.070 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 11 23:19 . 2024-09-11T23:19:03.070 INFO:teuthology.orchestra.run.smithi037.stdout:drwxrwxrwt. 3 root root system_u:object_r:postgresql_db_t:s0 1 Sep 11 23:19 .. 2024-09-11T23:19:03.070 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 data 2024-09-11T23:19:03.070 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:19:03.070 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data: 2024-09-11T23:19:03.070 INFO:teuthology.orchestra.run.smithi037.stdout:total 0 2024-09-11T23:19:03.070 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 . 2024-09-11T23:19:03.070 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 11 23:19 .. 2024-09-11T23:19:03.078 DEBUG:teuthology.orchestra.run.smithi037:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo mkdir -p /etc/systemd/system/postgresql.service.d/ && printf '"'"'[Service]\nEnvironment=PGDATA=/tmp/cephfs/postgres/data\nEnvironment=PGLOG=/tmp/cephfs/postgres/pgstartup.log\n'"'"' | sudo tee /etc/systemd/system/postgresql.service.d/env.conf' 2024-09-11T23:19:03.174 INFO:teuthology.orchestra.run.smithi037.stdout:[Service] 2024-09-11T23:19:03.175 INFO:teuthology.orchestra.run.smithi037.stdout:Environment=PGDATA=/tmp/cephfs/postgres/data 2024-09-11T23:19:03.175 INFO:teuthology.orchestra.run.smithi037.stdout:Environment=PGLOG=/tmp/cephfs/postgres/pgstartup.log 2024-09-11T23:19:03.179 DEBUG:teuthology.orchestra.run.smithi037:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- postgresql-setup --initdb' 2024-09-11T23:19:03.357 INFO:teuthology.orchestra.run.smithi037.stderr: * Initializing database in '/tmp/cephfs/postgres/data' 2024-09-11T23:19:03.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:19:03 smithi123 ceph-mon[35438]: pgmap v390: 129 pgs: 129 active+clean; 661 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-09-11T23:19:03.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:19:03 smithi037 ceph-mon[30630]: pgmap v390: 129 pgs: 129 active+clean; 661 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-09-11T23:19:03.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:19:03 smithi160 ceph-mon[35055]: pgmap v390: 129 pgs: 129 active+clean; 661 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-09-11T23:19:05.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:19:05 smithi123 ceph-mon[35438]: pgmap v391: 129 pgs: 129 active+clean; 661 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 2.0 KiB/s wr, 11 op/s 2024-09-11T23:19:05.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:19:05 smithi037 ceph-mon[30630]: pgmap v391: 129 pgs: 129 active+clean; 661 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 2.0 KiB/s wr, 11 op/s 2024-09-11T23:19:05.933 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:19:05 smithi160 ceph-mon[35055]: pgmap v391: 129 pgs: 129 active+clean; 661 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 2.0 KiB/s wr, 11 op/s 2024-09-11T23:19:07.736 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:19:07 smithi160 ceph-mon[35055]: pgmap v392: 129 pgs: 129 active+clean; 3.2 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 233 KiB/s wr, 21 op/s 2024-09-11T23:19:07.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:19:07 smithi123 ceph-mon[35438]: pgmap v392: 129 pgs: 129 active+clean; 3.2 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 233 KiB/s wr, 21 op/s 2024-09-11T23:19:07.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:19:07 smithi037 ceph-mon[30630]: pgmap v392: 129 pgs: 129 active+clean; 3.2 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 233 KiB/s wr, 21 op/s 2024-09-11T23:19:08.349 INFO:teuthology.orchestra.run.smithi037.stderr: * Initialized, logs are in /var/lib/pgsql/initdb_postgresql.log 2024-09-11T23:19:08.354 DEBUG:teuthology.orchestra.run.smithi037:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -lZaR /tmp/cephfs/postgres/' 2024-09-11T23:19:08.448 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/: 2024-09-11T23:19:08.448 INFO:teuthology.orchestra.run.smithi037.stdout:total 0 2024-09-11T23:19:08.448 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 11 23:19 . 2024-09-11T23:19:08.448 INFO:teuthology.orchestra.run.smithi037.stdout:drwxrwxrwt. 3 root root system_u:object_r:postgresql_db_t:s0 1 Sep 11 23:19 .. 2024-09-11T23:19:08.448 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 11 23:19 data 2024-09-11T23:19:08.448 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:19:08.448 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data: 2024-09-11T23:19:08.448 INFO:teuthology.orchestra.run.smithi037.stdout:total 35 2024-09-11T23:19:08.449 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 11 23:19 . 2024-09-11T23:19:08.449 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 11 23:19 .. 2024-09-11T23:19:08.449 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 11 23:19 base 2024-09-11T23:19:08.449 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 57 Sep 11 23:19 global 2024-09-11T23:19:08.449 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 log 2024-09-11T23:19:08.449 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 pg_commit_ts 2024-09-11T23:19:08.449 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 pg_dynshmem 2024-09-11T23:19:08.449 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 4516 Sep 11 23:19 pg_hba.conf 2024-09-11T23:19:08.449 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1636 Sep 11 23:19 pg_ident.conf 2024-09-11T23:19:08.449 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 11 23:19 pg_logical 2024-09-11T23:19:08.449 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 11 23:19 pg_multixact 2024-09-11T23:19:08.449 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 pg_notify 2024-09-11T23:19:08.449 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 pg_replslot 2024-09-11T23:19:08.450 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 pg_serial 2024-09-11T23:19:08.450 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 pg_snapshots 2024-09-11T23:19:08.450 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 pg_stat 2024-09-11T23:19:08.450 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 pg_stat_tmp 2024-09-11T23:19:08.450 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 11 23:19 pg_subtrans 2024-09-11T23:19:08.450 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 pg_tblspc 2024-09-11T23:19:08.450 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 pg_twophase 2024-09-11T23:19:08.450 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 11 23:19 PG_VERSION 2024-09-11T23:19:08.450 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 11 23:19 pg_wal 2024-09-11T23:19:08.450 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 11 23:19 pg_xact 2024-09-11T23:19:08.450 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 88 Sep 11 23:19 postgresql.auto.conf 2024-09-11T23:19:08.451 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 28074 Sep 11 23:19 postgresql.conf 2024-09-11T23:19:08.451 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:19:08.451 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/base: 2024-09-11T23:19:08.451 INFO:teuthology.orchestra.run.smithi037.stdout:total 0 2024-09-11T23:19:08.451 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 11 23:19 . 2024-09-11T23:19:08.451 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 11 23:19 .. 2024-09-11T23:19:08.451 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Sep 11 23:19 1 2024-09-11T23:19:08.451 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Sep 11 23:19 13493 2024-09-11T23:19:08.451 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Sep 11 23:19 13494 2024-09-11T23:19:08.451 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:19:08.451 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/base/1: 2024-09-11T23:19:08.451 INFO:teuthology.orchestra.run.smithi037.stdout:total 7777 2024-09-11T23:19:08.451 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Sep 11 23:19 . 2024-09-11T23:19:08.452 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 11 23:19 .. 2024-09-11T23:19:08.452 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 112 2024-09-11T23:19:08.452 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 113 2024-09-11T23:19:08.452 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 11 23:19 1247 2024-09-11T23:19:08.452 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 1247_fsm 2024-09-11T23:19:08.452 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 1247_vm 2024-09-11T23:19:08.452 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 Sep 11 23:19 1249 2024-09-11T23:19:08.452 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 1249_fsm 2024-09-11T23:19:08.452 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 1249_vm 2024-09-11T23:19:08.452 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 Sep 11 23:19 1255 2024-09-11T23:19:08.452 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 1255_fsm 2024-09-11T23:19:08.452 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 1255_vm 2024-09-11T23:19:08.453 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Sep 11 23:19 1259 2024-09-11T23:19:08.453 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 1259_fsm 2024-09-11T23:19:08.453 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 1259_vm 2024-09-11T23:19:08.453 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Sep 11 23:19 13344 2024-09-11T23:19:08.453 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 13344_fsm 2024-09-11T23:19:08.453 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 13344_vm 2024-09-11T23:19:08.453 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 13346 2024-09-11T23:19:08.453 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 13348 2024-09-11T23:19:08.453 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 13349 2024-09-11T23:19:08.453 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 13349_fsm 2024-09-11T23:19:08.453 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 13349_vm 2024-09-11T23:19:08.453 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 13351 2024-09-11T23:19:08.453 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 13353 2024-09-11T23:19:08.453 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 13354 2024-09-11T23:19:08.454 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 13354_fsm 2024-09-11T23:19:08.454 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 13354_vm 2024-09-11T23:19:08.454 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 13356 2024-09-11T23:19:08.454 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 13358 2024-09-11T23:19:08.454 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 13359 2024-09-11T23:19:08.454 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 13359_fsm 2024-09-11T23:19:08.454 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 13359_vm 2024-09-11T23:19:08.454 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 13361 2024-09-11T23:19:08.454 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 13363 2024-09-11T23:19:08.454 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 1417 2024-09-11T23:19:08.454 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 1418 2024-09-11T23:19:08.454 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 174 2024-09-11T23:19:08.454 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 175 2024-09-11T23:19:08.454 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2187 2024-09-11T23:19:08.455 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 2224 2024-09-11T23:19:08.455 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 2328 2024-09-11T23:19:08.455 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 2336 2024-09-11T23:19:08.455 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2337 2024-09-11T23:19:08.455 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2579 2024-09-11T23:19:08.455 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2600 2024-09-11T23:19:08.455 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2600_fsm 2024-09-11T23:19:08.455 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2600_vm 2024-09-11T23:19:08.455 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2601 2024-09-11T23:19:08.455 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2601_fsm 2024-09-11T23:19:08.455 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2601_vm 2024-09-11T23:19:08.455 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 11 23:19 2602 2024-09-11T23:19:08.455 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2602_fsm 2024-09-11T23:19:08.456 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2602_vm 2024-09-11T23:19:08.456 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 11 23:19 2603 2024-09-11T23:19:08.456 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2603_fsm 2024-09-11T23:19:08.456 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2603_vm 2024-09-11T23:19:08.456 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 2604 2024-09-11T23:19:08.456 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2605 2024-09-11T23:19:08.456 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2605_fsm 2024-09-11T23:19:08.456 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2605_vm 2024-09-11T23:19:08.456 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2606 2024-09-11T23:19:08.456 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2606_fsm 2024-09-11T23:19:08.456 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2606_vm 2024-09-11T23:19:08.456 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2607 2024-09-11T23:19:08.456 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2607_fsm 2024-09-11T23:19:08.456 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2607_vm 2024-09-11T23:19:08.457 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 Sep 11 23:19 2608 2024-09-11T23:19:08.457 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2608_fsm 2024-09-11T23:19:08.457 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2608_vm 2024-09-11T23:19:08.457 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 Sep 11 23:19 2609 2024-09-11T23:19:08.457 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2609_fsm 2024-09-11T23:19:08.457 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2609_vm 2024-09-11T23:19:08.457 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 11 23:19 2610 2024-09-11T23:19:08.457 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2610_fsm 2024-09-11T23:19:08.457 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2610_vm 2024-09-11T23:19:08.457 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 2611 2024-09-11T23:19:08.457 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2612 2024-09-11T23:19:08.457 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2612_fsm 2024-09-11T23:19:08.457 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2612_vm 2024-09-11T23:19:08.458 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 2613 2024-09-11T23:19:08.458 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2615 2024-09-11T23:19:08.458 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2615_fsm 2024-09-11T23:19:08.458 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2615_vm 2024-09-11T23:19:08.458 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2616 2024-09-11T23:19:08.458 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2616_fsm 2024-09-11T23:19:08.458 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2616_vm 2024-09-11T23:19:08.458 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Sep 11 23:19 2617 2024-09-11T23:19:08.458 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2617_fsm 2024-09-11T23:19:08.458 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2617_vm 2024-09-11T23:19:08.458 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Sep 11 23:19 2618 2024-09-11T23:19:08.458 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2618_fsm 2024-09-11T23:19:08.458 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2618_vm 2024-09-11T23:19:08.459 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 Sep 11 23:19 2619 2024-09-11T23:19:08.459 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2619_fsm 2024-09-11T23:19:08.459 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2619_vm 2024-09-11T23:19:08.459 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 2620 2024-09-11T23:19:08.459 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2650 2024-09-11T23:19:08.459 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2651 2024-09-11T23:19:08.459 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2652 2024-09-11T23:19:08.459 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 11 23:19 2653 2024-09-11T23:19:08.459 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 11 23:19 2654 2024-09-11T23:19:08.459 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 11 23:19 2655 2024-09-11T23:19:08.459 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2656 2024-09-11T23:19:08.459 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2657 2024-09-11T23:19:08.459 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Sep 11 23:19 2658 2024-09-11T23:19:08.459 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 11 23:19 2659 2024-09-11T23:19:08.460 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2660 2024-09-11T23:19:08.460 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2661 2024-09-11T23:19:08.460 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 11 23:19 2662 2024-09-11T23:19:08.460 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 11 23:19 2663 2024-09-11T23:19:08.460 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2664 2024-09-11T23:19:08.460 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2665 2024-09-11T23:19:08.460 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2666 2024-09-11T23:19:08.460 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2667 2024-09-11T23:19:08.460 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2668 2024-09-11T23:19:08.460 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2669 2024-09-11T23:19:08.460 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2670 2024-09-11T23:19:08.460 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 Sep 11 23:19 2673 2024-09-11T23:19:08.460 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 Sep 11 23:19 2674 2024-09-11T23:19:08.460 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Sep 11 23:19 2675 2024-09-11T23:19:08.461 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2678 2024-09-11T23:19:08.461 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2679 2024-09-11T23:19:08.461 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2680 2024-09-11T23:19:08.461 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2681 2024-09-11T23:19:08.461 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2682 2024-09-11T23:19:08.461 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2683 2024-09-11T23:19:08.461 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2684 2024-09-11T23:19:08.461 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2685 2024-09-11T23:19:08.461 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2686 2024-09-11T23:19:08.461 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2687 2024-09-11T23:19:08.461 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 11 23:19 2688 2024-09-11T23:19:08.461 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 11 23:19 2689 2024-09-11T23:19:08.461 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Sep 11 23:19 2690 2024-09-11T23:19:08.461 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 Sep 11 23:19 2691 2024-09-11T23:19:08.462 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2692 2024-09-11T23:19:08.462 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2693 2024-09-11T23:19:08.462 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2696 2024-09-11T23:19:08.462 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2699 2024-09-11T23:19:08.462 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2701 2024-09-11T23:19:08.462 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2702 2024-09-11T23:19:08.462 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 11 23:19 2703 2024-09-11T23:19:08.462 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 11 23:19 2704 2024-09-11T23:19:08.462 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2753 2024-09-11T23:19:08.462 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2753_fsm 2024-09-11T23:19:08.462 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2753_vm 2024-09-11T23:19:08.462 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2754 2024-09-11T23:19:08.462 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2755 2024-09-11T23:19:08.463 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 11 23:19 2756 2024-09-11T23:19:08.463 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 11 23:19 2757 2024-09-11T23:19:08.463 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 2830 2024-09-11T23:19:08.463 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2831 2024-09-11T23:19:08.463 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 2832 2024-09-11T23:19:08.463 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2833 2024-09-11T23:19:08.463 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 2834 2024-09-11T23:19:08.463 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2835 2024-09-11T23:19:08.463 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 2836 2024-09-11T23:19:08.463 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2837 2024-09-11T23:19:08.463 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 Sep 11 23:19 2838 2024-09-11T23:19:08.463 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2838_fsm 2024-09-11T23:19:08.463 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2838_vm 2024-09-11T23:19:08.464 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2839 2024-09-11T23:19:08.464 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2840 2024-09-11T23:19:08.464 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2840_fsm 2024-09-11T23:19:08.464 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2840_vm 2024-09-11T23:19:08.464 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2841 2024-09-11T23:19:08.464 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 2995 2024-09-11T23:19:08.464 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2996 2024-09-11T23:19:08.464 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3079 2024-09-11T23:19:08.464 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 3079_fsm 2024-09-11T23:19:08.464 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3079_vm 2024-09-11T23:19:08.464 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 3080 2024-09-11T23:19:08.464 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 3081 2024-09-11T23:19:08.464 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 11 23:19 3085 2024-09-11T23:19:08.465 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 3118 2024-09-11T23:19:08.465 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3119 2024-09-11T23:19:08.465 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Sep 11 23:19 3164 2024-09-11T23:19:08.465 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 3256 2024-09-11T23:19:08.465 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3257 2024-09-11T23:19:08.465 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3258 2024-09-11T23:19:08.465 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 3350 2024-09-11T23:19:08.465 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3351 2024-09-11T23:19:08.465 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3379 2024-09-11T23:19:08.465 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3380 2024-09-11T23:19:08.465 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 3381 2024-09-11T23:19:08.465 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 3394 2024-09-11T23:19:08.465 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 3394_fsm 2024-09-11T23:19:08.466 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3394_vm 2024-09-11T23:19:08.466 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 3395 2024-09-11T23:19:08.466 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 3429 2024-09-11T23:19:08.466 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 3430 2024-09-11T23:19:08.466 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3431 2024-09-11T23:19:08.466 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3433 2024-09-11T23:19:08.466 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 3439 2024-09-11T23:19:08.466 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3440 2024-09-11T23:19:08.466 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 11 23:19 3455 2024-09-11T23:19:08.466 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 Sep 11 23:19 3456 2024-09-11T23:19:08.466 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 3456_fsm 2024-09-11T23:19:08.466 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3456_vm 2024-09-11T23:19:08.466 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 3466 2024-09-11T23:19:08.466 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3467 2024-09-11T23:19:08.467 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3468 2024-09-11T23:19:08.467 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 3501 2024-09-11T23:19:08.467 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3502 2024-09-11T23:19:08.467 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3503 2024-09-11T23:19:08.467 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3534 2024-09-11T23:19:08.467 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3541 2024-09-11T23:19:08.467 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 3541_fsm 2024-09-11T23:19:08.467 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3541_vm 2024-09-11T23:19:08.467 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 3542 2024-09-11T23:19:08.467 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3574 2024-09-11T23:19:08.467 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3575 2024-09-11T23:19:08.467 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 3576 2024-09-11T23:19:08.467 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 3596 2024-09-11T23:19:08.467 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3597 2024-09-11T23:19:08.468 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 3598 2024-09-11T23:19:08.468 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3599 2024-09-11T23:19:08.468 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3600 2024-09-11T23:19:08.468 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 3600_fsm 2024-09-11T23:19:08.468 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3600_vm 2024-09-11T23:19:08.468 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3601 2024-09-11T23:19:08.468 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 3601_fsm 2024-09-11T23:19:08.468 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3601_vm 2024-09-11T23:19:08.468 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3602 2024-09-11T23:19:08.468 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 3602_fsm 2024-09-11T23:19:08.468 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3602_vm 2024-09-11T23:19:08.468 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 3603 2024-09-11T23:19:08.468 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 3603_fsm 2024-09-11T23:19:08.469 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3603_vm 2024-09-11T23:19:08.469 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 3604 2024-09-11T23:19:08.469 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 3605 2024-09-11T23:19:08.469 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 3606 2024-09-11T23:19:08.469 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 3607 2024-09-11T23:19:08.469 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 3608 2024-09-11T23:19:08.469 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 11 23:19 3609 2024-09-11T23:19:08.469 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 3712 2024-09-11T23:19:08.469 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3764 2024-09-11T23:19:08.469 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 3764_fsm 2024-09-11T23:19:08.469 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3764_vm 2024-09-11T23:19:08.469 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 3766 2024-09-11T23:19:08.469 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 3767 2024-09-11T23:19:08.470 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3997 2024-09-11T23:19:08.470 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 4143 2024-09-11T23:19:08.470 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 4144 2024-09-11T23:19:08.470 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 4145 2024-09-11T23:19:08.470 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 4146 2024-09-11T23:19:08.470 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 4147 2024-09-11T23:19:08.470 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 4148 2024-09-11T23:19:08.470 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 4149 2024-09-11T23:19:08.470 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 4150 2024-09-11T23:19:08.470 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 4151 2024-09-11T23:19:08.470 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 4152 2024-09-11T23:19:08.470 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 4153 2024-09-11T23:19:08.470 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 4154 2024-09-11T23:19:08.471 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 4155 2024-09-11T23:19:08.471 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 4156 2024-09-11T23:19:08.471 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 4157 2024-09-11T23:19:08.471 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 4158 2024-09-11T23:19:08.471 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 4159 2024-09-11T23:19:08.471 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 4160 2024-09-11T23:19:08.471 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 4161 2024-09-11T23:19:08.471 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 4162 2024-09-11T23:19:08.471 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 4163 2024-09-11T23:19:08.471 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 4164 2024-09-11T23:19:08.471 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 4165 2024-09-11T23:19:08.472 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 4166 2024-09-11T23:19:08.473 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 4167 2024-09-11T23:19:08.473 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 4168 2024-09-11T23:19:08.473 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 4169 2024-09-11T23:19:08.473 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 4170 2024-09-11T23:19:08.473 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 4171 2024-09-11T23:19:08.473 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 4172 2024-09-11T23:19:08.473 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 4173 2024-09-11T23:19:08.473 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 4174 2024-09-11T23:19:08.473 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 5002 2024-09-11T23:19:08.473 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 548 2024-09-11T23:19:08.473 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 549 2024-09-11T23:19:08.473 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 6102 2024-09-11T23:19:08.474 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 6104 2024-09-11T23:19:08.474 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 6106 2024-09-11T23:19:08.474 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 6110 2024-09-11T23:19:08.474 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 6111 2024-09-11T23:19:08.474 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 6112 2024-09-11T23:19:08.474 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 6113 2024-09-11T23:19:08.474 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 6117 2024-09-11T23:19:08.474 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 826 2024-09-11T23:19:08.474 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 827 2024-09-11T23:19:08.474 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 828 2024-09-11T23:19:08.474 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 11 23:19 pg_filenode.map 2024-09-11T23:19:08.474 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 11 23:19 PG_VERSION 2024-09-11T23:19:08.474 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:19:08.474 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/base/13493: 2024-09-11T23:19:08.475 INFO:teuthology.orchestra.run.smithi037.stdout:total 7777 2024-09-11T23:19:08.475 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Sep 11 23:19 . 2024-09-11T23:19:08.475 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 11 23:19 .. 2024-09-11T23:19:08.475 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 112 2024-09-11T23:19:08.475 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 113 2024-09-11T23:19:08.475 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 11 23:19 1247 2024-09-11T23:19:08.475 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 1247_fsm 2024-09-11T23:19:08.475 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 1247_vm 2024-09-11T23:19:08.475 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 Sep 11 23:19 1249 2024-09-11T23:19:08.475 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 1249_fsm 2024-09-11T23:19:08.475 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 1249_vm 2024-09-11T23:19:08.475 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 Sep 11 23:19 1255 2024-09-11T23:19:08.475 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 1255_fsm 2024-09-11T23:19:08.476 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 1255_vm 2024-09-11T23:19:08.476 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Sep 11 23:19 1259 2024-09-11T23:19:08.476 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 1259_fsm 2024-09-11T23:19:08.476 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 1259_vm 2024-09-11T23:19:08.476 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Sep 11 23:19 13344 2024-09-11T23:19:08.476 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 13344_fsm 2024-09-11T23:19:08.476 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 13344_vm 2024-09-11T23:19:08.476 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 13346 2024-09-11T23:19:08.476 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 13348 2024-09-11T23:19:08.476 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 13349 2024-09-11T23:19:08.476 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 13349_fsm 2024-09-11T23:19:08.476 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 13349_vm 2024-09-11T23:19:08.476 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 13351 2024-09-11T23:19:08.476 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 13353 2024-09-11T23:19:08.477 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 13354 2024-09-11T23:19:08.477 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 13354_fsm 2024-09-11T23:19:08.477 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 13354_vm 2024-09-11T23:19:08.477 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 13356 2024-09-11T23:19:08.477 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 13358 2024-09-11T23:19:08.477 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 13359 2024-09-11T23:19:08.477 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 13359_fsm 2024-09-11T23:19:08.477 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 13359_vm 2024-09-11T23:19:08.477 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 13361 2024-09-11T23:19:08.477 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 13363 2024-09-11T23:19:08.477 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 1417 2024-09-11T23:19:08.477 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 1418 2024-09-11T23:19:08.477 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 174 2024-09-11T23:19:08.477 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 175 2024-09-11T23:19:08.478 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2187 2024-09-11T23:19:08.478 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 2224 2024-09-11T23:19:08.478 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 2328 2024-09-11T23:19:08.478 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 2336 2024-09-11T23:19:08.478 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2337 2024-09-11T23:19:08.478 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2579 2024-09-11T23:19:08.478 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2600 2024-09-11T23:19:08.478 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2600_fsm 2024-09-11T23:19:08.478 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2600_vm 2024-09-11T23:19:08.478 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2601 2024-09-11T23:19:08.478 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2601_fsm 2024-09-11T23:19:08.478 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2601_vm 2024-09-11T23:19:08.478 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 11 23:19 2602 2024-09-11T23:19:08.478 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2602_fsm 2024-09-11T23:19:08.479 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2602_vm 2024-09-11T23:19:08.479 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 11 23:19 2603 2024-09-11T23:19:08.479 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2603_fsm 2024-09-11T23:19:08.479 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2603_vm 2024-09-11T23:19:08.479 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 2604 2024-09-11T23:19:08.479 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2605 2024-09-11T23:19:08.479 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2605_fsm 2024-09-11T23:19:08.479 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2605_vm 2024-09-11T23:19:08.479 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2606 2024-09-11T23:19:08.479 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2606_fsm 2024-09-11T23:19:08.479 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2606_vm 2024-09-11T23:19:08.479 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2607 2024-09-11T23:19:08.479 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2607_fsm 2024-09-11T23:19:08.479 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2607_vm 2024-09-11T23:19:08.480 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 Sep 11 23:19 2608 2024-09-11T23:19:08.480 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2608_fsm 2024-09-11T23:19:08.480 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2608_vm 2024-09-11T23:19:08.480 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 Sep 11 23:19 2609 2024-09-11T23:19:08.480 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2609_fsm 2024-09-11T23:19:08.480 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2609_vm 2024-09-11T23:19:08.480 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 11 23:19 2610 2024-09-11T23:19:08.480 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2610_fsm 2024-09-11T23:19:08.480 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2610_vm 2024-09-11T23:19:08.480 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 2611 2024-09-11T23:19:08.480 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2612 2024-09-11T23:19:08.480 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2612_fsm 2024-09-11T23:19:08.480 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2612_vm 2024-09-11T23:19:08.481 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 2613 2024-09-11T23:19:08.481 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2615 2024-09-11T23:19:08.481 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2615_fsm 2024-09-11T23:19:08.481 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2615_vm 2024-09-11T23:19:08.481 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2616 2024-09-11T23:19:08.481 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2616_fsm 2024-09-11T23:19:08.481 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2616_vm 2024-09-11T23:19:08.481 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Sep 11 23:19 2617 2024-09-11T23:19:08.481 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2617_fsm 2024-09-11T23:19:08.481 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2617_vm 2024-09-11T23:19:08.481 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Sep 11 23:19 2618 2024-09-11T23:19:08.481 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2618_fsm 2024-09-11T23:19:08.481 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2618_vm 2024-09-11T23:19:08.482 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 Sep 11 23:19 2619 2024-09-11T23:19:08.482 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2619_fsm 2024-09-11T23:19:08.482 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2619_vm 2024-09-11T23:19:08.482 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 2620 2024-09-11T23:19:08.482 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2650 2024-09-11T23:19:08.482 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2651 2024-09-11T23:19:08.482 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2652 2024-09-11T23:19:08.482 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 11 23:19 2653 2024-09-11T23:19:08.482 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 11 23:19 2654 2024-09-11T23:19:08.482 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 11 23:19 2655 2024-09-11T23:19:08.482 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2656 2024-09-11T23:19:08.482 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2657 2024-09-11T23:19:08.482 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Sep 11 23:19 2658 2024-09-11T23:19:08.482 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 11 23:19 2659 2024-09-11T23:19:08.483 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2660 2024-09-11T23:19:08.483 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2661 2024-09-11T23:19:08.483 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 11 23:19 2662 2024-09-11T23:19:08.483 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 11 23:19 2663 2024-09-11T23:19:08.483 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2664 2024-09-11T23:19:08.483 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2665 2024-09-11T23:19:08.483 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2666 2024-09-11T23:19:08.483 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2667 2024-09-11T23:19:08.483 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2668 2024-09-11T23:19:08.483 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2669 2024-09-11T23:19:08.483 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2670 2024-09-11T23:19:08.483 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 Sep 11 23:19 2673 2024-09-11T23:19:08.483 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 Sep 11 23:19 2674 2024-09-11T23:19:08.483 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Sep 11 23:19 2675 2024-09-11T23:19:08.483 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2678 2024-09-11T23:19:08.484 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2679 2024-09-11T23:19:08.484 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2680 2024-09-11T23:19:08.484 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2681 2024-09-11T23:19:08.484 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2682 2024-09-11T23:19:08.484 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2683 2024-09-11T23:19:08.484 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2684 2024-09-11T23:19:08.484 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2685 2024-09-11T23:19:08.484 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2686 2024-09-11T23:19:08.484 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2687 2024-09-11T23:19:08.484 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 11 23:19 2688 2024-09-11T23:19:08.484 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 11 23:19 2689 2024-09-11T23:19:08.484 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Sep 11 23:19 2690 2024-09-11T23:19:08.484 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 Sep 11 23:19 2691 2024-09-11T23:19:08.485 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2692 2024-09-11T23:19:08.485 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2693 2024-09-11T23:19:08.485 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2696 2024-09-11T23:19:08.485 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2699 2024-09-11T23:19:08.485 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2701 2024-09-11T23:19:08.485 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2702 2024-09-11T23:19:08.485 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 11 23:19 2703 2024-09-11T23:19:08.485 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 11 23:19 2704 2024-09-11T23:19:08.485 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2753 2024-09-11T23:19:08.485 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2753_fsm 2024-09-11T23:19:08.485 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2753_vm 2024-09-11T23:19:08.485 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2754 2024-09-11T23:19:08.485 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2755 2024-09-11T23:19:08.485 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 11 23:19 2756 2024-09-11T23:19:08.486 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 11 23:19 2757 2024-09-11T23:19:08.486 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 2830 2024-09-11T23:19:08.486 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2831 2024-09-11T23:19:08.486 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 2832 2024-09-11T23:19:08.486 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2833 2024-09-11T23:19:08.486 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 2834 2024-09-11T23:19:08.486 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2835 2024-09-11T23:19:08.486 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 2836 2024-09-11T23:19:08.486 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2837 2024-09-11T23:19:08.486 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 Sep 11 23:19 2838 2024-09-11T23:19:08.486 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2838_fsm 2024-09-11T23:19:08.486 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2838_vm 2024-09-11T23:19:08.487 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2839 2024-09-11T23:19:08.487 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2840 2024-09-11T23:19:08.487 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2840_fsm 2024-09-11T23:19:08.487 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2840_vm 2024-09-11T23:19:08.487 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2841 2024-09-11T23:19:08.487 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 2995 2024-09-11T23:19:08.487 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2996 2024-09-11T23:19:08.487 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3079 2024-09-11T23:19:08.487 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 3079_fsm 2024-09-11T23:19:08.487 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3079_vm 2024-09-11T23:19:08.487 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 3080 2024-09-11T23:19:08.487 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 3081 2024-09-11T23:19:08.487 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 11 23:19 3085 2024-09-11T23:19:08.488 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 3118 2024-09-11T23:19:08.488 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3119 2024-09-11T23:19:08.488 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Sep 11 23:19 3164 2024-09-11T23:19:08.488 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 3256 2024-09-11T23:19:08.488 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3257 2024-09-11T23:19:08.488 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3258 2024-09-11T23:19:08.488 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 3350 2024-09-11T23:19:08.488 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3351 2024-09-11T23:19:08.488 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3379 2024-09-11T23:19:08.488 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3380 2024-09-11T23:19:08.488 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 3381 2024-09-11T23:19:08.488 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 3394 2024-09-11T23:19:08.488 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 3394_fsm 2024-09-11T23:19:08.488 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3394_vm 2024-09-11T23:19:08.489 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 3395 2024-09-11T23:19:08.489 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 3429 2024-09-11T23:19:08.489 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 3430 2024-09-11T23:19:08.489 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3431 2024-09-11T23:19:08.489 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3433 2024-09-11T23:19:08.489 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 3439 2024-09-11T23:19:08.489 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3440 2024-09-11T23:19:08.489 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 11 23:19 3455 2024-09-11T23:19:08.489 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 Sep 11 23:19 3456 2024-09-11T23:19:08.489 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 3456_fsm 2024-09-11T23:19:08.489 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3456_vm 2024-09-11T23:19:08.489 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 3466 2024-09-11T23:19:08.489 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3467 2024-09-11T23:19:08.490 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3468 2024-09-11T23:19:08.490 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 3501 2024-09-11T23:19:08.490 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3502 2024-09-11T23:19:08.490 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3503 2024-09-11T23:19:08.490 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3534 2024-09-11T23:19:08.490 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3541 2024-09-11T23:19:08.490 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 3541_fsm 2024-09-11T23:19:08.490 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3541_vm 2024-09-11T23:19:08.490 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 3542 2024-09-11T23:19:08.490 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3574 2024-09-11T23:19:08.490 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3575 2024-09-11T23:19:08.490 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 3576 2024-09-11T23:19:08.490 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 3596 2024-09-11T23:19:08.491 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3597 2024-09-11T23:19:08.491 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 3598 2024-09-11T23:19:08.491 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3599 2024-09-11T23:19:08.491 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3600 2024-09-11T23:19:08.491 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 3600_fsm 2024-09-11T23:19:08.491 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3600_vm 2024-09-11T23:19:08.491 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3601 2024-09-11T23:19:08.491 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 3601_fsm 2024-09-11T23:19:08.491 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3601_vm 2024-09-11T23:19:08.491 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3602 2024-09-11T23:19:08.491 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 3602_fsm 2024-09-11T23:19:08.491 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3602_vm 2024-09-11T23:19:08.491 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 3603 2024-09-11T23:19:08.491 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 3603_fsm 2024-09-11T23:19:08.492 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3603_vm 2024-09-11T23:19:08.492 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 3604 2024-09-11T23:19:08.492 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 3605 2024-09-11T23:19:08.492 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 3606 2024-09-11T23:19:08.492 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 3607 2024-09-11T23:19:08.492 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 3608 2024-09-11T23:19:08.492 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 11 23:19 3609 2024-09-11T23:19:08.492 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 3712 2024-09-11T23:19:08.492 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3764 2024-09-11T23:19:08.492 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 3764_fsm 2024-09-11T23:19:08.492 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3764_vm 2024-09-11T23:19:08.492 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 3766 2024-09-11T23:19:08.492 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 3767 2024-09-11T23:19:08.492 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3997 2024-09-11T23:19:08.493 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 4143 2024-09-11T23:19:08.493 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 4144 2024-09-11T23:19:08.493 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 4145 2024-09-11T23:19:08.493 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 4146 2024-09-11T23:19:08.493 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 4147 2024-09-11T23:19:08.493 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 4148 2024-09-11T23:19:08.493 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 4149 2024-09-11T23:19:08.493 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 4150 2024-09-11T23:19:08.493 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 4151 2024-09-11T23:19:08.493 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 4152 2024-09-11T23:19:08.493 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 4153 2024-09-11T23:19:08.493 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 4154 2024-09-11T23:19:08.493 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 4155 2024-09-11T23:19:08.494 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 4156 2024-09-11T23:19:08.494 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 4157 2024-09-11T23:19:08.494 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 4158 2024-09-11T23:19:08.494 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 4159 2024-09-11T23:19:08.494 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 4160 2024-09-11T23:19:08.494 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 4161 2024-09-11T23:19:08.494 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 4162 2024-09-11T23:19:08.494 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 4163 2024-09-11T23:19:08.494 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 4164 2024-09-11T23:19:08.494 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 4165 2024-09-11T23:19:08.494 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 4166 2024-09-11T23:19:08.494 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 4167 2024-09-11T23:19:08.494 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 4168 2024-09-11T23:19:08.494 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 4169 2024-09-11T23:19:08.495 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 4170 2024-09-11T23:19:08.495 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 4171 2024-09-11T23:19:08.495 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 4172 2024-09-11T23:19:08.495 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 4173 2024-09-11T23:19:08.495 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 4174 2024-09-11T23:19:08.495 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 5002 2024-09-11T23:19:08.495 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 548 2024-09-11T23:19:08.497 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 549 2024-09-11T23:19:08.497 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 6102 2024-09-11T23:19:08.497 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 6104 2024-09-11T23:19:08.497 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 6106 2024-09-11T23:19:08.497 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 6110 2024-09-11T23:19:08.497 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 6111 2024-09-11T23:19:08.497 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 6112 2024-09-11T23:19:08.497 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 6113 2024-09-11T23:19:08.497 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 6117 2024-09-11T23:19:08.497 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 826 2024-09-11T23:19:08.497 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 827 2024-09-11T23:19:08.498 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 828 2024-09-11T23:19:08.498 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 11 23:19 pg_filenode.map 2024-09-11T23:19:08.498 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 11 23:19 PG_VERSION 2024-09-11T23:19:08.498 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:19:08.498 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/base/13494: 2024-09-11T23:19:08.498 INFO:teuthology.orchestra.run.smithi037.stdout:total 7777 2024-09-11T23:19:08.498 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Sep 11 23:19 . 2024-09-11T23:19:08.498 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 11 23:19 .. 2024-09-11T23:19:08.498 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 112 2024-09-11T23:19:08.498 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 113 2024-09-11T23:19:08.498 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 11 23:19 1247 2024-09-11T23:19:08.498 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 1247_fsm 2024-09-11T23:19:08.498 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 1247_vm 2024-09-11T23:19:08.499 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 Sep 11 23:19 1249 2024-09-11T23:19:08.499 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 1249_fsm 2024-09-11T23:19:08.499 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 1249_vm 2024-09-11T23:19:08.499 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 Sep 11 23:19 1255 2024-09-11T23:19:08.499 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 1255_fsm 2024-09-11T23:19:08.499 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 1255_vm 2024-09-11T23:19:08.499 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Sep 11 23:19 1259 2024-09-11T23:19:08.499 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 1259_fsm 2024-09-11T23:19:08.499 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 1259_vm 2024-09-11T23:19:08.499 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Sep 11 23:19 13344 2024-09-11T23:19:08.499 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 13344_fsm 2024-09-11T23:19:08.499 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 13344_vm 2024-09-11T23:19:08.499 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 13346 2024-09-11T23:19:08.500 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 13348 2024-09-11T23:19:08.500 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 13349 2024-09-11T23:19:08.500 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 13349_fsm 2024-09-11T23:19:08.500 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 13349_vm 2024-09-11T23:19:08.500 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 13351 2024-09-11T23:19:08.500 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 13353 2024-09-11T23:19:08.500 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 13354 2024-09-11T23:19:08.500 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 13354_fsm 2024-09-11T23:19:08.500 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 13354_vm 2024-09-11T23:19:08.500 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 13356 2024-09-11T23:19:08.500 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 13358 2024-09-11T23:19:08.500 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 13359 2024-09-11T23:19:08.500 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 13359_fsm 2024-09-11T23:19:08.501 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 13359_vm 2024-09-11T23:19:08.501 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 13361 2024-09-11T23:19:08.501 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 13363 2024-09-11T23:19:08.501 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 1417 2024-09-11T23:19:08.501 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 1418 2024-09-11T23:19:08.501 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 174 2024-09-11T23:19:08.501 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 175 2024-09-11T23:19:08.501 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2187 2024-09-11T23:19:08.501 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 2224 2024-09-11T23:19:08.501 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 2328 2024-09-11T23:19:08.501 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 2336 2024-09-11T23:19:08.501 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2337 2024-09-11T23:19:08.501 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2579 2024-09-11T23:19:08.502 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2600 2024-09-11T23:19:08.502 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2600_fsm 2024-09-11T23:19:08.502 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2600_vm 2024-09-11T23:19:08.502 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2601 2024-09-11T23:19:08.502 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2601_fsm 2024-09-11T23:19:08.502 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2601_vm 2024-09-11T23:19:08.502 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 11 23:19 2602 2024-09-11T23:19:08.502 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2602_fsm 2024-09-11T23:19:08.502 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2602_vm 2024-09-11T23:19:08.502 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 11 23:19 2603 2024-09-11T23:19:08.502 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2603_fsm 2024-09-11T23:19:08.502 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2603_vm 2024-09-11T23:19:08.502 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 2604 2024-09-11T23:19:08.502 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2605 2024-09-11T23:19:08.503 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2605_fsm 2024-09-11T23:19:08.503 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2605_vm 2024-09-11T23:19:08.503 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2606 2024-09-11T23:19:08.503 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2606_fsm 2024-09-11T23:19:08.503 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2606_vm 2024-09-11T23:19:08.503 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2607 2024-09-11T23:19:08.503 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2607_fsm 2024-09-11T23:19:08.503 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2607_vm 2024-09-11T23:19:08.503 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 Sep 11 23:19 2608 2024-09-11T23:19:08.503 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2608_fsm 2024-09-11T23:19:08.503 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2608_vm 2024-09-11T23:19:08.503 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 Sep 11 23:19 2609 2024-09-11T23:19:08.503 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2609_fsm 2024-09-11T23:19:08.503 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2609_vm 2024-09-11T23:19:08.504 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 11 23:19 2610 2024-09-11T23:19:08.504 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2610_fsm 2024-09-11T23:19:08.504 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2610_vm 2024-09-11T23:19:08.504 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 2611 2024-09-11T23:19:08.504 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2612 2024-09-11T23:19:08.504 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2612_fsm 2024-09-11T23:19:08.504 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2612_vm 2024-09-11T23:19:08.504 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 2613 2024-09-11T23:19:08.504 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2615 2024-09-11T23:19:08.504 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2615_fsm 2024-09-11T23:19:08.504 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2615_vm 2024-09-11T23:19:08.504 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2616 2024-09-11T23:19:08.504 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2616_fsm 2024-09-11T23:19:08.505 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2616_vm 2024-09-11T23:19:08.505 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Sep 11 23:19 2617 2024-09-11T23:19:08.505 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2617_fsm 2024-09-11T23:19:08.505 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2617_vm 2024-09-11T23:19:08.505 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Sep 11 23:19 2618 2024-09-11T23:19:08.505 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2618_fsm 2024-09-11T23:19:08.505 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2618_vm 2024-09-11T23:19:08.505 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 Sep 11 23:19 2619 2024-09-11T23:19:08.505 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2619_fsm 2024-09-11T23:19:08.505 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2619_vm 2024-09-11T23:19:08.505 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 2620 2024-09-11T23:19:08.505 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2650 2024-09-11T23:19:08.505 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2651 2024-09-11T23:19:08.505 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2652 2024-09-11T23:19:08.506 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 11 23:19 2653 2024-09-11T23:19:08.506 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 11 23:19 2654 2024-09-11T23:19:08.506 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 11 23:19 2655 2024-09-11T23:19:08.506 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2656 2024-09-11T23:19:08.506 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2657 2024-09-11T23:19:08.506 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Sep 11 23:19 2658 2024-09-11T23:19:08.506 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 11 23:19 2659 2024-09-11T23:19:08.506 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2660 2024-09-11T23:19:08.506 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2661 2024-09-11T23:19:08.506 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 11 23:19 2662 2024-09-11T23:19:08.506 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 11 23:19 2663 2024-09-11T23:19:08.506 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2664 2024-09-11T23:19:08.506 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2665 2024-09-11T23:19:08.506 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2666 2024-09-11T23:19:08.507 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2667 2024-09-11T23:19:08.507 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2668 2024-09-11T23:19:08.507 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2669 2024-09-11T23:19:08.507 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2670 2024-09-11T23:19:08.507 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 Sep 11 23:19 2673 2024-09-11T23:19:08.507 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 Sep 11 23:19 2674 2024-09-11T23:19:08.507 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Sep 11 23:19 2675 2024-09-11T23:19:08.507 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2678 2024-09-11T23:19:08.507 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2679 2024-09-11T23:19:08.507 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2680 2024-09-11T23:19:08.507 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2681 2024-09-11T23:19:08.507 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2682 2024-09-11T23:19:08.507 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2683 2024-09-11T23:19:08.507 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2684 2024-09-11T23:19:08.508 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2685 2024-09-11T23:19:08.508 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2686 2024-09-11T23:19:08.508 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2687 2024-09-11T23:19:08.508 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 11 23:19 2688 2024-09-11T23:19:08.508 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 11 23:19 2689 2024-09-11T23:19:08.508 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Sep 11 23:19 2690 2024-09-11T23:19:08.508 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 Sep 11 23:19 2691 2024-09-11T23:19:08.508 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2692 2024-09-11T23:19:08.508 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2693 2024-09-11T23:19:08.508 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2696 2024-09-11T23:19:08.508 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2699 2024-09-11T23:19:08.508 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2701 2024-09-11T23:19:08.508 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2702 2024-09-11T23:19:08.508 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 11 23:19 2703 2024-09-11T23:19:08.509 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 11 23:19 2704 2024-09-11T23:19:08.509 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2753 2024-09-11T23:19:08.509 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2753_fsm 2024-09-11T23:19:08.509 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2753_vm 2024-09-11T23:19:08.509 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2754 2024-09-11T23:19:08.509 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2755 2024-09-11T23:19:08.509 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 11 23:19 2756 2024-09-11T23:19:08.509 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 11 23:19 2757 2024-09-11T23:19:08.509 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 2830 2024-09-11T23:19:08.509 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2831 2024-09-11T23:19:08.509 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 2832 2024-09-11T23:19:08.509 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2833 2024-09-11T23:19:08.509 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 2834 2024-09-11T23:19:08.509 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2835 2024-09-11T23:19:08.510 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 2836 2024-09-11T23:19:08.510 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2837 2024-09-11T23:19:08.510 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 Sep 11 23:19 2838 2024-09-11T23:19:08.510 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2838_fsm 2024-09-11T23:19:08.510 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2838_vm 2024-09-11T23:19:08.510 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2839 2024-09-11T23:19:08.510 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2840 2024-09-11T23:19:08.510 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2840_fsm 2024-09-11T23:19:08.510 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2840_vm 2024-09-11T23:19:08.510 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2841 2024-09-11T23:19:08.510 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 2995 2024-09-11T23:19:08.510 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2996 2024-09-11T23:19:08.510 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3079 2024-09-11T23:19:08.510 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 3079_fsm 2024-09-11T23:19:08.510 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3079_vm 2024-09-11T23:19:08.511 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 3080 2024-09-11T23:19:08.511 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 3081 2024-09-11T23:19:08.511 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 11 23:19 3085 2024-09-11T23:19:08.511 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 3118 2024-09-11T23:19:08.511 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3119 2024-09-11T23:19:08.511 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Sep 11 23:19 3164 2024-09-11T23:19:08.511 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 3256 2024-09-11T23:19:08.511 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3257 2024-09-11T23:19:08.511 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3258 2024-09-11T23:19:08.511 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 3350 2024-09-11T23:19:08.511 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3351 2024-09-11T23:19:08.511 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3379 2024-09-11T23:19:08.511 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3380 2024-09-11T23:19:08.512 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 3381 2024-09-11T23:19:08.512 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 3394 2024-09-11T23:19:08.512 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 3394_fsm 2024-09-11T23:19:08.512 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3394_vm 2024-09-11T23:19:08.512 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 3395 2024-09-11T23:19:08.512 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 3429 2024-09-11T23:19:08.512 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 3430 2024-09-11T23:19:08.512 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3431 2024-09-11T23:19:08.512 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3433 2024-09-11T23:19:08.512 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 3439 2024-09-11T23:19:08.512 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3440 2024-09-11T23:19:08.512 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 11 23:19 3455 2024-09-11T23:19:08.512 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 Sep 11 23:19 3456 2024-09-11T23:19:08.512 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 3456_fsm 2024-09-11T23:19:08.513 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3456_vm 2024-09-11T23:19:08.513 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 3466 2024-09-11T23:19:08.513 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3467 2024-09-11T23:19:08.513 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3468 2024-09-11T23:19:08.513 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 3501 2024-09-11T23:19:08.513 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3502 2024-09-11T23:19:08.513 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3503 2024-09-11T23:19:08.513 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3534 2024-09-11T23:19:08.513 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3541 2024-09-11T23:19:08.513 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 3541_fsm 2024-09-11T23:19:08.513 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3541_vm 2024-09-11T23:19:08.513 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 3542 2024-09-11T23:19:08.513 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3574 2024-09-11T23:19:08.513 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3575 2024-09-11T23:19:08.514 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 3576 2024-09-11T23:19:08.514 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 3596 2024-09-11T23:19:08.514 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3597 2024-09-11T23:19:08.514 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 3598 2024-09-11T23:19:08.514 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3599 2024-09-11T23:19:08.514 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3600 2024-09-11T23:19:08.514 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 3600_fsm 2024-09-11T23:19:08.514 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3600_vm 2024-09-11T23:19:08.514 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3601 2024-09-11T23:19:08.514 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 3601_fsm 2024-09-11T23:19:08.514 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3601_vm 2024-09-11T23:19:08.514 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3602 2024-09-11T23:19:08.514 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 3602_fsm 2024-09-11T23:19:08.514 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3602_vm 2024-09-11T23:19:08.515 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 3603 2024-09-11T23:19:08.515 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 3603_fsm 2024-09-11T23:19:08.515 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3603_vm 2024-09-11T23:19:08.515 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 3604 2024-09-11T23:19:08.515 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 3605 2024-09-11T23:19:08.515 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 3606 2024-09-11T23:19:08.515 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 3607 2024-09-11T23:19:08.515 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 3608 2024-09-11T23:19:08.515 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 11 23:19 3609 2024-09-11T23:19:08.515 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 3712 2024-09-11T23:19:08.515 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3764 2024-09-11T23:19:08.515 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 3764_fsm 2024-09-11T23:19:08.515 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3764_vm 2024-09-11T23:19:08.515 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 3766 2024-09-11T23:19:08.516 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 3767 2024-09-11T23:19:08.516 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3997 2024-09-11T23:19:08.516 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 4143 2024-09-11T23:19:08.516 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 4144 2024-09-11T23:19:08.516 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 4145 2024-09-11T23:19:08.516 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 4146 2024-09-11T23:19:08.516 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 4147 2024-09-11T23:19:08.516 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 4148 2024-09-11T23:19:08.516 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 4149 2024-09-11T23:19:08.516 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 4150 2024-09-11T23:19:08.516 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 4151 2024-09-11T23:19:08.516 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 4152 2024-09-11T23:19:08.516 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 4153 2024-09-11T23:19:08.516 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 4154 2024-09-11T23:19:08.517 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 4155 2024-09-11T23:19:08.517 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 4156 2024-09-11T23:19:08.517 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 4157 2024-09-11T23:19:08.517 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 4158 2024-09-11T23:19:08.517 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 4159 2024-09-11T23:19:08.517 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 4160 2024-09-11T23:19:08.517 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 4161 2024-09-11T23:19:08.517 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 4162 2024-09-11T23:19:08.517 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 4163 2024-09-11T23:19:08.517 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 4164 2024-09-11T23:19:08.517 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 4165 2024-09-11T23:19:08.517 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 4166 2024-09-11T23:19:08.517 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 4167 2024-09-11T23:19:08.517 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 4168 2024-09-11T23:19:08.518 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 4169 2024-09-11T23:19:08.518 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 4170 2024-09-11T23:19:08.518 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 4171 2024-09-11T23:19:08.518 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 4172 2024-09-11T23:19:08.518 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 4173 2024-09-11T23:19:08.518 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 4174 2024-09-11T23:19:08.518 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 5002 2024-09-11T23:19:08.518 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 548 2024-09-11T23:19:08.518 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 549 2024-09-11T23:19:08.518 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 6102 2024-09-11T23:19:08.518 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 6104 2024-09-11T23:19:08.518 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 6106 2024-09-11T23:19:08.518 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 6110 2024-09-11T23:19:08.518 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 6111 2024-09-11T23:19:08.519 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 6112 2024-09-11T23:19:08.519 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 6113 2024-09-11T23:19:08.519 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 6117 2024-09-11T23:19:08.519 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 826 2024-09-11T23:19:08.519 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 827 2024-09-11T23:19:08.519 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 828 2024-09-11T23:19:08.519 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 11 23:19 pg_filenode.map 2024-09-11T23:19:08.519 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 11 23:19 PG_VERSION 2024-09-11T23:19:08.519 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:19:08.519 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/global: 2024-09-11T23:19:08.519 INFO:teuthology.orchestra.run.smithi037.stdout:total 537 2024-09-11T23:19:08.519 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 57 Sep 11 23:19 . 2024-09-11T23:19:08.519 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 11 23:19 .. 2024-09-11T23:19:08.519 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 1213 2024-09-11T23:19:08.520 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 1213_fsm 2024-09-11T23:19:08.520 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 1213_vm 2024-09-11T23:19:08.520 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 1214 2024-09-11T23:19:08.520 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 1214_fsm 2024-09-11T23:19:08.520 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 1214_vm 2024-09-11T23:19:08.520 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 1232 2024-09-11T23:19:08.520 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 1233 2024-09-11T23:19:08.520 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 1260 2024-09-11T23:19:08.520 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 1260_fsm 2024-09-11T23:19:08.520 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 1260_vm 2024-09-11T23:19:08.520 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 1261 2024-09-11T23:19:08.520 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 1261_fsm 2024-09-11T23:19:08.520 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 1261_vm 2024-09-11T23:19:08.521 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 1262 2024-09-11T23:19:08.521 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 1262_fsm 2024-09-11T23:19:08.521 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 1262_vm 2024-09-11T23:19:08.521 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2396 2024-09-11T23:19:08.521 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2396_fsm 2024-09-11T23:19:08.521 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2396_vm 2024-09-11T23:19:08.521 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2397 2024-09-11T23:19:08.521 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2671 2024-09-11T23:19:08.521 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2672 2024-09-11T23:19:08.521 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2676 2024-09-11T23:19:08.521 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2677 2024-09-11T23:19:08.521 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2694 2024-09-11T23:19:08.521 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2695 2024-09-11T23:19:08.521 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2697 2024-09-11T23:19:08.522 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2698 2024-09-11T23:19:08.522 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 2846 2024-09-11T23:19:08.522 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2847 2024-09-11T23:19:08.522 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 2964 2024-09-11T23:19:08.522 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2965 2024-09-11T23:19:08.522 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 2966 2024-09-11T23:19:08.522 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2967 2024-09-11T23:19:08.522 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 3592 2024-09-11T23:19:08.522 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3593 2024-09-11T23:19:08.522 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 4060 2024-09-11T23:19:08.522 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 4061 2024-09-11T23:19:08.522 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 4175 2024-09-11T23:19:08.522 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 4176 2024-09-11T23:19:08.523 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 4177 2024-09-11T23:19:08.523 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 4178 2024-09-11T23:19:08.523 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 4181 2024-09-11T23:19:08.523 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 4182 2024-09-11T23:19:08.523 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 4183 2024-09-11T23:19:08.523 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 4184 2024-09-11T23:19:08.523 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 4185 2024-09-11T23:19:08.523 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 4186 2024-09-11T23:19:08.523 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 6000 2024-09-11T23:19:08.523 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 6001 2024-09-11T23:19:08.523 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 6002 2024-09-11T23:19:08.523 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 6100 2024-09-11T23:19:08.523 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 6114 2024-09-11T23:19:08.523 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 6115 2024-09-11T23:19:08.524 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 pg_control 2024-09-11T23:19:08.524 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 11 23:19 pg_filenode.map 2024-09-11T23:19:08.524 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:19:08.524 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/log: 2024-09-11T23:19:08.524 INFO:teuthology.orchestra.run.smithi037.stdout:total 0 2024-09-11T23:19:08.524 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 . 2024-09-11T23:19:08.524 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 11 23:19 .. 2024-09-11T23:19:08.524 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:19:08.524 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_commit_ts: 2024-09-11T23:19:08.524 INFO:teuthology.orchestra.run.smithi037.stdout:total 0 2024-09-11T23:19:08.524 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 . 2024-09-11T23:19:08.524 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 11 23:19 .. 2024-09-11T23:19:08.524 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:19:08.525 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_dynshmem: 2024-09-11T23:19:08.525 INFO:teuthology.orchestra.run.smithi037.stdout:total 0 2024-09-11T23:19:08.525 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 . 2024-09-11T23:19:08.525 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 11 23:19 .. 2024-09-11T23:19:08.525 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:19:08.525 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_logical: 2024-09-11T23:19:08.525 INFO:teuthology.orchestra.run.smithi037.stdout:total 1 2024-09-11T23:19:08.525 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 11 23:19 . 2024-09-11T23:19:08.525 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 11 23:19 .. 2024-09-11T23:19:08.525 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 mappings 2024-09-11T23:19:08.525 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Sep 11 23:19 replorigin_checkpoint 2024-09-11T23:19:08.525 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 snapshots 2024-09-11T23:19:08.525 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:19:08.526 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_logical/mappings: 2024-09-11T23:19:08.526 INFO:teuthology.orchestra.run.smithi037.stdout:total 0 2024-09-11T23:19:08.526 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 . 2024-09-11T23:19:08.526 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 11 23:19 .. 2024-09-11T23:19:08.526 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:19:08.526 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_logical/snapshots: 2024-09-11T23:19:08.526 INFO:teuthology.orchestra.run.smithi037.stdout:total 0 2024-09-11T23:19:08.526 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 . 2024-09-11T23:19:08.526 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 11 23:19 .. 2024-09-11T23:19:08.526 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:19:08.526 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_multixact: 2024-09-11T23:19:08.526 INFO:teuthology.orchestra.run.smithi037.stdout:total 0 2024-09-11T23:19:08.526 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 11 23:19 . 2024-09-11T23:19:08.526 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 11 23:19 .. 2024-09-11T23:19:08.526 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 11 23:19 members 2024-09-11T23:19:08.527 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 11 23:19 offsets 2024-09-11T23:19:08.527 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:19:08.527 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_multixact/members: 2024-09-11T23:19:08.527 INFO:teuthology.orchestra.run.smithi037.stdout:total 8 2024-09-11T23:19:08.527 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 11 23:19 . 2024-09-11T23:19:08.527 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 11 23:19 .. 2024-09-11T23:19:08.527 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 0000 2024-09-11T23:19:08.527 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:19:08.527 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_multixact/offsets: 2024-09-11T23:19:08.527 INFO:teuthology.orchestra.run.smithi037.stdout:total 8 2024-09-11T23:19:08.527 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 11 23:19 . 2024-09-11T23:19:08.527 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 11 23:19 .. 2024-09-11T23:19:08.527 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 0000 2024-09-11T23:19:08.528 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:19:08.528 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_notify: 2024-09-11T23:19:08.528 INFO:teuthology.orchestra.run.smithi037.stdout:total 0 2024-09-11T23:19:08.528 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 . 2024-09-11T23:19:08.528 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 11 23:19 .. 2024-09-11T23:19:08.528 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:19:08.528 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_replslot: 2024-09-11T23:19:08.528 INFO:teuthology.orchestra.run.smithi037.stdout:total 0 2024-09-11T23:19:08.528 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 . 2024-09-11T23:19:08.528 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 11 23:19 .. 2024-09-11T23:19:08.528 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:19:08.528 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_serial: 2024-09-11T23:19:08.528 INFO:teuthology.orchestra.run.smithi037.stdout:total 0 2024-09-11T23:19:08.528 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 . 2024-09-11T23:19:08.529 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 11 23:19 .. 2024-09-11T23:19:08.529 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:19:08.529 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_snapshots: 2024-09-11T23:19:08.529 INFO:teuthology.orchestra.run.smithi037.stdout:total 0 2024-09-11T23:19:08.529 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 . 2024-09-11T23:19:08.529 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 11 23:19 .. 2024-09-11T23:19:08.529 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:19:08.529 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_stat: 2024-09-11T23:19:08.529 INFO:teuthology.orchestra.run.smithi037.stdout:total 0 2024-09-11T23:19:08.529 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 . 2024-09-11T23:19:08.529 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 11 23:19 .. 2024-09-11T23:19:08.529 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:19:08.529 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_stat_tmp: 2024-09-11T23:19:08.529 INFO:teuthology.orchestra.run.smithi037.stdout:total 0 2024-09-11T23:19:08.530 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 . 2024-09-11T23:19:08.530 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 11 23:19 .. 2024-09-11T23:19:08.530 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:19:08.530 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_subtrans: 2024-09-11T23:19:08.530 INFO:teuthology.orchestra.run.smithi037.stdout:total 8 2024-09-11T23:19:08.530 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 11 23:19 . 2024-09-11T23:19:08.530 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 11 23:19 .. 2024-09-11T23:19:08.530 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 0000 2024-09-11T23:19:08.530 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:19:08.530 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_tblspc: 2024-09-11T23:19:08.530 INFO:teuthology.orchestra.run.smithi037.stdout:total 0 2024-09-11T23:19:08.530 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 . 2024-09-11T23:19:08.530 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 11 23:19 .. 2024-09-11T23:19:08.530 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:19:08.531 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_twophase: 2024-09-11T23:19:08.531 INFO:teuthology.orchestra.run.smithi037.stdout:total 0 2024-09-11T23:19:08.531 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 . 2024-09-11T23:19:08.531 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 11 23:19 .. 2024-09-11T23:19:08.531 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:19:08.531 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_wal: 2024-09-11T23:19:08.531 INFO:teuthology.orchestra.run.smithi037.stdout:total 16384 2024-09-11T23:19:08.531 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 11 23:19 . 2024-09-11T23:19:08.531 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 11 23:19 .. 2024-09-11T23:19:08.531 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 23:19 000000010000000000000001 2024-09-11T23:19:08.532 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 archive_status 2024-09-11T23:19:08.532 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:19:08.532 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_wal/archive_status: 2024-09-11T23:19:08.532 INFO:teuthology.orchestra.run.smithi037.stdout:total 0 2024-09-11T23:19:08.532 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 . 2024-09-11T23:19:08.532 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 11 23:19 .. 2024-09-11T23:19:08.532 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:19:08.532 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_xact: 2024-09-11T23:19:08.532 INFO:teuthology.orchestra.run.smithi037.stdout:total 8 2024-09-11T23:19:08.532 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 11 23:19 . 2024-09-11T23:19:08.532 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 11 23:19 .. 2024-09-11T23:19:08.532 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 0000 2024-09-11T23:19:08.533 DEBUG:teuthology.orchestra.run.smithi037:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo systemctl start postgresql' 2024-09-11T23:19:08.772 DEBUG:teuthology.orchestra.run.smithi037:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- pgbench -s 32 -i' 2024-09-11T23:19:08.863 INFO:teuthology.orchestra.run.smithi037.stderr:dropping old tables... 2024-09-11T23:19:08.864 INFO:teuthology.orchestra.run.smithi037.stderr:NOTICE: table "pgbench_accounts" does not exist, skipping 2024-09-11T23:19:08.864 INFO:teuthology.orchestra.run.smithi037.stderr:NOTICE: table "pgbench_branches" does not exist, skipping 2024-09-11T23:19:08.865 INFO:teuthology.orchestra.run.smithi037.stderr:NOTICE: table "pgbench_history" does not exist, skipping 2024-09-11T23:19:08.865 INFO:teuthology.orchestra.run.smithi037.stderr:NOTICE: table "pgbench_tellers" does not exist, skipping 2024-09-11T23:19:08.865 INFO:teuthology.orchestra.run.smithi037.stderr:creating tables... 2024-09-11T23:19:08.880 INFO:teuthology.orchestra.run.smithi037.stderr:generating data (client-side)... 2024-09-11T23:19:09.030 INFO:teuthology.orchestra.run.smithi037.stderr:100000 of 3200000 tuples (3%) done (elapsed 0.12 s, remaining 3.81 s) 2024-09-11T23:19:09.366 INFO:teuthology.orchestra.run.smithi037.stderr:200000 of 3200000 tuples (6%) done (elapsed 0.46 s, remaining 6.87 s) 2024-09-11T23:19:09.642 INFO:teuthology.orchestra.run.smithi037.stderr:300000 of 3200000 tuples (9%) done (elapsed 0.73 s, remaining 7.10 s) 2024-09-11T23:19:09.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:19:09 smithi123 ceph-mon[35438]: pgmap v393: 129 pgs: 129 active+clean; 5.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 416 KiB/s wr, 28 op/s 2024-09-11T23:19:09.791 INFO:teuthology.orchestra.run.smithi037.stderr:400000 of 3200000 tuples (12%) done (elapsed 0.88 s, remaining 6.18 s) 2024-09-11T23:19:09.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:19:09 smithi037 ceph-mon[30630]: pgmap v393: 129 pgs: 129 active+clean; 5.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 416 KiB/s wr, 28 op/s 2024-09-11T23:19:09.933 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:19:09 smithi160 ceph-mon[35055]: pgmap v393: 129 pgs: 129 active+clean; 5.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 416 KiB/s wr, 28 op/s 2024-09-11T23:19:10.012 INFO:teuthology.orchestra.run.smithi037.stderr:500000 of 3200000 tuples (15%) done (elapsed 1.10 s, remaining 5.96 s) 2024-09-11T23:19:10.159 INFO:teuthology.orchestra.run.smithi037.stderr:600000 of 3200000 tuples (18%) done (elapsed 1.25 s, remaining 5.42 s) 2024-09-11T23:19:10.439 INFO:teuthology.orchestra.run.smithi037.stderr:700000 of 3200000 tuples (21%) done (elapsed 1.53 s, remaining 5.47 s) 2024-09-11T23:19:10.779 INFO:teuthology.orchestra.run.smithi037.stderr:800000 of 3200000 tuples (25%) done (elapsed 1.87 s, remaining 5.61 s) 2024-09-11T23:19:10.943 INFO:teuthology.orchestra.run.smithi037.stderr:900000 of 3200000 tuples (28%) done (elapsed 2.04 s, remaining 5.20 s) 2024-09-11T23:19:11.240 INFO:teuthology.orchestra.run.smithi037.stderr:1000000 of 3200000 tuples (31%) done (elapsed 2.33 s, remaining 5.13 s) 2024-09-11T23:19:11.541 INFO:teuthology.orchestra.run.smithi037.stderr:1100000 of 3200000 tuples (34%) done (elapsed 2.63 s, remaining 5.03 s) 2024-09-11T23:19:11.730 INFO:teuthology.orchestra.run.smithi037.stderr:1200000 of 3200000 tuples (37%) done (elapsed 2.82 s, remaining 4.70 s) 2024-09-11T23:19:11.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:19:11 smithi123 ceph-mon[35438]: pgmap v394: 129 pgs: 129 active+clean; 40 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 4.1 MiB/s wr, 80 op/s 2024-09-11T23:19:11.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:19:11 smithi037 ceph-mon[30630]: pgmap v394: 129 pgs: 129 active+clean; 40 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 4.1 MiB/s wr, 80 op/s 2024-09-11T23:19:11.933 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:19:11 smithi160 ceph-mon[35055]: pgmap v394: 129 pgs: 129 active+clean; 40 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 4.1 MiB/s wr, 80 op/s 2024-09-11T23:19:11.966 INFO:teuthology.orchestra.run.smithi037.stderr:1300000 of 3200000 tuples (40%) done (elapsed 3.06 s, remaining 4.47 s) 2024-09-11T23:19:12.235 INFO:teuthology.orchestra.run.smithi037.stderr:1400000 of 3200000 tuples (43%) done (elapsed 3.33 s, remaining 4.28 s) 2024-09-11T23:19:12.411 INFO:teuthology.orchestra.run.smithi037.stderr:1500000 of 3200000 tuples (46%) done (elapsed 3.50 s, remaining 3.97 s) 2024-09-11T23:19:12.758 INFO:teuthology.orchestra.run.smithi037.stderr:1600000 of 3200000 tuples (50%) done (elapsed 3.85 s, remaining 3.85 s) 2024-09-11T23:19:13.059 INFO:teuthology.orchestra.run.smithi037.stderr:1700000 of 3200000 tuples (53%) done (elapsed 4.15 s, remaining 3.66 s) 2024-09-11T23:19:13.153 INFO:teuthology.orchestra.run.smithi037.stderr:1800000 of 3200000 tuples (56%) done (elapsed 4.24 s, remaining 3.30 s) 2024-09-11T23:19:13.458 INFO:teuthology.orchestra.run.smithi037.stderr:1900000 of 3200000 tuples (59%) done (elapsed 4.55 s, remaining 3.11 s) 2024-09-11T23:19:13.629 INFO:teuthology.orchestra.run.smithi037.stderr:2000000 of 3200000 tuples (62%) done (elapsed 4.72 s, remaining 2.83 s) 2024-09-11T23:19:13.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:19:13 smithi123 ceph-mon[35438]: pgmap v395: 129 pgs: 129 active+clean; 60 MiB data, 497 MiB used, 1.0 TiB / 1.0 TiB avail; 332 KiB/s rd, 7.2 MiB/s wr, 131 op/s 2024-09-11T23:19:13.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:19:13 smithi037 ceph-mon[30630]: pgmap v395: 129 pgs: 129 active+clean; 60 MiB data, 497 MiB used, 1.0 TiB / 1.0 TiB avail; 332 KiB/s rd, 7.2 MiB/s wr, 131 op/s 2024-09-11T23:19:13.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:19:13 smithi160 ceph-mon[35055]: pgmap v395: 129 pgs: 129 active+clean; 60 MiB data, 497 MiB used, 1.0 TiB / 1.0 TiB avail; 332 KiB/s rd, 7.2 MiB/s wr, 131 op/s 2024-09-11T23:19:13.959 INFO:teuthology.orchestra.run.smithi037.stderr:2100000 of 3200000 tuples (65%) done (elapsed 5.05 s, remaining 2.65 s) 2024-09-11T23:19:14.231 INFO:teuthology.orchestra.run.smithi037.stderr:2200000 of 3200000 tuples (68%) done (elapsed 5.32 s, remaining 2.42 s) 2024-09-11T23:19:14.426 INFO:teuthology.orchestra.run.smithi037.stderr:2300000 of 3200000 tuples (71%) done (elapsed 5.52 s, remaining 2.16 s) 2024-09-11T23:19:14.686 INFO:teuthology.orchestra.run.smithi037.stderr:2400000 of 3200000 tuples (75%) done (elapsed 5.78 s, remaining 1.93 s) 2024-09-11T23:19:15.004 INFO:teuthology.orchestra.run.smithi037.stderr:2500000 of 3200000 tuples (78%) done (elapsed 6.10 s, remaining 1.71 s) 2024-09-11T23:19:15.151 INFO:teuthology.orchestra.run.smithi037.stderr:2600000 of 3200000 tuples (81%) done (elapsed 6.24 s, remaining 1.44 s) 2024-09-11T23:19:15.382 INFO:teuthology.orchestra.run.smithi037.stderr:2700000 of 3200000 tuples (84%) done (elapsed 6.48 s, remaining 1.20 s) 2024-09-11T23:19:15.521 INFO:teuthology.orchestra.run.smithi037.stderr:2800000 of 3200000 tuples (87%) done (elapsed 6.61 s, remaining 0.94 s) 2024-09-11T23:19:15.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:19:15 smithi123 ceph-mon[35438]: pgmap v396: 129 pgs: 129 active+clean; 164 MiB data, 617 MiB used, 1.0 TiB / 1.0 TiB avail; 338 KiB/s rd, 24 MiB/s wr, 138 op/s 2024-09-11T23:19:15.811 INFO:teuthology.orchestra.run.smithi037.stderr:2900000 of 3200000 tuples (90%) done (elapsed 6.90 s, remaining 0.71 s) 2024-09-11T23:19:15.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:19:15 smithi037 ceph-mon[30630]: pgmap v396: 129 pgs: 129 active+clean; 164 MiB data, 617 MiB used, 1.0 TiB / 1.0 TiB avail; 338 KiB/s rd, 24 MiB/s wr, 138 op/s 2024-09-11T23:19:15.933 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:19:15 smithi160 ceph-mon[35055]: pgmap v396: 129 pgs: 129 active+clean; 164 MiB data, 617 MiB used, 1.0 TiB / 1.0 TiB avail; 338 KiB/s rd, 24 MiB/s wr, 138 op/s 2024-09-11T23:19:16.109 INFO:teuthology.orchestra.run.smithi037.stderr:3000000 of 3200000 tuples (93%) done (elapsed 7.20 s, remaining 0.48 s) 2024-09-11T23:19:16.288 INFO:teuthology.orchestra.run.smithi037.stderr:3100000 of 3200000 tuples (96%) done (elapsed 7.38 s, remaining 0.24 s) 2024-09-11T23:19:16.537 INFO:teuthology.orchestra.run.smithi037.stderr:3200000 of 3200000 tuples (100%) done (elapsed 7.63 s, remaining 0.00 s) 2024-09-11T23:19:16.600 INFO:teuthology.orchestra.run.smithi037.stderr:vacuuming... 2024-09-11T23:19:17.561 INFO:teuthology.orchestra.run.smithi037.stderr:creating primary keys... 2024-09-11T23:19:17.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:19:17 smithi123 ceph-mon[35438]: pgmap v397: 129 pgs: 129 active+clean; 252 MiB data, 886 MiB used, 1.0 TiB / 1.0 TiB avail; 350 KiB/s rd, 39 MiB/s wr, 147 op/s 2024-09-11T23:19:17.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:19:17 smithi037 ceph-mon[30630]: pgmap v397: 129 pgs: 129 active+clean; 252 MiB data, 886 MiB used, 1.0 TiB / 1.0 TiB avail; 350 KiB/s rd, 39 MiB/s wr, 147 op/s 2024-09-11T23:19:17.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:19:17 smithi160 ceph-mon[35055]: pgmap v397: 129 pgs: 129 active+clean; 252 MiB data, 886 MiB used, 1.0 TiB / 1.0 TiB avail; 350 KiB/s rd, 39 MiB/s wr, 147 op/s 2024-09-11T23:19:19.690 INFO:teuthology.orchestra.run.smithi037.stderr:done in 10.83 s (drop tables 0.00 s, create tables 0.02 s, client-side generate 7.72 s, vacuum 0.96 s, primary keys 2.13 s). 2024-09-11T23:19:19.697 DEBUG:teuthology.orchestra.run.smithi037:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- pgbench -c 100 -j 4 --progress=5 --time=900' 2024-09-11T23:19:19.748 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:19:19 smithi037 ceph-mon[30630]: pgmap v398: 129 pgs: 129 active+clean; 292 MiB data, 942 MiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 45 MiB/s wr, 138 op/s 2024-09-11T23:19:19.748 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:19:19 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:19:19.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:19:19 smithi123 ceph-mon[35438]: pgmap v398: 129 pgs: 129 active+clean; 292 MiB data, 942 MiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 45 MiB/s wr, 138 op/s 2024-09-11T23:19:19.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:19:19 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:19:19.825 INFO:teuthology.orchestra.run.smithi037.stderr:starting vacuum...end. 2024-09-11T23:19:19.933 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:19:19 smithi160 ceph-mon[35055]: pgmap v398: 129 pgs: 129 active+clean; 292 MiB data, 942 MiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 45 MiB/s wr, 138 op/s 2024-09-11T23:19:19.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:19:19 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:19:20.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:19:20 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:19:20.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:19:20 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:19:20.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:19:20 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:19:20.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:19:20 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:19:21.000 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:19:20 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:19:21.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:19:20 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:19:21.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:19:20 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:19:21.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:19:20 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:19:21.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:19:20 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:19:21.066 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:19:20 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:19:21.066 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:19:20 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:19:21.066 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:19:20 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:19:22.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:19:21 smithi160 ceph-mon[35055]: pgmap v399: 129 pgs: 129 active+clean; 396 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 62 MiB/s wr, 142 op/s 2024-09-11T23:19:22.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:19:21 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:19:22.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:19:21 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:19:22.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:19:21 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:19:22.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:19:21 smithi123 ceph-mon[35438]: pgmap v399: 129 pgs: 129 active+clean; 396 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 62 MiB/s wr, 142 op/s 2024-09-11T23:19:22.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:19:21 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:19:22.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:19:21 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:19:22.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:19:21 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:19:22.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:19:21 smithi037 ceph-mon[30630]: pgmap v399: 129 pgs: 129 active+clean; 396 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 62 MiB/s wr, 142 op/s 2024-09-11T23:19:22.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:19:21 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:19:22.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:19:21 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:19:22.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:19:21 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:19:24.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:19:23 smithi037 ceph-mon[30630]: pgmap v400: 129 pgs: 129 active+clean; 416 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 61 MiB/s wr, 93 op/s 2024-09-11T23:19:24.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:19:23 smithi160 ceph-mon[35055]: pgmap v400: 129 pgs: 129 active+clean; 416 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 61 MiB/s wr, 93 op/s 2024-09-11T23:19:24.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:19:23 smithi123 ceph-mon[35438]: pgmap v400: 129 pgs: 129 active+clean; 416 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 61 MiB/s wr, 93 op/s 2024-09-11T23:19:24.826 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 5.0 s, 2488.0 tps, lat 38.208 ms stddev 46.718 2024-09-11T23:19:26.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:19:25 smithi160 ceph-mon[35055]: pgmap v401: 129 pgs: 129 active+clean; 516 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 67 MiB/s wr, 112 op/s 2024-09-11T23:19:26.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:19:25 smithi123 ceph-mon[35438]: pgmap v401: 129 pgs: 129 active+clean; 516 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 67 MiB/s wr, 112 op/s 2024-09-11T23:19:26.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:19:25 smithi037 ceph-mon[30630]: pgmap v401: 129 pgs: 129 active+clean; 516 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 67 MiB/s wr, 112 op/s 2024-09-11T23:19:28.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:19:27 smithi160 ceph-mon[35055]: pgmap v402: 129 pgs: 129 active+clean; 727 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 53 MiB/s wr, 157 op/s 2024-09-11T23:19:28.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:19:27 smithi123 ceph-mon[35438]: pgmap v402: 129 pgs: 129 active+clean; 727 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 53 MiB/s wr, 157 op/s 2024-09-11T23:19:28.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:19:27 smithi037 ceph-mon[30630]: pgmap v402: 129 pgs: 129 active+clean; 727 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 53 MiB/s wr, 157 op/s 2024-09-11T23:19:29.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 10.0 s, 2573.4 tps, lat 38.677 ms stddev 44.715 2024-09-11T23:19:30.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:19:29 smithi160 ceph-mon[35055]: pgmap v403: 129 pgs: 129 active+clean; 770 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 39 MiB/s wr, 167 op/s 2024-09-11T23:19:30.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:19:29 smithi123 ceph-mon[35438]: pgmap v403: 129 pgs: 129 active+clean; 770 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 39 MiB/s wr, 167 op/s 2024-09-11T23:19:30.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:19:29 smithi037 ceph-mon[30630]: pgmap v403: 129 pgs: 129 active+clean; 770 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 39 MiB/s wr, 167 op/s 2024-09-11T23:19:32.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:19:31 smithi160 ceph-mon[35055]: pgmap v404: 129 pgs: 129 active+clean; 902 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 34 MiB/s wr, 390 op/s 2024-09-11T23:19:32.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:19:31 smithi123 ceph-mon[35438]: pgmap v404: 129 pgs: 129 active+clean; 902 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 34 MiB/s wr, 390 op/s 2024-09-11T23:19:32.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:19:31 smithi037 ceph-mon[30630]: pgmap v404: 129 pgs: 129 active+clean; 902 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 34 MiB/s wr, 390 op/s 2024-09-11T23:19:34.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:19:33 smithi160 ceph-mon[35055]: pgmap v405: 129 pgs: 129 active+clean; 906 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 17 MiB/s wr, 410 op/s 2024-09-11T23:19:34.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:19:33 smithi123 ceph-mon[35438]: pgmap v405: 129 pgs: 129 active+clean; 906 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 17 MiB/s wr, 410 op/s 2024-09-11T23:19:34.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:19:33 smithi037 ceph-mon[30630]: pgmap v405: 129 pgs: 129 active+clean; 906 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 17 MiB/s wr, 410 op/s 2024-09-11T23:19:34.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 15.0 s, 2104.6 tps, lat 47.495 ms stddev 58.612 2024-09-11T23:19:36.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:19:35 smithi160 ceph-mon[35055]: pgmap v406: 129 pgs: 129 active+clean; 924 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 17 MiB/s wr, 502 op/s 2024-09-11T23:19:36.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:19:35 smithi123 ceph-mon[35438]: pgmap v406: 129 pgs: 129 active+clean; 924 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 17 MiB/s wr, 502 op/s 2024-09-11T23:19:36.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:19:35 smithi037 ceph-mon[30630]: pgmap v406: 129 pgs: 129 active+clean; 924 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 17 MiB/s wr, 502 op/s 2024-09-11T23:19:38.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:19:37 smithi160 ceph-mon[35055]: pgmap v407: 129 pgs: 129 active+clean; 932 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.0 MiB/s wr, 579 op/s 2024-09-11T23:19:38.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:19:37 smithi123 ceph-mon[35438]: pgmap v407: 129 pgs: 129 active+clean; 932 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.0 MiB/s wr, 579 op/s 2024-09-11T23:19:38.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:19:37 smithi037 ceph-mon[30630]: pgmap v407: 129 pgs: 129 active+clean; 932 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.0 MiB/s wr, 579 op/s 2024-09-11T23:19:39.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 20.0 s, 2200.0 tps, lat 45.750 ms stddev 53.189 2024-09-11T23:19:40.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:19:39 smithi160 ceph-mon[35055]: pgmap v408: 129 pgs: 129 active+clean; 933 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 7.1 MiB/s wr, 582 op/s 2024-09-11T23:19:40.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:19:39 smithi123 ceph-mon[35438]: pgmap v408: 129 pgs: 129 active+clean; 933 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 7.1 MiB/s wr, 582 op/s 2024-09-11T23:19:40.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:19:39 smithi037 ceph-mon[30630]: pgmap v408: 129 pgs: 129 active+clean; 933 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 7.1 MiB/s wr, 582 op/s 2024-09-11T23:19:42.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:19:41 smithi160 ceph-mon[35055]: pgmap v409: 129 pgs: 129 active+clean; 936 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.6 MiB/s wr, 750 op/s 2024-09-11T23:19:42.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:19:41 smithi123 ceph-mon[35438]: pgmap v409: 129 pgs: 129 active+clean; 936 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.6 MiB/s wr, 750 op/s 2024-09-11T23:19:42.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:19:41 smithi037 ceph-mon[30630]: pgmap v409: 129 pgs: 129 active+clean; 936 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.6 MiB/s wr, 750 op/s 2024-09-11T23:19:44.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:19:43 smithi160 ceph-mon[35055]: pgmap v410: 129 pgs: 129 active+clean; 937 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.5 MiB/s wr, 556 op/s 2024-09-11T23:19:44.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:19:43 smithi123 ceph-mon[35438]: pgmap v410: 129 pgs: 129 active+clean; 937 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.5 MiB/s wr, 556 op/s 2024-09-11T23:19:44.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:19:43 smithi037 ceph-mon[30630]: pgmap v410: 129 pgs: 129 active+clean; 937 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.5 MiB/s wr, 556 op/s 2024-09-11T23:19:44.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 25.0 s, 2300.2 tps, lat 43.488 ms stddev 52.332 2024-09-11T23:19:46.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:19:45 smithi123 ceph-mon[35438]: pgmap v411: 129 pgs: 129 active+clean; 944 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 8.6 MiB/s wr, 665 op/s 2024-09-11T23:19:46.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:19:45 smithi037 ceph-mon[30630]: pgmap v411: 129 pgs: 129 active+clean; 944 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 8.6 MiB/s wr, 665 op/s 2024-09-11T23:19:46.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:19:45 smithi160 ceph-mon[35055]: pgmap v411: 129 pgs: 129 active+clean; 944 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 8.6 MiB/s wr, 665 op/s 2024-09-11T23:19:48.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:19:47 smithi123 ceph-mon[35438]: pgmap v412: 129 pgs: 129 active+clean; 950 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 9.6 MiB/s wr, 765 op/s 2024-09-11T23:19:48.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:19:47 smithi037 ceph-mon[30630]: pgmap v412: 129 pgs: 129 active+clean; 950 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 9.6 MiB/s wr, 765 op/s 2024-09-11T23:19:48.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:19:47 smithi160 ceph-mon[35055]: pgmap v412: 129 pgs: 129 active+clean; 950 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 9.6 MiB/s wr, 765 op/s 2024-09-11T23:19:49.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 30.0 s, 2249.4 tps, lat 44.267 ms stddev 54.151 2024-09-11T23:19:50.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:19:49 smithi123 ceph-mon[35438]: pgmap v413: 129 pgs: 129 active+clean; 951 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 8.1 MiB/s wr, 638 op/s 2024-09-11T23:19:50.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:19:49 smithi037 ceph-mon[30630]: pgmap v413: 129 pgs: 129 active+clean; 951 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 8.1 MiB/s wr, 638 op/s 2024-09-11T23:19:50.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:19:49 smithi160 ceph-mon[35055]: pgmap v413: 129 pgs: 129 active+clean; 951 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 8.1 MiB/s wr, 638 op/s 2024-09-11T23:19:52.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:19:51 smithi123 ceph-mon[35438]: pgmap v414: 129 pgs: 129 active+clean; 976 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 11 MiB/s wr, 759 op/s 2024-09-11T23:19:52.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:19:51 smithi037 ceph-mon[30630]: pgmap v414: 129 pgs: 129 active+clean; 976 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 11 MiB/s wr, 759 op/s 2024-09-11T23:19:52.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:19:51 smithi160 ceph-mon[35055]: pgmap v414: 129 pgs: 129 active+clean; 976 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 11 MiB/s wr, 759 op/s 2024-09-11T23:19:54.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:19:53 smithi123 ceph-mon[35438]: pgmap v415: 129 pgs: 129 active+clean; 984 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 10 MiB/s wr, 608 op/s 2024-09-11T23:19:54.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:19:53 smithi037 ceph-mon[30630]: pgmap v415: 129 pgs: 129 active+clean; 984 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 10 MiB/s wr, 608 op/s 2024-09-11T23:19:54.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:19:53 smithi160 ceph-mon[35055]: pgmap v415: 129 pgs: 129 active+clean; 984 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 10 MiB/s wr, 608 op/s 2024-09-11T23:19:54.826 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 35.0 s, 1944.5 tps, lat 51.354 ms stddev 78.757 2024-09-11T23:19:56.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:19:55 smithi123 ceph-mon[35438]: pgmap v416: 129 pgs: 129 active+clean; 1001 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 14 MiB/s wr, 766 op/s 2024-09-11T23:19:56.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:19:55 smithi037 ceph-mon[30630]: pgmap v416: 129 pgs: 129 active+clean; 1001 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 14 MiB/s wr, 766 op/s 2024-09-11T23:19:56.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:19:55 smithi160 ceph-mon[35055]: pgmap v416: 129 pgs: 129 active+clean; 1001 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 14 MiB/s wr, 766 op/s 2024-09-11T23:19:58.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:19:57 smithi123 ceph-mon[35438]: pgmap v417: 129 pgs: 129 active+clean; 1018 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 16 MiB/s wr, 801 op/s 2024-09-11T23:19:58.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:19:57 smithi037 ceph-mon[30630]: pgmap v417: 129 pgs: 129 active+clean; 1018 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 16 MiB/s wr, 801 op/s 2024-09-11T23:19:58.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:19:57 smithi160 ceph-mon[35055]: pgmap v417: 129 pgs: 129 active+clean; 1018 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 16 MiB/s wr, 801 op/s 2024-09-11T23:19:59.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 40.0 s, 2186.8 tps, lat 46.006 ms stddev 51.174 2024-09-11T23:20:00.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:19:59 smithi123 ceph-mon[35438]: pgmap v418: 129 pgs: 129 active+clean; 1018 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 14 MiB/s wr, 630 op/s 2024-09-11T23:20:00.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:19:59 smithi037 ceph-mon[30630]: pgmap v418: 129 pgs: 129 active+clean; 1018 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 14 MiB/s wr, 630 op/s 2024-09-11T23:20:00.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:19:59 smithi160 ceph-mon[35055]: pgmap v418: 129 pgs: 129 active+clean; 1018 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 14 MiB/s wr, 630 op/s 2024-09-11T23:20:01.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:20:00 smithi123 ceph-mon[35438]: overall HEALTH_OK 2024-09-11T23:20:01.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:20:00 smithi037 ceph-mon[30630]: overall HEALTH_OK 2024-09-11T23:20:01.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:20:00 smithi160 ceph-mon[35055]: overall HEALTH_OK 2024-09-11T23:20:02.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:20:02 smithi123 ceph-mon[35438]: pgmap v419: 129 pgs: 129 active+clean; 1024 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 16 MiB/s wr, 814 op/s 2024-09-11T23:20:02.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:20:02 smithi037 ceph-mon[30630]: pgmap v419: 129 pgs: 129 active+clean; 1024 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 16 MiB/s wr, 814 op/s 2024-09-11T23:20:02.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:20:02 smithi160 ceph-mon[35055]: pgmap v419: 129 pgs: 129 active+clean; 1024 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 16 MiB/s wr, 814 op/s 2024-09-11T23:20:04.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:20:04 smithi037 ceph-mon[30630]: pgmap v420: 129 pgs: 129 active+clean; 1024 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 13 MiB/s wr, 668 op/s 2024-09-11T23:20:04.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:20:04 smithi160 ceph-mon[35055]: pgmap v420: 129 pgs: 129 active+clean; 1024 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 13 MiB/s wr, 668 op/s 2024-09-11T23:20:04.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:20:04 smithi123 ceph-mon[35438]: pgmap v420: 129 pgs: 129 active+clean; 1024 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 13 MiB/s wr, 668 op/s 2024-09-11T23:20:04.840 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 45.0 s, 2188.8 tps, lat 45.257 ms stddev 53.244 2024-09-11T23:20:06.316 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:20:06 smithi037 ceph-mon[30630]: pgmap v421: 129 pgs: 129 active+clean; 1005 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 14 MiB/s wr, 791 op/s 2024-09-11T23:20:06.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:20:06 smithi160 ceph-mon[35055]: pgmap v421: 129 pgs: 129 active+clean; 1005 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 14 MiB/s wr, 791 op/s 2024-09-11T23:20:06.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:20:06 smithi123 ceph-mon[35438]: pgmap v421: 129 pgs: 129 active+clean; 1005 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 14 MiB/s wr, 791 op/s 2024-09-11T23:20:08.302 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:20:08 smithi123 ceph-mon[35438]: pgmap v422: 129 pgs: 129 active+clean; 979 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 MiB/s wr, 723 op/s 2024-09-11T23:20:08.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:20:08 smithi037 ceph-mon[30630]: pgmap v422: 129 pgs: 129 active+clean; 979 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 MiB/s wr, 723 op/s 2024-09-11T23:20:08.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:20:08 smithi160 ceph-mon[35055]: pgmap v422: 129 pgs: 129 active+clean; 979 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 MiB/s wr, 723 op/s 2024-09-11T23:20:09.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 50.0 s, 1873.4 tps, lat 53.620 ms stddev 63.748 2024-09-11T23:20:10.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:20:10 smithi037 ceph-mon[30630]: pgmap v423: 129 pgs: 129 active+clean; 980 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 6.9 MiB/s wr, 567 op/s 2024-09-11T23:20:10.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:20:10 smithi160 ceph-mon[35055]: pgmap v423: 129 pgs: 129 active+clean; 980 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 6.9 MiB/s wr, 567 op/s 2024-09-11T23:20:10.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:20:10 smithi123 ceph-mon[35438]: pgmap v423: 129 pgs: 129 active+clean; 980 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 6.9 MiB/s wr, 567 op/s 2024-09-11T23:20:12.294 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:20:12 smithi037 ceph-mon[30630]: pgmap v424: 129 pgs: 129 active+clean; 980 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.2 MiB/s wr, 712 op/s 2024-09-11T23:20:12.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:20:12 smithi160 ceph-mon[35055]: pgmap v424: 129 pgs: 129 active+clean; 980 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.2 MiB/s wr, 712 op/s 2024-09-11T23:20:12.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:20:12 smithi123 ceph-mon[35438]: pgmap v424: 129 pgs: 129 active+clean; 980 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.2 MiB/s wr, 712 op/s 2024-09-11T23:20:14.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:20:14 smithi037 ceph-mon[30630]: pgmap v425: 129 pgs: 129 active+clean; 980 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 6.8 MiB/s wr, 595 op/s 2024-09-11T23:20:14.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:20:14 smithi160 ceph-mon[35055]: pgmap v425: 129 pgs: 129 active+clean; 980 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 6.8 MiB/s wr, 595 op/s 2024-09-11T23:20:14.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:20:14 smithi123 ceph-mon[35438]: pgmap v425: 129 pgs: 129 active+clean; 980 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 6.8 MiB/s wr, 595 op/s 2024-09-11T23:20:14.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 55.0 s, 2397.4 tps, lat 41.801 ms stddev 49.078 2024-09-11T23:20:16.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:20:16 smithi037 ceph-mon[30630]: pgmap v426: 129 pgs: 129 active+clean; 981 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 7.8 MiB/s wr, 690 op/s 2024-09-11T23:20:16.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:20:16 smithi160 ceph-mon[35055]: pgmap v426: 129 pgs: 129 active+clean; 981 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 7.8 MiB/s wr, 690 op/s 2024-09-11T23:20:16.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:20:16 smithi123 ceph-mon[35438]: pgmap v426: 129 pgs: 129 active+clean; 981 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 7.8 MiB/s wr, 690 op/s 2024-09-11T23:20:17.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:20:17 smithi160 ceph-mon[35055]: pgmap v427: 129 pgs: 129 active+clean; 981 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.6 MiB/s wr, 655 op/s 2024-09-11T23:20:17.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:20:17 smithi123 ceph-mon[35438]: pgmap v427: 129 pgs: 129 active+clean; 981 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.6 MiB/s wr, 655 op/s 2024-09-11T23:20:17.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:20:17 smithi037 ceph-mon[30630]: pgmap v427: 129 pgs: 129 active+clean; 981 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.6 MiB/s wr, 655 op/s 2024-09-11T23:20:19.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:20:19 smithi037 ceph-mon[30630]: pgmap v428: 129 pgs: 129 active+clean; 981 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.6 MiB/s wr, 577 op/s 2024-09-11T23:20:19.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:20:19 smithi160 ceph-mon[35055]: pgmap v428: 129 pgs: 129 active+clean; 981 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.6 MiB/s wr, 577 op/s 2024-09-11T23:20:19.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:20:19 smithi123 ceph-mon[35438]: pgmap v428: 129 pgs: 129 active+clean; 981 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.6 MiB/s wr, 577 op/s 2024-09-11T23:20:19.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 60.0 s, 1713.8 tps, lat 58.490 ms stddev 93.324 2024-09-11T23:20:21.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:20:21 smithi160 ceph-mon[35055]: pgmap v429: 129 pgs: 129 active+clean; 993 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 14 MiB/s wr, 907 op/s 2024-09-11T23:20:21.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:20:21 smithi123 ceph-mon[35438]: pgmap v429: 129 pgs: 129 active+clean; 993 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 14 MiB/s wr, 907 op/s 2024-09-11T23:20:21.566 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:20:21 smithi037 ceph-mon[30630]: pgmap v429: 129 pgs: 129 active+clean; 993 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 14 MiB/s wr, 907 op/s 2024-09-11T23:20:22.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:20:22 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:20:22.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:20:22 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:20:22.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:20:22 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:20:22.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:20:22 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:20:22.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:20:22 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:20:22.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:20:22 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:20:22.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:20:22 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:20:22.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:20:22 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:20:22.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:20:22 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:20:23.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:20:23 smithi160 ceph-mon[35055]: pgmap v430: 129 pgs: 129 active+clean; 993 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 15 MiB/s wr, 837 op/s 2024-09-11T23:20:23.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:20:23 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:20:23.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:20:23 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:20:23.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:20:23 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:20:23.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:20:23 smithi123 ceph-mon[35438]: pgmap v430: 129 pgs: 129 active+clean; 993 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 15 MiB/s wr, 837 op/s 2024-09-11T23:20:23.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:20:23 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:20:23.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:20:23 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:20:23.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:20:23 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:20:23.512 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:20:23 smithi037 ceph-mon[30630]: pgmap v430: 129 pgs: 129 active+clean; 993 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 15 MiB/s wr, 837 op/s 2024-09-11T23:20:23.513 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:20:23 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:20:23.513 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:20:23 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:20:23.815 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:20:23 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:20:24.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:20:24 smithi160 ceph-mon[35055]: mgrmap e20: x(active, since 11m), standbys: z, y 2024-09-11T23:20:24.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:20:24 smithi123 ceph-mon[35438]: mgrmap e20: x(active, since 11m), standbys: z, y 2024-09-11T23:20:24.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:20:24 smithi037 ceph-mon[30630]: mgrmap e20: x(active, since 11m), standbys: z, y 2024-09-11T23:20:24.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 65.0 s, 1958.8 tps, lat 50.483 ms stddev 78.866 2024-09-11T23:20:25.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:20:25 smithi160 ceph-mon[35055]: pgmap v431: 129 pgs: 129 active+clean; 1001 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 17 MiB/s wr, 911 op/s 2024-09-11T23:20:25.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:20:25 smithi123 ceph-mon[35438]: pgmap v431: 129 pgs: 129 active+clean; 1001 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 17 MiB/s wr, 911 op/s 2024-09-11T23:20:25.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:20:25 smithi037 ceph-mon[30630]: pgmap v431: 129 pgs: 129 active+clean; 1001 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 17 MiB/s wr, 911 op/s 2024-09-11T23:20:27.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:20:27 smithi123 ceph-mon[35438]: pgmap v432: 129 pgs: 129 active+clean; 1002 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 17 MiB/s wr, 960 op/s 2024-09-11T23:20:27.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:20:27 smithi037 ceph-mon[30630]: pgmap v432: 129 pgs: 129 active+clean; 1002 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 17 MiB/s wr, 960 op/s 2024-09-11T23:20:27.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:20:27 smithi160 ceph-mon[35055]: pgmap v432: 129 pgs: 129 active+clean; 1002 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 17 MiB/s wr, 960 op/s 2024-09-11T23:20:29.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:20:29 smithi123 ceph-mon[35438]: pgmap v433: 129 pgs: 129 active+clean; 1002 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 MiB/s wr, 869 op/s 2024-09-11T23:20:29.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:20:29 smithi037 ceph-mon[30630]: pgmap v433: 129 pgs: 129 active+clean; 1002 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 MiB/s wr, 869 op/s 2024-09-11T23:20:29.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:20:29 smithi160 ceph-mon[35055]: pgmap v433: 129 pgs: 129 active+clean; 1002 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 MiB/s wr, 869 op/s 2024-09-11T23:20:29.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 70.0 s, 1806.4 tps, lat 55.798 ms stddev 68.929 2024-09-11T23:20:31.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:20:31 smithi123 ceph-mon[35438]: pgmap v434: 129 pgs: 129 active+clean; 1003 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 19 MiB/s wr, 1.09k op/s 2024-09-11T23:20:31.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:20:31 smithi037 ceph-mon[30630]: pgmap v434: 129 pgs: 129 active+clean; 1003 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 19 MiB/s wr, 1.09k op/s 2024-09-11T23:20:31.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:20:31 smithi160 ceph-mon[35055]: pgmap v434: 129 pgs: 129 active+clean; 1003 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 19 MiB/s wr, 1.09k op/s 2024-09-11T23:20:33.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:20:33 smithi123 ceph-mon[35438]: pgmap v435: 129 pgs: 129 active+clean; 1003 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 12 MiB/s wr, 792 op/s 2024-09-11T23:20:33.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:20:33 smithi037 ceph-mon[30630]: pgmap v435: 129 pgs: 129 active+clean; 1003 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 12 MiB/s wr, 792 op/s 2024-09-11T23:20:33.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:20:33 smithi160 ceph-mon[35055]: pgmap v435: 129 pgs: 129 active+clean; 1003 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 12 MiB/s wr, 792 op/s 2024-09-11T23:20:34.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 75.0 s, 1936.0 tps, lat 51.487 ms stddev 61.478 2024-09-11T23:20:35.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:20:35 smithi123 ceph-mon[35438]: pgmap v436: 129 pgs: 129 active+clean; 1003 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 12 MiB/s wr, 825 op/s 2024-09-11T23:20:35.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:20:35 smithi037 ceph-mon[30630]: pgmap v436: 129 pgs: 129 active+clean; 1003 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 12 MiB/s wr, 825 op/s 2024-09-11T23:20:35.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:20:35 smithi160 ceph-mon[35055]: pgmap v436: 129 pgs: 129 active+clean; 1003 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 12 MiB/s wr, 825 op/s 2024-09-11T23:20:37.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:20:37 smithi123 ceph-mon[35438]: pgmap v437: 129 pgs: 129 active+clean; 1003 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 10 MiB/s wr, 838 op/s 2024-09-11T23:20:37.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:20:37 smithi037 ceph-mon[30630]: pgmap v437: 129 pgs: 129 active+clean; 1003 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 10 MiB/s wr, 838 op/s 2024-09-11T23:20:37.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:20:37 smithi160 ceph-mon[35055]: pgmap v437: 129 pgs: 129 active+clean; 1003 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 10 MiB/s wr, 838 op/s 2024-09-11T23:20:39.495 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:20:39 smithi160 ceph-mon[35055]: pgmap v438: 129 pgs: 129 active+clean; 1003 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 9.3 MiB/s wr, 754 op/s 2024-09-11T23:20:39.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:20:39 smithi123 ceph-mon[35438]: pgmap v438: 129 pgs: 129 active+clean; 1003 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 9.3 MiB/s wr, 754 op/s 2024-09-11T23:20:39.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:20:39 smithi037 ceph-mon[30630]: pgmap v438: 129 pgs: 129 active+clean; 1003 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 9.3 MiB/s wr, 754 op/s 2024-09-11T23:20:39.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 80.0 s, 2024.6 tps, lat 49.398 ms stddev 66.954 2024-09-11T23:20:41.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:20:41 smithi123 ceph-mon[35438]: pgmap v439: 129 pgs: 129 active+clean; 1020 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 MiB/s wr, 929 op/s 2024-09-11T23:20:41.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:20:41 smithi037 ceph-mon[30630]: pgmap v439: 129 pgs: 129 active+clean; 1020 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 MiB/s wr, 929 op/s 2024-09-11T23:20:41.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:20:41 smithi160 ceph-mon[35055]: pgmap v439: 129 pgs: 129 active+clean; 1020 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 MiB/s wr, 929 op/s 2024-09-11T23:20:43.566 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:20:43 smithi037 ceph-mon[30630]: pgmap v440: 129 pgs: 129 active+clean; 1020 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.4 MiB/s wr, 696 op/s 2024-09-11T23:20:43.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:20:43 smithi160 ceph-mon[35055]: pgmap v440: 129 pgs: 129 active+clean; 1020 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.4 MiB/s wr, 696 op/s 2024-09-11T23:20:43.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:20:43 smithi123 ceph-mon[35438]: pgmap v440: 129 pgs: 129 active+clean; 1020 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.4 MiB/s wr, 696 op/s 2024-09-11T23:20:44.827 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 85.0 s, 2361.6 tps, lat 42.441 ms stddev 48.552 2024-09-11T23:20:45.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:20:45 smithi037 ceph-mon[30630]: pgmap v441: 129 pgs: 129 active+clean; 1020 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.7 MiB/s wr, 762 op/s 2024-09-11T23:20:45.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:20:45 smithi160 ceph-mon[35055]: pgmap v441: 129 pgs: 129 active+clean; 1020 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.7 MiB/s wr, 762 op/s 2024-09-11T23:20:45.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:20:45 smithi123 ceph-mon[35438]: pgmap v441: 129 pgs: 129 active+clean; 1020 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.7 MiB/s wr, 762 op/s 2024-09-11T23:20:47.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:20:47 smithi037 ceph-mon[30630]: pgmap v442: 129 pgs: 129 active+clean; 1020 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.1 MiB/s wr, 778 op/s 2024-09-11T23:20:47.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:20:47 smithi160 ceph-mon[35055]: pgmap v442: 129 pgs: 129 active+clean; 1020 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.1 MiB/s wr, 778 op/s 2024-09-11T23:20:47.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:20:47 smithi123 ceph-mon[35438]: pgmap v442: 129 pgs: 129 active+clean; 1020 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.1 MiB/s wr, 778 op/s 2024-09-11T23:20:49.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:20:49 smithi037 ceph-mon[30630]: pgmap v443: 129 pgs: 129 active+clean; 1021 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 7.7 MiB/s wr, 627 op/s 2024-09-11T23:20:49.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:20:49 smithi160 ceph-mon[35055]: pgmap v443: 129 pgs: 129 active+clean; 1021 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 7.7 MiB/s wr, 627 op/s 2024-09-11T23:20:49.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:20:49 smithi123 ceph-mon[35438]: pgmap v443: 129 pgs: 129 active+clean; 1021 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 7.7 MiB/s wr, 627 op/s 2024-09-11T23:20:49.828 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 90.0 s, 2618.3 tps, lat 38.152 ms stddev 44.833 2024-09-11T23:20:51.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:20:51 smithi037 ceph-mon[30630]: pgmap v444: 129 pgs: 129 active+clean; 1021 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.8 MiB/s wr, 769 op/s 2024-09-11T23:20:51.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:20:51 smithi160 ceph-mon[35055]: pgmap v444: 129 pgs: 129 active+clean; 1021 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.8 MiB/s wr, 769 op/s 2024-09-11T23:20:51.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:20:51 smithi123 ceph-mon[35438]: pgmap v444: 129 pgs: 129 active+clean; 1021 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.8 MiB/s wr, 769 op/s 2024-09-11T23:20:53.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:20:53 smithi037 ceph-mon[30630]: pgmap v445: 129 pgs: 129 active+clean; 1021 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.5 MiB/s wr, 599 op/s 2024-09-11T23:20:53.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:20:53 smithi160 ceph-mon[35055]: pgmap v445: 129 pgs: 129 active+clean; 1021 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.5 MiB/s wr, 599 op/s 2024-09-11T23:20:53.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:20:53 smithi123 ceph-mon[35438]: pgmap v445: 129 pgs: 129 active+clean; 1021 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.5 MiB/s wr, 599 op/s 2024-09-11T23:20:54.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 95.0 s, 2286.0 tps, lat 42.826 ms stddev 55.389 2024-09-11T23:20:55.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:20:55 smithi037 ceph-mon[30630]: pgmap v446: 129 pgs: 129 active+clean; 1.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 7.0 MiB/s wr, 674 op/s 2024-09-11T23:20:55.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:20:55 smithi160 ceph-mon[35055]: pgmap v446: 129 pgs: 129 active+clean; 1.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 7.0 MiB/s wr, 674 op/s 2024-09-11T23:20:55.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:20:55 smithi123 ceph-mon[35438]: pgmap v446: 129 pgs: 129 active+clean; 1.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 7.0 MiB/s wr, 674 op/s 2024-09-11T23:20:57.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:20:57 smithi037 ceph-mon[30630]: pgmap v447: 129 pgs: 129 active+clean; 1.0 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.0 MiB/s wr, 723 op/s 2024-09-11T23:20:57.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:20:57 smithi160 ceph-mon[35055]: pgmap v447: 129 pgs: 129 active+clean; 1.0 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.0 MiB/s wr, 723 op/s 2024-09-11T23:20:57.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:20:57 smithi123 ceph-mon[35438]: pgmap v447: 129 pgs: 129 active+clean; 1.0 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.0 MiB/s wr, 723 op/s 2024-09-11T23:20:59.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:20:59 smithi037 ceph-mon[30630]: pgmap v448: 129 pgs: 129 active+clean; 1.0 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 7.1 MiB/s wr, 616 op/s 2024-09-11T23:20:59.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:20:59 smithi160 ceph-mon[35055]: pgmap v448: 129 pgs: 129 active+clean; 1.0 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 7.1 MiB/s wr, 616 op/s 2024-09-11T23:20:59.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:20:59 smithi123 ceph-mon[35438]: pgmap v448: 129 pgs: 129 active+clean; 1.0 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 7.1 MiB/s wr, 616 op/s 2024-09-11T23:20:59.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 100.0 s, 1775.8 tps, lat 56.813 ms stddev 69.609 2024-09-11T23:21:01.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:21:01 smithi160 ceph-mon[35055]: pgmap v449: 129 pgs: 129 active+clean; 1.0 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 10 MiB/s wr, 860 op/s 2024-09-11T23:21:01.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:21:01 smithi123 ceph-mon[35438]: pgmap v449: 129 pgs: 129 active+clean; 1.0 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 10 MiB/s wr, 860 op/s 2024-09-11T23:21:01.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:21:01 smithi037 ceph-mon[30630]: pgmap v449: 129 pgs: 129 active+clean; 1.0 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 10 MiB/s wr, 860 op/s 2024-09-11T23:21:03.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:21:03 smithi160 ceph-mon[35055]: pgmap v450: 129 pgs: 129 active+clean; 1.0 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.3 MiB/s wr, 709 op/s 2024-09-11T23:21:03.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:21:03 smithi123 ceph-mon[35438]: pgmap v450: 129 pgs: 129 active+clean; 1.0 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.3 MiB/s wr, 709 op/s 2024-09-11T23:21:03.815 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:21:03 smithi037 ceph-mon[30630]: pgmap v450: 129 pgs: 129 active+clean; 1.0 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.3 MiB/s wr, 709 op/s 2024-09-11T23:21:04.827 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 105.0 s, 1801.7 tps, lat 56.017 ms stddev 82.239 2024-09-11T23:21:05.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:21:05 smithi160 ceph-mon[35055]: pgmap v451: 129 pgs: 129 active+clean; 1.0 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 MiB/s wr, 863 op/s 2024-09-11T23:21:05.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:21:05 smithi123 ceph-mon[35438]: pgmap v451: 129 pgs: 129 active+clean; 1.0 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 MiB/s wr, 863 op/s 2024-09-11T23:21:05.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:21:05 smithi037 ceph-mon[30630]: pgmap v451: 129 pgs: 129 active+clean; 1.0 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 MiB/s wr, 863 op/s 2024-09-11T23:21:07.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:21:07 smithi160 ceph-mon[35055]: pgmap v452: 129 pgs: 129 active+clean; 1.0 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 14 MiB/s wr, 962 op/s 2024-09-11T23:21:07.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:21:07 smithi123 ceph-mon[35438]: pgmap v452: 129 pgs: 129 active+clean; 1.0 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 14 MiB/s wr, 962 op/s 2024-09-11T23:21:07.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:21:07 smithi037 ceph-mon[30630]: pgmap v452: 129 pgs: 129 active+clean; 1.0 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 14 MiB/s wr, 962 op/s 2024-09-11T23:21:09.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:21:09 smithi160 ceph-mon[35055]: pgmap v453: 129 pgs: 129 active+clean; 1.0 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 12 MiB/s wr, 864 op/s 2024-09-11T23:21:09.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:21:09 smithi123 ceph-mon[35438]: pgmap v453: 129 pgs: 129 active+clean; 1.0 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 12 MiB/s wr, 864 op/s 2024-09-11T23:21:09.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:21:09 smithi037 ceph-mon[30630]: pgmap v453: 129 pgs: 129 active+clean; 1.0 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 12 MiB/s wr, 864 op/s 2024-09-11T23:21:09.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 110.0 s, 2305.6 tps, lat 43.439 ms stddev 53.229 2024-09-11T23:21:11.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:21:11 smithi160 ceph-mon[35055]: pgmap v454: 129 pgs: 129 active+clean; 1.0 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 14 MiB/s wr, 1.02k op/s 2024-09-11T23:21:11.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:21:11 smithi123 ceph-mon[35438]: pgmap v454: 129 pgs: 129 active+clean; 1.0 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 14 MiB/s wr, 1.02k op/s 2024-09-11T23:21:11.815 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:21:11 smithi037 ceph-mon[30630]: pgmap v454: 129 pgs: 129 active+clean; 1.0 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 14 MiB/s wr, 1.02k op/s 2024-09-11T23:21:13.620 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:21:13 smithi037 ceph-mon[30630]: pgmap v455: 129 pgs: 129 active+clean; 1.0 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 11 MiB/s wr, 816 op/s 2024-09-11T23:21:13.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:21:13 smithi160 ceph-mon[35055]: pgmap v455: 129 pgs: 129 active+clean; 1.0 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 11 MiB/s wr, 816 op/s 2024-09-11T23:21:13.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:21:13 smithi123 ceph-mon[35438]: pgmap v455: 129 pgs: 129 active+clean; 1.0 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 11 MiB/s wr, 816 op/s 2024-09-11T23:21:14.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 115.0 s, 1706.4 tps, lat 57.941 ms stddev 84.012 2024-09-11T23:21:15.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:21:15 smithi160 ceph-mon[35055]: pgmap v456: 129 pgs: 129 active+clean; 1.0 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 13 MiB/s wr, 914 op/s 2024-09-11T23:21:15.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:21:15 smithi123 ceph-mon[35438]: pgmap v456: 129 pgs: 129 active+clean; 1.0 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 13 MiB/s wr, 914 op/s 2024-09-11T23:21:15.815 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:21:15 smithi037 ceph-mon[30630]: pgmap v456: 129 pgs: 129 active+clean; 1.0 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 13 MiB/s wr, 914 op/s 2024-09-11T23:21:17.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:21:17 smithi160 ceph-mon[35055]: pgmap v457: 129 pgs: 129 active+clean; 1.0 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 14 MiB/s wr, 905 op/s 2024-09-11T23:21:17.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:21:17 smithi123 ceph-mon[35438]: pgmap v457: 129 pgs: 129 active+clean; 1.0 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 14 MiB/s wr, 905 op/s 2024-09-11T23:21:17.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:21:17 smithi037 ceph-mon[30630]: pgmap v457: 129 pgs: 129 active+clean; 1.0 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 14 MiB/s wr, 905 op/s 2024-09-11T23:21:19.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:21:19 smithi160 ceph-mon[35055]: pgmap v458: 129 pgs: 129 active+clean; 1.0 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 11 MiB/s wr, 747 op/s 2024-09-11T23:21:19.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:21:19 smithi123 ceph-mon[35438]: pgmap v458: 129 pgs: 129 active+clean; 1.0 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 11 MiB/s wr, 747 op/s 2024-09-11T23:21:19.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:21:19 smithi037 ceph-mon[30630]: pgmap v458: 129 pgs: 129 active+clean; 1.0 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 11 MiB/s wr, 747 op/s 2024-09-11T23:21:19.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 120.0 s, 2332.2 tps, lat 43.091 ms stddev 52.022 2024-09-11T23:21:21.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:21:21 smithi160 ceph-mon[35055]: pgmap v459: 129 pgs: 129 active+clean; 1.0 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 13 MiB/s wr, 897 op/s 2024-09-11T23:21:21.753 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:21:21 smithi123 ceph-mon[35438]: pgmap v459: 129 pgs: 129 active+clean; 1.0 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 13 MiB/s wr, 897 op/s 2024-09-11T23:21:21.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:21:21 smithi037 ceph-mon[30630]: pgmap v459: 129 pgs: 129 active+clean; 1.0 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 13 MiB/s wr, 897 op/s 2024-09-11T23:21:23.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:21:23 smithi160 ceph-mon[35055]: pgmap v460: 129 pgs: 129 active+clean; 1.0 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 11 MiB/s wr, 737 op/s 2024-09-11T23:21:23.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:21:23 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:21:23.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:21:23 smithi123 ceph-mon[35438]: pgmap v460: 129 pgs: 129 active+clean; 1.0 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 11 MiB/s wr, 737 op/s 2024-09-11T23:21:23.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:21:23 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:21:23.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:21:23 smithi037 ceph-mon[30630]: pgmap v460: 129 pgs: 129 active+clean; 1.0 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 11 MiB/s wr, 737 op/s 2024-09-11T23:21:23.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:21:23 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:21:24.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:21:24 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:21:24.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:21:24 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:21:24.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:21:24 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:21:24.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:21:24 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:21:24.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:21:24 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:21:24.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:21:24 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:21:24.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:21:24 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:21:24.815 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:21:24 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:21:24.815 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:21:24 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:21:24.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 125.0 s, 1156.6 tps, lat 86.710 ms stddev 128.421 2024-09-11T23:21:26.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:21:25 smithi160 ceph-mon[35055]: pgmap v461: 129 pgs: 129 active+clean; 1.0 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 11 MiB/s wr, 749 op/s 2024-09-11T23:21:26.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:21:25 smithi123 ceph-mon[35438]: pgmap v461: 129 pgs: 129 active+clean; 1.0 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 11 MiB/s wr, 749 op/s 2024-09-11T23:21:26.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:21:25 smithi037 ceph-mon[30630]: pgmap v461: 129 pgs: 129 active+clean; 1.0 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 11 MiB/s wr, 749 op/s 2024-09-11T23:21:28.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:21:27 smithi160 ceph-mon[35055]: pgmap v462: 129 pgs: 129 active+clean; 1.0 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 8.7 MiB/s wr, 721 op/s 2024-09-11T23:21:28.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:21:27 smithi123 ceph-mon[35438]: pgmap v462: 129 pgs: 129 active+clean; 1.0 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 8.7 MiB/s wr, 721 op/s 2024-09-11T23:21:28.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:21:27 smithi037 ceph-mon[30630]: pgmap v462: 129 pgs: 129 active+clean; 1.0 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 8.7 MiB/s wr, 721 op/s 2024-09-11T23:21:29.826 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 130.0 s, 1319.8 tps, lat 74.689 ms stddev 88.254 2024-09-11T23:21:30.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:21:29 smithi160 ceph-mon[35055]: pgmap v463: 129 pgs: 129 active+clean; 1.0 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 5.0 MiB/s wr, 553 op/s 2024-09-11T23:21:30.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:21:29 smithi123 ceph-mon[35438]: pgmap v463: 129 pgs: 129 active+clean; 1.0 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 5.0 MiB/s wr, 553 op/s 2024-09-11T23:21:30.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:21:29 smithi037 ceph-mon[30630]: pgmap v463: 129 pgs: 129 active+clean; 1.0 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 5.0 MiB/s wr, 553 op/s 2024-09-11T23:21:32.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:21:31 smithi160 ceph-mon[35055]: pgmap v464: 129 pgs: 129 active+clean; 1.0 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 6.5 MiB/s wr, 706 op/s 2024-09-11T23:21:32.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:21:31 smithi123 ceph-mon[35438]: pgmap v464: 129 pgs: 129 active+clean; 1.0 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 6.5 MiB/s wr, 706 op/s 2024-09-11T23:21:32.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:21:31 smithi037 ceph-mon[30630]: pgmap v464: 129 pgs: 129 active+clean; 1.0 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 6.5 MiB/s wr, 706 op/s 2024-09-11T23:21:34.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:21:33 smithi160 ceph-mon[35055]: pgmap v465: 129 pgs: 129 active+clean; 1.0 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 4.7 MiB/s wr, 520 op/s 2024-09-11T23:21:34.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:21:33 smithi123 ceph-mon[35438]: pgmap v465: 129 pgs: 129 active+clean; 1.0 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 4.7 MiB/s wr, 520 op/s 2024-09-11T23:21:34.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:21:33 smithi037 ceph-mon[30630]: pgmap v465: 129 pgs: 129 active+clean; 1.0 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 4.7 MiB/s wr, 520 op/s 2024-09-11T23:21:34.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 135.0 s, 1386.8 tps, lat 72.824 ms stddev 88.609 2024-09-11T23:21:36.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:21:35 smithi160 ceph-mon[35055]: pgmap v466: 129 pgs: 129 active+clean; 1.0 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 5.4 MiB/s wr, 593 op/s 2024-09-11T23:21:36.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:21:35 smithi123 ceph-mon[35438]: pgmap v466: 129 pgs: 129 active+clean; 1.0 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 5.4 MiB/s wr, 593 op/s 2024-09-11T23:21:36.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:21:35 smithi037 ceph-mon[30630]: pgmap v466: 129 pgs: 129 active+clean; 1.0 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 5.4 MiB/s wr, 593 op/s 2024-09-11T23:21:38.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:21:37 smithi123 ceph-mon[35438]: pgmap v467: 129 pgs: 129 active+clean; 1.0 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 6.5 MiB/s wr, 607 op/s 2024-09-11T23:21:38.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:21:37 smithi037 ceph-mon[30630]: pgmap v467: 129 pgs: 129 active+clean; 1.0 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 6.5 MiB/s wr, 607 op/s 2024-09-11T23:21:38.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:21:37 smithi160 ceph-mon[35055]: pgmap v467: 129 pgs: 129 active+clean; 1.0 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 6.5 MiB/s wr, 607 op/s 2024-09-11T23:21:39.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 140.0 s, 1537.4 tps, lat 65.353 ms stddev 82.429 2024-09-11T23:21:40.235 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:21:39 smithi160 ceph-mon[35055]: pgmap v468: 129 pgs: 129 active+clean; 1.0 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 6.3 MiB/s wr, 537 op/s 2024-09-11T23:21:40.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:21:39 smithi123 ceph-mon[35438]: pgmap v468: 129 pgs: 129 active+clean; 1.0 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 6.3 MiB/s wr, 537 op/s 2024-09-11T23:21:40.316 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:21:39 smithi037 ceph-mon[30630]: pgmap v468: 129 pgs: 129 active+clean; 1.0 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 6.3 MiB/s wr, 537 op/s 2024-09-11T23:21:42.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:21:41 smithi123 ceph-mon[35438]: pgmap v469: 129 pgs: 129 active+clean; 1.0 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 7.5 MiB/s wr, 681 op/s 2024-09-11T23:21:42.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:21:41 smithi037 ceph-mon[30630]: pgmap v469: 129 pgs: 129 active+clean; 1.0 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 7.5 MiB/s wr, 681 op/s 2024-09-11T23:21:42.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:21:41 smithi160 ceph-mon[35055]: pgmap v469: 129 pgs: 129 active+clean; 1.0 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 7.5 MiB/s wr, 681 op/s 2024-09-11T23:21:44.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:21:43 smithi123 ceph-mon[35438]: pgmap v470: 129 pgs: 129 active+clean; 1.0 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 6.0 MiB/s wr, 534 op/s 2024-09-11T23:21:44.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:21:43 smithi037 ceph-mon[30630]: pgmap v470: 129 pgs: 129 active+clean; 1.0 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 6.0 MiB/s wr, 534 op/s 2024-09-11T23:21:44.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:21:43 smithi160 ceph-mon[35055]: pgmap v470: 129 pgs: 129 active+clean; 1.0 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 6.0 MiB/s wr, 534 op/s 2024-09-11T23:21:44.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 145.0 s, 1550.4 tps, lat 64.729 ms stddev 73.372 2024-09-11T23:21:46.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:21:45 smithi123 ceph-mon[35438]: pgmap v471: 129 pgs: 129 active+clean; 1.1 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 6.7 MiB/s wr, 616 op/s 2024-09-11T23:21:46.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:21:45 smithi037 ceph-mon[30630]: pgmap v471: 129 pgs: 129 active+clean; 1.1 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 6.7 MiB/s wr, 616 op/s 2024-09-11T23:21:46.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:21:45 smithi160 ceph-mon[35055]: pgmap v471: 129 pgs: 129 active+clean; 1.1 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 6.7 MiB/s wr, 616 op/s 2024-09-11T23:21:48.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:21:47 smithi123 ceph-mon[35438]: pgmap v472: 129 pgs: 129 active+clean; 1.1 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 7.1 MiB/s wr, 646 op/s 2024-09-11T23:21:48.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:21:47 smithi037 ceph-mon[30630]: pgmap v472: 129 pgs: 129 active+clean; 1.1 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 7.1 MiB/s wr, 646 op/s 2024-09-11T23:21:48.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:21:47 smithi160 ceph-mon[35055]: pgmap v472: 129 pgs: 129 active+clean; 1.1 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 7.1 MiB/s wr, 646 op/s 2024-09-11T23:21:49.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 150.0 s, 1335.4 tps, lat 73.450 ms stddev 87.991 2024-09-11T23:21:50.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:21:49 smithi123 ceph-mon[35438]: pgmap v473: 129 pgs: 129 active+clean; 1.1 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 5.7 MiB/s wr, 602 op/s 2024-09-11T23:21:50.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:21:49 smithi037 ceph-mon[30630]: pgmap v473: 129 pgs: 129 active+clean; 1.1 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 5.7 MiB/s wr, 602 op/s 2024-09-11T23:21:50.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:21:49 smithi160 ceph-mon[35055]: pgmap v473: 129 pgs: 129 active+clean; 1.1 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 5.7 MiB/s wr, 602 op/s 2024-09-11T23:21:52.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:21:51 smithi123 ceph-mon[35438]: pgmap v474: 129 pgs: 129 active+clean; 1.1 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 6.6 MiB/s wr, 714 op/s 2024-09-11T23:21:52.316 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:21:51 smithi037 ceph-mon[30630]: pgmap v474: 129 pgs: 129 active+clean; 1.1 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 6.6 MiB/s wr, 714 op/s 2024-09-11T23:21:52.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:21:51 smithi160 ceph-mon[35055]: pgmap v474: 129 pgs: 129 active+clean; 1.1 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 6.6 MiB/s wr, 714 op/s 2024-09-11T23:21:54.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:21:53 smithi123 ceph-mon[35438]: pgmap v475: 129 pgs: 129 active+clean; 1.1 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 5.5 MiB/s wr, 588 op/s 2024-09-11T23:21:54.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:21:53 smithi037 ceph-mon[30630]: pgmap v475: 129 pgs: 129 active+clean; 1.1 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 5.5 MiB/s wr, 588 op/s 2024-09-11T23:21:54.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:21:53 smithi160 ceph-mon[35055]: pgmap v475: 129 pgs: 129 active+clean; 1.1 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 5.5 MiB/s wr, 588 op/s 2024-09-11T23:21:54.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 155.0 s, 1080.4 tps, lat 92.751 ms stddev 142.479 2024-09-11T23:21:56.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:21:56 smithi123 ceph-mon[35438]: pgmap v476: 129 pgs: 129 active+clean; 1.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.2 MiB/s wr, 731 op/s 2024-09-11T23:21:56.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:21:55 smithi037 ceph-mon[30630]: pgmap v476: 129 pgs: 129 active+clean; 1.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.2 MiB/s wr, 731 op/s 2024-09-11T23:21:56.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:21:55 smithi160 ceph-mon[35055]: pgmap v476: 129 pgs: 129 active+clean; 1.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.2 MiB/s wr, 731 op/s 2024-09-11T23:21:58.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:21:58 smithi037 ceph-mon[30630]: pgmap v477: 129 pgs: 129 active+clean; 1.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 13 MiB/s wr, 942 op/s 2024-09-11T23:21:58.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:21:58 smithi160 ceph-mon[35055]: pgmap v477: 129 pgs: 129 active+clean; 1.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 13 MiB/s wr, 942 op/s 2024-09-11T23:21:58.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:21:58 smithi123 ceph-mon[35438]: pgmap v477: 129 pgs: 129 active+clean; 1.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 13 MiB/s wr, 942 op/s 2024-09-11T23:21:59.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 160.0 s, 1147.4 tps, lat 87.587 ms stddev 100.519 2024-09-11T23:22:00.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:22:00 smithi037 ceph-mon[30630]: pgmap v478: 129 pgs: 129 active+clean; 1.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 13 MiB/s wr, 884 op/s 2024-09-11T23:22:00.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:22:00 smithi160 ceph-mon[35055]: pgmap v478: 129 pgs: 129 active+clean; 1.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 13 MiB/s wr, 884 op/s 2024-09-11T23:22:00.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:22:00 smithi123 ceph-mon[35438]: pgmap v478: 129 pgs: 129 active+clean; 1.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 13 MiB/s wr, 884 op/s 2024-09-11T23:22:02.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:22:02 smithi037 ceph-mon[30630]: pgmap v479: 129 pgs: 129 active+clean; 1.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 15 MiB/s wr, 1.03k op/s 2024-09-11T23:22:02.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:22:02 smithi160 ceph-mon[35055]: pgmap v479: 129 pgs: 129 active+clean; 1.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 15 MiB/s wr, 1.03k op/s 2024-09-11T23:22:02.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:22:02 smithi123 ceph-mon[35438]: pgmap v479: 129 pgs: 129 active+clean; 1.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 15 MiB/s wr, 1.03k op/s 2024-09-11T23:22:04.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:22:04 smithi037 ceph-mon[30630]: pgmap v480: 129 pgs: 129 active+clean; 1.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 13 MiB/s wr, 881 op/s 2024-09-11T23:22:04.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:22:04 smithi160 ceph-mon[35055]: pgmap v480: 129 pgs: 129 active+clean; 1.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 13 MiB/s wr, 881 op/s 2024-09-11T23:22:04.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:22:04 smithi123 ceph-mon[35438]: pgmap v480: 129 pgs: 129 active+clean; 1.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 13 MiB/s wr, 881 op/s 2024-09-11T23:22:04.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 165.0 s, 1061.4 tps, lat 91.977 ms stddev 115.298 2024-09-11T23:22:06.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:22:06 smithi037 ceph-mon[30630]: pgmap v481: 129 pgs: 129 active+clean; 1.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 15 MiB/s wr, 964 op/s 2024-09-11T23:22:06.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:22:06 smithi160 ceph-mon[35055]: pgmap v481: 129 pgs: 129 active+clean; 1.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 15 MiB/s wr, 964 op/s 2024-09-11T23:22:06.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:22:06 smithi123 ceph-mon[35438]: pgmap v481: 129 pgs: 129 active+clean; 1.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 15 MiB/s wr, 964 op/s 2024-09-11T23:22:08.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:22:08 smithi037 ceph-mon[30630]: pgmap v482: 129 pgs: 129 active+clean; 1.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 12 MiB/s wr, 854 op/s 2024-09-11T23:22:08.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:22:08 smithi160 ceph-mon[35055]: pgmap v482: 129 pgs: 129 active+clean; 1.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 12 MiB/s wr, 854 op/s 2024-09-11T23:22:08.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:22:08 smithi123 ceph-mon[35438]: pgmap v482: 129 pgs: 129 active+clean; 1.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 12 MiB/s wr, 854 op/s 2024-09-11T23:22:09.826 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 170.0 s, 1088.8 tps, lat 94.078 ms stddev 128.737 2024-09-11T23:22:10.302 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:22:10 smithi123 ceph-mon[35438]: pgmap v483: 129 pgs: 129 active+clean; 1.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 7.0 MiB/s wr, 577 op/s 2024-09-11T23:22:10.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:22:10 smithi037 ceph-mon[30630]: pgmap v483: 129 pgs: 129 active+clean; 1.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 7.0 MiB/s wr, 577 op/s 2024-09-11T23:22:10.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:22:10 smithi160 ceph-mon[35055]: pgmap v483: 129 pgs: 129 active+clean; 1.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 7.0 MiB/s wr, 577 op/s 2024-09-11T23:22:12.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:22:12 smithi037 ceph-mon[30630]: pgmap v484: 129 pgs: 129 active+clean; 1.1 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.2 MiB/s wr, 716 op/s 2024-09-11T23:22:12.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:22:12 smithi160 ceph-mon[35055]: pgmap v484: 129 pgs: 129 active+clean; 1.1 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.2 MiB/s wr, 716 op/s 2024-09-11T23:22:12.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:22:12 smithi123 ceph-mon[35438]: pgmap v484: 129 pgs: 129 active+clean; 1.1 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.2 MiB/s wr, 716 op/s 2024-09-11T23:22:14.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:22:14 smithi037 ceph-mon[30630]: pgmap v485: 129 pgs: 129 active+clean; 1.1 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.2 MiB/s wr, 555 op/s 2024-09-11T23:22:14.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:22:14 smithi160 ceph-mon[35055]: pgmap v485: 129 pgs: 129 active+clean; 1.1 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.2 MiB/s wr, 555 op/s 2024-09-11T23:22:14.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:22:14 smithi123 ceph-mon[35438]: pgmap v485: 129 pgs: 129 active+clean; 1.1 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.2 MiB/s wr, 555 op/s 2024-09-11T23:22:14.826 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 175.0 s, 1291.8 tps, lat 77.039 ms stddev 117.790 2024-09-11T23:22:16.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:22:16 smithi160 ceph-mon[35055]: pgmap v486: 129 pgs: 129 active+clean; 1.1 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 6.6 MiB/s wr, 639 op/s 2024-09-11T23:22:16.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:22:16 smithi123 ceph-mon[35438]: pgmap v486: 129 pgs: 129 active+clean; 1.1 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 6.6 MiB/s wr, 639 op/s 2024-09-11T23:22:16.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:22:16 smithi037 ceph-mon[30630]: pgmap v486: 129 pgs: 129 active+clean; 1.1 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 6.6 MiB/s wr, 639 op/s 2024-09-11T23:22:18.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:22:18 smithi160 ceph-mon[35055]: pgmap v487: 129 pgs: 129 active+clean; 1.1 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 5.5 MiB/s wr, 609 op/s 2024-09-11T23:22:18.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:22:18 smithi123 ceph-mon[35438]: pgmap v487: 129 pgs: 129 active+clean; 1.1 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 5.5 MiB/s wr, 609 op/s 2024-09-11T23:22:18.566 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:22:18 smithi037 ceph-mon[30630]: pgmap v487: 129 pgs: 129 active+clean; 1.1 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 5.5 MiB/s wr, 609 op/s 2024-09-11T23:22:19.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 180.0 s, 1167.2 tps, lat 85.627 ms stddev 101.408 2024-09-11T23:22:20.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:22:20 smithi160 ceph-mon[35055]: pgmap v488: 129 pgs: 129 active+clean; 1.1 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 5.4 MiB/s wr, 584 op/s 2024-09-11T23:22:20.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:22:20 smithi123 ceph-mon[35438]: pgmap v488: 129 pgs: 129 active+clean; 1.1 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 5.4 MiB/s wr, 584 op/s 2024-09-11T23:22:20.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:22:20 smithi037 ceph-mon[30630]: pgmap v488: 129 pgs: 129 active+clean; 1.1 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 5.4 MiB/s wr, 584 op/s 2024-09-11T23:22:22.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:22:22 smithi160 ceph-mon[35055]: pgmap v489: 129 pgs: 129 active+clean; 1.1 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 6.3 MiB/s wr, 697 op/s 2024-09-11T23:22:22.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:22:22 smithi123 ceph-mon[35438]: pgmap v489: 129 pgs: 129 active+clean; 1.1 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 6.3 MiB/s wr, 697 op/s 2024-09-11T23:22:22.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:22:22 smithi037 ceph-mon[30630]: pgmap v489: 129 pgs: 129 active+clean; 1.1 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 6.3 MiB/s wr, 697 op/s 2024-09-11T23:22:23.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:22:23 smithi160 ceph-mon[35055]: pgmap v490: 129 pgs: 129 active+clean; 1.1 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.8 MiB/s wr, 547 op/s 2024-09-11T23:22:23.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:22:23 smithi123 ceph-mon[35438]: pgmap v490: 129 pgs: 129 active+clean; 1.1 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.8 MiB/s wr, 547 op/s 2024-09-11T23:22:23.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:22:23 smithi037 ceph-mon[30630]: pgmap v490: 129 pgs: 129 active+clean; 1.1 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.8 MiB/s wr, 547 op/s 2024-09-11T23:22:24.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:22:24 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:22:24.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:22:24 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:22:24.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:22:24 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:22:24.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 185.0 s, 1872.4 tps, lat 54.117 ms stddev 70.603 2024-09-11T23:22:25.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:22:25 smithi160 ceph-mon[35055]: pgmap v491: 129 pgs: 129 active+clean; 1.1 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 5.1 MiB/s wr, 585 op/s 2024-09-11T23:22:25.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:22:25 smithi123 ceph-mon[35438]: pgmap v491: 129 pgs: 129 active+clean; 1.1 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 5.1 MiB/s wr, 585 op/s 2024-09-11T23:22:25.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:22:25 smithi037 ceph-mon[30630]: pgmap v491: 129 pgs: 129 active+clean; 1.1 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 5.1 MiB/s wr, 585 op/s 2024-09-11T23:22:26.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:22:26 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:22:26.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:22:26 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:22:26.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:22:26 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:22:26.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:22:26 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:22:26.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:22:26 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:22:26.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:22:26 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:22:26.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:22:26 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:22:26.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:22:26 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:22:26.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:22:26 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:22:27.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:22:27 smithi160 ceph-mon[35055]: pgmap v492: 129 pgs: 129 active+clean; 1.1 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.1 MiB/s wr, 589 op/s 2024-09-11T23:22:27.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:22:27 smithi123 ceph-mon[35438]: pgmap v492: 129 pgs: 129 active+clean; 1.1 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.1 MiB/s wr, 589 op/s 2024-09-11T23:22:27.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:22:27 smithi037 ceph-mon[30630]: pgmap v492: 129 pgs: 129 active+clean; 1.1 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.1 MiB/s wr, 589 op/s 2024-09-11T23:22:29.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:22:29 smithi123 ceph-mon[35438]: pgmap v493: 129 pgs: 129 active+clean; 1.1 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.9 MiB/s wr, 554 op/s 2024-09-11T23:22:29.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:22:29 smithi037 ceph-mon[30630]: pgmap v493: 129 pgs: 129 active+clean; 1.1 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.9 MiB/s wr, 554 op/s 2024-09-11T23:22:29.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:22:29 smithi160 ceph-mon[35055]: pgmap v493: 129 pgs: 129 active+clean; 1.1 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.9 MiB/s wr, 554 op/s 2024-09-11T23:22:29.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 190.0 s, 1353.0 tps, lat 73.668 ms stddev 103.143 2024-09-11T23:22:31.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:22:31 smithi123 ceph-mon[35438]: pgmap v494: 129 pgs: 129 active+clean; 1.1 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 7.9 MiB/s wr, 719 op/s 2024-09-11T23:22:31.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:22:31 smithi037 ceph-mon[30630]: pgmap v494: 129 pgs: 129 active+clean; 1.1 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 7.9 MiB/s wr, 719 op/s 2024-09-11T23:22:31.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:22:31 smithi160 ceph-mon[35055]: pgmap v494: 129 pgs: 129 active+clean; 1.1 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 7.9 MiB/s wr, 719 op/s 2024-09-11T23:22:33.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:22:33 smithi123 ceph-mon[35438]: pgmap v495: 129 pgs: 129 active+clean; 1.1 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 7.0 MiB/s wr, 596 op/s 2024-09-11T23:22:33.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:22:33 smithi037 ceph-mon[30630]: pgmap v495: 129 pgs: 129 active+clean; 1.1 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 7.0 MiB/s wr, 596 op/s 2024-09-11T23:22:33.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:22:33 smithi160 ceph-mon[35055]: pgmap v495: 129 pgs: 129 active+clean; 1.1 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 7.0 MiB/s wr, 596 op/s 2024-09-11T23:22:34.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 195.0 s, 1339.2 tps, lat 74.079 ms stddev 91.571 2024-09-11T23:22:35.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:22:35 smithi123 ceph-mon[35438]: pgmap v496: 129 pgs: 129 active+clean; 1.1 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 7.0 MiB/s wr, 614 op/s 2024-09-11T23:22:35.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:22:35 smithi037 ceph-mon[30630]: pgmap v496: 129 pgs: 129 active+clean; 1.1 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 7.0 MiB/s wr, 614 op/s 2024-09-11T23:22:35.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:22:35 smithi160 ceph-mon[35055]: pgmap v496: 129 pgs: 129 active+clean; 1.1 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 7.0 MiB/s wr, 614 op/s 2024-09-11T23:22:37.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:22:37 smithi123 ceph-mon[35438]: pgmap v497: 129 pgs: 129 active+clean; 1.1 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 7.5 MiB/s wr, 653 op/s 2024-09-11T23:22:37.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:22:37 smithi037 ceph-mon[30630]: pgmap v497: 129 pgs: 129 active+clean; 1.1 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 7.5 MiB/s wr, 653 op/s 2024-09-11T23:22:37.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:22:37 smithi160 ceph-mon[35055]: pgmap v497: 129 pgs: 129 active+clean; 1.1 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 7.5 MiB/s wr, 653 op/s 2024-09-11T23:22:39.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:22:39 smithi123 ceph-mon[35438]: pgmap v498: 129 pgs: 129 active+clean; 1.1 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 6.7 MiB/s wr, 575 op/s 2024-09-11T23:22:39.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:22:39 smithi037 ceph-mon[30630]: pgmap v498: 129 pgs: 129 active+clean; 1.1 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 6.7 MiB/s wr, 575 op/s 2024-09-11T23:22:39.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:22:39 smithi160 ceph-mon[35055]: pgmap v498: 129 pgs: 129 active+clean; 1.1 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 6.7 MiB/s wr, 575 op/s 2024-09-11T23:22:39.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 200.0 s, 1362.2 tps, lat 73.615 ms stddev 92.165 2024-09-11T23:22:41.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:22:41 smithi123 ceph-mon[35438]: pgmap v499: 129 pgs: 129 active+clean; 1.1 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 8.6 MiB/s wr, 746 op/s 2024-09-11T23:22:41.566 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:22:41 smithi037 ceph-mon[30630]: pgmap v499: 129 pgs: 129 active+clean; 1.1 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 8.6 MiB/s wr, 746 op/s 2024-09-11T23:22:41.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:22:41 smithi160 ceph-mon[35055]: pgmap v499: 129 pgs: 129 active+clean; 1.1 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 8.6 MiB/s wr, 746 op/s 2024-09-11T23:22:43.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:22:43 smithi037 ceph-mon[30630]: pgmap v500: 129 pgs: 129 active+clean; 1.1 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 5.9 MiB/s wr, 607 op/s 2024-09-11T23:22:43.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:22:43 smithi160 ceph-mon[35055]: pgmap v500: 129 pgs: 129 active+clean; 1.1 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 5.9 MiB/s wr, 607 op/s 2024-09-11T23:22:43.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:22:43 smithi123 ceph-mon[35438]: pgmap v500: 129 pgs: 129 active+clean; 1.1 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 5.9 MiB/s wr, 607 op/s 2024-09-11T23:22:44.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 205.0 s, 1855.4 tps, lat 53.687 ms stddev 64.865 2024-09-11T23:22:45.566 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:22:45 smithi037 ceph-mon[30630]: pgmap v501: 129 pgs: 129 active+clean; 1.1 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 6.7 MiB/s wr, 676 op/s 2024-09-11T23:22:45.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:22:45 smithi160 ceph-mon[35055]: pgmap v501: 129 pgs: 129 active+clean; 1.1 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 6.7 MiB/s wr, 676 op/s 2024-09-11T23:22:45.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:22:45 smithi123 ceph-mon[35438]: pgmap v501: 129 pgs: 129 active+clean; 1.1 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 6.7 MiB/s wr, 676 op/s 2024-09-11T23:22:47.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:22:47 smithi037 ceph-mon[30630]: pgmap v502: 129 pgs: 129 active+clean; 1.1 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.4 MiB/s wr, 737 op/s 2024-09-11T23:22:47.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:22:47 smithi160 ceph-mon[35055]: pgmap v502: 129 pgs: 129 active+clean; 1.1 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.4 MiB/s wr, 737 op/s 2024-09-11T23:22:47.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:22:47 smithi123 ceph-mon[35438]: pgmap v502: 129 pgs: 129 active+clean; 1.1 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.4 MiB/s wr, 737 op/s 2024-09-11T23:22:49.566 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:22:49 smithi037 ceph-mon[30630]: pgmap v503: 129 pgs: 129 active+clean; 1.1 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.8 MiB/s wr, 671 op/s 2024-09-11T23:22:49.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:22:49 smithi160 ceph-mon[35055]: pgmap v503: 129 pgs: 129 active+clean; 1.1 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.8 MiB/s wr, 671 op/s 2024-09-11T23:22:49.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:22:49 smithi123 ceph-mon[35438]: pgmap v503: 129 pgs: 129 active+clean; 1.1 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.8 MiB/s wr, 671 op/s 2024-09-11T23:22:49.827 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 210.0 s, 1532.0 tps, lat 64.747 ms stddev 86.305 2024-09-11T23:22:51.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:22:51 smithi037 ceph-mon[30630]: pgmap v504: 129 pgs: 129 active+clean; 1.1 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.0 MiB/s wr, 801 op/s 2024-09-11T23:22:51.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:22:51 smithi160 ceph-mon[35055]: pgmap v504: 129 pgs: 129 active+clean; 1.1 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.0 MiB/s wr, 801 op/s 2024-09-11T23:22:51.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:22:51 smithi123 ceph-mon[35438]: pgmap v504: 129 pgs: 129 active+clean; 1.1 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.0 MiB/s wr, 801 op/s 2024-09-11T23:22:53.567 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:22:53 smithi037 ceph-mon[30630]: pgmap v505: 129 pgs: 129 active+clean; 1.1 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.0 MiB/s wr, 631 op/s 2024-09-11T23:22:53.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:22:53 smithi160 ceph-mon[35055]: pgmap v505: 129 pgs: 129 active+clean; 1.1 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.0 MiB/s wr, 631 op/s 2024-09-11T23:22:53.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:22:53 smithi123 ceph-mon[35438]: pgmap v505: 129 pgs: 129 active+clean; 1.1 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.0 MiB/s wr, 631 op/s 2024-09-11T23:22:54.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 215.0 s, 1333.6 tps, lat 74.986 ms stddev 96.253 2024-09-11T23:22:55.566 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:22:55 smithi037 ceph-mon[30630]: pgmap v506: 129 pgs: 129 active+clean; 1.1 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.5 MiB/s wr, 654 op/s 2024-09-11T23:22:55.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:22:55 smithi160 ceph-mon[35055]: pgmap v506: 129 pgs: 129 active+clean; 1.1 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.5 MiB/s wr, 654 op/s 2024-09-11T23:22:55.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:22:55 smithi123 ceph-mon[35438]: pgmap v506: 129 pgs: 129 active+clean; 1.1 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.5 MiB/s wr, 654 op/s 2024-09-11T23:22:57.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:22:57 smithi037 ceph-mon[30630]: pgmap v507: 129 pgs: 129 active+clean; 1.1 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 7.1 MiB/s wr, 646 op/s 2024-09-11T23:22:57.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:22:57 smithi160 ceph-mon[35055]: pgmap v507: 129 pgs: 129 active+clean; 1.1 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 7.1 MiB/s wr, 646 op/s 2024-09-11T23:22:57.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:22:57 smithi123 ceph-mon[35438]: pgmap v507: 129 pgs: 129 active+clean; 1.1 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 7.1 MiB/s wr, 646 op/s 2024-09-11T23:22:59.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:22:59 smithi037 ceph-mon[30630]: pgmap v508: 129 pgs: 129 active+clean; 1.1 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 6.0 MiB/s wr, 546 op/s 2024-09-11T23:22:59.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:22:59 smithi160 ceph-mon[35055]: pgmap v508: 129 pgs: 129 active+clean; 1.1 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 6.0 MiB/s wr, 546 op/s 2024-09-11T23:22:59.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:22:59 smithi123 ceph-mon[35438]: pgmap v508: 129 pgs: 129 active+clean; 1.1 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 6.0 MiB/s wr, 546 op/s 2024-09-11T23:22:59.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 220.0 s, 1388.6 tps, lat 72.718 ms stddev 92.358 2024-09-11T23:23:01.568 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:23:01 smithi037 ceph-mon[30630]: pgmap v509: 129 pgs: 129 active+clean; 1.1 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.3 MiB/s wr, 679 op/s 2024-09-11T23:23:01.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:23:01 smithi160 ceph-mon[35055]: pgmap v509: 129 pgs: 129 active+clean; 1.1 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.3 MiB/s wr, 679 op/s 2024-09-11T23:23:01.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:23:01 smithi123 ceph-mon[35438]: pgmap v509: 129 pgs: 129 active+clean; 1.1 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.3 MiB/s wr, 679 op/s 2024-09-11T23:23:03.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:23:03 smithi160 ceph-mon[35055]: pgmap v510: 129 pgs: 129 active+clean; 1.1 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.3 MiB/s wr, 568 op/s 2024-09-11T23:23:03.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:23:03 smithi123 ceph-mon[35438]: pgmap v510: 129 pgs: 129 active+clean; 1.1 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.3 MiB/s wr, 568 op/s 2024-09-11T23:23:03.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:23:03 smithi037 ceph-mon[30630]: pgmap v510: 129 pgs: 129 active+clean; 1.1 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.3 MiB/s wr, 568 op/s 2024-09-11T23:23:04.826 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 225.0 s, 1253.9 tps, lat 79.962 ms stddev 113.542 2024-09-11T23:23:05.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:23:05 smithi160 ceph-mon[35055]: pgmap v511: 129 pgs: 129 active+clean; 1.1 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 7.7 MiB/s wr, 668 op/s 2024-09-11T23:23:05.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:23:05 smithi123 ceph-mon[35438]: pgmap v511: 129 pgs: 129 active+clean; 1.1 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 7.7 MiB/s wr, 668 op/s 2024-09-11T23:23:05.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:23:05 smithi037 ceph-mon[30630]: pgmap v511: 129 pgs: 129 active+clean; 1.1 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 7.7 MiB/s wr, 668 op/s 2024-09-11T23:23:07.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:23:07 smithi160 ceph-mon[35055]: pgmap v512: 129 pgs: 129 active+clean; 1.1 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.0 MiB/s wr, 648 op/s 2024-09-11T23:23:07.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:23:07 smithi123 ceph-mon[35438]: pgmap v512: 129 pgs: 129 active+clean; 1.1 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.0 MiB/s wr, 648 op/s 2024-09-11T23:23:07.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:23:07 smithi037 ceph-mon[30630]: pgmap v512: 129 pgs: 129 active+clean; 1.1 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.0 MiB/s wr, 648 op/s 2024-09-11T23:23:09.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:23:09 smithi160 ceph-mon[35055]: pgmap v513: 129 pgs: 129 active+clean; 1.1 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 5.6 MiB/s wr, 595 op/s 2024-09-11T23:23:09.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:23:09 smithi123 ceph-mon[35438]: pgmap v513: 129 pgs: 129 active+clean; 1.1 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 5.6 MiB/s wr, 595 op/s 2024-09-11T23:23:09.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:23:09 smithi037 ceph-mon[30630]: pgmap v513: 129 pgs: 129 active+clean; 1.1 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 5.6 MiB/s wr, 595 op/s 2024-09-11T23:23:09.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 230.0 s, 1445.9 tps, lat 68.135 ms stddev 88.273 2024-09-11T23:23:11.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:23:11 smithi160 ceph-mon[35055]: pgmap v514: 129 pgs: 129 active+clean; 1.1 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 7.2 MiB/s wr, 747 op/s 2024-09-11T23:23:11.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:23:11 smithi123 ceph-mon[35438]: pgmap v514: 129 pgs: 129 active+clean; 1.1 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 7.2 MiB/s wr, 747 op/s 2024-09-11T23:23:11.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:23:11 smithi037 ceph-mon[30630]: pgmap v514: 129 pgs: 129 active+clean; 1.1 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 7.2 MiB/s wr, 747 op/s 2024-09-11T23:23:13.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:23:13 smithi160 ceph-mon[35055]: pgmap v515: 129 pgs: 129 active+clean; 1.1 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 6.5 MiB/s wr, 647 op/s 2024-09-11T23:23:13.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:23:13 smithi123 ceph-mon[35438]: pgmap v515: 129 pgs: 129 active+clean; 1.1 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 6.5 MiB/s wr, 647 op/s 2024-09-11T23:23:13.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:23:13 smithi037 ceph-mon[30630]: pgmap v515: 129 pgs: 129 active+clean; 1.1 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 6.5 MiB/s wr, 647 op/s 2024-09-11T23:23:14.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 235.0 s, 1067.2 tps, lat 92.849 ms stddev 137.230 2024-09-11T23:23:15.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:23:15 smithi160 ceph-mon[35055]: pgmap v516: 129 pgs: 129 active+clean; 1.1 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 8.1 MiB/s wr, 753 op/s 2024-09-11T23:23:15.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:23:15 smithi123 ceph-mon[35438]: pgmap v516: 129 pgs: 129 active+clean; 1.1 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 8.1 MiB/s wr, 753 op/s 2024-09-11T23:23:15.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:23:15 smithi037 ceph-mon[30630]: pgmap v516: 129 pgs: 129 active+clean; 1.1 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 8.1 MiB/s wr, 753 op/s 2024-09-11T23:23:17.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:23:17 smithi160 ceph-mon[35055]: pgmap v517: 129 pgs: 129 active+clean; 1.1 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 7.6 MiB/s wr, 721 op/s 2024-09-11T23:23:17.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:23:17 smithi123 ceph-mon[35438]: pgmap v517: 129 pgs: 129 active+clean; 1.1 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 7.6 MiB/s wr, 721 op/s 2024-09-11T23:23:17.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:23:17 smithi037 ceph-mon[30630]: pgmap v517: 129 pgs: 129 active+clean; 1.1 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 7.6 MiB/s wr, 721 op/s 2024-09-11T23:23:19.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:23:19 smithi160 ceph-mon[35055]: pgmap v518: 129 pgs: 129 active+clean; 1.1 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 7.3 MiB/s wr, 679 op/s 2024-09-11T23:23:19.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:23:19 smithi123 ceph-mon[35438]: pgmap v518: 129 pgs: 129 active+clean; 1.1 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 7.3 MiB/s wr, 679 op/s 2024-09-11T23:23:19.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:23:19 smithi037 ceph-mon[30630]: pgmap v518: 129 pgs: 129 active+clean; 1.1 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 7.3 MiB/s wr, 679 op/s 2024-09-11T23:23:19.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 240.0 s, 900.4 tps, lat 111.323 ms stddev 121.804 2024-09-11T23:23:21.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:23:21 smithi160 ceph-mon[35055]: pgmap v519: 129 pgs: 129 active+clean; 1.1 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 8.8 MiB/s wr, 796 op/s 2024-09-11T23:23:21.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:23:21 smithi123 ceph-mon[35438]: pgmap v519: 129 pgs: 129 active+clean; 1.1 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 8.8 MiB/s wr, 796 op/s 2024-09-11T23:23:21.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:23:21 smithi037 ceph-mon[30630]: pgmap v519: 129 pgs: 129 active+clean; 1.1 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 8.8 MiB/s wr, 796 op/s 2024-09-11T23:23:23.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:23:23 smithi160 ceph-mon[35055]: pgmap v520: 129 pgs: 129 active+clean; 1.1 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 7.2 MiB/s wr, 650 op/s 2024-09-11T23:23:23.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:23:23 smithi123 ceph-mon[35438]: pgmap v520: 129 pgs: 129 active+clean; 1.1 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 7.2 MiB/s wr, 650 op/s 2024-09-11T23:23:23.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:23:23 smithi037 ceph-mon[30630]: pgmap v520: 129 pgs: 129 active+clean; 1.1 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 7.2 MiB/s wr, 650 op/s 2024-09-11T23:23:24.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 245.0 s, 970.4 tps, lat 102.274 ms stddev 122.801 2024-09-11T23:23:25.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:23:25 smithi160 ceph-mon[35055]: pgmap v521: 129 pgs: 129 active+clean; 1.1 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 7.2 MiB/s wr, 649 op/s 2024-09-11T23:23:25.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:23:25 smithi123 ceph-mon[35438]: pgmap v521: 129 pgs: 129 active+clean; 1.1 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 7.2 MiB/s wr, 649 op/s 2024-09-11T23:23:25.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:23:25 smithi037 ceph-mon[30630]: pgmap v521: 129 pgs: 129 active+clean; 1.1 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 7.2 MiB/s wr, 649 op/s 2024-09-11T23:23:26.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:23:26 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:23:26.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:23:26 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:23:26.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:23:26 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:23:27.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:23:27 smithi160 ceph-mon[35055]: pgmap v522: 129 pgs: 129 active+clean; 1.1 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 7.4 MiB/s wr, 616 op/s 2024-09-11T23:23:27.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:23:27 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:23:27.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:23:27 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:23:27.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:23:27 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:23:27.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:23:27 smithi123 ceph-mon[35438]: pgmap v522: 129 pgs: 129 active+clean; 1.1 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 7.4 MiB/s wr, 616 op/s 2024-09-11T23:23:27.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:23:27 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:23:27.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:23:27 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:23:27.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:23:27 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:23:27.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:23:27 smithi037 ceph-mon[30630]: pgmap v522: 129 pgs: 129 active+clean; 1.1 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 7.4 MiB/s wr, 616 op/s 2024-09-11T23:23:27.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:23:27 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:23:27.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:23:27 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:23:27.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:23:27 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:23:29.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:23:29 smithi123 ceph-mon[35438]: pgmap v523: 129 pgs: 129 active+clean; 1.1 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.8 MiB/s wr, 552 op/s 2024-09-11T23:23:29.815 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:23:29 smithi037 ceph-mon[30630]: pgmap v523: 129 pgs: 129 active+clean; 1.1 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.8 MiB/s wr, 552 op/s 2024-09-11T23:23:29.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 250.0 s, 742.8 tps, lat 137.207 ms stddev 163.765 2024-09-11T23:23:29.933 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:23:29 smithi160 ceph-mon[35055]: pgmap v523: 129 pgs: 129 active+clean; 1.1 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.8 MiB/s wr, 552 op/s 2024-09-11T23:23:31.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:23:31 smithi123 ceph-mon[35438]: pgmap v524: 129 pgs: 129 active+clean; 1.1 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 8.9 MiB/s wr, 677 op/s 2024-09-11T23:23:31.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:23:31 smithi037 ceph-mon[30630]: pgmap v524: 129 pgs: 129 active+clean; 1.1 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 8.9 MiB/s wr, 677 op/s 2024-09-11T23:23:31.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:23:31 smithi160 ceph-mon[35055]: pgmap v524: 129 pgs: 129 active+clean; 1.1 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 8.9 MiB/s wr, 677 op/s 2024-09-11T23:23:33.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:23:33 smithi123 ceph-mon[35438]: pgmap v525: 129 pgs: 129 active+clean; 1.1 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.9 MiB/s wr, 639 op/s 2024-09-11T23:23:33.815 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:23:33 smithi037 ceph-mon[30630]: pgmap v525: 129 pgs: 129 active+clean; 1.1 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.9 MiB/s wr, 639 op/s 2024-09-11T23:23:33.933 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:23:33 smithi160 ceph-mon[35055]: pgmap v525: 129 pgs: 129 active+clean; 1.1 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.9 MiB/s wr, 639 op/s 2024-09-11T23:23:34.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 255.0 s, 1927.0 tps, lat 51.511 ms stddev 76.939 2024-09-11T23:23:35.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:23:35 smithi123 ceph-mon[35438]: pgmap v526: 129 pgs: 129 active+clean; 1.1 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 MiB/s wr, 725 op/s 2024-09-11T23:23:35.815 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:23:35 smithi037 ceph-mon[30630]: pgmap v526: 129 pgs: 129 active+clean; 1.1 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 MiB/s wr, 725 op/s 2024-09-11T23:23:35.933 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:23:35 smithi160 ceph-mon[35055]: pgmap v526: 129 pgs: 129 active+clean; 1.1 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 MiB/s wr, 725 op/s 2024-09-11T23:23:37.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:23:37 smithi123 ceph-mon[35438]: pgmap v527: 129 pgs: 129 active+clean; 1.1 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 12 MiB/s wr, 823 op/s 2024-09-11T23:23:37.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:23:37 smithi037 ceph-mon[30630]: pgmap v527: 129 pgs: 129 active+clean; 1.1 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 12 MiB/s wr, 823 op/s 2024-09-11T23:23:37.933 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:23:37 smithi160 ceph-mon[35055]: pgmap v527: 129 pgs: 129 active+clean; 1.1 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 12 MiB/s wr, 823 op/s 2024-09-11T23:23:39.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:23:39 smithi123 ceph-mon[35438]: pgmap v528: 129 pgs: 129 active+clean; 1.1 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 10 MiB/s wr, 730 op/s 2024-09-11T23:23:39.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:23:39 smithi037 ceph-mon[30630]: pgmap v528: 129 pgs: 129 active+clean; 1.1 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 10 MiB/s wr, 730 op/s 2024-09-11T23:23:39.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 260.0 s, 882.8 tps, lat 113.733 ms stddev 119.311 2024-09-11T23:23:39.933 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:23:39 smithi160 ceph-mon[35055]: pgmap v528: 129 pgs: 129 active+clean; 1.1 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 10 MiB/s wr, 730 op/s 2024-09-11T23:23:41.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:23:41 smithi123 ceph-mon[35438]: pgmap v529: 129 pgs: 129 active+clean; 1.1 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 MiB/s wr, 819 op/s 2024-09-11T23:23:41.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:23:41 smithi037 ceph-mon[30630]: pgmap v529: 129 pgs: 129 active+clean; 1.1 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 MiB/s wr, 819 op/s 2024-09-11T23:23:41.933 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:23:41 smithi160 ceph-mon[35055]: pgmap v529: 129 pgs: 129 active+clean; 1.1 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 MiB/s wr, 819 op/s 2024-09-11T23:23:43.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:23:43 smithi123 ceph-mon[35438]: pgmap v530: 129 pgs: 129 active+clean; 1.1 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 10 MiB/s wr, 764 op/s 2024-09-11T23:23:43.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:23:43 smithi037 ceph-mon[30630]: pgmap v530: 129 pgs: 129 active+clean; 1.1 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 10 MiB/s wr, 764 op/s 2024-09-11T23:23:43.933 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:23:43 smithi160 ceph-mon[35055]: pgmap v530: 129 pgs: 129 active+clean; 1.1 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 10 MiB/s wr, 764 op/s 2024-09-11T23:23:44.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 265.0 s, 681.0 tps, lat 146.943 ms stddev 191.245 2024-09-11T23:23:45.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:23:45 smithi037 ceph-mon[30630]: pgmap v531: 129 pgs: 129 active+clean; 1.1 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 11 MiB/s wr, 808 op/s 2024-09-11T23:23:45.933 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:23:45 smithi160 ceph-mon[35055]: pgmap v531: 129 pgs: 129 active+clean; 1.1 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 11 MiB/s wr, 808 op/s 2024-09-11T23:23:46.000 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:23:45 smithi123 ceph-mon[35438]: pgmap v531: 129 pgs: 129 active+clean; 1.1 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 11 MiB/s wr, 808 op/s 2024-09-11T23:23:47.815 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:23:47 smithi037 ceph-mon[30630]: pgmap v532: 129 pgs: 129 active+clean; 1.1 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.5 MiB/s wr, 776 op/s 2024-09-11T23:23:47.933 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:23:47 smithi160 ceph-mon[35055]: pgmap v532: 129 pgs: 129 active+clean; 1.1 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.5 MiB/s wr, 776 op/s 2024-09-11T23:23:48.000 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:23:47 smithi123 ceph-mon[35438]: pgmap v532: 129 pgs: 129 active+clean; 1.1 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.5 MiB/s wr, 776 op/s 2024-09-11T23:23:49.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:23:49 smithi037 ceph-mon[30630]: pgmap v533: 129 pgs: 129 active+clean; 1.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 7.5 MiB/s wr, 643 op/s 2024-09-11T23:23:49.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 270.0 s, 1125.6 tps, lat 89.735 ms stddev 107.654 2024-09-11T23:23:49.933 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:23:49 smithi160 ceph-mon[35055]: pgmap v533: 129 pgs: 129 active+clean; 1.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 7.5 MiB/s wr, 643 op/s 2024-09-11T23:23:50.000 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:23:49 smithi123 ceph-mon[35438]: pgmap v533: 129 pgs: 129 active+clean; 1.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 7.5 MiB/s wr, 643 op/s 2024-09-11T23:23:51.816 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:23:51 smithi037 ceph-mon[30630]: pgmap v534: 129 pgs: 129 active+clean; 1.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 8.6 MiB/s wr, 751 op/s 2024-09-11T23:23:51.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:23:51 smithi160 ceph-mon[35055]: pgmap v534: 129 pgs: 129 active+clean; 1.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 8.6 MiB/s wr, 751 op/s 2024-09-11T23:23:52.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:23:51 smithi123 ceph-mon[35438]: pgmap v534: 129 pgs: 129 active+clean; 1.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 8.6 MiB/s wr, 751 op/s 2024-09-11T23:23:53.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:23:53 smithi037 ceph-mon[30630]: pgmap v535: 129 pgs: 129 active+clean; 1.1 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.6 MiB/s wr, 642 op/s 2024-09-11T23:23:53.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:23:53 smithi160 ceph-mon[35055]: pgmap v535: 129 pgs: 129 active+clean; 1.1 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.6 MiB/s wr, 642 op/s 2024-09-11T23:23:54.000 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:23:53 smithi123 ceph-mon[35438]: pgmap v535: 129 pgs: 129 active+clean; 1.1 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.6 MiB/s wr, 642 op/s 2024-09-11T23:23:54.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 275.0 s, 1327.4 tps, lat 75.983 ms stddev 98.667 2024-09-11T23:23:55.819 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:23:55 smithi037 ceph-mon[30630]: pgmap v536: 129 pgs: 129 active+clean; 1.1 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 7.5 MiB/s wr, 642 op/s 2024-09-11T23:23:55.933 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:23:55 smithi160 ceph-mon[35055]: pgmap v536: 129 pgs: 129 active+clean; 1.1 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 7.5 MiB/s wr, 642 op/s 2024-09-11T23:23:56.000 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:23:55 smithi123 ceph-mon[35438]: pgmap v536: 129 pgs: 129 active+clean; 1.1 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 7.5 MiB/s wr, 642 op/s 2024-09-11T23:23:57.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:23:57 smithi037 ceph-mon[30630]: pgmap v537: 129 pgs: 129 active+clean; 1.1 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.3 MiB/s wr, 586 op/s 2024-09-11T23:23:57.933 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:23:57 smithi160 ceph-mon[35055]: pgmap v537: 129 pgs: 129 active+clean; 1.1 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.3 MiB/s wr, 586 op/s 2024-09-11T23:23:58.000 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:23:57 smithi123 ceph-mon[35438]: pgmap v537: 129 pgs: 129 active+clean; 1.1 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.3 MiB/s wr, 586 op/s 2024-09-11T23:23:59.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:23:59 smithi037 ceph-mon[30630]: pgmap v538: 129 pgs: 129 active+clean; 1.1 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 5.8 MiB/s wr, 527 op/s 2024-09-11T23:23:59.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 280.0 s, 1654.0 tps, lat 58.216 ms stddev 86.460 2024-09-11T23:23:59.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:23:59 smithi160 ceph-mon[35055]: pgmap v538: 129 pgs: 129 active+clean; 1.1 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 5.8 MiB/s wr, 527 op/s 2024-09-11T23:24:00.000 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:23:59 smithi123 ceph-mon[35438]: pgmap v538: 129 pgs: 129 active+clean; 1.1 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 5.8 MiB/s wr, 527 op/s 2024-09-11T23:24:01.933 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:24:01 smithi160 ceph-mon[35055]: pgmap v539: 129 pgs: 129 active+clean; 1.1 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 7.2 MiB/s wr, 659 op/s 2024-09-11T23:24:02.000 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:24:01 smithi123 ceph-mon[35438]: pgmap v539: 129 pgs: 129 active+clean; 1.1 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 7.2 MiB/s wr, 659 op/s 2024-09-11T23:24:02.066 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:24:01 smithi037 ceph-mon[30630]: pgmap v539: 129 pgs: 129 active+clean; 1.1 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 7.2 MiB/s wr, 659 op/s 2024-09-11T23:24:03.933 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:24:03 smithi160 ceph-mon[35055]: pgmap v540: 129 pgs: 129 active+clean; 1.1 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 6.1 MiB/s wr, 549 op/s 2024-09-11T23:24:04.000 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:24:03 smithi123 ceph-mon[35438]: pgmap v540: 129 pgs: 129 active+clean; 1.1 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 6.1 MiB/s wr, 549 op/s 2024-09-11T23:24:04.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:24:03 smithi037 ceph-mon[30630]: pgmap v540: 129 pgs: 129 active+clean; 1.1 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 6.1 MiB/s wr, 549 op/s 2024-09-11T23:24:04.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 285.0 s, 819.6 tps, lat 125.044 ms stddev 139.480 2024-09-11T23:24:05.933 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:24:05 smithi160 ceph-mon[35055]: pgmap v541: 129 pgs: 129 active+clean; 1.1 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 6.8 MiB/s wr, 628 op/s 2024-09-11T23:24:06.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:24:05 smithi123 ceph-mon[35438]: pgmap v541: 129 pgs: 129 active+clean; 1.1 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 6.8 MiB/s wr, 628 op/s 2024-09-11T23:24:06.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:24:05 smithi037 ceph-mon[30630]: pgmap v541: 129 pgs: 129 active+clean; 1.1 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 6.8 MiB/s wr, 628 op/s 2024-09-11T23:24:07.933 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:24:07 smithi160 ceph-mon[35055]: pgmap v542: 129 pgs: 129 active+clean; 1.1 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.2 MiB/s wr, 622 op/s 2024-09-11T23:24:08.000 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:24:07 smithi123 ceph-mon[35438]: pgmap v542: 129 pgs: 129 active+clean; 1.1 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.2 MiB/s wr, 622 op/s 2024-09-11T23:24:08.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:24:07 smithi037 ceph-mon[30630]: pgmap v542: 129 pgs: 129 active+clean; 1.1 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.2 MiB/s wr, 622 op/s 2024-09-11T23:24:09.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 290.0 s, 669.8 tps, lat 144.414 ms stddev 173.563 2024-09-11T23:24:09.933 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:24:09 smithi160 ceph-mon[35055]: pgmap v543: 129 pgs: 129 active+clean; 1.1 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 6.1 MiB/s wr, 603 op/s 2024-09-11T23:24:10.000 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:24:09 smithi123 ceph-mon[35438]: pgmap v543: 129 pgs: 129 active+clean; 1.1 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 6.1 MiB/s wr, 603 op/s 2024-09-11T23:24:10.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:24:09 smithi037 ceph-mon[30630]: pgmap v543: 129 pgs: 129 active+clean; 1.1 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 6.1 MiB/s wr, 603 op/s 2024-09-11T23:24:11.937 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:24:11 smithi160 ceph-mon[35055]: pgmap v544: 129 pgs: 129 active+clean; 1.1 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 8.3 MiB/s wr, 764 op/s 2024-09-11T23:24:12.000 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:24:11 smithi123 ceph-mon[35438]: pgmap v544: 129 pgs: 129 active+clean; 1.1 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 8.3 MiB/s wr, 764 op/s 2024-09-11T23:24:12.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:24:11 smithi037 ceph-mon[30630]: pgmap v544: 129 pgs: 129 active+clean; 1.1 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 8.3 MiB/s wr, 764 op/s 2024-09-11T23:24:13.933 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:24:13 smithi160 ceph-mon[35055]: pgmap v545: 129 pgs: 129 active+clean; 1.1 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 7.9 MiB/s wr, 674 op/s 2024-09-11T23:24:14.000 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:24:13 smithi123 ceph-mon[35438]: pgmap v545: 129 pgs: 129 active+clean; 1.1 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 7.9 MiB/s wr, 674 op/s 2024-09-11T23:24:14.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:24:13 smithi037 ceph-mon[30630]: pgmap v545: 129 pgs: 129 active+clean; 1.1 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 7.9 MiB/s wr, 674 op/s 2024-09-11T23:24:14.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 295.0 s, 675.8 tps, lat 151.778 ms stddev 192.777 2024-09-11T23:24:15.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:24:15 smithi160 ceph-mon[35055]: pgmap v546: 129 pgs: 129 active+clean; 1.2 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 12 MiB/s wr, 786 op/s 2024-09-11T23:24:16.000 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:24:15 smithi123 ceph-mon[35438]: pgmap v546: 129 pgs: 129 active+clean; 1.2 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 12 MiB/s wr, 786 op/s 2024-09-11T23:24:16.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:24:15 smithi037 ceph-mon[30630]: pgmap v546: 129 pgs: 129 active+clean; 1.2 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 12 MiB/s wr, 786 op/s 2024-09-11T23:24:17.933 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:24:17 smithi160 ceph-mon[35055]: pgmap v547: 129 pgs: 129 active+clean; 1.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 14 MiB/s wr, 804 op/s 2024-09-11T23:24:18.000 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:24:17 smithi123 ceph-mon[35438]: pgmap v547: 129 pgs: 129 active+clean; 1.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 14 MiB/s wr, 804 op/s 2024-09-11T23:24:18.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:24:17 smithi037 ceph-mon[30630]: pgmap v547: 129 pgs: 129 active+clean; 1.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 14 MiB/s wr, 804 op/s 2024-09-11T23:24:19.826 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 300.0 s, 642.8 tps, lat 153.310 ms stddev 178.794 2024-09-11T23:24:19.933 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:24:19 smithi160 ceph-mon[35055]: pgmap v548: 129 pgs: 129 active+clean; 1.2 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 14 MiB/s wr, 761 op/s 2024-09-11T23:24:20.000 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:24:19 smithi123 ceph-mon[35438]: pgmap v548: 129 pgs: 129 active+clean; 1.2 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 14 MiB/s wr, 761 op/s 2024-09-11T23:24:20.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:24:19 smithi037 ceph-mon[30630]: pgmap v548: 129 pgs: 129 active+clean; 1.2 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 14 MiB/s wr, 761 op/s 2024-09-11T23:24:21.933 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:24:21 smithi160 ceph-mon[35055]: pgmap v549: 129 pgs: 129 active+clean; 1.2 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 17 MiB/s wr, 809 op/s 2024-09-11T23:24:22.000 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:24:21 smithi123 ceph-mon[35438]: pgmap v549: 129 pgs: 129 active+clean; 1.2 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 17 MiB/s wr, 809 op/s 2024-09-11T23:24:22.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:24:21 smithi037 ceph-mon[30630]: pgmap v549: 129 pgs: 129 active+clean; 1.2 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 17 MiB/s wr, 809 op/s 2024-09-11T23:24:23.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:24:23 smithi160 ceph-mon[35055]: pgmap v550: 129 pgs: 129 active+clean; 1.2 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 15 MiB/s wr, 647 op/s 2024-09-11T23:24:24.000 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:24:23 smithi123 ceph-mon[35438]: pgmap v550: 129 pgs: 129 active+clean; 1.2 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 15 MiB/s wr, 647 op/s 2024-09-11T23:24:24.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:24:23 smithi037 ceph-mon[30630]: pgmap v550: 129 pgs: 129 active+clean; 1.2 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 15 MiB/s wr, 647 op/s 2024-09-11T23:24:24.826 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 305.0 s, 639.2 tps, lat 159.301 ms stddev 212.384 2024-09-11T23:24:25.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:24:25 smithi160 ceph-mon[35055]: pgmap v551: 129 pgs: 129 active+clean; 1.2 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 17 MiB/s wr, 685 op/s 2024-09-11T23:24:26.000 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:24:25 smithi123 ceph-mon[35438]: pgmap v551: 129 pgs: 129 active+clean; 1.2 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 17 MiB/s wr, 685 op/s 2024-09-11T23:24:26.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:24:25 smithi037 ceph-mon[30630]: pgmap v551: 129 pgs: 129 active+clean; 1.2 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 17 MiB/s wr, 685 op/s 2024-09-11T23:24:27.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:24:27 smithi160 ceph-mon[35055]: pgmap v552: 129 pgs: 129 active+clean; 1.2 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 15 MiB/s wr, 622 op/s 2024-09-11T23:24:27.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:24:27 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:24:28.000 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:24:27 smithi123 ceph-mon[35438]: pgmap v552: 129 pgs: 129 active+clean; 1.2 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 15 MiB/s wr, 622 op/s 2024-09-11T23:24:28.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:24:27 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:24:28.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:24:27 smithi037 ceph-mon[30630]: pgmap v552: 129 pgs: 129 active+clean; 1.2 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 15 MiB/s wr, 622 op/s 2024-09-11T23:24:28.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:24:27 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:24:29.826 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 310.0 s, 757.2 tps, lat 128.483 ms stddev 158.259 2024-09-11T23:24:29.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:24:29 smithi160 ceph-mon[35055]: pgmap v553: 129 pgs: 129 active+clean; 1.2 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 MiB/s wr, 541 op/s 2024-09-11T23:24:29.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:24:29 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:24:29.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:24:29 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:24:29.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:24:29 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:24:29.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:24:29 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:24:29.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:24:29 smithi160 ceph-mon[35055]: Adjusting osd_memory_target on smithi037 to 177.5M 2024-09-11T23:24:29.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:24:29 smithi160 ceph-mon[35055]: Unable to set osd_memory_target on smithi037 to 186147225: error parsing value: Value '186147225' is below minimum 939524096 2024-09-11T23:24:29.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:24:29 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:24:29.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:24:29 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:24:29.935 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:24:29 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:24:30.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:24:29 smithi123 ceph-mon[35438]: pgmap v553: 129 pgs: 129 active+clean; 1.2 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 MiB/s wr, 541 op/s 2024-09-11T23:24:30.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:24:29 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:24:30.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:24:29 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:24:30.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:24:29 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:24:30.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:24:29 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:24:30.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:24:29 smithi123 ceph-mon[35438]: Adjusting osd_memory_target on smithi037 to 177.5M 2024-09-11T23:24:30.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:24:29 smithi123 ceph-mon[35438]: Unable to set osd_memory_target on smithi037 to 186147225: error parsing value: Value '186147225' is below minimum 939524096 2024-09-11T23:24:30.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:24:29 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:24:30.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:24:29 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:24:30.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:24:29 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:24:30.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:24:29 smithi037 ceph-mon[30630]: pgmap v553: 129 pgs: 129 active+clean; 1.2 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 MiB/s wr, 541 op/s 2024-09-11T23:24:30.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:24:29 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:24:30.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:24:29 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:24:30.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:24:29 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:24:30.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:24:29 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:24:30.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:24:29 smithi037 ceph-mon[30630]: Adjusting osd_memory_target on smithi037 to 177.5M 2024-09-11T23:24:30.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:24:29 smithi037 ceph-mon[30630]: Unable to set osd_memory_target on smithi037 to 186147225: error parsing value: Value '186147225' is below minimum 939524096 2024-09-11T23:24:30.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:24:29 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:24:30.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:24:29 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:24:30.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:24:29 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:24:31.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:24:31 smithi160 ceph-mon[35055]: pgmap v554: 129 pgs: 129 active+clean; 1.2 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 MiB/s wr, 611 op/s 2024-09-11T23:24:32.000 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:24:31 smithi123 ceph-mon[35438]: pgmap v554: 129 pgs: 129 active+clean; 1.2 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 MiB/s wr, 611 op/s 2024-09-11T23:24:32.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:24:31 smithi037 ceph-mon[30630]: pgmap v554: 129 pgs: 129 active+clean; 1.2 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 MiB/s wr, 611 op/s 2024-09-11T23:24:34.000 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:24:33 smithi123 ceph-mon[35438]: pgmap v555: 129 pgs: 129 active+clean; 1.2 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 MiB/s wr, 505 op/s 2024-09-11T23:24:34.066 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:24:33 smithi037 ceph-mon[30630]: pgmap v555: 129 pgs: 129 active+clean; 1.2 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 MiB/s wr, 505 op/s 2024-09-11T23:24:34.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:24:33 smithi160 ceph-mon[35055]: pgmap v555: 129 pgs: 129 active+clean; 1.2 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 MiB/s wr, 505 op/s 2024-09-11T23:24:34.826 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 315.0 s, 799.0 tps, lat 129.525 ms stddev 156.686 2024-09-11T23:24:36.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:24:35 smithi123 ceph-mon[35438]: pgmap v556: 129 pgs: 129 active+clean; 1.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 15 MiB/s wr, 592 op/s 2024-09-11T23:24:36.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:24:35 smithi037 ceph-mon[30630]: pgmap v556: 129 pgs: 129 active+clean; 1.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 15 MiB/s wr, 592 op/s 2024-09-11T23:24:36.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:24:35 smithi160 ceph-mon[35055]: pgmap v556: 129 pgs: 129 active+clean; 1.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 15 MiB/s wr, 592 op/s 2024-09-11T23:24:38.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:24:37 smithi123 ceph-mon[35438]: pgmap v557: 129 pgs: 129 active+clean; 1.3 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 14 MiB/s wr, 564 op/s 2024-09-11T23:24:38.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:24:37 smithi037 ceph-mon[30630]: pgmap v557: 129 pgs: 129 active+clean; 1.3 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 14 MiB/s wr, 564 op/s 2024-09-11T23:24:38.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:24:37 smithi160 ceph-mon[35055]: pgmap v557: 129 pgs: 129 active+clean; 1.3 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 14 MiB/s wr, 564 op/s 2024-09-11T23:24:39.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 320.0 s, 638.4 tps, lat 151.045 ms stddev 184.526 2024-09-11T23:24:40.000 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:24:39 smithi123 ceph-mon[35438]: pgmap v558: 129 pgs: 129 active+clean; 1.3 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 12 MiB/s wr, 516 op/s 2024-09-11T23:24:40.066 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:24:39 smithi037 ceph-mon[30630]: pgmap v558: 129 pgs: 129 active+clean; 1.3 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 12 MiB/s wr, 516 op/s 2024-09-11T23:24:40.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:24:39 smithi160 ceph-mon[35055]: pgmap v558: 129 pgs: 129 active+clean; 1.3 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 12 MiB/s wr, 516 op/s 2024-09-11T23:24:41.985 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:24:41 smithi160 ceph-mon[35055]: pgmap v559: 129 pgs: 129 active+clean; 1.3 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 MiB/s wr, 606 op/s 2024-09-11T23:24:42.000 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:24:41 smithi123 ceph-mon[35438]: pgmap v559: 129 pgs: 129 active+clean; 1.3 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 MiB/s wr, 606 op/s 2024-09-11T23:24:42.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:24:41 smithi037 ceph-mon[30630]: pgmap v559: 129 pgs: 129 active+clean; 1.3 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 MiB/s wr, 606 op/s 2024-09-11T23:24:44.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:24:43 smithi123 ceph-mon[35438]: pgmap v560: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 MiB/s wr, 514 op/s 2024-09-11T23:24:44.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:24:43 smithi037 ceph-mon[30630]: pgmap v560: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 MiB/s wr, 514 op/s 2024-09-11T23:24:44.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:24:43 smithi160 ceph-mon[35055]: pgmap v560: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 MiB/s wr, 514 op/s 2024-09-11T23:24:44.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 325.0 s, 655.2 tps, lat 157.376 ms stddev 171.396 2024-09-11T23:24:46.000 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:24:45 smithi123 ceph-mon[35438]: pgmap v561: 129 pgs: 129 active+clean; 1.3 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 14 MiB/s wr, 613 op/s 2024-09-11T23:24:46.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:24:45 smithi037 ceph-mon[30630]: pgmap v561: 129 pgs: 129 active+clean; 1.3 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 14 MiB/s wr, 613 op/s 2024-09-11T23:24:46.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:24:45 smithi160 ceph-mon[35055]: pgmap v561: 129 pgs: 129 active+clean; 1.3 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 14 MiB/s wr, 613 op/s 2024-09-11T23:24:48.000 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:24:47 smithi123 ceph-mon[35438]: pgmap v562: 129 pgs: 129 active+clean; 1.3 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 12 MiB/s wr, 609 op/s 2024-09-11T23:24:48.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:24:47 smithi037 ceph-mon[30630]: pgmap v562: 129 pgs: 129 active+clean; 1.3 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 12 MiB/s wr, 609 op/s 2024-09-11T23:24:48.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:24:47 smithi160 ceph-mon[35055]: pgmap v562: 129 pgs: 129 active+clean; 1.3 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 12 MiB/s wr, 609 op/s 2024-09-11T23:24:49.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 330.0 s, 781.6 tps, lat 125.748 ms stddev 165.485 2024-09-11T23:24:50.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:24:49 smithi037 ceph-mon[30630]: pgmap v563: 129 pgs: 129 active+clean; 1.3 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 MiB/s wr, 562 op/s 2024-09-11T23:24:50.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:24:49 smithi160 ceph-mon[35055]: pgmap v563: 129 pgs: 129 active+clean; 1.3 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 MiB/s wr, 562 op/s 2024-09-11T23:24:50.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:24:49 smithi123 ceph-mon[35438]: pgmap v563: 129 pgs: 129 active+clean; 1.3 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 MiB/s wr, 562 op/s 2024-09-11T23:24:52.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:24:51 smithi037 ceph-mon[30630]: pgmap v564: 129 pgs: 129 active+clean; 1.3 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 14 MiB/s wr, 656 op/s 2024-09-11T23:24:52.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:24:51 smithi160 ceph-mon[35055]: pgmap v564: 129 pgs: 129 active+clean; 1.3 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 14 MiB/s wr, 656 op/s 2024-09-11T23:24:52.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:24:51 smithi123 ceph-mon[35438]: pgmap v564: 129 pgs: 129 active+clean; 1.3 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 14 MiB/s wr, 656 op/s 2024-09-11T23:24:54.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:24:53 smithi037 ceph-mon[30630]: pgmap v565: 129 pgs: 129 active+clean; 1.3 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 13 MiB/s wr, 554 op/s 2024-09-11T23:24:54.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:24:53 smithi160 ceph-mon[35055]: pgmap v565: 129 pgs: 129 active+clean; 1.3 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 13 MiB/s wr, 554 op/s 2024-09-11T23:24:54.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:24:53 smithi123 ceph-mon[35438]: pgmap v565: 129 pgs: 129 active+clean; 1.3 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 13 MiB/s wr, 554 op/s 2024-09-11T23:24:54.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 335.0 s, 724.8 tps, lat 138.746 ms stddev 159.617 2024-09-11T23:24:56.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:24:55 smithi037 ceph-mon[30630]: pgmap v566: 129 pgs: 129 active+clean; 1.3 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 MiB/s wr, 630 op/s 2024-09-11T23:24:56.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:24:55 smithi160 ceph-mon[35055]: pgmap v566: 129 pgs: 129 active+clean; 1.3 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 MiB/s wr, 630 op/s 2024-09-11T23:24:56.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:24:55 smithi123 ceph-mon[35438]: pgmap v566: 129 pgs: 129 active+clean; 1.3 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 MiB/s wr, 630 op/s 2024-09-11T23:24:58.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:24:57 smithi037 ceph-mon[30630]: pgmap v567: 129 pgs: 129 active+clean; 1.3 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 13 MiB/s wr, 596 op/s 2024-09-11T23:24:58.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:24:57 smithi160 ceph-mon[35055]: pgmap v567: 129 pgs: 129 active+clean; 1.3 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 13 MiB/s wr, 596 op/s 2024-09-11T23:24:58.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:24:57 smithi123 ceph-mon[35438]: pgmap v567: 129 pgs: 129 active+clean; 1.3 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 13 MiB/s wr, 596 op/s 2024-09-11T23:24:59.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 340.0 s, 724.4 tps, lat 137.536 ms stddev 229.532 2024-09-11T23:25:00.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:24:59 smithi037 ceph-mon[30630]: pgmap v568: 129 pgs: 129 active+clean; 1.3 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 12 MiB/s wr, 521 op/s 2024-09-11T23:25:00.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:24:59 smithi160 ceph-mon[35055]: pgmap v568: 129 pgs: 129 active+clean; 1.3 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 12 MiB/s wr, 521 op/s 2024-09-11T23:25:00.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:24:59 smithi123 ceph-mon[35438]: pgmap v568: 129 pgs: 129 active+clean; 1.3 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 12 MiB/s wr, 521 op/s 2024-09-11T23:25:02.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:25:01 smithi037 ceph-mon[30630]: pgmap v569: 129 pgs: 129 active+clean; 1.4 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 14 MiB/s wr, 610 op/s 2024-09-11T23:25:02.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:25:01 smithi160 ceph-mon[35055]: pgmap v569: 129 pgs: 129 active+clean; 1.4 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 14 MiB/s wr, 610 op/s 2024-09-11T23:25:02.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:25:01 smithi123 ceph-mon[35438]: pgmap v569: 129 pgs: 129 active+clean; 1.4 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 14 MiB/s wr, 610 op/s 2024-09-11T23:25:04.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:25:03 smithi037 ceph-mon[30630]: pgmap v570: 129 pgs: 129 active+clean; 1.4 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 10 MiB/s wr, 501 op/s 2024-09-11T23:25:04.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:25:03 smithi160 ceph-mon[35055]: pgmap v570: 129 pgs: 129 active+clean; 1.4 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 10 MiB/s wr, 501 op/s 2024-09-11T23:25:04.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:25:03 smithi123 ceph-mon[35438]: pgmap v570: 129 pgs: 129 active+clean; 1.4 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 10 MiB/s wr, 501 op/s 2024-09-11T23:25:04.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 345.0 s, 798.2 tps, lat 125.153 ms stddev 163.318 2024-09-11T23:25:06.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:25:05 smithi160 ceph-mon[35055]: pgmap v571: 129 pgs: 129 active+clean; 1.4 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 MiB/s wr, 570 op/s 2024-09-11T23:25:06.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:25:05 smithi123 ceph-mon[35438]: pgmap v571: 129 pgs: 129 active+clean; 1.4 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 MiB/s wr, 570 op/s 2024-09-11T23:25:06.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:25:05 smithi037 ceph-mon[30630]: pgmap v571: 129 pgs: 129 active+clean; 1.4 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 MiB/s wr, 570 op/s 2024-09-11T23:25:08.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:25:07 smithi160 ceph-mon[35055]: pgmap v572: 129 pgs: 129 active+clean; 1.4 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 12 MiB/s wr, 568 op/s 2024-09-11T23:25:08.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:25:07 smithi123 ceph-mon[35438]: pgmap v572: 129 pgs: 129 active+clean; 1.4 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 12 MiB/s wr, 568 op/s 2024-09-11T23:25:08.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:25:07 smithi037 ceph-mon[30630]: pgmap v572: 129 pgs: 129 active+clean; 1.4 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 12 MiB/s wr, 568 op/s 2024-09-11T23:25:09.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 350.0 s, 752.6 tps, lat 132.700 ms stddev 147.790 2024-09-11T23:25:10.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:25:09 smithi160 ceph-mon[35055]: pgmap v573: 129 pgs: 129 active+clean; 1.4 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.9 MiB/s wr, 514 op/s 2024-09-11T23:25:10.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:25:09 smithi123 ceph-mon[35438]: pgmap v573: 129 pgs: 129 active+clean; 1.4 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.9 MiB/s wr, 514 op/s 2024-09-11T23:25:10.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:25:09 smithi037 ceph-mon[30630]: pgmap v573: 129 pgs: 129 active+clean; 1.4 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.9 MiB/s wr, 514 op/s 2024-09-11T23:25:12.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:25:11 smithi160 ceph-mon[35055]: pgmap v574: 129 pgs: 129 active+clean; 1.4 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 MiB/s wr, 611 op/s 2024-09-11T23:25:12.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:25:11 smithi123 ceph-mon[35438]: pgmap v574: 129 pgs: 129 active+clean; 1.4 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 MiB/s wr, 611 op/s 2024-09-11T23:25:12.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:25:11 smithi037 ceph-mon[30630]: pgmap v574: 129 pgs: 129 active+clean; 1.4 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 MiB/s wr, 611 op/s 2024-09-11T23:25:14.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:25:13 smithi160 ceph-mon[35055]: pgmap v575: 129 pgs: 129 active+clean; 1.4 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.3 MiB/s wr, 511 op/s 2024-09-11T23:25:14.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:25:13 smithi123 ceph-mon[35438]: pgmap v575: 129 pgs: 129 active+clean; 1.4 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.3 MiB/s wr, 511 op/s 2024-09-11T23:25:14.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:25:13 smithi037 ceph-mon[30630]: pgmap v575: 129 pgs: 129 active+clean; 1.4 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.3 MiB/s wr, 511 op/s 2024-09-11T23:25:14.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 355.0 s, 673.6 tps, lat 149.597 ms stddev 193.861 2024-09-11T23:25:16.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:25:15 smithi160 ceph-mon[35055]: pgmap v576: 129 pgs: 129 active+clean; 1.4 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 MiB/s wr, 580 op/s 2024-09-11T23:25:16.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:25:15 smithi123 ceph-mon[35438]: pgmap v576: 129 pgs: 129 active+clean; 1.4 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 MiB/s wr, 580 op/s 2024-09-11T23:25:16.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:25:15 smithi037 ceph-mon[30630]: pgmap v576: 129 pgs: 129 active+clean; 1.4 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 MiB/s wr, 580 op/s 2024-09-11T23:25:18.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:25:17 smithi160 ceph-mon[35055]: pgmap v577: 129 pgs: 129 active+clean; 1.4 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 11 MiB/s wr, 640 op/s 2024-09-11T23:25:18.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:25:17 smithi123 ceph-mon[35438]: pgmap v577: 129 pgs: 129 active+clean; 1.4 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 11 MiB/s wr, 640 op/s 2024-09-11T23:25:18.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:25:17 smithi037 ceph-mon[30630]: pgmap v577: 129 pgs: 129 active+clean; 1.4 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 11 MiB/s wr, 640 op/s 2024-09-11T23:25:19.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 360.0 s, 641.6 tps, lat 154.116 ms stddev 177.128 2024-09-11T23:25:20.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:25:19 smithi160 ceph-mon[35055]: pgmap v578: 129 pgs: 129 active+clean; 1.4 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 10 MiB/s wr, 579 op/s 2024-09-11T23:25:20.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:25:19 smithi123 ceph-mon[35438]: pgmap v578: 129 pgs: 129 active+clean; 1.4 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 10 MiB/s wr, 579 op/s 2024-09-11T23:25:20.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:25:19 smithi037 ceph-mon[30630]: pgmap v578: 129 pgs: 129 active+clean; 1.4 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 10 MiB/s wr, 579 op/s 2024-09-11T23:25:22.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:25:21 smithi160 ceph-mon[35055]: pgmap v579: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 11 MiB/s wr, 657 op/s 2024-09-11T23:25:22.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:25:21 smithi123 ceph-mon[35438]: pgmap v579: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 11 MiB/s wr, 657 op/s 2024-09-11T23:25:22.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:25:21 smithi037 ceph-mon[30630]: pgmap v579: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 11 MiB/s wr, 657 op/s 2024-09-11T23:25:24.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:25:23 smithi160 ceph-mon[35055]: pgmap v580: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 8.8 MiB/s wr, 546 op/s 2024-09-11T23:25:24.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:25:23 smithi123 ceph-mon[35438]: pgmap v580: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 8.8 MiB/s wr, 546 op/s 2024-09-11T23:25:24.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:25:23 smithi037 ceph-mon[30630]: pgmap v580: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 8.8 MiB/s wr, 546 op/s 2024-09-11T23:25:24.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 365.0 s, 748.8 tps, lat 134.812 ms stddev 166.674 2024-09-11T23:25:26.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:25:25 smithi160 ceph-mon[35055]: pgmap v581: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 10 MiB/s wr, 618 op/s 2024-09-11T23:25:26.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:25:25 smithi123 ceph-mon[35438]: pgmap v581: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 10 MiB/s wr, 618 op/s 2024-09-11T23:25:26.317 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:25:25 smithi037 ceph-mon[30630]: pgmap v581: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 10 MiB/s wr, 618 op/s 2024-09-11T23:25:28.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:25:27 smithi160 ceph-mon[35055]: pgmap v582: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 11 MiB/s wr, 630 op/s 2024-09-11T23:25:28.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:25:27 smithi123 ceph-mon[35438]: pgmap v582: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 11 MiB/s wr, 630 op/s 2024-09-11T23:25:28.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:25:27 smithi037 ceph-mon[30630]: pgmap v582: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 11 MiB/s wr, 630 op/s 2024-09-11T23:25:29.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 370.0 s, 634.4 tps, lat 150.484 ms stddev 182.874 2024-09-11T23:25:30.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:25:29 smithi123 ceph-mon[35438]: pgmap v583: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.3 MiB/s wr, 479 op/s 2024-09-11T23:25:30.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:25:29 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:25:30.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:25:29 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:25:30.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:25:29 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:25:30.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:25:29 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:25:30.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:25:29 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:25:30.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:25:29 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:25:30.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:25:29 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:25:30.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:25:29 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:25:30.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:25:29 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:25:30.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:25:29 smithi037 ceph-mon[30630]: pgmap v583: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.3 MiB/s wr, 479 op/s 2024-09-11T23:25:30.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:25:29 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:25:30.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:25:29 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:25:30.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:25:29 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:25:30.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:25:29 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:25:30.316 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:25:29 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:25:30.316 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:25:29 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:25:30.316 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:25:29 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:25:30.316 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:25:29 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:25:30.316 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:25:29 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:25:30.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:25:29 smithi160 ceph-mon[35055]: pgmap v583: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.3 MiB/s wr, 479 op/s 2024-09-11T23:25:30.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:25:29 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:25:30.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:25:29 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:25:30.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:25:29 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:25:30.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:25:29 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:25:30.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:25:29 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:25:30.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:25:29 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:25:30.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:25:29 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:25:30.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:25:29 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:25:30.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:25:29 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:25:31.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:25:30 smithi123 ceph-mon[35438]: Adjusting osd_memory_target on smithi160 to 176.0M 2024-09-11T23:25:31.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:25:30 smithi123 ceph-mon[35438]: Adjusting osd_memory_target on smithi123 to 176.0M 2024-09-11T23:25:31.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:25:30 smithi123 ceph-mon[35438]: Unable to set osd_memory_target on smithi160 to 184591769: error parsing value: Value '184591769' is below minimum 939524096 2024-09-11T23:25:31.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:25:30 smithi123 ceph-mon[35438]: Unable to set osd_memory_target on smithi123 to 184588902: error parsing value: Value '184588902' is below minimum 939524096 2024-09-11T23:25:31.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:25:30 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:25:31.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:25:30 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:25:31.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:25:30 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:25:31.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:25:30 smithi037 ceph-mon[30630]: Adjusting osd_memory_target on smithi160 to 176.0M 2024-09-11T23:25:31.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:25:30 smithi037 ceph-mon[30630]: Adjusting osd_memory_target on smithi123 to 176.0M 2024-09-11T23:25:31.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:25:30 smithi037 ceph-mon[30630]: Unable to set osd_memory_target on smithi160 to 184591769: error parsing value: Value '184591769' is below minimum 939524096 2024-09-11T23:25:31.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:25:30 smithi037 ceph-mon[30630]: Unable to set osd_memory_target on smithi123 to 184588902: error parsing value: Value '184588902' is below minimum 939524096 2024-09-11T23:25:31.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:25:30 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:25:31.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:25:30 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:25:31.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:25:30 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:25:31.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:25:30 smithi160 ceph-mon[35055]: Adjusting osd_memory_target on smithi160 to 176.0M 2024-09-11T23:25:31.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:25:30 smithi160 ceph-mon[35055]: Adjusting osd_memory_target on smithi123 to 176.0M 2024-09-11T23:25:31.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:25:30 smithi160 ceph-mon[35055]: Unable to set osd_memory_target on smithi160 to 184591769: error parsing value: Value '184591769' is below minimum 939524096 2024-09-11T23:25:31.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:25:30 smithi160 ceph-mon[35055]: Unable to set osd_memory_target on smithi123 to 184588902: error parsing value: Value '184588902' is below minimum 939524096 2024-09-11T23:25:31.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:25:30 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:25:31.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:25:30 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:25:31.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:25:30 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:25:32.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:25:31 smithi123 ceph-mon[35438]: pgmap v584: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 10 MiB/s wr, 593 op/s 2024-09-11T23:25:32.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:25:31 smithi037 ceph-mon[30630]: pgmap v584: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 10 MiB/s wr, 593 op/s 2024-09-11T23:25:32.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:25:31 smithi160 ceph-mon[35055]: pgmap v584: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 10 MiB/s wr, 593 op/s 2024-09-11T23:25:34.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:25:33 smithi123 ceph-mon[35438]: pgmap v585: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.1 MiB/s wr, 503 op/s 2024-09-11T23:25:34.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:25:33 smithi037 ceph-mon[30630]: pgmap v585: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.1 MiB/s wr, 503 op/s 2024-09-11T23:25:34.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:25:33 smithi160 ceph-mon[35055]: pgmap v585: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.1 MiB/s wr, 503 op/s 2024-09-11T23:25:34.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 375.0 s, 680.8 tps, lat 151.192 ms stddev 201.617 2024-09-11T23:25:36.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:25:35 smithi123 ceph-mon[35438]: pgmap v586: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 10 MiB/s wr, 579 op/s 2024-09-11T23:25:36.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:25:35 smithi037 ceph-mon[30630]: pgmap v586: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 10 MiB/s wr, 579 op/s 2024-09-11T23:25:36.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:25:35 smithi160 ceph-mon[35055]: pgmap v586: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 10 MiB/s wr, 579 op/s 2024-09-11T23:25:38.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:25:37 smithi123 ceph-mon[35438]: pgmap v587: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.1 MiB/s wr, 580 op/s 2024-09-11T23:25:38.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:25:37 smithi037 ceph-mon[30630]: pgmap v587: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.1 MiB/s wr, 580 op/s 2024-09-11T23:25:38.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:25:37 smithi160 ceph-mon[35055]: pgmap v587: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.1 MiB/s wr, 580 op/s 2024-09-11T23:25:39.828 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 380.0 s, 760.5 tps, lat 132.264 ms stddev 180.486 2024-09-11T23:25:40.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:25:39 smithi123 ceph-mon[35438]: pgmap v588: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 7.3 MiB/s wr, 476 op/s 2024-09-11T23:25:40.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:25:39 smithi037 ceph-mon[30630]: pgmap v588: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 7.3 MiB/s wr, 476 op/s 2024-09-11T23:25:40.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:25:39 smithi160 ceph-mon[35055]: pgmap v588: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 7.3 MiB/s wr, 476 op/s 2024-09-11T23:25:42.235 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:25:41 smithi160 ceph-mon[35055]: pgmap v589: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 10 MiB/s wr, 640 op/s 2024-09-11T23:25:42.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:25:41 smithi123 ceph-mon[35438]: pgmap v589: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 10 MiB/s wr, 640 op/s 2024-09-11T23:25:42.317 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:25:41 smithi037 ceph-mon[30630]: pgmap v589: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 10 MiB/s wr, 640 op/s 2024-09-11T23:25:44.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:25:43 smithi123 ceph-mon[35438]: pgmap v590: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.2 MiB/s wr, 509 op/s 2024-09-11T23:25:44.318 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:25:43 smithi037 ceph-mon[30630]: pgmap v590: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.2 MiB/s wr, 509 op/s 2024-09-11T23:25:44.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:25:43 smithi160 ceph-mon[35055]: pgmap v590: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.2 MiB/s wr, 509 op/s 2024-09-11T23:25:44.826 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 385.0 s, 560.2 tps, lat 178.911 ms stddev 189.155 2024-09-11T23:25:46.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:25:46 smithi037 ceph-mon[30630]: pgmap v591: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 8.8 MiB/s wr, 579 op/s 2024-09-11T23:25:46.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:25:46 smithi160 ceph-mon[35055]: pgmap v591: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 8.8 MiB/s wr, 579 op/s 2024-09-11T23:25:46.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:25:46 smithi123 ceph-mon[35438]: pgmap v591: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 8.8 MiB/s wr, 579 op/s 2024-09-11T23:25:48.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:25:48 smithi037 ceph-mon[30630]: pgmap v592: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 8.3 MiB/s wr, 548 op/s 2024-09-11T23:25:48.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:25:48 smithi160 ceph-mon[35055]: pgmap v592: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 8.3 MiB/s wr, 548 op/s 2024-09-11T23:25:48.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:25:48 smithi123 ceph-mon[35438]: pgmap v592: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 8.3 MiB/s wr, 548 op/s 2024-09-11T23:25:49.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 390.0 s, 451.6 tps, lat 222.951 ms stddev 387.188 2024-09-11T23:25:50.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:25:50 smithi037 ceph-mon[30630]: pgmap v593: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 8.1 MiB/s wr, 513 op/s 2024-09-11T23:25:50.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:25:50 smithi160 ceph-mon[35055]: pgmap v593: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 8.1 MiB/s wr, 513 op/s 2024-09-11T23:25:50.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:25:50 smithi123 ceph-mon[35438]: pgmap v593: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 8.1 MiB/s wr, 513 op/s 2024-09-11T23:25:52.316 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:25:52 smithi037 ceph-mon[30630]: pgmap v594: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 MiB/s wr, 1.16k op/s 2024-09-11T23:25:52.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:25:52 smithi160 ceph-mon[35055]: pgmap v594: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 MiB/s wr, 1.16k op/s 2024-09-11T23:25:52.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:25:52 smithi123 ceph-mon[35438]: pgmap v594: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 MiB/s wr, 1.16k op/s 2024-09-11T23:25:54.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:25:54 smithi037 ceph-mon[30630]: pgmap v595: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 MiB/s wr, 1.13k op/s 2024-09-11T23:25:54.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:25:54 smithi160 ceph-mon[35055]: pgmap v595: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 MiB/s wr, 1.13k op/s 2024-09-11T23:25:54.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:25:54 smithi123 ceph-mon[35438]: pgmap v595: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 MiB/s wr, 1.13k op/s 2024-09-11T23:25:54.830 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 395.0 s, 614.7 tps, lat 164.145 ms stddev 196.298 2024-09-11T23:25:56.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:25:56 smithi037 ceph-mon[30630]: pgmap v596: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 15 MiB/s wr, 1.29k op/s 2024-09-11T23:25:56.435 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:25:56 smithi160 ceph-mon[35055]: pgmap v596: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 15 MiB/s wr, 1.29k op/s 2024-09-11T23:25:56.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:25:56 smithi123 ceph-mon[35438]: pgmap v596: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 15 MiB/s wr, 1.29k op/s 2024-09-11T23:25:58.207 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:25:58 smithi037 ceph-mon[30630]: pgmap v597: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 14 MiB/s wr, 1.28k op/s 2024-09-11T23:25:58.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:25:58 smithi160 ceph-mon[35055]: pgmap v597: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 14 MiB/s wr, 1.28k op/s 2024-09-11T23:25:58.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:25:58 smithi123 ceph-mon[35438]: pgmap v597: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 14 MiB/s wr, 1.28k op/s 2024-09-11T23:25:59.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 400.0 s, 658.4 tps, lat 150.035 ms stddev 185.071 2024-09-11T23:26:00.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:26:00 smithi160 ceph-mon[35055]: pgmap v598: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 14 MiB/s wr, 1.25k op/s 2024-09-11T23:26:00.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:26:00 smithi123 ceph-mon[35438]: pgmap v598: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 14 MiB/s wr, 1.25k op/s 2024-09-11T23:26:00.578 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:26:00 smithi037 ceph-mon[30630]: pgmap v598: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 14 MiB/s wr, 1.25k op/s 2024-09-11T23:26:02.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:26:02 smithi160 ceph-mon[35055]: pgmap v599: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 14 MiB/s wr, 1.37k op/s 2024-09-11T23:26:02.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:26:02 smithi123 ceph-mon[35438]: pgmap v599: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 14 MiB/s wr, 1.37k op/s 2024-09-11T23:26:02.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:26:02 smithi037 ceph-mon[30630]: pgmap v599: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 14 MiB/s wr, 1.37k op/s 2024-09-11T23:26:04.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:26:04 smithi160 ceph-mon[35055]: pgmap v600: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 7.9 MiB/s wr, 757 op/s 2024-09-11T23:26:04.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:26:04 smithi123 ceph-mon[35438]: pgmap v600: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 7.9 MiB/s wr, 757 op/s 2024-09-11T23:26:04.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:26:04 smithi037 ceph-mon[30630]: pgmap v600: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 7.9 MiB/s wr, 757 op/s 2024-09-11T23:26:04.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 405.0 s, 618.2 tps, lat 158.149 ms stddev 226.552 2024-09-11T23:26:06.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:26:06 smithi160 ceph-mon[35055]: pgmap v601: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 7.0 MiB/s wr, 670 op/s 2024-09-11T23:26:06.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:26:06 smithi123 ceph-mon[35438]: pgmap v601: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 7.0 MiB/s wr, 670 op/s 2024-09-11T23:26:06.567 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:26:06 smithi037 ceph-mon[30630]: pgmap v601: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 7.0 MiB/s wr, 670 op/s 2024-09-11T23:26:08.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:26:08 smithi160 ceph-mon[35055]: pgmap v602: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 6.2 MiB/s wr, 589 op/s 2024-09-11T23:26:08.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:26:08 smithi123 ceph-mon[35438]: pgmap v602: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 6.2 MiB/s wr, 589 op/s 2024-09-11T23:26:08.567 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:26:08 smithi037 ceph-mon[30630]: pgmap v602: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 6.2 MiB/s wr, 589 op/s 2024-09-11T23:26:09.826 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 410.0 s, 759.2 tps, lat 136.027 ms stddev 154.360 2024-09-11T23:26:10.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:26:10 smithi160 ceph-mon[35055]: pgmap v603: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 6.0 MiB/s wr, 559 op/s 2024-09-11T23:26:10.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:26:10 smithi123 ceph-mon[35438]: pgmap v603: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 6.0 MiB/s wr, 559 op/s 2024-09-11T23:26:10.566 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:26:10 smithi037 ceph-mon[30630]: pgmap v603: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 6.0 MiB/s wr, 559 op/s 2024-09-11T23:26:12.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:26:12 smithi160 ceph-mon[35055]: pgmap v604: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 7.2 MiB/s wr, 667 op/s 2024-09-11T23:26:12.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:26:12 smithi123 ceph-mon[35438]: pgmap v604: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 7.2 MiB/s wr, 667 op/s 2024-09-11T23:26:12.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:26:12 smithi037 ceph-mon[30630]: pgmap v604: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 7.2 MiB/s wr, 667 op/s 2024-09-11T23:26:14.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:26:14 smithi160 ceph-mon[35055]: pgmap v605: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 5.4 MiB/s wr, 516 op/s 2024-09-11T23:26:14.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:26:14 smithi123 ceph-mon[35438]: pgmap v605: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 5.4 MiB/s wr, 516 op/s 2024-09-11T23:26:14.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:26:14 smithi037 ceph-mon[30630]: pgmap v605: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 5.4 MiB/s wr, 516 op/s 2024-09-11T23:26:14.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 415.0 s, 652.4 tps, lat 147.267 ms stddev 184.538 2024-09-11T23:26:16.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:26:16 smithi160 ceph-mon[35055]: pgmap v606: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 5.8 MiB/s wr, 564 op/s 2024-09-11T23:26:16.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:26:16 smithi123 ceph-mon[35438]: pgmap v606: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 5.8 MiB/s wr, 564 op/s 2024-09-11T23:26:16.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:26:16 smithi037 ceph-mon[30630]: pgmap v606: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 5.8 MiB/s wr, 564 op/s 2024-09-11T23:26:18.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:26:18 smithi160 ceph-mon[35055]: pgmap v607: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 7.2 MiB/s wr, 706 op/s 2024-09-11T23:26:18.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:26:18 smithi123 ceph-mon[35438]: pgmap v607: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 7.2 MiB/s wr, 706 op/s 2024-09-11T23:26:18.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:26:18 smithi037 ceph-mon[30630]: pgmap v607: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 7.2 MiB/s wr, 706 op/s 2024-09-11T23:26:19.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 420.0 s, 524.2 tps, lat 193.168 ms stddev 242.008 2024-09-11T23:26:20.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:26:20 smithi160 ceph-mon[35055]: pgmap v608: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 6.4 MiB/s wr, 644 op/s 2024-09-11T23:26:20.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:26:20 smithi123 ceph-mon[35438]: pgmap v608: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 6.4 MiB/s wr, 644 op/s 2024-09-11T23:26:20.567 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:26:20 smithi037 ceph-mon[30630]: pgmap v608: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 6.4 MiB/s wr, 644 op/s 2024-09-11T23:26:22.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:26:22 smithi160 ceph-mon[35055]: pgmap v609: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 7.6 MiB/s wr, 785 op/s 2024-09-11T23:26:22.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:26:22 smithi123 ceph-mon[35438]: pgmap v609: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 7.6 MiB/s wr, 785 op/s 2024-09-11T23:26:22.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:26:22 smithi037 ceph-mon[30630]: pgmap v609: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 7.6 MiB/s wr, 785 op/s 2024-09-11T23:26:24.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:26:24 smithi160 ceph-mon[35055]: pgmap v610: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 6.2 MiB/s wr, 658 op/s 2024-09-11T23:26:24.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:26:24 smithi123 ceph-mon[35438]: pgmap v610: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 6.2 MiB/s wr, 658 op/s 2024-09-11T23:26:24.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:26:24 smithi037 ceph-mon[30630]: pgmap v610: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 6.2 MiB/s wr, 658 op/s 2024-09-11T23:26:24.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 425.0 s, 715.4 tps, lat 141.273 ms stddev 168.873 2024-09-11T23:26:26.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:26:26 smithi160 ceph-mon[35055]: pgmap v611: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 7.0 MiB/s wr, 682 op/s 2024-09-11T23:26:26.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:26:26 smithi123 ceph-mon[35438]: pgmap v611: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 7.0 MiB/s wr, 682 op/s 2024-09-11T23:26:26.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:26:26 smithi037 ceph-mon[30630]: pgmap v611: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 7.0 MiB/s wr, 682 op/s 2024-09-11T23:26:28.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:26:28 smithi160 ceph-mon[35055]: pgmap v612: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 7.2 MiB/s wr, 706 op/s 2024-09-11T23:26:28.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:26:28 smithi123 ceph-mon[35438]: pgmap v612: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 7.2 MiB/s wr, 706 op/s 2024-09-11T23:26:28.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:26:28 smithi037 ceph-mon[30630]: pgmap v612: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 7.2 MiB/s wr, 706 op/s 2024-09-11T23:26:29.826 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 430.0 s, 524.0 tps, lat 190.917 ms stddev 225.701 2024-09-11T23:26:30.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:26:30 smithi123 ceph-mon[35438]: pgmap v613: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 5.3 MiB/s wr, 548 op/s 2024-09-11T23:26:30.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:26:30 smithi037 ceph-mon[30630]: pgmap v613: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 5.3 MiB/s wr, 548 op/s 2024-09-11T23:26:30.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:26:30 smithi160 ceph-mon[35055]: pgmap v613: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 5.3 MiB/s wr, 548 op/s 2024-09-11T23:26:31.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:26:31 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:26:31.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:26:31 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:26:31.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:26:31 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:26:32.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:26:32 smithi123 ceph-mon[35438]: pgmap v614: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 6.5 MiB/s wr, 646 op/s 2024-09-11T23:26:32.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:26:32 smithi037 ceph-mon[30630]: pgmap v614: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 6.5 MiB/s wr, 646 op/s 2024-09-11T23:26:32.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:26:32 smithi160 ceph-mon[35055]: pgmap v614: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 6.5 MiB/s wr, 646 op/s 2024-09-11T23:26:33.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:26:33 smithi123 ceph-mon[35438]: pgmap v615: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.7 MiB/s wr, 478 op/s 2024-09-11T23:26:33.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:26:33 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:26:33.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:26:33 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:26:33.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:26:33 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:26:33.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:26:33 smithi037 ceph-mon[30630]: pgmap v615: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.7 MiB/s wr, 478 op/s 2024-09-11T23:26:33.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:26:33 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:26:33.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:26:33 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:26:33.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:26:33 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:26:33.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:26:33 smithi160 ceph-mon[35055]: pgmap v615: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.7 MiB/s wr, 478 op/s 2024-09-11T23:26:33.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:26:33 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:26:33.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:26:33 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:26:33.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:26:33 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:26:34.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 435.0 s, 506.8 tps, lat 195.504 ms stddev 239.732 2024-09-11T23:26:35.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:26:35 smithi160 ceph-mon[35055]: pgmap v616: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.1 MiB/s wr, 500 op/s 2024-09-11T23:26:35.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:26:35 smithi123 ceph-mon[35438]: pgmap v616: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.1 MiB/s wr, 500 op/s 2024-09-11T23:26:35.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:26:35 smithi037 ceph-mon[30630]: pgmap v616: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.1 MiB/s wr, 500 op/s 2024-09-11T23:26:37.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:26:37 smithi160 ceph-mon[35055]: pgmap v617: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.0 MiB/s wr, 535 op/s 2024-09-11T23:26:37.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:26:37 smithi123 ceph-mon[35438]: pgmap v617: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.0 MiB/s wr, 535 op/s 2024-09-11T23:26:37.815 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:26:37 smithi037 ceph-mon[30630]: pgmap v617: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.0 MiB/s wr, 535 op/s 2024-09-11T23:26:39.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:26:39 smithi160 ceph-mon[35055]: pgmap v618: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.5 MiB/s wr, 465 op/s 2024-09-11T23:26:39.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:26:39 smithi123 ceph-mon[35438]: pgmap v618: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.5 MiB/s wr, 465 op/s 2024-09-11T23:26:39.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:26:39 smithi037 ceph-mon[30630]: pgmap v618: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.5 MiB/s wr, 465 op/s 2024-09-11T23:26:39.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 440.0 s, 530.6 tps, lat 193.018 ms stddev 228.174 2024-09-11T23:26:41.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:26:41 smithi160 ceph-mon[35055]: pgmap v619: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 5.7 MiB/s wr, 577 op/s 2024-09-11T23:26:41.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:26:41 smithi123 ceph-mon[35438]: pgmap v619: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 5.7 MiB/s wr, 577 op/s 2024-09-11T23:26:41.815 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:26:41 smithi037 ceph-mon[30630]: pgmap v619: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 5.7 MiB/s wr, 577 op/s 2024-09-11T23:26:43.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:26:43 smithi123 ceph-mon[35438]: pgmap v620: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 4.1 MiB/s wr, 429 op/s 2024-09-11T23:26:43.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:26:43 smithi037 ceph-mon[30630]: pgmap v620: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 4.1 MiB/s wr, 429 op/s 2024-09-11T23:26:43.933 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:26:43 smithi160 ceph-mon[35055]: pgmap v620: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 4.1 MiB/s wr, 429 op/s 2024-09-11T23:26:44.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 445.0 s, 942.6 tps, lat 105.198 ms stddev 143.473 2024-09-11T23:26:45.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:26:45 smithi123 ceph-mon[35438]: pgmap v621: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 4.1 MiB/s wr, 428 op/s 2024-09-11T23:26:45.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:26:45 smithi037 ceph-mon[30630]: pgmap v621: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 4.1 MiB/s wr, 428 op/s 2024-09-11T23:26:45.933 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:26:45 smithi160 ceph-mon[35055]: pgmap v621: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 4.1 MiB/s wr, 428 op/s 2024-09-11T23:26:47.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:26:47 smithi123 ceph-mon[35438]: pgmap v622: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 5.5 MiB/s wr, 550 op/s 2024-09-11T23:26:47.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:26:47 smithi037 ceph-mon[30630]: pgmap v622: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 5.5 MiB/s wr, 550 op/s 2024-09-11T23:26:47.933 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:26:47 smithi160 ceph-mon[35055]: pgmap v622: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 5.5 MiB/s wr, 550 op/s 2024-09-11T23:26:49.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:26:49 smithi037 ceph-mon[30630]: pgmap v623: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 4.8 MiB/s wr, 478 op/s 2024-09-11T23:26:49.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 450.0 s, 545.2 tps, lat 182.982 ms stddev 204.808 2024-09-11T23:26:49.933 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:26:49 smithi160 ceph-mon[35055]: pgmap v623: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 4.8 MiB/s wr, 478 op/s 2024-09-11T23:26:50.000 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:26:49 smithi123 ceph-mon[35438]: pgmap v623: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 4.8 MiB/s wr, 478 op/s 2024-09-11T23:26:51.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:26:51 smithi037 ceph-mon[30630]: pgmap v624: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 6.2 MiB/s wr, 643 op/s 2024-09-11T23:26:51.933 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:26:51 smithi160 ceph-mon[35055]: pgmap v624: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 6.2 MiB/s wr, 643 op/s 2024-09-11T23:26:52.000 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:26:51 smithi123 ceph-mon[35438]: pgmap v624: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 6.2 MiB/s wr, 643 op/s 2024-09-11T23:26:53.815 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:26:53 smithi037 ceph-mon[30630]: pgmap v625: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.8 MiB/s wr, 501 op/s 2024-09-11T23:26:53.933 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:26:53 smithi160 ceph-mon[35055]: pgmap v625: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.8 MiB/s wr, 501 op/s 2024-09-11T23:26:54.000 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:26:53 smithi123 ceph-mon[35438]: pgmap v625: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.8 MiB/s wr, 501 op/s 2024-09-11T23:26:54.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 455.0 s, 501.2 tps, lat 196.329 ms stddev 213.393 2024-09-11T23:26:55.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:26:55 smithi037 ceph-mon[30630]: pgmap v626: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 5.4 MiB/s wr, 538 op/s 2024-09-11T23:26:55.933 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:26:55 smithi160 ceph-mon[35055]: pgmap v626: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 5.4 MiB/s wr, 538 op/s 2024-09-11T23:26:56.000 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:26:55 smithi123 ceph-mon[35438]: pgmap v626: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 5.4 MiB/s wr, 538 op/s 2024-09-11T23:26:57.815 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:26:57 smithi037 ceph-mon[30630]: pgmap v627: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.3 MiB/s wr, 651 op/s 2024-09-11T23:26:57.933 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:26:57 smithi160 ceph-mon[35055]: pgmap v627: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.3 MiB/s wr, 651 op/s 2024-09-11T23:26:58.000 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:26:57 smithi123 ceph-mon[35438]: pgmap v627: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.3 MiB/s wr, 651 op/s 2024-09-11T23:26:59.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:26:59 smithi037 ceph-mon[30630]: pgmap v628: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.8 MiB/s wr, 517 op/s 2024-09-11T23:26:59.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 460.0 s, 606.4 tps, lat 167.195 ms stddev 198.953 2024-09-11T23:26:59.933 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:26:59 smithi160 ceph-mon[35055]: pgmap v628: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.8 MiB/s wr, 517 op/s 2024-09-11T23:27:00.000 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:26:59 smithi123 ceph-mon[35438]: pgmap v628: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.8 MiB/s wr, 517 op/s 2024-09-11T23:27:01.933 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:27:01 smithi160 ceph-mon[35055]: pgmap v629: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 5.9 MiB/s wr, 647 op/s 2024-09-11T23:27:02.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:27:01 smithi123 ceph-mon[35438]: pgmap v629: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 5.9 MiB/s wr, 647 op/s 2024-09-11T23:27:02.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:27:01 smithi037 ceph-mon[30630]: pgmap v629: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 5.9 MiB/s wr, 647 op/s 2024-09-11T23:27:03.933 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:27:03 smithi160 ceph-mon[35055]: pgmap v630: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.4 MiB/s wr, 467 op/s 2024-09-11T23:27:04.000 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:27:03 smithi123 ceph-mon[35438]: pgmap v630: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.4 MiB/s wr, 467 op/s 2024-09-11T23:27:04.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:27:03 smithi037 ceph-mon[30630]: pgmap v630: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.4 MiB/s wr, 467 op/s 2024-09-11T23:27:04.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 465.0 s, 591.4 tps, lat 164.819 ms stddev 233.047 2024-09-11T23:27:05.933 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:27:05 smithi160 ceph-mon[35055]: pgmap v631: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 5.0 MiB/s wr, 526 op/s 2024-09-11T23:27:06.000 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:27:05 smithi123 ceph-mon[35438]: pgmap v631: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 5.0 MiB/s wr, 526 op/s 2024-09-11T23:27:06.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:27:05 smithi037 ceph-mon[30630]: pgmap v631: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 5.0 MiB/s wr, 526 op/s 2024-09-11T23:27:07.933 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:27:07 smithi160 ceph-mon[35055]: pgmap v632: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 7.0 MiB/s wr, 765 op/s 2024-09-11T23:27:08.000 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:27:07 smithi123 ceph-mon[35438]: pgmap v632: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 7.0 MiB/s wr, 765 op/s 2024-09-11T23:27:08.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:27:07 smithi037 ceph-mon[30630]: pgmap v632: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 7.0 MiB/s wr, 765 op/s 2024-09-11T23:27:09.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 470.0 s, 638.6 tps, lat 159.423 ms stddev 193.960 2024-09-11T23:27:09.933 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:27:09 smithi160 ceph-mon[35055]: pgmap v633: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 6.0 MiB/s wr, 654 op/s 2024-09-11T23:27:10.000 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:27:09 smithi123 ceph-mon[35438]: pgmap v633: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 6.0 MiB/s wr, 654 op/s 2024-09-11T23:27:10.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:27:09 smithi037 ceph-mon[30630]: pgmap v633: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 6.0 MiB/s wr, 654 op/s 2024-09-11T23:27:11.933 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:27:11 smithi160 ceph-mon[35055]: pgmap v634: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 7.3 MiB/s wr, 795 op/s 2024-09-11T23:27:12.000 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:27:11 smithi123 ceph-mon[35438]: pgmap v634: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 7.3 MiB/s wr, 795 op/s 2024-09-11T23:27:12.066 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:27:11 smithi037 ceph-mon[30630]: pgmap v634: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 7.3 MiB/s wr, 795 op/s 2024-09-11T23:27:13.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:27:13 smithi160 ceph-mon[35055]: pgmap v635: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 5.8 MiB/s wr, 637 op/s 2024-09-11T23:27:14.000 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:27:13 smithi123 ceph-mon[35438]: pgmap v635: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 5.8 MiB/s wr, 637 op/s 2024-09-11T23:27:14.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:27:13 smithi037 ceph-mon[30630]: pgmap v635: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 5.8 MiB/s wr, 637 op/s 2024-09-11T23:27:14.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 475.0 s, 797.4 tps, lat 125.136 ms stddev 163.511 2024-09-11T23:27:15.936 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:27:15 smithi160 ceph-mon[35055]: pgmap v636: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 6.2 MiB/s wr, 679 op/s 2024-09-11T23:27:16.000 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:27:15 smithi123 ceph-mon[35438]: pgmap v636: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 6.2 MiB/s wr, 679 op/s 2024-09-11T23:27:16.066 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:27:15 smithi037 ceph-mon[30630]: pgmap v636: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 6.2 MiB/s wr, 679 op/s 2024-09-11T23:27:17.933 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:27:17 smithi160 ceph-mon[35055]: pgmap v637: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 6.8 MiB/s wr, 736 op/s 2024-09-11T23:27:18.000 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:27:17 smithi123 ceph-mon[35438]: pgmap v637: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 6.8 MiB/s wr, 736 op/s 2024-09-11T23:27:18.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:27:17 smithi037 ceph-mon[30630]: pgmap v637: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 6.8 MiB/s wr, 736 op/s 2024-09-11T23:27:19.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 480.0 s, 631.2 tps, lat 159.204 ms stddev 204.469 2024-09-11T23:27:19.933 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:27:19 smithi160 ceph-mon[35055]: pgmap v638: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 4.4 MiB/s wr, 477 op/s 2024-09-11T23:27:20.000 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:27:19 smithi123 ceph-mon[35438]: pgmap v638: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 4.4 MiB/s wr, 477 op/s 2024-09-11T23:27:20.066 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:27:19 smithi037 ceph-mon[30630]: pgmap v638: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 4.4 MiB/s wr, 477 op/s 2024-09-11T23:27:21.933 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:27:21 smithi160 ceph-mon[35055]: pgmap v639: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 5.9 MiB/s wr, 633 op/s 2024-09-11T23:27:22.000 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:27:21 smithi123 ceph-mon[35438]: pgmap v639: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 5.9 MiB/s wr, 633 op/s 2024-09-11T23:27:22.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:27:21 smithi037 ceph-mon[30630]: pgmap v639: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 5.9 MiB/s wr, 633 op/s 2024-09-11T23:27:23.933 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:27:23 smithi160 ceph-mon[35055]: pgmap v640: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.3 MiB/s wr, 464 op/s 2024-09-11T23:27:24.000 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:27:23 smithi123 ceph-mon[35438]: pgmap v640: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.3 MiB/s wr, 464 op/s 2024-09-11T23:27:24.069 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:27:23 smithi037 ceph-mon[30630]: pgmap v640: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.3 MiB/s wr, 464 op/s 2024-09-11T23:27:24.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 485.0 s, 586.2 tps, lat 171.305 ms stddev 201.175 2024-09-11T23:27:25.933 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:27:25 smithi160 ceph-mon[35055]: pgmap v641: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 5.1 MiB/s wr, 533 op/s 2024-09-11T23:27:26.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:27:25 smithi123 ceph-mon[35438]: pgmap v641: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 5.1 MiB/s wr, 533 op/s 2024-09-11T23:27:26.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:27:25 smithi037 ceph-mon[30630]: pgmap v641: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 5.1 MiB/s wr, 533 op/s 2024-09-11T23:27:28.000 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:27:27 smithi123 ceph-mon[35438]: pgmap v642: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 5.5 MiB/s wr, 581 op/s 2024-09-11T23:27:28.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:27:27 smithi037 ceph-mon[30630]: pgmap v642: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 5.5 MiB/s wr, 581 op/s 2024-09-11T23:27:28.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:27:27 smithi160 ceph-mon[35055]: pgmap v642: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 5.5 MiB/s wr, 581 op/s 2024-09-11T23:27:29.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 490.0 s, 492.4 tps, lat 199.983 ms stddev 229.579 2024-09-11T23:27:30.000 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:27:29 smithi123 ceph-mon[35438]: pgmap v643: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.5 MiB/s wr, 478 op/s 2024-09-11T23:27:30.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:27:29 smithi037 ceph-mon[30630]: pgmap v643: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.5 MiB/s wr, 478 op/s 2024-09-11T23:27:30.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:27:29 smithi160 ceph-mon[35055]: pgmap v643: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.5 MiB/s wr, 478 op/s 2024-09-11T23:27:32.000 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:27:31 smithi123 ceph-mon[35438]: pgmap v644: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.7 MiB/s wr, 611 op/s 2024-09-11T23:27:32.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:27:31 smithi037 ceph-mon[30630]: pgmap v644: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.7 MiB/s wr, 611 op/s 2024-09-11T23:27:32.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:27:31 smithi160 ceph-mon[35055]: pgmap v644: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.7 MiB/s wr, 611 op/s 2024-09-11T23:27:33.003 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:27:32 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:27:33.066 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:27:32 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:27:33.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:27:32 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:27:34.000 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:27:33 smithi123 ceph-mon[35438]: pgmap v645: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.9 MiB/s wr, 434 op/s 2024-09-11T23:27:34.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:27:33 smithi037 ceph-mon[30630]: pgmap v645: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.9 MiB/s wr, 434 op/s 2024-09-11T23:27:34.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:27:33 smithi160 ceph-mon[35055]: pgmap v645: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.9 MiB/s wr, 434 op/s 2024-09-11T23:27:34.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 495.0 s, 534.6 tps, lat 188.173 ms stddev 238.452 2024-09-11T23:27:35.000 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:27:34 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:27:35.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:27:34 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:27:35.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:27:34 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:27:35.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:27:34 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:27:35.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:27:34 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:27:35.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:27:34 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:27:35.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:27:34 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:27:35.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:27:34 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:27:35.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:27:34 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:27:36.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:27:36 smithi037 ceph-mon[30630]: pgmap v646: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 4.7 MiB/s wr, 515 op/s 2024-09-11T23:27:36.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:27:36 smithi160 ceph-mon[35055]: pgmap v646: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 4.7 MiB/s wr, 515 op/s 2024-09-11T23:27:36.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:27:36 smithi123 ceph-mon[35438]: pgmap v646: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 4.7 MiB/s wr, 515 op/s 2024-09-11T23:27:38.316 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:27:38 smithi037 ceph-mon[30630]: pgmap v647: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.9 MiB/s wr, 564 op/s 2024-09-11T23:27:38.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:27:38 smithi160 ceph-mon[35055]: pgmap v647: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.9 MiB/s wr, 564 op/s 2024-09-11T23:27:38.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:27:38 smithi123 ceph-mon[35438]: pgmap v647: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.9 MiB/s wr, 564 op/s 2024-09-11T23:27:39.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 500.0 s, 507.0 tps, lat 193.994 ms stddev 255.732 2024-09-11T23:27:40.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:27:40 smithi037 ceph-mon[30630]: pgmap v648: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.2 MiB/s wr, 487 op/s 2024-09-11T23:27:40.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:27:40 smithi160 ceph-mon[35055]: pgmap v648: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.2 MiB/s wr, 487 op/s 2024-09-11T23:27:40.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:27:40 smithi123 ceph-mon[35438]: pgmap v648: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.2 MiB/s wr, 487 op/s 2024-09-11T23:27:42.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:27:42 smithi160 ceph-mon[35055]: pgmap v649: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.6 MiB/s wr, 628 op/s 2024-09-11T23:27:42.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:27:42 smithi123 ceph-mon[35438]: pgmap v649: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.6 MiB/s wr, 628 op/s 2024-09-11T23:27:42.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:27:42 smithi037 ceph-mon[30630]: pgmap v649: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.6 MiB/s wr, 628 op/s 2024-09-11T23:27:44.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:27:44 smithi160 ceph-mon[35055]: pgmap v650: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 4.2 MiB/s wr, 477 op/s 2024-09-11T23:27:44.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:27:44 smithi123 ceph-mon[35438]: pgmap v650: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 4.2 MiB/s wr, 477 op/s 2024-09-11T23:27:44.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:27:44 smithi037 ceph-mon[30630]: pgmap v650: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 4.2 MiB/s wr, 477 op/s 2024-09-11T23:27:44.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 505.0 s, 544.2 tps, lat 186.997 ms stddev 208.176 2024-09-11T23:27:46.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:27:46 smithi160 ceph-mon[35055]: pgmap v651: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 5.0 MiB/s wr, 550 op/s 2024-09-11T23:27:46.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:27:46 smithi123 ceph-mon[35438]: pgmap v651: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 5.0 MiB/s wr, 550 op/s 2024-09-11T23:27:46.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:27:46 smithi037 ceph-mon[30630]: pgmap v651: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 5.0 MiB/s wr, 550 op/s 2024-09-11T23:27:48.367 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:27:48 smithi037 ceph-mon[30630]: pgmap v652: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 5.0 MiB/s wr, 573 op/s 2024-09-11T23:27:48.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:27:48 smithi160 ceph-mon[35055]: pgmap v652: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 5.0 MiB/s wr, 573 op/s 2024-09-11T23:27:48.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:27:48 smithi123 ceph-mon[35438]: pgmap v652: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 5.0 MiB/s wr, 573 op/s 2024-09-11T23:27:49.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 510.0 s, 608.4 tps, lat 164.226 ms stddev 183.587 2024-09-11T23:27:50.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:27:50 smithi160 ceph-mon[35055]: pgmap v653: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 4.3 MiB/s wr, 472 op/s 2024-09-11T23:27:50.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:27:50 smithi123 ceph-mon[35438]: pgmap v653: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 4.3 MiB/s wr, 472 op/s 2024-09-11T23:27:50.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:27:50 smithi037 ceph-mon[30630]: pgmap v653: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 4.3 MiB/s wr, 472 op/s 2024-09-11T23:27:52.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:27:52 smithi160 ceph-mon[35055]: pgmap v654: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 5.3 MiB/s wr, 582 op/s 2024-09-11T23:27:52.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:27:52 smithi123 ceph-mon[35438]: pgmap v654: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 5.3 MiB/s wr, 582 op/s 2024-09-11T23:27:52.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:27:52 smithi037 ceph-mon[30630]: pgmap v654: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 5.3 MiB/s wr, 582 op/s 2024-09-11T23:27:54.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:27:54 smithi160 ceph-mon[35055]: pgmap v655: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 4.2 MiB/s wr, 459 op/s 2024-09-11T23:27:54.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:27:54 smithi123 ceph-mon[35438]: pgmap v655: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 4.2 MiB/s wr, 459 op/s 2024-09-11T23:27:54.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:27:54 smithi037 ceph-mon[30630]: pgmap v655: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 4.2 MiB/s wr, 459 op/s 2024-09-11T23:27:54.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 515.0 s, 593.4 tps, lat 169.967 ms stddev 185.633 2024-09-11T23:27:56.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:27:56 smithi160 ceph-mon[35055]: pgmap v656: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 4.6 MiB/s wr, 513 op/s 2024-09-11T23:27:56.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:27:56 smithi123 ceph-mon[35438]: pgmap v656: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 4.6 MiB/s wr, 513 op/s 2024-09-11T23:27:56.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:27:56 smithi037 ceph-mon[30630]: pgmap v656: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 4.6 MiB/s wr, 513 op/s 2024-09-11T23:27:58.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:27:58 smithi160 ceph-mon[35055]: pgmap v657: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.0 MiB/s wr, 561 op/s 2024-09-11T23:27:58.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:27:58 smithi123 ceph-mon[35438]: pgmap v657: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.0 MiB/s wr, 561 op/s 2024-09-11T23:27:58.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:27:58 smithi037 ceph-mon[30630]: pgmap v657: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.0 MiB/s wr, 561 op/s 2024-09-11T23:27:59.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 520.0 s, 482.4 tps, lat 206.600 ms stddev 262.921 2024-09-11T23:28:00.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:28:00 smithi160 ceph-mon[35055]: pgmap v658: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 4.3 MiB/s wr, 476 op/s 2024-09-11T23:28:00.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:28:00 smithi123 ceph-mon[35438]: pgmap v658: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 4.3 MiB/s wr, 476 op/s 2024-09-11T23:28:00.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:28:00 smithi037 ceph-mon[30630]: pgmap v658: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 4.3 MiB/s wr, 476 op/s 2024-09-11T23:28:02.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:28:02 smithi160 ceph-mon[35055]: pgmap v659: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 5.0 MiB/s wr, 566 op/s 2024-09-11T23:28:02.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:28:02 smithi123 ceph-mon[35438]: pgmap v659: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 5.0 MiB/s wr, 566 op/s 2024-09-11T23:28:02.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:28:02 smithi037 ceph-mon[30630]: pgmap v659: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 5.0 MiB/s wr, 566 op/s 2024-09-11T23:28:04.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:28:04 smithi160 ceph-mon[35055]: pgmap v660: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 4.2 MiB/s wr, 475 op/s 2024-09-11T23:28:04.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:28:04 smithi123 ceph-mon[35438]: pgmap v660: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 4.2 MiB/s wr, 475 op/s 2024-09-11T23:28:04.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:28:04 smithi037 ceph-mon[30630]: pgmap v660: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 4.2 MiB/s wr, 475 op/s 2024-09-11T23:28:04.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 525.0 s, 488.8 tps, lat 202.030 ms stddev 237.080 2024-09-11T23:28:06.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:28:06 smithi160 ceph-mon[35055]: pgmap v661: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 4.4 MiB/s wr, 500 op/s 2024-09-11T23:28:06.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:28:06 smithi123 ceph-mon[35438]: pgmap v661: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 4.4 MiB/s wr, 500 op/s 2024-09-11T23:28:06.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:28:06 smithi037 ceph-mon[30630]: pgmap v661: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 4.4 MiB/s wr, 500 op/s 2024-09-11T23:28:08.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:28:08 smithi160 ceph-mon[35055]: pgmap v662: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 5.2 MiB/s wr, 581 op/s 2024-09-11T23:28:08.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:28:08 smithi123 ceph-mon[35438]: pgmap v662: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 5.2 MiB/s wr, 581 op/s 2024-09-11T23:28:08.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:28:08 smithi037 ceph-mon[30630]: pgmap v662: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 5.2 MiB/s wr, 581 op/s 2024-09-11T23:28:09.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 530.0 s, 573.2 tps, lat 175.803 ms stddev 227.959 2024-09-11T23:28:10.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:28:10 smithi123 ceph-mon[35438]: pgmap v663: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.2 MiB/s wr, 486 op/s 2024-09-11T23:28:10.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:28:10 smithi037 ceph-mon[30630]: pgmap v663: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.2 MiB/s wr, 486 op/s 2024-09-11T23:28:10.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:28:10 smithi160 ceph-mon[35055]: pgmap v663: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.2 MiB/s wr, 486 op/s 2024-09-11T23:28:12.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:28:12 smithi123 ceph-mon[35438]: pgmap v664: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 5.5 MiB/s wr, 621 op/s 2024-09-11T23:28:12.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:28:12 smithi037 ceph-mon[30630]: pgmap v664: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 5.5 MiB/s wr, 621 op/s 2024-09-11T23:28:12.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:28:12 smithi160 ceph-mon[35055]: pgmap v664: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 5.5 MiB/s wr, 621 op/s 2024-09-11T23:28:14.485 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:28:14 smithi160 ceph-mon[35055]: pgmap v665: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 5.2 MiB/s wr, 571 op/s 2024-09-11T23:28:14.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:28:14 smithi123 ceph-mon[35438]: pgmap v665: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 5.2 MiB/s wr, 571 op/s 2024-09-11T23:28:14.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:28:14 smithi037 ceph-mon[30630]: pgmap v665: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 5.2 MiB/s wr, 571 op/s 2024-09-11T23:28:14.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 535.0 s, 515.2 tps, lat 195.801 ms stddev 223.473 2024-09-11T23:28:16.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:28:16 smithi123 ceph-mon[35438]: pgmap v666: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 5.6 MiB/s wr, 637 op/s 2024-09-11T23:28:16.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:28:16 smithi037 ceph-mon[30630]: pgmap v666: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 5.6 MiB/s wr, 637 op/s 2024-09-11T23:28:16.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:28:16 smithi160 ceph-mon[35055]: pgmap v666: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 5.6 MiB/s wr, 637 op/s 2024-09-11T23:28:18.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:28:18 smithi123 ceph-mon[35438]: pgmap v667: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 229 KiB/s rd, 6.3 MiB/s wr, 718 op/s 2024-09-11T23:28:18.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:28:18 smithi037 ceph-mon[30630]: pgmap v667: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 229 KiB/s rd, 6.3 MiB/s wr, 718 op/s 2024-09-11T23:28:18.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:28:18 smithi160 ceph-mon[35055]: pgmap v667: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 229 KiB/s rd, 6.3 MiB/s wr, 718 op/s 2024-09-11T23:28:19.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 540.0 s, 641.2 tps, lat 157.292 ms stddev 165.829 2024-09-11T23:28:20.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:28:20 smithi123 ceph-mon[35438]: pgmap v668: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 218 KiB/s rd, 5.2 MiB/s wr, 600 op/s 2024-09-11T23:28:20.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:28:20 smithi037 ceph-mon[30630]: pgmap v668: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 218 KiB/s rd, 5.2 MiB/s wr, 600 op/s 2024-09-11T23:28:20.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:28:20 smithi160 ceph-mon[35055]: pgmap v668: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 218 KiB/s rd, 5.2 MiB/s wr, 600 op/s 2024-09-11T23:28:22.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:28:22 smithi037 ceph-mon[30630]: pgmap v669: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 6.0 MiB/s wr, 685 op/s 2024-09-11T23:28:22.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:28:22 smithi160 ceph-mon[35055]: pgmap v669: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 6.0 MiB/s wr, 685 op/s 2024-09-11T23:28:22.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:28:22 smithi123 ceph-mon[35438]: pgmap v669: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 6.0 MiB/s wr, 685 op/s 2024-09-11T23:28:24.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:28:24 smithi037 ceph-mon[30630]: pgmap v670: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 5.3 MiB/s wr, 610 op/s 2024-09-11T23:28:24.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:28:24 smithi160 ceph-mon[35055]: pgmap v670: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 5.3 MiB/s wr, 610 op/s 2024-09-11T23:28:24.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:28:24 smithi123 ceph-mon[35438]: pgmap v670: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 5.3 MiB/s wr, 610 op/s 2024-09-11T23:28:24.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 545.0 s, 778.0 tps, lat 125.637 ms stddev 151.962 2024-09-11T23:28:25.591 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:28:25 smithi037 ceph-mon[30630]: pgmap v671: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 239 KiB/s rd, 5.2 MiB/s wr, 610 op/s 2024-09-11T23:28:25.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:28:25 smithi160 ceph-mon[35055]: pgmap v671: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 239 KiB/s rd, 5.2 MiB/s wr, 610 op/s 2024-09-11T23:28:25.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:28:25 smithi123 ceph-mon[35438]: pgmap v671: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 239 KiB/s rd, 5.2 MiB/s wr, 610 op/s 2024-09-11T23:28:27.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:28:27 smithi123 ceph-mon[35438]: pgmap v672: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 257 KiB/s rd, 5.9 MiB/s wr, 655 op/s 2024-09-11T23:28:27.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:28:27 smithi037 ceph-mon[30630]: pgmap v672: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 257 KiB/s rd, 5.9 MiB/s wr, 655 op/s 2024-09-11T23:28:27.933 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:28:27 smithi160 ceph-mon[35055]: pgmap v672: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 257 KiB/s rd, 5.9 MiB/s wr, 655 op/s 2024-09-11T23:28:29.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:28:29 smithi123 ceph-mon[35438]: pgmap v673: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 5.1 MiB/s wr, 550 op/s 2024-09-11T23:28:29.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:28:29 smithi037 ceph-mon[30630]: pgmap v673: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 5.1 MiB/s wr, 550 op/s 2024-09-11T23:28:29.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 550.0 s, 506.2 tps, lat 202.216 ms stddev 239.872 2024-09-11T23:28:29.933 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:28:29 smithi160 ceph-mon[35055]: pgmap v673: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 5.1 MiB/s wr, 550 op/s 2024-09-11T23:28:31.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:28:31 smithi123 ceph-mon[35438]: pgmap v674: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 6.0 MiB/s wr, 675 op/s 2024-09-11T23:28:31.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:28:31 smithi037 ceph-mon[30630]: pgmap v674: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 6.0 MiB/s wr, 675 op/s 2024-09-11T23:28:31.933 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:28:31 smithi160 ceph-mon[35055]: pgmap v674: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 6.0 MiB/s wr, 675 op/s 2024-09-11T23:28:33.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:28:33 smithi123 ceph-mon[35438]: pgmap v675: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 5.7 MiB/s wr, 637 op/s 2024-09-11T23:28:33.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:28:33 smithi037 ceph-mon[30630]: pgmap v675: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 5.7 MiB/s wr, 637 op/s 2024-09-11T23:28:33.933 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:28:33 smithi160 ceph-mon[35055]: pgmap v675: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 5.7 MiB/s wr, 637 op/s 2024-09-11T23:28:34.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:28:34 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:28:34.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:28:34 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:28:34.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 555.0 s, 443.0 tps, lat 213.504 ms stddev 255.048 2024-09-11T23:28:34.933 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:28:34 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:28:35.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:28:35 smithi160 ceph-mon[35055]: pgmap v676: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 5.6 MiB/s wr, 627 op/s 2024-09-11T23:28:35.772 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:28:35 smithi123 ceph-mon[35438]: pgmap v676: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 5.6 MiB/s wr, 627 op/s 2024-09-11T23:28:35.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:28:35 smithi037 ceph-mon[30630]: pgmap v676: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 5.6 MiB/s wr, 627 op/s 2024-09-11T23:28:37.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:28:37 smithi037 ceph-mon[30630]: pgmap v677: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 5.9 MiB/s wr, 664 op/s 2024-09-11T23:28:37.815 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:28:37 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:28:37.815 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:28:37 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:28:37.815 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:28:37 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:28:37.815 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:28:37 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:28:37.933 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:28:37 smithi160 ceph-mon[35055]: pgmap v677: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 5.9 MiB/s wr, 664 op/s 2024-09-11T23:28:37.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:28:37 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:28:37.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:28:37 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:28:37.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:28:37 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:28:37.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:28:37 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:28:38.000 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:28:37 smithi123 ceph-mon[35438]: pgmap v677: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 5.9 MiB/s wr, 664 op/s 2024-09-11T23:28:38.000 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:28:37 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:28:38.000 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:28:37 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:28:38.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:28:37 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:28:38.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:28:37 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:28:39.816 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:28:39 smithi037 ceph-mon[30630]: pgmap v678: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 4.3 MiB/s wr, 518 op/s 2024-09-11T23:28:39.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 560.0 s, 418.8 tps, lat 249.246 ms stddev 280.809 2024-09-11T23:28:39.933 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:28:39 smithi160 ceph-mon[35055]: pgmap v678: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 4.3 MiB/s wr, 518 op/s 2024-09-11T23:28:40.000 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:28:39 smithi123 ceph-mon[35438]: pgmap v678: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 4.3 MiB/s wr, 518 op/s 2024-09-11T23:28:41.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:28:40 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:28:41.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:28:40 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:28:41.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:28:40 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:28:41.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:28:40 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:28:41.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:28:40 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:28:41.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:28:40 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:28:42.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:28:41 smithi037 ceph-mon[30630]: pgmap v679: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 4.7 MiB/s wr, 551 op/s 2024-09-11T23:28:42.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:28:41 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:28:42.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:28:41 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:28:42.066 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:28:41 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:28:42.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:28:41 smithi160 ceph-mon[35055]: pgmap v679: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 4.7 MiB/s wr, 551 op/s 2024-09-11T23:28:42.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:28:41 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:28:42.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:28:41 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:28:42.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:28:41 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:28:42.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:28:41 smithi123 ceph-mon[35438]: pgmap v679: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 4.7 MiB/s wr, 551 op/s 2024-09-11T23:28:42.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:28:41 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:28:42.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:28:41 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:28:42.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:28:41 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:28:44.052 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:28:43 smithi123 ceph-mon[35438]: pgmap v680: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 3.9 MiB/s wr, 456 op/s 2024-09-11T23:28:44.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:28:43 smithi037 ceph-mon[30630]: pgmap v680: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 3.9 MiB/s wr, 456 op/s 2024-09-11T23:28:44.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:28:43 smithi160 ceph-mon[35055]: pgmap v680: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 3.9 MiB/s wr, 456 op/s 2024-09-11T23:28:44.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 565.0 s, 449.8 tps, lat 217.695 ms stddev 259.636 2024-09-11T23:28:46.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:28:45 smithi037 ceph-mon[30630]: pgmap v681: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 3.9 MiB/s wr, 460 op/s 2024-09-11T23:28:46.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:28:45 smithi160 ceph-mon[35055]: pgmap v681: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 3.9 MiB/s wr, 460 op/s 2024-09-11T23:28:46.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:28:45 smithi123 ceph-mon[35438]: pgmap v681: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 3.9 MiB/s wr, 460 op/s 2024-09-11T23:28:48.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:28:47 smithi037 ceph-mon[30630]: pgmap v682: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 4.0 MiB/s wr, 473 op/s 2024-09-11T23:28:48.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:28:47 smithi160 ceph-mon[35055]: pgmap v682: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 4.0 MiB/s wr, 473 op/s 2024-09-11T23:28:48.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:28:47 smithi123 ceph-mon[35438]: pgmap v682: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 4.0 MiB/s wr, 473 op/s 2024-09-11T23:28:49.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 570.0 s, 562.2 tps, lat 180.053 ms stddev 203.334 2024-09-11T23:28:50.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:28:49 smithi037 ceph-mon[30630]: pgmap v683: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 3.5 MiB/s wr, 406 op/s 2024-09-11T23:28:50.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:28:49 smithi160 ceph-mon[35055]: pgmap v683: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 3.5 MiB/s wr, 406 op/s 2024-09-11T23:28:50.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:28:49 smithi123 ceph-mon[35438]: pgmap v683: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 3.5 MiB/s wr, 406 op/s 2024-09-11T23:28:52.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:28:51 smithi160 ceph-mon[35055]: pgmap v684: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 4.0 MiB/s wr, 470 op/s 2024-09-11T23:28:52.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:28:51 smithi123 ceph-mon[35438]: pgmap v684: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 4.0 MiB/s wr, 470 op/s 2024-09-11T23:28:52.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:28:51 smithi037 ceph-mon[30630]: pgmap v684: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 4.0 MiB/s wr, 470 op/s 2024-09-11T23:28:54.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:28:53 smithi160 ceph-mon[35055]: pgmap v685: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 3.8 MiB/s wr, 468 op/s 2024-09-11T23:28:54.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:28:53 smithi123 ceph-mon[35438]: pgmap v685: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 3.8 MiB/s wr, 468 op/s 2024-09-11T23:28:54.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:28:53 smithi037 ceph-mon[30630]: pgmap v685: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 3.8 MiB/s wr, 468 op/s 2024-09-11T23:28:54.828 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 575.0 s, 504.8 tps, lat 199.705 ms stddev 221.381 2024-09-11T23:28:56.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:28:55 smithi160 ceph-mon[35055]: pgmap v686: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 4.4 MiB/s wr, 514 op/s 2024-09-11T23:28:56.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:28:55 smithi123 ceph-mon[35438]: pgmap v686: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 4.4 MiB/s wr, 514 op/s 2024-09-11T23:28:56.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:28:55 smithi037 ceph-mon[30630]: pgmap v686: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 4.4 MiB/s wr, 514 op/s 2024-09-11T23:28:58.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:28:57 smithi160 ceph-mon[35055]: pgmap v687: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 4.1 MiB/s wr, 493 op/s 2024-09-11T23:28:58.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:28:57 smithi123 ceph-mon[35438]: pgmap v687: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 4.1 MiB/s wr, 493 op/s 2024-09-11T23:28:58.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:28:57 smithi037 ceph-mon[30630]: pgmap v687: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 4.1 MiB/s wr, 493 op/s 2024-09-11T23:28:59.826 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 580.0 s, 534.3 tps, lat 188.961 ms stddev 242.157 2024-09-11T23:29:00.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:28:59 smithi160 ceph-mon[35055]: pgmap v688: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 3.9 MiB/s wr, 462 op/s 2024-09-11T23:29:00.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:28:59 smithi123 ceph-mon[35438]: pgmap v688: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 3.9 MiB/s wr, 462 op/s 2024-09-11T23:29:00.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:28:59 smithi037 ceph-mon[30630]: pgmap v688: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 3.9 MiB/s wr, 462 op/s 2024-09-11T23:29:02.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:29:01 smithi160 ceph-mon[35055]: pgmap v689: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 4.4 MiB/s wr, 514 op/s 2024-09-11T23:29:02.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:29:01 smithi123 ceph-mon[35438]: pgmap v689: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 4.4 MiB/s wr, 514 op/s 2024-09-11T23:29:02.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:29:01 smithi037 ceph-mon[30630]: pgmap v689: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 4.4 MiB/s wr, 514 op/s 2024-09-11T23:29:04.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:29:03 smithi160 ceph-mon[35055]: pgmap v690: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 4.3 MiB/s wr, 511 op/s 2024-09-11T23:29:04.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:29:03 smithi123 ceph-mon[35438]: pgmap v690: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 4.3 MiB/s wr, 511 op/s 2024-09-11T23:29:04.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:29:03 smithi037 ceph-mon[30630]: pgmap v690: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 4.3 MiB/s wr, 511 op/s 2024-09-11T23:29:04.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 585.0 s, 526.5 tps, lat 190.053 ms stddev 250.392 2024-09-11T23:29:06.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:29:05 smithi160 ceph-mon[35055]: pgmap v691: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.7 MiB/s wr, 538 op/s 2024-09-11T23:29:06.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:29:05 smithi123 ceph-mon[35438]: pgmap v691: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.7 MiB/s wr, 538 op/s 2024-09-11T23:29:06.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:29:05 smithi037 ceph-mon[30630]: pgmap v691: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.7 MiB/s wr, 538 op/s 2024-09-11T23:29:08.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:29:07 smithi160 ceph-mon[35055]: pgmap v692: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 4.2 MiB/s wr, 504 op/s 2024-09-11T23:29:08.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:29:07 smithi123 ceph-mon[35438]: pgmap v692: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 4.2 MiB/s wr, 504 op/s 2024-09-11T23:29:08.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:29:07 smithi037 ceph-mon[30630]: pgmap v692: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 4.2 MiB/s wr, 504 op/s 2024-09-11T23:29:09.826 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 590.0 s, 508.8 tps, lat 184.721 ms stddev 216.278 2024-09-11T23:29:10.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:29:09 smithi160 ceph-mon[35055]: pgmap v693: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 4.5 MiB/s wr, 518 op/s 2024-09-11T23:29:10.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:29:09 smithi123 ceph-mon[35438]: pgmap v693: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 4.5 MiB/s wr, 518 op/s 2024-09-11T23:29:10.316 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:29:09 smithi037 ceph-mon[30630]: pgmap v693: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 4.5 MiB/s wr, 518 op/s 2024-09-11T23:29:12.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:29:11 smithi160 ceph-mon[35055]: pgmap v694: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 4.6 MiB/s wr, 536 op/s 2024-09-11T23:29:12.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:29:11 smithi123 ceph-mon[35438]: pgmap v694: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 4.6 MiB/s wr, 536 op/s 2024-09-11T23:29:12.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:29:11 smithi037 ceph-mon[30630]: pgmap v694: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 4.6 MiB/s wr, 536 op/s 2024-09-11T23:29:14.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:29:13 smithi160 ceph-mon[35055]: pgmap v695: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 4.6 MiB/s wr, 529 op/s 2024-09-11T23:29:14.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:29:13 smithi123 ceph-mon[35438]: pgmap v695: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 4.6 MiB/s wr, 529 op/s 2024-09-11T23:29:14.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:29:13 smithi037 ceph-mon[30630]: pgmap v695: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 4.6 MiB/s wr, 529 op/s 2024-09-11T23:29:14.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 595.0 s, 501.8 tps, lat 204.092 ms stddev 223.142 2024-09-11T23:29:16.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:29:15 smithi160 ceph-mon[35055]: pgmap v696: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 5.5 MiB/s wr, 540 op/s 2024-09-11T23:29:16.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:29:15 smithi123 ceph-mon[35438]: pgmap v696: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 5.5 MiB/s wr, 540 op/s 2024-09-11T23:29:16.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:29:15 smithi037 ceph-mon[30630]: pgmap v696: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 5.5 MiB/s wr, 540 op/s 2024-09-11T23:29:18.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:29:17 smithi123 ceph-mon[35438]: pgmap v697: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 6.2 MiB/s wr, 539 op/s 2024-09-11T23:29:18.316 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:29:17 smithi037 ceph-mon[30630]: pgmap v697: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 6.2 MiB/s wr, 539 op/s 2024-09-11T23:29:18.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:29:17 smithi160 ceph-mon[35055]: pgmap v697: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 6.2 MiB/s wr, 539 op/s 2024-09-11T23:29:19.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 600.0 s, 453.8 tps, lat 225.894 ms stddev 312.593 2024-09-11T23:29:20.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:29:19 smithi123 ceph-mon[35438]: pgmap v698: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 6.6 MiB/s wr, 545 op/s 2024-09-11T23:29:20.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:29:19 smithi037 ceph-mon[30630]: pgmap v698: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 6.6 MiB/s wr, 545 op/s 2024-09-11T23:29:20.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:29:19 smithi160 ceph-mon[35055]: pgmap v698: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 6.6 MiB/s wr, 545 op/s 2024-09-11T23:29:22.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:29:21 smithi123 ceph-mon[35438]: pgmap v699: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 6.7 MiB/s wr, 543 op/s 2024-09-11T23:29:22.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:29:21 smithi037 ceph-mon[30630]: pgmap v699: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 6.7 MiB/s wr, 543 op/s 2024-09-11T23:29:22.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:29:21 smithi160 ceph-mon[35055]: pgmap v699: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 6.7 MiB/s wr, 543 op/s 2024-09-11T23:29:24.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:29:23 smithi123 ceph-mon[35438]: pgmap v700: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 8.3 MiB/s wr, 554 op/s 2024-09-11T23:29:24.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:29:23 smithi037 ceph-mon[30630]: pgmap v700: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 8.3 MiB/s wr, 554 op/s 2024-09-11T23:29:24.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:29:23 smithi160 ceph-mon[35055]: pgmap v700: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 8.3 MiB/s wr, 554 op/s 2024-09-11T23:29:24.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 605.0 s, 578.6 tps, lat 164.030 ms stddev 175.803 2024-09-11T23:29:26.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:29:25 smithi123 ceph-mon[35438]: pgmap v701: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 9.3 MiB/s wr, 570 op/s 2024-09-11T23:29:26.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:29:25 smithi037 ceph-mon[30630]: pgmap v701: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 9.3 MiB/s wr, 570 op/s 2024-09-11T23:29:26.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:29:25 smithi160 ceph-mon[35055]: pgmap v701: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 9.3 MiB/s wr, 570 op/s 2024-09-11T23:29:28.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:29:27 smithi123 ceph-mon[35438]: pgmap v702: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 8.8 MiB/s wr, 574 op/s 2024-09-11T23:29:28.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:29:27 smithi037 ceph-mon[30630]: pgmap v702: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 8.8 MiB/s wr, 574 op/s 2024-09-11T23:29:28.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:29:27 smithi160 ceph-mon[35055]: pgmap v702: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 8.8 MiB/s wr, 574 op/s 2024-09-11T23:29:29.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 610.0 s, 577.0 tps, lat 177.132 ms stddev 212.906 2024-09-11T23:29:30.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:29:30 smithi037 ceph-mon[30630]: pgmap v703: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 7.8 MiB/s wr, 505 op/s 2024-09-11T23:29:30.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:29:30 smithi160 ceph-mon[35055]: pgmap v703: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 7.8 MiB/s wr, 505 op/s 2024-09-11T23:29:30.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:29:30 smithi123 ceph-mon[35438]: pgmap v703: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 7.8 MiB/s wr, 505 op/s 2024-09-11T23:29:32.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:29:32 smithi037 ceph-mon[30630]: pgmap v704: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 8.1 MiB/s wr, 509 op/s 2024-09-11T23:29:32.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:29:32 smithi160 ceph-mon[35055]: pgmap v704: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 8.1 MiB/s wr, 509 op/s 2024-09-11T23:29:32.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:29:32 smithi123 ceph-mon[35438]: pgmap v704: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 8.1 MiB/s wr, 509 op/s 2024-09-11T23:29:34.317 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:29:34 smithi037 ceph-mon[30630]: pgmap v705: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 8.9 MiB/s wr, 512 op/s 2024-09-11T23:29:34.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:29:34 smithi160 ceph-mon[35055]: pgmap v705: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 8.9 MiB/s wr, 512 op/s 2024-09-11T23:29:34.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:29:34 smithi123 ceph-mon[35438]: pgmap v705: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 8.9 MiB/s wr, 512 op/s 2024-09-11T23:29:34.826 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 615.0 s, 510.7 tps, lat 196.824 ms stddev 237.390 2024-09-11T23:29:36.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:29:36 smithi037 ceph-mon[30630]: pgmap v706: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 8.5 MiB/s wr, 519 op/s 2024-09-11T23:29:36.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:29:36 smithi160 ceph-mon[35055]: pgmap v706: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 8.5 MiB/s wr, 519 op/s 2024-09-11T23:29:36.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:29:36 smithi123 ceph-mon[35438]: pgmap v706: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 8.5 MiB/s wr, 519 op/s 2024-09-11T23:29:38.321 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:29:38 smithi037 ceph-mon[30630]: pgmap v707: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 7.7 MiB/s wr, 519 op/s 2024-09-11T23:29:38.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:29:38 smithi160 ceph-mon[35055]: pgmap v707: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 7.7 MiB/s wr, 519 op/s 2024-09-11T23:29:38.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:29:38 smithi123 ceph-mon[35438]: pgmap v707: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 7.7 MiB/s wr, 519 op/s 2024-09-11T23:29:39.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 620.0 s, 561.5 tps, lat 178.043 ms stddev 222.973 2024-09-11T23:29:40.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:29:40 smithi037 ceph-mon[30630]: pgmap v708: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.1 MiB/s wr, 450 op/s 2024-09-11T23:29:40.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:29:40 smithi160 ceph-mon[35055]: pgmap v708: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.1 MiB/s wr, 450 op/s 2024-09-11T23:29:40.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:29:40 smithi123 ceph-mon[35438]: pgmap v708: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.1 MiB/s wr, 450 op/s 2024-09-11T23:29:42.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:29:42 smithi037 ceph-mon[30630]: pgmap v709: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 8.4 MiB/s wr, 509 op/s 2024-09-11T23:29:42.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:29:42 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:29:42.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:29:42 smithi160 ceph-mon[35055]: pgmap v709: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 8.4 MiB/s wr, 509 op/s 2024-09-11T23:29:42.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:29:42 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:29:42.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:29:42 smithi123 ceph-mon[35438]: pgmap v709: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 8.4 MiB/s wr, 509 op/s 2024-09-11T23:29:42.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:29:42 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:29:43.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:29:43 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:29:43.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:29:43 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:29:43.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:29:43 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:29:43.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:29:43 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:29:43.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:29:43 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:29:43.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:29:43 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:29:44.402 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:29:44 smithi123 ceph-mon[35438]: pgmap v710: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 7.7 MiB/s wr, 514 op/s 2024-09-11T23:29:44.402 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:29:44 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:29:44.402 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:29:44 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:29:44.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:29:44 smithi160 ceph-mon[35055]: pgmap v710: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 7.7 MiB/s wr, 514 op/s 2024-09-11T23:29:44.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:29:44 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:29:44.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:29:44 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:29:44.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:29:44 smithi037 ceph-mon[30630]: pgmap v710: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 7.7 MiB/s wr, 514 op/s 2024-09-11T23:29:44.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:29:44 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:29:44.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:29:44 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:29:44.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 625.0 s, 556.0 tps, lat 180.184 ms stddev 224.046 2024-09-11T23:29:46.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:29:46 smithi160 ceph-mon[35055]: pgmap v711: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 7.4 MiB/s wr, 530 op/s 2024-09-11T23:29:46.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:29:46 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:29:46.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:29:46 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:29:46.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:29:46 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:29:46.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:29:46 smithi123 ceph-mon[35438]: pgmap v711: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 7.4 MiB/s wr, 530 op/s 2024-09-11T23:29:46.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:29:46 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:29:46.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:29:46 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:29:46.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:29:46 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:29:46.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:29:46 smithi037 ceph-mon[30630]: pgmap v711: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 7.4 MiB/s wr, 530 op/s 2024-09-11T23:29:46.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:29:46 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:29:46.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:29:46 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:29:46.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:29:46 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:29:48.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:29:48 smithi160 ceph-mon[35055]: pgmap v712: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 7.8 MiB/s wr, 556 op/s 2024-09-11T23:29:48.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:29:48 smithi123 ceph-mon[35438]: pgmap v712: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 7.8 MiB/s wr, 556 op/s 2024-09-11T23:29:48.566 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:29:48 smithi037 ceph-mon[30630]: pgmap v712: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 7.8 MiB/s wr, 556 op/s 2024-09-11T23:29:49.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 630.0 s, 516.2 tps, lat 193.745 ms stddev 214.684 2024-09-11T23:29:50.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:29:50 smithi160 ceph-mon[35055]: pgmap v713: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 6.8 MiB/s wr, 464 op/s 2024-09-11T23:29:50.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:29:50 smithi123 ceph-mon[35438]: pgmap v713: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 6.8 MiB/s wr, 464 op/s 2024-09-11T23:29:50.566 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:29:50 smithi037 ceph-mon[30630]: pgmap v713: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 6.8 MiB/s wr, 464 op/s 2024-09-11T23:29:52.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:29:52 smithi160 ceph-mon[35055]: pgmap v714: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 7.9 MiB/s wr, 534 op/s 2024-09-11T23:29:52.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:29:52 smithi123 ceph-mon[35438]: pgmap v714: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 7.9 MiB/s wr, 534 op/s 2024-09-11T23:29:52.566 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:29:52 smithi037 ceph-mon[30630]: pgmap v714: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 7.9 MiB/s wr, 534 op/s 2024-09-11T23:29:54.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:29:54 smithi160 ceph-mon[35055]: pgmap v715: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 6.7 MiB/s wr, 524 op/s 2024-09-11T23:29:54.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:29:54 smithi123 ceph-mon[35438]: pgmap v715: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 6.7 MiB/s wr, 524 op/s 2024-09-11T23:29:54.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:29:54 smithi037 ceph-mon[30630]: pgmap v715: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 6.7 MiB/s wr, 524 op/s 2024-09-11T23:29:54.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 635.0 s, 480.6 tps, lat 206.087 ms stddev 235.170 2024-09-11T23:29:56.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:29:56 smithi160 ceph-mon[35055]: pgmap v716: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 7.7 MiB/s wr, 533 op/s 2024-09-11T23:29:56.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:29:56 smithi123 ceph-mon[35438]: pgmap v716: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 7.7 MiB/s wr, 533 op/s 2024-09-11T23:29:56.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:29:56 smithi037 ceph-mon[30630]: pgmap v716: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 7.7 MiB/s wr, 533 op/s 2024-09-11T23:29:58.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:29:58 smithi123 ceph-mon[35438]: pgmap v717: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 7.5 MiB/s wr, 544 op/s 2024-09-11T23:29:58.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:29:58 smithi037 ceph-mon[30630]: pgmap v717: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 7.5 MiB/s wr, 544 op/s 2024-09-11T23:29:58.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:29:58 smithi160 ceph-mon[35055]: pgmap v717: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 7.5 MiB/s wr, 544 op/s 2024-09-11T23:29:59.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 640.0 s, 505.2 tps, lat 197.577 ms stddev 221.786 2024-09-11T23:30:00.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:30:00 smithi123 ceph-mon[35438]: pgmap v718: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 5.3 MiB/s wr, 429 op/s 2024-09-11T23:30:00.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:30:00 smithi123 ceph-mon[35438]: overall HEALTH_OK 2024-09-11T23:30:00.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:30:00 smithi037 ceph-mon[30630]: pgmap v718: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 5.3 MiB/s wr, 429 op/s 2024-09-11T23:30:00.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:30:00 smithi037 ceph-mon[30630]: overall HEALTH_OK 2024-09-11T23:30:00.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:30:00 smithi160 ceph-mon[35055]: pgmap v718: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 5.3 MiB/s wr, 429 op/s 2024-09-11T23:30:00.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:30:00 smithi160 ceph-mon[35055]: overall HEALTH_OK 2024-09-11T23:30:02.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:30:02 smithi123 ceph-mon[35438]: pgmap v719: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 7.0 MiB/s wr, 520 op/s 2024-09-11T23:30:02.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:30:02 smithi037 ceph-mon[30630]: pgmap v719: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 7.0 MiB/s wr, 520 op/s 2024-09-11T23:30:02.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:30:02 smithi160 ceph-mon[35055]: pgmap v719: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 7.0 MiB/s wr, 520 op/s 2024-09-11T23:30:04.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:30:04 smithi123 ceph-mon[35438]: pgmap v720: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 6.3 MiB/s wr, 505 op/s 2024-09-11T23:30:04.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:30:04 smithi037 ceph-mon[30630]: pgmap v720: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 6.3 MiB/s wr, 505 op/s 2024-09-11T23:30:04.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:30:04 smithi160 ceph-mon[35055]: pgmap v720: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 6.3 MiB/s wr, 505 op/s 2024-09-11T23:30:04.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 645.0 s, 492.8 tps, lat 203.856 ms stddev 261.183 2024-09-11T23:30:06.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:30:06 smithi123 ceph-mon[35438]: pgmap v721: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 6.6 MiB/s wr, 509 op/s 2024-09-11T23:30:06.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:30:06 smithi037 ceph-mon[30630]: pgmap v721: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 6.6 MiB/s wr, 509 op/s 2024-09-11T23:30:06.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:30:06 smithi160 ceph-mon[35055]: pgmap v721: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 6.6 MiB/s wr, 509 op/s 2024-09-11T23:30:08.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:30:08 smithi123 ceph-mon[35438]: pgmap v722: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 5.5 MiB/s wr, 473 op/s 2024-09-11T23:30:08.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:30:08 smithi037 ceph-mon[30630]: pgmap v722: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 5.5 MiB/s wr, 473 op/s 2024-09-11T23:30:08.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:30:08 smithi160 ceph-mon[35055]: pgmap v722: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 5.5 MiB/s wr, 473 op/s 2024-09-11T23:30:09.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 650.0 s, 514.6 tps, lat 197.781 ms stddev 218.828 2024-09-11T23:30:10.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:30:10 smithi123 ceph-mon[35438]: pgmap v723: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 5.6 MiB/s wr, 420 op/s 2024-09-11T23:30:10.566 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:30:10 smithi037 ceph-mon[30630]: pgmap v723: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 5.6 MiB/s wr, 420 op/s 2024-09-11T23:30:10.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:30:10 smithi160 ceph-mon[35055]: pgmap v723: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 5.6 MiB/s wr, 420 op/s 2024-09-11T23:30:12.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:30:12 smithi123 ceph-mon[35438]: pgmap v724: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.3 MiB/s wr, 519 op/s 2024-09-11T23:30:12.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:30:12 smithi037 ceph-mon[30630]: pgmap v724: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.3 MiB/s wr, 519 op/s 2024-09-11T23:30:12.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:30:12 smithi160 ceph-mon[35055]: pgmap v724: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.3 MiB/s wr, 519 op/s 2024-09-11T23:30:14.567 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:30:14 smithi037 ceph-mon[30630]: pgmap v725: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.1 MiB/s wr, 496 op/s 2024-09-11T23:30:14.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:30:14 smithi160 ceph-mon[35055]: pgmap v725: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.1 MiB/s wr, 496 op/s 2024-09-11T23:30:14.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:30:14 smithi123 ceph-mon[35438]: pgmap v725: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.1 MiB/s wr, 496 op/s 2024-09-11T23:30:14.826 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 655.0 s, 517.8 tps, lat 192.396 ms stddev 217.467 2024-09-11T23:30:16.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:30:16 smithi037 ceph-mon[30630]: pgmap v726: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 6.6 MiB/s wr, 504 op/s 2024-09-11T23:30:16.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:30:16 smithi160 ceph-mon[35055]: pgmap v726: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 6.6 MiB/s wr, 504 op/s 2024-09-11T23:30:16.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:30:16 smithi123 ceph-mon[35438]: pgmap v726: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 6.6 MiB/s wr, 504 op/s 2024-09-11T23:30:18.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:30:18 smithi037 ceph-mon[30630]: pgmap v727: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 6.5 MiB/s wr, 499 op/s 2024-09-11T23:30:18.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:30:18 smithi160 ceph-mon[35055]: pgmap v727: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 6.5 MiB/s wr, 499 op/s 2024-09-11T23:30:18.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:30:18 smithi123 ceph-mon[35438]: pgmap v727: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 6.5 MiB/s wr, 499 op/s 2024-09-11T23:30:19.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 660.0 s, 625.6 tps, lat 159.490 ms stddev 184.535 2024-09-11T23:30:20.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:30:20 smithi037 ceph-mon[30630]: pgmap v728: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 6.5 MiB/s wr, 497 op/s 2024-09-11T23:30:20.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:30:20 smithi160 ceph-mon[35055]: pgmap v728: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 6.5 MiB/s wr, 497 op/s 2024-09-11T23:30:20.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:30:20 smithi123 ceph-mon[35438]: pgmap v728: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 6.5 MiB/s wr, 497 op/s 2024-09-11T23:30:22.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:30:22 smithi037 ceph-mon[30630]: pgmap v729: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 7.2 MiB/s wr, 541 op/s 2024-09-11T23:30:22.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:30:22 smithi160 ceph-mon[35055]: pgmap v729: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 7.2 MiB/s wr, 541 op/s 2024-09-11T23:30:22.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:30:22 smithi123 ceph-mon[35438]: pgmap v729: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 7.2 MiB/s wr, 541 op/s 2024-09-11T23:30:24.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:30:24 smithi037 ceph-mon[30630]: pgmap v730: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 6.1 MiB/s wr, 515 op/s 2024-09-11T23:30:24.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:30:24 smithi160 ceph-mon[35055]: pgmap v730: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 6.1 MiB/s wr, 515 op/s 2024-09-11T23:30:24.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:30:24 smithi123 ceph-mon[35438]: pgmap v730: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 6.1 MiB/s wr, 515 op/s 2024-09-11T23:30:24.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 665.0 s, 627.6 tps, lat 162.035 ms stddev 174.341 2024-09-11T23:30:26.567 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:30:26 smithi037 ceph-mon[30630]: pgmap v731: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 7.4 MiB/s wr, 542 op/s 2024-09-11T23:30:26.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:30:26 smithi160 ceph-mon[35055]: pgmap v731: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 7.4 MiB/s wr, 542 op/s 2024-09-11T23:30:26.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:30:26 smithi123 ceph-mon[35438]: pgmap v731: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 7.4 MiB/s wr, 542 op/s 2024-09-11T23:30:28.620 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:30:28 smithi160 ceph-mon[35055]: pgmap v732: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.9 MiB/s wr, 525 op/s 2024-09-11T23:30:28.884 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:30:28 smithi037 ceph-mon[30630]: pgmap v732: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.9 MiB/s wr, 525 op/s 2024-09-11T23:30:28.884 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:30:28 smithi123 ceph-mon[35438]: pgmap v732: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.9 MiB/s wr, 525 op/s 2024-09-11T23:30:29.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 670.0 s, 613.6 tps, lat 156.731 ms stddev 184.819 2024-09-11T23:30:30.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:30:30 smithi160 ceph-mon[35055]: pgmap v733: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.5 MiB/s wr, 507 op/s 2024-09-11T23:30:30.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:30:30 smithi123 ceph-mon[35438]: pgmap v733: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.5 MiB/s wr, 507 op/s 2024-09-11T23:30:30.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:30:30 smithi037 ceph-mon[30630]: pgmap v733: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.5 MiB/s wr, 507 op/s 2024-09-11T23:30:31.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:30:31 smithi160 ceph-mon[35055]: pgmap v734: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 7.5 MiB/s wr, 541 op/s 2024-09-11T23:30:31.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:30:31 smithi123 ceph-mon[35438]: pgmap v734: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 7.5 MiB/s wr, 541 op/s 2024-09-11T23:30:31.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:30:31 smithi037 ceph-mon[30630]: pgmap v734: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 7.5 MiB/s wr, 541 op/s 2024-09-11T23:30:33.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:30:33 smithi037 ceph-mon[30630]: pgmap v735: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.7 MiB/s wr, 537 op/s 2024-09-11T23:30:33.933 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:30:33 smithi160 ceph-mon[35055]: pgmap v735: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.7 MiB/s wr, 537 op/s 2024-09-11T23:30:34.000 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:30:33 smithi123 ceph-mon[35438]: pgmap v735: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.7 MiB/s wr, 537 op/s 2024-09-11T23:30:34.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 675.0 s, 532.4 tps, lat 191.299 ms stddev 231.869 2024-09-11T23:30:35.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:30:35 smithi037 ceph-mon[30630]: pgmap v736: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.8 MiB/s wr, 545 op/s 2024-09-11T23:30:35.933 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:30:35 smithi160 ceph-mon[35055]: pgmap v736: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.8 MiB/s wr, 545 op/s 2024-09-11T23:30:36.000 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:30:35 smithi123 ceph-mon[35438]: pgmap v736: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.8 MiB/s wr, 545 op/s 2024-09-11T23:30:37.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:30:37 smithi037 ceph-mon[30630]: pgmap v737: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.2 MiB/s wr, 527 op/s 2024-09-11T23:30:37.933 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:30:37 smithi160 ceph-mon[35055]: pgmap v737: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.2 MiB/s wr, 527 op/s 2024-09-11T23:30:38.000 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:30:37 smithi123 ceph-mon[35438]: pgmap v737: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.2 MiB/s wr, 527 op/s 2024-09-11T23:30:39.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:30:39 smithi037 ceph-mon[30630]: pgmap v738: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 6.0 MiB/s wr, 514 op/s 2024-09-11T23:30:39.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 680.0 s, 537.0 tps, lat 185.769 ms stddev 246.873 2024-09-11T23:30:39.933 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:30:39 smithi160 ceph-mon[35055]: pgmap v738: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 6.0 MiB/s wr, 514 op/s 2024-09-11T23:30:40.000 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:30:39 smithi123 ceph-mon[35438]: pgmap v738: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 6.0 MiB/s wr, 514 op/s 2024-09-11T23:30:41.933 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:30:41 smithi160 ceph-mon[35055]: pgmap v739: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 6.4 MiB/s wr, 535 op/s 2024-09-11T23:30:42.000 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:30:41 smithi123 ceph-mon[35438]: pgmap v739: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 6.4 MiB/s wr, 535 op/s 2024-09-11T23:30:42.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:30:41 smithi037 ceph-mon[30630]: pgmap v739: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 6.4 MiB/s wr, 535 op/s 2024-09-11T23:30:43.933 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:30:43 smithi160 ceph-mon[35055]: pgmap v740: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.9 MiB/s wr, 530 op/s 2024-09-11T23:30:44.000 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:30:43 smithi123 ceph-mon[35438]: pgmap v740: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.9 MiB/s wr, 530 op/s 2024-09-11T23:30:44.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:30:43 smithi037 ceph-mon[30630]: pgmap v740: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.9 MiB/s wr, 530 op/s 2024-09-11T23:30:44.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 685.0 s, 513.0 tps, lat 197.873 ms stddev 249.212 2024-09-11T23:30:45.933 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:30:45 smithi160 ceph-mon[35055]: pgmap v741: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 6.2 MiB/s wr, 541 op/s 2024-09-11T23:30:46.002 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:30:45 smithi123 ceph-mon[35438]: pgmap v741: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 6.2 MiB/s wr, 541 op/s 2024-09-11T23:30:46.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:30:45 smithi037 ceph-mon[30630]: pgmap v741: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 6.2 MiB/s wr, 541 op/s 2024-09-11T23:30:46.933 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:30:46 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:30:46.933 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:30:46 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:30:46.933 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:30:46 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:30:47.000 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:30:46 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:30:47.000 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:30:46 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:30:47.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:30:46 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:30:47.066 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:30:46 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:30:47.066 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:30:46 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:30:47.067 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:30:46 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:30:48.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:30:48 smithi037 ceph-mon[30630]: pgmap v742: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 6.3 MiB/s wr, 538 op/s 2024-09-11T23:30:48.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:30:48 smithi160 ceph-mon[35055]: pgmap v742: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 6.3 MiB/s wr, 538 op/s 2024-09-11T23:30:48.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:30:48 smithi123 ceph-mon[35438]: pgmap v742: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 6.3 MiB/s wr, 538 op/s 2024-09-11T23:30:49.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:30:49 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:30:49.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:30:49 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:30:49.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:30:49 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:30:49.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:30:49 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:30:49.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:30:49 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:30:49.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:30:49 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:30:49.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:30:49 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:30:49.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:30:49 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:30:49.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:30:49 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:30:49.828 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 690.0 s, 497.3 tps, lat 198.249 ms stddev 229.699 2024-09-11T23:30:50.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:30:50 smithi037 ceph-mon[30630]: pgmap v743: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 5.5 MiB/s wr, 522 op/s 2024-09-11T23:30:50.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:30:50 smithi160 ceph-mon[35055]: pgmap v743: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 5.5 MiB/s wr, 522 op/s 2024-09-11T23:30:50.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:30:50 smithi123 ceph-mon[35438]: pgmap v743: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 5.5 MiB/s wr, 522 op/s 2024-09-11T23:30:52.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:30:52 smithi037 ceph-mon[30630]: pgmap v744: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 6.1 MiB/s wr, 543 op/s 2024-09-11T23:30:52.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:30:52 smithi160 ceph-mon[35055]: pgmap v744: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 6.1 MiB/s wr, 543 op/s 2024-09-11T23:30:52.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:30:52 smithi123 ceph-mon[35438]: pgmap v744: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 6.1 MiB/s wr, 543 op/s 2024-09-11T23:30:54.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:30:54 smithi037 ceph-mon[30630]: pgmap v745: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.7 MiB/s wr, 537 op/s 2024-09-11T23:30:54.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:30:54 smithi160 ceph-mon[35055]: pgmap v745: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.7 MiB/s wr, 537 op/s 2024-09-11T23:30:54.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:30:54 smithi123 ceph-mon[35438]: pgmap v745: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.7 MiB/s wr, 537 op/s 2024-09-11T23:30:54.826 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 695.0 s, 476.8 tps, lat 214.257 ms stddev 267.839 2024-09-11T23:30:56.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:30:56 smithi037 ceph-mon[30630]: pgmap v746: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 5.9 MiB/s wr, 545 op/s 2024-09-11T23:30:56.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:30:56 smithi160 ceph-mon[35055]: pgmap v746: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 5.9 MiB/s wr, 545 op/s 2024-09-11T23:30:56.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:30:56 smithi123 ceph-mon[35438]: pgmap v746: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 5.9 MiB/s wr, 545 op/s 2024-09-11T23:30:58.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:30:58 smithi037 ceph-mon[30630]: pgmap v747: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 5.5 MiB/s wr, 509 op/s 2024-09-11T23:30:58.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:30:58 smithi160 ceph-mon[35055]: pgmap v747: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 5.5 MiB/s wr, 509 op/s 2024-09-11T23:30:58.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:30:58 smithi123 ceph-mon[35438]: pgmap v747: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 5.5 MiB/s wr, 509 op/s 2024-09-11T23:30:59.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 700.0 s, 587.9 tps, lat 169.368 ms stddev 204.497 2024-09-11T23:31:00.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:31:00 smithi160 ceph-mon[35055]: pgmap v748: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.6 MiB/s wr, 505 op/s 2024-09-11T23:31:00.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:31:00 smithi123 ceph-mon[35438]: pgmap v748: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.6 MiB/s wr, 505 op/s 2024-09-11T23:31:00.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:31:00 smithi037 ceph-mon[30630]: pgmap v748: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.6 MiB/s wr, 505 op/s 2024-09-11T23:31:02.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:31:02 smithi160 ceph-mon[35055]: pgmap v749: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.3 MiB/s wr, 536 op/s 2024-09-11T23:31:02.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:31:02 smithi123 ceph-mon[35438]: pgmap v749: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.3 MiB/s wr, 536 op/s 2024-09-11T23:31:02.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:31:02 smithi037 ceph-mon[30630]: pgmap v749: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.3 MiB/s wr, 536 op/s 2024-09-11T23:31:04.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:31:04 smithi160 ceph-mon[35055]: pgmap v750: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.6 MiB/s wr, 516 op/s 2024-09-11T23:31:04.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:31:04 smithi123 ceph-mon[35438]: pgmap v750: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.6 MiB/s wr, 516 op/s 2024-09-11T23:31:04.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:31:04 smithi037 ceph-mon[30630]: pgmap v750: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.6 MiB/s wr, 516 op/s 2024-09-11T23:31:04.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 705.0 s, 599.8 tps, lat 166.138 ms stddev 213.849 2024-09-11T23:31:06.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:31:06 smithi160 ceph-mon[35055]: pgmap v751: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.0 MiB/s wr, 585 op/s 2024-09-11T23:31:06.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:31:06 smithi123 ceph-mon[35438]: pgmap v751: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.0 MiB/s wr, 585 op/s 2024-09-11T23:31:06.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:31:06 smithi037 ceph-mon[30630]: pgmap v751: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.0 MiB/s wr, 585 op/s 2024-09-11T23:31:08.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:31:08 smithi160 ceph-mon[35055]: pgmap v752: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.3 MiB/s wr, 556 op/s 2024-09-11T23:31:08.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:31:08 smithi123 ceph-mon[35438]: pgmap v752: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.3 MiB/s wr, 556 op/s 2024-09-11T23:31:08.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:31:08 smithi037 ceph-mon[30630]: pgmap v752: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.3 MiB/s wr, 556 op/s 2024-09-11T23:31:09.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 710.0 s, 469.8 tps, lat 208.229 ms stddev 257.817 2024-09-11T23:31:10.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:31:10 smithi160 ceph-mon[35055]: pgmap v753: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 6.0 MiB/s wr, 546 op/s 2024-09-11T23:31:10.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:31:10 smithi123 ceph-mon[35438]: pgmap v753: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 6.0 MiB/s wr, 546 op/s 2024-09-11T23:31:10.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:31:10 smithi037 ceph-mon[30630]: pgmap v753: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 6.0 MiB/s wr, 546 op/s 2024-09-11T23:31:12.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:31:12 smithi160 ceph-mon[35055]: pgmap v754: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.8 MiB/s wr, 552 op/s 2024-09-11T23:31:12.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:31:12 smithi123 ceph-mon[35438]: pgmap v754: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.8 MiB/s wr, 552 op/s 2024-09-11T23:31:12.566 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:31:12 smithi037 ceph-mon[30630]: pgmap v754: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.8 MiB/s wr, 552 op/s 2024-09-11T23:31:14.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:31:14 smithi160 ceph-mon[35055]: pgmap v755: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 5.5 MiB/s wr, 512 op/s 2024-09-11T23:31:14.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:31:14 smithi123 ceph-mon[35438]: pgmap v755: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 5.5 MiB/s wr, 512 op/s 2024-09-11T23:31:14.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:31:14 smithi037 ceph-mon[30630]: pgmap v755: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 5.5 MiB/s wr, 512 op/s 2024-09-11T23:31:14.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 715.0 s, 664.4 tps, lat 158.022 ms stddev 213.009 2024-09-11T23:31:16.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:31:16 smithi160 ceph-mon[35055]: pgmap v756: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.4 MiB/s wr, 586 op/s 2024-09-11T23:31:16.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:31:16 smithi123 ceph-mon[35438]: pgmap v756: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.4 MiB/s wr, 586 op/s 2024-09-11T23:31:16.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:31:16 smithi037 ceph-mon[30630]: pgmap v756: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.4 MiB/s wr, 586 op/s 2024-09-11T23:31:18.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:31:18 smithi123 ceph-mon[35438]: pgmap v757: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 5.5 MiB/s wr, 523 op/s 2024-09-11T23:31:18.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:31:18 smithi037 ceph-mon[30630]: pgmap v757: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 5.5 MiB/s wr, 523 op/s 2024-09-11T23:31:18.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:31:18 smithi160 ceph-mon[35055]: pgmap v757: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 5.5 MiB/s wr, 523 op/s 2024-09-11T23:31:19.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 720.0 s, 478.8 tps, lat 199.508 ms stddev 228.486 2024-09-11T23:31:20.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:31:20 smithi123 ceph-mon[35438]: pgmap v758: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 5.7 MiB/s wr, 535 op/s 2024-09-11T23:31:20.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:31:20 smithi037 ceph-mon[30630]: pgmap v758: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 5.7 MiB/s wr, 535 op/s 2024-09-11T23:31:20.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:31:20 smithi160 ceph-mon[35055]: pgmap v758: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 5.7 MiB/s wr, 535 op/s 2024-09-11T23:31:22.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:31:22 smithi123 ceph-mon[35438]: pgmap v759: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 6.3 MiB/s wr, 599 op/s 2024-09-11T23:31:22.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:31:22 smithi037 ceph-mon[30630]: pgmap v759: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 6.3 MiB/s wr, 599 op/s 2024-09-11T23:31:22.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:31:22 smithi160 ceph-mon[35055]: pgmap v759: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 6.3 MiB/s wr, 599 op/s 2024-09-11T23:31:24.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:31:24 smithi123 ceph-mon[35438]: pgmap v760: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 6.3 MiB/s wr, 577 op/s 2024-09-11T23:31:24.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:31:24 smithi037 ceph-mon[30630]: pgmap v760: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 6.3 MiB/s wr, 577 op/s 2024-09-11T23:31:24.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:31:24 smithi160 ceph-mon[35055]: pgmap v760: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 6.3 MiB/s wr, 577 op/s 2024-09-11T23:31:24.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 725.0 s, 470.8 tps, lat 206.143 ms stddev 251.855 2024-09-11T23:31:26.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:31:26 smithi123 ceph-mon[35438]: pgmap v761: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 6.5 MiB/s wr, 640 op/s 2024-09-11T23:31:26.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:31:26 smithi037 ceph-mon[30630]: pgmap v761: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 6.5 MiB/s wr, 640 op/s 2024-09-11T23:31:26.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:31:26 smithi160 ceph-mon[35055]: pgmap v761: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 6.5 MiB/s wr, 640 op/s 2024-09-11T23:31:28.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:31:28 smithi123 ceph-mon[35438]: pgmap v762: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 5.6 MiB/s wr, 565 op/s 2024-09-11T23:31:28.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:31:28 smithi037 ceph-mon[30630]: pgmap v762: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 5.6 MiB/s wr, 565 op/s 2024-09-11T23:31:28.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:31:28 smithi160 ceph-mon[35055]: pgmap v762: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 5.6 MiB/s wr, 565 op/s 2024-09-11T23:31:29.826 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 730.0 s, 533.3 tps, lat 195.859 ms stddev 294.008 2024-09-11T23:31:30.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:31:30 smithi123 ceph-mon[35438]: pgmap v763: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 5.3 MiB/s wr, 545 op/s 2024-09-11T23:31:30.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:31:30 smithi037 ceph-mon[30630]: pgmap v763: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 5.3 MiB/s wr, 545 op/s 2024-09-11T23:31:30.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:31:30 smithi160 ceph-mon[35055]: pgmap v763: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 5.3 MiB/s wr, 545 op/s 2024-09-11T23:31:32.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:31:32 smithi123 ceph-mon[35438]: pgmap v764: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 5.6 MiB/s wr, 566 op/s 2024-09-11T23:31:32.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:31:32 smithi037 ceph-mon[30630]: pgmap v764: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 5.6 MiB/s wr, 566 op/s 2024-09-11T23:31:32.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:31:32 smithi160 ceph-mon[35055]: pgmap v764: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 5.6 MiB/s wr, 566 op/s 2024-09-11T23:31:34.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:31:34 smithi123 ceph-mon[35438]: pgmap v765: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 4.8 MiB/s wr, 490 op/s 2024-09-11T23:31:34.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:31:34 smithi037 ceph-mon[30630]: pgmap v765: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 4.8 MiB/s wr, 490 op/s 2024-09-11T23:31:34.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:31:34 smithi160 ceph-mon[35055]: pgmap v765: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 4.8 MiB/s wr, 490 op/s 2024-09-11T23:31:34.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 735.0 s, 495.9 tps, lat 200.821 ms stddev 221.552 2024-09-11T23:31:36.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:31:36 smithi037 ceph-mon[30630]: pgmap v766: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 5.2 MiB/s wr, 542 op/s 2024-09-11T23:31:36.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:31:36 smithi160 ceph-mon[35055]: pgmap v766: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 5.2 MiB/s wr, 542 op/s 2024-09-11T23:31:36.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:31:36 smithi123 ceph-mon[35438]: pgmap v766: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 5.2 MiB/s wr, 542 op/s 2024-09-11T23:31:38.569 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:31:38 smithi037 ceph-mon[30630]: pgmap v767: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 5.3 MiB/s wr, 499 op/s 2024-09-11T23:31:38.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:31:38 smithi160 ceph-mon[35055]: pgmap v767: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 5.3 MiB/s wr, 499 op/s 2024-09-11T23:31:38.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:31:38 smithi123 ceph-mon[35438]: pgmap v767: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 5.3 MiB/s wr, 499 op/s 2024-09-11T23:31:39.828 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 740.0 s, 500.1 tps, lat 197.095 ms stddev 231.447 2024-09-11T23:31:40.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:31:40 smithi037 ceph-mon[30630]: pgmap v768: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 5.2 MiB/s wr, 493 op/s 2024-09-11T23:31:40.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:31:40 smithi160 ceph-mon[35055]: pgmap v768: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 5.2 MiB/s wr, 493 op/s 2024-09-11T23:31:40.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:31:40 smithi123 ceph-mon[35438]: pgmap v768: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 5.2 MiB/s wr, 493 op/s 2024-09-11T23:31:42.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:31:42 smithi037 ceph-mon[30630]: pgmap v769: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 5.4 MiB/s wr, 525 op/s 2024-09-11T23:31:42.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:31:42 smithi160 ceph-mon[35055]: pgmap v769: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 5.4 MiB/s wr, 525 op/s 2024-09-11T23:31:42.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:31:42 smithi123 ceph-mon[35438]: pgmap v769: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 5.4 MiB/s wr, 525 op/s 2024-09-11T23:31:44.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:31:44 smithi037 ceph-mon[30630]: pgmap v770: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 4.8 MiB/s wr, 474 op/s 2024-09-11T23:31:44.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:31:44 smithi160 ceph-mon[35055]: pgmap v770: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 4.8 MiB/s wr, 474 op/s 2024-09-11T23:31:44.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:31:44 smithi123 ceph-mon[35438]: pgmap v770: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 4.8 MiB/s wr, 474 op/s 2024-09-11T23:31:44.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 745.0 s, 533.1 tps, lat 187.854 ms stddev 237.094 2024-09-11T23:31:46.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:31:46 smithi037 ceph-mon[30630]: pgmap v771: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 5.9 MiB/s wr, 554 op/s 2024-09-11T23:31:46.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:31:46 smithi160 ceph-mon[35055]: pgmap v771: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 5.9 MiB/s wr, 554 op/s 2024-09-11T23:31:46.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:31:46 smithi123 ceph-mon[35438]: pgmap v771: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 5.9 MiB/s wr, 554 op/s 2024-09-11T23:31:48.566 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:31:48 smithi037 ceph-mon[30630]: pgmap v772: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 5.3 MiB/s wr, 503 op/s 2024-09-11T23:31:48.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:31:48 smithi160 ceph-mon[35055]: pgmap v772: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 5.3 MiB/s wr, 503 op/s 2024-09-11T23:31:48.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:31:48 smithi123 ceph-mon[35438]: pgmap v772: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 5.3 MiB/s wr, 503 op/s 2024-09-11T23:31:49.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:31:49 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:31:49.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:31:49 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:31:49.815 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:31:49 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:31:49.826 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 750.0 s, 473.6 tps, lat 216.508 ms stddev 241.474 2024-09-11T23:31:50.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:31:50 smithi160 ceph-mon[35055]: pgmap v773: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 4.6 MiB/s wr, 477 op/s 2024-09-11T23:31:50.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:31:50 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:31:50.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:31:50 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:31:50.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:31:50 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:31:50.716 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:31:50 smithi037 ceph-mon[30630]: pgmap v773: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 4.6 MiB/s wr, 477 op/s 2024-09-11T23:31:50.716 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:31:50 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:31:50.716 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:31:50 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:31:50.716 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:31:50 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:31:50.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:31:50 smithi123 ceph-mon[35438]: pgmap v773: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 4.6 MiB/s wr, 477 op/s 2024-09-11T23:31:50.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:31:50 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:31:50.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:31:50 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:31:50.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:31:50 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:31:52.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:31:52 smithi160 ceph-mon[35055]: pgmap v774: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 4.9 MiB/s wr, 510 op/s 2024-09-11T23:31:52.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:31:52 smithi123 ceph-mon[35438]: pgmap v774: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 4.9 MiB/s wr, 510 op/s 2024-09-11T23:31:52.815 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:31:52 smithi037 ceph-mon[30630]: pgmap v774: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 4.9 MiB/s wr, 510 op/s 2024-09-11T23:31:54.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:31:54 smithi160 ceph-mon[35055]: pgmap v775: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 4.9 MiB/s wr, 477 op/s 2024-09-11T23:31:54.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:31:54 smithi123 ceph-mon[35438]: pgmap v775: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 4.9 MiB/s wr, 477 op/s 2024-09-11T23:31:54.816 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:31:54 smithi037 ceph-mon[30630]: pgmap v775: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 4.9 MiB/s wr, 477 op/s 2024-09-11T23:31:54.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 755.0 s, 529.4 tps, lat 183.839 ms stddev 214.685 2024-09-11T23:31:55.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:31:55 smithi160 ceph-mon[35055]: pgmap v776: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 5.5 MiB/s wr, 541 op/s 2024-09-11T23:31:55.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:31:55 smithi123 ceph-mon[35438]: pgmap v776: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 5.5 MiB/s wr, 541 op/s 2024-09-11T23:31:55.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:31:55 smithi037 ceph-mon[30630]: pgmap v776: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 5.5 MiB/s wr, 541 op/s 2024-09-11T23:31:57.933 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:31:57 smithi160 ceph-mon[35055]: pgmap v777: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 4.5 MiB/s wr, 482 op/s 2024-09-11T23:31:58.000 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:31:57 smithi123 ceph-mon[35438]: pgmap v777: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 4.5 MiB/s wr, 482 op/s 2024-09-11T23:31:58.066 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:31:57 smithi037 ceph-mon[30630]: pgmap v777: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 4.5 MiB/s wr, 482 op/s 2024-09-11T23:31:59.826 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 760.0 s, 520.0 tps, lat 196.319 ms stddev 244.174 2024-09-11T23:31:59.933 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:31:59 smithi160 ceph-mon[35055]: pgmap v778: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 4.5 MiB/s wr, 476 op/s 2024-09-11T23:32:00.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:31:59 smithi123 ceph-mon[35438]: pgmap v778: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 4.5 MiB/s wr, 476 op/s 2024-09-11T23:32:00.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:31:59 smithi037 ceph-mon[30630]: pgmap v778: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 4.5 MiB/s wr, 476 op/s 2024-09-11T23:32:02.000 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:32:01 smithi123 ceph-mon[35438]: pgmap v779: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 5.2 MiB/s wr, 526 op/s 2024-09-11T23:32:02.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:32:01 smithi037 ceph-mon[30630]: pgmap v779: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 5.2 MiB/s wr, 526 op/s 2024-09-11T23:32:02.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:32:01 smithi160 ceph-mon[35055]: pgmap v779: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 5.2 MiB/s wr, 526 op/s 2024-09-11T23:32:04.000 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:32:03 smithi123 ceph-mon[35438]: pgmap v780: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 5.0 MiB/s wr, 487 op/s 2024-09-11T23:32:04.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:32:03 smithi037 ceph-mon[30630]: pgmap v780: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 5.0 MiB/s wr, 487 op/s 2024-09-11T23:32:04.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:32:03 smithi160 ceph-mon[35055]: pgmap v780: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 5.0 MiB/s wr, 487 op/s 2024-09-11T23:32:04.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 765.0 s, 466.0 tps, lat 213.495 ms stddev 259.433 2024-09-11T23:32:06.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:32:05 smithi037 ceph-mon[30630]: pgmap v781: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 4.9 MiB/s wr, 538 op/s 2024-09-11T23:32:06.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:32:05 smithi160 ceph-mon[35055]: pgmap v781: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 4.9 MiB/s wr, 538 op/s 2024-09-11T23:32:06.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:32:05 smithi123 ceph-mon[35438]: pgmap v781: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 4.9 MiB/s wr, 538 op/s 2024-09-11T23:32:08.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:32:07 smithi037 ceph-mon[30630]: pgmap v782: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 4.6 MiB/s wr, 492 op/s 2024-09-11T23:32:08.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:32:07 smithi160 ceph-mon[35055]: pgmap v782: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 4.6 MiB/s wr, 492 op/s 2024-09-11T23:32:08.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:32:07 smithi123 ceph-mon[35438]: pgmap v782: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 4.6 MiB/s wr, 492 op/s 2024-09-11T23:32:09.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 770.0 s, 531.2 tps, lat 193.071 ms stddev 205.381 2024-09-11T23:32:10.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:32:09 smithi037 ceph-mon[30630]: pgmap v783: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 4.5 MiB/s wr, 470 op/s 2024-09-11T23:32:10.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:32:09 smithi160 ceph-mon[35055]: pgmap v783: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 4.5 MiB/s wr, 470 op/s 2024-09-11T23:32:10.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:32:09 smithi123 ceph-mon[35438]: pgmap v783: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 4.5 MiB/s wr, 470 op/s 2024-09-11T23:32:12.066 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:32:11 smithi037 ceph-mon[30630]: pgmap v784: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 4.9 MiB/s wr, 513 op/s 2024-09-11T23:32:12.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:32:11 smithi160 ceph-mon[35055]: pgmap v784: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 4.9 MiB/s wr, 513 op/s 2024-09-11T23:32:12.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:32:11 smithi123 ceph-mon[35438]: pgmap v784: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 4.9 MiB/s wr, 513 op/s 2024-09-11T23:32:14.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:32:13 smithi037 ceph-mon[30630]: pgmap v785: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 4.1 MiB/s wr, 454 op/s 2024-09-11T23:32:14.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:32:13 smithi160 ceph-mon[35055]: pgmap v785: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 4.1 MiB/s wr, 454 op/s 2024-09-11T23:32:14.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:32:13 smithi123 ceph-mon[35438]: pgmap v785: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 4.1 MiB/s wr, 454 op/s 2024-09-11T23:32:14.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 775.0 s, 699.4 tps, lat 142.449 ms stddev 163.962 2024-09-11T23:32:16.051 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:32:15 smithi123 ceph-mon[35438]: pgmap v786: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 298 KiB/s rd, 4.7 MiB/s wr, 527 op/s 2024-09-11T23:32:16.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:32:15 smithi037 ceph-mon[30630]: pgmap v786: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 298 KiB/s rd, 4.7 MiB/s wr, 527 op/s 2024-09-11T23:32:16.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:32:15 smithi160 ceph-mon[35055]: pgmap v786: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 298 KiB/s rd, 4.7 MiB/s wr, 527 op/s 2024-09-11T23:32:18.067 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:32:17 smithi037 ceph-mon[30630]: pgmap v787: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 4.8 MiB/s wr, 521 op/s 2024-09-11T23:32:18.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:32:17 smithi160 ceph-mon[35055]: pgmap v787: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 4.8 MiB/s wr, 521 op/s 2024-09-11T23:32:18.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:32:17 smithi123 ceph-mon[35438]: pgmap v787: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 4.8 MiB/s wr, 521 op/s 2024-09-11T23:32:19.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 780.0 s, 437.6 tps, lat 226.999 ms stddev 264.940 2024-09-11T23:32:20.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:32:19 smithi037 ceph-mon[30630]: pgmap v788: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 320 KiB/s rd, 4.6 MiB/s wr, 511 op/s 2024-09-11T23:32:20.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:32:19 smithi160 ceph-mon[35055]: pgmap v788: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 320 KiB/s rd, 4.6 MiB/s wr, 511 op/s 2024-09-11T23:32:20.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:32:19 smithi123 ceph-mon[35438]: pgmap v788: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 320 KiB/s rd, 4.6 MiB/s wr, 511 op/s 2024-09-11T23:32:22.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:32:21 smithi160 ceph-mon[35055]: pgmap v789: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 310 KiB/s rd, 5.8 MiB/s wr, 587 op/s 2024-09-11T23:32:22.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:32:21 smithi123 ceph-mon[35438]: pgmap v789: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 310 KiB/s rd, 5.8 MiB/s wr, 587 op/s 2024-09-11T23:32:22.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:32:21 smithi037 ceph-mon[30630]: pgmap v789: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 310 KiB/s rd, 5.8 MiB/s wr, 587 op/s 2024-09-11T23:32:24.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:32:23 smithi160 ceph-mon[35055]: pgmap v790: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 294 KiB/s rd, 5.3 MiB/s wr, 548 op/s 2024-09-11T23:32:24.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:32:23 smithi123 ceph-mon[35438]: pgmap v790: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 294 KiB/s rd, 5.3 MiB/s wr, 548 op/s 2024-09-11T23:32:24.316 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:32:23 smithi037 ceph-mon[30630]: pgmap v790: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 294 KiB/s rd, 5.3 MiB/s wr, 548 op/s 2024-09-11T23:32:24.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 785.0 s, 546.6 tps, lat 178.577 ms stddev 201.031 2024-09-11T23:32:26.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:32:25 smithi160 ceph-mon[35055]: pgmap v791: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 282 KiB/s rd, 6.2 MiB/s wr, 614 op/s 2024-09-11T23:32:26.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:32:25 smithi123 ceph-mon[35438]: pgmap v791: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 282 KiB/s rd, 6.2 MiB/s wr, 614 op/s 2024-09-11T23:32:26.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:32:25 smithi037 ceph-mon[30630]: pgmap v791: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 282 KiB/s rd, 6.2 MiB/s wr, 614 op/s 2024-09-11T23:32:28.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:32:27 smithi160 ceph-mon[35055]: pgmap v792: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 5.9 MiB/s wr, 580 op/s 2024-09-11T23:32:28.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:32:27 smithi123 ceph-mon[35438]: pgmap v792: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 5.9 MiB/s wr, 580 op/s 2024-09-11T23:32:28.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:32:27 smithi037 ceph-mon[30630]: pgmap v792: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 5.9 MiB/s wr, 580 op/s 2024-09-11T23:32:29.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 790.0 s, 487.4 tps, lat 208.195 ms stddev 243.409 2024-09-11T23:32:30.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:32:29 smithi160 ceph-mon[35055]: pgmap v793: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 5.3 MiB/s wr, 526 op/s 2024-09-11T23:32:30.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:32:29 smithi123 ceph-mon[35438]: pgmap v793: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 5.3 MiB/s wr, 526 op/s 2024-09-11T23:32:30.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:32:29 smithi037 ceph-mon[30630]: pgmap v793: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 5.3 MiB/s wr, 526 op/s 2024-09-11T23:32:32.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:32:31 smithi160 ceph-mon[35055]: pgmap v794: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 5.5 MiB/s wr, 560 op/s 2024-09-11T23:32:32.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:32:31 smithi123 ceph-mon[35438]: pgmap v794: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 5.5 MiB/s wr, 560 op/s 2024-09-11T23:32:32.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:32:31 smithi037 ceph-mon[30630]: pgmap v794: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 5.5 MiB/s wr, 560 op/s 2024-09-11T23:32:34.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:32:33 smithi160 ceph-mon[35055]: pgmap v795: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.6 MiB/s wr, 492 op/s 2024-09-11T23:32:34.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:32:33 smithi123 ceph-mon[35438]: pgmap v795: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.6 MiB/s wr, 492 op/s 2024-09-11T23:32:34.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:32:33 smithi037 ceph-mon[30630]: pgmap v795: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.6 MiB/s wr, 492 op/s 2024-09-11T23:32:34.826 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 795.0 s, 497.8 tps, lat 193.147 ms stddev 223.166 2024-09-11T23:32:36.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:32:35 smithi160 ceph-mon[35055]: pgmap v796: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.3 MiB/s wr, 616 op/s 2024-09-11T23:32:36.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:32:35 smithi123 ceph-mon[35438]: pgmap v796: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.3 MiB/s wr, 616 op/s 2024-09-11T23:32:36.316 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:32:35 smithi037 ceph-mon[30630]: pgmap v796: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.3 MiB/s wr, 616 op/s 2024-09-11T23:32:38.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:32:37 smithi123 ceph-mon[35438]: pgmap v797: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 6.5 MiB/s wr, 637 op/s 2024-09-11T23:32:38.403 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:32:37 smithi037 ceph-mon[30630]: pgmap v797: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 6.5 MiB/s wr, 637 op/s 2024-09-11T23:32:38.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:32:37 smithi160 ceph-mon[35055]: pgmap v797: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 6.5 MiB/s wr, 637 op/s 2024-09-11T23:32:39.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 800.0 s, 423.2 tps, lat 241.819 ms stddev 285.014 2024-09-11T23:32:40.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:32:39 smithi123 ceph-mon[35438]: pgmap v798: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 6.3 MiB/s wr, 596 op/s 2024-09-11T23:32:40.316 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:32:39 smithi037 ceph-mon[30630]: pgmap v798: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 6.3 MiB/s wr, 596 op/s 2024-09-11T23:32:40.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:32:39 smithi160 ceph-mon[35055]: pgmap v798: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 6.3 MiB/s wr, 596 op/s 2024-09-11T23:32:42.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:32:41 smithi123 ceph-mon[35438]: pgmap v799: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 9.8 MiB/s wr, 860 op/s 2024-09-11T23:32:42.316 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:32:41 smithi037 ceph-mon[30630]: pgmap v799: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 9.8 MiB/s wr, 860 op/s 2024-09-11T23:32:42.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:32:41 smithi160 ceph-mon[35055]: pgmap v799: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 9.8 MiB/s wr, 860 op/s 2024-09-11T23:32:44.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:32:43 smithi123 ceph-mon[35438]: pgmap v800: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 11 MiB/s wr, 903 op/s 2024-09-11T23:32:44.318 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:32:43 smithi037 ceph-mon[30630]: pgmap v800: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 11 MiB/s wr, 903 op/s 2024-09-11T23:32:44.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:32:43 smithi160 ceph-mon[35055]: pgmap v800: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 11 MiB/s wr, 903 op/s 2024-09-11T23:32:44.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 805.0 s, 494.8 tps, lat 198.890 ms stddev 260.887 2024-09-11T23:32:46.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:32:45 smithi123 ceph-mon[35438]: pgmap v801: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 11 MiB/s wr, 933 op/s 2024-09-11T23:32:46.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:32:45 smithi037 ceph-mon[30630]: pgmap v801: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 11 MiB/s wr, 933 op/s 2024-09-11T23:32:46.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:32:45 smithi160 ceph-mon[35055]: pgmap v801: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 11 MiB/s wr, 933 op/s 2024-09-11T23:32:48.235 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:32:47 smithi160 ceph-mon[35055]: pgmap v802: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 9.3 MiB/s wr, 829 op/s 2024-09-11T23:32:48.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:32:47 smithi123 ceph-mon[35438]: pgmap v802: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 9.3 MiB/s wr, 829 op/s 2024-09-11T23:32:48.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:32:47 smithi037 ceph-mon[30630]: pgmap v802: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 9.3 MiB/s wr, 829 op/s 2024-09-11T23:32:49.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 810.0 s, 722.0 tps, lat 140.313 ms stddev 203.232 2024-09-11T23:32:50.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:32:49 smithi123 ceph-mon[35438]: pgmap v803: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 8.4 MiB/s wr, 729 op/s 2024-09-11T23:32:50.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:32:49 smithi037 ceph-mon[30630]: pgmap v803: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 8.4 MiB/s wr, 729 op/s 2024-09-11T23:32:50.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:32:49 smithi160 ceph-mon[35055]: pgmap v803: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 8.4 MiB/s wr, 729 op/s 2024-09-11T23:32:51.318 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:32:51 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:32:51.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:32:51 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:32:51.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:32:51 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:32:52.318 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:32:52 smithi037 ceph-mon[30630]: pgmap v804: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 8.8 MiB/s wr, 799 op/s 2024-09-11T23:32:52.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:32:52 smithi160 ceph-mon[35055]: pgmap v804: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 8.8 MiB/s wr, 799 op/s 2024-09-11T23:32:52.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:32:52 smithi123 ceph-mon[35438]: pgmap v804: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 8.8 MiB/s wr, 799 op/s 2024-09-11T23:32:53.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:32:53 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:32:53.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:32:53 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:32:53.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:32:53 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:32:53.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:32:53 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:32:53.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:32:53 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:32:53.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:32:53 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:32:53.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:32:53 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:32:53.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:32:53 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:32:53.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:32:53 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:32:54.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:32:54 smithi160 ceph-mon[35055]: pgmap v805: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 5.7 MiB/s wr, 566 op/s 2024-09-11T23:32:54.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:32:54 smithi123 ceph-mon[35438]: pgmap v805: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 5.7 MiB/s wr, 566 op/s 2024-09-11T23:32:54.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:32:54 smithi037 ceph-mon[30630]: pgmap v805: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 5.7 MiB/s wr, 566 op/s 2024-09-11T23:32:54.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 815.0 s, 524.2 tps, lat 191.036 ms stddev 216.000 2024-09-11T23:32:56.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:32:56 smithi160 ceph-mon[35055]: pgmap v806: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 4.6 MiB/s wr, 521 op/s 2024-09-11T23:32:56.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:32:56 smithi123 ceph-mon[35438]: pgmap v806: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 4.6 MiB/s wr, 521 op/s 2024-09-11T23:32:56.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:32:56 smithi037 ceph-mon[30630]: pgmap v806: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 4.6 MiB/s wr, 521 op/s 2024-09-11T23:32:58.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:32:58 smithi160 ceph-mon[35055]: pgmap v807: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 5.0 MiB/s wr, 536 op/s 2024-09-11T23:32:58.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:32:58 smithi123 ceph-mon[35438]: pgmap v807: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 5.0 MiB/s wr, 536 op/s 2024-09-11T23:32:58.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:32:58 smithi037 ceph-mon[30630]: pgmap v807: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 5.0 MiB/s wr, 536 op/s 2024-09-11T23:32:59.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 820.0 s, 524.8 tps, lat 188.373 ms stddev 209.295 2024-09-11T23:33:00.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:33:00 smithi160 ceph-mon[35055]: pgmap v808: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 4.4 MiB/s wr, 470 op/s 2024-09-11T23:33:00.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:33:00 smithi123 ceph-mon[35438]: pgmap v808: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 4.4 MiB/s wr, 470 op/s 2024-09-11T23:33:00.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:33:00 smithi037 ceph-mon[30630]: pgmap v808: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 4.4 MiB/s wr, 470 op/s 2024-09-11T23:33:02.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:33:02 smithi160 ceph-mon[35055]: pgmap v809: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 5.1 MiB/s wr, 560 op/s 2024-09-11T23:33:02.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:33:02 smithi123 ceph-mon[35438]: pgmap v809: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 5.1 MiB/s wr, 560 op/s 2024-09-11T23:33:02.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:33:02 smithi037 ceph-mon[30630]: pgmap v809: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 5.1 MiB/s wr, 560 op/s 2024-09-11T23:33:04.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:33:04 smithi160 ceph-mon[35055]: pgmap v810: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 4.9 MiB/s wr, 523 op/s 2024-09-11T23:33:04.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:33:04 smithi123 ceph-mon[35438]: pgmap v810: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 4.9 MiB/s wr, 523 op/s 2024-09-11T23:33:04.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:33:04 smithi037 ceph-mon[30630]: pgmap v810: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 4.9 MiB/s wr, 523 op/s 2024-09-11T23:33:04.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 825.0 s, 442.2 tps, lat 212.030 ms stddev 288.559 2024-09-11T23:33:06.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:33:06 smithi160 ceph-mon[35055]: pgmap v811: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 6.2 MiB/s wr, 633 op/s 2024-09-11T23:33:06.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:33:06 smithi123 ceph-mon[35438]: pgmap v811: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 6.2 MiB/s wr, 633 op/s 2024-09-11T23:33:06.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:33:06 smithi037 ceph-mon[30630]: pgmap v811: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 6.2 MiB/s wr, 633 op/s 2024-09-11T23:33:08.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:33:08 smithi160 ceph-mon[35055]: pgmap v812: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 6.7 MiB/s wr, 670 op/s 2024-09-11T23:33:08.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:33:08 smithi123 ceph-mon[35438]: pgmap v812: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 6.7 MiB/s wr, 670 op/s 2024-09-11T23:33:08.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:33:08 smithi037 ceph-mon[30630]: pgmap v812: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 6.7 MiB/s wr, 670 op/s 2024-09-11T23:33:09.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 830.0 s, 431.0 tps, lat 252.894 ms stddev 341.074 2024-09-11T23:33:10.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:33:10 smithi160 ceph-mon[35055]: pgmap v813: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 7.1 MiB/s wr, 673 op/s 2024-09-11T23:33:10.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:33:10 smithi123 ceph-mon[35438]: pgmap v813: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 7.1 MiB/s wr, 673 op/s 2024-09-11T23:33:10.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:33:10 smithi037 ceph-mon[30630]: pgmap v813: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 7.1 MiB/s wr, 673 op/s 2024-09-11T23:33:12.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:33:12 smithi123 ceph-mon[35438]: pgmap v814: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 MiB/s wr, 994 op/s 2024-09-11T23:33:12.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:33:12 smithi037 ceph-mon[30630]: pgmap v814: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 MiB/s wr, 994 op/s 2024-09-11T23:33:12.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:33:12 smithi160 ceph-mon[35055]: pgmap v814: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 MiB/s wr, 994 op/s 2024-09-11T23:33:14.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:33:14 smithi123 ceph-mon[35438]: pgmap v815: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 MiB/s wr, 1.03k op/s 2024-09-11T23:33:14.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:33:14 smithi037 ceph-mon[30630]: pgmap v815: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 MiB/s wr, 1.03k op/s 2024-09-11T23:33:14.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:33:14 smithi160 ceph-mon[35055]: pgmap v815: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 MiB/s wr, 1.03k op/s 2024-09-11T23:33:14.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 835.0 s, 482.4 tps, lat 206.266 ms stddev 237.940 2024-09-11T23:33:16.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:33:16 smithi123 ceph-mon[35438]: pgmap v816: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 12 MiB/s wr, 1.06k op/s 2024-09-11T23:33:16.566 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:33:16 smithi037 ceph-mon[30630]: pgmap v816: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 12 MiB/s wr, 1.06k op/s 2024-09-11T23:33:16.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:33:16 smithi160 ceph-mon[35055]: pgmap v816: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 12 MiB/s wr, 1.06k op/s 2024-09-11T23:33:18.485 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:33:18 smithi160 ceph-mon[35055]: pgmap v817: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 10 MiB/s wr, 952 op/s 2024-09-11T23:33:18.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:33:18 smithi123 ceph-mon[35438]: pgmap v817: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 10 MiB/s wr, 952 op/s 2024-09-11T23:33:18.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:33:18 smithi037 ceph-mon[30630]: pgmap v817: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 10 MiB/s wr, 952 op/s 2024-09-11T23:33:19.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 840.0 s, 484.4 tps, lat 203.677 ms stddev 231.434 2024-09-11T23:33:20.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:33:20 smithi123 ceph-mon[35438]: pgmap v818: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 9.3 MiB/s wr, 854 op/s 2024-09-11T23:33:20.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:33:20 smithi037 ceph-mon[30630]: pgmap v818: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 9.3 MiB/s wr, 854 op/s 2024-09-11T23:33:20.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:33:20 smithi160 ceph-mon[35055]: pgmap v818: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 9.3 MiB/s wr, 854 op/s 2024-09-11T23:33:22.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:33:22 smithi123 ceph-mon[35438]: pgmap v819: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 8.7 MiB/s wr, 849 op/s 2024-09-11T23:33:22.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:33:22 smithi037 ceph-mon[30630]: pgmap v819: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 8.7 MiB/s wr, 849 op/s 2024-09-11T23:33:22.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:33:22 smithi160 ceph-mon[35055]: pgmap v819: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 8.7 MiB/s wr, 849 op/s 2024-09-11T23:33:24.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:33:24 smithi123 ceph-mon[35438]: pgmap v820: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 5.2 MiB/s wr, 563 op/s 2024-09-11T23:33:24.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:33:24 smithi037 ceph-mon[30630]: pgmap v820: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 5.2 MiB/s wr, 563 op/s 2024-09-11T23:33:24.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:33:24 smithi160 ceph-mon[35055]: pgmap v820: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 5.2 MiB/s wr, 563 op/s 2024-09-11T23:33:24.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 845.0 s, 477.2 tps, lat 212.060 ms stddev 254.465 2024-09-11T23:33:26.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:33:26 smithi123 ceph-mon[35438]: pgmap v821: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 4.6 MiB/s wr, 505 op/s 2024-09-11T23:33:26.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:33:26 smithi037 ceph-mon[30630]: pgmap v821: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 4.6 MiB/s wr, 505 op/s 2024-09-11T23:33:26.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:33:26 smithi160 ceph-mon[35055]: pgmap v821: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 4.6 MiB/s wr, 505 op/s 2024-09-11T23:33:28.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:33:28 smithi037 ceph-mon[30630]: pgmap v822: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.1 MiB/s wr, 471 op/s 2024-09-11T23:33:28.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:33:28 smithi160 ceph-mon[35055]: pgmap v822: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.1 MiB/s wr, 471 op/s 2024-09-11T23:33:28.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:33:28 smithi123 ceph-mon[35438]: pgmap v822: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.1 MiB/s wr, 471 op/s 2024-09-11T23:33:29.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 850.0 s, 491.0 tps, lat 207.251 ms stddev 292.826 2024-09-11T23:33:30.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:33:30 smithi037 ceph-mon[30630]: pgmap v823: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 3.6 MiB/s wr, 407 op/s 2024-09-11T23:33:30.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:33:30 smithi160 ceph-mon[35055]: pgmap v823: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 3.6 MiB/s wr, 407 op/s 2024-09-11T23:33:30.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:33:30 smithi123 ceph-mon[35438]: pgmap v823: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 3.6 MiB/s wr, 407 op/s 2024-09-11T23:33:32.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:33:32 smithi037 ceph-mon[30630]: pgmap v824: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.3 MiB/s wr, 491 op/s 2024-09-11T23:33:32.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:33:32 smithi160 ceph-mon[35055]: pgmap v824: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.3 MiB/s wr, 491 op/s 2024-09-11T23:33:32.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:33:32 smithi123 ceph-mon[35438]: pgmap v824: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.3 MiB/s wr, 491 op/s 2024-09-11T23:33:34.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:33:34 smithi037 ceph-mon[30630]: pgmap v825: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 4.1 MiB/s wr, 461 op/s 2024-09-11T23:33:34.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:33:34 smithi160 ceph-mon[35055]: pgmap v825: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 4.1 MiB/s wr, 461 op/s 2024-09-11T23:33:34.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:33:34 smithi123 ceph-mon[35438]: pgmap v825: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 4.1 MiB/s wr, 461 op/s 2024-09-11T23:33:34.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 855.0 s, 807.6 tps, lat 118.663 ms stddev 172.298 2024-09-11T23:33:36.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:33:36 smithi037 ceph-mon[30630]: pgmap v826: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.3 MiB/s wr, 482 op/s 2024-09-11T23:33:36.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:33:36 smithi160 ceph-mon[35055]: pgmap v826: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.3 MiB/s wr, 482 op/s 2024-09-11T23:33:36.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:33:36 smithi123 ceph-mon[35438]: pgmap v826: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.3 MiB/s wr, 482 op/s 2024-09-11T23:33:38.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:33:38 smithi037 ceph-mon[30630]: pgmap v827: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.6 MiB/s wr, 503 op/s 2024-09-11T23:33:38.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:33:38 smithi160 ceph-mon[35055]: pgmap v827: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.6 MiB/s wr, 503 op/s 2024-09-11T23:33:38.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:33:38 smithi123 ceph-mon[35438]: pgmap v827: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.6 MiB/s wr, 503 op/s 2024-09-11T23:33:39.826 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 860.0 s, 489.3 tps, lat 204.865 ms stddev 263.569 2024-09-11T23:33:40.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:33:40 smithi037 ceph-mon[30630]: pgmap v828: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.2 MiB/s wr, 451 op/s 2024-09-11T23:33:40.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:33:40 smithi160 ceph-mon[35055]: pgmap v828: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.2 MiB/s wr, 451 op/s 2024-09-11T23:33:40.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:33:40 smithi123 ceph-mon[35438]: pgmap v828: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.2 MiB/s wr, 451 op/s 2024-09-11T23:33:42.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:33:42 smithi160 ceph-mon[35055]: pgmap v829: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.9 MiB/s wr, 536 op/s 2024-09-11T23:33:42.730 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:33:42 smithi037 ceph-mon[30630]: pgmap v829: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.9 MiB/s wr, 536 op/s 2024-09-11T23:33:42.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:33:42 smithi123 ceph-mon[35438]: pgmap v829: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.9 MiB/s wr, 536 op/s 2024-09-11T23:33:44.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:33:44 smithi160 ceph-mon[35055]: pgmap v830: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.8 MiB/s wr, 534 op/s 2024-09-11T23:33:44.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:33:44 smithi123 ceph-mon[35438]: pgmap v830: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.8 MiB/s wr, 534 op/s 2024-09-11T23:33:44.815 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:33:44 smithi037 ceph-mon[30630]: pgmap v830: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.8 MiB/s wr, 534 op/s 2024-09-11T23:33:44.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 865.0 s, 545.7 tps, lat 186.598 ms stddev 237.712 2024-09-11T23:33:46.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:33:46 smithi160 ceph-mon[35055]: pgmap v831: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.9 MiB/s wr, 526 op/s 2024-09-11T23:33:46.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:33:46 smithi123 ceph-mon[35438]: pgmap v831: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.9 MiB/s wr, 526 op/s 2024-09-11T23:33:46.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:33:46 smithi037 ceph-mon[30630]: pgmap v831: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.9 MiB/s wr, 526 op/s 2024-09-11T23:33:48.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:33:48 smithi160 ceph-mon[35055]: pgmap v832: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 5.3 MiB/s wr, 585 op/s 2024-09-11T23:33:48.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:33:48 smithi123 ceph-mon[35438]: pgmap v832: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 5.3 MiB/s wr, 585 op/s 2024-09-11T23:33:48.817 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:33:48 smithi037 ceph-mon[30630]: pgmap v832: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 5.3 MiB/s wr, 585 op/s 2024-09-11T23:33:49.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 870.0 s, 499.0 tps, lat 200.794 ms stddev 247.798 2024-09-11T23:33:50.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:33:50 smithi160 ceph-mon[35055]: pgmap v833: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.2 MiB/s wr, 481 op/s 2024-09-11T23:33:50.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:33:50 smithi123 ceph-mon[35438]: pgmap v833: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.2 MiB/s wr, 481 op/s 2024-09-11T23:33:50.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:33:50 smithi037 ceph-mon[30630]: pgmap v833: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.2 MiB/s wr, 481 op/s 2024-09-11T23:33:52.618 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:33:52 smithi037 ceph-mon[30630]: pgmap v834: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 5.0 MiB/s wr, 564 op/s 2024-09-11T23:33:52.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:33:52 smithi160 ceph-mon[35055]: pgmap v834: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 5.0 MiB/s wr, 564 op/s 2024-09-11T23:33:52.752 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:33:52 smithi123 ceph-mon[35438]: pgmap v834: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 5.0 MiB/s wr, 564 op/s 2024-09-11T23:33:53.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:33:53 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:33:53.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:33:53 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:33:53.815 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:33:53 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:33:54.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:33:54 smithi160 ceph-mon[35055]: pgmap v835: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 4.7 MiB/s wr, 530 op/s 2024-09-11T23:33:54.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:33:54 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:33:54.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:33:54 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:33:54.684 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:33:54 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:33:54.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:33:54 smithi123 ceph-mon[35438]: pgmap v835: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 4.7 MiB/s wr, 530 op/s 2024-09-11T23:33:54.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:33:54 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:33:54.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:33:54 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:33:54.751 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:33:54 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:33:54.816 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:33:54 smithi037 ceph-mon[30630]: pgmap v835: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 4.7 MiB/s wr, 530 op/s 2024-09-11T23:33:54.816 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:33:54 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:33:54.816 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:33:54 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:33:54.816 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:33:54 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:33:54.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 875.0 s, 428.4 tps, lat 230.846 ms stddev 323.421 2024-09-11T23:33:56.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:33:56 smithi160 ceph-mon[35055]: pgmap v836: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.1 MiB/s wr, 470 op/s 2024-09-11T23:33:56.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:33:56 smithi123 ceph-mon[35438]: pgmap v836: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.1 MiB/s wr, 470 op/s 2024-09-11T23:33:56.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:33:56 smithi037 ceph-mon[30630]: pgmap v836: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.1 MiB/s wr, 470 op/s 2024-09-11T23:33:58.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:33:58 smithi160 ceph-mon[35055]: pgmap v837: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.6 MiB/s wr, 542 op/s 2024-09-11T23:33:58.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:33:58 smithi123 ceph-mon[35438]: pgmap v837: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.6 MiB/s wr, 542 op/s 2024-09-11T23:33:58.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:33:58 smithi037 ceph-mon[30630]: pgmap v837: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.6 MiB/s wr, 542 op/s 2024-09-11T23:33:59.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 880.0 s, 492.6 tps, lat 204.841 ms stddev 239.955 2024-09-11T23:34:00.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:34:00 smithi160 ceph-mon[35055]: pgmap v838: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 3.8 MiB/s wr, 430 op/s 2024-09-11T23:34:00.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:34:00 smithi123 ceph-mon[35438]: pgmap v838: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 3.8 MiB/s wr, 430 op/s 2024-09-11T23:34:00.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:34:00 smithi037 ceph-mon[30630]: pgmap v838: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 3.8 MiB/s wr, 430 op/s 2024-09-11T23:34:02.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:34:02 smithi160 ceph-mon[35055]: pgmap v839: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 4.4 MiB/s wr, 500 op/s 2024-09-11T23:34:02.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:34:02 smithi123 ceph-mon[35438]: pgmap v839: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 4.4 MiB/s wr, 500 op/s 2024-09-11T23:34:02.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:34:02 smithi037 ceph-mon[30630]: pgmap v839: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 4.4 MiB/s wr, 500 op/s 2024-09-11T23:34:04.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:34:04 smithi160 ceph-mon[35055]: pgmap v840: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 3.9 MiB/s wr, 468 op/s 2024-09-11T23:34:04.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:34:04 smithi123 ceph-mon[35438]: pgmap v840: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 3.9 MiB/s wr, 468 op/s 2024-09-11T23:34:04.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:34:04 smithi037 ceph-mon[30630]: pgmap v840: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 3.9 MiB/s wr, 468 op/s 2024-09-11T23:34:04.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 885.0 s, 538.2 tps, lat 186.053 ms stddev 211.359 2024-09-11T23:34:06.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:34:06 smithi160 ceph-mon[35055]: pgmap v841: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.2 MiB/s wr, 468 op/s 2024-09-11T23:34:06.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:34:06 smithi123 ceph-mon[35438]: pgmap v841: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.2 MiB/s wr, 468 op/s 2024-09-11T23:34:06.816 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:34:06 smithi037 ceph-mon[30630]: pgmap v841: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.2 MiB/s wr, 468 op/s 2024-09-11T23:34:08.683 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:34:08 smithi160 ceph-mon[35055]: pgmap v842: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 4.5 MiB/s wr, 515 op/s 2024-09-11T23:34:08.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:34:08 smithi123 ceph-mon[35438]: pgmap v842: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 4.5 MiB/s wr, 515 op/s 2024-09-11T23:34:08.815 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:34:08 smithi037 ceph-mon[30630]: pgmap v842: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 4.5 MiB/s wr, 515 op/s 2024-09-11T23:34:09.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 890.0 s, 751.6 tps, lat 128.407 ms stddev 142.703 2024-09-11T23:34:10.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:34:10 smithi123 ceph-mon[35438]: pgmap v843: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 4.0 MiB/s wr, 454 op/s 2024-09-11T23:34:10.815 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:34:10 smithi037 ceph-mon[30630]: pgmap v843: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 4.0 MiB/s wr, 454 op/s 2024-09-11T23:34:10.933 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:34:10 smithi160 ceph-mon[35055]: pgmap v843: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 4.0 MiB/s wr, 454 op/s 2024-09-11T23:34:11.750 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:34:11 smithi123 ceph-mon[35438]: pgmap v844: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.7 MiB/s wr, 554 op/s 2024-09-11T23:34:11.814 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:34:11 smithi037 ceph-mon[30630]: pgmap v844: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.7 MiB/s wr, 554 op/s 2024-09-11T23:34:11.933 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:34:11 smithi160 ceph-mon[35055]: pgmap v844: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.7 MiB/s wr, 554 op/s 2024-09-11T23:34:13.933 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:34:13 smithi160 ceph-mon[35055]: pgmap v845: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.6 MiB/s wr, 590 op/s 2024-09-11T23:34:14.000 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:34:13 smithi123 ceph-mon[35438]: pgmap v845: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.6 MiB/s wr, 590 op/s 2024-09-11T23:34:14.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:34:13 smithi037 ceph-mon[30630]: pgmap v845: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.6 MiB/s wr, 590 op/s 2024-09-11T23:34:14.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 895.0 s, 445.8 tps, lat 226.638 ms stddev 353.209 2024-09-11T23:34:15.933 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:34:15 smithi160 ceph-mon[35055]: pgmap v846: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 6.0 MiB/s wr, 578 op/s 2024-09-11T23:34:16.000 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:34:15 smithi123 ceph-mon[35438]: pgmap v846: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 6.0 MiB/s wr, 578 op/s 2024-09-11T23:34:16.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:34:15 smithi037 ceph-mon[30630]: pgmap v846: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 6.0 MiB/s wr, 578 op/s 2024-09-11T23:34:17.933 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:34:17 smithi160 ceph-mon[35055]: pgmap v847: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 6.1 MiB/s wr, 616 op/s 2024-09-11T23:34:18.000 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:34:17 smithi123 ceph-mon[35438]: pgmap v847: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 6.1 MiB/s wr, 616 op/s 2024-09-11T23:34:18.066 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:34:17 smithi037 ceph-mon[30630]: pgmap v847: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 6.1 MiB/s wr, 616 op/s 2024-09-11T23:34:19.825 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 900.0 s, 439.4 tps, lat 222.765 ms stddev 326.936 2024-09-11T23:34:19.933 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:34:19 smithi160 ceph-mon[35055]: pgmap v848: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 363 KiB/s rd, 6.6 MiB/s wr, 586 op/s 2024-09-11T23:34:20.000 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:34:19 smithi123 ceph-mon[35438]: pgmap v848: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 363 KiB/s rd, 6.6 MiB/s wr, 586 op/s 2024-09-11T23:34:20.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:34:19 smithi037 ceph-mon[30630]: pgmap v848: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 363 KiB/s rd, 6.6 MiB/s wr, 586 op/s 2024-09-11T23:34:20.160 INFO:teuthology.orchestra.run.smithi037.stdout:transaction type: 2024-09-11T23:34:20.160 INFO:teuthology.orchestra.run.smithi037.stdout:scaling factor: 32 2024-09-11T23:34:20.160 INFO:teuthology.orchestra.run.smithi037.stdout:query mode: simple 2024-09-11T23:34:20.161 INFO:teuthology.orchestra.run.smithi037.stdout:number of clients: 100 2024-09-11T23:34:20.161 INFO:teuthology.orchestra.run.smithi037.stdout:number of threads: 4 2024-09-11T23:34:20.161 INFO:teuthology.orchestra.run.smithi037.stdout:duration: 900 s 2024-09-11T23:34:20.161 INFO:teuthology.orchestra.run.smithi037.stdout:number of transactions actually processed: 816633 2024-09-11T23:34:20.161 INFO:teuthology.orchestra.run.smithi037.stdout:latency average = 110.188 ms 2024-09-11T23:34:20.161 INFO:teuthology.orchestra.run.smithi037.stdout:latency stddev = 168.774 ms 2024-09-11T23:34:20.161 INFO:teuthology.orchestra.run.smithi037.stdout:tps = 907.032616 (including connections establishing) 2024-09-11T23:34:20.161 INFO:teuthology.orchestra.run.smithi037.stdout:tps = 907.040473 (excluding connections establishing) 2024-09-11T23:34:20.200 DEBUG:teuthology.orchestra.run.smithi037:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo systemctl stop postgresql' 2024-09-11T23:34:22.000 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:34:21 smithi123 ceph-mon[35438]: pgmap v849: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 450 KiB/s rd, 7.6 MiB/s wr, 612 op/s 2024-09-11T23:34:22.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:34:21 smithi037 ceph-mon[30630]: pgmap v849: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 450 KiB/s rd, 7.6 MiB/s wr, 612 op/s 2024-09-11T23:34:22.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:34:21 smithi160 ceph-mon[35055]: pgmap v849: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 450 KiB/s rd, 7.6 MiB/s wr, 612 op/s 2024-09-11T23:34:24.000 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:34:23 smithi123 ceph-mon[35438]: pgmap v850: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 450 KiB/s rd, 7.9 MiB/s wr, 574 op/s 2024-09-11T23:34:24.066 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:34:23 smithi037 ceph-mon[30630]: pgmap v850: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 450 KiB/s rd, 7.9 MiB/s wr, 574 op/s 2024-09-11T23:34:24.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:34:23 smithi160 ceph-mon[35055]: pgmap v850: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 450 KiB/s rd, 7.9 MiB/s wr, 574 op/s 2024-09-11T23:34:26.000 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:34:25 smithi123 ceph-mon[35438]: pgmap v851: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 447 KiB/s rd, 7.7 MiB/s wr, 576 op/s 2024-09-11T23:34:26.067 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:34:25 smithi037 ceph-mon[30630]: pgmap v851: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 447 KiB/s rd, 7.7 MiB/s wr, 576 op/s 2024-09-11T23:34:26.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:34:25 smithi160 ceph-mon[35055]: pgmap v851: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 447 KiB/s rd, 7.7 MiB/s wr, 576 op/s 2024-09-11T23:34:28.000 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:34:27 smithi123 ceph-mon[35438]: pgmap v852: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 447 KiB/s rd, 8.3 MiB/s wr, 695 op/s 2024-09-11T23:34:28.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:34:27 smithi037 ceph-mon[30630]: pgmap v852: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 447 KiB/s rd, 8.3 MiB/s wr, 695 op/s 2024-09-11T23:34:28.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:34:27 smithi160 ceph-mon[35055]: pgmap v852: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 447 KiB/s rd, 8.3 MiB/s wr, 695 op/s 2024-09-11T23:34:30.000 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:34:29 smithi123 ceph-mon[35438]: pgmap v853: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 432 KiB/s rd, 8.1 MiB/s wr, 646 op/s 2024-09-11T23:34:30.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:34:29 smithi037 ceph-mon[30630]: pgmap v853: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 432 KiB/s rd, 8.1 MiB/s wr, 646 op/s 2024-09-11T23:34:30.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:34:29 smithi160 ceph-mon[35055]: pgmap v853: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 432 KiB/s rd, 8.1 MiB/s wr, 646 op/s 2024-09-11T23:34:32.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:34:31 smithi037 ceph-mon[30630]: pgmap v854: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 8.0 MiB/s wr, 679 op/s 2024-09-11T23:34:32.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:34:31 smithi160 ceph-mon[35055]: pgmap v854: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 8.0 MiB/s wr, 679 op/s 2024-09-11T23:34:32.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:34:31 smithi123 ceph-mon[35438]: pgmap v854: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 8.0 MiB/s wr, 679 op/s 2024-09-11T23:34:33.283 DEBUG:teuthology.orchestra.run.smithi037:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -lZaR /tmp/cephfs/postgres/' 2024-09-11T23:34:33.383 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/: 2024-09-11T23:34:33.383 INFO:teuthology.orchestra.run.smithi037.stdout:total 0 2024-09-11T23:34:33.383 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 11 23:19 . 2024-09-11T23:34:33.384 INFO:teuthology.orchestra.run.smithi037.stdout:drwxrwxrwt. 3 root root system_u:object_r:postgresql_db_t:s0 1 Sep 11 23:19 .. 2024-09-11T23:34:33.384 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 11 23:34 data 2024-09-11T23:34:33.384 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:34:33.384 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data: 2024-09-11T23:34:33.384 INFO:teuthology.orchestra.run.smithi037.stdout:total 36 2024-09-11T23:34:33.384 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 11 23:34 . 2024-09-11T23:34:33.384 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 11 23:19 .. 2024-09-11T23:34:33.384 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 4 Sep 11 23:19 base 2024-09-11T23:34:33.384 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 30 Sep 11 23:19 current_logfiles 2024-09-11T23:34:33.384 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 58 Sep 11 23:19 global 2024-09-11T23:34:33.384 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 11 23:19 log 2024-09-11T23:34:33.385 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 pg_commit_ts 2024-09-11T23:34:33.385 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 pg_dynshmem 2024-09-11T23:34:33.385 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 4516 Sep 11 23:19 pg_hba.conf 2024-09-11T23:34:33.385 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1636 Sep 11 23:19 pg_ident.conf 2024-09-11T23:34:33.385 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 11 23:34 pg_logical 2024-09-11T23:34:33.385 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 11 23:19 pg_multixact 2024-09-11T23:34:33.385 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 pg_notify 2024-09-11T23:34:33.385 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 pg_replslot 2024-09-11T23:34:33.385 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 pg_serial 2024-09-11T23:34:33.385 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 pg_snapshots 2024-09-11T23:34:33.385 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 11 23:34 pg_stat 2024-09-11T23:34:33.386 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:34 pg_stat_tmp 2024-09-11T23:34:33.386 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 11 23:34 pg_subtrans 2024-09-11T23:34:33.386 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 pg_tblspc 2024-09-11T23:34:33.386 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 pg_twophase 2024-09-11T23:34:33.386 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 11 23:19 PG_VERSION 2024-09-11T23:34:33.386 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 59 Sep 11 23:34 pg_wal 2024-09-11T23:34:33.386 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 11 23:19 pg_xact 2024-09-11T23:34:33.386 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 88 Sep 11 23:19 postgresql.auto.conf 2024-09-11T23:34:33.386 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 28074 Sep 11 23:19 postgresql.conf 2024-09-11T23:34:33.386 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 51 Sep 11 23:19 postmaster.opts 2024-09-11T23:34:33.387 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:34:33.387 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/base: 2024-09-11T23:34:33.387 INFO:teuthology.orchestra.run.smithi037.stdout:total 0 2024-09-11T23:34:33.387 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 4 Sep 11 23:19 . 2024-09-11T23:34:33.387 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 11 23:34 .. 2024-09-11T23:34:33.387 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Sep 11 23:19 1 2024-09-11T23:34:33.387 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Sep 11 23:19 13493 2024-09-11T23:34:33.387 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 305 Sep 11 23:25 13494 2024-09-11T23:34:33.387 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 pgsql_tmp 2024-09-11T23:34:33.388 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:34:33.388 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/base/1: 2024-09-11T23:34:33.388 INFO:teuthology.orchestra.run.smithi037.stdout:total 7777 2024-09-11T23:34:33.388 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Sep 11 23:19 . 2024-09-11T23:34:33.388 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 4 Sep 11 23:19 .. 2024-09-11T23:34:33.388 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 112 2024-09-11T23:34:33.388 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 113 2024-09-11T23:34:33.388 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 11 23:19 1247 2024-09-11T23:34:33.388 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 1247_fsm 2024-09-11T23:34:33.388 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 1247_vm 2024-09-11T23:34:33.388 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 Sep 11 23:19 1249 2024-09-11T23:34:33.388 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 1249_fsm 2024-09-11T23:34:33.389 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 1249_vm 2024-09-11T23:34:33.389 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 Sep 11 23:19 1255 2024-09-11T23:34:33.389 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 1255_fsm 2024-09-11T23:34:33.389 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 1255_vm 2024-09-11T23:34:33.389 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Sep 11 23:19 1259 2024-09-11T23:34:33.389 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 1259_fsm 2024-09-11T23:34:33.389 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 1259_vm 2024-09-11T23:34:33.389 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Sep 11 23:19 13344 2024-09-11T23:34:33.389 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 13344_fsm 2024-09-11T23:34:33.389 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 13344_vm 2024-09-11T23:34:33.389 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 13346 2024-09-11T23:34:33.389 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 13348 2024-09-11T23:34:33.389 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 13349 2024-09-11T23:34:33.390 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 13349_fsm 2024-09-11T23:34:33.390 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 13349_vm 2024-09-11T23:34:33.390 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 13351 2024-09-11T23:34:33.390 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 13353 2024-09-11T23:34:33.390 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 13354 2024-09-11T23:34:33.390 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 13354_fsm 2024-09-11T23:34:33.390 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 13354_vm 2024-09-11T23:34:33.390 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 13356 2024-09-11T23:34:33.390 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 13358 2024-09-11T23:34:33.390 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 13359 2024-09-11T23:34:33.391 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 13359_fsm 2024-09-11T23:34:33.391 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 13359_vm 2024-09-11T23:34:33.391 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 13361 2024-09-11T23:34:33.391 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 13363 2024-09-11T23:34:33.391 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 1417 2024-09-11T23:34:33.391 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 1418 2024-09-11T23:34:33.391 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 174 2024-09-11T23:34:33.391 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 175 2024-09-11T23:34:33.391 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2187 2024-09-11T23:34:33.391 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 2224 2024-09-11T23:34:33.391 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 2328 2024-09-11T23:34:33.391 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 2336 2024-09-11T23:34:33.392 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2337 2024-09-11T23:34:33.392 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2579 2024-09-11T23:34:33.392 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2600 2024-09-11T23:34:33.392 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2600_fsm 2024-09-11T23:34:33.392 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2600_vm 2024-09-11T23:34:33.392 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2601 2024-09-11T23:34:33.392 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2601_fsm 2024-09-11T23:34:33.392 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2601_vm 2024-09-11T23:34:33.392 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 11 23:19 2602 2024-09-11T23:34:33.392 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2602_fsm 2024-09-11T23:34:33.392 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2602_vm 2024-09-11T23:34:33.392 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 11 23:19 2603 2024-09-11T23:34:33.393 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2603_fsm 2024-09-11T23:34:33.393 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2603_vm 2024-09-11T23:34:33.393 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 2604 2024-09-11T23:34:33.393 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2605 2024-09-11T23:34:33.393 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2605_fsm 2024-09-11T23:34:33.393 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2605_vm 2024-09-11T23:34:33.393 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2606 2024-09-11T23:34:33.393 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2606_fsm 2024-09-11T23:34:33.393 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2606_vm 2024-09-11T23:34:33.393 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2607 2024-09-11T23:34:33.393 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2607_fsm 2024-09-11T23:34:33.393 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2607_vm 2024-09-11T23:34:33.393 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 Sep 11 23:19 2608 2024-09-11T23:34:33.394 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2608_fsm 2024-09-11T23:34:33.394 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2608_vm 2024-09-11T23:34:33.394 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 Sep 11 23:19 2609 2024-09-11T23:34:33.394 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2609_fsm 2024-09-11T23:34:33.394 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2609_vm 2024-09-11T23:34:33.394 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 11 23:19 2610 2024-09-11T23:34:33.394 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2610_fsm 2024-09-11T23:34:33.394 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2610_vm 2024-09-11T23:34:33.394 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 2611 2024-09-11T23:34:33.394 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2612 2024-09-11T23:34:33.394 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2612_fsm 2024-09-11T23:34:33.394 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2612_vm 2024-09-11T23:34:33.395 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 2613 2024-09-11T23:34:33.395 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2615 2024-09-11T23:34:33.395 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2615_fsm 2024-09-11T23:34:33.395 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2615_vm 2024-09-11T23:34:33.395 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2616 2024-09-11T23:34:33.395 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2616_fsm 2024-09-11T23:34:33.395 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2616_vm 2024-09-11T23:34:33.395 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Sep 11 23:19 2617 2024-09-11T23:34:33.395 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2617_fsm 2024-09-11T23:34:33.395 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2617_vm 2024-09-11T23:34:33.395 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Sep 11 23:19 2618 2024-09-11T23:34:33.395 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2618_fsm 2024-09-11T23:34:33.395 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2618_vm 2024-09-11T23:34:33.396 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 Sep 11 23:19 2619 2024-09-11T23:34:33.396 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2619_fsm 2024-09-11T23:34:33.396 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2619_vm 2024-09-11T23:34:33.396 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 2620 2024-09-11T23:34:33.396 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2650 2024-09-11T23:34:33.396 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2651 2024-09-11T23:34:33.396 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2652 2024-09-11T23:34:33.396 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 11 23:19 2653 2024-09-11T23:34:33.396 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 11 23:19 2654 2024-09-11T23:34:33.396 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 11 23:19 2655 2024-09-11T23:34:33.396 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2656 2024-09-11T23:34:33.396 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2657 2024-09-11T23:34:33.396 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Sep 11 23:19 2658 2024-09-11T23:34:33.397 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 11 23:19 2659 2024-09-11T23:34:33.397 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2660 2024-09-11T23:34:33.397 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2661 2024-09-11T23:34:33.397 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 11 23:19 2662 2024-09-11T23:34:33.397 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 11 23:19 2663 2024-09-11T23:34:33.397 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2664 2024-09-11T23:34:33.397 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2665 2024-09-11T23:34:33.397 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2666 2024-09-11T23:34:33.397 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2667 2024-09-11T23:34:33.397 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2668 2024-09-11T23:34:33.397 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2669 2024-09-11T23:34:33.397 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2670 2024-09-11T23:34:33.397 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 Sep 11 23:19 2673 2024-09-11T23:34:33.398 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 Sep 11 23:19 2674 2024-09-11T23:34:33.398 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Sep 11 23:19 2675 2024-09-11T23:34:33.398 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2678 2024-09-11T23:34:33.398 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2679 2024-09-11T23:34:33.398 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2680 2024-09-11T23:34:33.398 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2681 2024-09-11T23:34:33.398 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2682 2024-09-11T23:34:33.398 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2683 2024-09-11T23:34:33.398 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2684 2024-09-11T23:34:33.398 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2685 2024-09-11T23:34:33.398 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2686 2024-09-11T23:34:33.398 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2687 2024-09-11T23:34:33.398 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 11 23:19 2688 2024-09-11T23:34:33.399 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 11 23:19 2689 2024-09-11T23:34:33.399 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Sep 11 23:19 2690 2024-09-11T23:34:33.399 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 Sep 11 23:19 2691 2024-09-11T23:34:33.399 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2692 2024-09-11T23:34:33.399 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2693 2024-09-11T23:34:33.399 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2696 2024-09-11T23:34:33.399 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2699 2024-09-11T23:34:33.399 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2701 2024-09-11T23:34:33.399 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2702 2024-09-11T23:34:33.399 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 11 23:19 2703 2024-09-11T23:34:33.399 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 11 23:19 2704 2024-09-11T23:34:33.399 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2753 2024-09-11T23:34:33.399 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2753_fsm 2024-09-11T23:34:33.400 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2753_vm 2024-09-11T23:34:33.400 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2754 2024-09-11T23:34:33.400 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2755 2024-09-11T23:34:33.400 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 11 23:19 2756 2024-09-11T23:34:33.400 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 11 23:19 2757 2024-09-11T23:34:33.400 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 2830 2024-09-11T23:34:33.400 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2831 2024-09-11T23:34:33.400 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 2832 2024-09-11T23:34:33.400 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2833 2024-09-11T23:34:33.400 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 2834 2024-09-11T23:34:33.400 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2835 2024-09-11T23:34:33.400 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 2836 2024-09-11T23:34:33.400 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2837 2024-09-11T23:34:33.401 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 Sep 11 23:19 2838 2024-09-11T23:34:33.401 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2838_fsm 2024-09-11T23:34:33.401 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2838_vm 2024-09-11T23:34:33.401 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2839 2024-09-11T23:34:33.401 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2840 2024-09-11T23:34:33.401 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2840_fsm 2024-09-11T23:34:33.401 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2840_vm 2024-09-11T23:34:33.401 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2841 2024-09-11T23:34:33.401 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 2995 2024-09-11T23:34:33.401 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2996 2024-09-11T23:34:33.401 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3079 2024-09-11T23:34:33.401 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 3079_fsm 2024-09-11T23:34:33.401 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3079_vm 2024-09-11T23:34:33.402 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 3080 2024-09-11T23:34:33.402 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 3081 2024-09-11T23:34:33.402 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 11 23:19 3085 2024-09-11T23:34:33.402 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 3118 2024-09-11T23:34:33.402 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3119 2024-09-11T23:34:33.402 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Sep 11 23:19 3164 2024-09-11T23:34:33.402 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 3256 2024-09-11T23:34:33.402 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3257 2024-09-11T23:34:33.402 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3258 2024-09-11T23:34:33.402 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 3350 2024-09-11T23:34:33.402 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3351 2024-09-11T23:34:33.402 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3379 2024-09-11T23:34:33.402 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3380 2024-09-11T23:34:33.403 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 3381 2024-09-11T23:34:33.403 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 3394 2024-09-11T23:34:33.403 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 3394_fsm 2024-09-11T23:34:33.403 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3394_vm 2024-09-11T23:34:33.403 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 3395 2024-09-11T23:34:33.403 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 3429 2024-09-11T23:34:33.403 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 3430 2024-09-11T23:34:33.403 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3431 2024-09-11T23:34:33.403 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3433 2024-09-11T23:34:33.403 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 3439 2024-09-11T23:34:33.403 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3440 2024-09-11T23:34:33.403 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 11 23:19 3455 2024-09-11T23:34:33.403 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 Sep 11 23:19 3456 2024-09-11T23:34:33.403 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 3456_fsm 2024-09-11T23:34:33.404 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3456_vm 2024-09-11T23:34:33.404 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 3466 2024-09-11T23:34:33.404 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3467 2024-09-11T23:34:33.404 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3468 2024-09-11T23:34:33.404 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 3501 2024-09-11T23:34:33.404 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3502 2024-09-11T23:34:33.404 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3503 2024-09-11T23:34:33.404 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3534 2024-09-11T23:34:33.404 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3541 2024-09-11T23:34:33.404 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 3541_fsm 2024-09-11T23:34:33.404 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3541_vm 2024-09-11T23:34:33.404 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 3542 2024-09-11T23:34:33.404 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3574 2024-09-11T23:34:33.405 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3575 2024-09-11T23:34:33.405 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 3576 2024-09-11T23:34:33.405 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 3596 2024-09-11T23:34:33.405 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3597 2024-09-11T23:34:33.405 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 3598 2024-09-11T23:34:33.405 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3599 2024-09-11T23:34:33.405 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3600 2024-09-11T23:34:33.405 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 3600_fsm 2024-09-11T23:34:33.405 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3600_vm 2024-09-11T23:34:33.405 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3601 2024-09-11T23:34:33.405 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 3601_fsm 2024-09-11T23:34:33.405 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3601_vm 2024-09-11T23:34:33.405 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3602 2024-09-11T23:34:33.405 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 3602_fsm 2024-09-11T23:34:33.406 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3602_vm 2024-09-11T23:34:33.406 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 3603 2024-09-11T23:34:33.406 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 3603_fsm 2024-09-11T23:34:33.406 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3603_vm 2024-09-11T23:34:33.406 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 3604 2024-09-11T23:34:33.406 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 3605 2024-09-11T23:34:33.406 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 3606 2024-09-11T23:34:33.406 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 3607 2024-09-11T23:34:33.406 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 3608 2024-09-11T23:34:33.406 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 11 23:19 3609 2024-09-11T23:34:33.406 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 3712 2024-09-11T23:34:33.406 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3764 2024-09-11T23:34:33.406 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 3764_fsm 2024-09-11T23:34:33.407 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3764_vm 2024-09-11T23:34:33.407 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 3766 2024-09-11T23:34:33.407 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 3767 2024-09-11T23:34:33.407 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3997 2024-09-11T23:34:33.407 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 4143 2024-09-11T23:34:33.407 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 4144 2024-09-11T23:34:33.407 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 4145 2024-09-11T23:34:33.407 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 4146 2024-09-11T23:34:33.407 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 4147 2024-09-11T23:34:33.407 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 4148 2024-09-11T23:34:33.407 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 4149 2024-09-11T23:34:33.407 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 4150 2024-09-11T23:34:33.407 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 4151 2024-09-11T23:34:33.408 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 4152 2024-09-11T23:34:33.408 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 4153 2024-09-11T23:34:33.408 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 4154 2024-09-11T23:34:33.408 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 4155 2024-09-11T23:34:33.408 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 4156 2024-09-11T23:34:33.408 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 4157 2024-09-11T23:34:33.408 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 4158 2024-09-11T23:34:33.408 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 4159 2024-09-11T23:34:33.408 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 4160 2024-09-11T23:34:33.408 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 4161 2024-09-11T23:34:33.409 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 4162 2024-09-11T23:34:33.410 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 4163 2024-09-11T23:34:33.410 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 4164 2024-09-11T23:34:33.410 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 4165 2024-09-11T23:34:33.410 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 4166 2024-09-11T23:34:33.410 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 4167 2024-09-11T23:34:33.410 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 4168 2024-09-11T23:34:33.410 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 4169 2024-09-11T23:34:33.410 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 4170 2024-09-11T23:34:33.410 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 4171 2024-09-11T23:34:33.410 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 4172 2024-09-11T23:34:33.411 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 4173 2024-09-11T23:34:33.411 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 4174 2024-09-11T23:34:33.411 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 5002 2024-09-11T23:34:33.411 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 548 2024-09-11T23:34:33.411 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 549 2024-09-11T23:34:33.411 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 6102 2024-09-11T23:34:33.411 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 6104 2024-09-11T23:34:33.411 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 6106 2024-09-11T23:34:33.411 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 6110 2024-09-11T23:34:33.411 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 6111 2024-09-11T23:34:33.411 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 6112 2024-09-11T23:34:33.411 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 6113 2024-09-11T23:34:33.411 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 6117 2024-09-11T23:34:33.412 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 826 2024-09-11T23:34:33.412 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 827 2024-09-11T23:34:33.412 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 828 2024-09-11T23:34:33.412 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 11 23:19 pg_filenode.map 2024-09-11T23:34:33.412 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 11 23:19 PG_VERSION 2024-09-11T23:34:33.412 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:34:33.412 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/base/13493: 2024-09-11T23:34:33.412 INFO:teuthology.orchestra.run.smithi037.stdout:total 7777 2024-09-11T23:34:33.412 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Sep 11 23:19 . 2024-09-11T23:34:33.412 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 4 Sep 11 23:19 .. 2024-09-11T23:34:33.412 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 112 2024-09-11T23:34:33.412 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 113 2024-09-11T23:34:33.412 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 11 23:19 1247 2024-09-11T23:34:33.413 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 1247_fsm 2024-09-11T23:34:33.413 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 1247_vm 2024-09-11T23:34:33.413 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 Sep 11 23:19 1249 2024-09-11T23:34:33.413 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 1249_fsm 2024-09-11T23:34:33.413 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 1249_vm 2024-09-11T23:34:33.413 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 Sep 11 23:19 1255 2024-09-11T23:34:33.413 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 1255_fsm 2024-09-11T23:34:33.413 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 1255_vm 2024-09-11T23:34:33.413 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Sep 11 23:19 1259 2024-09-11T23:34:33.413 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 1259_fsm 2024-09-11T23:34:33.413 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 1259_vm 2024-09-11T23:34:33.413 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Sep 11 23:19 13344 2024-09-11T23:34:33.413 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 13344_fsm 2024-09-11T23:34:33.413 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 13344_vm 2024-09-11T23:34:33.414 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 13346 2024-09-11T23:34:33.414 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 13348 2024-09-11T23:34:33.414 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 13349 2024-09-11T23:34:33.414 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 13349_fsm 2024-09-11T23:34:33.414 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 13349_vm 2024-09-11T23:34:33.414 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 13351 2024-09-11T23:34:33.414 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 13353 2024-09-11T23:34:33.414 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 13354 2024-09-11T23:34:33.414 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 13354_fsm 2024-09-11T23:34:33.414 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 13354_vm 2024-09-11T23:34:33.414 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 13356 2024-09-11T23:34:33.414 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 13358 2024-09-11T23:34:33.414 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 13359 2024-09-11T23:34:33.415 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 13359_fsm 2024-09-11T23:34:33.415 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 13359_vm 2024-09-11T23:34:33.415 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 13361 2024-09-11T23:34:33.415 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 13363 2024-09-11T23:34:33.415 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 1417 2024-09-11T23:34:33.415 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 1418 2024-09-11T23:34:33.415 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 174 2024-09-11T23:34:33.415 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 175 2024-09-11T23:34:33.415 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2187 2024-09-11T23:34:33.415 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 2224 2024-09-11T23:34:33.415 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 2328 2024-09-11T23:34:33.415 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 2336 2024-09-11T23:34:33.415 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2337 2024-09-11T23:34:33.415 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2579 2024-09-11T23:34:33.416 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2600 2024-09-11T23:34:33.416 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2600_fsm 2024-09-11T23:34:33.416 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2600_vm 2024-09-11T23:34:33.416 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2601 2024-09-11T23:34:33.416 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2601_fsm 2024-09-11T23:34:33.416 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2601_vm 2024-09-11T23:34:33.416 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 11 23:19 2602 2024-09-11T23:34:33.416 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2602_fsm 2024-09-11T23:34:33.416 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2602_vm 2024-09-11T23:34:33.416 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 11 23:19 2603 2024-09-11T23:34:33.416 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2603_fsm 2024-09-11T23:34:33.416 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2603_vm 2024-09-11T23:34:33.417 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 2604 2024-09-11T23:34:33.417 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2605 2024-09-11T23:34:33.417 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2605_fsm 2024-09-11T23:34:33.417 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2605_vm 2024-09-11T23:34:33.417 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2606 2024-09-11T23:34:33.417 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2606_fsm 2024-09-11T23:34:33.417 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2606_vm 2024-09-11T23:34:33.417 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2607 2024-09-11T23:34:33.417 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2607_fsm 2024-09-11T23:34:33.417 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2607_vm 2024-09-11T23:34:33.417 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 Sep 11 23:19 2608 2024-09-11T23:34:33.417 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2608_fsm 2024-09-11T23:34:33.417 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2608_vm 2024-09-11T23:34:33.417 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 Sep 11 23:19 2609 2024-09-11T23:34:33.418 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2609_fsm 2024-09-11T23:34:33.418 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2609_vm 2024-09-11T23:34:33.418 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 11 23:19 2610 2024-09-11T23:34:33.418 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2610_fsm 2024-09-11T23:34:33.418 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2610_vm 2024-09-11T23:34:33.418 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 2611 2024-09-11T23:34:33.418 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2612 2024-09-11T23:34:33.418 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2612_fsm 2024-09-11T23:34:33.418 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2612_vm 2024-09-11T23:34:33.418 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 2613 2024-09-11T23:34:33.418 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2615 2024-09-11T23:34:33.418 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2615_fsm 2024-09-11T23:34:33.418 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2615_vm 2024-09-11T23:34:33.419 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2616 2024-09-11T23:34:33.419 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2616_fsm 2024-09-11T23:34:33.419 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2616_vm 2024-09-11T23:34:33.419 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Sep 11 23:19 2617 2024-09-11T23:34:33.419 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2617_fsm 2024-09-11T23:34:33.419 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2617_vm 2024-09-11T23:34:33.419 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Sep 11 23:19 2618 2024-09-11T23:34:33.419 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2618_fsm 2024-09-11T23:34:33.419 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2618_vm 2024-09-11T23:34:33.419 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 Sep 11 23:19 2619 2024-09-11T23:34:33.419 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2619_fsm 2024-09-11T23:34:33.419 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2619_vm 2024-09-11T23:34:33.419 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 2620 2024-09-11T23:34:33.420 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2650 2024-09-11T23:34:33.420 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2651 2024-09-11T23:34:33.420 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2652 2024-09-11T23:34:33.420 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 11 23:19 2653 2024-09-11T23:34:33.420 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 11 23:19 2654 2024-09-11T23:34:33.420 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 11 23:19 2655 2024-09-11T23:34:33.420 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2656 2024-09-11T23:34:33.420 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2657 2024-09-11T23:34:33.420 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Sep 11 23:19 2658 2024-09-11T23:34:33.420 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 11 23:19 2659 2024-09-11T23:34:33.420 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2660 2024-09-11T23:34:33.420 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2661 2024-09-11T23:34:33.421 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 11 23:19 2662 2024-09-11T23:34:33.421 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 11 23:19 2663 2024-09-11T23:34:33.421 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2664 2024-09-11T23:34:33.421 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2665 2024-09-11T23:34:33.421 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2666 2024-09-11T23:34:33.421 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2667 2024-09-11T23:34:33.421 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2668 2024-09-11T23:34:33.421 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2669 2024-09-11T23:34:33.421 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2670 2024-09-11T23:34:33.421 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 Sep 11 23:19 2673 2024-09-11T23:34:33.421 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 Sep 11 23:19 2674 2024-09-11T23:34:33.421 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Sep 11 23:19 2675 2024-09-11T23:34:33.421 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2678 2024-09-11T23:34:33.422 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2679 2024-09-11T23:34:33.422 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2680 2024-09-11T23:34:33.422 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2681 2024-09-11T23:34:33.422 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2682 2024-09-11T23:34:33.422 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2683 2024-09-11T23:34:33.422 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2684 2024-09-11T23:34:33.422 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2685 2024-09-11T23:34:33.422 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2686 2024-09-11T23:34:33.422 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2687 2024-09-11T23:34:33.422 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 11 23:19 2688 2024-09-11T23:34:33.422 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 11 23:19 2689 2024-09-11T23:34:33.422 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Sep 11 23:19 2690 2024-09-11T23:34:33.422 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 Sep 11 23:19 2691 2024-09-11T23:34:33.422 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2692 2024-09-11T23:34:33.423 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2693 2024-09-11T23:34:33.423 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2696 2024-09-11T23:34:33.423 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2699 2024-09-11T23:34:33.423 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2701 2024-09-11T23:34:33.423 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2702 2024-09-11T23:34:33.423 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 11 23:19 2703 2024-09-11T23:34:33.423 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 11 23:19 2704 2024-09-11T23:34:33.423 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2753 2024-09-11T23:34:33.423 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2753_fsm 2024-09-11T23:34:33.423 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2753_vm 2024-09-11T23:34:33.423 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2754 2024-09-11T23:34:33.423 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2755 2024-09-11T23:34:33.423 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 11 23:19 2756 2024-09-11T23:34:33.424 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 11 23:19 2757 2024-09-11T23:34:33.424 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 2830 2024-09-11T23:34:33.424 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2831 2024-09-11T23:34:33.424 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 2832 2024-09-11T23:34:33.424 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2833 2024-09-11T23:34:33.424 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 2834 2024-09-11T23:34:33.424 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2835 2024-09-11T23:34:33.424 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 2836 2024-09-11T23:34:33.424 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2837 2024-09-11T23:34:33.424 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 Sep 11 23:19 2838 2024-09-11T23:34:33.424 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2838_fsm 2024-09-11T23:34:33.424 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2838_vm 2024-09-11T23:34:33.425 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2839 2024-09-11T23:34:33.425 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2840 2024-09-11T23:34:33.425 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2840_fsm 2024-09-11T23:34:33.425 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2840_vm 2024-09-11T23:34:33.425 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2841 2024-09-11T23:34:33.425 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 2995 2024-09-11T23:34:33.425 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2996 2024-09-11T23:34:33.425 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3079 2024-09-11T23:34:33.425 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 3079_fsm 2024-09-11T23:34:33.425 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3079_vm 2024-09-11T23:34:33.425 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 3080 2024-09-11T23:34:33.425 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 3081 2024-09-11T23:34:33.426 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 11 23:19 3085 2024-09-11T23:34:33.426 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 3118 2024-09-11T23:34:33.426 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3119 2024-09-11T23:34:33.426 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Sep 11 23:19 3164 2024-09-11T23:34:33.426 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 3256 2024-09-11T23:34:33.426 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3257 2024-09-11T23:34:33.426 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3258 2024-09-11T23:34:33.426 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 3350 2024-09-11T23:34:33.426 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3351 2024-09-11T23:34:33.426 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3379 2024-09-11T23:34:33.426 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3380 2024-09-11T23:34:33.426 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 3381 2024-09-11T23:34:33.427 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 3394 2024-09-11T23:34:33.427 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 3394_fsm 2024-09-11T23:34:33.427 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3394_vm 2024-09-11T23:34:33.427 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 3395 2024-09-11T23:34:33.427 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 3429 2024-09-11T23:34:33.427 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 3430 2024-09-11T23:34:33.427 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3431 2024-09-11T23:34:33.427 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3433 2024-09-11T23:34:33.427 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 3439 2024-09-11T23:34:33.427 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3440 2024-09-11T23:34:33.428 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 11 23:19 3455 2024-09-11T23:34:33.428 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 Sep 11 23:19 3456 2024-09-11T23:34:33.428 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 3456_fsm 2024-09-11T23:34:33.428 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3456_vm 2024-09-11T23:34:33.428 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 3466 2024-09-11T23:34:33.428 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3467 2024-09-11T23:34:33.428 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3468 2024-09-11T23:34:33.428 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 3501 2024-09-11T23:34:33.428 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3502 2024-09-11T23:34:33.428 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3503 2024-09-11T23:34:33.428 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3534 2024-09-11T23:34:33.428 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3541 2024-09-11T23:34:33.428 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 3541_fsm 2024-09-11T23:34:33.429 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3541_vm 2024-09-11T23:34:33.429 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 3542 2024-09-11T23:34:33.429 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3574 2024-09-11T23:34:33.429 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3575 2024-09-11T23:34:33.429 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 3576 2024-09-11T23:34:33.429 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 3596 2024-09-11T23:34:33.429 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3597 2024-09-11T23:34:33.429 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 3598 2024-09-11T23:34:33.429 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3599 2024-09-11T23:34:33.429 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3600 2024-09-11T23:34:33.429 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 3600_fsm 2024-09-11T23:34:33.429 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3600_vm 2024-09-11T23:34:33.430 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3601 2024-09-11T23:34:33.430 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 3601_fsm 2024-09-11T23:34:33.430 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3601_vm 2024-09-11T23:34:33.430 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3602 2024-09-11T23:34:33.430 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 3602_fsm 2024-09-11T23:34:33.430 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3602_vm 2024-09-11T23:34:33.430 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 3603 2024-09-11T23:34:33.430 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 3603_fsm 2024-09-11T23:34:33.430 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3603_vm 2024-09-11T23:34:33.430 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 3604 2024-09-11T23:34:33.430 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 3605 2024-09-11T23:34:33.430 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 3606 2024-09-11T23:34:33.430 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 3607 2024-09-11T23:34:33.430 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 3608 2024-09-11T23:34:33.431 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 11 23:19 3609 2024-09-11T23:34:33.431 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 3712 2024-09-11T23:34:33.431 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3764 2024-09-11T23:34:33.431 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 3764_fsm 2024-09-11T23:34:33.431 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3764_vm 2024-09-11T23:34:33.431 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 3766 2024-09-11T23:34:33.431 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 3767 2024-09-11T23:34:33.431 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3997 2024-09-11T23:34:33.431 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 4143 2024-09-11T23:34:33.431 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 4144 2024-09-11T23:34:33.431 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 4145 2024-09-11T23:34:33.431 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 4146 2024-09-11T23:34:33.431 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 4147 2024-09-11T23:34:33.432 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 4148 2024-09-11T23:34:33.432 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 4149 2024-09-11T23:34:33.432 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 4150 2024-09-11T23:34:33.432 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 4151 2024-09-11T23:34:33.432 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 4152 2024-09-11T23:34:33.432 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 4153 2024-09-11T23:34:33.432 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 4154 2024-09-11T23:34:33.432 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 4155 2024-09-11T23:34:33.432 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 4156 2024-09-11T23:34:33.432 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 4157 2024-09-11T23:34:33.432 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 4158 2024-09-11T23:34:33.432 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 4159 2024-09-11T23:34:33.432 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 4160 2024-09-11T23:34:33.433 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 4161 2024-09-11T23:34:33.433 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 4162 2024-09-11T23:34:33.433 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 4163 2024-09-11T23:34:33.433 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 4164 2024-09-11T23:34:33.433 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 4165 2024-09-11T23:34:33.433 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 4166 2024-09-11T23:34:33.433 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 4167 2024-09-11T23:34:33.433 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 4168 2024-09-11T23:34:33.433 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 4169 2024-09-11T23:34:33.433 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 4170 2024-09-11T23:34:33.433 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 4171 2024-09-11T23:34:33.433 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 4172 2024-09-11T23:34:33.435 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 4173 2024-09-11T23:34:33.435 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 4174 2024-09-11T23:34:33.435 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 5002 2024-09-11T23:34:33.435 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 548 2024-09-11T23:34:33.435 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 549 2024-09-11T23:34:33.435 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 6102 2024-09-11T23:34:33.435 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 6104 2024-09-11T23:34:33.435 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 6106 2024-09-11T23:34:33.435 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 6110 2024-09-11T23:34:33.436 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 6111 2024-09-11T23:34:33.436 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 6112 2024-09-11T23:34:33.436 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 6113 2024-09-11T23:34:33.436 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 6117 2024-09-11T23:34:33.436 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 826 2024-09-11T23:34:33.436 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 827 2024-09-11T23:34:33.436 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 828 2024-09-11T23:34:33.436 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 11 23:19 pg_filenode.map 2024-09-11T23:34:33.436 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 11 23:19 PG_VERSION 2024-09-11T23:34:33.436 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:34:33.436 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/base/13494: 2024-09-11T23:34:33.436 INFO:teuthology.orchestra.run.smithi037.stdout:total 551318 2024-09-11T23:34:33.437 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 305 Sep 11 23:25 . 2024-09-11T23:34:33.437 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 4 Sep 11 23:19 .. 2024-09-11T23:34:33.437 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 112 2024-09-11T23:34:33.437 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 113 2024-09-11T23:34:33.437 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 11 23:19 1247 2024-09-11T23:34:33.437 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 1247_fsm 2024-09-11T23:34:33.437 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 1247_vm 2024-09-11T23:34:33.437 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 Sep 11 23:19 1249 2024-09-11T23:34:33.437 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 1249_fsm 2024-09-11T23:34:33.437 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 1249_vm 2024-09-11T23:34:33.437 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 Sep 11 23:19 1255 2024-09-11T23:34:33.437 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 1255_fsm 2024-09-11T23:34:33.438 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 1255_vm 2024-09-11T23:34:33.438 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Sep 11 23:34 1259 2024-09-11T23:34:33.438 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 1259_fsm 2024-09-11T23:34:33.438 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 1259_vm 2024-09-11T23:34:33.438 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Sep 11 23:19 13344 2024-09-11T23:34:33.438 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 13344_fsm 2024-09-11T23:34:33.438 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 13344_vm 2024-09-11T23:34:33.438 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 13346 2024-09-11T23:34:33.438 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 13348 2024-09-11T23:34:33.438 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 13349 2024-09-11T23:34:33.438 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 13349_fsm 2024-09-11T23:34:33.438 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 13349_vm 2024-09-11T23:34:33.438 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 13351 2024-09-11T23:34:33.439 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 13353 2024-09-11T23:34:33.439 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 13354 2024-09-11T23:34:33.439 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 13354_fsm 2024-09-11T23:34:33.439 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 13354_vm 2024-09-11T23:34:33.439 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 13356 2024-09-11T23:34:33.439 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 13358 2024-09-11T23:34:33.439 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 13359 2024-09-11T23:34:33.439 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 13359_fsm 2024-09-11T23:34:33.439 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 13359_vm 2024-09-11T23:34:33.439 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 13361 2024-09-11T23:34:33.439 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 13363 2024-09-11T23:34:33.439 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 1417 2024-09-11T23:34:33.439 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 1418 2024-09-11T23:34:33.440 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 440188928 Sep 11 23:34 16396 2024-09-11T23:34:33.440 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 131072 Sep 11 23:34 16396_fsm 2024-09-11T23:34:33.440 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:29 16396_vm 2024-09-11T23:34:33.440 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 688128 Sep 11 23:34 16397 2024-09-11T23:34:33.440 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:34 16397_fsm 2024-09-11T23:34:33.440 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:34 16397_vm 2024-09-11T23:34:33.440 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 589824 Sep 11 23:34 16399 2024-09-11T23:34:33.440 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:34 16399_fsm 2024-09-11T23:34:33.440 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:34 16399_vm 2024-09-11T23:34:33.440 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:34 16400 2024-09-11T23:34:33.440 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 11 23:34 16402 2024-09-11T23:34:33.440 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 71901184 Sep 11 23:34 16404 2024-09-11T23:34:33.440 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 42713088 Sep 11 23:34 16406 2024-09-11T23:34:33.441 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 11 23:34 16406_fsm 2024-09-11T23:34:33.441 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:34 16406_vm 2024-09-11T23:34:33.441 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 174 2024-09-11T23:34:33.441 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 175 2024-09-11T23:34:33.441 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2187 2024-09-11T23:34:33.441 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 2224 2024-09-11T23:34:33.441 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 2328 2024-09-11T23:34:33.441 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 2336 2024-09-11T23:34:33.441 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2337 2024-09-11T23:34:33.441 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2579 2024-09-11T23:34:33.441 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2600 2024-09-11T23:34:33.441 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2600_fsm 2024-09-11T23:34:33.441 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2600_vm 2024-09-11T23:34:33.441 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2601 2024-09-11T23:34:33.442 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2601_fsm 2024-09-11T23:34:33.442 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2601_vm 2024-09-11T23:34:33.442 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 11 23:19 2602 2024-09-11T23:34:33.442 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2602_fsm 2024-09-11T23:34:33.442 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2602_vm 2024-09-11T23:34:33.442 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 11 23:19 2603 2024-09-11T23:34:33.442 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2603_fsm 2024-09-11T23:34:33.442 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2603_vm 2024-09-11T23:34:33.442 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 2604 2024-09-11T23:34:33.442 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2605 2024-09-11T23:34:33.442 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2605_fsm 2024-09-11T23:34:33.442 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2605_vm 2024-09-11T23:34:33.442 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2606 2024-09-11T23:34:33.443 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2606_fsm 2024-09-11T23:34:33.443 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2606_vm 2024-09-11T23:34:33.443 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2607 2024-09-11T23:34:33.443 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2607_fsm 2024-09-11T23:34:33.443 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2607_vm 2024-09-11T23:34:33.443 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 Sep 11 23:19 2608 2024-09-11T23:34:33.443 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2608_fsm 2024-09-11T23:34:33.443 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2608_vm 2024-09-11T23:34:33.443 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 Sep 11 23:19 2609 2024-09-11T23:34:33.443 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2609_fsm 2024-09-11T23:34:33.443 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2609_vm 2024-09-11T23:34:33.443 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 11 23:19 2610 2024-09-11T23:34:33.443 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2610_fsm 2024-09-11T23:34:33.444 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2610_vm 2024-09-11T23:34:33.444 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 2611 2024-09-11T23:34:33.444 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2612 2024-09-11T23:34:33.444 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2612_fsm 2024-09-11T23:34:33.444 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2612_vm 2024-09-11T23:34:33.444 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 2613 2024-09-11T23:34:33.444 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2615 2024-09-11T23:34:33.444 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2615_fsm 2024-09-11T23:34:33.444 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2615_vm 2024-09-11T23:34:33.444 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2616 2024-09-11T23:34:33.444 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2616_fsm 2024-09-11T23:34:33.444 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2616_vm 2024-09-11T23:34:33.444 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Sep 11 23:19 2617 2024-09-11T23:34:33.445 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2617_fsm 2024-09-11T23:34:33.445 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2617_vm 2024-09-11T23:34:33.445 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Sep 11 23:19 2618 2024-09-11T23:34:33.445 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2618_fsm 2024-09-11T23:34:33.445 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2618_vm 2024-09-11T23:34:33.445 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 172032 Sep 11 23:34 2619 2024-09-11T23:34:33.445 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:22 2619_fsm 2024-09-11T23:34:33.445 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2619_vm 2024-09-11T23:34:33.445 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 2620 2024-09-11T23:34:33.445 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2650 2024-09-11T23:34:33.445 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2651 2024-09-11T23:34:33.445 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2652 2024-09-11T23:34:33.445 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 11 23:19 2653 2024-09-11T23:34:33.445 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 11 23:19 2654 2024-09-11T23:34:33.446 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 11 23:19 2655 2024-09-11T23:34:33.446 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2656 2024-09-11T23:34:33.446 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2657 2024-09-11T23:34:33.446 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Sep 11 23:19 2658 2024-09-11T23:34:33.446 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 11 23:19 2659 2024-09-11T23:34:33.446 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2660 2024-09-11T23:34:33.446 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2661 2024-09-11T23:34:33.446 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 11 23:19 2662 2024-09-11T23:34:33.446 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 11 23:19 2663 2024-09-11T23:34:33.446 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2664 2024-09-11T23:34:33.446 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2665 2024-09-11T23:34:33.446 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2666 2024-09-11T23:34:33.447 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2667 2024-09-11T23:34:33.447 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2668 2024-09-11T23:34:33.447 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2669 2024-09-11T23:34:33.447 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2670 2024-09-11T23:34:33.447 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 Sep 11 23:19 2673 2024-09-11T23:34:33.447 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 Sep 11 23:19 2674 2024-09-11T23:34:33.447 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Sep 11 23:19 2675 2024-09-11T23:34:33.447 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2678 2024-09-11T23:34:33.447 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2679 2024-09-11T23:34:33.447 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2680 2024-09-11T23:34:33.447 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2681 2024-09-11T23:34:33.447 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2682 2024-09-11T23:34:33.447 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2683 2024-09-11T23:34:33.448 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2684 2024-09-11T23:34:33.448 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2685 2024-09-11T23:34:33.448 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2686 2024-09-11T23:34:33.448 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2687 2024-09-11T23:34:33.448 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 11 23:19 2688 2024-09-11T23:34:33.448 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 11 23:19 2689 2024-09-11T23:34:33.448 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Sep 11 23:19 2690 2024-09-11T23:34:33.448 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 Sep 11 23:19 2691 2024-09-11T23:34:33.448 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2692 2024-09-11T23:34:33.448 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2693 2024-09-11T23:34:33.448 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 11 23:23 2696 2024-09-11T23:34:33.448 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2699 2024-09-11T23:34:33.448 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2701 2024-09-11T23:34:33.449 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2702 2024-09-11T23:34:33.449 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 11 23:19 2703 2024-09-11T23:34:33.449 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 11 23:19 2704 2024-09-11T23:34:33.449 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2753 2024-09-11T23:34:33.449 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2753_fsm 2024-09-11T23:34:33.449 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2753_vm 2024-09-11T23:34:33.449 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2754 2024-09-11T23:34:33.449 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2755 2024-09-11T23:34:33.449 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 11 23:19 2756 2024-09-11T23:34:33.449 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 11 23:19 2757 2024-09-11T23:34:33.449 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 2830 2024-09-11T23:34:33.449 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2831 2024-09-11T23:34:33.449 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 2832 2024-09-11T23:34:33.450 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2833 2024-09-11T23:34:33.450 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 2834 2024-09-11T23:34:33.450 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2835 2024-09-11T23:34:33.450 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 2836 2024-09-11T23:34:33.450 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2837 2024-09-11T23:34:33.450 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 Sep 11 23:19 2838 2024-09-11T23:34:33.450 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2838_fsm 2024-09-11T23:34:33.450 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2838_vm 2024-09-11T23:34:33.450 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2839 2024-09-11T23:34:33.450 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2840 2024-09-11T23:34:33.450 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2840_fsm 2024-09-11T23:34:33.450 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2840_vm 2024-09-11T23:34:33.450 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2841 2024-09-11T23:34:33.451 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 2995 2024-09-11T23:34:33.451 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2996 2024-09-11T23:34:33.451 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3079 2024-09-11T23:34:33.451 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 3079_fsm 2024-09-11T23:34:33.451 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3079_vm 2024-09-11T23:34:33.451 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 3080 2024-09-11T23:34:33.451 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 3081 2024-09-11T23:34:33.451 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 11 23:19 3085 2024-09-11T23:34:33.451 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 3118 2024-09-11T23:34:33.451 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3119 2024-09-11T23:34:33.451 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Sep 11 23:19 3164 2024-09-11T23:34:33.451 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 3256 2024-09-11T23:34:33.451 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3257 2024-09-11T23:34:33.451 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3258 2024-09-11T23:34:33.452 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 3350 2024-09-11T23:34:33.452 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3351 2024-09-11T23:34:33.452 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3379 2024-09-11T23:34:33.452 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3380 2024-09-11T23:34:33.452 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 3381 2024-09-11T23:34:33.452 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 3394 2024-09-11T23:34:33.452 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 3394_fsm 2024-09-11T23:34:33.452 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3394_vm 2024-09-11T23:34:33.452 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 3395 2024-09-11T23:34:33.452 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 3429 2024-09-11T23:34:33.452 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 3430 2024-09-11T23:34:33.452 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3431 2024-09-11T23:34:33.452 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3433 2024-09-11T23:34:33.453 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 3439 2024-09-11T23:34:33.453 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3440 2024-09-11T23:34:33.453 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 11 23:19 3455 2024-09-11T23:34:33.453 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 Sep 11 23:19 3456 2024-09-11T23:34:33.453 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 3456_fsm 2024-09-11T23:34:33.453 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3456_vm 2024-09-11T23:34:33.453 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 3466 2024-09-11T23:34:33.453 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3467 2024-09-11T23:34:33.453 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3468 2024-09-11T23:34:33.453 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 3501 2024-09-11T23:34:33.453 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3502 2024-09-11T23:34:33.453 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3503 2024-09-11T23:34:33.453 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3534 2024-09-11T23:34:33.454 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3541 2024-09-11T23:34:33.454 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 3541_fsm 2024-09-11T23:34:33.454 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3541_vm 2024-09-11T23:34:33.454 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 3542 2024-09-11T23:34:33.454 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3574 2024-09-11T23:34:33.454 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3575 2024-09-11T23:34:33.454 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 3576 2024-09-11T23:34:33.454 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 3596 2024-09-11T23:34:33.454 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3597 2024-09-11T23:34:33.454 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 3598 2024-09-11T23:34:33.454 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3599 2024-09-11T23:34:33.454 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3600 2024-09-11T23:34:33.454 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 3600_fsm 2024-09-11T23:34:33.455 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3600_vm 2024-09-11T23:34:33.455 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3601 2024-09-11T23:34:33.455 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 3601_fsm 2024-09-11T23:34:33.455 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3601_vm 2024-09-11T23:34:33.455 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3602 2024-09-11T23:34:33.455 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 3602_fsm 2024-09-11T23:34:33.455 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3602_vm 2024-09-11T23:34:33.455 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 3603 2024-09-11T23:34:33.455 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 3603_fsm 2024-09-11T23:34:33.455 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3603_vm 2024-09-11T23:34:33.455 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 3604 2024-09-11T23:34:33.455 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 3605 2024-09-11T23:34:33.455 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 3606 2024-09-11T23:34:33.456 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 3607 2024-09-11T23:34:33.456 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 3608 2024-09-11T23:34:33.456 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 11 23:19 3609 2024-09-11T23:34:33.456 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 3712 2024-09-11T23:34:33.456 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3764 2024-09-11T23:34:33.456 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 3764_fsm 2024-09-11T23:34:33.456 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3764_vm 2024-09-11T23:34:33.456 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 3766 2024-09-11T23:34:33.456 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 3767 2024-09-11T23:34:33.456 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3997 2024-09-11T23:34:33.456 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 4143 2024-09-11T23:34:33.456 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 4144 2024-09-11T23:34:33.456 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 4145 2024-09-11T23:34:33.457 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 4146 2024-09-11T23:34:33.457 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 4147 2024-09-11T23:34:33.457 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 4148 2024-09-11T23:34:33.457 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 4149 2024-09-11T23:34:33.457 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 4150 2024-09-11T23:34:33.457 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 4151 2024-09-11T23:34:33.457 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 4152 2024-09-11T23:34:33.457 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 4153 2024-09-11T23:34:33.457 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 4154 2024-09-11T23:34:33.457 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 4155 2024-09-11T23:34:33.457 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 4156 2024-09-11T23:34:33.457 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 4157 2024-09-11T23:34:33.457 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 4158 2024-09-11T23:34:33.458 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 4159 2024-09-11T23:34:33.458 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 4160 2024-09-11T23:34:33.458 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 4161 2024-09-11T23:34:33.458 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 4162 2024-09-11T23:34:33.458 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 4163 2024-09-11T23:34:33.458 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 4164 2024-09-11T23:34:33.458 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 4165 2024-09-11T23:34:33.458 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 4166 2024-09-11T23:34:33.458 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 4167 2024-09-11T23:34:33.458 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 4168 2024-09-11T23:34:33.458 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 4169 2024-09-11T23:34:33.458 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 4170 2024-09-11T23:34:33.458 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 4171 2024-09-11T23:34:33.459 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 4172 2024-09-11T23:34:33.459 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 4173 2024-09-11T23:34:33.459 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 4174 2024-09-11T23:34:33.459 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 5002 2024-09-11T23:34:33.459 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 548 2024-09-11T23:34:33.459 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 549 2024-09-11T23:34:33.459 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 6102 2024-09-11T23:34:33.459 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 6104 2024-09-11T23:34:33.459 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 6106 2024-09-11T23:34:33.459 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 6110 2024-09-11T23:34:33.459 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 6111 2024-09-11T23:34:33.459 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 6112 2024-09-11T23:34:33.459 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 6113 2024-09-11T23:34:33.459 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 6117 2024-09-11T23:34:33.460 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 826 2024-09-11T23:34:33.460 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 827 2024-09-11T23:34:33.460 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 828 2024-09-11T23:34:33.460 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 11 23:19 pg_filenode.map 2024-09-11T23:34:33.460 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 151596 Sep 11 23:19 pg_internal.init 2024-09-11T23:34:33.460 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 11 23:19 PG_VERSION 2024-09-11T23:34:33.460 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:34:33.460 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/base/pgsql_tmp: 2024-09-11T23:34:33.460 INFO:teuthology.orchestra.run.smithi037.stdout:total 0 2024-09-11T23:34:33.460 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 . 2024-09-11T23:34:33.460 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 4 Sep 11 23:19 .. 2024-09-11T23:34:33.460 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:34:33.460 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/global: 2024-09-11T23:34:33.461 INFO:teuthology.orchestra.run.smithi037.stdout:total 560 2024-09-11T23:34:33.461 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 58 Sep 11 23:19 . 2024-09-11T23:34:33.461 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 11 23:34 .. 2024-09-11T23:34:33.461 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 1213 2024-09-11T23:34:33.461 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 1213_fsm 2024-09-11T23:34:33.461 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 1213_vm 2024-09-11T23:34:33.461 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 1214 2024-09-11T23:34:33.461 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 1214_fsm 2024-09-11T23:34:33.461 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 1214_vm 2024-09-11T23:34:33.461 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 1232 2024-09-11T23:34:33.461 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 1233 2024-09-11T23:34:33.461 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 1260 2024-09-11T23:34:33.461 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 1260_fsm 2024-09-11T23:34:33.462 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 1260_vm 2024-09-11T23:34:33.462 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 1261 2024-09-11T23:34:33.462 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 1261_fsm 2024-09-11T23:34:33.462 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 1261_vm 2024-09-11T23:34:33.462 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 1262 2024-09-11T23:34:33.462 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 1262_fsm 2024-09-11T23:34:33.462 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 1262_vm 2024-09-11T23:34:33.462 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2396 2024-09-11T23:34:33.462 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 23:19 2396_fsm 2024-09-11T23:34:33.462 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2396_vm 2024-09-11T23:34:33.462 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2397 2024-09-11T23:34:33.462 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2671 2024-09-11T23:34:33.462 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2672 2024-09-11T23:34:33.463 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2676 2024-09-11T23:34:33.463 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2677 2024-09-11T23:34:33.463 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2694 2024-09-11T23:34:33.463 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2695 2024-09-11T23:34:33.463 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2697 2024-09-11T23:34:33.463 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 23:19 2698 2024-09-11T23:34:33.463 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 2846 2024-09-11T23:34:33.463 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2847 2024-09-11T23:34:33.463 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 2964 2024-09-11T23:34:33.463 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2965 2024-09-11T23:34:33.463 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 2966 2024-09-11T23:34:33.463 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 2967 2024-09-11T23:34:33.463 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 3592 2024-09-11T23:34:33.463 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 3593 2024-09-11T23:34:33.464 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 4060 2024-09-11T23:34:33.464 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 4061 2024-09-11T23:34:33.464 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 4175 2024-09-11T23:34:33.464 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 4176 2024-09-11T23:34:33.464 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 4177 2024-09-11T23:34:33.464 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 4178 2024-09-11T23:34:33.464 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 4181 2024-09-11T23:34:33.464 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 4182 2024-09-11T23:34:33.464 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 4183 2024-09-11T23:34:33.464 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 4184 2024-09-11T23:34:33.464 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 4185 2024-09-11T23:34:33.464 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 4186 2024-09-11T23:34:33.465 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 6000 2024-09-11T23:34:33.465 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 6001 2024-09-11T23:34:33.465 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 6002 2024-09-11T23:34:33.465 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 6100 2024-09-11T23:34:33.465 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 6114 2024-09-11T23:34:33.465 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 6115 2024-09-11T23:34:33.465 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:34 pg_control 2024-09-11T23:34:33.465 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 11 23:19 pg_filenode.map 2024-09-11T23:34:33.465 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 23144 Sep 11 23:19 pg_internal.init 2024-09-11T23:34:33.465 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:34:33.465 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/log: 2024-09-11T23:34:33.465 INFO:teuthology.orchestra.run.smithi037.stdout:total 2 2024-09-11T23:34:33.465 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 11 23:19 . 2024-09-11T23:34:33.466 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 11 23:34 .. 2024-09-11T23:34:33.466 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1118 Sep 11 23:34 postgresql-Wed.log 2024-09-11T23:34:33.466 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:34:33.466 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_commit_ts: 2024-09-11T23:34:33.466 INFO:teuthology.orchestra.run.smithi037.stdout:total 0 2024-09-11T23:34:33.466 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 . 2024-09-11T23:34:33.466 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 11 23:34 .. 2024-09-11T23:34:33.466 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:34:33.466 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_dynshmem: 2024-09-11T23:34:33.466 INFO:teuthology.orchestra.run.smithi037.stdout:total 0 2024-09-11T23:34:33.466 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 . 2024-09-11T23:34:33.466 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 11 23:34 .. 2024-09-11T23:34:33.466 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:34:33.467 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_logical: 2024-09-11T23:34:33.467 INFO:teuthology.orchestra.run.smithi037.stdout:total 1 2024-09-11T23:34:33.467 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 11 23:34 . 2024-09-11T23:34:33.467 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 11 23:34 .. 2024-09-11T23:34:33.467 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 mappings 2024-09-11T23:34:33.467 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Sep 11 23:34 replorigin_checkpoint 2024-09-11T23:34:33.467 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 snapshots 2024-09-11T23:34:33.467 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:34:33.467 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_logical/mappings: 2024-09-11T23:34:33.467 INFO:teuthology.orchestra.run.smithi037.stdout:total 0 2024-09-11T23:34:33.467 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 . 2024-09-11T23:34:33.467 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 11 23:34 .. 2024-09-11T23:34:33.467 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:34:33.467 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_logical/snapshots: 2024-09-11T23:34:33.468 INFO:teuthology.orchestra.run.smithi037.stdout:total 0 2024-09-11T23:34:33.468 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 . 2024-09-11T23:34:33.468 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 11 23:34 .. 2024-09-11T23:34:33.468 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:34:33.468 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_multixact: 2024-09-11T23:34:33.468 INFO:teuthology.orchestra.run.smithi037.stdout:total 0 2024-09-11T23:34:33.468 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 11 23:19 . 2024-09-11T23:34:33.468 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 11 23:34 .. 2024-09-11T23:34:33.468 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 11 23:19 members 2024-09-11T23:34:33.468 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 11 23:19 offsets 2024-09-11T23:34:33.468 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:34:33.468 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_multixact/members: 2024-09-11T23:34:33.468 INFO:teuthology.orchestra.run.smithi037.stdout:total 8 2024-09-11T23:34:33.468 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 11 23:19 . 2024-09-11T23:34:33.469 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 11 23:19 .. 2024-09-11T23:34:33.469 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:19 0000 2024-09-11T23:34:33.469 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:34:33.469 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_multixact/offsets: 2024-09-11T23:34:33.469 INFO:teuthology.orchestra.run.smithi037.stdout:total 8 2024-09-11T23:34:33.469 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 11 23:19 . 2024-09-11T23:34:33.469 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 11 23:19 .. 2024-09-11T23:34:33.469 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 23:24 0000 2024-09-11T23:34:33.469 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:34:33.469 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_notify: 2024-09-11T23:34:33.469 INFO:teuthology.orchestra.run.smithi037.stdout:total 0 2024-09-11T23:34:33.469 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 . 2024-09-11T23:34:33.469 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 11 23:34 .. 2024-09-11T23:34:33.469 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:34:33.470 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_replslot: 2024-09-11T23:34:33.470 INFO:teuthology.orchestra.run.smithi037.stdout:total 0 2024-09-11T23:34:33.470 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 . 2024-09-11T23:34:33.471 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 11 23:34 .. 2024-09-11T23:34:33.471 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:34:33.471 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_serial: 2024-09-11T23:34:33.471 INFO:teuthology.orchestra.run.smithi037.stdout:total 0 2024-09-11T23:34:33.471 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 . 2024-09-11T23:34:33.471 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 11 23:34 .. 2024-09-11T23:34:33.471 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:34:33.471 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_snapshots: 2024-09-11T23:34:33.472 INFO:teuthology.orchestra.run.smithi037.stdout:total 0 2024-09-11T23:34:33.472 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 . 2024-09-11T23:34:33.472 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 11 23:34 .. 2024-09-11T23:34:33.472 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:34:33.472 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_stat: 2024-09-11T23:34:33.472 INFO:teuthology.orchestra.run.smithi037.stdout:total 15 2024-09-11T23:34:33.472 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 11 23:34 . 2024-09-11T23:34:33.472 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 11 23:34 .. 2024-09-11T23:34:33.472 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1952 Sep 11 23:34 db_0.stat 2024-09-11T23:34:33.472 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 10979 Sep 11 23:34 db_13494.stat 2024-09-11T23:34:33.472 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1151 Sep 11 23:34 global.stat 2024-09-11T23:34:33.472 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:34:33.472 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_stat_tmp: 2024-09-11T23:34:33.473 INFO:teuthology.orchestra.run.smithi037.stdout:total 0 2024-09-11T23:34:33.473 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:34 . 2024-09-11T23:34:33.473 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 11 23:34 .. 2024-09-11T23:34:33.473 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:34:33.473 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_subtrans: 2024-09-11T23:34:33.473 INFO:teuthology.orchestra.run.smithi037.stdout:total 128 2024-09-11T23:34:33.473 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 11 23:34 . 2024-09-11T23:34:33.473 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 11 23:34 .. 2024-09-11T23:34:33.473 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 131072 Sep 11 23:34 000C 2024-09-11T23:34:33.473 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:34:33.473 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_tblspc: 2024-09-11T23:34:33.473 INFO:teuthology.orchestra.run.smithi037.stdout:total 0 2024-09-11T23:34:33.473 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 . 2024-09-11T23:34:33.474 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 11 23:34 .. 2024-09-11T23:34:33.474 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:34:33.474 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_twophase: 2024-09-11T23:34:33.474 INFO:teuthology.orchestra.run.smithi037.stdout:total 0 2024-09-11T23:34:33.474 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 . 2024-09-11T23:34:33.474 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 11 23:34 .. 2024-09-11T23:34:33.474 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:34:33.474 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_wal: 2024-09-11T23:34:33.474 INFO:teuthology.orchestra.run.smithi037.stdout:total 950272 2024-09-11T23:34:33.474 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 59 Sep 11 23:34 . 2024-09-11T23:34:33.474 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 11 23:34 .. 2024-09-11T23:34:33.474 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 23:34 000000010000000000000066 2024-09-11T23:34:33.474 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 23:24 000000010000000000000067 2024-09-11T23:34:33.474 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 23:24 000000010000000000000068 2024-09-11T23:34:33.475 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 23:26 000000010000000000000069 2024-09-11T23:34:33.475 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 23:24 00000001000000000000006A 2024-09-11T23:34:33.475 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 23:25 00000001000000000000006B 2024-09-11T23:34:33.475 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 23:25 00000001000000000000006C 2024-09-11T23:34:33.475 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 23:24 00000001000000000000006D 2024-09-11T23:34:33.475 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 23:27 00000001000000000000006E 2024-09-11T23:34:33.475 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 23:27 00000001000000000000006F 2024-09-11T23:34:33.475 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 23:25 000000010000000000000070 2024-09-11T23:34:33.475 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 23:25 000000010000000000000071 2024-09-11T23:34:33.475 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 23:27 000000010000000000000072 2024-09-11T23:34:33.475 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 23:25 000000010000000000000073 2024-09-11T23:34:33.475 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 23:26 000000010000000000000074 2024-09-11T23:34:33.475 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 23:24 000000010000000000000075 2024-09-11T23:34:33.476 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 23:24 000000010000000000000076 2024-09-11T23:34:33.476 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 23:24 000000010000000000000077 2024-09-11T23:34:33.476 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 23:24 000000010000000000000078 2024-09-11T23:34:33.476 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 23:28 000000010000000000000079 2024-09-11T23:34:33.476 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 23:24 00000001000000000000007A 2024-09-11T23:34:33.476 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 23:25 00000001000000000000007B 2024-09-11T23:34:33.476 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 23:25 00000001000000000000007C 2024-09-11T23:34:33.476 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 23:24 00000001000000000000007D 2024-09-11T23:34:33.476 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 23:26 00000001000000000000007E 2024-09-11T23:34:33.476 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 23:25 00000001000000000000007F 2024-09-11T23:34:33.476 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 23:24 000000010000000000000080 2024-09-11T23:34:33.476 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 23:24 000000010000000000000081 2024-09-11T23:34:33.476 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 23:29 000000010000000000000082 2024-09-11T23:34:33.477 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 23:30 000000010000000000000083 2024-09-11T23:34:33.477 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 23:30 000000010000000000000084 2024-09-11T23:34:33.477 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 23:31 000000010000000000000085 2024-09-11T23:34:33.477 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 23:31 000000010000000000000086 2024-09-11T23:34:33.477 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 23:33 000000010000000000000087 2024-09-11T23:34:33.477 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 23:29 000000010000000000000088 2024-09-11T23:34:33.477 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 23:30 000000010000000000000089 2024-09-11T23:34:33.477 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 23:33 00000001000000000000008A 2024-09-11T23:34:33.477 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 23:31 00000001000000000000008B 2024-09-11T23:34:33.477 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 23:30 00000001000000000000008C 2024-09-11T23:34:33.477 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 23:32 00000001000000000000008D 2024-09-11T23:34:33.477 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 23:29 00000001000000000000008E 2024-09-11T23:34:33.477 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 23:31 00000001000000000000008F 2024-09-11T23:34:33.477 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 23:29 000000010000000000000090 2024-09-11T23:34:33.478 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 23:30 000000010000000000000091 2024-09-11T23:34:33.478 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 23:29 000000010000000000000092 2024-09-11T23:34:33.478 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 23:30 000000010000000000000093 2024-09-11T23:34:33.478 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 23:33 000000010000000000000094 2024-09-11T23:34:33.478 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 23:31 000000010000000000000095 2024-09-11T23:34:33.478 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 23:29 000000010000000000000096 2024-09-11T23:34:33.478 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 23:29 000000010000000000000097 2024-09-11T23:34:33.478 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 23:30 000000010000000000000098 2024-09-11T23:34:33.478 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 23:29 000000010000000000000099 2024-09-11T23:34:33.478 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 23:32 00000001000000000000009A 2024-09-11T23:34:33.478 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 23:30 00000001000000000000009B 2024-09-11T23:34:33.478 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 23:29 00000001000000000000009C 2024-09-11T23:34:33.478 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 23:29 00000001000000000000009D 2024-09-11T23:34:33.479 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 23:29 00000001000000000000009E 2024-09-11T23:34:33.479 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 23:32 00000001000000000000009F 2024-09-11T23:34:33.479 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 archive_status 2024-09-11T23:34:33.479 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:34:33.479 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_wal/archive_status: 2024-09-11T23:34:33.479 INFO:teuthology.orchestra.run.smithi037.stdout:total 0 2024-09-11T23:34:33.479 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 23:19 . 2024-09-11T23:34:33.479 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 59 Sep 11 23:34 .. 2024-09-11T23:34:33.479 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:34:33.479 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_xact: 2024-09-11T23:34:33.479 INFO:teuthology.orchestra.run.smithi037.stdout:total 200 2024-09-11T23:34:33.479 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 11 23:19 . 2024-09-11T23:34:33.479 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 11 23:34 .. 2024-09-11T23:34:33.480 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 204800 Sep 11 23:34 0000 2024-09-11T23:34:33.480 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-11T23:34:33.491 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:34:34.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:34:33 smithi037 ceph-mon[30630]: pgmap v855: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 7.8 MiB/s wr, 771 op/s 2024-09-11T23:34:34.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:34:33 smithi160 ceph-mon[35055]: pgmap v855: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 7.8 MiB/s wr, 771 op/s 2024-09-11T23:34:34.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:34:33 smithi123 ceph-mon[35438]: pgmap v855: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 7.8 MiB/s wr, 771 op/s 2024-09-11T23:34:34.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:34.616+0000 7fca50200640 1 -- 172.21.15.37:0/2219571599 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fca48104f10 msgr2=0x7fca48105390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:34:34.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:34.616+0000 7fca50200640 1 --2- 172.21.15.37:0/2219571599 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fca48104f10 0x7fca48105390 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fca34009900 tx=0x7fca3402a3f0 comp rx=0 tx=0).stop 2024-09-11T23:34:34.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:34.616+0000 7fca50200640 1 -- 172.21.15.37:0/2219571599 shutdown_connections 2024-09-11T23:34:34.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:34.616+0000 7fca50200640 1 --2- 172.21.15.37:0/2219571599 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fca48104f10 0x7fca48105390 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:34:34.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:34.616+0000 7fca50200640 1 --2- 172.21.15.37:0/2219571599 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fca481058d0 0x7fca4810c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:34:34.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:34.616+0000 7fca50200640 1 --2- 172.21.15.37:0/2219571599 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fca48103d20 0x7fca48104120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:34:34.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:34.616+0000 7fca50200640 1 -- 172.21.15.37:0/2219571599 >> 172.21.15.37:0/2219571599 conn(0x7fca480ff480 msgr2=0x7fca481018c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:34:34.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:34.616+0000 7fca50200640 1 -- 172.21.15.37:0/2219571599 shutdown_connections 2024-09-11T23:34:34.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:34.616+0000 7fca50200640 1 -- 172.21.15.37:0/2219571599 wait complete. 2024-09-11T23:34:34.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:34.617+0000 7fca50200640 1 Processor -- start 2024-09-11T23:34:34.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:34.617+0000 7fca50200640 1 -- start start 2024-09-11T23:34:34.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:34.618+0000 7fca50200640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fca48103d20 0x7fca4819a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:34:34.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:34.618+0000 7fca50200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fca48104f10 0x7fca4819a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:34:34.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:34.618+0000 7fca50200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fca481058d0 0x7fca481a1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:34:34.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:34.618+0000 7fca50200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fca4810f9f0 con 0x7fca48104f10 2024-09-11T23:34:34.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:34.618+0000 7fca50200640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fca4810f870 con 0x7fca481058d0 2024-09-11T23:34:34.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:34.618+0000 7fca50200640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fca4810fb70 con 0x7fca48103d20 2024-09-11T23:34:34.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:34.618+0000 7fca4ce00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fca48104f10 0x7fca4819a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:34:34.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:34.618+0000 7fca4d800640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fca48103d20 0x7fca4819a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:34:34.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:34.618+0000 7fca4d800640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fca48103d20 0x7fca4819a070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.37:55024/0 (socket says 172.21.15.37:55024) 2024-09-11T23:34:34.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:34.618+0000 7fca4d800640 1 -- 172.21.15.37:0/2024319843 learned_addr learned my addr 172.21.15.37:0/2024319843 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:34:34.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:34.618+0000 7fca4e200640 1 --2- 172.21.15.37:0/2024319843 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fca481058d0 0x7fca481a1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:34:34.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:34.619+0000 7fca4ce00640 1 -- 172.21.15.37:0/2024319843 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fca48103d20 msgr2=0x7fca4819a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:34:34.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:34.619+0000 7fca4ce00640 1 --2- 172.21.15.37:0/2024319843 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fca48103d20 0x7fca4819a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:34:34.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:34.619+0000 7fca4ce00640 1 -- 172.21.15.37:0/2024319843 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fca481058d0 msgr2=0x7fca481a1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:34:34.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:34.619+0000 7fca4ce00640 1 --2- 172.21.15.37:0/2024319843 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fca481058d0 0x7fca481a1620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:34:34.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:34.619+0000 7fca4ce00640 1 -- 172.21.15.37:0/2024319843 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca481a1c90 con 0x7fca48104f10 2024-09-11T23:34:34.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:34.619+0000 7fca4d800640 1 --2- 172.21.15.37:0/2024319843 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fca48103d20 0x7fca4819a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:34:34.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:34.619+0000 7fca4ce00640 1 --2- 172.21.15.37:0/2024319843 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fca48104f10 0x7fca4819a5b0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fca3402a910 tx=0x7fca34032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:34:34.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:34.619+0000 7fca46000640 1 -- 172.21.15.37:0/2024319843 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca3403f030 con 0x7fca48104f10 2024-09-11T23:34:34.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:34.620+0000 7fca46000640 1 -- 172.21.15.37:0/2024319843 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca34003ce0 con 0x7fca48104f10 2024-09-11T23:34:34.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:34.620+0000 7fca50200640 1 -- 172.21.15.37:0/2024319843 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca481a1f20 con 0x7fca48104f10 2024-09-11T23:34:34.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:34.620+0000 7fca46000640 1 -- 172.21.15.37:0/2024319843 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca34035070 con 0x7fca48104f10 2024-09-11T23:34:34.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:34.620+0000 7fca50200640 1 -- 172.21.15.37:0/2024319843 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca481a2380 con 0x7fca48104f10 2024-09-11T23:34:34.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:34.621+0000 7fca50200640 1 -- 172.21.15.37:0/2024319843 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca4810b070 con 0x7fca48104f10 2024-09-11T23:34:34.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:34.623+0000 7fca46000640 1 -- 172.21.15.37:0/2024319843 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 20) ==== 137833+0+0 (secure 0 0 0) 0x7fca34042030 con 0x7fca48104f10 2024-09-11T23:34:34.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:34.625+0000 7fca46000640 1 --2- 172.21.15.37:0/2024319843 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fca300a2b90 0x7fca300a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:34:34.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:34.625+0000 7fca46000640 1 -- 172.21.15.37:0/2024319843 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9295+0+0 (secure 0 0 0) 0x7fca340efb70 con 0x7fca48104f10 2024-09-11T23:34:34.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:34.625+0000 7fca4d800640 1 --2- 172.21.15.37:0/2024319843 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fca300a2b90 0x7fca300a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:34:34.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:34.626+0000 7fca4d800640 1 --2- 172.21.15.37:0/2024319843 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fca300a2b90 0x7fca300a5050 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fca3c0058c0 tx=0x7fca3c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:34:34.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:34.627+0000 7fca46000640 1 -- 172.21.15.37:0/2024319843 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fca340bc000 con 0x7fca48104f10 2024-09-11T23:34:34.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:34.820+0000 7fca50200640 1 -- 172.21.15.37:0/2024319843 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fca4802d990 con 0x7fca48104f10 2024-09-11T23:34:34.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:34.822+0000 7fca46000640 1 -- 172.21.15.37:0/2024319843 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) ==== 74+0+25054 (secure 0 0 0) 0x7fca340c0300 con 0x7fca48104f10 2024-09-11T23:34:34.822 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:34:34.822 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":95,"fsid":"8b03efce-7092-11ef-bcea-c7b262605968","created":"2024-09-11T23:07:59.386838+0000","modified":"2024-09-11T23:17:53.878617+0000","last_up_change":"2024-09-11T23:15:16.985748+0000","last_in_change":"2024-09-11T23:14:54.154116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:11:16.547642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:16:11.075859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T23:16:14.019910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-11T23:16:22.041463+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f76ccb11-fe3b-4df1-9a71-e6ca50de80e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1678472768},{"type":"v1","addr":"172.21.15.37:6803","nonce":1678472768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1678472768},{"type":"v1","addr":"172.21.15.37:6805","nonce":1678472768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1678472768},{"type":"v1","addr":"172.21.15.37:6809","nonce":1678472768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1678472768},{"type":"v1","addr":"172.21.15.37:6807","nonce":1678472768}]},"public_addr":"172.21.15.37:6803/1678472768","cluster_addr":"172.21.15.37:6805/1678472768","heartbeat_back_addr":"172.21.15.37:6809/1678472768","heartbeat_front_addr":"172.21.15.37:6807/1678472768","state":["exists","up"]},{"osd":1,"uuid":"13d26eed-1160-4b15-b66b-66c89066c66f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":141504725},{"type":"v1","addr":"172.21.15.123:6801","nonce":141504725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":141504725},{"type":"v1","addr":"172.21.15.123:6803","nonce":141504725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":141504725},{"type":"v1","addr":"172.21.15.123:6807","nonce":141504725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":141504725},{"type":"v1","addr":"172.21.15.123:6805","nonce":141504725}]},"public_addr":"172.21.15.123:6801/141504725","cluster_addr":"172.21.15.123:6803/141504725","heartbeat_back_addr":"172.21.15.123:6807/141504725","heartbeat_front_addr":"172.21.15.123:6805/141504725","state":["exists","up"]},{"osd":2,"uuid":"53daf4d5-2a43-4a89-bae9-f32b89b517f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":1866489133},{"type":"v1","addr":"172.21.15.160:6801","nonce":1866489133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":1866489133},{"type":"v1","addr":"172.21.15.160:6803","nonce":1866489133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":1866489133},{"type":"v1","addr":"172.21.15.160:6807","nonce":1866489133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":1866489133},{"type":"v1","addr":"172.21.15.160:6805","nonce":1866489133}]},"public_addr":"172.21.15.160:6801/1866489133","cluster_addr":"172.21.15.160:6803/1866489133","heartbeat_back_addr":"172.21.15.160:6807/1866489133","heartbeat_front_addr":"172.21.15.160:6805/1866489133","state":["exists","up"]},{"osd":3,"uuid":"7c819225-964b-44f2-93e5-1d7585eb0b36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":412656036},{"type":"v1","addr":"172.21.15.37:6811","nonce":412656036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":412656036},{"type":"v1","addr":"172.21.15.37:6813","nonce":412656036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":412656036},{"type":"v1","addr":"172.21.15.37:6817","nonce":412656036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":412656036},{"type":"v1","addr":"172.21.15.37:6815","nonce":412656036}]},"public_addr":"172.21.15.37:6811/412656036","cluster_addr":"172.21.15.37:6813/412656036","heartbeat_back_addr":"172.21.15.37:6817/412656036","heartbeat_front_addr":"172.21.15.37:6815/412656036","state":["exists","up"]},{"osd":4,"uuid":"e5ab5638-8c7e-4433-8dd0-ba57e28f39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":3228822066},{"type":"v1","addr":"172.21.15.123:6809","nonce":3228822066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":3228822066},{"type":"v1","addr":"172.21.15.123:6811","nonce":3228822066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":3228822066},{"type":"v1","addr":"172.21.15.123:6815","nonce":3228822066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":3228822066},{"type":"v1","addr":"172.21.15.123:6813","nonce":3228822066}]},"public_addr":"172.21.15.123:6809/3228822066","cluster_addr":"172.21.15.123:6811/3228822066","heartbeat_back_addr":"172.21.15.123:6815/3228822066","heartbeat_front_addr":"172.21.15.123:6813/3228822066","state":["exists","up"]},{"osd":5,"uuid":"7f080d49-eec8-4cd9-b410-b2e84139292e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":1618319675},{"type":"v1","addr":"172.21.15.160:6809","nonce":1618319675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":1618319675},{"type":"v1","addr":"172.21.15.160:6811","nonce":1618319675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":1618319675},{"type":"v1","addr":"172.21.15.160:6815","nonce":1618319675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":1618319675},{"type":"v1","addr":"172.21.15.160:6813","nonce":1618319675}]},"public_addr":"172.21.15.160:6809/1618319675","cluster_addr":"172.21.15.160:6811/1618319675","heartbeat_back_addr":"172.21.15.160:6815/1618319675","heartbeat_front_addr":"172.21.15.160:6813/1618319675","state":["exists","up"]},{"osd":6,"uuid":"d0881c4e-bd8d-4575-8c81-94d21825c227","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3541251299},{"type":"v1","addr":"172.21.15.37:6819","nonce":3541251299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3541251299},{"type":"v1","addr":"172.21.15.37:6821","nonce":3541251299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":3541251299},{"type":"v1","addr":"172.21.15.37:6825","nonce":3541251299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3541251299},{"type":"v1","addr":"172.21.15.37:6823","nonce":3541251299}]},"public_addr":"172.21.15.37:6819/3541251299","cluster_addr":"172.21.15.37:6821/3541251299","heartbeat_back_addr":"172.21.15.37:6825/3541251299","heartbeat_front_addr":"172.21.15.37:6823/3541251299","state":["exists","up"]},{"osd":7,"uuid":"04fbec2e-91b5-4a89-a4a3-472398c45288","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":4279933341},{"type":"v1","addr":"172.21.15.123:6817","nonce":4279933341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":4279933341},{"type":"v1","addr":"172.21.15.123:6819","nonce":4279933341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":4279933341},{"type":"v1","addr":"172.21.15.123:6823","nonce":4279933341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":4279933341},{"type":"v1","addr":"172.21.15.123:6821","nonce":4279933341}]},"public_addr":"172.21.15.123:6817/4279933341","cluster_addr":"172.21.15.123:6819/4279933341","heartbeat_back_addr":"172.21.15.123:6823/4279933341","heartbeat_front_addr":"172.21.15.123:6821/4279933341","state":["exists","up"]},{"osd":8,"uuid":"c77090a7-308e-4c6d-a56e-ce6f8e050ae5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":740968584},{"type":"v1","addr":"172.21.15.160:6817","nonce":740968584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":740968584},{"type":"v1","addr":"172.21.15.160:6819","nonce":740968584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":740968584},{"type":"v1","addr":"172.21.15.160:6823","nonce":740968584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":740968584},{"type":"v1","addr":"172.21.15.160:6821","nonce":740968584}]},"public_addr":"172.21.15.160:6817/740968584","cluster_addr":"172.21.15.160:6819/740968584","heartbeat_back_addr":"172.21.15.160:6823/740968584","heartbeat_front_addr":"172.21.15.160:6821/740968584","state":["exists","up"]},{"osd":9,"uuid":"bcd19bd4-88bc-46f7-b48c-af9e3d17aa96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":692114850},{"type":"v1","addr":"172.21.15.37:6827","nonce":692114850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":692114850},{"type":"v1","addr":"172.21.15.37:6829","nonce":692114850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":692114850},{"type":"v1","addr":"172.21.15.37:6833","nonce":692114850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":692114850},{"type":"v1","addr":"172.21.15.37:6831","nonce":692114850}]},"public_addr":"172.21.15.37:6827/692114850","cluster_addr":"172.21.15.37:6829/692114850","heartbeat_back_addr":"172.21.15.37:6833/692114850","heartbeat_front_addr":"172.21.15.37:6831/692114850","state":["exists","up"]},{"osd":10,"uuid":"9e956e6c-c28a-4a4c-b385-c458788858ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":471058996},{"type":"v1","addr":"172.21.15.123:6825","nonce":471058996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":471058996},{"type":"v1","addr":"172.21.15.123:6827","nonce":471058996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":471058996},{"type":"v1","addr":"172.21.15.123:6831","nonce":471058996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":471058996},{"type":"v1","addr":"172.21.15.123:6829","nonce":471058996}]},"public_addr":"172.21.15.123:6825/471058996","cluster_addr":"172.21.15.123:6827/471058996","heartbeat_back_addr":"172.21.15.123:6831/471058996","heartbeat_front_addr":"172.21.15.123:6829/471058996","state":["exists","up"]},{"osd":11,"uuid":"0b5b3364-9a40-4cab-90d4-b7b1cba57bc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":3982315018},{"type":"v1","addr":"172.21.15.160:6825","nonce":3982315018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3982315018},{"type":"v1","addr":"172.21.15.160:6827","nonce":3982315018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3982315018},{"type":"v1","addr":"172.21.15.160:6831","nonce":3982315018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3982315018},{"type":"v1","addr":"172.21.15.160:6829","nonce":3982315018}]},"public_addr":"172.21.15.160:6825/3982315018","cluster_addr":"172.21.15.160:6827/3982315018","heartbeat_back_addr":"172.21.15.160:6831/3982315018","heartbeat_front_addr":"172.21.15.160:6829/3982315018","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:10:21.139833+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:10:47.004960+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:11:11.460263+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:11:40.849286+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:12:06.497448+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:12:32.043206+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:13:01.402019+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:13:27.993489+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:13:52.291643+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:23.840299+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:49.448254+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:15:15.310947+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":1}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":7}]},{"pgid":"3.17","mappings":[{"from":4,"to":7}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.30","mappings":[{"from":1,"to":9}]},{"pgid":"3.38","mappings":[{"from":5,"to":8}]},{"pgid":"4.5","mappings":[{"from":9,"to":10}]},{"pgid":"4.b","mappings":[{"from":9,"to":8}]},{"pgid":"4.11","mappings":[{"from":5,"to":8}]},{"pgid":"4.16","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:6801/2886800769":"2024-09-12T23:08:51.934167+0000","172.21.15.37:0/1811301224":"2024-09-12T23:08:51.934167+0000","172.21.15.37:0/513883980":"2024-09-12T23:08:51.934167+0000","172.21.15.37:0/3698260188":"2024-09-12T23:08:23.793913+0000","172.21.15.37:6800/2886800769":"2024-09-12T23:08:51.934167+0000","172.21.15.37:0/4134736061":"2024-09-12T23:08:23.793913+0000","172.21.15.37:0/3426758476":"2024-09-12T23:08:51.934167+0000","172.21.15.37:0/2545840561":"2024-09-12T23:08:23.793913+0000","172.21.15.37:6801/3447426643":"2024-09-12T23:08:23.793913+0000","172.21.15.37:6800/3447426643":"2024-09-12T23:08:23.793913+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:34:34.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:34.824+0000 7fca50200640 1 -- 172.21.15.37:0/2024319843 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fca300a2b90 msgr2=0x7fca300a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:34:34.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:34.824+0000 7fca50200640 1 --2- 172.21.15.37:0/2024319843 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fca300a2b90 0x7fca300a5050 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fca3c0058c0 tx=0x7fca3c005f90 comp rx=0 tx=0).stop 2024-09-11T23:34:34.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:34.824+0000 7fca50200640 1 -- 172.21.15.37:0/2024319843 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fca48104f10 msgr2=0x7fca4819a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:34:34.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:34.824+0000 7fca50200640 1 --2- 172.21.15.37:0/2024319843 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fca48104f10 0x7fca4819a5b0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fca3402a910 tx=0x7fca34032ce0 comp rx=0 tx=0).stop 2024-09-11T23:34:34.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:34.824+0000 7fca50200640 1 -- 172.21.15.37:0/2024319843 shutdown_connections 2024-09-11T23:34:34.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:34.824+0000 7fca50200640 1 --2- 172.21.15.37:0/2024319843 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fca300a2b90 0x7fca300a5050 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:34:34.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:34.824+0000 7fca50200640 1 --2- 172.21.15.37:0/2024319843 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fca481058d0 0x7fca481a1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:34:34.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:34.824+0000 7fca50200640 1 --2- 172.21.15.37:0/2024319843 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fca48104f10 0x7fca4819a5b0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:34:34.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:34.824+0000 7fca50200640 1 --2- 172.21.15.37:0/2024319843 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fca48103d20 0x7fca4819a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:34:34.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:34.824+0000 7fca50200640 1 -- 172.21.15.37:0/2024319843 >> 172.21.15.37:0/2024319843 conn(0x7fca480ff480 msgr2=0x7fca48108240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:34:34.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:34.824+0000 7fca50200640 1 -- 172.21.15.37:0/2024319843 shutdown_connections 2024-09-11T23:34:34.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:34.824+0000 7fca50200640 1 -- 172.21.15.37:0/2024319843 wait complete. 2024-09-11T23:34:34.852 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-11T23:11:16.547642+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-11T23:16:11.075859+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-11T23:16:14.019910+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-11T23:16:22.041463+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '91', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-11T23:34:34.853 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-11T23:34:35.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.016+0000 7fa32cc00640 1 -- 172.21.15.37:0/3356594750 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3281035b0 msgr2=0x7fa328109e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:34:35.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.016+0000 7fa32cc00640 1 --2- 172.21.15.37:0/3356594750 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3281035b0 0x7fa328109e40 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fa320009ca0 tx=0x7fa32002a8c0 comp rx=0 tx=0).stop 2024-09-11T23:34:35.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.016+0000 7fa32cc00640 1 -- 172.21.15.37:0/3356594750 shutdown_connections 2024-09-11T23:34:35.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.016+0000 7fa32cc00640 1 --2- 172.21.15.37:0/3356594750 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa328102bf0 0x7fa328103070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:34:35.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.016+0000 7fa32cc00640 1 --2- 172.21.15.37:0/3356594750 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3281035b0 0x7fa328109e40 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:34:35.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.016+0000 7fa32cc00640 1 --2- 172.21.15.37:0/3356594750 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa328101a00 0x7fa328101e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:34:35.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.016+0000 7fa32cc00640 1 -- 172.21.15.37:0/3356594750 >> 172.21.15.37:0/3356594750 conn(0x7fa3280fd180 msgr2=0x7fa3280ff5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:34:35.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.016+0000 7fa32cc00640 1 -- 172.21.15.37:0/3356594750 shutdown_connections 2024-09-11T23:34:35.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.016+0000 7fa32cc00640 1 -- 172.21.15.37:0/3356594750 wait complete. 2024-09-11T23:34:35.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.017+0000 7fa32cc00640 1 Processor -- start 2024-09-11T23:34:35.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.017+0000 7fa32cc00640 1 -- start start 2024-09-11T23:34:35.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.017+0000 7fa32cc00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa328101a00 0x7fa328075fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:34:35.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.017+0000 7fa32cc00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa328102bf0 0x7fa3280745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:34:35.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.017+0000 7fa32cc00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa3281035b0 0x7fa328074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:34:35.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.017+0000 7fa32cc00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa32810d6d0 con 0x7fa328102bf0 2024-09-11T23:34:35.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.017+0000 7fa32cc00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fa32810d550 con 0x7fa328101a00 2024-09-11T23:34:35.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.017+0000 7fa32cc00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fa32810d850 con 0x7fa3281035b0 2024-09-11T23:34:35.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.018+0000 7fa31fe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa328102bf0 0x7fa3280745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:34:35.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.018+0000 7fa327e00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa3281035b0 0x7fa328074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:34:35.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.018+0000 7fa31fe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa328102bf0 0x7fa3280745e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55664/0 (socket says 172.21.15.37:55664) 2024-09-11T23:34:35.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.018+0000 7fa327e00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa3281035b0 0x7fa328074b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.37:55028/0 (socket says 172.21.15.37:55028) 2024-09-11T23:34:35.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.018+0000 7fa31fe00640 1 -- 172.21.15.37:0/1088912578 learned_addr learned my addr 172.21.15.37:0/1088912578 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:34:35.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.018+0000 7fa327400640 1 --2- 172.21.15.37:0/1088912578 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa328101a00 0x7fa328075fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:34:35.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.018+0000 7fa31fe00640 1 -- 172.21.15.37:0/1088912578 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa3281035b0 msgr2=0x7fa328074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:34:35.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.018+0000 7fa31fe00640 1 --2- 172.21.15.37:0/1088912578 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa3281035b0 0x7fa328074b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:34:35.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.018+0000 7fa31fe00640 1 -- 172.21.15.37:0/1088912578 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa328101a00 msgr2=0x7fa328075fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:34:35.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.018+0000 7fa31fe00640 1 --2- 172.21.15.37:0/1088912578 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa328101a00 0x7fa328075fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:34:35.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.018+0000 7fa31fe00640 1 -- 172.21.15.37:0/1088912578 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3280753b0 con 0x7fa328102bf0 2024-09-11T23:34:35.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.018+0000 7fa31fe00640 1 --2- 172.21.15.37:0/1088912578 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa328102bf0 0x7fa3280745e0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fa31000e9f0 tx=0x7fa31000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:34:35.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.019+0000 7fa324c00640 1 -- 172.21.15.37:0/1088912578 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa31000cd80 con 0x7fa328102bf0 2024-09-11T23:34:35.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.019+0000 7fa324c00640 1 -- 172.21.15.37:0/1088912578 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa310010910 con 0x7fa328102bf0 2024-09-11T23:34:35.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.019+0000 7fa32cc00640 1 -- 172.21.15.37:0/1088912578 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3281a1dc0 con 0x7fa328102bf0 2024-09-11T23:34:35.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.019+0000 7fa324c00640 1 -- 172.21.15.37:0/1088912578 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa310018990 con 0x7fa328102bf0 2024-09-11T23:34:35.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.019+0000 7fa32cc00640 1 -- 172.21.15.37:0/1088912578 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3281a2280 con 0x7fa328102bf0 2024-09-11T23:34:35.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.020+0000 7fa32cc00640 1 -- 172.21.15.37:0/1088912578 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa328108da0 con 0x7fa328102bf0 2024-09-11T23:34:35.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.022+0000 7fa324c00640 1 -- 172.21.15.37:0/1088912578 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 20) ==== 137833+0+0 (secure 0 0 0) 0x7fa310010ac0 con 0x7fa328102bf0 2024-09-11T23:34:35.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.023+0000 7fa324c00640 1 --2- 172.21.15.37:0/1088912578 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fa30c0a2c10 0x7fa30c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:34:35.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.023+0000 7fa324c00640 1 -- 172.21.15.37:0/1088912578 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9295+0+0 (secure 0 0 0) 0x7fa3100cf730 con 0x7fa328102bf0 2024-09-11T23:34:35.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.023+0000 7fa327400640 1 --2- 172.21.15.37:0/1088912578 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fa30c0a2c10 0x7fa30c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:34:35.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.024+0000 7fa327400640 1 --2- 172.21.15.37:0/1088912578 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fa30c0a2c10 0x7fa30c0a50d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fa328102a50 tx=0x7fa318005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:34:35.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.027+0000 7fa324c00640 1 -- 172.21.15.37:0/1088912578 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa31009bbc0 con 0x7fa328102bf0 2024-09-11T23:34:35.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.212+0000 7fa32cc00640 1 -- 172.21.15.37:0/1088912578 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fa328062df0 con 0x7fa328102bf0 2024-09-11T23:34:35.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.213+0000 7fa324c00640 1 -- 172.21.15.37:0/1088912578 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v95) ==== 93+0+10 (secure 0 0 0) 0x7fa31009fec0 con 0x7fa328102bf0 2024-09-11T23:34:35.212 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2024-09-11T23:34:35.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.215+0000 7fa32cc00640 1 -- 172.21.15.37:0/1088912578 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fa30c0a2c10 msgr2=0x7fa30c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:34:35.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.215+0000 7fa32cc00640 1 --2- 172.21.15.37:0/1088912578 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fa30c0a2c10 0x7fa30c0a50d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fa328102a50 tx=0x7fa318005f90 comp rx=0 tx=0).stop 2024-09-11T23:34:35.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.215+0000 7fa32cc00640 1 -- 172.21.15.37:0/1088912578 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa328102bf0 msgr2=0x7fa3280745e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:34:35.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.215+0000 7fa32cc00640 1 --2- 172.21.15.37:0/1088912578 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa328102bf0 0x7fa3280745e0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fa31000e9f0 tx=0x7fa31000eeb0 comp rx=0 tx=0).stop 2024-09-11T23:34:35.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.215+0000 7fa32cc00640 1 -- 172.21.15.37:0/1088912578 shutdown_connections 2024-09-11T23:34:35.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.215+0000 7fa32cc00640 1 --2- 172.21.15.37:0/1088912578 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fa30c0a2c10 0x7fa30c0a50d0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:34:35.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.215+0000 7fa32cc00640 1 --2- 172.21.15.37:0/1088912578 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa3281035b0 0x7fa328074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:34:35.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.215+0000 7fa32cc00640 1 --2- 172.21.15.37:0/1088912578 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa328102bf0 0x7fa3280745e0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:34:35.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.215+0000 7fa32cc00640 1 --2- 172.21.15.37:0/1088912578 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa328101a00 0x7fa328075fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:34:35.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.215+0000 7fa32cc00640 1 -- 172.21.15.37:0/1088912578 >> 172.21.15.37:0/1088912578 conn(0x7fa3280fd180 msgr2=0x7fa328105f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:34:35.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.215+0000 7fa32cc00640 1 -- 172.21.15.37:0/1088912578 shutdown_connections 2024-09-11T23:34:35.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.215+0000 7fa32cc00640 1 -- 172.21.15.37:0/1088912578 wait complete. 2024-09-11T23:34:35.232 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-11T23:34:35.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.394+0000 7f34e9c00640 1 -- 172.21.15.37:0/3326173080 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34e4103c10 msgr2=0x7f34e4104010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:34:35.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.394+0000 7f34e9c00640 1 --2- 172.21.15.37:0/3326173080 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34e4103c10 0x7f34e4104010 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f34d4009900 tx=0x7f34d402a3f0 comp rx=0 tx=0).stop 2024-09-11T23:34:35.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.394+0000 7f34e9c00640 1 -- 172.21.15.37:0/3326173080 shutdown_connections 2024-09-11T23:34:35.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.394+0000 7f34e9c00640 1 --2- 172.21.15.37:0/3326173080 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34e4104e00 0x7f34e4105280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:34:35.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.394+0000 7f34e9c00640 1 --2- 172.21.15.37:0/3326173080 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f34e41057c0 0x7f34e410c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:34:35.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.394+0000 7f34e9c00640 1 --2- 172.21.15.37:0/3326173080 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34e4103c10 0x7f34e4104010 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:34:35.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.394+0000 7f34e9c00640 1 -- 172.21.15.37:0/3326173080 >> 172.21.15.37:0/3326173080 conn(0x7f34e40ff390 msgr2=0x7f34e41017b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:34:35.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.394+0000 7f34e9c00640 1 -- 172.21.15.37:0/3326173080 shutdown_connections 2024-09-11T23:34:35.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.394+0000 7f34e9c00640 1 -- 172.21.15.37:0/3326173080 wait complete. 2024-09-11T23:34:35.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.395+0000 7f34e9c00640 1 Processor -- start 2024-09-11T23:34:35.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.395+0000 7f34e9c00640 1 -- start start 2024-09-11T23:34:35.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.395+0000 7f34e9c00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34e4103c10 0x7f34e4199f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:34:35.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.395+0000 7f34e9c00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f34e4104e00 0x7f34e419a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:34:35.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.395+0000 7f34e9c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34e41057c0 0x7f34e41a1520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:34:35.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.396+0000 7f34e9c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f34e410f890 con 0x7f34e41057c0 2024-09-11T23:34:35.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.396+0000 7f34e9c00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f34e410f710 con 0x7f34e4103c10 2024-09-11T23:34:35.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.396+0000 7f34e9c00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f34e410fa10 con 0x7f34e4104e00 2024-09-11T23:34:35.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.396+0000 7f34e9200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34e41057c0 0x7f34e41a1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:34:35.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.396+0000 7f34e9200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34e41057c0 0x7f34e41a1520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55686/0 (socket says 172.21.15.37:55686) 2024-09-11T23:34:35.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.396+0000 7f34e9200640 1 -- 172.21.15.37:0/978750456 learned_addr learned my addr 172.21.15.37:0/978750456 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:34:35.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.396+0000 7f34e3e00640 1 --2- 172.21.15.37:0/978750456 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34e4103c10 0x7f34e4199f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:34:35.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.396+0000 7f34e3400640 1 --2- 172.21.15.37:0/978750456 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f34e4104e00 0x7f34e419a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:34:35.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.396+0000 7f34e9200640 1 -- 172.21.15.37:0/978750456 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f34e4104e00 msgr2=0x7f34e419a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:34:35.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.396+0000 7f34e9200640 1 --2- 172.21.15.37:0/978750456 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f34e4104e00 0x7f34e419a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:34:35.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.396+0000 7f34e9200640 1 -- 172.21.15.37:0/978750456 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34e4103c10 msgr2=0x7f34e4199f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:34:35.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.396+0000 7f34e9200640 1 --2- 172.21.15.37:0/978750456 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34e4103c10 0x7f34e4199f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:34:35.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.396+0000 7f34e9200640 1 -- 172.21.15.37:0/978750456 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34e41a1b90 con 0x7f34e41057c0 2024-09-11T23:34:35.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.396+0000 7f34e3400640 1 --2- 172.21.15.37:0/978750456 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f34e4104e00 0x7f34e419a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:34:35.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.396+0000 7f34e9200640 1 --2- 172.21.15.37:0/978750456 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34e41057c0 0x7f34e41a1520 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f34dc00eb10 tx=0x7f34dc00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:34:35.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.397+0000 7f34e0c00640 1 -- 172.21.15.37:0/978750456 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34dc004b20 con 0x7f34e41057c0 2024-09-11T23:34:35.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.397+0000 7f34e0c00640 1 -- 172.21.15.37:0/978750456 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f34dc004cc0 con 0x7f34e41057c0 2024-09-11T23:34:35.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.397+0000 7f34e9c00640 1 -- 172.21.15.37:0/978750456 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34e41a1e80 con 0x7f34e41057c0 2024-09-11T23:34:35.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.397+0000 7f34e0c00640 1 -- 172.21.15.37:0/978750456 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34dc010760 con 0x7f34e41057c0 2024-09-11T23:34:35.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.397+0000 7f34e9c00640 1 -- 172.21.15.37:0/978750456 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34e41a2390 con 0x7f34e41057c0 2024-09-11T23:34:35.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.398+0000 7f34e9c00640 1 -- 172.21.15.37:0/978750456 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34e410afa0 con 0x7f34e41057c0 2024-09-11T23:34:35.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.400+0000 7f34e0c00640 1 -- 172.21.15.37:0/978750456 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 20) ==== 137833+0+0 (secure 0 0 0) 0x7f34dc005020 con 0x7f34e41057c0 2024-09-11T23:34:35.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.401+0000 7f34e0c00640 1 --2- 172.21.15.37:0/978750456 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f34c80a2c10 0x7f34c80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:34:35.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.401+0000 7f34e0c00640 1 -- 172.21.15.37:0/978750456 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9295+0+0 (secure 0 0 0) 0x7f34dc0cfae0 con 0x7f34e41057c0 2024-09-11T23:34:35.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.401+0000 7f34e3e00640 1 --2- 172.21.15.37:0/978750456 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f34c80a2c10 0x7f34c80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:34:35.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.402+0000 7f34e3e00640 1 --2- 172.21.15.37:0/978750456 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f34c80a2c10 0x7f34c80a50d0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f34d4005ab0 tx=0x7f34d4000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:34:35.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.405+0000 7f34e0c00640 1 -- 172.21.15.37:0/978750456 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f34dc09c620 con 0x7f34e41057c0 2024-09-11T23:34:35.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.590+0000 7f34e9c00640 1 -- 172.21.15.37:0/978750456 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f34e4062df0 con 0x7f34e41057c0 2024-09-11T23:34:35.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.591+0000 7f34e0c00640 1 -- 172.21.15.37:0/978750456 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v95) ==== 104+0+11 (secure 0 0 0) 0x7f34dc09bf20 con 0x7f34e41057c0 2024-09-11T23:34:35.590 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2024-09-11T23:34:35.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.593+0000 7f34e9c00640 1 -- 172.21.15.37:0/978750456 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f34c80a2c10 msgr2=0x7f34c80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:34:35.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.593+0000 7f34e9c00640 1 --2- 172.21.15.37:0/978750456 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f34c80a2c10 0x7f34c80a50d0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f34d4005ab0 tx=0x7f34d4000bc0 comp rx=0 tx=0).stop 2024-09-11T23:34:35.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.593+0000 7f34e9c00640 1 -- 172.21.15.37:0/978750456 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34e41057c0 msgr2=0x7f34e41a1520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:34:35.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.593+0000 7f34e9c00640 1 --2- 172.21.15.37:0/978750456 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34e41057c0 0x7f34e41a1520 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f34dc00eb10 tx=0x7f34dc00c2d0 comp rx=0 tx=0).stop 2024-09-11T23:34:35.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.593+0000 7f34e9c00640 1 -- 172.21.15.37:0/978750456 shutdown_connections 2024-09-11T23:34:35.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.593+0000 7f34e9c00640 1 --2- 172.21.15.37:0/978750456 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f34c80a2c10 0x7f34c80a50d0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:34:35.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.593+0000 7f34e9c00640 1 --2- 172.21.15.37:0/978750456 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34e41057c0 0x7f34e41a1520 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:34:35.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.593+0000 7f34e9c00640 1 --2- 172.21.15.37:0/978750456 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f34e4104e00 0x7f34e419a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:34:35.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.593+0000 7f34e9c00640 1 --2- 172.21.15.37:0/978750456 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34e4103c10 0x7f34e4199f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:34:35.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.593+0000 7f34e9c00640 1 -- 172.21.15.37:0/978750456 >> 172.21.15.37:0/978750456 conn(0x7f34e40ff390 msgr2=0x7f34e4108170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:34:35.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.593+0000 7f34e9c00640 1 -- 172.21.15.37:0/978750456 shutdown_connections 2024-09-11T23:34:35.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.593+0000 7f34e9c00640 1 -- 172.21.15.37:0/978750456 wait complete. 2024-09-11T23:34:35.609 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-11T23:34:35.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.771+0000 7fa5ea800640 1 -- 172.21.15.37:0/31538442 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa5e4103d30 msgr2=0x7fa5e4104130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:34:35.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.771+0000 7fa5ea800640 1 --2- 172.21.15.37:0/31538442 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa5e4103d30 0x7fa5e4104130 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa5d4009860 tx=0x7fa5d402a340 comp rx=0 tx=0).stop 2024-09-11T23:34:35.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.771+0000 7fa5ea800640 1 -- 172.21.15.37:0/31538442 shutdown_connections 2024-09-11T23:34:35.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.771+0000 7fa5ea800640 1 --2- 172.21.15.37:0/31538442 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5e41058e0 0x7fa5e410c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:34:35.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.771+0000 7fa5ea800640 1 --2- 172.21.15.37:0/31538442 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa5e4104f20 0x7fa5e41053a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:34:35.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.771+0000 7fa5ea800640 1 --2- 172.21.15.37:0/31538442 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa5e4103d30 0x7fa5e4104130 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:34:35.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.771+0000 7fa5ea800640 1 -- 172.21.15.37:0/31538442 >> 172.21.15.37:0/31538442 conn(0x7fa5e40ff470 msgr2=0x7fa5e41018d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:34:35.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.771+0000 7fa5ea800640 1 -- 172.21.15.37:0/31538442 shutdown_connections 2024-09-11T23:34:35.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.771+0000 7fa5ea800640 1 -- 172.21.15.37:0/31538442 wait complete. 2024-09-11T23:34:35.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.772+0000 7fa5ea800640 1 Processor -- start 2024-09-11T23:34:35.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.772+0000 7fa5ea800640 1 -- start start 2024-09-11T23:34:35.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.772+0000 7fa5ea800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa5e4103d30 0x7fa5e419a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:34:35.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.772+0000 7fa5ea800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5e4104f20 0x7fa5e419a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:34:35.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.772+0000 7fa5ea800640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa5e41058e0 0x7fa5e41a1650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:34:35.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.772+0000 7fa5ea800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa5e410f9b0 con 0x7fa5e4104f20 2024-09-11T23:34:35.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.772+0000 7fa5ea800640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fa5e410f830 con 0x7fa5e4103d30 2024-09-11T23:34:35.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.772+0000 7fa5ea800640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fa5e410fb30 con 0x7fa5e41058e0 2024-09-11T23:34:35.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.773+0000 7fa5dbe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5e4104f20 0x7fa5e419a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:34:35.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.773+0000 7fa5dbe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5e4104f20 0x7fa5e419a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55710/0 (socket says 172.21.15.37:55710) 2024-09-11T23:34:35.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.773+0000 7fa5dbe00640 1 -- 172.21.15.37:0/1483159258 learned_addr learned my addr 172.21.15.37:0/1483159258 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:34:35.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.773+0000 7fa5e3400640 1 --2- 172.21.15.37:0/1483159258 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa5e4103d30 0x7fa5e419a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:34:35.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.773+0000 7fa5e3e00640 1 --2- 172.21.15.37:0/1483159258 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa5e41058e0 0x7fa5e41a1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:34:35.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.773+0000 7fa5dbe00640 1 -- 172.21.15.37:0/1483159258 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa5e41058e0 msgr2=0x7fa5e41a1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:34:35.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.773+0000 7fa5dbe00640 1 --2- 172.21.15.37:0/1483159258 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa5e41058e0 0x7fa5e41a1650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:34:35.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.773+0000 7fa5dbe00640 1 -- 172.21.15.37:0/1483159258 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa5e4103d30 msgr2=0x7fa5e419a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:34:35.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.773+0000 7fa5dbe00640 1 --2- 172.21.15.37:0/1483159258 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa5e4103d30 0x7fa5e419a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:34:35.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.773+0000 7fa5dbe00640 1 -- 172.21.15.37:0/1483159258 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5e41a1cc0 con 0x7fa5e4104f20 2024-09-11T23:34:35.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.773+0000 7fa5dbe00640 1 --2- 172.21.15.37:0/1483159258 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5e4104f20 0x7fa5e419a5e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fa5cc00e9f0 tx=0x7fa5cc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:34:35.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.774+0000 7fa5e0c00640 1 -- 172.21.15.37:0/1483159258 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5cc00cd80 con 0x7fa5e4104f20 2024-09-11T23:34:35.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.774+0000 7fa5e0c00640 1 -- 172.21.15.37:0/1483159258 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa5cc005500 con 0x7fa5e4104f20 2024-09-11T23:34:35.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.774+0000 7fa5e0c00640 1 -- 172.21.15.37:0/1483159258 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5cc010690 con 0x7fa5e4104f20 2024-09-11T23:34:35.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.774+0000 7fa5ea800640 1 -- 172.21.15.37:0/1483159258 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5e41a1fb0 con 0x7fa5e4104f20 2024-09-11T23:34:35.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.774+0000 7fa5ea800640 1 -- 172.21.15.37:0/1483159258 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5e41a2420 con 0x7fa5e4104f20 2024-09-11T23:34:35.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.775+0000 7fa5ea800640 1 -- 172.21.15.37:0/1483159258 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5e410b210 con 0x7fa5e4104f20 2024-09-11T23:34:35.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.777+0000 7fa5e0c00640 1 -- 172.21.15.37:0/1483159258 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 20) ==== 137833+0+0 (secure 0 0 0) 0x7fa5cc0046c0 con 0x7fa5e4104f20 2024-09-11T23:34:35.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.779+0000 7fa5e0c00640 1 --2- 172.21.15.37:0/1483159258 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fa5c80a2b90 0x7fa5c80a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:34:35.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.779+0000 7fa5e0c00640 1 -- 172.21.15.37:0/1483159258 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9295+0+0 (secure 0 0 0) 0x7fa5cc0cf890 con 0x7fa5e4104f20 2024-09-11T23:34:35.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.779+0000 7fa5e3400640 1 --2- 172.21.15.37:0/1483159258 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fa5c80a2b90 0x7fa5c80a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:34:35.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.780+0000 7fa5e3400640 1 --2- 172.21.15.37:0/1483159258 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fa5c80a2b90 0x7fa5c80a5050 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fa5d4030410 tx=0x7fa5d4030550 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:34:35.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.783+0000 7fa5e0c00640 1 -- 172.21.15.37:0/1483159258 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa5cc09c370 con 0x7fa5e4104f20 2024-09-11T23:34:35.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.968+0000 7fa5ea800640 1 -- 172.21.15.37:0/1483159258 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fa5e4062e90 con 0x7fa5e4104f20 2024-09-11T23:34:35.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.968+0000 7fa5e0c00640 1 -- 172.21.15.37:0/1483159258 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v95) ==== 100+0+11 (secure 0 0 0) 0x7fa5cc09bc70 con 0x7fa5e4104f20 2024-09-11T23:34:35.968 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2024-09-11T23:34:35.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.971+0000 7fa5ea800640 1 -- 172.21.15.37:0/1483159258 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fa5c80a2b90 msgr2=0x7fa5c80a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:34:35.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.971+0000 7fa5ea800640 1 --2- 172.21.15.37:0/1483159258 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fa5c80a2b90 0x7fa5c80a5050 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fa5d4030410 tx=0x7fa5d4030550 comp rx=0 tx=0).stop 2024-09-11T23:34:35.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.971+0000 7fa5ea800640 1 -- 172.21.15.37:0/1483159258 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5e4104f20 msgr2=0x7fa5e419a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:34:35.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.971+0000 7fa5ea800640 1 --2- 172.21.15.37:0/1483159258 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5e4104f20 0x7fa5e419a5e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fa5cc00e9f0 tx=0x7fa5cc00edf0 comp rx=0 tx=0).stop 2024-09-11T23:34:35.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.971+0000 7fa5ea800640 1 -- 172.21.15.37:0/1483159258 shutdown_connections 2024-09-11T23:34:35.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.971+0000 7fa5ea800640 1 --2- 172.21.15.37:0/1483159258 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fa5c80a2b90 0x7fa5c80a5050 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:34:35.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.971+0000 7fa5ea800640 1 --2- 172.21.15.37:0/1483159258 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa5e41058e0 0x7fa5e41a1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:34:35.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.971+0000 7fa5ea800640 1 --2- 172.21.15.37:0/1483159258 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5e4104f20 0x7fa5e419a5e0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:34:35.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.971+0000 7fa5ea800640 1 --2- 172.21.15.37:0/1483159258 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa5e4103d30 0x7fa5e419a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:34:35.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.971+0000 7fa5ea800640 1 -- 172.21.15.37:0/1483159258 >> 172.21.15.37:0/1483159258 conn(0x7fa5e40ff470 msgr2=0x7fa5e41083e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:34:35.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.971+0000 7fa5ea800640 1 -- 172.21.15.37:0/1483159258 shutdown_connections 2024-09-11T23:34:35.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:35.971+0000 7fa5ea800640 1 -- 172.21.15.37:0/1483159258 wait complete. 2024-09-11T23:34:35.984 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:34:35 smithi037 ceph-mon[30630]: pgmap v856: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 7.0 MiB/s wr, 747 op/s 2024-09-11T23:34:35.985 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:34:35 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/2024319843' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:34:35.985 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:34:35 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/1088912578' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-11T23:34:35.985 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:34:35 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/978750456' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-11T23:34:35.987 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-11T23:34:36.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:36.155+0000 7f1933200640 1 -- 172.21.15.37:0/556480414 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1934074c50 msgr2=0x7f19340750b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:34:36.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:36.155+0000 7f1933200640 1 --2- 172.21.15.37:0/556480414 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1934074c50 0x7f19340750b0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f191c009900 tx=0x7f191c02a410 comp rx=0 tx=0).stop 2024-09-11T23:34:36.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:36.155+0000 7f1933200640 1 -- 172.21.15.37:0/556480414 shutdown_connections 2024-09-11T23:34:36.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:36.155+0000 7f1933200640 1 --2- 172.21.15.37:0/556480414 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f193410dfc0 0x7f19341103b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:34:36.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:36.155+0000 7f1933200640 1 --2- 172.21.15.37:0/556480414 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1934074c50 0x7f19340750b0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:34:36.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:36.155+0000 7f1933200640 1 --2- 172.21.15.37:0/556480414 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1934076230 0x7f1934074680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:34:36.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:36.155+0000 7f1933200640 1 -- 172.21.15.37:0/556480414 >> 172.21.15.37:0/556480414 conn(0x7f19340fd190 msgr2=0x7f19340ff5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:34:36.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:36.155+0000 7f1933200640 1 -- 172.21.15.37:0/556480414 shutdown_connections 2024-09-11T23:34:36.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:36.155+0000 7f1933200640 1 -- 172.21.15.37:0/556480414 wait complete. 2024-09-11T23:34:36.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:36.156+0000 7f1933200640 1 Processor -- start 2024-09-11T23:34:36.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:36.156+0000 7f1933200640 1 -- start start 2024-09-11T23:34:36.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:36.156+0000 7f1933200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1934074c50 0x7f193419e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:34:36.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:36.156+0000 7f1933200640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1934076230 0x7f193419e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:34:36.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:36.156+0000 7f1933200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f193410dfc0 0x7f19341a58c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:34:36.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:36.156+0000 7f1933200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1934113c80 con 0x7f193410dfc0 2024-09-11T23:34:36.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:36.156+0000 7f1933200640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f1934113b00 con 0x7f1934074c50 2024-09-11T23:34:36.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:36.156+0000 7f1933200640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f1934113e00 con 0x7f1934076230 2024-09-11T23:34:36.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:36.156+0000 7f1932800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f193410dfc0 0x7f19341a58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:34:36.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:36.156+0000 7f1932800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f193410dfc0 0x7f19341a58c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55734/0 (socket says 172.21.15.37:55734) 2024-09-11T23:34:36.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:36.156+0000 7f1932800640 1 -- 172.21.15.37:0/3683466141 learned_addr learned my addr 172.21.15.37:0/3683466141 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:34:36.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:36.156+0000 7f1931e00640 1 --2- 172.21.15.37:0/3683466141 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1934074c50 0x7f193419e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:34:36.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:36.156+0000 7f1929400640 1 --2- 172.21.15.37:0/3683466141 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1934076230 0x7f193419e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:34:36.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:36.157+0000 7f1932800640 1 -- 172.21.15.37:0/3683466141 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1934076230 msgr2=0x7f193419e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:34:36.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:36.157+0000 7f1932800640 1 --2- 172.21.15.37:0/3683466141 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1934076230 0x7f193419e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:34:36.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:36.157+0000 7f1932800640 1 -- 172.21.15.37:0/3683466141 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1934074c50 msgr2=0x7f193419e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:34:36.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:36.157+0000 7f1932800640 1 --2- 172.21.15.37:0/3683466141 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1934074c50 0x7f193419e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:34:36.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:36.157+0000 7f1932800640 1 -- 172.21.15.37:0/3683466141 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19341a5f30 con 0x7f193410dfc0 2024-09-11T23:34:36.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:36.157+0000 7f1931e00640 1 --2- 172.21.15.37:0/3683466141 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1934074c50 0x7f193419e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:34:36.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:36.157+0000 7f1932800640 1 --2- 172.21.15.37:0/3683466141 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f193410dfc0 0x7f19341a58c0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f192c00eb10 tx=0x7f192c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:34:36.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:36.157+0000 7f192b400640 1 -- 172.21.15.37:0/3683466141 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f192c004b20 con 0x7f193410dfc0 2024-09-11T23:34:36.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:36.157+0000 7f192b400640 1 -- 172.21.15.37:0/3683466141 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f192c004cc0 con 0x7f193410dfc0 2024-09-11T23:34:36.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:36.157+0000 7f1933200640 1 -- 172.21.15.37:0/3683466141 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19341a6220 con 0x7f193410dfc0 2024-09-11T23:34:36.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:36.157+0000 7f192b400640 1 -- 172.21.15.37:0/3683466141 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f192c010760 con 0x7f193410dfc0 2024-09-11T23:34:36.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:36.158+0000 7f1933200640 1 -- 172.21.15.37:0/3683466141 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19341a6740 con 0x7f193410dfc0 2024-09-11T23:34:36.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:36.159+0000 7f1933200640 1 -- 172.21.15.37:0/3683466141 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1934104070 con 0x7f193410dfc0 2024-09-11T23:34:36.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:36.160+0000 7f192b400640 1 -- 172.21.15.37:0/3683466141 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 20) ==== 137833+0+0 (secure 0 0 0) 0x7f192c005020 con 0x7f193410dfc0 2024-09-11T23:34:36.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:36.162+0000 7f192b400640 1 --2- 172.21.15.37:0/3683466141 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f19180a2b90 0x7f19180a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:34:36.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:36.162+0000 7f192b400640 1 -- 172.21.15.37:0/3683466141 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9295+0+0 (secure 0 0 0) 0x7f192c0cfb60 con 0x7f193410dfc0 2024-09-11T23:34:36.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:36.162+0000 7f1931e00640 1 --2- 172.21.15.37:0/3683466141 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f19180a2b90 0x7f19180a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:34:36.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:36.163+0000 7f1931e00640 1 --2- 172.21.15.37:0/3683466141 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f19180a2b90 0x7f19180a5050 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f1924009fc0 tx=0x7f1924005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:34:36.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:36.166+0000 7f192b400640 1 -- 172.21.15.37:0/3683466141 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f192c09c640 con 0x7f193410dfc0 2024-09-11T23:34:36.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:34:35 smithi160 ceph-mon[35055]: pgmap v856: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 7.0 MiB/s wr, 747 op/s 2024-09-11T23:34:36.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:34:35 smithi160 ceph-mon[35055]: from='client.? 172.21.15.37:0/2024319843' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:34:36.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:34:35 smithi160 ceph-mon[35055]: from='client.? 172.21.15.37:0/1088912578' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-11T23:34:36.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:34:35 smithi160 ceph-mon[35055]: from='client.? 172.21.15.37:0/978750456' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-11T23:34:36.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:34:35 smithi123 ceph-mon[35438]: pgmap v856: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 7.0 MiB/s wr, 747 op/s 2024-09-11T23:34:36.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:34:35 smithi123 ceph-mon[35438]: from='client.? 172.21.15.37:0/2024319843' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:34:36.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:34:35 smithi123 ceph-mon[35438]: from='client.? 172.21.15.37:0/1088912578' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-11T23:34:36.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:34:35 smithi123 ceph-mon[35438]: from='client.? 172.21.15.37:0/978750456' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-11T23:34:36.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:36.351+0000 7f1933200640 1 -- 172.21.15.37:0/3683466141 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f1934062df0 con 0x7f193410dfc0 2024-09-11T23:34:36.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:36.352+0000 7f192b400640 1 -- 172.21.15.37:0/3683466141 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v95) ==== 103+0+11 (secure 0 0 0) 0x7f192c09bf40 con 0x7f193410dfc0 2024-09-11T23:34:36.352 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2024-09-11T23:34:36.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:36.354+0000 7f1933200640 1 -- 172.21.15.37:0/3683466141 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f19180a2b90 msgr2=0x7f19180a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:34:36.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:36.354+0000 7f1933200640 1 --2- 172.21.15.37:0/3683466141 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f19180a2b90 0x7f19180a5050 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f1924009fc0 tx=0x7f1924005f90 comp rx=0 tx=0).stop 2024-09-11T23:34:36.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:36.354+0000 7f1933200640 1 -- 172.21.15.37:0/3683466141 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f193410dfc0 msgr2=0x7f19341a58c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:34:36.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:36.354+0000 7f1933200640 1 --2- 172.21.15.37:0/3683466141 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f193410dfc0 0x7f19341a58c0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f192c00eb10 tx=0x7f192c00c2d0 comp rx=0 tx=0).stop 2024-09-11T23:34:36.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:36.354+0000 7f1933200640 1 -- 172.21.15.37:0/3683466141 shutdown_connections 2024-09-11T23:34:36.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:36.354+0000 7f1933200640 1 --2- 172.21.15.37:0/3683466141 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f19180a2b90 0x7f19180a5050 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:34:36.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:36.354+0000 7f1933200640 1 --2- 172.21.15.37:0/3683466141 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f193410dfc0 0x7f19341a58c0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:34:36.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:36.354+0000 7f1933200640 1 --2- 172.21.15.37:0/3683466141 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1934076230 0x7f193419e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:34:36.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:36.354+0000 7f1933200640 1 --2- 172.21.15.37:0/3683466141 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1934074c50 0x7f193419e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:34:36.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:36.354+0000 7f1933200640 1 -- 172.21.15.37:0/3683466141 >> 172.21.15.37:0/3683466141 conn(0x7f19340fd190 msgr2=0x7f1934101240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:34:36.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:36.354+0000 7f1933200640 1 -- 172.21.15.37:0/3683466141 shutdown_connections 2024-09-11T23:34:36.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:36.354+0000 7f1933200640 1 -- 172.21.15.37:0/3683466141 wait complete. 2024-09-11T23:34:36.370 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-11T23:34:36.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:36.529+0000 7f8cd8000640 1 -- 172.21.15.37:0/423727420 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8cd0103d30 msgr2=0x7f8cd0104130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:34:36.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:36.529+0000 7f8cd8000640 1 --2- 172.21.15.37:0/423727420 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8cd0103d30 0x7f8cd0104130 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8cc4009ca0 tx=0x7f8cc402a8c0 comp rx=0 tx=0).stop 2024-09-11T23:34:36.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:36.529+0000 7f8cd8000640 1 -- 172.21.15.37:0/423727420 shutdown_connections 2024-09-11T23:34:36.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:36.529+0000 7f8cd8000640 1 --2- 172.21.15.37:0/423727420 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8cd01058e0 0x7f8cd010c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:34:36.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:36.529+0000 7f8cd8000640 1 --2- 172.21.15.37:0/423727420 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8cd0104f20 0x7f8cd01053a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:34:36.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:36.529+0000 7f8cd8000640 1 --2- 172.21.15.37:0/423727420 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8cd0103d30 0x7f8cd0104130 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:34:36.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:36.529+0000 7f8cd8000640 1 -- 172.21.15.37:0/423727420 >> 172.21.15.37:0/423727420 conn(0x7f8cd00ff4b0 msgr2=0x7f8cd01018d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:34:36.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:36.529+0000 7f8cd8000640 1 -- 172.21.15.37:0/423727420 shutdown_connections 2024-09-11T23:34:36.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:36.529+0000 7f8cd8000640 1 -- 172.21.15.37:0/423727420 wait complete. 2024-09-11T23:34:36.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:36.530+0000 7f8cd8000640 1 Processor -- start 2024-09-11T23:34:36.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:36.530+0000 7f8cd8000640 1 -- start start 2024-09-11T23:34:36.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:36.530+0000 7f8cd8000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8cd0103d30 0x7f8cd019a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:34:36.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:36.530+0000 7f8cd8000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8cd0104f20 0x7f8cd019a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:34:36.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:36.530+0000 7f8cd8000640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8cd01058e0 0x7f8cd01a1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:34:36.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:36.530+0000 7f8cd8000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8cd010f990 con 0x7f8cd0103d30 2024-09-11T23:34:36.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:36.530+0000 7f8cd8000640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f8cd010f810 con 0x7f8cd0104f20 2024-09-11T23:34:36.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:36.530+0000 7f8cd8000640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f8cd010fb10 con 0x7f8cd01058e0 2024-09-11T23:34:36.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:36.531+0000 7f8cd5600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8cd0103d30 0x7f8cd019a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:34:36.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:36.531+0000 7f8cd5600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8cd0103d30 0x7f8cd019a050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55758/0 (socket says 172.21.15.37:55758) 2024-09-11T23:34:36.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:36.531+0000 7f8cd5600640 1 -- 172.21.15.37:0/1659108324 learned_addr learned my addr 172.21.15.37:0/1659108324 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:34:36.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:36.531+0000 7f8cd6000640 1 --2- 172.21.15.37:0/1659108324 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8cd01058e0 0x7f8cd01a1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:34:36.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:36.531+0000 7f8cd4c00640 1 --2- 172.21.15.37:0/1659108324 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8cd0104f20 0x7f8cd019a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:34:36.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:36.531+0000 7f8cd5600640 1 -- 172.21.15.37:0/1659108324 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8cd01058e0 msgr2=0x7f8cd01a1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:34:36.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:36.531+0000 7f8cd5600640 1 --2- 172.21.15.37:0/1659108324 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8cd01058e0 0x7f8cd01a1600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:34:36.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:36.531+0000 7f8cd5600640 1 -- 172.21.15.37:0/1659108324 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8cd0104f20 msgr2=0x7f8cd019a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:34:36.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:36.531+0000 7f8cd5600640 1 --2- 172.21.15.37:0/1659108324 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8cd0104f20 0x7f8cd019a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:34:36.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:36.531+0000 7f8cd5600640 1 -- 172.21.15.37:0/1659108324 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cd01a1c70 con 0x7f8cd0103d30 2024-09-11T23:34:36.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:36.531+0000 7f8cd4c00640 1 --2- 172.21.15.37:0/1659108324 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8cd0104f20 0x7f8cd019a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:34:36.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:36.531+0000 7f8cd5600640 1 --2- 172.21.15.37:0/1659108324 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8cd0103d30 0x7f8cd019a050 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f8cc4009bf0 tx=0x7f8cc4031ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:34:36.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:36.532+0000 7f8cce000640 1 -- 172.21.15.37:0/1659108324 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cc402fa20 con 0x7f8cd0103d30 2024-09-11T23:34:36.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:36.532+0000 7f8cce000640 1 -- 172.21.15.37:0/1659108324 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8cc402fbc0 con 0x7f8cd0103d30 2024-09-11T23:34:36.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:36.532+0000 7f8cce000640 1 -- 172.21.15.37:0/1659108324 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cc4046750 con 0x7f8cd0103d30 2024-09-11T23:34:36.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:36.532+0000 7f8cd8000640 1 -- 172.21.15.37:0/1659108324 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cd01a1f00 con 0x7f8cd0103d30 2024-09-11T23:34:36.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:36.532+0000 7f8cd8000640 1 -- 172.21.15.37:0/1659108324 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cd01a2360 con 0x7f8cd0103d30 2024-09-11T23:34:36.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:36.533+0000 7f8cd8000640 1 -- 172.21.15.37:0/1659108324 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8cd010b1c0 con 0x7f8cd0103d30 2024-09-11T23:34:36.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:36.535+0000 7f8cce000640 1 -- 172.21.15.37:0/1659108324 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 20) ==== 137833+0+0 (secure 0 0 0) 0x7f8cc402fd70 con 0x7f8cd0103d30 2024-09-11T23:34:36.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:36.537+0000 7f8cce000640 1 --2- 172.21.15.37:0/1659108324 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f8cb80a2b90 0x7f8cb80a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:34:36.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:36.537+0000 7f8cce000640 1 -- 172.21.15.37:0/1659108324 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9295+0+0 (secure 0 0 0) 0x7f8cc40f0890 con 0x7f8cd0103d30 2024-09-11T23:34:36.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:36.537+0000 7f8cd4c00640 1 --2- 172.21.15.37:0/1659108324 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f8cb80a2b90 0x7f8cb80a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:34:36.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:36.538+0000 7f8cd4c00640 1 --2- 172.21.15.37:0/1659108324 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f8cb80a2b90 0x7f8cb80a5050 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f8cd019b560 tx=0x7f8cbc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:34:36.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:36.541+0000 7f8cce000640 1 -- 172.21.15.37:0/1659108324 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8cc40bd370 con 0x7f8cd0103d30 2024-09-11T23:34:36.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:36.774+0000 7f8cd8000640 1 -- 172.21.15.37:0/1659108324 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7f8cd0062ec0 con 0x7f8cd0103d30 2024-09-11T23:34:36.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:36.785+0000 7f8cce000640 1 -- 172.21.15.37:0/1659108324 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v20) ==== 81+0+740360 (secure 0 0 0) 0x7f8cc40bcc70 con 0x7f8cd0103d30 2024-09-11T23:34:36.795 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:34:36.795 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-11T23:34:36.795 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 20, 2024-09-11T23:34:36.795 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.795 INFO:teuthology.orchestra.run.smithi037.stdout: "active_gid": 14150, 2024-09-11T23:34:36.795 INFO:teuthology.orchestra.run.smithi037.stdout: "active_name": "x", 2024-09-11T23:34:36.796 INFO:teuthology.orchestra.run.smithi037.stdout: "active_addrs": { 2024-09-11T23:34:36.796 INFO:teuthology.orchestra.run.smithi037.stdout: "addrvec": [ 2024-09-11T23:34:36.796 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:34:36.796 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v2", 2024-09-11T23:34:36.796 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.37:6800", 2024-09-11T23:34:36.796 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 31543269 2024-09-11T23:34:36.796 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.796 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:34:36.796 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2024-09-11T23:34:36.796 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.37:6801", 2024-09-11T23:34:36.796 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 31543269 2024-09-11T23:34:36.796 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:36.796 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2024-09-11T23:34:36.797 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.797 INFO:teuthology.orchestra.run.smithi037.stdout: "active_addr": "172.21.15.37:6801/31543269", 2024-09-11T23:34:36.797 INFO:teuthology.orchestra.run.smithi037.stdout: "active_change": "2024-09-11T23:08:51.934273+0000", 2024-09-11T23:34:36.797 INFO:teuthology.orchestra.run.smithi037.stdout: "active_mgr_features": 4540701547738038271, 2024-09-11T23:34:36.797 INFO:teuthology.orchestra.run.smithi037.stdout: "available": true, 2024-09-11T23:34:36.797 INFO:teuthology.orchestra.run.smithi037.stdout: "standbys": [ 2024-09-11T23:34:36.797 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:34:36.797 INFO:teuthology.orchestra.run.smithi037.stdout: "gid": 24109, 2024-09-11T23:34:36.797 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "z", 2024-09-11T23:34:36.797 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr_features": 4540701547738038271, 2024-09-11T23:34:36.797 INFO:teuthology.orchestra.run.smithi037.stdout: "available_modules": [ 2024-09-11T23:34:36.797 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:34:36.797 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "alerts", 2024-09-11T23:34:36.798 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-11T23:34:36.798 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-11T23:34:36.798 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-11T23:34:36.798 INFO:teuthology.orchestra.run.smithi037.stdout: "interval": { 2024-09-11T23:34:36.798 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "interval", 2024-09-11T23:34:36.798 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-11T23:34:36.798 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.798 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:36.798 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "60", 2024-09-11T23:34:36.798 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.798 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.798 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.798 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "How frequently to reexamine health status", 2024-09-11T23:34:36.798 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.799 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.799 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.799 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.799 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-11T23:34:36.799 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-11T23:34:36.799 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:36.799 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.799 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:36.799 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:36.799 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.799 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.799 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:36.800 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:36.800 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:36.800 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:36.800 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:36.800 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:36.800 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:36.800 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:36.800 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:36.800 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.800 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.800 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.800 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.801 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-11T23:34:36.801 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-11T23:34:36.801 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:36.801 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.801 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:36.801 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:36.801 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.801 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.801 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.801 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:36.801 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.801 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.801 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.802 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.802 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-11T23:34:36.802 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-11T23:34:36.802 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:36.802 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.802 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:36.802 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-11T23:34:36.802 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.802 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.802 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:36.802 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:36.802 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:36.802 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:36.803 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:36.803 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:36.803 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:36.803 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:36.803 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:36.803 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.803 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.803 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.803 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.803 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-11T23:34:36.803 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-11T23:34:36.803 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:36.803 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.803 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:36.804 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:36.804 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.804 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.804 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.804 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:36.804 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.804 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.804 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.804 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.804 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_destination": { 2024-09-11T23:34:36.804 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_destination", 2024-09-11T23:34:36.804 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:36.804 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.805 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:36.805 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:36.805 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.805 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.805 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.805 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Email address to send alerts to", 2024-09-11T23:34:36.805 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.805 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.805 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.805 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.805 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_from_name": { 2024-09-11T23:34:36.805 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_from_name", 2024-09-11T23:34:36.805 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:36.806 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.806 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:36.806 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "Ceph", 2024-09-11T23:34:36.806 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.806 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.806 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.806 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Email From: name", 2024-09-11T23:34:36.806 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.806 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.806 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.806 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.806 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_host": { 2024-09-11T23:34:36.807 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_host", 2024-09-11T23:34:36.807 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:36.807 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.807 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:36.807 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:36.807 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.807 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.807 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.807 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "SMTP server", 2024-09-11T23:34:36.807 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.807 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.807 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.807 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.807 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_password": { 2024-09-11T23:34:36.808 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_password", 2024-09-11T23:34:36.808 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:36.808 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.808 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:36.808 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:36.808 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.808 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.808 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.808 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Password to authenticate with", 2024-09-11T23:34:36.808 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.808 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.808 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.808 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.809 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_port": { 2024-09-11T23:34:36.809 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_port", 2024-09-11T23:34:36.809 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:36.809 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.809 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:36.809 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "465", 2024-09-11T23:34:36.809 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.809 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.809 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.809 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "SMTP port", 2024-09-11T23:34:36.809 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.809 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.809 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.809 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.810 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_sender": { 2024-09-11T23:34:36.810 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_sender", 2024-09-11T23:34:36.810 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:36.810 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.810 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:36.810 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:36.810 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.810 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.810 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.810 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "SMTP envelope sender", 2024-09-11T23:34:36.810 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.810 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.810 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.811 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.811 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_ssl": { 2024-09-11T23:34:36.811 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_ssl", 2024-09-11T23:34:36.811 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:36.811 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.811 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:36.811 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:36.811 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.811 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.811 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.811 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-11T23:34:36.811 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.811 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.811 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.812 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.812 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_user": { 2024-09-11T23:34:36.812 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_user", 2024-09-11T23:34:36.812 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:36.812 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.812 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:36.812 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:36.812 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.812 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.812 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.812 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "User to authenticate as", 2024-09-11T23:34:36.812 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.812 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.813 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.813 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:36.813 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:36.813 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.813 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:34:36.813 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "balancer", 2024-09-11T23:34:36.813 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-11T23:34:36.813 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-11T23:34:36.813 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-11T23:34:36.813 INFO:teuthology.orchestra.run.smithi037.stdout: "active": { 2024-09-11T23:34:36.813 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "active", 2024-09-11T23:34:36.813 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:36.813 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.814 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:36.814 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:36.814 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.814 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.814 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.814 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "automatically balance PGs across cluster", 2024-09-11T23:34:36.814 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.814 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.814 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.814 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.814 INFO:teuthology.orchestra.run.smithi037.stdout: "begin_time": { 2024-09-11T23:34:36.814 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "begin_time", 2024-09-11T23:34:36.814 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:36.815 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.815 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:36.815 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0000", 2024-09-11T23:34:36.815 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.815 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.815 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.815 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "beginning time of day to automatically balance", 2024-09-11T23:34:36.815 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-11T23:34:36.815 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.815 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.815 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.816 INFO:teuthology.orchestra.run.smithi037.stdout: "begin_weekday": { 2024-09-11T23:34:36.816 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "begin_weekday", 2024-09-11T23:34:36.816 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "uint", 2024-09-11T23:34:36.816 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.816 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:36.816 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-11T23:34:36.816 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "0", 2024-09-11T23:34:36.816 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "6", 2024-09-11T23:34:36.816 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.816 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-11T23:34:36.816 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-11T23:34:36.816 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.816 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.817 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.817 INFO:teuthology.orchestra.run.smithi037.stdout: "crush_compat_max_iterations": { 2024-09-11T23:34:36.817 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "crush_compat_max_iterations", 2024-09-11T23:34:36.817 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "uint", 2024-09-11T23:34:36.817 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.817 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:36.817 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "25", 2024-09-11T23:34:36.817 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "1", 2024-09-11T23:34:36.817 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "250", 2024-09-11T23:34:36.817 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.817 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-11T23:34:36.817 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.817 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.818 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.818 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.818 INFO:teuthology.orchestra.run.smithi037.stdout: "crush_compat_metrics": { 2024-09-11T23:34:36.818 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "crush_compat_metrics", 2024-09-11T23:34:36.818 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:36.818 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.818 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:36.818 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "pgs,objects,bytes", 2024-09-11T23:34:36.818 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.818 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.818 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.818 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-11T23:34:36.818 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-11T23:34:36.819 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.819 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.819 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.819 INFO:teuthology.orchestra.run.smithi037.stdout: "crush_compat_step": { 2024-09-11T23:34:36.819 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "crush_compat_step", 2024-09-11T23:34:36.819 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-09-11T23:34:36.819 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.819 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:36.819 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0.5", 2024-09-11T23:34:36.819 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "0.001", 2024-09-11T23:34:36.819 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "0.999", 2024-09-11T23:34:36.819 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.819 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "aggressiveness of optimization", 2024-09-11T23:34:36.819 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-11T23:34:36.820 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.820 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.820 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.820 INFO:teuthology.orchestra.run.smithi037.stdout: "end_time": { 2024-09-11T23:34:36.820 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "end_time", 2024-09-11T23:34:36.820 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:36.820 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.820 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:36.820 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "2359", 2024-09-11T23:34:36.820 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.820 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.820 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.821 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "ending time of day to automatically balance", 2024-09-11T23:34:36.821 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-11T23:34:36.821 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.821 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.821 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.821 INFO:teuthology.orchestra.run.smithi037.stdout: "end_weekday": { 2024-09-11T23:34:36.821 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "end_weekday", 2024-09-11T23:34:36.821 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "uint", 2024-09-11T23:34:36.821 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.821 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:36.821 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-11T23:34:36.821 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "0", 2024-09-11T23:34:36.821 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "6", 2024-09-11T23:34:36.822 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.822 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-11T23:34:36.822 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-11T23:34:36.822 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.822 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.822 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.822 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-11T23:34:36.822 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-11T23:34:36.822 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:36.822 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.822 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:36.822 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:36.822 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.822 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.823 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:36.823 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:36.823 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:36.823 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:36.823 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:36.823 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:36.823 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:36.823 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:36.823 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:36.823 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.823 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.823 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.823 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.824 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-11T23:34:36.824 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-11T23:34:36.824 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:36.824 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.824 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:36.824 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:36.824 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.824 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.824 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.824 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:36.824 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.824 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.825 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.825 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.825 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-11T23:34:36.825 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-11T23:34:36.825 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:36.825 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.825 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:36.825 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-11T23:34:36.825 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.825 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.825 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:36.825 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:36.825 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:36.826 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:36.826 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:36.826 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:36.826 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:36.826 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:36.826 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:36.826 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.826 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.826 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.826 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.826 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-11T23:34:36.826 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-11T23:34:36.827 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:36.827 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.827 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:36.827 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:36.827 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.827 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.827 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.827 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:36.827 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.827 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.827 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.827 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.828 INFO:teuthology.orchestra.run.smithi037.stdout: "min_score": { 2024-09-11T23:34:36.828 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "min_score", 2024-09-11T23:34:36.828 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-09-11T23:34:36.828 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.828 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:36.828 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-11T23:34:36.828 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.828 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.828 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.828 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-11T23:34:36.828 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.828 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.828 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.829 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.829 INFO:teuthology.orchestra.run.smithi037.stdout: "mode": { 2024-09-11T23:34:36.829 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mode", 2024-09-11T23:34:36.829 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:36.829 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.829 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:36.829 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "upmap", 2024-09-11T23:34:36.829 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.829 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.829 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:36.829 INFO:teuthology.orchestra.run.smithi037.stdout: "crush-compat", 2024-09-11T23:34:36.829 INFO:teuthology.orchestra.run.smithi037.stdout: "none", 2024-09-11T23:34:36.829 INFO:teuthology.orchestra.run.smithi037.stdout: "read", 2024-09-11T23:34:36.830 INFO:teuthology.orchestra.run.smithi037.stdout: "upmap", 2024-09-11T23:34:36.830 INFO:teuthology.orchestra.run.smithi037.stdout: "upmap-read" 2024-09-11T23:34:36.830 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:36.830 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Balancer mode", 2024-09-11T23:34:36.830 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.830 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.830 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.830 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.830 INFO:teuthology.orchestra.run.smithi037.stdout: "pool_ids": { 2024-09-11T23:34:36.830 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "pool_ids", 2024-09-11T23:34:36.830 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:36.830 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.831 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:36.831 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:36.831 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.831 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.831 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.831 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-11T23:34:36.831 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.831 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.831 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.831 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.831 INFO:teuthology.orchestra.run.smithi037.stdout: "sleep_interval": { 2024-09-11T23:34:36.831 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sleep_interval", 2024-09-11T23:34:36.831 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-11T23:34:36.832 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.832 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:36.832 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "60", 2024-09-11T23:34:36.832 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.832 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.832 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.832 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-11T23:34:36.832 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.832 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.833 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.833 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.833 INFO:teuthology.orchestra.run.smithi037.stdout: "upmap_max_deviation": { 2024-09-11T23:34:36.833 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "upmap_max_deviation", 2024-09-11T23:34:36.833 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:36.833 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.833 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:36.833 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5", 2024-09-11T23:34:36.833 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "1", 2024-09-11T23:34:36.833 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.833 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.833 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-11T23:34:36.834 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-11T23:34:36.834 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.834 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.834 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.834 INFO:teuthology.orchestra.run.smithi037.stdout: "upmap_max_optimizations": { 2024-09-11T23:34:36.834 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "upmap_max_optimizations", 2024-09-11T23:34:36.834 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "uint", 2024-09-11T23:34:36.834 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.834 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:36.835 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-09-11T23:34:36.835 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.835 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.835 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.835 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-11T23:34:36.835 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.835 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.835 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.835 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:36.835 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:36.835 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.835 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:34:36.835 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cephadm", 2024-09-11T23:34:36.835 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-11T23:34:36.836 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-11T23:34:36.836 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-11T23:34:36.836 INFO:teuthology.orchestra.run.smithi037.stdout: "agent_down_multiplier": { 2024-09-11T23:34:36.836 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "agent_down_multiplier", 2024-09-11T23:34:36.836 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-09-11T23:34:36.836 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.836 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.836 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "3.0", 2024-09-11T23:34:36.836 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.836 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.836 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.836 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-11T23:34:36.837 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.837 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.837 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.837 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.837 INFO:teuthology.orchestra.run.smithi037.stdout: "agent_refresh_rate": { 2024-09-11T23:34:36.837 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "agent_refresh_rate", 2024-09-11T23:34:36.837 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-11T23:34:36.837 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.837 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.837 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "20", 2024-09-11T23:34:36.837 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.837 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.837 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.838 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-11T23:34:36.838 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.838 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.838 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.838 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.838 INFO:teuthology.orchestra.run.smithi037.stdout: "agent_starting_port": { 2024-09-11T23:34:36.838 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "agent_starting_port", 2024-09-11T23:34:36.838 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:36.838 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.838 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.838 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "4721", 2024-09-11T23:34:36.838 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.838 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.838 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.839 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-11T23:34:36.839 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.839 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.839 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.839 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.839 INFO:teuthology.orchestra.run.smithi037.stdout: "allow_ptrace": { 2024-09-11T23:34:36.839 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "allow_ptrace", 2024-09-11T23:34:36.839 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:36.839 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.839 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.839 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:36.840 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.840 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.840 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.840 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-11T23:34:36.840 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-11T23:34:36.840 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.840 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.840 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.840 INFO:teuthology.orchestra.run.smithi037.stdout: "autotune_interval": { 2024-09-11T23:34:36.840 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "autotune_interval", 2024-09-11T23:34:36.840 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-11T23:34:36.840 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.840 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.841 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "600", 2024-09-11T23:34:36.841 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.841 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.841 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.841 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-11T23:34:36.841 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.841 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.841 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.841 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.841 INFO:teuthology.orchestra.run.smithi037.stdout: "autotune_memory_target_ratio": { 2024-09-11T23:34:36.841 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "autotune_memory_target_ratio", 2024-09-11T23:34:36.841 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-09-11T23:34:36.841 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.842 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.842 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0.7", 2024-09-11T23:34:36.842 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.842 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.842 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.842 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-11T23:34:36.842 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.842 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.842 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.842 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.842 INFO:teuthology.orchestra.run.smithi037.stdout: "cephadm_log_destination": { 2024-09-11T23:34:36.842 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cephadm_log_destination", 2024-09-11T23:34:36.842 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:36.843 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.843 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.843 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:36.843 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.843 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.843 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:36.843 INFO:teuthology.orchestra.run.smithi037.stdout: "file", 2024-09-11T23:34:36.843 INFO:teuthology.orchestra.run.smithi037.stdout: "file,syslog", 2024-09-11T23:34:36.843 INFO:teuthology.orchestra.run.smithi037.stdout: "syslog" 2024-09-11T23:34:36.843 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:36.843 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-11T23:34:36.843 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.843 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.844 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.844 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.844 INFO:teuthology.orchestra.run.smithi037.stdout: "cgroups_split": { 2024-09-11T23:34:36.844 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cgroups_split", 2024-09-11T23:34:36.844 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:36.844 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.844 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.844 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:36.844 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.844 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.844 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.844 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-11T23:34:36.845 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.845 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.845 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.845 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.845 INFO:teuthology.orchestra.run.smithi037.stdout: "config_checks_enabled": { 2024-09-11T23:34:36.845 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "config_checks_enabled", 2024-09-11T23:34:36.845 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:36.845 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.845 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.845 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:36.845 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.845 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.845 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.845 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-11T23:34:36.846 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.846 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.846 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.846 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.846 INFO:teuthology.orchestra.run.smithi037.stdout: "config_dashboard": { 2024-09-11T23:34:36.846 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "config_dashboard", 2024-09-11T23:34:36.846 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:36.846 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.846 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.846 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:36.846 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.846 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.846 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.846 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-11T23:34:36.847 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.847 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.847 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.847 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.847 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_alertmanager": { 2024-09-11T23:34:36.847 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_alertmanager", 2024-09-11T23:34:36.847 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:36.847 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.847 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.847 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-11T23:34:36.847 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.847 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.848 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.848 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Prometheus container image", 2024-09-11T23:34:36.848 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.848 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.848 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.848 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.848 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_base": { 2024-09-11T23:34:36.848 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_base", 2024-09-11T23:34:36.848 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:36.848 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.848 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:36.848 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-11T23:34:36.848 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.848 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.849 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.849 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Container image name, without the tag", 2024-09-11T23:34:36.849 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.849 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.849 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.849 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.849 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_elasticsearch": { 2024-09-11T23:34:36.849 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_elasticsearch", 2024-09-11T23:34:36.849 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:36.849 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.849 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.849 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-11T23:34:36.850 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.850 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.850 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.850 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "elasticsearch container image", 2024-09-11T23:34:36.850 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.850 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.850 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.850 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.850 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_grafana": { 2024-09-11T23:34:36.850 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_grafana", 2024-09-11T23:34:36.850 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:36.850 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.850 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.851 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-11T23:34:36.851 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.851 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.851 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.851 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Prometheus container image", 2024-09-11T23:34:36.851 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.851 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.851 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.851 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.851 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_haproxy": { 2024-09-11T23:34:36.851 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_haproxy", 2024-09-11T23:34:36.851 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:36.851 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.852 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.852 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-11T23:34:36.852 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.852 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.852 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.852 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "HAproxy container image", 2024-09-11T23:34:36.852 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.852 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.852 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.852 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.852 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_jaeger_agent": { 2024-09-11T23:34:36.853 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_jaeger_agent", 2024-09-11T23:34:36.853 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:36.853 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.853 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.853 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-11T23:34:36.853 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.853 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.853 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.853 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Jaeger agent container image", 2024-09-11T23:34:36.853 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.853 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.853 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.853 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.853 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_jaeger_collector": { 2024-09-11T23:34:36.854 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_jaeger_collector", 2024-09-11T23:34:36.854 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:36.854 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.854 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.854 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-11T23:34:36.854 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.854 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.854 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.854 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Jaeger collector container image", 2024-09-11T23:34:36.854 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.854 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.854 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.854 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.855 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_jaeger_query": { 2024-09-11T23:34:36.855 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_jaeger_query", 2024-09-11T23:34:36.855 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:36.855 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.855 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.855 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-11T23:34:36.855 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.855 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.855 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.855 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Jaeger query container image", 2024-09-11T23:34:36.855 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.855 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.856 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.856 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.856 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_keepalived": { 2024-09-11T23:34:36.856 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_keepalived", 2024-09-11T23:34:36.856 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:36.856 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.856 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.856 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-11T23:34:36.856 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.856 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.856 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.856 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Keepalived container image", 2024-09-11T23:34:36.856 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.857 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.857 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.857 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.857 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_loki": { 2024-09-11T23:34:36.857 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_loki", 2024-09-11T23:34:36.857 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:36.857 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.857 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.857 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-11T23:34:36.857 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.857 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.857 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.857 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Loki container image", 2024-09-11T23:34:36.858 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.858 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.858 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.858 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.858 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_node_exporter": { 2024-09-11T23:34:36.858 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_node_exporter", 2024-09-11T23:34:36.858 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:36.858 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.858 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.858 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-11T23:34:36.858 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.858 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.859 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.859 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Prometheus container image", 2024-09-11T23:34:36.859 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.859 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.859 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.859 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.859 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_nvmeof": { 2024-09-11T23:34:36.859 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_nvmeof", 2024-09-11T23:34:36.859 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:36.859 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.859 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.859 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-11T23:34:36.859 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.859 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.860 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.860 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Nvme-of container image", 2024-09-11T23:34:36.860 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.860 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.860 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.860 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.860 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_prometheus": { 2024-09-11T23:34:36.860 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_prometheus", 2024-09-11T23:34:36.860 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:36.860 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.860 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.860 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-11T23:34:36.860 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.861 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.861 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.861 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Prometheus container image", 2024-09-11T23:34:36.861 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.861 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.861 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.861 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.861 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_promtail": { 2024-09-11T23:34:36.861 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_promtail", 2024-09-11T23:34:36.861 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:36.861 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.861 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.861 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-11T23:34:36.862 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.862 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.862 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.862 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Promtail container image", 2024-09-11T23:34:36.862 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.862 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.862 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.862 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.862 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_samba": { 2024-09-11T23:34:36.862 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_samba", 2024-09-11T23:34:36.862 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:36.862 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.862 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.863 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-11T23:34:36.863 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.863 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.863 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.863 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Samba/SMB container image", 2024-09-11T23:34:36.863 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.863 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.863 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.863 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.863 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_snmp_gateway": { 2024-09-11T23:34:36.863 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_snmp_gateway", 2024-09-11T23:34:36.863 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:36.863 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.863 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.864 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-11T23:34:36.864 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.864 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.864 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.864 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "SNMP Gateway container image", 2024-09-11T23:34:36.864 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.864 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.864 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.864 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.864 INFO:teuthology.orchestra.run.smithi037.stdout: "container_init": { 2024-09-11T23:34:36.864 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_init", 2024-09-11T23:34:36.864 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:36.864 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.865 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.865 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:36.865 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.865 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.865 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.865 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Run podman/docker with `--init`", 2024-09-11T23:34:36.865 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.865 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.865 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.865 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.865 INFO:teuthology.orchestra.run.smithi037.stdout: "daemon_cache_timeout": { 2024-09-11T23:34:36.865 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "daemon_cache_timeout", 2024-09-11T23:34:36.866 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-11T23:34:36.866 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.866 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.866 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "600", 2024-09-11T23:34:36.866 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.866 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.866 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.866 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-11T23:34:36.866 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.866 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.867 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.867 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.867 INFO:teuthology.orchestra.run.smithi037.stdout: "default_cephadm_command_timeout": { 2024-09-11T23:34:36.867 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "default_cephadm_command_timeout", 2024-09-11T23:34:36.867 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:36.867 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.867 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.867 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "900", 2024-09-11T23:34:36.867 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.867 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.867 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.867 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-11T23:34:36.868 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.868 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.868 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.868 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.868 INFO:teuthology.orchestra.run.smithi037.stdout: "default_registry": { 2024-09-11T23:34:36.868 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "default_registry", 2024-09-11T23:34:36.868 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:36.868 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.868 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.868 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "docker.io", 2024-09-11T23:34:36.868 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.868 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.869 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.869 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-11T23:34:36.869 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.869 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.869 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.869 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.869 INFO:teuthology.orchestra.run.smithi037.stdout: "device_cache_timeout": { 2024-09-11T23:34:36.869 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "device_cache_timeout", 2024-09-11T23:34:36.869 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-11T23:34:36.869 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.869 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.869 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "1800", 2024-09-11T23:34:36.869 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.870 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.870 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.870 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "seconds to cache device inventory", 2024-09-11T23:34:36.870 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.870 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.870 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.870 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.870 INFO:teuthology.orchestra.run.smithi037.stdout: "device_enhanced_scan": { 2024-09-11T23:34:36.870 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "device_enhanced_scan", 2024-09-11T23:34:36.870 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:36.870 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.870 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.870 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:36.871 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.871 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.871 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.871 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-11T23:34:36.871 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.871 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.871 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.871 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.871 INFO:teuthology.orchestra.run.smithi037.stdout: "facts_cache_timeout": { 2024-09-11T23:34:36.871 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "facts_cache_timeout", 2024-09-11T23:34:36.872 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-11T23:34:36.872 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.872 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.872 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "60", 2024-09-11T23:34:36.872 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.872 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.872 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.872 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "seconds to cache host facts data", 2024-09-11T23:34:36.872 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.872 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.872 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.872 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.873 INFO:teuthology.orchestra.run.smithi037.stdout: "grafana_dashboards_path": { 2024-09-11T23:34:36.873 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "grafana_dashboards_path", 2024-09-11T23:34:36.873 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:36.873 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.873 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.873 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-11T23:34:36.873 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.873 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.873 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.873 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-11T23:34:36.873 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.873 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.873 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.873 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.874 INFO:teuthology.orchestra.run.smithi037.stdout: "host_check_interval": { 2024-09-11T23:34:36.874 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "host_check_interval", 2024-09-11T23:34:36.874 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-11T23:34:36.874 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.874 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.874 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "600", 2024-09-11T23:34:36.874 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.874 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.874 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.874 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how frequently to perform a host check", 2024-09-11T23:34:36.874 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.874 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.874 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.875 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.875 INFO:teuthology.orchestra.run.smithi037.stdout: "hw_monitoring": { 2024-09-11T23:34:36.875 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "hw_monitoring", 2024-09-11T23:34:36.875 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:36.875 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.875 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.875 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:36.875 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.875 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.876 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.876 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-11T23:34:36.876 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.876 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.876 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.876 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.876 INFO:teuthology.orchestra.run.smithi037.stdout: "inventory_list_all": { 2024-09-11T23:34:36.876 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "inventory_list_all", 2024-09-11T23:34:36.876 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:36.876 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.876 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.876 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:36.876 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.877 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.877 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.877 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-11T23:34:36.877 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.877 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.877 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.877 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.877 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-11T23:34:36.877 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-11T23:34:36.877 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:36.877 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.877 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:36.877 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:36.878 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.878 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.878 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:36.878 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:36.878 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:36.878 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:36.878 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:36.878 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:36.878 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:36.878 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:36.878 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:36.878 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.878 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.879 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.879 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.879 INFO:teuthology.orchestra.run.smithi037.stdout: "log_refresh_metadata": { 2024-09-11T23:34:36.879 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_refresh_metadata", 2024-09-11T23:34:36.879 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:36.879 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.879 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.879 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:36.879 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.879 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.879 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.879 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-11T23:34:36.880 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.880 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.880 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.880 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.880 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-11T23:34:36.880 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-11T23:34:36.880 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:36.880 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.880 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.880 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:36.880 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.880 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.881 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.881 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-11T23:34:36.881 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.881 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.881 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.881 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.881 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-11T23:34:36.881 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-11T23:34:36.881 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:36.881 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.881 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:36.881 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-11T23:34:36.881 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.882 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.882 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:36.882 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:36.882 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:36.882 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:36.882 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:36.882 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:36.882 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:36.882 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:36.882 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:36.882 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.882 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.882 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.883 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.883 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-11T23:34:36.883 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-11T23:34:36.883 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:36.883 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.883 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:36.883 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:36.883 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.883 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.883 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.883 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:36.883 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.883 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.884 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.884 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.884 INFO:teuthology.orchestra.run.smithi037.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-11T23:34:36.884 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-11T23:34:36.884 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:36.884 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.884 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.884 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:36.884 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.884 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.884 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.884 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-11T23:34:36.885 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.885 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.885 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.885 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.885 INFO:teuthology.orchestra.run.smithi037.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-11T23:34:36.885 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-11T23:34:36.885 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:36.885 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.885 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.885 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "*", 2024-09-11T23:34:36.885 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.885 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.885 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.886 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-11T23:34:36.886 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.886 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.886 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.886 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.886 INFO:teuthology.orchestra.run.smithi037.stdout: "max_count_per_host": { 2024-09-11T23:34:36.886 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "max_count_per_host", 2024-09-11T23:34:36.886 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:36.886 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.888 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.888 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-09-11T23:34:36.888 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.888 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.888 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.888 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "max number of daemons per service per host", 2024-09-11T23:34:36.888 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.889 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.889 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.889 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.889 INFO:teuthology.orchestra.run.smithi037.stdout: "max_osd_draining_count": { 2024-09-11T23:34:36.889 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "max_osd_draining_count", 2024-09-11T23:34:36.889 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:36.889 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.889 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.889 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-09-11T23:34:36.889 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.889 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.889 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.889 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-11T23:34:36.890 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.890 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.890 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.890 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.890 INFO:teuthology.orchestra.run.smithi037.stdout: "migration_current": { 2024-09-11T23:34:36.890 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "migration_current", 2024-09-11T23:34:36.890 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:36.890 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.890 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.890 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:36.890 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.890 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.890 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.891 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "internal - do not modify", 2024-09-11T23:34:36.891 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.891 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.891 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.891 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.891 INFO:teuthology.orchestra.run.smithi037.stdout: "mode": { 2024-09-11T23:34:36.891 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mode", 2024-09-11T23:34:36.891 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:36.891 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.891 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.891 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "root", 2024-09-11T23:34:36.891 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.891 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.891 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:36.891 INFO:teuthology.orchestra.run.smithi037.stdout: "cephadm-package", 2024-09-11T23:34:36.892 INFO:teuthology.orchestra.run.smithi037.stdout: "root" 2024-09-11T23:34:36.892 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:36.892 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "mode for remote execution of cephadm", 2024-09-11T23:34:36.892 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.892 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.892 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.892 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.892 INFO:teuthology.orchestra.run.smithi037.stdout: "oob_default_addr": { 2024-09-11T23:34:36.892 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "oob_default_addr", 2024-09-11T23:34:36.892 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:36.892 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.892 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.892 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "169.254.1.1", 2024-09-11T23:34:36.893 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.893 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.893 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.893 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-11T23:34:36.893 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.893 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.893 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.893 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.893 INFO:teuthology.orchestra.run.smithi037.stdout: "prometheus_alerts_path": { 2024-09-11T23:34:36.893 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "prometheus_alerts_path", 2024-09-11T23:34:36.893 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:36.893 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.893 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.893 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-11T23:34:36.894 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.894 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.894 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.894 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-11T23:34:36.894 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.894 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.894 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.894 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.894 INFO:teuthology.orchestra.run.smithi037.stdout: "registry_insecure": { 2024-09-11T23:34:36.894 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "registry_insecure", 2024-09-11T23:34:36.894 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:36.894 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.894 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.895 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:36.895 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.895 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.895 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.895 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-11T23:34:36.895 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.895 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.895 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.895 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.895 INFO:teuthology.orchestra.run.smithi037.stdout: "registry_password": { 2024-09-11T23:34:36.895 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "registry_password", 2024-09-11T23:34:36.895 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:36.895 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.895 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.896 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:36.896 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.896 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.896 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.896 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-11T23:34:36.896 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.896 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.896 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.896 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.896 INFO:teuthology.orchestra.run.smithi037.stdout: "registry_url": { 2024-09-11T23:34:36.896 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "registry_url", 2024-09-11T23:34:36.896 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:36.896 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.897 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.897 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:36.897 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.897 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.897 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.897 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-11T23:34:36.897 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.897 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.897 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.897 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.897 INFO:teuthology.orchestra.run.smithi037.stdout: "registry_username": { 2024-09-11T23:34:36.897 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "registry_username", 2024-09-11T23:34:36.897 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:36.898 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.898 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.898 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:36.898 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.898 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.898 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.898 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-11T23:34:36.898 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.898 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.898 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.898 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.898 INFO:teuthology.orchestra.run.smithi037.stdout: "secure_monitoring_stack": { 2024-09-11T23:34:36.898 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "secure_monitoring_stack", 2024-09-11T23:34:36.898 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:36.899 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.899 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.899 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:36.899 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.899 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.899 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.899 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-11T23:34:36.899 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.899 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.899 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.899 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.899 INFO:teuthology.orchestra.run.smithi037.stdout: "service_discovery_port": { 2024-09-11T23:34:36.899 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "service_discovery_port", 2024-09-11T23:34:36.899 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:36.900 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.900 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.900 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "8765", 2024-09-11T23:34:36.900 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.900 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.900 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.900 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "cephadm service discovery port", 2024-09-11T23:34:36.900 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.900 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.900 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.900 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.900 INFO:teuthology.orchestra.run.smithi037.stdout: "ssh_config_file": { 2024-09-11T23:34:36.900 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ssh_config_file", 2024-09-11T23:34:36.901 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:36.901 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.901 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.901 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:36.901 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.901 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.901 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.901 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-11T23:34:36.901 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.901 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.901 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.901 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.901 INFO:teuthology.orchestra.run.smithi037.stdout: "use_agent": { 2024-09-11T23:34:36.902 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "use_agent", 2024-09-11T23:34:36.902 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:36.902 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.902 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.902 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:36.902 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.902 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.902 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.902 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-11T23:34:36.902 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.902 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.902 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.902 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.902 INFO:teuthology.orchestra.run.smithi037.stdout: "use_repo_digest": { 2024-09-11T23:34:36.903 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "use_repo_digest", 2024-09-11T23:34:36.903 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:36.903 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.903 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.903 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:36.903 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.903 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.903 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.903 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-11T23:34:36.903 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.903 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.903 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.903 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.904 INFO:teuthology.orchestra.run.smithi037.stdout: "warn_on_failed_host_check": { 2024-09-11T23:34:36.904 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "warn_on_failed_host_check", 2024-09-11T23:34:36.904 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:36.904 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.904 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.904 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:36.904 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.904 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.904 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.904 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "raise a health warning if the host check fails", 2024-09-11T23:34:36.904 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.904 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.904 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.904 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.905 INFO:teuthology.orchestra.run.smithi037.stdout: "warn_on_stray_daemons": { 2024-09-11T23:34:36.905 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "warn_on_stray_daemons", 2024-09-11T23:34:36.905 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:36.905 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.905 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.905 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:36.905 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.905 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.905 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.905 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-11T23:34:36.905 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.905 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.905 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.906 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.906 INFO:teuthology.orchestra.run.smithi037.stdout: "warn_on_stray_hosts": { 2024-09-11T23:34:36.906 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "warn_on_stray_hosts", 2024-09-11T23:34:36.906 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:36.906 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.906 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.906 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:36.906 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.906 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.906 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.906 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-11T23:34:36.906 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.906 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.906 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.907 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:36.907 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:36.907 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.907 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:34:36.907 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "crash", 2024-09-11T23:34:36.907 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-11T23:34:36.907 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-11T23:34:36.907 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-11T23:34:36.907 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-11T23:34:36.907 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-11T23:34:36.907 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:36.907 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.908 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:36.908 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:36.908 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.908 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.908 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:36.908 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:36.908 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:36.908 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:36.908 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:36.908 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:36.908 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:36.908 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:36.908 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:36.909 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.909 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.909 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.909 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.909 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-11T23:34:36.909 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-11T23:34:36.909 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:36.909 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.909 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:36.909 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:36.909 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.909 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.909 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.910 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:36.910 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.910 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.910 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.910 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.910 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-11T23:34:36.910 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-11T23:34:36.910 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:36.910 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.910 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:36.910 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-11T23:34:36.910 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.911 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.911 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:36.911 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:36.911 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:36.911 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:36.911 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:36.911 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:36.911 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:36.911 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:36.911 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:36.911 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.911 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.912 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.912 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.912 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-11T23:34:36.912 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-11T23:34:36.912 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:36.912 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.912 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:36.912 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:36.912 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.912 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.912 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.912 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:36.912 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.912 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.913 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.913 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.913 INFO:teuthology.orchestra.run.smithi037.stdout: "retain_interval": { 2024-09-11T23:34:36.913 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "retain_interval", 2024-09-11T23:34:36.913 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-11T23:34:36.913 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.913 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:36.913 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "31536000", 2024-09-11T23:34:36.913 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.913 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.913 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.913 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-11T23:34:36.914 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.914 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.914 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.914 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.914 INFO:teuthology.orchestra.run.smithi037.stdout: "warn_recent_interval": { 2024-09-11T23:34:36.914 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "warn_recent_interval", 2024-09-11T23:34:36.914 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-11T23:34:36.914 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.914 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:36.914 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "1209600", 2024-09-11T23:34:36.914 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.914 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.914 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.915 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-11T23:34:36.915 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.915 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.915 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.915 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:36.915 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:36.915 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.915 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:34:36.915 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "dashboard", 2024-09-11T23:34:36.915 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-11T23:34:36.915 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-11T23:34:36.915 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-11T23:34:36.915 INFO:teuthology.orchestra.run.smithi037.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-11T23:34:36.915 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-11T23:34:36.916 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:36.916 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.916 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.916 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-09-11T23:34:36.916 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.916 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.916 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.916 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:36.916 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.916 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.916 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.916 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.916 INFO:teuthology.orchestra.run.smithi037.stdout: "ALERTMANAGER_API_HOST": { 2024-09-11T23:34:36.917 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-11T23:34:36.917 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:36.917 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.917 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.917 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:36.917 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.917 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.917 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.917 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:36.917 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.917 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.917 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.917 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.918 INFO:teuthology.orchestra.run.smithi037.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-11T23:34:36.918 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-11T23:34:36.918 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:36.918 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.918 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.918 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:36.918 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.918 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.918 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.918 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:36.918 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.918 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.918 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.918 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.919 INFO:teuthology.orchestra.run.smithi037.stdout: "AUDIT_API_ENABLED": { 2024-09-11T23:34:36.919 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "AUDIT_API_ENABLED", 2024-09-11T23:34:36.919 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:36.919 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.919 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.919 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:36.919 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.919 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.919 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.919 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:36.919 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.919 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.919 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.920 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.920 INFO:teuthology.orchestra.run.smithi037.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-11T23:34:36.920 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-11T23:34:36.920 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:36.920 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.920 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.920 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:36.920 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.920 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.920 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.920 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:36.920 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.920 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.921 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.921 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.921 INFO:teuthology.orchestra.run.smithi037.stdout: "ENABLE_BROWSABLE_API": { 2024-09-11T23:34:36.921 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-11T23:34:36.921 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:36.921 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.921 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.921 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:36.921 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.921 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.921 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.921 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:36.921 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.922 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.922 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.922 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.922 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-11T23:34:36.922 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-11T23:34:36.922 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:36.922 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.922 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.922 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:36.922 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.922 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.922 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.922 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:36.923 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.923 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.923 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.923 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.923 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-11T23:34:36.923 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-11T23:34:36.923 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:36.923 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.923 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.923 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:36.923 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.923 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.923 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.924 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:36.924 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.924 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.924 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.924 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.924 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-11T23:34:36.924 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-11T23:34:36.924 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:36.924 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.924 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.924 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:36.924 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.925 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.925 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.925 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:36.925 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.925 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.925 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.925 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.925 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-11T23:34:36.925 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-11T23:34:36.925 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:36.925 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.925 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.925 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:36.926 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.926 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.926 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.926 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:36.926 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.926 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.926 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.926 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.926 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-11T23:34:36.926 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-11T23:34:36.926 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:36.926 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.926 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.926 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:36.927 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.927 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.927 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.927 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:36.927 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.927 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.927 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.927 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.927 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-11T23:34:36.927 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-11T23:34:36.927 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:36.927 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.927 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.928 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:36.928 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.928 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.928 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.928 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:36.928 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.928 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.928 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.928 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.928 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-11T23:34:36.928 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-11T23:34:36.928 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:36.928 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.929 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.929 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:36.929 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.929 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.929 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.929 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:36.929 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.929 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.929 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.929 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.929 INFO:teuthology.orchestra.run.smithi037.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-11T23:34:36.929 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-11T23:34:36.929 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:36.930 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.930 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.930 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:36.930 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.930 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.930 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.930 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:36.930 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.930 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.930 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.930 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.930 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_API_PASSWORD": { 2024-09-11T23:34:36.930 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-11T23:34:36.931 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:36.931 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.931 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.931 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "admin", 2024-09-11T23:34:36.931 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.931 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.931 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.931 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:36.931 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.931 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.931 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.931 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.931 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-11T23:34:36.932 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-11T23:34:36.932 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:36.932 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.932 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.932 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:36.932 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.932 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.932 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.932 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:36.932 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.932 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.932 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.932 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.933 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_API_URL": { 2024-09-11T23:34:36.933 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_API_URL", 2024-09-11T23:34:36.933 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:36.933 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.933 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.933 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:36.933 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.933 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.933 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.933 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:36.933 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.933 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.933 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.933 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.934 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_API_USERNAME": { 2024-09-11T23:34:36.934 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-11T23:34:36.934 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:36.934 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.934 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.934 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "admin", 2024-09-11T23:34:36.934 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.934 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.934 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.934 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:36.934 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.934 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.934 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.934 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.935 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-11T23:34:36.935 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-11T23:34:36.935 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:36.935 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.935 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.935 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:36.935 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.935 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.935 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.935 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:36.935 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.935 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.935 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.936 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.936 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-11T23:34:36.936 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-11T23:34:36.936 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:36.936 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.936 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.936 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:36.936 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.936 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.936 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.936 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:36.936 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.937 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.937 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.937 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.937 INFO:teuthology.orchestra.run.smithi037.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-11T23:34:36.937 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-11T23:34:36.937 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:36.937 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.937 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.937 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:36.937 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.937 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.937 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.937 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:36.938 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.938 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.938 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.938 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.938 INFO:teuthology.orchestra.run.smithi037.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-11T23:34:36.938 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-11T23:34:36.938 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:36.938 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.938 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.938 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:36.938 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.938 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.938 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.939 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:36.939 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.939 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.939 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.939 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.939 INFO:teuthology.orchestra.run.smithi037.stdout: "PROMETHEUS_API_HOST": { 2024-09-11T23:34:36.939 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-11T23:34:36.939 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:36.939 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.939 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.939 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:36.939 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.939 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.939 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.940 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:36.940 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.940 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.940 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.940 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.940 INFO:teuthology.orchestra.run.smithi037.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-11T23:34:36.940 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-11T23:34:36.940 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:36.940 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.940 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.940 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:36.940 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.940 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.941 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.941 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:36.941 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.941 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.941 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.941 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.941 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-11T23:34:36.941 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-11T23:34:36.941 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:36.941 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.941 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.941 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:36.941 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.942 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.942 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.942 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:36.942 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.942 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.942 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.942 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.942 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-11T23:34:36.942 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-11T23:34:36.942 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:36.942 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.942 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.942 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:36.942 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.943 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.943 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.943 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:36.943 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.943 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.943 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.943 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.943 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-11T23:34:36.943 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-11T23:34:36.943 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:36.943 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.943 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.943 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:36.944 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.944 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.944 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.944 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:36.944 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.944 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.944 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.944 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.944 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-11T23:34:36.944 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-11T23:34:36.944 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:36.944 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.944 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.945 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:36.945 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.945 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.945 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.945 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:36.945 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.945 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.945 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.945 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.945 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-11T23:34:36.945 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-11T23:34:36.945 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:36.945 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.946 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.946 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:36.946 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.946 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.946 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.946 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:36.946 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.946 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.946 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.946 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.946 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-11T23:34:36.946 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-11T23:34:36.946 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:36.947 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.947 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.947 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:36.947 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.947 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.947 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.947 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:36.947 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.947 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.947 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.947 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.947 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-11T23:34:36.947 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-11T23:34:36.947 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:36.948 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.948 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.948 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:36.948 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.948 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.948 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.948 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:36.948 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.948 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.948 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.948 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.948 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_ENABLED": { 2024-09-11T23:34:36.948 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-11T23:34:36.949 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:36.949 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.949 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.949 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:36.949 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.949 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.949 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.949 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:36.949 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.949 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.949 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.949 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.949 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-11T23:34:36.950 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-11T23:34:36.950 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:36.950 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.950 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.950 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-11T23:34:36.950 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.950 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.950 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.950 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:36.950 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.950 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.950 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.950 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.951 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-11T23:34:36.951 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-11T23:34:36.951 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:36.951 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.951 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.951 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-09-11T23:34:36.951 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.951 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.951 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.951 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:36.951 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.951 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.952 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.952 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.952 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-11T23:34:36.952 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-11T23:34:36.952 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:36.952 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.952 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.952 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "8", 2024-09-11T23:34:36.952 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.952 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.952 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.952 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:36.952 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.953 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.953 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.953 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.953 INFO:teuthology.orchestra.run.smithi037.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-11T23:34:36.953 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-11T23:34:36.953 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:36.953 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.953 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.953 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "45", 2024-09-11T23:34:36.953 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.953 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.953 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.953 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:36.954 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.954 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.954 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.954 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.954 INFO:teuthology.orchestra.run.smithi037.stdout: "RGW_API_ACCESS_KEY": { 2024-09-11T23:34:36.954 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-11T23:34:36.954 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:36.954 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.954 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.954 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:36.954 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.954 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.954 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.955 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:36.955 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.955 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.955 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.955 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.955 INFO:teuthology.orchestra.run.smithi037.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-11T23:34:36.955 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-11T23:34:36.955 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:36.955 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.955 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.955 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "admin", 2024-09-11T23:34:36.955 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.955 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.956 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.956 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:36.956 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.956 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.956 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.956 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.956 INFO:teuthology.orchestra.run.smithi037.stdout: "RGW_API_SECRET_KEY": { 2024-09-11T23:34:36.956 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-11T23:34:36.956 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:36.956 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.956 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.956 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:36.956 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.957 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.957 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.957 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:36.957 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.957 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.957 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.957 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.957 INFO:teuthology.orchestra.run.smithi037.stdout: "RGW_API_SSL_VERIFY": { 2024-09-11T23:34:36.957 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-11T23:34:36.957 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:36.957 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.957 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.957 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:36.958 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.958 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.958 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.958 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:36.958 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.958 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.958 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.958 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.958 INFO:teuthology.orchestra.run.smithi037.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-11T23:34:36.958 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-11T23:34:36.958 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:36.958 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.958 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.959 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-11T23:34:36.959 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.959 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.959 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.959 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:36.959 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.959 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.959 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.959 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.959 INFO:teuthology.orchestra.run.smithi037.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-11T23:34:36.959 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-11T23:34:36.959 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:36.959 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.960 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.960 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-09-11T23:34:36.960 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.960 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.960 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.960 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:36.960 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.960 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.960 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.960 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.960 INFO:teuthology.orchestra.run.smithi037.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-11T23:34:36.960 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-11T23:34:36.960 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:36.960 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.961 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.961 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5", 2024-09-11T23:34:36.961 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.961 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.961 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.961 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:36.961 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.961 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.961 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.961 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.961 INFO:teuthology.orchestra.run.smithi037.stdout: "cross_origin_url": { 2024-09-11T23:34:36.961 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cross_origin_url", 2024-09-11T23:34:36.961 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:36.961 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.962 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.962 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:36.962 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.962 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.962 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.962 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:36.962 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.962 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.962 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.962 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.962 INFO:teuthology.orchestra.run.smithi037.stdout: "crt_file": { 2024-09-11T23:34:36.962 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "crt_file", 2024-09-11T23:34:36.962 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:36.963 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.963 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.963 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:36.963 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.963 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.963 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.963 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:36.963 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.963 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.963 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.963 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.963 INFO:teuthology.orchestra.run.smithi037.stdout: "debug": { 2024-09-11T23:34:36.963 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "debug", 2024-09-11T23:34:36.964 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:36.964 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.964 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.964 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:36.964 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.964 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.964 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.964 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Enable/disable debug options", 2024-09-11T23:34:36.964 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.964 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.964 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.964 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.964 INFO:teuthology.orchestra.run.smithi037.stdout: "jwt_token_ttl": { 2024-09-11T23:34:36.965 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "jwt_token_ttl", 2024-09-11T23:34:36.965 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:36.965 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.965 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.965 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "28800", 2024-09-11T23:34:36.965 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.965 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.965 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.965 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:36.965 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.965 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.965 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.965 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.966 INFO:teuthology.orchestra.run.smithi037.stdout: "key_file": { 2024-09-11T23:34:36.966 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "key_file", 2024-09-11T23:34:36.966 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:36.966 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.966 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.966 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:36.966 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.966 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.966 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.966 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:36.966 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.966 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.966 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.967 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.967 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-11T23:34:36.967 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-11T23:34:36.967 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:36.967 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.967 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:36.967 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:36.967 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.967 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.967 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:36.967 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:36.967 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:36.967 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:36.968 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:36.968 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:36.968 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:36.968 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:36.968 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:36.968 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.968 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.968 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.968 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.968 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-11T23:34:36.968 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-11T23:34:36.968 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:36.968 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.969 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:36.969 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:36.969 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.969 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.969 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.969 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:36.969 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.969 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.969 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.969 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.969 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-11T23:34:36.969 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-11T23:34:36.969 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:36.970 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.970 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:36.970 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-11T23:34:36.970 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.970 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.970 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:36.970 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:36.970 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:36.970 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:36.970 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:36.970 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:36.970 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:36.970 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:36.971 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:36.971 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.971 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.971 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.971 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.971 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-11T23:34:36.971 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-11T23:34:36.971 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:36.971 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.971 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:36.971 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:36.971 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.971 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.972 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.972 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:36.972 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.972 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.972 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.972 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.972 INFO:teuthology.orchestra.run.smithi037.stdout: "motd": { 2024-09-11T23:34:36.972 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "motd", 2024-09-11T23:34:36.972 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:36.972 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.972 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.972 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:36.972 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.973 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.973 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.973 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "The message of the day", 2024-09-11T23:34:36.973 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.973 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.973 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.973 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.973 INFO:teuthology.orchestra.run.smithi037.stdout: "redirect_resolve_ip_addr": { 2024-09-11T23:34:36.973 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "redirect_resolve_ip_addr", 2024-09-11T23:34:36.973 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:36.973 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.973 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.973 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:36.974 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.974 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.974 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.974 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:36.974 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.974 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.974 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.974 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.974 INFO:teuthology.orchestra.run.smithi037.stdout: "server_addr": { 2024-09-11T23:34:36.974 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_addr", 2024-09-11T23:34:36.974 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:36.974 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.974 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.974 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "::", 2024-09-11T23:34:36.975 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.975 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.975 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.975 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:36.975 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.975 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.975 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.975 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.975 INFO:teuthology.orchestra.run.smithi037.stdout: "server_port": { 2024-09-11T23:34:36.975 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_port", 2024-09-11T23:34:36.975 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:36.975 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.975 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.976 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "8080", 2024-09-11T23:34:36.976 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.976 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.976 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.976 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:36.976 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.976 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.976 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.976 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.976 INFO:teuthology.orchestra.run.smithi037.stdout: "ssl": { 2024-09-11T23:34:36.976 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ssl", 2024-09-11T23:34:36.976 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:36.976 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.977 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.977 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:36.977 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.977 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.977 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.977 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:36.977 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.977 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.977 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.977 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.977 INFO:teuthology.orchestra.run.smithi037.stdout: "ssl_server_port": { 2024-09-11T23:34:36.977 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ssl_server_port", 2024-09-11T23:34:36.977 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:36.978 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.978 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.978 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "8443", 2024-09-11T23:34:36.978 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.978 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.978 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.978 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:36.978 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.978 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.978 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.978 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.979 INFO:teuthology.orchestra.run.smithi037.stdout: "standby_behaviour": { 2024-09-11T23:34:36.979 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "standby_behaviour", 2024-09-11T23:34:36.979 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:36.979 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.979 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.979 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "redirect", 2024-09-11T23:34:36.979 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.979 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.979 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:36.979 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:36.979 INFO:teuthology.orchestra.run.smithi037.stdout: "redirect" 2024-09-11T23:34:36.979 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:36.979 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:36.980 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.980 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.980 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.980 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.980 INFO:teuthology.orchestra.run.smithi037.stdout: "standby_error_status_code": { 2024-09-11T23:34:36.980 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "standby_error_status_code", 2024-09-11T23:34:36.980 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:36.980 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.980 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.980 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "500", 2024-09-11T23:34:36.980 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "400", 2024-09-11T23:34:36.980 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "599", 2024-09-11T23:34:36.980 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.981 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:36.981 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.981 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.981 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.981 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.981 INFO:teuthology.orchestra.run.smithi037.stdout: "url_prefix": { 2024-09-11T23:34:36.981 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "url_prefix", 2024-09-11T23:34:36.981 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:36.981 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.981 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:36.981 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:36.981 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.981 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.982 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.982 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:36.982 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.982 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.982 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.982 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:36.982 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:36.982 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.982 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:34:36.982 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "devicehealth", 2024-09-11T23:34:36.982 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-11T23:34:36.982 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-11T23:34:36.982 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-11T23:34:36.983 INFO:teuthology.orchestra.run.smithi037.stdout: "enable_monitoring": { 2024-09-11T23:34:36.983 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "enable_monitoring", 2024-09-11T23:34:36.983 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:36.983 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.983 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:36.983 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:36.983 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.983 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.983 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.983 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "monitor device health metrics", 2024-09-11T23:34:36.983 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.983 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.983 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.984 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.984 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-11T23:34:36.984 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-11T23:34:36.984 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:36.984 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.984 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:36.984 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:36.984 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.984 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.984 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:36.984 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:36.984 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:36.985 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:36.985 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:36.985 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:36.985 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:36.985 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:36.985 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:36.985 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.985 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.985 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.985 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.985 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-11T23:34:36.985 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-11T23:34:36.985 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:36.986 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.986 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:36.986 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:36.986 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.986 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.986 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.986 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:36.986 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.986 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.986 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.986 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.986 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-11T23:34:36.986 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-11T23:34:36.986 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:36.987 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.987 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:36.987 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-11T23:34:36.987 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.987 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.987 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:36.987 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:36.987 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:36.987 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:36.987 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:36.987 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:36.987 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:36.987 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:36.987 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:36.988 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.988 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.988 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.988 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.988 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-11T23:34:36.988 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-11T23:34:36.988 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:36.988 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.988 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:36.988 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:36.988 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.988 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.988 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.989 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:36.989 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.989 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.989 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.989 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.989 INFO:teuthology.orchestra.run.smithi037.stdout: "mark_out_threshold": { 2024-09-11T23:34:36.989 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mark_out_threshold", 2024-09-11T23:34:36.989 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-11T23:34:36.989 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.989 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:36.989 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "2419200", 2024-09-11T23:34:36.989 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.989 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.990 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.990 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-11T23:34:36.990 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.990 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.990 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.990 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.990 INFO:teuthology.orchestra.run.smithi037.stdout: "pool_name": { 2024-09-11T23:34:36.990 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "pool_name", 2024-09-11T23:34:36.990 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:36.990 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.990 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:36.990 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "device_health_metrics", 2024-09-11T23:34:36.990 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.991 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.991 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.991 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-11T23:34:36.991 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.991 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.991 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.991 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.991 INFO:teuthology.orchestra.run.smithi037.stdout: "retention_period": { 2024-09-11T23:34:36.991 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "retention_period", 2024-09-11T23:34:36.991 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-11T23:34:36.991 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.991 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:36.991 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "15552000", 2024-09-11T23:34:36.992 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.992 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.992 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.992 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how long to retain device health metrics", 2024-09-11T23:34:36.992 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.992 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.992 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.992 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.992 INFO:teuthology.orchestra.run.smithi037.stdout: "scrape_frequency": { 2024-09-11T23:34:36.992 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "scrape_frequency", 2024-09-11T23:34:36.992 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-11T23:34:36.992 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.992 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:36.992 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "86400", 2024-09-11T23:34:36.993 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.993 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.993 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.993 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-11T23:34:36.993 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.994 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.994 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.994 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.994 INFO:teuthology.orchestra.run.smithi037.stdout: "self_heal": { 2024-09-11T23:34:36.994 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "self_heal", 2024-09-11T23:34:36.994 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:36.994 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.994 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:36.994 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:36.994 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.994 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.994 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.994 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-11T23:34:36.995 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.995 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.995 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.995 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.995 INFO:teuthology.orchestra.run.smithi037.stdout: "sleep_interval": { 2024-09-11T23:34:36.995 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sleep_interval", 2024-09-11T23:34:36.995 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-11T23:34:36.995 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.995 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:36.995 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "600", 2024-09-11T23:34:36.995 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.995 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.996 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.996 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how frequently to wake up and check device health", 2024-09-11T23:34:36.996 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.996 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.996 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.996 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.996 INFO:teuthology.orchestra.run.smithi037.stdout: "warn_threshold": { 2024-09-11T23:34:36.996 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "warn_threshold", 2024-09-11T23:34:36.996 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-11T23:34:36.996 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.996 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:36.996 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "7257600", 2024-09-11T23:34:36.997 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.997 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.997 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:36.997 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-11T23:34:36.997 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.997 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.997 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.997 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:36.997 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:36.997 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.997 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:34:36.997 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "diskprediction_local", 2024-09-11T23:34:36.997 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-11T23:34:36.998 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-11T23:34:36.998 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-11T23:34:36.998 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-11T23:34:36.998 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-11T23:34:36.998 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:36.998 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:36.998 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:36.998 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:36.998 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:36.998 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:36.998 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:36.998 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:36.998 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:36.998 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:36.999 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:36.999 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:36.999 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:36.999 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:36.999 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:36.999 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:36.999 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:36.999 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:36.999 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:36.999 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-11T23:34:36.999 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-11T23:34:36.999 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:36.999 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.000 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.000 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.000 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.000 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.000 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.000 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.000 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.000 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.000 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.000 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.000 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-11T23:34:37.000 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-11T23:34:37.000 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.001 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.001 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.001 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-11T23:34:37.001 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.001 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.001 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.001 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.001 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.001 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.001 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.001 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.001 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.001 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.002 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.002 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.002 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.002 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.002 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.002 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-11T23:34:37.002 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-11T23:34:37.002 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.002 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.002 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.002 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.002 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.002 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.002 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.003 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.003 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.003 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.003 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.003 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.003 INFO:teuthology.orchestra.run.smithi037.stdout: "predict_interval": { 2024-09-11T23:34:37.003 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "predict_interval", 2024-09-11T23:34:37.003 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.003 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.003 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.003 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "86400", 2024-09-11T23:34:37.003 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.003 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.004 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.004 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.004 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.004 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.004 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.004 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.004 INFO:teuthology.orchestra.run.smithi037.stdout: "predictor_model": { 2024-09-11T23:34:37.004 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "predictor_model", 2024-09-11T23:34:37.004 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.004 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.004 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.004 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "prophetstor", 2024-09-11T23:34:37.004 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.005 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.005 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.005 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.005 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.005 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.005 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.005 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.005 INFO:teuthology.orchestra.run.smithi037.stdout: "sleep_interval": { 2024-09-11T23:34:37.005 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sleep_interval", 2024-09-11T23:34:37.005 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.005 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.005 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.005 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "600", 2024-09-11T23:34:37.006 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.006 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.006 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.006 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.006 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.006 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.006 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.006 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.006 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.006 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.006 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:34:37.006 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "influx", 2024-09-11T23:34:37.006 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": false, 2024-09-11T23:34:37.007 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "influxdb python module not found", 2024-09-11T23:34:37.007 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-11T23:34:37.007 INFO:teuthology.orchestra.run.smithi037.stdout: "batch_size": { 2024-09-11T23:34:37.007 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "batch_size", 2024-09-11T23:34:37.007 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:37.007 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.007 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.007 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5000", 2024-09-11T23:34:37.007 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.007 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.007 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.007 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-11T23:34:37.007 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.007 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.008 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.008 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.008 INFO:teuthology.orchestra.run.smithi037.stdout: "database": { 2024-09-11T23:34:37.008 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "database", 2024-09-11T23:34:37.008 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.008 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.008 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.008 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "ceph", 2024-09-11T23:34:37.008 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.008 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.008 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.008 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-11T23:34:37.009 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.009 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.009 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.009 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.009 INFO:teuthology.orchestra.run.smithi037.stdout: "hostname": { 2024-09-11T23:34:37.009 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "hostname", 2024-09-11T23:34:37.009 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.009 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.009 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.009 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.009 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.009 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.009 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.010 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "InfluxDB server hostname", 2024-09-11T23:34:37.010 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.010 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.010 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.010 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.010 INFO:teuthology.orchestra.run.smithi037.stdout: "interval": { 2024-09-11T23:34:37.010 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "interval", 2024-09-11T23:34:37.010 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-11T23:34:37.010 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.010 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.010 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "30", 2024-09-11T23:34:37.010 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "5", 2024-09-11T23:34:37.010 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.011 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.011 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-11T23:34:37.011 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.011 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.011 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.011 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.011 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-11T23:34:37.011 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-11T23:34:37.011 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.011 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.011 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.011 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.011 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.012 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.012 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.012 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.012 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.012 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.012 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.012 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.012 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.012 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.012 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.012 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.012 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.012 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.013 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.013 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-11T23:34:37.013 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-11T23:34:37.013 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.013 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.013 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.013 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.013 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.013 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.013 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.013 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.013 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.013 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.014 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.014 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.014 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-11T23:34:37.014 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-11T23:34:37.014 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.014 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.014 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.014 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-11T23:34:37.014 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.014 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.014 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.014 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.014 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.014 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.015 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.015 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.015 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.015 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.015 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.015 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.015 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.015 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.015 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.015 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-11T23:34:37.015 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-11T23:34:37.015 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.016 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.016 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.016 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.016 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.016 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.016 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.016 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.016 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.016 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.016 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.016 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.016 INFO:teuthology.orchestra.run.smithi037.stdout: "password": { 2024-09-11T23:34:37.016 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "password", 2024-09-11T23:34:37.017 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.017 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.017 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.017 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.017 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.017 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.017 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.017 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "password of InfluxDB server user", 2024-09-11T23:34:37.017 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.017 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.017 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.017 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.017 INFO:teuthology.orchestra.run.smithi037.stdout: "port": { 2024-09-11T23:34:37.017 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "port", 2024-09-11T23:34:37.018 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:37.018 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.018 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.018 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "8086", 2024-09-11T23:34:37.018 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.018 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.018 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.018 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "InfluxDB server port", 2024-09-11T23:34:37.018 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.018 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.018 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.018 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.018 INFO:teuthology.orchestra.run.smithi037.stdout: "ssl": { 2024-09-11T23:34:37.019 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ssl", 2024-09-11T23:34:37.019 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.019 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.019 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.019 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "false", 2024-09-11T23:34:37.019 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.019 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.019 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.019 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-11T23:34:37.019 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.020 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.020 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.020 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.020 INFO:teuthology.orchestra.run.smithi037.stdout: "threads": { 2024-09-11T23:34:37.020 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "threads", 2024-09-11T23:34:37.020 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:37.020 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.020 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.020 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5", 2024-09-11T23:34:37.020 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "1", 2024-09-11T23:34:37.020 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "32", 2024-09-11T23:34:37.020 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.021 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-11T23:34:37.021 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.021 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.021 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.021 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.021 INFO:teuthology.orchestra.run.smithi037.stdout: "username": { 2024-09-11T23:34:37.021 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "username", 2024-09-11T23:34:37.021 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.021 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.021 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.021 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.021 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.021 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.021 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.022 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "username of InfluxDB server user", 2024-09-11T23:34:37.022 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.022 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.022 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.022 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.022 INFO:teuthology.orchestra.run.smithi037.stdout: "verify_ssl": { 2024-09-11T23:34:37.022 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "verify_ssl", 2024-09-11T23:34:37.022 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.022 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.022 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.022 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "true", 2024-09-11T23:34:37.023 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.023 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.023 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.023 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-11T23:34:37.023 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.023 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.023 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.023 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.023 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.023 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.023 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:34:37.023 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "insights", 2024-09-11T23:34:37.023 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-11T23:34:37.024 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-11T23:34:37.024 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-11T23:34:37.024 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-11T23:34:37.024 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-11T23:34:37.024 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.024 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.024 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.024 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.024 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.024 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.024 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.024 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.024 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.025 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.025 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.025 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.025 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.025 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.025 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.025 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.025 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.025 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.025 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.025 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-11T23:34:37.025 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-11T23:34:37.025 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.026 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.026 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.026 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.026 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.026 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.026 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.026 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.026 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.026 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.026 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.026 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.026 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-11T23:34:37.026 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-11T23:34:37.027 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.027 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.027 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.027 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-11T23:34:37.027 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.027 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.027 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.027 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.027 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.027 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.027 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.027 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.027 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.027 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.028 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.028 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.028 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.028 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.028 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.028 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-11T23:34:37.028 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-11T23:34:37.028 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.028 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.028 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.028 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.028 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.029 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.029 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.029 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.029 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.029 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.029 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.029 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.029 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.029 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.029 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:34:37.029 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "iostat", 2024-09-11T23:34:37.029 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-11T23:34:37.029 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-11T23:34:37.030 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-11T23:34:37.030 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-11T23:34:37.030 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-11T23:34:37.030 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.030 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.030 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.030 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.030 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.030 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.030 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.030 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.030 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.030 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.031 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.031 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.031 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.031 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.031 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.031 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.031 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.031 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.031 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.031 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-11T23:34:37.031 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-11T23:34:37.031 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.031 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.032 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.032 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.032 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.032 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.032 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.032 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.032 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.032 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.032 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.032 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.032 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-11T23:34:37.032 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-11T23:34:37.033 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.033 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.033 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.033 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-11T23:34:37.033 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.033 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.033 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.033 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.033 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.033 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.033 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.033 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.033 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.034 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.034 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.034 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.034 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.034 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.034 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.034 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-11T23:34:37.034 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-11T23:34:37.034 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.034 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.034 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.034 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.034 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.034 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.035 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.035 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.035 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.035 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.035 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.035 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.035 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.035 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.035 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:34:37.035 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "k8sevents", 2024-09-11T23:34:37.035 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-11T23:34:37.035 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-11T23:34:37.036 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-11T23:34:37.036 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_event_retention_days": { 2024-09-11T23:34:37.036 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ceph_event_retention_days", 2024-09-11T23:34:37.036 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:37.036 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.036 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.036 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "7", 2024-09-11T23:34:37.036 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.036 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.036 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.036 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-11T23:34:37.036 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.036 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.037 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.037 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.037 INFO:teuthology.orchestra.run.smithi037.stdout: "config_check_secs": { 2024-09-11T23:34:37.037 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "config_check_secs", 2024-09-11T23:34:37.037 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:37.037 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.037 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.037 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-09-11T23:34:37.037 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "10", 2024-09-11T23:34:37.037 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.037 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.037 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-11T23:34:37.038 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.038 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.038 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.038 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.038 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-11T23:34:37.038 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-11T23:34:37.038 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.038 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.038 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.038 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.038 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.038 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.038 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.039 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.039 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.039 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.039 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.039 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.039 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.039 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.039 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.039 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.039 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.039 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.039 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.039 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-11T23:34:37.039 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-11T23:34:37.040 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.040 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.040 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.040 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.040 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.040 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.040 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.040 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.040 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.040 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.040 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.040 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.041 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-11T23:34:37.041 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-11T23:34:37.041 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.041 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.041 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.041 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-11T23:34:37.041 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.041 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.041 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.041 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.041 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.041 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.041 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.042 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.042 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.042 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.042 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.042 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.042 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.042 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.042 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.042 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-11T23:34:37.042 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-11T23:34:37.042 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.042 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.042 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.043 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.043 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.043 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.043 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.043 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.043 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.043 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.043 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.043 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.043 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.043 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.043 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:34:37.043 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "localpool", 2024-09-11T23:34:37.043 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-11T23:34:37.044 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-11T23:34:37.044 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-11T23:34:37.044 INFO:teuthology.orchestra.run.smithi037.stdout: "failure_domain": { 2024-09-11T23:34:37.044 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "failure_domain", 2024-09-11T23:34:37.044 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.044 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.044 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.044 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "host", 2024-09-11T23:34:37.044 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.044 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.044 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.044 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "failure domain for any created local pool", 2024-09-11T23:34:37.044 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-11T23:34:37.045 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.045 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.045 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.045 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-11T23:34:37.045 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-11T23:34:37.045 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.045 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.045 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.045 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.045 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.045 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.045 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.045 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.046 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.046 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.046 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.046 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.046 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.046 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.046 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.046 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.046 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.046 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.046 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.046 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-11T23:34:37.046 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-11T23:34:37.047 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.047 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.047 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.047 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.047 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.047 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.047 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.047 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.047 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.047 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.047 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.047 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.047 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-11T23:34:37.047 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-11T23:34:37.048 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.048 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.048 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.048 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-11T23:34:37.048 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.048 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.048 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.048 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.048 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.048 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.048 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.048 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.048 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.049 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.049 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.049 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.049 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.049 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.049 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.049 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-11T23:34:37.049 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-11T23:34:37.049 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.049 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.049 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.049 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.049 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.049 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.050 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.050 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.050 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.050 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.050 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.050 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.050 INFO:teuthology.orchestra.run.smithi037.stdout: "min_size": { 2024-09-11T23:34:37.050 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "min_size", 2024-09-11T23:34:37.050 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:37.050 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.050 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.050 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.051 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.051 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.051 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.051 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "default min_size for any created local pool", 2024-09-11T23:34:37.051 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-11T23:34:37.051 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.051 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.051 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.051 INFO:teuthology.orchestra.run.smithi037.stdout: "num_rep": { 2024-09-11T23:34:37.051 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "num_rep", 2024-09-11T23:34:37.051 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:37.051 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.051 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.051 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "3", 2024-09-11T23:34:37.052 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.052 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.052 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.052 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "default replica count for any created local pool", 2024-09-11T23:34:37.052 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.052 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.052 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.052 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.052 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_num": { 2024-09-11T23:34:37.052 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "pg_num", 2024-09-11T23:34:37.052 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:37.052 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.053 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.053 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "128", 2024-09-11T23:34:37.053 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.053 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.053 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.053 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "default pg_num for any created local pool", 2024-09-11T23:34:37.053 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.053 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.053 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.053 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.053 INFO:teuthology.orchestra.run.smithi037.stdout: "prefix": { 2024-09-11T23:34:37.053 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "prefix", 2024-09-11T23:34:37.053 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.054 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.054 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.054 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.054 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.054 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.054 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.054 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "name prefix for any created local pool", 2024-09-11T23:34:37.054 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.054 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.054 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.054 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.054 INFO:teuthology.orchestra.run.smithi037.stdout: "subtree": { 2024-09-11T23:34:37.054 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "subtree", 2024-09-11T23:34:37.055 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.055 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.055 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.055 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "rack", 2024-09-11T23:34:37.055 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.055 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.055 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.055 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-11T23:34:37.055 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-11T23:34:37.055 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.055 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.055 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.055 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.055 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.056 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:34:37.056 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mds_autoscaler", 2024-09-11T23:34:37.056 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-11T23:34:37.056 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-11T23:34:37.056 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-11T23:34:37.056 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-11T23:34:37.056 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-11T23:34:37.056 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.056 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.056 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.056 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.056 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.057 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.057 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.057 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.057 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.057 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.057 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.057 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.057 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.057 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.057 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.057 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.057 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.057 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.058 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.058 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-11T23:34:37.058 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-11T23:34:37.058 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.058 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.058 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.058 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.058 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.058 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.058 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.058 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.058 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.058 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.059 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.059 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.059 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-11T23:34:37.059 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-11T23:34:37.059 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.059 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.059 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.059 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-11T23:34:37.059 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.059 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.059 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.059 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.059 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.060 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.060 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.060 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.060 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.060 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.060 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.060 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.060 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.060 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.060 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.060 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-11T23:34:37.060 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-11T23:34:37.061 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.061 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.061 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.061 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.061 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.061 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.061 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.061 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.061 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.061 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.061 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.061 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.061 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.062 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.062 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:34:37.062 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mirroring", 2024-09-11T23:34:37.062 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-11T23:34:37.062 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-11T23:34:37.062 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-11T23:34:37.062 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-11T23:34:37.062 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-11T23:34:37.062 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.062 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.062 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.062 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.062 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.062 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.063 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.063 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.063 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.063 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.063 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.063 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.063 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.063 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.063 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.063 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.063 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.063 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.063 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.063 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-11T23:34:37.064 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-11T23:34:37.064 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.064 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.064 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.064 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.064 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.064 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.064 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.064 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.064 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.064 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.064 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.064 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.065 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-11T23:34:37.065 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-11T23:34:37.065 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.065 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.065 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.065 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-11T23:34:37.065 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.065 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.065 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.065 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.065 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.065 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.065 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.066 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.066 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.066 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.066 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.066 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.066 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.066 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.066 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.066 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-11T23:34:37.066 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-11T23:34:37.066 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.066 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.066 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.067 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.067 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.067 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.067 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.067 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.067 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.067 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.067 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.067 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.067 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.067 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.067 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:34:37.067 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "nfs", 2024-09-11T23:34:37.068 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-11T23:34:37.068 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-11T23:34:37.068 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-11T23:34:37.068 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-11T23:34:37.068 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-11T23:34:37.068 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.068 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.068 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.068 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.069 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.069 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.069 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.069 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.069 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.069 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.069 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.069 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.069 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.069 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.069 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.069 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.070 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.070 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.070 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.070 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-11T23:34:37.070 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-11T23:34:37.070 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.070 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.070 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.070 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.070 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.070 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.070 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.071 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.071 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.071 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.071 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.071 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.071 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-11T23:34:37.071 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-11T23:34:37.071 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.071 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.071 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.071 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-11T23:34:37.072 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.072 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.072 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.072 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.072 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.072 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.072 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.072 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.072 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.072 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.072 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.072 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.072 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.073 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.073 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.073 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-11T23:34:37.073 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-11T23:34:37.073 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.073 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.073 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.073 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.073 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.073 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.073 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.073 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.073 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.074 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.074 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.074 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.074 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.074 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.074 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:34:37.074 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "orchestrator", 2024-09-11T23:34:37.074 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-11T23:34:37.074 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-11T23:34:37.074 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-11T23:34:37.074 INFO:teuthology.orchestra.run.smithi037.stdout: "fail_fs": { 2024-09-11T23:34:37.074 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "fail_fs", 2024-09-11T23:34:37.074 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.074 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.075 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.075 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.075 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.075 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.075 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.075 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-11T23:34:37.075 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.075 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.075 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.075 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.075 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-11T23:34:37.075 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-11T23:34:37.075 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.076 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.076 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.076 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.076 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.076 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.076 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.076 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.076 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.076 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.076 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.076 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.076 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.076 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.077 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.077 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.077 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.077 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.077 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.077 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-11T23:34:37.077 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-11T23:34:37.077 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.077 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.077 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.077 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.077 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.077 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.077 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.078 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.078 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.078 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.078 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.078 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.078 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-11T23:34:37.078 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-11T23:34:37.078 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.078 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.078 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.078 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-11T23:34:37.078 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.078 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.078 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.079 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.079 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.079 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.079 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.079 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.079 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.079 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.079 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.079 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.079 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.079 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.079 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.079 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-11T23:34:37.079 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-11T23:34:37.080 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.080 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.080 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.080 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.080 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.080 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.080 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.080 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.080 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.080 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.080 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.080 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.080 INFO:teuthology.orchestra.run.smithi037.stdout: "orchestrator": { 2024-09-11T23:34:37.080 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "orchestrator", 2024-09-11T23:34:37.081 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.081 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.081 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.081 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.081 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.081 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.081 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.081 INFO:teuthology.orchestra.run.smithi037.stdout: "cephadm", 2024-09-11T23:34:37.081 INFO:teuthology.orchestra.run.smithi037.stdout: "rook", 2024-09-11T23:34:37.081 INFO:teuthology.orchestra.run.smithi037.stdout: "test_orchestrator" 2024-09-11T23:34:37.081 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.081 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Orchestrator backend", 2024-09-11T23:34:37.081 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.082 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.082 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.082 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.082 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.082 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.082 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:34:37.082 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "osd_perf_query", 2024-09-11T23:34:37.082 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-11T23:34:37.082 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-11T23:34:37.082 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-11T23:34:37.082 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-11T23:34:37.082 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-11T23:34:37.082 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.083 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.083 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.083 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.083 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.083 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.083 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.083 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.083 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.083 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.083 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.083 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.083 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.083 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.084 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.084 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.084 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.084 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.084 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.084 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-11T23:34:37.084 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-11T23:34:37.084 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.084 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.084 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.084 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.084 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.084 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.085 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.085 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.085 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.085 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.085 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.085 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.085 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-11T23:34:37.085 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-11T23:34:37.085 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.085 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.085 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.085 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-11T23:34:37.085 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.085 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.086 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.086 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.086 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.086 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.086 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.086 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.086 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.086 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.086 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.086 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.086 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.086 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.086 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.087 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-11T23:34:37.087 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-11T23:34:37.087 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.087 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.087 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.087 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.087 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.087 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.087 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.087 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.087 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.087 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.087 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.087 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.088 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.088 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.088 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:34:37.088 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "osd_support", 2024-09-11T23:34:37.088 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-11T23:34:37.088 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-11T23:34:37.088 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-11T23:34:37.088 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-11T23:34:37.088 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-11T23:34:37.088 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.088 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.088 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.088 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.089 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.089 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.089 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.089 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.089 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.089 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.089 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.089 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.089 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.092 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.092 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.092 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.093 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.093 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.093 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.093 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-11T23:34:37.093 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-11T23:34:37.093 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.093 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.093 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.093 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.093 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.093 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.093 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.093 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.094 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.094 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.094 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.094 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.094 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-11T23:34:37.094 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-11T23:34:37.094 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.094 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.094 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.094 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-11T23:34:37.094 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.094 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.094 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.095 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.095 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.095 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.095 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.095 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.095 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.095 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.095 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.095 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.095 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.095 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.095 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.095 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-11T23:34:37.095 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-11T23:34:37.096 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.096 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.096 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.096 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.096 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.096 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.096 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.096 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.096 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.096 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.096 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.096 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.096 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.097 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.097 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:34:37.097 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "pg_autoscaler", 2024-09-11T23:34:37.097 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-11T23:34:37.097 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-11T23:34:37.097 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-11T23:34:37.097 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-11T23:34:37.097 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-11T23:34:37.097 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.097 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.097 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.097 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.097 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.097 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.098 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.098 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.098 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.098 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.098 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.098 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.098 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.098 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.098 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.098 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.098 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.098 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.098 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.099 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-11T23:34:37.099 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-11T23:34:37.099 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.099 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.099 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.099 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.099 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.099 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.099 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.099 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.099 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.099 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.099 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.099 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.100 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-11T23:34:37.100 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-11T23:34:37.100 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.100 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.100 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.100 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-11T23:34:37.100 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.100 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.100 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.100 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.100 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.101 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.101 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.101 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.101 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.101 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.101 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.101 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.101 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.101 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.101 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.101 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-11T23:34:37.101 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-11T23:34:37.102 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.102 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.102 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.102 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.102 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.102 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.102 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.102 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.102 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.102 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.102 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.102 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.102 INFO:teuthology.orchestra.run.smithi037.stdout: "sleep_interval": { 2024-09-11T23:34:37.102 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sleep_interval", 2024-09-11T23:34:37.103 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-11T23:34:37.103 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.103 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.103 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "60", 2024-09-11T23:34:37.103 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.103 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.103 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.103 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.103 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.103 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.103 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.103 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.103 INFO:teuthology.orchestra.run.smithi037.stdout: "threshold": { 2024-09-11T23:34:37.104 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "threshold", 2024-09-11T23:34:37.104 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-09-11T23:34:37.104 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.104 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.104 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "3.0", 2024-09-11T23:34:37.104 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "1.0", 2024-09-11T23:34:37.104 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.104 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.104 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "scaling threshold", 2024-09-11T23:34:37.104 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-11T23:34:37.104 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.104 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.105 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.105 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.105 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.105 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:34:37.105 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "progress", 2024-09-11T23:34:37.105 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-11T23:34:37.105 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-11T23:34:37.105 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-11T23:34:37.105 INFO:teuthology.orchestra.run.smithi037.stdout: "allow_pg_recovery_event": { 2024-09-11T23:34:37.105 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "allow_pg_recovery_event", 2024-09-11T23:34:37.105 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.105 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.105 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.106 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.106 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.106 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.106 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.106 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-11T23:34:37.106 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.106 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.106 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.106 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.106 INFO:teuthology.orchestra.run.smithi037.stdout: "enabled": { 2024-09-11T23:34:37.106 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "enabled", 2024-09-11T23:34:37.106 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.106 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.106 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.107 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:37.107 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.107 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.107 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.107 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.107 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.107 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.107 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.107 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.107 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-11T23:34:37.107 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-11T23:34:37.107 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.107 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.108 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.108 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.108 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.108 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.108 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.108 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.108 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.108 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.108 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.108 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.108 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.108 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.108 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.109 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.109 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.109 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.109 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.109 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-11T23:34:37.109 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-11T23:34:37.109 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.109 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.109 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.109 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.109 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.109 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.109 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.110 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.110 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.110 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.110 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.110 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.110 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-11T23:34:37.110 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-11T23:34:37.110 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.110 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.110 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.110 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-11T23:34:37.110 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.110 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.110 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.111 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.111 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.111 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.111 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.111 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.111 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.111 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.111 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.111 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.111 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.111 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.111 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.111 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-11T23:34:37.111 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-11T23:34:37.112 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.112 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.112 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.112 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.112 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.112 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.112 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.112 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.112 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.112 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.112 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.112 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.112 INFO:teuthology.orchestra.run.smithi037.stdout: "max_completed_events": { 2024-09-11T23:34:37.112 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "max_completed_events", 2024-09-11T23:34:37.113 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:37.113 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.113 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.113 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "50", 2024-09-11T23:34:37.113 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.113 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.113 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.113 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "number of past completed events to remember", 2024-09-11T23:34:37.113 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.113 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.113 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.113 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.113 INFO:teuthology.orchestra.run.smithi037.stdout: "sleep_interval": { 2024-09-11T23:34:37.113 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sleep_interval", 2024-09-11T23:34:37.114 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-11T23:34:37.114 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.114 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.114 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5", 2024-09-11T23:34:37.114 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.114 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.114 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.114 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how long the module is going to sleep", 2024-09-11T23:34:37.114 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.114 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.114 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.114 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.114 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.115 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.115 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:34:37.115 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "prometheus", 2024-09-11T23:34:37.115 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-11T23:34:37.115 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-11T23:34:37.115 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-11T23:34:37.115 INFO:teuthology.orchestra.run.smithi037.stdout: "cache": { 2024-09-11T23:34:37.115 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cache", 2024-09-11T23:34:37.115 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.115 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.115 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.115 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:37.115 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.116 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.116 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.116 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.116 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.116 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.116 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.116 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.116 INFO:teuthology.orchestra.run.smithi037.stdout: "exclude_perf_counters": { 2024-09-11T23:34:37.116 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "exclude_perf_counters", 2024-09-11T23:34:37.116 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.116 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.116 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.116 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:37.116 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.117 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.117 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.117 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-11T23:34:37.117 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-11T23:34:37.117 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.117 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.117 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.117 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-11T23:34:37.117 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-11T23:34:37.117 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.117 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.117 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.117 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.118 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.118 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.118 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.118 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.118 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.118 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.118 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.118 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.118 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.118 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.118 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.118 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.118 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.118 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.119 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.119 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-11T23:34:37.119 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-11T23:34:37.119 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.119 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.119 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.119 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.119 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.119 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.119 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.119 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.119 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.119 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.119 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.120 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.120 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-11T23:34:37.120 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-11T23:34:37.120 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.120 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.120 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.120 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-11T23:34:37.120 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.120 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.120 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.120 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.120 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.121 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.121 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.121 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.121 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.121 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.121 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.121 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.121 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.121 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.121 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.121 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-11T23:34:37.121 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-11T23:34:37.121 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.121 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.122 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.122 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.122 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.122 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.122 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.122 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.122 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.122 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.122 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.122 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.122 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_stats_pools": { 2024-09-11T23:34:37.122 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rbd_stats_pools", 2024-09-11T23:34:37.122 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.123 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.123 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.123 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.123 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.123 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.123 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.123 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.123 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.123 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.123 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.123 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.123 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-11T23:34:37.123 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-11T23:34:37.123 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:37.124 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.124 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.124 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "300", 2024-09-11T23:34:37.124 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.124 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.124 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.124 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.124 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.124 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.124 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.124 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.124 INFO:teuthology.orchestra.run.smithi037.stdout: "scrape_interval": { 2024-09-11T23:34:37.124 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "scrape_interval", 2024-09-11T23:34:37.124 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-09-11T23:34:37.125 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.125 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.125 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "15.0", 2024-09-11T23:34:37.125 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.125 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.125 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.125 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.125 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.125 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.125 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.125 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.125 INFO:teuthology.orchestra.run.smithi037.stdout: "server_addr": { 2024-09-11T23:34:37.125 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_addr", 2024-09-11T23:34:37.125 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.126 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.126 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.126 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "::", 2024-09-11T23:34:37.126 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.126 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.126 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.126 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-11T23:34:37.126 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.126 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.126 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.126 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.126 INFO:teuthology.orchestra.run.smithi037.stdout: "server_port": { 2024-09-11T23:34:37.126 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_port", 2024-09-11T23:34:37.127 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:37.127 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.127 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.127 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "9283", 2024-09-11T23:34:37.127 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.127 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.127 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.127 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-11T23:34:37.127 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.127 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.127 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.127 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.127 INFO:teuthology.orchestra.run.smithi037.stdout: "stale_cache_strategy": { 2024-09-11T23:34:37.128 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "stale_cache_strategy", 2024-09-11T23:34:37.128 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.128 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.128 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.128 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "log", 2024-09-11T23:34:37.128 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.128 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.128 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.128 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.128 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.128 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.128 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.129 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.129 INFO:teuthology.orchestra.run.smithi037.stdout: "standby_behaviour": { 2024-09-11T23:34:37.129 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "standby_behaviour", 2024-09-11T23:34:37.129 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.129 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.129 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.129 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "default", 2024-09-11T23:34:37.129 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.129 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.129 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.129 INFO:teuthology.orchestra.run.smithi037.stdout: "default", 2024-09-11T23:34:37.129 INFO:teuthology.orchestra.run.smithi037.stdout: "error" 2024-09-11T23:34:37.129 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.130 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.130 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.130 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.130 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.130 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.130 INFO:teuthology.orchestra.run.smithi037.stdout: "standby_error_status_code": { 2024-09-11T23:34:37.130 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "standby_error_status_code", 2024-09-11T23:34:37.130 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:37.130 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.130 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.130 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "500", 2024-09-11T23:34:37.130 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "400", 2024-09-11T23:34:37.130 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "599", 2024-09-11T23:34:37.130 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.131 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.131 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.131 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.131 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.131 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.131 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.131 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.131 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:34:37.131 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rbd_support", 2024-09-11T23:34:37.131 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-11T23:34:37.131 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-11T23:34:37.131 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-11T23:34:37.132 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-11T23:34:37.132 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-11T23:34:37.132 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.132 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.132 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.132 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.132 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.132 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.132 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.132 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.132 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.132 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.132 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.133 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.133 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.133 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.133 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.133 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.133 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.133 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.133 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.133 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-11T23:34:37.133 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-11T23:34:37.133 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.133 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.133 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.134 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.134 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.134 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.134 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.134 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.134 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.134 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.134 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.134 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.134 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-11T23:34:37.134 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-11T23:34:37.134 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.134 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.135 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.135 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-11T23:34:37.135 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.135 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.135 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.135 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.135 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.135 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.135 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.135 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.135 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.135 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.135 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.135 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.136 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.136 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.136 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.136 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-11T23:34:37.136 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-11T23:34:37.136 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.136 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.136 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.136 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.136 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.136 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.136 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.137 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.137 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.137 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.137 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.137 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.137 INFO:teuthology.orchestra.run.smithi037.stdout: "max_concurrent_snap_create": { 2024-09-11T23:34:37.137 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "max_concurrent_snap_create", 2024-09-11T23:34:37.137 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:37.137 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.137 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.137 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-09-11T23:34:37.137 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.137 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.137 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.138 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.138 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.138 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.138 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.138 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.138 INFO:teuthology.orchestra.run.smithi037.stdout: "mirror_snapshot_schedule": { 2024-09-11T23:34:37.138 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mirror_snapshot_schedule", 2024-09-11T23:34:37.138 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.138 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.138 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.138 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.138 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.138 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.139 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.139 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.139 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.139 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.139 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.139 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.139 INFO:teuthology.orchestra.run.smithi037.stdout: "trash_purge_schedule": { 2024-09-11T23:34:37.139 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "trash_purge_schedule", 2024-09-11T23:34:37.139 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.139 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.139 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.139 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.139 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.140 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.140 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.140 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.140 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.140 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.140 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.140 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.140 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.140 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.140 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:34:37.140 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "restful", 2024-09-11T23:34:37.140 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-11T23:34:37.140 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-11T23:34:37.141 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-11T23:34:37.141 INFO:teuthology.orchestra.run.smithi037.stdout: "enable_auth": { 2024-09-11T23:34:37.141 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "enable_auth", 2024-09-11T23:34:37.141 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.141 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.141 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.141 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:37.141 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.141 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.141 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.141 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.141 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.141 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.142 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.142 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.142 INFO:teuthology.orchestra.run.smithi037.stdout: "key_file": { 2024-09-11T23:34:37.142 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "key_file", 2024-09-11T23:34:37.142 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.142 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.142 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.142 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.142 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.142 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.142 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.142 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.143 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.143 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.143 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.143 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.143 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-11T23:34:37.143 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-11T23:34:37.143 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.143 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.143 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.144 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.144 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.144 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.144 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.144 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.144 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.144 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.144 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.144 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.144 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.144 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.144 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.144 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.145 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.145 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.145 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.145 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-11T23:34:37.145 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-11T23:34:37.145 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.145 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.145 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.145 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.145 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.145 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.145 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.145 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.145 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.146 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.146 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.146 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.146 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-11T23:34:37.146 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-11T23:34:37.146 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.146 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.146 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.146 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-11T23:34:37.146 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.146 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.146 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.146 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.147 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.147 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.147 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.147 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.147 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.147 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.147 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.147 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.147 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.147 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.147 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.147 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-11T23:34:37.147 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-11T23:34:37.147 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.148 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.148 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.148 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.148 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.148 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.148 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.148 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.148 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.148 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.148 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.148 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.148 INFO:teuthology.orchestra.run.smithi037.stdout: "server_addr": { 2024-09-11T23:34:37.148 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_addr", 2024-09-11T23:34:37.149 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.149 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.149 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.149 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.149 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.149 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.149 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.149 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.149 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.149 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.149 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.149 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.149 INFO:teuthology.orchestra.run.smithi037.stdout: "server_port": { 2024-09-11T23:34:37.149 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_port", 2024-09-11T23:34:37.150 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.150 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.150 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.150 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.150 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.150 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.150 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.150 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.150 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.150 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.150 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.150 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.150 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.150 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.151 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:34:37.151 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rgw", 2024-09-11T23:34:37.151 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-11T23:34:37.151 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-11T23:34:37.151 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-11T23:34:37.151 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-11T23:34:37.151 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-11T23:34:37.151 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.151 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.151 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.151 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.151 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.151 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.152 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.152 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.152 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.152 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.152 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.152 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.152 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.152 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.152 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.152 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.152 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.152 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.152 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.153 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-11T23:34:37.153 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-11T23:34:37.153 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.153 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.153 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.153 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.153 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.153 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.153 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.153 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.153 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.153 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.153 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.154 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.154 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-11T23:34:37.154 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-11T23:34:37.154 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.154 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.154 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.154 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-11T23:34:37.154 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.154 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.154 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.154 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.154 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.154 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.154 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.155 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.155 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.155 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.155 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.155 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.155 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.155 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.155 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.155 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-11T23:34:37.155 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-11T23:34:37.155 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.155 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.155 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.155 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.156 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.156 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.156 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.156 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.156 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.156 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.156 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.156 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.156 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.156 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.156 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:34:37.156 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rook", 2024-09-11T23:34:37.156 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-11T23:34:37.157 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-11T23:34:37.157 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-11T23:34:37.157 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-11T23:34:37.157 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-11T23:34:37.157 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.157 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.157 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.157 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.157 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.157 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.157 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.157 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.157 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.157 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.158 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.158 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.158 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.158 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.158 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.158 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.158 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.158 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.158 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.158 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-11T23:34:37.158 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-11T23:34:37.158 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.158 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.158 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.159 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.159 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.159 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.159 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.159 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.159 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.159 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.159 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.159 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.159 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-11T23:34:37.159 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-11T23:34:37.159 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.159 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.159 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.160 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-11T23:34:37.160 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.160 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.160 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.160 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.160 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.160 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.160 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.160 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.160 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.160 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.160 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.160 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.160 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.161 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.161 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.161 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-11T23:34:37.161 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-11T23:34:37.161 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.161 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.161 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.161 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.161 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.161 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.161 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.161 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.161 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.162 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.162 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.162 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.162 INFO:teuthology.orchestra.run.smithi037.stdout: "storage_class": { 2024-09-11T23:34:37.162 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "storage_class", 2024-09-11T23:34:37.162 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.162 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.162 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.162 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "local", 2024-09-11T23:34:37.162 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.162 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.162 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.162 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-11T23:34:37.162 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.163 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.163 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.163 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.163 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.163 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.163 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:34:37.163 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "selftest", 2024-09-11T23:34:37.163 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-11T23:34:37.163 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-11T23:34:37.163 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-11T23:34:37.163 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-11T23:34:37.163 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-11T23:34:37.163 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.163 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.164 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.164 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.164 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.164 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.164 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.164 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.164 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.164 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.164 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.164 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.164 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.164 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.164 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.164 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.165 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.165 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.165 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.165 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-11T23:34:37.165 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-11T23:34:37.165 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.165 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.165 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.165 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.165 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.165 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.165 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.166 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.166 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.166 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.166 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.166 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.166 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-11T23:34:37.166 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-11T23:34:37.166 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.166 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.166 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.166 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-11T23:34:37.166 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.166 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.166 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.167 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.167 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.167 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.167 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.167 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.167 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.167 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.167 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.167 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.167 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.167 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.167 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.167 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-11T23:34:37.168 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-11T23:34:37.168 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.168 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.168 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.168 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.168 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.168 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.168 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.168 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.168 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.168 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.168 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.168 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.168 INFO:teuthology.orchestra.run.smithi037.stdout: "roption1": { 2024-09-11T23:34:37.169 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "roption1", 2024-09-11T23:34:37.169 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.169 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.169 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.169 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.169 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.169 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.169 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.169 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.169 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.169 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.169 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.169 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.169 INFO:teuthology.orchestra.run.smithi037.stdout: "roption2": { 2024-09-11T23:34:37.170 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "roption2", 2024-09-11T23:34:37.170 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.170 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.170 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.170 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "xyz", 2024-09-11T23:34:37.170 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.170 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.170 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.170 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.170 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.170 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.170 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.170 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.170 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption1": { 2024-09-11T23:34:37.171 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption1", 2024-09-11T23:34:37.171 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.171 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.171 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.171 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.171 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.171 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.171 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.171 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.171 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.171 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.171 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.171 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.172 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption2": { 2024-09-11T23:34:37.172 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption2", 2024-09-11T23:34:37.172 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:37.172 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.172 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.172 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.172 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.172 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.172 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.172 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.172 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.172 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.173 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.173 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.173 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption3": { 2024-09-11T23:34:37.173 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption3", 2024-09-11T23:34:37.173 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-09-11T23:34:37.173 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.173 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.173 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.173 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.173 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.173 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.173 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.174 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.174 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.174 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.174 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.174 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption4": { 2024-09-11T23:34:37.174 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption4", 2024-09-11T23:34:37.174 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.174 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.174 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.174 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.174 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.174 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.175 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.175 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.175 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.175 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.175 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.175 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.175 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption5": { 2024-09-11T23:34:37.175 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption5", 2024-09-11T23:34:37.175 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.175 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.175 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.175 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.175 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.176 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.176 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.176 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.176 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.176 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.176 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.176 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.176 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption6": { 2024-09-11T23:34:37.176 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption6", 2024-09-11T23:34:37.176 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.176 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.176 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.176 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:37.177 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.177 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.177 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.177 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.177 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.177 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.177 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.177 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.177 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption7": { 2024-09-11T23:34:37.177 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption7", 2024-09-11T23:34:37.177 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:37.177 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.177 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.178 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.178 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "1", 2024-09-11T23:34:37.178 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "42", 2024-09-11T23:34:37.178 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.178 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.178 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.178 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.178 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.178 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.178 INFO:teuthology.orchestra.run.smithi037.stdout: "testkey": { 2024-09-11T23:34:37.178 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "testkey", 2024-09-11T23:34:37.178 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.178 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.179 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.179 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.179 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.179 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.179 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.179 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.179 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.179 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.179 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.179 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.179 INFO:teuthology.orchestra.run.smithi037.stdout: "testlkey": { 2024-09-11T23:34:37.179 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "testlkey", 2024-09-11T23:34:37.179 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.179 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.180 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.180 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.180 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.180 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.180 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.180 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.180 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.180 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.180 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.180 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.180 INFO:teuthology.orchestra.run.smithi037.stdout: "testnewline": { 2024-09-11T23:34:37.180 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "testnewline", 2024-09-11T23:34:37.180 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.181 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.181 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.181 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.181 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.181 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.181 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.181 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.181 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.181 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.181 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.181 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.181 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.181 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.182 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:34:37.182 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "snap_schedule", 2024-09-11T23:34:37.182 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-11T23:34:37.182 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-11T23:34:37.182 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-11T23:34:37.182 INFO:teuthology.orchestra.run.smithi037.stdout: "allow_m_granularity": { 2024-09-11T23:34:37.182 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "allow_m_granularity", 2024-09-11T23:34:37.182 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.182 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.182 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.182 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.182 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.182 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.182 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.183 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "allow minute scheduled snapshots", 2024-09-11T23:34:37.183 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.183 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.183 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.183 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.183 INFO:teuthology.orchestra.run.smithi037.stdout: "dump_on_update": { 2024-09-11T23:34:37.183 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "dump_on_update", 2024-09-11T23:34:37.183 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.183 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.183 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.183 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.183 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.183 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.183 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.184 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "dump database to debug log on update", 2024-09-11T23:34:37.184 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.184 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.184 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.184 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.184 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-11T23:34:37.184 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-11T23:34:37.184 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.184 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.184 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.184 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.184 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.184 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.184 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.185 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.185 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.185 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.185 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.185 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.185 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.185 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.185 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.185 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.185 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.185 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.185 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.185 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-11T23:34:37.186 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-11T23:34:37.186 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.186 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.186 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.186 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.186 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.186 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.186 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.186 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.186 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.186 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.186 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.187 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.187 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-11T23:34:37.187 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-11T23:34:37.187 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.187 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.187 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.187 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-11T23:34:37.187 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.187 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.187 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.187 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.187 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.187 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.188 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.188 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.188 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.188 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.188 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.188 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.188 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.188 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.188 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.188 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-11T23:34:37.188 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-11T23:34:37.188 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.188 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.188 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.189 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.189 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.189 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.189 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.189 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.189 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.189 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.189 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.189 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.189 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.189 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.189 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:34:37.189 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "stats", 2024-09-11T23:34:37.190 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-11T23:34:37.190 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-11T23:34:37.190 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-11T23:34:37.190 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-11T23:34:37.190 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-11T23:34:37.190 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.190 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.190 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.190 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.190 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.190 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.190 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.190 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.191 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.191 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.191 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.191 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.191 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.191 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.191 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.191 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.191 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.191 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.191 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.191 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-11T23:34:37.191 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-11T23:34:37.192 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.192 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.192 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.192 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.192 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.192 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.192 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.192 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.192 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.192 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.192 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.192 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.192 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-11T23:34:37.192 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-11T23:34:37.193 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.193 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.193 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.193 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-11T23:34:37.193 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.193 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.193 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.193 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.193 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.193 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.193 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.193 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.193 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.194 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.194 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.194 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.194 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.194 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.194 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.194 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-11T23:34:37.194 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-11T23:34:37.194 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.194 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.194 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.194 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.194 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.194 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.195 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.195 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.195 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.195 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.195 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.195 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.195 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.195 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.195 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:34:37.195 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "status", 2024-09-11T23:34:37.195 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-11T23:34:37.195 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-11T23:34:37.195 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-11T23:34:37.195 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-11T23:34:37.196 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-11T23:34:37.196 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.196 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.196 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.196 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.196 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.196 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.196 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.196 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.196 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.196 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.196 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.197 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.197 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.197 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.197 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.197 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.197 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.197 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.197 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.197 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-11T23:34:37.197 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-11T23:34:37.197 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.197 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.197 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.197 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.198 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.198 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.198 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.198 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.198 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.198 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.198 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.198 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.198 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-11T23:34:37.198 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-11T23:34:37.198 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.198 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.198 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.199 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-11T23:34:37.199 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.199 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.199 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.199 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.199 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.199 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.199 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.199 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.199 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.199 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.199 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.199 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.200 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.200 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.200 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.200 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-11T23:34:37.200 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-11T23:34:37.200 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.200 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.200 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.200 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.200 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.200 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.200 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.200 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.201 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.201 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.201 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.201 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.201 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.201 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.201 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:34:37.201 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "telegraf", 2024-09-11T23:34:37.201 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-11T23:34:37.201 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-11T23:34:37.201 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-11T23:34:37.201 INFO:teuthology.orchestra.run.smithi037.stdout: "address": { 2024-09-11T23:34:37.201 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "address", 2024-09-11T23:34:37.201 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.202 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.202 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.202 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-11T23:34:37.202 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.202 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.202 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.202 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.202 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.202 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.202 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.202 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.203 INFO:teuthology.orchestra.run.smithi037.stdout: "interval": { 2024-09-11T23:34:37.203 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "interval", 2024-09-11T23:34:37.203 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-11T23:34:37.203 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.203 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.203 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "15", 2024-09-11T23:34:37.203 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.203 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.203 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.203 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.203 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.203 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.203 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.203 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.204 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-11T23:34:37.204 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-11T23:34:37.204 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.204 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.204 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.204 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.204 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.204 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.204 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.204 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.204 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.204 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.204 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.205 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.205 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.205 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.205 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.205 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.205 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.205 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.205 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.205 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-11T23:34:37.205 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-11T23:34:37.205 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.205 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.206 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.206 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.206 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.206 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.206 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.206 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.206 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.206 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.206 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.206 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.206 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-11T23:34:37.206 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-11T23:34:37.206 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.206 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.207 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.207 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-11T23:34:37.207 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.207 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.207 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.207 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.207 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.207 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.207 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.207 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.207 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.207 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.207 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.208 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.208 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.208 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.208 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.208 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-11T23:34:37.208 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-11T23:34:37.208 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.208 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.208 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.208 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.208 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.208 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.209 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.209 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.209 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.209 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.209 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.209 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.209 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.209 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.209 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:34:37.209 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "telemetry", 2024-09-11T23:34:37.209 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-11T23:34:37.209 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-11T23:34:37.209 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-11T23:34:37.210 INFO:teuthology.orchestra.run.smithi037.stdout: "channel_basic": { 2024-09-11T23:34:37.210 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "channel_basic", 2024-09-11T23:34:37.210 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.210 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.210 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.210 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:37.210 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.210 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.210 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.210 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-11T23:34:37.210 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.210 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.210 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.211 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.211 INFO:teuthology.orchestra.run.smithi037.stdout: "channel_crash": { 2024-09-11T23:34:37.211 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "channel_crash", 2024-09-11T23:34:37.211 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.211 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.211 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.211 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:37.211 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.211 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.211 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.211 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-11T23:34:37.211 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.211 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.212 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.212 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.212 INFO:teuthology.orchestra.run.smithi037.stdout: "channel_device": { 2024-09-11T23:34:37.212 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "channel_device", 2024-09-11T23:34:37.212 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.212 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.212 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.212 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:37.212 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.212 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.212 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.212 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-11T23:34:37.213 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.213 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.213 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.213 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.213 INFO:teuthology.orchestra.run.smithi037.stdout: "channel_ident": { 2024-09-11T23:34:37.213 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "channel_ident", 2024-09-11T23:34:37.213 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.213 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.213 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.213 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.213 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.213 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.213 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.214 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-11T23:34:37.214 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.214 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.214 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.214 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.214 INFO:teuthology.orchestra.run.smithi037.stdout: "channel_perf": { 2024-09-11T23:34:37.214 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "channel_perf", 2024-09-11T23:34:37.214 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.214 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.214 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.214 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.214 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.214 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.215 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.215 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-11T23:34:37.215 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.215 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.215 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.215 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.215 INFO:teuthology.orchestra.run.smithi037.stdout: "contact": { 2024-09-11T23:34:37.215 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "contact", 2024-09-11T23:34:37.215 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.215 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.215 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.215 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.215 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.215 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.216 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.216 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.216 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.216 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.216 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.216 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.216 INFO:teuthology.orchestra.run.smithi037.stdout: "description": { 2024-09-11T23:34:37.216 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "description", 2024-09-11T23:34:37.216 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.216 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.216 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.217 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.217 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.217 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.217 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.217 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.217 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.217 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.217 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.217 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.217 INFO:teuthology.orchestra.run.smithi037.stdout: "device_url": { 2024-09-11T23:34:37.217 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "device_url", 2024-09-11T23:34:37.217 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.217 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.217 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.218 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-11T23:34:37.218 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.218 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.218 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.218 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.218 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.218 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.218 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.218 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.218 INFO:teuthology.orchestra.run.smithi037.stdout: "enabled": { 2024-09-11T23:34:37.218 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "enabled", 2024-09-11T23:34:37.218 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.218 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.219 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.219 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.219 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.219 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.219 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.219 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.219 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.219 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.219 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.219 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.219 INFO:teuthology.orchestra.run.smithi037.stdout: "interval": { 2024-09-11T23:34:37.219 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "interval", 2024-09-11T23:34:37.219 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:37.220 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.220 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.220 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "24", 2024-09-11T23:34:37.220 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "8", 2024-09-11T23:34:37.220 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.220 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.220 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.220 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.220 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.220 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.220 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.220 INFO:teuthology.orchestra.run.smithi037.stdout: "last_opt_revision": { 2024-09-11T23:34:37.220 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "last_opt_revision", 2024-09-11T23:34:37.221 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:37.221 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.221 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.221 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "1", 2024-09-11T23:34:37.221 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.221 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.221 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.221 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.221 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.221 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.221 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.221 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.221 INFO:teuthology.orchestra.run.smithi037.stdout: "leaderboard": { 2024-09-11T23:34:37.222 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "leaderboard", 2024-09-11T23:34:37.222 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.222 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.222 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.222 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.222 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.222 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.222 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.222 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.222 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.222 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.222 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.222 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.223 INFO:teuthology.orchestra.run.smithi037.stdout: "leaderboard_description": { 2024-09-11T23:34:37.223 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "leaderboard_description", 2024-09-11T23:34:37.223 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.223 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.223 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.223 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.223 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.223 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.223 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.223 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.223 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.223 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.223 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.224 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.224 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-11T23:34:37.224 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-11T23:34:37.224 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.224 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.224 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.224 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.224 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.224 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.224 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.224 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.224 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.224 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.225 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.225 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.225 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.225 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.225 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.225 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.225 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.225 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.225 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.225 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-11T23:34:37.225 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-11T23:34:37.225 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.225 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.226 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.226 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.226 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.226 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.226 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.226 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.226 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.226 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.226 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.226 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.226 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-11T23:34:37.226 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-11T23:34:37.226 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.226 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.227 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.227 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-11T23:34:37.227 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.227 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.227 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.227 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.227 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.227 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.227 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.227 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.227 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.227 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.227 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.227 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.227 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.228 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.228 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.228 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-11T23:34:37.228 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-11T23:34:37.228 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.228 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.228 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.228 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.228 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.228 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.228 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.228 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.228 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.229 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.229 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.229 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.229 INFO:teuthology.orchestra.run.smithi037.stdout: "organization": { 2024-09-11T23:34:37.229 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "organization", 2024-09-11T23:34:37.229 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.229 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.229 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.229 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.229 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.229 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.229 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.229 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.230 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.230 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.230 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.230 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.230 INFO:teuthology.orchestra.run.smithi037.stdout: "proxy": { 2024-09-11T23:34:37.230 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "proxy", 2024-09-11T23:34:37.230 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.230 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.230 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.230 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.230 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.230 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.230 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.230 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.230 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.231 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.231 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.231 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.231 INFO:teuthology.orchestra.run.smithi037.stdout: "url": { 2024-09-11T23:34:37.231 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "url", 2024-09-11T23:34:37.231 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.231 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.231 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.231 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-11T23:34:37.231 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.231 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.231 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.232 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.232 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.232 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.232 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.232 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.232 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.232 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.232 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:34:37.232 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "test_orchestrator", 2024-09-11T23:34:37.232 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-11T23:34:37.232 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-11T23:34:37.232 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-11T23:34:37.232 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-11T23:34:37.233 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-11T23:34:37.233 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.233 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.233 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.233 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.233 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.233 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.233 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.233 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.233 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.233 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.233 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.233 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.233 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.234 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.234 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.234 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.234 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.234 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.234 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.234 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-11T23:34:37.234 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-11T23:34:37.234 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.234 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.234 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.234 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.235 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.235 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.235 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.235 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.235 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.235 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.235 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.235 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.235 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-11T23:34:37.235 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-11T23:34:37.235 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.235 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.235 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.236 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-11T23:34:37.236 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.236 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.236 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.236 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.236 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.236 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.236 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.236 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.236 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.236 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.236 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.236 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.236 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.237 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.237 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.237 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-11T23:34:37.237 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-11T23:34:37.237 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.237 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.237 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.237 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.237 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.237 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.237 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.237 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.237 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.238 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.238 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.238 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.238 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.238 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.238 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:34:37.238 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "volumes", 2024-09-11T23:34:37.238 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-11T23:34:37.238 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-11T23:34:37.238 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-11T23:34:37.238 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-11T23:34:37.238 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-11T23:34:37.238 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.239 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.239 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.239 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.239 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.239 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.239 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.239 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.239 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.239 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.239 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.239 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.239 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.239 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.240 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.240 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.240 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.240 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.240 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.240 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-11T23:34:37.240 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-11T23:34:37.240 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.240 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.240 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.240 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.240 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.240 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.240 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.241 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.241 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.241 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.241 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.241 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.241 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-11T23:34:37.241 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-11T23:34:37.241 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.241 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.241 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.241 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-11T23:34:37.241 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.241 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.242 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.242 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.242 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.242 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.242 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.242 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.242 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.242 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.242 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.242 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.242 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.242 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.242 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.243 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-11T23:34:37.243 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-11T23:34:37.243 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.243 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.243 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.243 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.243 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.243 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.243 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.243 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.243 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.243 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.243 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.243 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.244 INFO:teuthology.orchestra.run.smithi037.stdout: "max_concurrent_clones": { 2024-09-11T23:34:37.244 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "max_concurrent_clones", 2024-09-11T23:34:37.244 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:37.244 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.244 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.244 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "4", 2024-09-11T23:34:37.244 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.244 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.244 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.244 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-11T23:34:37.244 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.244 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.245 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.245 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.245 INFO:teuthology.orchestra.run.smithi037.stdout: "periodic_async_work": { 2024-09-11T23:34:37.245 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "periodic_async_work", 2024-09-11T23:34:37.245 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.245 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.245 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.245 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.245 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.245 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.245 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.245 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Periodically check for async work", 2024-09-11T23:34:37.245 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.246 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.246 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.246 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.246 INFO:teuthology.orchestra.run.smithi037.stdout: "snapshot_clone_delay": { 2024-09-11T23:34:37.246 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "snapshot_clone_delay", 2024-09-11T23:34:37.246 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:37.246 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.246 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.246 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-11T23:34:37.246 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.246 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.246 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.246 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-11T23:34:37.247 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.247 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.247 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.247 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.247 INFO:teuthology.orchestra.run.smithi037.stdout: "snapshot_clone_no_wait": { 2024-09-11T23:34:37.247 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "snapshot_clone_no_wait", 2024-09-11T23:34:37.247 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.247 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.247 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.247 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:37.247 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.247 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.248 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.248 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-11T23:34:37.248 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.248 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.248 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.248 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.248 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.248 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.248 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:34:37.248 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "zabbix", 2024-09-11T23:34:37.248 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-11T23:34:37.248 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-11T23:34:37.248 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-11T23:34:37.249 INFO:teuthology.orchestra.run.smithi037.stdout: "discovery_interval": { 2024-09-11T23:34:37.249 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "discovery_interval", 2024-09-11T23:34:37.249 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "uint", 2024-09-11T23:34:37.249 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.249 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.249 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "100", 2024-09-11T23:34:37.249 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.249 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.249 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.249 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.249 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.249 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.249 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.250 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.250 INFO:teuthology.orchestra.run.smithi037.stdout: "identifier": { 2024-09-11T23:34:37.250 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "identifier", 2024-09-11T23:34:37.250 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.250 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.250 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.250 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.250 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.250 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.250 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.250 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.250 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.250 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.251 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.251 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.251 INFO:teuthology.orchestra.run.smithi037.stdout: "interval": { 2024-09-11T23:34:37.251 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "interval", 2024-09-11T23:34:37.251 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-11T23:34:37.251 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.251 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.251 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "60", 2024-09-11T23:34:37.251 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.251 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.251 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.251 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.251 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.252 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.252 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.252 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.252 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-11T23:34:37.252 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-11T23:34:37.252 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.252 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.252 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.252 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.252 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.252 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.252 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.252 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.253 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.253 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.253 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.253 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.253 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.253 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.253 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.253 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.253 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.253 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.253 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.253 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-11T23:34:37.254 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-11T23:34:37.254 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.254 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.254 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.254 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.254 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.254 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.254 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.254 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.254 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.254 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.254 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.254 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.254 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-11T23:34:37.255 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-11T23:34:37.255 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.255 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.255 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.255 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-11T23:34:37.255 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.255 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.255 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.255 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.255 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.255 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.255 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.255 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.256 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.256 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.256 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.256 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.256 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.256 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.256 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.256 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-11T23:34:37.256 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-11T23:34:37.256 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.256 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.256 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.256 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.257 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.257 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.257 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.257 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.257 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.257 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.257 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.257 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.257 INFO:teuthology.orchestra.run.smithi037.stdout: "zabbix_host": { 2024-09-11T23:34:37.257 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "zabbix_host", 2024-09-11T23:34:37.257 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.257 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.257 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.258 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.258 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.258 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.258 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.258 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.258 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.258 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.258 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.258 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.258 INFO:teuthology.orchestra.run.smithi037.stdout: "zabbix_port": { 2024-09-11T23:34:37.258 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "zabbix_port", 2024-09-11T23:34:37.258 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:37.258 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.259 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.259 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10051", 2024-09-11T23:34:37.259 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.259 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.259 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.259 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.259 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.259 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.259 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.259 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.259 INFO:teuthology.orchestra.run.smithi037.stdout: "zabbix_sender": { 2024-09-11T23:34:37.259 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "zabbix_sender", 2024-09-11T23:34:37.259 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.259 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.260 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.260 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-11T23:34:37.260 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.260 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.260 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.260 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.260 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.260 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.260 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.260 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.260 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.261 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.261 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2024-09-11T23:34:37.261 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.261 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:34:37.261 INFO:teuthology.orchestra.run.smithi037.stdout: "gid": 24110, 2024-09-11T23:34:37.261 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "y", 2024-09-11T23:34:37.261 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr_features": 4540701547738038271, 2024-09-11T23:34:37.261 INFO:teuthology.orchestra.run.smithi037.stdout: "available_modules": [ 2024-09-11T23:34:37.261 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:34:37.261 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "alerts", 2024-09-11T23:34:37.261 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-11T23:34:37.261 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-11T23:34:37.261 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-11T23:34:37.262 INFO:teuthology.orchestra.run.smithi037.stdout: "interval": { 2024-09-11T23:34:37.262 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "interval", 2024-09-11T23:34:37.262 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-11T23:34:37.262 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.262 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.262 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "60", 2024-09-11T23:34:37.262 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.262 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.262 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.262 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "How frequently to reexamine health status", 2024-09-11T23:34:37.262 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.262 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.262 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.262 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.263 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-11T23:34:37.263 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-11T23:34:37.263 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.263 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.263 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.263 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.263 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.263 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.263 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.263 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.263 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.263 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.263 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.263 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.264 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.264 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.264 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.264 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.264 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.264 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.264 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.264 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-11T23:34:37.264 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-11T23:34:37.264 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.264 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.264 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.264 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.265 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.265 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.265 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.265 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.265 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.265 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.265 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.265 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.265 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-11T23:34:37.265 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-11T23:34:37.265 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.265 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.266 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.266 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-11T23:34:37.266 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.266 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.266 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.266 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.266 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.266 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.266 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.266 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.266 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.266 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.266 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.267 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.267 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.267 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.267 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.267 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-11T23:34:37.267 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-11T23:34:37.267 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.267 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.267 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.267 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.267 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.267 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.267 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.267 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.268 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.268 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.268 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.268 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.268 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_destination": { 2024-09-11T23:34:37.268 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_destination", 2024-09-11T23:34:37.268 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.268 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.268 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.268 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.268 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.268 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.268 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.269 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Email address to send alerts to", 2024-09-11T23:34:37.269 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.269 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.269 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.269 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.269 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_from_name": { 2024-09-11T23:34:37.269 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_from_name", 2024-09-11T23:34:37.269 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.269 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.269 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.269 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "Ceph", 2024-09-11T23:34:37.269 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.269 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.270 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.270 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Email From: name", 2024-09-11T23:34:37.270 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.270 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.270 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.270 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.270 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_host": { 2024-09-11T23:34:37.270 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_host", 2024-09-11T23:34:37.270 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.270 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.270 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.270 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.270 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.271 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.271 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.271 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "SMTP server", 2024-09-11T23:34:37.271 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.271 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.271 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.271 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.271 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_password": { 2024-09-11T23:34:37.271 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_password", 2024-09-11T23:34:37.271 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.271 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.271 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.271 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.272 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.272 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.272 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.272 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Password to authenticate with", 2024-09-11T23:34:37.272 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.272 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.272 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.272 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.272 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_port": { 2024-09-11T23:34:37.272 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_port", 2024-09-11T23:34:37.272 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:37.272 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.272 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.273 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "465", 2024-09-11T23:34:37.273 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.273 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.273 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.273 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "SMTP port", 2024-09-11T23:34:37.273 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.273 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.273 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.273 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.273 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_sender": { 2024-09-11T23:34:37.273 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_sender", 2024-09-11T23:34:37.273 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.273 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.274 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.274 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.274 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.274 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.274 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.274 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "SMTP envelope sender", 2024-09-11T23:34:37.274 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.274 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.274 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.274 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.274 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_ssl": { 2024-09-11T23:34:37.274 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_ssl", 2024-09-11T23:34:37.274 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.274 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.275 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.275 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:37.275 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.275 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.275 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.275 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-11T23:34:37.275 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.275 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.275 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.275 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.275 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_user": { 2024-09-11T23:34:37.275 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_user", 2024-09-11T23:34:37.276 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.276 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.276 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.276 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.276 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.276 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.276 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.276 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "User to authenticate as", 2024-09-11T23:34:37.276 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.276 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.276 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.276 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.276 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.277 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.277 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:34:37.277 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "balancer", 2024-09-11T23:34:37.277 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-11T23:34:37.277 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-11T23:34:37.277 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-11T23:34:37.277 INFO:teuthology.orchestra.run.smithi037.stdout: "active": { 2024-09-11T23:34:37.277 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "active", 2024-09-11T23:34:37.277 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.277 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.277 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.277 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:37.277 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.278 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.278 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.278 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "automatically balance PGs across cluster", 2024-09-11T23:34:37.278 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.278 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.278 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.278 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.278 INFO:teuthology.orchestra.run.smithi037.stdout: "begin_time": { 2024-09-11T23:34:37.278 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "begin_time", 2024-09-11T23:34:37.278 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.278 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.278 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.278 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0000", 2024-09-11T23:34:37.279 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.279 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.279 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.279 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "beginning time of day to automatically balance", 2024-09-11T23:34:37.279 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-11T23:34:37.279 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.279 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.279 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.279 INFO:teuthology.orchestra.run.smithi037.stdout: "begin_weekday": { 2024-09-11T23:34:37.279 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "begin_weekday", 2024-09-11T23:34:37.279 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "uint", 2024-09-11T23:34:37.279 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.279 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.280 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-11T23:34:37.280 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "0", 2024-09-11T23:34:37.280 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "6", 2024-09-11T23:34:37.280 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.280 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-11T23:34:37.280 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-11T23:34:37.280 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.280 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.280 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.280 INFO:teuthology.orchestra.run.smithi037.stdout: "crush_compat_max_iterations": { 2024-09-11T23:34:37.280 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "crush_compat_max_iterations", 2024-09-11T23:34:37.280 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "uint", 2024-09-11T23:34:37.280 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.281 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.281 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "25", 2024-09-11T23:34:37.281 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "1", 2024-09-11T23:34:37.281 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "250", 2024-09-11T23:34:37.281 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.281 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-11T23:34:37.281 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.281 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.281 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.281 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.281 INFO:teuthology.orchestra.run.smithi037.stdout: "crush_compat_metrics": { 2024-09-11T23:34:37.281 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "crush_compat_metrics", 2024-09-11T23:34:37.282 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.282 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.282 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.282 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "pgs,objects,bytes", 2024-09-11T23:34:37.282 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.282 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.282 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.282 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-11T23:34:37.282 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-11T23:34:37.282 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.282 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.282 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.282 INFO:teuthology.orchestra.run.smithi037.stdout: "crush_compat_step": { 2024-09-11T23:34:37.283 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "crush_compat_step", 2024-09-11T23:34:37.283 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-09-11T23:34:37.283 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.283 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.283 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0.5", 2024-09-11T23:34:37.283 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "0.001", 2024-09-11T23:34:37.283 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "0.999", 2024-09-11T23:34:37.283 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.283 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "aggressiveness of optimization", 2024-09-11T23:34:37.283 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-11T23:34:37.283 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.283 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.283 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.283 INFO:teuthology.orchestra.run.smithi037.stdout: "end_time": { 2024-09-11T23:34:37.283 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "end_time", 2024-09-11T23:34:37.284 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.284 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.284 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.284 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "2359", 2024-09-11T23:34:37.284 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.284 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.284 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.284 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "ending time of day to automatically balance", 2024-09-11T23:34:37.284 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-11T23:34:37.284 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.284 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.284 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.284 INFO:teuthology.orchestra.run.smithi037.stdout: "end_weekday": { 2024-09-11T23:34:37.285 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "end_weekday", 2024-09-11T23:34:37.285 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "uint", 2024-09-11T23:34:37.285 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.285 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.285 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-11T23:34:37.285 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "0", 2024-09-11T23:34:37.285 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "6", 2024-09-11T23:34:37.285 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.285 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-11T23:34:37.285 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-11T23:34:37.285 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.285 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.285 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.286 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-11T23:34:37.286 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-11T23:34:37.286 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.286 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.286 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.286 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.286 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.286 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.286 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.286 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.286 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.286 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.286 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.287 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.287 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.287 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.287 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.287 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.287 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.287 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.287 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.287 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-11T23:34:37.287 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-11T23:34:37.287 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.287 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.287 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.288 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.288 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.288 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.288 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.288 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.288 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.288 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.288 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.288 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.288 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-11T23:34:37.288 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-11T23:34:37.288 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.288 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.289 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.289 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-11T23:34:37.289 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.289 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.289 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.289 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.289 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.289 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.289 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.289 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.289 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.289 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.289 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.290 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.290 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.290 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.290 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.290 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-11T23:34:37.290 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-11T23:34:37.290 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.290 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.290 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.290 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.290 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.290 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.290 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.291 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.291 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.291 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.291 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.291 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.291 INFO:teuthology.orchestra.run.smithi037.stdout: "min_score": { 2024-09-11T23:34:37.291 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "min_score", 2024-09-11T23:34:37.291 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-09-11T23:34:37.291 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.291 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.291 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-11T23:34:37.291 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.291 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.291 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.291 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-11T23:34:37.292 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.292 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.292 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.292 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.292 INFO:teuthology.orchestra.run.smithi037.stdout: "mode": { 2024-09-11T23:34:37.292 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mode", 2024-09-11T23:34:37.292 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.292 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.292 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.292 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "upmap", 2024-09-11T23:34:37.292 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.292 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.292 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.293 INFO:teuthology.orchestra.run.smithi037.stdout: "crush-compat", 2024-09-11T23:34:37.293 INFO:teuthology.orchestra.run.smithi037.stdout: "none", 2024-09-11T23:34:37.293 INFO:teuthology.orchestra.run.smithi037.stdout: "read", 2024-09-11T23:34:37.293 INFO:teuthology.orchestra.run.smithi037.stdout: "upmap", 2024-09-11T23:34:37.293 INFO:teuthology.orchestra.run.smithi037.stdout: "upmap-read" 2024-09-11T23:34:37.293 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.293 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Balancer mode", 2024-09-11T23:34:37.293 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.293 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.293 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.293 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.293 INFO:teuthology.orchestra.run.smithi037.stdout: "pool_ids": { 2024-09-11T23:34:37.293 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "pool_ids", 2024-09-11T23:34:37.294 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.294 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.294 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.294 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.294 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.294 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.294 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.294 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-11T23:34:37.294 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.294 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.294 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.294 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.294 INFO:teuthology.orchestra.run.smithi037.stdout: "sleep_interval": { 2024-09-11T23:34:37.295 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sleep_interval", 2024-09-11T23:34:37.295 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-11T23:34:37.295 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.295 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.295 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "60", 2024-09-11T23:34:37.295 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.295 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.295 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.295 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-11T23:34:37.295 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.295 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.295 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.295 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.295 INFO:teuthology.orchestra.run.smithi037.stdout: "upmap_max_deviation": { 2024-09-11T23:34:37.296 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "upmap_max_deviation", 2024-09-11T23:34:37.296 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:37.296 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.296 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.296 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5", 2024-09-11T23:34:37.296 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "1", 2024-09-11T23:34:37.296 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.296 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.296 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-11T23:34:37.296 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-11T23:34:37.296 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.296 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.296 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.297 INFO:teuthology.orchestra.run.smithi037.stdout: "upmap_max_optimizations": { 2024-09-11T23:34:37.297 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "upmap_max_optimizations", 2024-09-11T23:34:37.297 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "uint", 2024-09-11T23:34:37.297 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.297 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.297 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-09-11T23:34:37.297 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.297 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.297 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.297 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-11T23:34:37.297 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.297 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.297 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.298 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.298 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.298 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.298 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:34:37.298 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cephadm", 2024-09-11T23:34:37.298 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-11T23:34:37.298 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-11T23:34:37.298 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-11T23:34:37.298 INFO:teuthology.orchestra.run.smithi037.stdout: "agent_down_multiplier": { 2024-09-11T23:34:37.300 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "agent_down_multiplier", 2024-09-11T23:34:37.300 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-09-11T23:34:37.300 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.300 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.300 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "3.0", 2024-09-11T23:34:37.300 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.301 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.301 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.301 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-11T23:34:37.301 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.301 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.301 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.301 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.301 INFO:teuthology.orchestra.run.smithi037.stdout: "agent_refresh_rate": { 2024-09-11T23:34:37.301 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "agent_refresh_rate", 2024-09-11T23:34:37.301 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-11T23:34:37.301 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.301 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.301 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "20", 2024-09-11T23:34:37.301 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.302 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.302 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.302 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-11T23:34:37.302 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.302 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.302 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.302 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.302 INFO:teuthology.orchestra.run.smithi037.stdout: "agent_starting_port": { 2024-09-11T23:34:37.302 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "agent_starting_port", 2024-09-11T23:34:37.302 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:37.302 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.302 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.302 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "4721", 2024-09-11T23:34:37.302 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.303 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.303 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.303 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-11T23:34:37.303 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.303 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.303 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.303 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.303 INFO:teuthology.orchestra.run.smithi037.stdout: "allow_ptrace": { 2024-09-11T23:34:37.303 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "allow_ptrace", 2024-09-11T23:34:37.303 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.303 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.303 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.303 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.304 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.304 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.304 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.304 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-11T23:34:37.304 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-11T23:34:37.304 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.304 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.304 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.304 INFO:teuthology.orchestra.run.smithi037.stdout: "autotune_interval": { 2024-09-11T23:34:37.304 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "autotune_interval", 2024-09-11T23:34:37.304 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-11T23:34:37.304 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.305 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.305 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "600", 2024-09-11T23:34:37.305 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.305 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.305 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.305 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-11T23:34:37.305 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.305 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.305 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.305 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.305 INFO:teuthology.orchestra.run.smithi037.stdout: "autotune_memory_target_ratio": { 2024-09-11T23:34:37.305 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "autotune_memory_target_ratio", 2024-09-11T23:34:37.305 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-09-11T23:34:37.305 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.306 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.306 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0.7", 2024-09-11T23:34:37.306 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.306 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.306 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.306 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-11T23:34:37.306 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.306 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.306 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.306 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.306 INFO:teuthology.orchestra.run.smithi037.stdout: "cephadm_log_destination": { 2024-09-11T23:34:37.306 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cephadm_log_destination", 2024-09-11T23:34:37.306 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.307 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.307 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.307 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.307 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.307 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.307 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.307 INFO:teuthology.orchestra.run.smithi037.stdout: "file", 2024-09-11T23:34:37.307 INFO:teuthology.orchestra.run.smithi037.stdout: "file,syslog", 2024-09-11T23:34:37.307 INFO:teuthology.orchestra.run.smithi037.stdout: "syslog" 2024-09-11T23:34:37.307 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.307 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-11T23:34:37.307 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.307 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.308 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.308 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.308 INFO:teuthology.orchestra.run.smithi037.stdout: "cgroups_split": { 2024-09-11T23:34:37.308 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cgroups_split", 2024-09-11T23:34:37.308 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.308 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.308 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.308 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:37.308 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.308 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.308 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.308 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-11T23:34:37.309 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.309 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.309 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.309 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.309 INFO:teuthology.orchestra.run.smithi037.stdout: "config_checks_enabled": { 2024-09-11T23:34:37.309 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "config_checks_enabled", 2024-09-11T23:34:37.309 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.309 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.309 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.309 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.309 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.309 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.309 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.309 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-11T23:34:37.310 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.310 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.310 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.310 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.310 INFO:teuthology.orchestra.run.smithi037.stdout: "config_dashboard": { 2024-09-11T23:34:37.310 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "config_dashboard", 2024-09-11T23:34:37.310 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.310 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.310 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.310 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:37.310 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.310 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.310 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.311 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-11T23:34:37.311 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.311 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.311 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.311 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.311 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_alertmanager": { 2024-09-11T23:34:37.311 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_alertmanager", 2024-09-11T23:34:37.311 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.311 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.311 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.311 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-11T23:34:37.311 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.312 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.312 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.312 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Prometheus container image", 2024-09-11T23:34:37.312 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.312 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.312 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.312 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.312 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_base": { 2024-09-11T23:34:37.312 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_base", 2024-09-11T23:34:37.312 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.312 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.312 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.312 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-11T23:34:37.313 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.313 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.313 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.313 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Container image name, without the tag", 2024-09-11T23:34:37.313 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.313 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.313 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.313 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.313 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_elasticsearch": { 2024-09-11T23:34:37.313 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_elasticsearch", 2024-09-11T23:34:37.313 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.313 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.313 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.314 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-11T23:34:37.314 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.314 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.314 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.314 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "elasticsearch container image", 2024-09-11T23:34:37.314 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.314 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.314 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.314 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.314 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_grafana": { 2024-09-11T23:34:37.314 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_grafana", 2024-09-11T23:34:37.314 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.314 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.314 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.315 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-11T23:34:37.315 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.315 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.315 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.315 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Prometheus container image", 2024-09-11T23:34:37.315 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.315 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.315 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.315 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.315 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_haproxy": { 2024-09-11T23:34:37.315 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_haproxy", 2024-09-11T23:34:37.315 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.315 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.316 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.316 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-11T23:34:37.316 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.316 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.316 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.316 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "HAproxy container image", 2024-09-11T23:34:37.316 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.316 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.316 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.316 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.316 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_jaeger_agent": { 2024-09-11T23:34:37.316 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_jaeger_agent", 2024-09-11T23:34:37.316 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.317 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.317 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.317 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-11T23:34:37.317 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.317 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.317 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.317 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Jaeger agent container image", 2024-09-11T23:34:37.317 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.317 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.317 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.317 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.317 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_jaeger_collector": { 2024-09-11T23:34:37.317 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_jaeger_collector", 2024-09-11T23:34:37.318 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.318 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.318 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.318 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-11T23:34:37.318 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.318 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.318 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.318 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Jaeger collector container image", 2024-09-11T23:34:37.318 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.318 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.318 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.318 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.318 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_jaeger_query": { 2024-09-11T23:34:37.319 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_jaeger_query", 2024-09-11T23:34:37.319 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.319 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.319 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.319 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-11T23:34:37.319 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.319 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.319 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.319 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Jaeger query container image", 2024-09-11T23:34:37.319 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.319 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.319 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.319 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.320 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_keepalived": { 2024-09-11T23:34:37.320 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_keepalived", 2024-09-11T23:34:37.320 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.320 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.320 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.320 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-11T23:34:37.320 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.320 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.320 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.320 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Keepalived container image", 2024-09-11T23:34:37.320 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.320 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.321 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.321 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.321 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_loki": { 2024-09-11T23:34:37.321 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_loki", 2024-09-11T23:34:37.321 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.321 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.321 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.321 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-11T23:34:37.321 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.321 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.321 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.321 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Loki container image", 2024-09-11T23:34:37.322 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.322 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.322 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.322 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.322 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_node_exporter": { 2024-09-11T23:34:37.322 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_node_exporter", 2024-09-11T23:34:37.322 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.322 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.322 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.322 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-11T23:34:37.322 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.322 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.322 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.322 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Prometheus container image", 2024-09-11T23:34:37.323 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.323 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.323 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.323 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.323 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_nvmeof": { 2024-09-11T23:34:37.323 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_nvmeof", 2024-09-11T23:34:37.323 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.323 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.323 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.323 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-11T23:34:37.323 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.323 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.323 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.324 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Nvme-of container image", 2024-09-11T23:34:37.324 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.324 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.324 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.324 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.324 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_prometheus": { 2024-09-11T23:34:37.324 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_prometheus", 2024-09-11T23:34:37.324 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.324 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.324 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.324 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-11T23:34:37.324 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.324 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.325 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.325 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Prometheus container image", 2024-09-11T23:34:37.325 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.325 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.325 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.325 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.325 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_promtail": { 2024-09-11T23:34:37.325 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_promtail", 2024-09-11T23:34:37.325 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.325 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.325 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.325 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-11T23:34:37.325 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.326 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.326 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.326 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Promtail container image", 2024-09-11T23:34:37.326 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.326 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.326 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.326 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.326 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_samba": { 2024-09-11T23:34:37.326 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_samba", 2024-09-11T23:34:37.326 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.326 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.326 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.326 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-11T23:34:37.327 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.327 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.327 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.327 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Samba/SMB container image", 2024-09-11T23:34:37.327 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.327 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.327 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.327 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.327 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_snmp_gateway": { 2024-09-11T23:34:37.327 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_snmp_gateway", 2024-09-11T23:34:37.327 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.327 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.327 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.328 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-11T23:34:37.328 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.328 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.328 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.328 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "SNMP Gateway container image", 2024-09-11T23:34:37.328 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.328 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.328 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.328 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.328 INFO:teuthology.orchestra.run.smithi037.stdout: "container_init": { 2024-09-11T23:34:37.328 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_init", 2024-09-11T23:34:37.328 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.328 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.328 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.329 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:37.329 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.329 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.329 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.329 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Run podman/docker with `--init`", 2024-09-11T23:34:37.329 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.329 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.329 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.329 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.329 INFO:teuthology.orchestra.run.smithi037.stdout: "daemon_cache_timeout": { 2024-09-11T23:34:37.329 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "daemon_cache_timeout", 2024-09-11T23:34:37.329 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-11T23:34:37.329 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.330 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.330 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "600", 2024-09-11T23:34:37.330 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.330 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.330 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.330 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-11T23:34:37.330 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.330 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.330 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.330 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.330 INFO:teuthology.orchestra.run.smithi037.stdout: "default_cephadm_command_timeout": { 2024-09-11T23:34:37.330 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "default_cephadm_command_timeout", 2024-09-11T23:34:37.331 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:37.331 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.331 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.331 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "900", 2024-09-11T23:34:37.331 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.331 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.331 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.331 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-11T23:34:37.331 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.331 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.331 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.331 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.331 INFO:teuthology.orchestra.run.smithi037.stdout: "default_registry": { 2024-09-11T23:34:37.332 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "default_registry", 2024-09-11T23:34:37.332 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.332 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.332 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.332 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "docker.io", 2024-09-11T23:34:37.332 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.332 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.332 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.332 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-11T23:34:37.332 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.332 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.332 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.333 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.333 INFO:teuthology.orchestra.run.smithi037.stdout: "device_cache_timeout": { 2024-09-11T23:34:37.333 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "device_cache_timeout", 2024-09-11T23:34:37.333 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-11T23:34:37.333 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.333 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.333 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "1800", 2024-09-11T23:34:37.333 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.333 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.333 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.333 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "seconds to cache device inventory", 2024-09-11T23:34:37.333 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.333 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.333 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.334 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.334 INFO:teuthology.orchestra.run.smithi037.stdout: "device_enhanced_scan": { 2024-09-11T23:34:37.334 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "device_enhanced_scan", 2024-09-11T23:34:37.334 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.334 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.334 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.334 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.334 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.334 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.334 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.334 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-11T23:34:37.334 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.334 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.335 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.335 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.335 INFO:teuthology.orchestra.run.smithi037.stdout: "facts_cache_timeout": { 2024-09-11T23:34:37.335 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "facts_cache_timeout", 2024-09-11T23:34:37.335 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-11T23:34:37.335 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.335 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.335 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "60", 2024-09-11T23:34:37.335 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.335 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.335 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.335 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "seconds to cache host facts data", 2024-09-11T23:34:37.335 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.336 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.336 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.336 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.336 INFO:teuthology.orchestra.run.smithi037.stdout: "grafana_dashboards_path": { 2024-09-11T23:34:37.336 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "grafana_dashboards_path", 2024-09-11T23:34:37.336 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.336 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.336 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.336 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-11T23:34:37.336 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.336 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.336 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.336 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-11T23:34:37.336 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.337 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.337 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.337 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.337 INFO:teuthology.orchestra.run.smithi037.stdout: "host_check_interval": { 2024-09-11T23:34:37.337 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "host_check_interval", 2024-09-11T23:34:37.337 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-11T23:34:37.337 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.337 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.337 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "600", 2024-09-11T23:34:37.337 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.337 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.337 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.338 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how frequently to perform a host check", 2024-09-11T23:34:37.338 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.338 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.338 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.338 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.338 INFO:teuthology.orchestra.run.smithi037.stdout: "hw_monitoring": { 2024-09-11T23:34:37.338 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "hw_monitoring", 2024-09-11T23:34:37.338 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.338 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.338 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.338 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.338 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.338 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.338 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.339 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-11T23:34:37.339 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.339 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.339 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.339 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.339 INFO:teuthology.orchestra.run.smithi037.stdout: "inventory_list_all": { 2024-09-11T23:34:37.339 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "inventory_list_all", 2024-09-11T23:34:37.339 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.339 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.339 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.339 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.339 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.339 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.340 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.340 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-11T23:34:37.340 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.340 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.340 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.340 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.340 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-11T23:34:37.340 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-11T23:34:37.340 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.340 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.340 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.340 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.340 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.341 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.341 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.341 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.341 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.341 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.341 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.341 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.341 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.341 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.341 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.341 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.341 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.341 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.342 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.342 INFO:teuthology.orchestra.run.smithi037.stdout: "log_refresh_metadata": { 2024-09-11T23:34:37.342 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_refresh_metadata", 2024-09-11T23:34:37.342 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.342 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.342 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.342 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.342 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.342 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.342 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.342 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-11T23:34:37.342 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.342 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.342 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.343 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.343 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-11T23:34:37.343 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-11T23:34:37.343 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.343 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.343 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.343 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:37.343 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.343 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.343 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.343 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-11T23:34:37.343 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.344 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.344 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.344 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.344 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-11T23:34:37.344 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-11T23:34:37.344 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.344 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.344 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.344 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-11T23:34:37.344 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.344 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.344 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.344 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.345 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.345 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.345 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.345 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.345 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.345 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.345 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.345 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.345 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.345 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.345 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.345 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-11T23:34:37.345 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-11T23:34:37.346 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.346 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.346 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.346 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.346 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.346 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.346 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.346 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.346 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.346 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.346 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.346 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.346 INFO:teuthology.orchestra.run.smithi037.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-11T23:34:37.347 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-11T23:34:37.347 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.347 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.347 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.347 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.347 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.347 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.347 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.347 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-11T23:34:37.347 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.347 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.347 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.347 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.348 INFO:teuthology.orchestra.run.smithi037.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-11T23:34:37.348 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-11T23:34:37.348 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.348 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.348 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.348 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "*", 2024-09-11T23:34:37.348 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.348 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.348 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.348 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-11T23:34:37.348 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.348 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.348 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.348 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.349 INFO:teuthology.orchestra.run.smithi037.stdout: "max_count_per_host": { 2024-09-11T23:34:37.349 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "max_count_per_host", 2024-09-11T23:34:37.349 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:37.349 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.349 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.349 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-09-11T23:34:37.349 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.349 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.349 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.349 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "max number of daemons per service per host", 2024-09-11T23:34:37.349 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.349 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.349 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.350 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.350 INFO:teuthology.orchestra.run.smithi037.stdout: "max_osd_draining_count": { 2024-09-11T23:34:37.350 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "max_osd_draining_count", 2024-09-11T23:34:37.350 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:37.350 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.350 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.350 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-09-11T23:34:37.350 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.350 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.350 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.350 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-11T23:34:37.350 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.350 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.351 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.351 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.351 INFO:teuthology.orchestra.run.smithi037.stdout: "migration_current": { 2024-09-11T23:34:37.351 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "migration_current", 2024-09-11T23:34:37.351 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:37.351 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.351 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.351 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.351 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.351 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.351 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.351 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "internal - do not modify", 2024-09-11T23:34:37.351 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.352 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.352 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.352 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.352 INFO:teuthology.orchestra.run.smithi037.stdout: "mode": { 2024-09-11T23:34:37.352 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mode", 2024-09-11T23:34:37.352 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.352 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.352 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.352 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "root", 2024-09-11T23:34:37.352 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.352 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.352 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.352 INFO:teuthology.orchestra.run.smithi037.stdout: "cephadm-package", 2024-09-11T23:34:37.353 INFO:teuthology.orchestra.run.smithi037.stdout: "root" 2024-09-11T23:34:37.353 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.353 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "mode for remote execution of cephadm", 2024-09-11T23:34:37.353 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.353 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.353 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.353 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.353 INFO:teuthology.orchestra.run.smithi037.stdout: "oob_default_addr": { 2024-09-11T23:34:37.353 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "oob_default_addr", 2024-09-11T23:34:37.353 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.353 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.353 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.353 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "169.254.1.1", 2024-09-11T23:34:37.354 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.354 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.354 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.354 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-11T23:34:37.354 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.354 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.354 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.354 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.354 INFO:teuthology.orchestra.run.smithi037.stdout: "prometheus_alerts_path": { 2024-09-11T23:34:37.354 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "prometheus_alerts_path", 2024-09-11T23:34:37.354 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.354 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.354 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.355 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-11T23:34:37.355 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.355 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.355 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.355 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-11T23:34:37.355 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.355 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.355 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.355 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.355 INFO:teuthology.orchestra.run.smithi037.stdout: "registry_insecure": { 2024-09-11T23:34:37.355 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "registry_insecure", 2024-09-11T23:34:37.355 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.355 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.356 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.356 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.356 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.356 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.356 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.356 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-11T23:34:37.356 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.356 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.356 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.356 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.356 INFO:teuthology.orchestra.run.smithi037.stdout: "registry_password": { 2024-09-11T23:34:37.356 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "registry_password", 2024-09-11T23:34:37.357 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.357 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.357 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.357 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.357 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.357 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.357 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.357 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-11T23:34:37.357 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.357 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.357 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.357 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.357 INFO:teuthology.orchestra.run.smithi037.stdout: "registry_url": { 2024-09-11T23:34:37.358 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "registry_url", 2024-09-11T23:34:37.358 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.358 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.358 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.358 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.358 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.358 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.358 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.358 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-11T23:34:37.358 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.358 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.358 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.358 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.358 INFO:teuthology.orchestra.run.smithi037.stdout: "registry_username": { 2024-09-11T23:34:37.359 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "registry_username", 2024-09-11T23:34:37.359 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.359 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.359 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.359 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.359 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.359 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.359 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.359 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-11T23:34:37.359 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.359 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.359 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.359 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.359 INFO:teuthology.orchestra.run.smithi037.stdout: "secure_monitoring_stack": { 2024-09-11T23:34:37.360 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "secure_monitoring_stack", 2024-09-11T23:34:37.360 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.360 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.360 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.360 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.360 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.360 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.360 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.360 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-11T23:34:37.360 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.360 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.360 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.361 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.361 INFO:teuthology.orchestra.run.smithi037.stdout: "service_discovery_port": { 2024-09-11T23:34:37.361 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "service_discovery_port", 2024-09-11T23:34:37.361 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:37.361 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.361 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.361 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "8765", 2024-09-11T23:34:37.361 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.361 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.361 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.361 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "cephadm service discovery port", 2024-09-11T23:34:37.361 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.361 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.361 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.362 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.362 INFO:teuthology.orchestra.run.smithi037.stdout: "ssh_config_file": { 2024-09-11T23:34:37.362 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ssh_config_file", 2024-09-11T23:34:37.362 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.362 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.362 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.362 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.362 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.362 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.362 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.362 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-11T23:34:37.362 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.362 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.363 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.363 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.363 INFO:teuthology.orchestra.run.smithi037.stdout: "use_agent": { 2024-09-11T23:34:37.363 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "use_agent", 2024-09-11T23:34:37.363 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.363 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.363 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.363 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.363 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.363 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.363 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.363 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-11T23:34:37.363 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.364 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.364 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.364 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.364 INFO:teuthology.orchestra.run.smithi037.stdout: "use_repo_digest": { 2024-09-11T23:34:37.364 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "use_repo_digest", 2024-09-11T23:34:37.364 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.364 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.364 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.364 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:37.364 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.364 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.364 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.364 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-11T23:34:37.364 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.365 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.365 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.365 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.365 INFO:teuthology.orchestra.run.smithi037.stdout: "warn_on_failed_host_check": { 2024-09-11T23:34:37.365 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "warn_on_failed_host_check", 2024-09-11T23:34:37.365 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.365 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.365 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.365 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:37.365 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.365 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.365 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.366 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "raise a health warning if the host check fails", 2024-09-11T23:34:37.366 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.366 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.366 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.366 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.366 INFO:teuthology.orchestra.run.smithi037.stdout: "warn_on_stray_daemons": { 2024-09-11T23:34:37.366 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "warn_on_stray_daemons", 2024-09-11T23:34:37.366 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.366 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.366 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.366 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:37.366 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.366 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.367 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.367 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-11T23:34:37.367 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.367 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.367 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.367 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.367 INFO:teuthology.orchestra.run.smithi037.stdout: "warn_on_stray_hosts": { 2024-09-11T23:34:37.367 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "warn_on_stray_hosts", 2024-09-11T23:34:37.367 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.367 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.367 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.367 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:37.367 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.368 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.368 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.368 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-11T23:34:37.368 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.368 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.368 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.368 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.368 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.368 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.368 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:34:37.368 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "crash", 2024-09-11T23:34:37.368 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-11T23:34:37.368 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-11T23:34:37.369 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-11T23:34:37.369 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-11T23:34:37.369 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-11T23:34:37.369 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.369 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.369 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.369 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.369 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.369 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.369 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.369 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.369 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.370 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.370 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.370 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.370 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.370 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.370 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.370 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.370 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.370 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.370 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.370 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-11T23:34:37.370 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-11T23:34:37.370 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.371 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.371 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.371 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.371 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.371 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.371 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.371 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.371 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.371 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.371 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.371 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.371 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-11T23:34:37.371 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-11T23:34:37.372 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.372 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.372 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.372 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-11T23:34:37.372 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.372 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.372 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.372 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.372 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.372 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.372 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.372 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.372 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.373 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.373 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.373 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.373 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.373 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.373 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.373 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-11T23:34:37.373 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-11T23:34:37.373 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.373 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.373 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.373 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.373 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.373 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.374 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.374 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.374 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.374 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.374 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.374 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.374 INFO:teuthology.orchestra.run.smithi037.stdout: "retain_interval": { 2024-09-11T23:34:37.374 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "retain_interval", 2024-09-11T23:34:37.374 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-11T23:34:37.374 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.374 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.374 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "31536000", 2024-09-11T23:34:37.374 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.375 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.375 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.375 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-11T23:34:37.375 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.375 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.375 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.375 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.375 INFO:teuthology.orchestra.run.smithi037.stdout: "warn_recent_interval": { 2024-09-11T23:34:37.375 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "warn_recent_interval", 2024-09-11T23:34:37.375 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-11T23:34:37.375 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.375 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.376 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "1209600", 2024-09-11T23:34:37.376 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.376 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.376 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.376 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-11T23:34:37.376 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.376 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.376 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.376 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.376 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.376 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.376 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:34:37.377 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "dashboard", 2024-09-11T23:34:37.377 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-11T23:34:37.377 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-11T23:34:37.377 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-11T23:34:37.377 INFO:teuthology.orchestra.run.smithi037.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-11T23:34:37.377 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-11T23:34:37.377 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:37.377 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.377 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.377 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-09-11T23:34:37.377 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.377 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.377 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.378 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.378 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.378 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.378 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.378 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.378 INFO:teuthology.orchestra.run.smithi037.stdout: "ALERTMANAGER_API_HOST": { 2024-09-11T23:34:37.378 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-11T23:34:37.378 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.378 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.378 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.378 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.378 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.378 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.379 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.379 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.379 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.379 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.379 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.379 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.379 INFO:teuthology.orchestra.run.smithi037.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-11T23:34:37.379 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-11T23:34:37.379 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.379 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.379 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.379 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:37.379 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.379 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.380 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.380 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.380 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.380 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.380 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.380 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.380 INFO:teuthology.orchestra.run.smithi037.stdout: "AUDIT_API_ENABLED": { 2024-09-11T23:34:37.380 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "AUDIT_API_ENABLED", 2024-09-11T23:34:37.380 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.380 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.380 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.380 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.380 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.381 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.381 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.381 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.381 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.381 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.381 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.381 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.381 INFO:teuthology.orchestra.run.smithi037.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-11T23:34:37.381 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-11T23:34:37.381 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.381 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.381 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.381 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:37.382 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.382 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.382 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.382 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.382 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.382 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.382 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.382 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.382 INFO:teuthology.orchestra.run.smithi037.stdout: "ENABLE_BROWSABLE_API": { 2024-09-11T23:34:37.382 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-11T23:34:37.382 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.382 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.382 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.382 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:37.383 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.383 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.383 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.383 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.383 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.383 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.383 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.383 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.383 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-11T23:34:37.383 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-11T23:34:37.383 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.383 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.383 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.383 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:37.384 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.384 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.384 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.384 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.384 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.384 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.384 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.384 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.384 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-11T23:34:37.384 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-11T23:34:37.384 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.384 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.385 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.385 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:37.385 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.385 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.385 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.385 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.385 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.385 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.385 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.385 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.385 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-11T23:34:37.385 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-11T23:34:37.385 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.386 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.386 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.386 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:37.386 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.386 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.386 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.386 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.386 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.386 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.386 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.386 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.386 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-11T23:34:37.386 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-11T23:34:37.387 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.387 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.387 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.387 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:37.387 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.387 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.387 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.387 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.387 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.387 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.387 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.387 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.387 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-11T23:34:37.388 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-11T23:34:37.388 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.388 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.388 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.388 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:37.388 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.388 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.388 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.388 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.388 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.388 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.388 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.389 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.389 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-11T23:34:37.389 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-11T23:34:37.389 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.389 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.389 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.389 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:37.389 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.389 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.389 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.389 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.389 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.389 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.389 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.390 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.390 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-11T23:34:37.390 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-11T23:34:37.390 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.390 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.390 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.390 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:37.390 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.390 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.390 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.390 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.390 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.391 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.391 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.391 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.391 INFO:teuthology.orchestra.run.smithi037.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-11T23:34:37.391 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-11T23:34:37.391 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.391 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.391 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.391 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.391 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.391 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.391 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.391 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.391 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.392 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.392 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.392 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.392 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_API_PASSWORD": { 2024-09-11T23:34:37.392 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-11T23:34:37.392 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.392 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.392 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.392 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "admin", 2024-09-11T23:34:37.392 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.392 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.392 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.392 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.392 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.393 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.393 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.393 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.393 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-11T23:34:37.393 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-11T23:34:37.393 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.393 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.393 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.393 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:37.393 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.393 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.393 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.393 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.394 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.394 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.394 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.394 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.394 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_API_URL": { 2024-09-11T23:34:37.394 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_API_URL", 2024-09-11T23:34:37.394 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.394 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.394 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.394 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.394 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.394 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.394 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.395 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.395 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.395 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.395 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.395 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.395 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_API_USERNAME": { 2024-09-11T23:34:37.395 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-11T23:34:37.395 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.395 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.395 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.395 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "admin", 2024-09-11T23:34:37.395 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.395 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.396 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.396 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.396 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.396 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.396 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.396 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.396 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-11T23:34:37.396 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-11T23:34:37.396 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.396 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.396 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.396 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.396 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.397 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.397 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.397 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.397 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.397 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.397 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.397 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.397 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-11T23:34:37.397 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-11T23:34:37.397 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.397 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.397 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.397 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.397 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.398 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.398 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.398 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.398 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.398 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.398 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.398 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.398 INFO:teuthology.orchestra.run.smithi037.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-11T23:34:37.398 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-11T23:34:37.398 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.398 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.398 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.398 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:37.399 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.399 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.399 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.399 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.399 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.399 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.399 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.399 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.399 INFO:teuthology.orchestra.run.smithi037.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-11T23:34:37.399 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-11T23:34:37.399 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.399 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.399 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.400 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.400 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.400 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.400 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.400 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.400 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.400 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.400 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.400 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.400 INFO:teuthology.orchestra.run.smithi037.stdout: "PROMETHEUS_API_HOST": { 2024-09-11T23:34:37.400 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-11T23:34:37.400 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.400 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.401 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.401 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.401 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.401 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.401 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.401 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.401 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.401 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.401 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.401 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.401 INFO:teuthology.orchestra.run.smithi037.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-11T23:34:37.401 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-11T23:34:37.401 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.402 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.402 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.402 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:37.402 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.402 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.402 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.402 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.402 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.402 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.402 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.402 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.402 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-11T23:34:37.402 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-11T23:34:37.403 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.403 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.403 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.403 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.403 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.403 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.403 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.403 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.403 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.403 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.403 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.403 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.403 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-11T23:34:37.404 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-11T23:34:37.404 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.404 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.404 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.404 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.404 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.404 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.404 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.404 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.404 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.404 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.404 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.405 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.405 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-11T23:34:37.405 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-11T23:34:37.405 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.405 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.405 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.405 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:37.405 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.405 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.405 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.405 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.405 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.405 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.406 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.406 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.406 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-11T23:34:37.406 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-11T23:34:37.406 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.406 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.406 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.406 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:37.406 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.406 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.406 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.406 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.406 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.406 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.407 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.407 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.407 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-11T23:34:37.407 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-11T23:34:37.407 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.407 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.407 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.407 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.407 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.407 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.407 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.407 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.407 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.408 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.408 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.408 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.408 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-11T23:34:37.408 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-11T23:34:37.408 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.408 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.408 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.408 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.408 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.408 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.408 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.408 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.409 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.409 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.409 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.409 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.409 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-11T23:34:37.409 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-11T23:34:37.409 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.409 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.409 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.409 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.409 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.409 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.409 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.409 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.410 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.410 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.410 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.410 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.410 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_ENABLED": { 2024-09-11T23:34:37.410 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-11T23:34:37.410 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.410 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.410 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.410 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:37.410 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.410 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.410 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.411 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.411 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.411 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.411 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.411 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.411 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-11T23:34:37.411 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-11T23:34:37.411 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.411 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.411 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.411 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-11T23:34:37.411 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.411 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.412 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.412 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.412 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.412 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.412 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.412 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.412 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-11T23:34:37.412 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-11T23:34:37.412 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:37.412 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.413 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.413 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-09-11T23:34:37.413 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.413 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.413 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.413 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.413 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.413 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.413 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.413 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.413 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-11T23:34:37.413 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-11T23:34:37.414 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:37.414 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.414 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.414 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "8", 2024-09-11T23:34:37.414 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.414 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.414 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.414 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.414 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.414 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.414 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.414 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.414 INFO:teuthology.orchestra.run.smithi037.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-11T23:34:37.415 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-11T23:34:37.415 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:37.415 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.415 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.415 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "45", 2024-09-11T23:34:37.415 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.415 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.415 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.415 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.415 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.415 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.415 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.415 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.416 INFO:teuthology.orchestra.run.smithi037.stdout: "RGW_API_ACCESS_KEY": { 2024-09-11T23:34:37.416 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-11T23:34:37.416 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.416 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.416 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.416 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.416 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.416 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.416 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.416 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.416 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.416 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.416 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.417 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.417 INFO:teuthology.orchestra.run.smithi037.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-11T23:34:37.417 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-11T23:34:37.417 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.417 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.417 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.417 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "admin", 2024-09-11T23:34:37.417 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.417 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.417 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.417 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.417 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.417 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.418 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.418 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.418 INFO:teuthology.orchestra.run.smithi037.stdout: "RGW_API_SECRET_KEY": { 2024-09-11T23:34:37.418 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-11T23:34:37.418 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.418 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.418 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.418 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.418 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.418 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.418 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.418 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.418 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.418 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.419 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.419 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.419 INFO:teuthology.orchestra.run.smithi037.stdout: "RGW_API_SSL_VERIFY": { 2024-09-11T23:34:37.419 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-11T23:34:37.419 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.419 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.419 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.419 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:37.419 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.419 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.419 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.419 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.419 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.420 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.420 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.420 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.420 INFO:teuthology.orchestra.run.smithi037.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-11T23:34:37.420 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-11T23:34:37.420 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:37.420 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.420 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.420 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-11T23:34:37.420 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.420 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.420 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.420 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.421 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.421 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.421 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.421 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.421 INFO:teuthology.orchestra.run.smithi037.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-11T23:34:37.421 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-11T23:34:37.421 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:37.421 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.421 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.421 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-09-11T23:34:37.421 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.421 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.421 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.422 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.422 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.422 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.422 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.422 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.422 INFO:teuthology.orchestra.run.smithi037.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-11T23:34:37.422 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-11T23:34:37.422 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:37.422 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.422 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.422 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5", 2024-09-11T23:34:37.422 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.422 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.423 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.423 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.423 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.423 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.423 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.423 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.423 INFO:teuthology.orchestra.run.smithi037.stdout: "cross_origin_url": { 2024-09-11T23:34:37.423 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cross_origin_url", 2024-09-11T23:34:37.423 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.423 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.423 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.423 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.423 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.424 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.424 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.424 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.424 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.424 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.424 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.424 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.424 INFO:teuthology.orchestra.run.smithi037.stdout: "crt_file": { 2024-09-11T23:34:37.424 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "crt_file", 2024-09-11T23:34:37.424 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.424 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.424 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.424 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.425 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.425 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.425 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.425 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.425 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.425 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.425 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.425 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.425 INFO:teuthology.orchestra.run.smithi037.stdout: "debug": { 2024-09-11T23:34:37.425 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "debug", 2024-09-11T23:34:37.425 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.425 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.425 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.426 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.426 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.426 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.426 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.426 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Enable/disable debug options", 2024-09-11T23:34:37.426 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.426 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.426 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.426 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.426 INFO:teuthology.orchestra.run.smithi037.stdout: "jwt_token_ttl": { 2024-09-11T23:34:37.426 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "jwt_token_ttl", 2024-09-11T23:34:37.426 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:37.426 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.427 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.427 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "28800", 2024-09-11T23:34:37.427 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.427 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.427 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.427 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.427 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.427 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.427 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.427 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.427 INFO:teuthology.orchestra.run.smithi037.stdout: "key_file": { 2024-09-11T23:34:37.427 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "key_file", 2024-09-11T23:34:37.427 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.428 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.428 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.428 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.428 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.428 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.428 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.428 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.428 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.428 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.428 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.428 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.428 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-11T23:34:37.429 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-11T23:34:37.429 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.429 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.429 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.429 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.429 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.429 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.429 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.429 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.429 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.429 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.429 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.429 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.430 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.430 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.430 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.430 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.430 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.430 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.430 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.430 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-11T23:34:37.430 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-11T23:34:37.430 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.430 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.430 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.430 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.431 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.431 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.431 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.431 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.431 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.431 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.431 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.431 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.431 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-11T23:34:37.431 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-11T23:34:37.431 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.431 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.431 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.432 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-11T23:34:37.432 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.432 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.432 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.432 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.432 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.432 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.432 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.432 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.432 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.432 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.432 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.432 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.433 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.433 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.433 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.433 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-11T23:34:37.433 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-11T23:34:37.433 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.433 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.433 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.433 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.433 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.433 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.433 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.433 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.434 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.434 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.434 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.434 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.434 INFO:teuthology.orchestra.run.smithi037.stdout: "motd": { 2024-09-11T23:34:37.434 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "motd", 2024-09-11T23:34:37.434 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.434 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.434 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.434 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.434 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.434 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.434 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.434 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "The message of the day", 2024-09-11T23:34:37.435 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.435 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.435 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.435 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.435 INFO:teuthology.orchestra.run.smithi037.stdout: "redirect_resolve_ip_addr": { 2024-09-11T23:34:37.435 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "redirect_resolve_ip_addr", 2024-09-11T23:34:37.435 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.435 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.435 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.435 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.435 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.435 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.435 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.435 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.436 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.436 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.436 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.436 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.436 INFO:teuthology.orchestra.run.smithi037.stdout: "server_addr": { 2024-09-11T23:34:37.436 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_addr", 2024-09-11T23:34:37.436 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.436 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.436 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.436 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "::", 2024-09-11T23:34:37.436 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.436 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.436 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.437 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.437 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.437 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.437 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.437 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.437 INFO:teuthology.orchestra.run.smithi037.stdout: "server_port": { 2024-09-11T23:34:37.437 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_port", 2024-09-11T23:34:37.437 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:37.437 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.437 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.437 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "8080", 2024-09-11T23:34:37.437 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.437 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.438 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.438 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.438 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.438 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.438 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.438 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.438 INFO:teuthology.orchestra.run.smithi037.stdout: "ssl": { 2024-09-11T23:34:37.438 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ssl", 2024-09-11T23:34:37.438 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.438 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.438 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.438 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:37.438 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.438 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.439 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.439 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.439 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.439 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.439 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.439 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.439 INFO:teuthology.orchestra.run.smithi037.stdout: "ssl_server_port": { 2024-09-11T23:34:37.439 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ssl_server_port", 2024-09-11T23:34:37.439 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:37.439 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.439 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.439 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "8443", 2024-09-11T23:34:37.439 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.439 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.440 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.440 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.440 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.440 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.440 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.440 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.440 INFO:teuthology.orchestra.run.smithi037.stdout: "standby_behaviour": { 2024-09-11T23:34:37.440 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "standby_behaviour", 2024-09-11T23:34:37.440 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.440 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.440 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.440 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "redirect", 2024-09-11T23:34:37.440 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.441 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.441 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.441 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.441 INFO:teuthology.orchestra.run.smithi037.stdout: "redirect" 2024-09-11T23:34:37.441 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.441 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.441 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.441 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.441 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.441 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.441 INFO:teuthology.orchestra.run.smithi037.stdout: "standby_error_status_code": { 2024-09-11T23:34:37.442 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "standby_error_status_code", 2024-09-11T23:34:37.442 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:37.442 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.442 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.442 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "500", 2024-09-11T23:34:37.442 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "400", 2024-09-11T23:34:37.442 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "599", 2024-09-11T23:34:37.442 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.442 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.442 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.442 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.442 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.442 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.443 INFO:teuthology.orchestra.run.smithi037.stdout: "url_prefix": { 2024-09-11T23:34:37.443 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "url_prefix", 2024-09-11T23:34:37.443 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.443 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.443 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.443 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.443 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.443 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.443 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.443 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.443 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.443 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.443 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.444 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.444 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.444 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.444 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:34:37.444 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "devicehealth", 2024-09-11T23:34:37.444 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-11T23:34:37.444 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-11T23:34:37.444 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-11T23:34:37.444 INFO:teuthology.orchestra.run.smithi037.stdout: "enable_monitoring": { 2024-09-11T23:34:37.444 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "enable_monitoring", 2024-09-11T23:34:37.444 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.444 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.444 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.445 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:37.445 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.445 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.445 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.445 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "monitor device health metrics", 2024-09-11T23:34:37.445 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.445 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.445 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.445 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.445 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-11T23:34:37.445 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-11T23:34:37.445 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.446 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.446 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.446 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.446 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.446 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.446 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.446 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.446 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.446 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.446 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.446 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.446 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.446 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.447 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.447 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.447 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.447 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.447 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.447 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-11T23:34:37.447 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-11T23:34:37.447 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.447 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.447 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.447 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.447 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.448 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.448 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.448 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.448 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.448 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.448 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.448 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.448 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-11T23:34:37.448 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-11T23:34:37.448 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.448 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.448 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.448 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-11T23:34:37.449 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.449 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.449 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.449 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.449 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.449 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.449 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.449 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.449 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.449 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.449 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.449 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.449 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.450 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.450 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.450 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-11T23:34:37.450 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-11T23:34:37.450 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.450 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.450 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.450 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.450 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.450 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.450 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.450 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.450 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.451 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.451 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.451 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.451 INFO:teuthology.orchestra.run.smithi037.stdout: "mark_out_threshold": { 2024-09-11T23:34:37.451 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mark_out_threshold", 2024-09-11T23:34:37.451 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-11T23:34:37.451 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.451 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.451 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "2419200", 2024-09-11T23:34:37.451 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.451 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.451 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.451 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-11T23:34:37.451 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.452 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.452 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.452 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.452 INFO:teuthology.orchestra.run.smithi037.stdout: "pool_name": { 2024-09-11T23:34:37.452 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "pool_name", 2024-09-11T23:34:37.452 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.452 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.452 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.452 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "device_health_metrics", 2024-09-11T23:34:37.452 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.452 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.452 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.452 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-11T23:34:37.453 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.453 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.453 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.453 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.453 INFO:teuthology.orchestra.run.smithi037.stdout: "retention_period": { 2024-09-11T23:34:37.453 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "retention_period", 2024-09-11T23:34:37.453 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-11T23:34:37.453 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.453 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.453 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "15552000", 2024-09-11T23:34:37.453 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.453 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.453 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.453 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how long to retain device health metrics", 2024-09-11T23:34:37.454 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.454 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.454 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.454 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.454 INFO:teuthology.orchestra.run.smithi037.stdout: "scrape_frequency": { 2024-09-11T23:34:37.454 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "scrape_frequency", 2024-09-11T23:34:37.454 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-11T23:34:37.454 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.454 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.454 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "86400", 2024-09-11T23:34:37.454 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.454 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.454 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.455 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-11T23:34:37.455 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.455 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.455 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.455 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.455 INFO:teuthology.orchestra.run.smithi037.stdout: "self_heal": { 2024-09-11T23:34:37.455 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "self_heal", 2024-09-11T23:34:37.455 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.455 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.455 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.455 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:37.455 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.456 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.456 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.456 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-11T23:34:37.456 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.456 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.456 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.456 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.456 INFO:teuthology.orchestra.run.smithi037.stdout: "sleep_interval": { 2024-09-11T23:34:37.456 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sleep_interval", 2024-09-11T23:34:37.456 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-11T23:34:37.456 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.456 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.456 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "600", 2024-09-11T23:34:37.456 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.457 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.457 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.457 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how frequently to wake up and check device health", 2024-09-11T23:34:37.457 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.457 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.457 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.457 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.457 INFO:teuthology.orchestra.run.smithi037.stdout: "warn_threshold": { 2024-09-11T23:34:37.457 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "warn_threshold", 2024-09-11T23:34:37.457 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-11T23:34:37.457 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.457 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.457 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "7257600", 2024-09-11T23:34:37.458 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.458 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.458 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.458 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-11T23:34:37.458 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.458 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.458 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.458 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.458 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.458 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.458 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:34:37.458 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "diskprediction_local", 2024-09-11T23:34:37.458 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-11T23:34:37.459 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-11T23:34:37.459 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-11T23:34:37.459 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-11T23:34:37.459 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-11T23:34:37.459 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.459 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.459 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.459 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.459 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.459 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.459 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.459 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.459 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.460 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.460 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.460 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.460 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.460 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.460 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.460 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.460 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.460 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.460 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.460 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-11T23:34:37.460 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-11T23:34:37.460 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.461 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.461 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.461 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.461 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.461 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.461 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.461 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.461 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.461 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.461 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.461 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.461 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-11T23:34:37.461 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-11T23:34:37.462 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.462 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.462 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.462 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-11T23:34:37.462 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.462 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.462 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.462 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.462 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.462 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.462 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.462 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.462 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.463 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.463 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.463 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.463 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.463 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.463 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.463 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-11T23:34:37.463 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-11T23:34:37.463 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.463 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.463 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.463 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.463 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.464 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.464 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.464 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.464 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.464 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.464 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.464 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.464 INFO:teuthology.orchestra.run.smithi037.stdout: "predict_interval": { 2024-09-11T23:34:37.464 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "predict_interval", 2024-09-11T23:34:37.464 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.464 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.464 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.464 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "86400", 2024-09-11T23:34:37.465 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.465 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.465 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.465 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.465 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.465 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.465 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.465 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.465 INFO:teuthology.orchestra.run.smithi037.stdout: "predictor_model": { 2024-09-11T23:34:37.465 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "predictor_model", 2024-09-11T23:34:37.465 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.465 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.465 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.466 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "prophetstor", 2024-09-11T23:34:37.466 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.466 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.466 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.466 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.466 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.466 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.466 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.466 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.466 INFO:teuthology.orchestra.run.smithi037.stdout: "sleep_interval": { 2024-09-11T23:34:37.466 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sleep_interval", 2024-09-11T23:34:37.466 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.466 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.466 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.467 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "600", 2024-09-11T23:34:37.467 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.467 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.467 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.467 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.467 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.467 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.467 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.467 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.467 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.467 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.467 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:34:37.467 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "influx", 2024-09-11T23:34:37.468 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": false, 2024-09-11T23:34:37.468 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "influxdb python module not found", 2024-09-11T23:34:37.468 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-11T23:34:37.468 INFO:teuthology.orchestra.run.smithi037.stdout: "batch_size": { 2024-09-11T23:34:37.468 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "batch_size", 2024-09-11T23:34:37.468 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:37.468 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.468 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.468 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5000", 2024-09-11T23:34:37.468 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.468 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.468 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.468 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-11T23:34:37.469 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.469 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.469 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.469 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.469 INFO:teuthology.orchestra.run.smithi037.stdout: "database": { 2024-09-11T23:34:37.469 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "database", 2024-09-11T23:34:37.469 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.469 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.469 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.469 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "ceph", 2024-09-11T23:34:37.469 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.469 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.469 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.470 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-11T23:34:37.470 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.470 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.470 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.470 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.470 INFO:teuthology.orchestra.run.smithi037.stdout: "hostname": { 2024-09-11T23:34:37.470 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "hostname", 2024-09-11T23:34:37.470 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.470 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.470 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.470 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.470 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.470 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.471 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.471 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "InfluxDB server hostname", 2024-09-11T23:34:37.471 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.471 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.471 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.471 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.471 INFO:teuthology.orchestra.run.smithi037.stdout: "interval": { 2024-09-11T23:34:37.471 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "interval", 2024-09-11T23:34:37.471 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-11T23:34:37.471 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.471 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.471 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "30", 2024-09-11T23:34:37.471 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "5", 2024-09-11T23:34:37.472 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.472 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.472 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-11T23:34:37.472 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.472 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.472 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.472 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.472 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-11T23:34:37.472 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-11T23:34:37.472 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.472 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.472 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.472 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.473 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.473 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.473 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.473 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.473 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.473 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.473 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.473 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.473 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.473 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.473 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.473 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.473 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.474 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.474 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.474 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-11T23:34:37.474 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-11T23:34:37.474 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.474 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.474 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.474 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.474 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.474 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.474 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.474 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.474 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.474 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.475 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.475 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.475 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-11T23:34:37.475 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-11T23:34:37.475 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.475 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.475 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.475 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-11T23:34:37.475 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.475 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.475 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.475 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.475 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.475 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.476 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.476 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.476 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.476 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.476 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.476 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.476 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.476 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.476 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.476 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-11T23:34:37.476 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-11T23:34:37.476 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.476 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.477 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.477 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.477 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.477 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.477 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.477 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.477 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.477 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.477 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.477 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.477 INFO:teuthology.orchestra.run.smithi037.stdout: "password": { 2024-09-11T23:34:37.477 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "password", 2024-09-11T23:34:37.477 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.478 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.478 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.478 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.478 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.478 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.478 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.478 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "password of InfluxDB server user", 2024-09-11T23:34:37.478 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.478 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.478 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.478 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.478 INFO:teuthology.orchestra.run.smithi037.stdout: "port": { 2024-09-11T23:34:37.478 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "port", 2024-09-11T23:34:37.478 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:37.479 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.479 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.479 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "8086", 2024-09-11T23:34:37.479 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.479 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.479 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.479 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "InfluxDB server port", 2024-09-11T23:34:37.479 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.479 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.479 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.479 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.479 INFO:teuthology.orchestra.run.smithi037.stdout: "ssl": { 2024-09-11T23:34:37.479 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ssl", 2024-09-11T23:34:37.479 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.480 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.480 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.480 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "false", 2024-09-11T23:34:37.480 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.480 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.480 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.480 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-11T23:34:37.480 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.480 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.480 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.480 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.480 INFO:teuthology.orchestra.run.smithi037.stdout: "threads": { 2024-09-11T23:34:37.480 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "threads", 2024-09-11T23:34:37.481 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:37.481 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.481 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.481 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5", 2024-09-11T23:34:37.481 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "1", 2024-09-11T23:34:37.481 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "32", 2024-09-11T23:34:37.481 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.481 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-11T23:34:37.481 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.481 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.481 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.481 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.481 INFO:teuthology.orchestra.run.smithi037.stdout: "username": { 2024-09-11T23:34:37.482 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "username", 2024-09-11T23:34:37.482 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.482 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.482 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.482 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.482 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.482 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.482 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.482 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "username of InfluxDB server user", 2024-09-11T23:34:37.482 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.482 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.482 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.482 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.483 INFO:teuthology.orchestra.run.smithi037.stdout: "verify_ssl": { 2024-09-11T23:34:37.483 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "verify_ssl", 2024-09-11T23:34:37.483 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.483 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.483 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.483 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "true", 2024-09-11T23:34:37.483 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.483 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.483 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.483 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-11T23:34:37.483 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.483 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.483 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.484 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.484 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.484 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.484 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:34:37.484 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "insights", 2024-09-11T23:34:37.484 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-11T23:34:37.484 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-11T23:34:37.484 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-11T23:34:37.484 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-11T23:34:37.484 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-11T23:34:37.484 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.484 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.484 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.484 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.485 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.485 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.485 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.485 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.485 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.485 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.485 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.485 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.485 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.485 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.485 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.485 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.485 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.486 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.486 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.486 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-11T23:34:37.486 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-11T23:34:37.486 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.486 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.486 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.486 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.486 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.486 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.486 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.486 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.487 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.487 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.487 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.487 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.487 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-11T23:34:37.487 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-11T23:34:37.487 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.487 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.487 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.487 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-11T23:34:37.487 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.487 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.487 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.488 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.488 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.488 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.488 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.488 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.488 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.488 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.488 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.488 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.488 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.488 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.488 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.488 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-11T23:34:37.489 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-11T23:34:37.489 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.489 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.489 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.489 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.489 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.489 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.489 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.489 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.489 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.489 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.489 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.489 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.489 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.490 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.490 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:34:37.490 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "iostat", 2024-09-11T23:34:37.490 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-11T23:34:37.490 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-11T23:34:37.490 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-11T23:34:37.490 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-11T23:34:37.490 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-11T23:34:37.490 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.490 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.490 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.490 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.490 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.491 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.491 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.491 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.491 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.491 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.491 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.491 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.491 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.491 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.491 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.491 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.491 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.491 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.492 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.492 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-11T23:34:37.492 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-11T23:34:37.492 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.492 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.492 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.492 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.492 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.492 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.492 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.492 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.492 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.492 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.493 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.493 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.493 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-11T23:34:37.493 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-11T23:34:37.493 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.493 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.493 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.493 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-11T23:34:37.493 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.493 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.493 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.493 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.493 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.493 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.494 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.494 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.494 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.494 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.494 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.494 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.494 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.494 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.494 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.494 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-11T23:34:37.494 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-11T23:34:37.494 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.495 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.495 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.495 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.495 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.495 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.495 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.495 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.495 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.495 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.495 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.495 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.495 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.495 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.496 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:34:37.496 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "k8sevents", 2024-09-11T23:34:37.496 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-11T23:34:37.496 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-11T23:34:37.496 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-11T23:34:37.496 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_event_retention_days": { 2024-09-11T23:34:37.496 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ceph_event_retention_days", 2024-09-11T23:34:37.496 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:37.496 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.496 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.496 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "7", 2024-09-11T23:34:37.496 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.496 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.497 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.497 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-11T23:34:37.497 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.497 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.497 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.497 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.497 INFO:teuthology.orchestra.run.smithi037.stdout: "config_check_secs": { 2024-09-11T23:34:37.497 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "config_check_secs", 2024-09-11T23:34:37.497 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:37.497 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.497 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.497 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-09-11T23:34:37.497 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "10", 2024-09-11T23:34:37.498 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.498 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.498 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-11T23:34:37.498 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.498 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.498 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.498 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.498 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-11T23:34:37.498 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-11T23:34:37.498 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.498 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.498 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.498 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.499 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.499 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.499 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.499 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.499 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.499 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.499 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.499 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.499 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.499 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.499 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.499 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.499 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.500 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.500 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.500 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-11T23:34:37.500 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-11T23:34:37.500 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.500 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.500 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.500 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.500 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.500 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.500 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.500 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.500 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.501 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.501 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.501 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.501 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-11T23:34:37.501 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-11T23:34:37.501 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.501 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.501 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.501 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-11T23:34:37.501 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.501 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.501 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.501 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.501 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.504 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.504 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.504 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.504 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.504 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.504 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.505 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.505 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.505 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.505 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.505 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-11T23:34:37.505 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-11T23:34:37.505 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.505 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.505 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.505 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.505 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.505 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.505 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.506 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.506 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.506 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.506 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.506 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.506 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.506 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.506 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:34:37.506 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "localpool", 2024-09-11T23:34:37.506 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-11T23:34:37.506 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-11T23:34:37.506 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-11T23:34:37.506 INFO:teuthology.orchestra.run.smithi037.stdout: "failure_domain": { 2024-09-11T23:34:37.507 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "failure_domain", 2024-09-11T23:34:37.507 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.507 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.507 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.507 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "host", 2024-09-11T23:34:37.507 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.507 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.507 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.507 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "failure domain for any created local pool", 2024-09-11T23:34:37.507 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-11T23:34:37.507 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.507 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.507 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.508 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-11T23:34:37.508 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-11T23:34:37.508 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.508 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.508 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.508 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.508 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.508 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.508 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.508 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.508 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.508 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.508 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.509 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.509 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.509 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.509 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.509 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.509 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.509 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.509 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.509 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-11T23:34:37.509 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-11T23:34:37.509 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.509 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.509 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.509 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.510 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.510 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.510 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.510 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.510 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.510 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.510 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.510 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.510 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-11T23:34:37.510 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-11T23:34:37.510 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.510 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.510 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.511 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-11T23:34:37.511 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.511 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.511 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.511 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.511 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.511 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.511 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.511 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.511 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.511 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.511 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.511 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.512 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.512 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.512 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.512 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-11T23:34:37.512 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-11T23:34:37.512 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.512 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.512 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.512 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.512 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.512 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.512 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.512 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.513 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.513 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.513 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.513 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.513 INFO:teuthology.orchestra.run.smithi037.stdout: "min_size": { 2024-09-11T23:34:37.513 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "min_size", 2024-09-11T23:34:37.513 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:37.513 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.513 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.513 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.513 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.513 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.513 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.514 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "default min_size for any created local pool", 2024-09-11T23:34:37.514 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-11T23:34:37.514 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.514 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.514 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.514 INFO:teuthology.orchestra.run.smithi037.stdout: "num_rep": { 2024-09-11T23:34:37.514 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "num_rep", 2024-09-11T23:34:37.514 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:37.514 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.514 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.514 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "3", 2024-09-11T23:34:37.514 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.514 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.514 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.515 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "default replica count for any created local pool", 2024-09-11T23:34:37.515 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.515 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.515 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.515 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.515 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_num": { 2024-09-11T23:34:37.515 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "pg_num", 2024-09-11T23:34:37.515 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:37.515 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.515 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.516 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "128", 2024-09-11T23:34:37.516 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.516 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.516 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.516 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "default pg_num for any created local pool", 2024-09-11T23:34:37.516 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.516 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.516 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.516 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.516 INFO:teuthology.orchestra.run.smithi037.stdout: "prefix": { 2024-09-11T23:34:37.516 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "prefix", 2024-09-11T23:34:37.516 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.517 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.517 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.517 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.517 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.517 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.517 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.517 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "name prefix for any created local pool", 2024-09-11T23:34:37.517 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.517 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.517 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.517 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.517 INFO:teuthology.orchestra.run.smithi037.stdout: "subtree": { 2024-09-11T23:34:37.518 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "subtree", 2024-09-11T23:34:37.518 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.518 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.518 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.518 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "rack", 2024-09-11T23:34:37.518 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.518 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.518 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.518 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-11T23:34:37.518 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-11T23:34:37.518 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.518 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.518 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.518 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.519 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.519 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:34:37.519 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mds_autoscaler", 2024-09-11T23:34:37.519 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-11T23:34:37.519 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-11T23:34:37.519 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-11T23:34:37.519 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-11T23:34:37.519 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-11T23:34:37.519 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.519 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.519 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.519 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.519 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.520 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.520 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.520 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.520 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.520 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.520 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.520 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.520 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.520 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.520 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.520 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.520 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.520 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.521 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.521 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-11T23:34:37.521 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-11T23:34:37.521 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.521 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.521 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.521 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.521 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.521 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.521 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.521 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.521 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.521 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.522 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.522 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.522 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-11T23:34:37.522 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-11T23:34:37.522 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.522 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.522 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.522 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-11T23:34:37.522 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.522 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.522 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.522 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.522 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.522 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.523 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.523 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.523 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.523 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.523 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.523 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.523 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.523 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.523 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.523 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-11T23:34:37.523 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-11T23:34:37.523 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.523 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.524 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.524 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.524 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.524 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.524 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.524 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.524 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.524 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.524 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.524 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.524 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.524 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.524 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:34:37.525 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mirroring", 2024-09-11T23:34:37.525 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-11T23:34:37.525 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-11T23:34:37.525 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-11T23:34:37.525 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-11T23:34:37.525 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-11T23:34:37.525 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.525 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.525 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.525 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.525 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.525 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.526 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.526 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.526 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.526 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.526 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.526 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.526 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.526 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.526 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.526 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.526 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.526 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.526 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.526 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-11T23:34:37.527 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-11T23:34:37.527 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.527 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.527 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.527 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.527 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.527 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.527 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.527 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.527 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.527 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.527 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.527 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.528 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-11T23:34:37.528 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-11T23:34:37.528 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.528 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.528 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.528 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-11T23:34:37.528 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.528 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.528 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.528 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.528 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.528 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.528 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.529 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.529 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.529 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.529 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.529 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.529 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.529 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.529 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.529 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-11T23:34:37.529 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-11T23:34:37.529 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.529 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.529 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.529 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.530 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.530 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.530 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.530 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.530 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.530 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.530 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.530 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.530 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.530 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.530 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:34:37.530 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "nfs", 2024-09-11T23:34:37.531 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-11T23:34:37.531 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-11T23:34:37.531 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-11T23:34:37.531 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-11T23:34:37.531 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-11T23:34:37.531 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.531 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.531 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.531 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.531 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.531 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.531 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.531 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.532 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.532 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.532 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.532 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.532 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.532 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.532 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.532 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.532 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.532 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.532 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.532 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-11T23:34:37.533 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-11T23:34:37.533 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.533 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.533 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.533 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.533 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.533 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.533 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.533 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.533 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.533 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.533 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.533 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.534 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-11T23:34:37.534 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-11T23:34:37.534 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.534 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.534 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.534 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-11T23:34:37.534 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.534 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.534 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.534 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.534 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.534 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.534 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.535 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.535 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.535 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.535 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.535 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.535 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.535 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.535 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.535 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-11T23:34:37.535 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-11T23:34:37.535 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.535 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.535 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.535 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.536 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.536 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.536 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.536 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.536 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.536 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.536 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.536 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.536 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.536 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.536 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:34:37.536 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "orchestrator", 2024-09-11T23:34:37.537 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-11T23:34:37.537 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-11T23:34:37.537 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-11T23:34:37.537 INFO:teuthology.orchestra.run.smithi037.stdout: "fail_fs": { 2024-09-11T23:34:37.537 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "fail_fs", 2024-09-11T23:34:37.537 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.537 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.537 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.537 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.537 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.537 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.537 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.537 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-11T23:34:37.538 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.538 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.538 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.538 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.538 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-11T23:34:37.538 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-11T23:34:37.538 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.538 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.538 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.538 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.538 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.538 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.538 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.539 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.539 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.539 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.539 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.539 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.539 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.539 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.539 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.539 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.539 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.539 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.539 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.539 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-11T23:34:37.540 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-11T23:34:37.540 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.540 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.540 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.540 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.540 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.540 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.540 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.540 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.540 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.540 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.540 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.540 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.541 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-11T23:34:37.541 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-11T23:34:37.541 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.541 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.541 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.541 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-11T23:34:37.541 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.541 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.541 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.541 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.541 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.541 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.541 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.542 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.542 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.542 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.542 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.542 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.542 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.542 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.542 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.542 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-11T23:34:37.542 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-11T23:34:37.542 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.542 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.542 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.543 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.543 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.543 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.543 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.543 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.543 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.543 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.543 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.543 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.543 INFO:teuthology.orchestra.run.smithi037.stdout: "orchestrator": { 2024-09-11T23:34:37.543 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "orchestrator", 2024-09-11T23:34:37.543 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.543 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.543 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.544 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.544 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.544 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.544 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.544 INFO:teuthology.orchestra.run.smithi037.stdout: "cephadm", 2024-09-11T23:34:37.544 INFO:teuthology.orchestra.run.smithi037.stdout: "rook", 2024-09-11T23:34:37.544 INFO:teuthology.orchestra.run.smithi037.stdout: "test_orchestrator" 2024-09-11T23:34:37.544 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.544 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Orchestrator backend", 2024-09-11T23:34:37.544 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.544 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.544 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.544 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.545 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.545 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.545 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:34:37.545 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "osd_perf_query", 2024-09-11T23:34:37.545 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-11T23:34:37.545 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-11T23:34:37.545 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-11T23:34:37.545 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-11T23:34:37.545 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-11T23:34:37.545 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.545 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.545 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.546 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.546 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.546 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.546 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.546 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.546 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.546 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.546 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.546 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.546 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.546 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.546 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.546 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.546 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.547 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.547 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.547 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-11T23:34:37.547 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-11T23:34:37.547 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.547 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.547 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.547 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.547 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.547 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.547 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.547 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.547 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.548 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.548 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.548 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.548 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-11T23:34:37.548 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-11T23:34:37.548 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.548 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.548 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.548 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-11T23:34:37.548 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.548 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.548 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.548 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.549 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.549 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.549 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.549 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.549 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.549 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.549 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.549 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.549 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.549 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.549 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.549 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-11T23:34:37.549 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-11T23:34:37.550 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.550 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.550 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.550 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.550 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.550 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.550 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.550 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.550 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.550 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.550 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.550 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.550 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.550 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.551 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:34:37.551 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "osd_support", 2024-09-11T23:34:37.551 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-11T23:34:37.551 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-11T23:34:37.551 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-11T23:34:37.551 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-11T23:34:37.551 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-11T23:34:37.551 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.551 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.551 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.551 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.551 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.551 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.552 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.552 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.552 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.552 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.552 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.552 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.552 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.552 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.552 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.552 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.552 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.552 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.552 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.553 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-11T23:34:37.553 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-11T23:34:37.553 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.553 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.553 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.553 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.553 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.553 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.553 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.553 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.553 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.553 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.553 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.553 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.554 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-11T23:34:37.554 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-11T23:34:37.554 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.554 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.554 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.554 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-11T23:34:37.554 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.554 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.554 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.554 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.554 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.554 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.554 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.555 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.555 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.555 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.555 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.555 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.555 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.555 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.555 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.555 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-11T23:34:37.555 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-11T23:34:37.555 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.555 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.555 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.556 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.556 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.556 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.556 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.556 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.556 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.556 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.556 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.556 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.556 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.556 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.556 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:34:37.556 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "pg_autoscaler", 2024-09-11T23:34:37.556 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-11T23:34:37.557 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-11T23:34:37.557 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-11T23:34:37.557 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-11T23:34:37.557 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-11T23:34:37.557 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.557 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.557 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.557 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.557 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.557 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.557 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.557 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.557 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.558 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.558 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.558 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.558 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.558 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.558 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.558 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.558 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.558 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.558 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.558 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-11T23:34:37.558 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-11T23:34:37.559 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.559 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.559 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.559 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.559 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.559 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.559 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.559 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.559 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.559 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.559 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.559 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.559 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-11T23:34:37.559 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-11T23:34:37.560 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.560 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.560 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.560 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-11T23:34:37.560 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.560 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.560 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.560 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.560 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.560 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.560 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.560 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.560 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.561 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.561 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.561 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.561 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.561 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.561 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.561 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-11T23:34:37.561 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-11T23:34:37.561 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.561 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.561 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.561 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.561 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.562 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.562 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.562 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.562 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.562 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.562 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.562 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.562 INFO:teuthology.orchestra.run.smithi037.stdout: "sleep_interval": { 2024-09-11T23:34:37.562 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sleep_interval", 2024-09-11T23:34:37.562 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-11T23:34:37.562 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.562 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.562 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "60", 2024-09-11T23:34:37.563 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.563 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.563 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.563 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.563 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.563 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.563 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.563 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.563 INFO:teuthology.orchestra.run.smithi037.stdout: "threshold": { 2024-09-11T23:34:37.563 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "threshold", 2024-09-11T23:34:37.563 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-09-11T23:34:37.563 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.563 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.563 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "3.0", 2024-09-11T23:34:37.564 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "1.0", 2024-09-11T23:34:37.564 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.564 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.564 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "scaling threshold", 2024-09-11T23:34:37.564 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-11T23:34:37.564 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.564 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.564 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.564 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.564 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.564 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:34:37.564 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "progress", 2024-09-11T23:34:37.565 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-11T23:34:37.565 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-11T23:34:37.565 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-11T23:34:37.565 INFO:teuthology.orchestra.run.smithi037.stdout: "allow_pg_recovery_event": { 2024-09-11T23:34:37.565 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "allow_pg_recovery_event", 2024-09-11T23:34:37.565 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.565 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.565 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.565 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.565 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.565 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.565 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.565 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-11T23:34:37.565 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.566 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.566 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.566 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.566 INFO:teuthology.orchestra.run.smithi037.stdout: "enabled": { 2024-09-11T23:34:37.566 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "enabled", 2024-09-11T23:34:37.566 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.566 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.566 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.566 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:37.566 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.566 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.566 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.566 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.567 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.567 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.567 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.567 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.567 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-11T23:34:37.567 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-11T23:34:37.567 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.567 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.567 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.567 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.567 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.567 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.567 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.568 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.568 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.568 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.568 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.568 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.568 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.568 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.568 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.568 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.568 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.568 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.568 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.568 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-11T23:34:37.569 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-11T23:34:37.569 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.569 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.569 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.569 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.569 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.569 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.569 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.569 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.569 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.569 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.569 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.569 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.570 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-11T23:34:37.570 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-11T23:34:37.570 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.570 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.570 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.570 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-11T23:34:37.570 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.570 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.570 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.570 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.570 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.570 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.570 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.571 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.571 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.571 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.571 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.571 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.571 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.571 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.571 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.571 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-11T23:34:37.571 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-11T23:34:37.571 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.571 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.571 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.572 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.572 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.572 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.572 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.572 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.572 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.572 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.572 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.572 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.572 INFO:teuthology.orchestra.run.smithi037.stdout: "max_completed_events": { 2024-09-11T23:34:37.572 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "max_completed_events", 2024-09-11T23:34:37.572 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:37.572 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.573 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.573 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "50", 2024-09-11T23:34:37.573 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.573 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.573 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.573 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "number of past completed events to remember", 2024-09-11T23:34:37.573 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.573 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.573 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.573 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.573 INFO:teuthology.orchestra.run.smithi037.stdout: "sleep_interval": { 2024-09-11T23:34:37.574 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sleep_interval", 2024-09-11T23:34:37.574 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-11T23:34:37.574 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.574 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.574 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5", 2024-09-11T23:34:37.574 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.574 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.574 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.574 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how long the module is going to sleep", 2024-09-11T23:34:37.574 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.574 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.574 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.574 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.575 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.575 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.575 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:34:37.575 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "prometheus", 2024-09-11T23:34:37.575 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-11T23:34:37.575 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-11T23:34:37.575 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-11T23:34:37.575 INFO:teuthology.orchestra.run.smithi037.stdout: "cache": { 2024-09-11T23:34:37.575 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cache", 2024-09-11T23:34:37.575 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.575 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.575 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.575 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:37.576 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.576 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.576 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.576 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.576 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.576 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.576 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.576 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.576 INFO:teuthology.orchestra.run.smithi037.stdout: "exclude_perf_counters": { 2024-09-11T23:34:37.576 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "exclude_perf_counters", 2024-09-11T23:34:37.576 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.576 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.576 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.577 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:37.577 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.577 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.577 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.577 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-11T23:34:37.577 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-11T23:34:37.577 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.577 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.577 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.577 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-11T23:34:37.577 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-11T23:34:37.577 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.578 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.578 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.578 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.578 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.578 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.578 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.578 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.578 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.578 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.578 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.578 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.578 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.578 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.578 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.579 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.579 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.579 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.579 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.579 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-11T23:34:37.579 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-11T23:34:37.579 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.579 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.579 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.579 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.579 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.579 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.579 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.580 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.580 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.580 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.580 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.580 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.580 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-11T23:34:37.580 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-11T23:34:37.580 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.580 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.580 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.580 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-11T23:34:37.580 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.581 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.581 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.581 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.581 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.581 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.581 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.581 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.581 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.581 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.581 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.581 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.581 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.581 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.582 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.582 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-11T23:34:37.582 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-11T23:34:37.582 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.582 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.582 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.582 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.582 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.582 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.582 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.582 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.582 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.582 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.582 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.583 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.583 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_stats_pools": { 2024-09-11T23:34:37.583 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rbd_stats_pools", 2024-09-11T23:34:37.583 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.583 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.583 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.583 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.583 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.583 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.583 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.583 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.583 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.583 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.584 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.584 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.584 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-11T23:34:37.584 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-11T23:34:37.584 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:37.584 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.584 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.584 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "300", 2024-09-11T23:34:37.584 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.584 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.584 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.584 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.584 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.585 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.585 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.585 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.585 INFO:teuthology.orchestra.run.smithi037.stdout: "scrape_interval": { 2024-09-11T23:34:37.585 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "scrape_interval", 2024-09-11T23:34:37.585 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-09-11T23:34:37.585 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.585 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.585 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "15.0", 2024-09-11T23:34:37.585 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.585 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.585 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.585 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.586 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.586 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.586 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.586 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.586 INFO:teuthology.orchestra.run.smithi037.stdout: "server_addr": { 2024-09-11T23:34:37.586 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_addr", 2024-09-11T23:34:37.586 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.586 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.586 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.586 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "::", 2024-09-11T23:34:37.586 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.586 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.586 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.586 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-11T23:34:37.587 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.587 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.587 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.587 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.587 INFO:teuthology.orchestra.run.smithi037.stdout: "server_port": { 2024-09-11T23:34:37.587 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_port", 2024-09-11T23:34:37.587 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:37.587 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.587 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.587 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "9283", 2024-09-11T23:34:37.587 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.587 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.587 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.587 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-11T23:34:37.588 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.588 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.588 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.588 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.588 INFO:teuthology.orchestra.run.smithi037.stdout: "stale_cache_strategy": { 2024-09-11T23:34:37.588 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "stale_cache_strategy", 2024-09-11T23:34:37.588 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.588 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.588 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.588 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "log", 2024-09-11T23:34:37.588 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.588 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.588 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.589 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.589 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.589 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.589 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.589 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.589 INFO:teuthology.orchestra.run.smithi037.stdout: "standby_behaviour": { 2024-09-11T23:34:37.589 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "standby_behaviour", 2024-09-11T23:34:37.589 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.589 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.589 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.589 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "default", 2024-09-11T23:34:37.589 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.590 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.590 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.590 INFO:teuthology.orchestra.run.smithi037.stdout: "default", 2024-09-11T23:34:37.590 INFO:teuthology.orchestra.run.smithi037.stdout: "error" 2024-09-11T23:34:37.590 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.590 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.590 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.590 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.590 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.590 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.590 INFO:teuthology.orchestra.run.smithi037.stdout: "standby_error_status_code": { 2024-09-11T23:34:37.590 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "standby_error_status_code", 2024-09-11T23:34:37.590 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:37.591 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.591 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.591 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "500", 2024-09-11T23:34:37.591 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "400", 2024-09-11T23:34:37.591 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "599", 2024-09-11T23:34:37.591 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.591 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.591 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.591 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.591 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.591 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.591 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.591 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.591 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:34:37.592 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rbd_support", 2024-09-11T23:34:37.592 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-11T23:34:37.592 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-11T23:34:37.592 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-11T23:34:37.592 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-11T23:34:37.592 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-11T23:34:37.592 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.592 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.592 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.592 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.592 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.592 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.592 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.593 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.593 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.593 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.593 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.593 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.593 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.593 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.593 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.593 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.593 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.593 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.593 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.593 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-11T23:34:37.594 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-11T23:34:37.594 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.594 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.594 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.594 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.594 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.594 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.594 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.594 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.594 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.594 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.594 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.594 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.595 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-11T23:34:37.595 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-11T23:34:37.595 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.595 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.595 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.595 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-11T23:34:37.595 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.595 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.595 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.595 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.595 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.595 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.595 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.596 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.596 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.596 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.596 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.596 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.596 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.596 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.596 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.596 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-11T23:34:37.596 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-11T23:34:37.596 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.596 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.596 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.597 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.597 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.597 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.597 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.597 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.597 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.597 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.597 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.597 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.597 INFO:teuthology.orchestra.run.smithi037.stdout: "max_concurrent_snap_create": { 2024-09-11T23:34:37.597 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "max_concurrent_snap_create", 2024-09-11T23:34:37.597 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:37.598 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.598 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.598 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-09-11T23:34:37.598 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.598 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.598 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.598 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.598 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.598 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.598 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.598 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.598 INFO:teuthology.orchestra.run.smithi037.stdout: "mirror_snapshot_schedule": { 2024-09-11T23:34:37.598 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mirror_snapshot_schedule", 2024-09-11T23:34:37.599 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.599 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.599 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.599 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.599 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.599 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.599 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.599 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.599 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.599 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.599 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.599 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.600 INFO:teuthology.orchestra.run.smithi037.stdout: "trash_purge_schedule": { 2024-09-11T23:34:37.600 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "trash_purge_schedule", 2024-09-11T23:34:37.600 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.600 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.600 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.600 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.600 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.600 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.600 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.600 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.600 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.600 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.600 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.600 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.601 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.601 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.601 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:34:37.601 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "restful", 2024-09-11T23:34:37.601 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-11T23:34:37.601 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-11T23:34:37.601 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-11T23:34:37.601 INFO:teuthology.orchestra.run.smithi037.stdout: "enable_auth": { 2024-09-11T23:34:37.601 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "enable_auth", 2024-09-11T23:34:37.601 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.601 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.601 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.601 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:37.602 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.602 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.602 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.602 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.602 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.602 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.602 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.602 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.602 INFO:teuthology.orchestra.run.smithi037.stdout: "key_file": { 2024-09-11T23:34:37.602 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "key_file", 2024-09-11T23:34:37.602 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.602 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.602 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.602 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.603 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.603 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.603 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.603 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.603 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.603 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.603 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.603 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.603 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-11T23:34:37.603 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-11T23:34:37.603 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.603 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.603 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.603 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.604 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.604 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.604 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.604 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.604 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.604 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.604 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.604 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.604 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.604 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.604 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.604 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.605 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.605 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.605 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.605 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-11T23:34:37.605 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-11T23:34:37.605 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.605 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.605 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.605 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.605 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.605 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.605 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.605 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.606 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.606 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.606 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.606 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.606 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-11T23:34:37.606 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-11T23:34:37.606 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.606 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.606 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.606 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-11T23:34:37.606 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.606 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.606 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.607 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.607 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.607 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.607 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.607 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.607 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.607 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.607 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.607 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.607 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.607 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.607 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.608 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-11T23:34:37.608 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-11T23:34:37.608 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.608 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.608 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.608 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.608 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.608 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.608 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.608 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.608 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.608 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.608 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.609 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.609 INFO:teuthology.orchestra.run.smithi037.stdout: "server_addr": { 2024-09-11T23:34:37.609 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_addr", 2024-09-11T23:34:37.609 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.609 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.609 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.609 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.609 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.609 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.609 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.609 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.609 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.609 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.610 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.610 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.610 INFO:teuthology.orchestra.run.smithi037.stdout: "server_port": { 2024-09-11T23:34:37.610 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_port", 2024-09-11T23:34:37.610 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.610 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.610 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.610 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.610 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.610 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.610 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.610 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.610 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.611 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.611 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.611 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.611 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.611 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.611 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:34:37.611 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rgw", 2024-09-11T23:34:37.611 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-11T23:34:37.611 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-11T23:34:37.611 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-11T23:34:37.611 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-11T23:34:37.611 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-11T23:34:37.611 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.612 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.612 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.612 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.612 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.612 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.612 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.612 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.612 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.612 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.612 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.612 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.612 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.612 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.613 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.613 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.613 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.613 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.613 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.613 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-11T23:34:37.613 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-11T23:34:37.613 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.613 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.613 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.613 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.613 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.613 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.614 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.614 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.614 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.614 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.614 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.614 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.614 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-11T23:34:37.614 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-11T23:34:37.614 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.614 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.614 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.614 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-11T23:34:37.614 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.614 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.615 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.615 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.615 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.615 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.615 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.615 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.615 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.615 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.615 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.615 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.615 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.615 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.615 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.616 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-11T23:34:37.616 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-11T23:34:37.616 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.616 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.616 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.616 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.616 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.616 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.616 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.616 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.616 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.616 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.616 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.616 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.617 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.617 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.617 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:34:37.617 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rook", 2024-09-11T23:34:37.617 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-11T23:34:37.617 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-11T23:34:37.617 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-11T23:34:37.617 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-11T23:34:37.617 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-11T23:34:37.617 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.617 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.617 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.617 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.618 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.618 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.618 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.618 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.618 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.618 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.618 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.618 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.618 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.618 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.618 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.618 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.618 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.618 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.619 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.619 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-11T23:34:37.619 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-11T23:34:37.619 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.619 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.619 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.619 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.619 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.619 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.619 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.619 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.619 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.620 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.620 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.620 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.620 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-11T23:34:37.620 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-11T23:34:37.620 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.620 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.620 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.620 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-11T23:34:37.620 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.620 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.620 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.620 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.621 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.621 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.621 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.621 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.621 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.621 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.621 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.621 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.621 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.621 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.621 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.621 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-11T23:34:37.622 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-11T23:34:37.622 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.622 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.622 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.622 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.622 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.622 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.622 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.622 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.622 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.622 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.622 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.622 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.622 INFO:teuthology.orchestra.run.smithi037.stdout: "storage_class": { 2024-09-11T23:34:37.623 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "storage_class", 2024-09-11T23:34:37.623 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.623 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.623 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.623 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "local", 2024-09-11T23:34:37.623 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.623 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.623 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.623 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-11T23:34:37.623 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.623 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.623 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.624 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.624 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.624 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.624 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:34:37.624 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "selftest", 2024-09-11T23:34:37.624 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-11T23:34:37.624 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-11T23:34:37.624 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-11T23:34:37.624 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-11T23:34:37.624 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-11T23:34:37.624 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.624 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.624 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.625 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.625 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.625 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.625 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.625 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.625 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.625 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.625 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.625 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.625 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.625 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.625 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.625 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.626 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.626 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.626 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.626 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-11T23:34:37.626 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-11T23:34:37.626 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.626 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.626 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.626 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.626 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.626 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.626 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.626 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.627 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.627 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.627 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.627 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.627 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-11T23:34:37.627 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-11T23:34:37.627 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.627 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.627 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.627 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-11T23:34:37.627 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.627 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.627 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.628 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.628 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.628 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.628 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.628 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.628 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.628 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.628 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.628 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.628 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.628 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.628 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.628 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-11T23:34:37.629 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-11T23:34:37.629 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.629 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.629 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.629 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.629 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.629 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.629 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.629 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.629 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.629 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.629 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.629 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.630 INFO:teuthology.orchestra.run.smithi037.stdout: "roption1": { 2024-09-11T23:34:37.630 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "roption1", 2024-09-11T23:34:37.630 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.630 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.630 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.630 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.630 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.630 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.630 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.630 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.630 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.630 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.630 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.630 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.631 INFO:teuthology.orchestra.run.smithi037.stdout: "roption2": { 2024-09-11T23:34:37.631 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "roption2", 2024-09-11T23:34:37.631 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.631 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.631 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.631 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "xyz", 2024-09-11T23:34:37.631 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.631 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.631 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.631 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.631 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.631 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.631 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.631 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.632 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption1": { 2024-09-11T23:34:37.632 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption1", 2024-09-11T23:34:37.632 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.632 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.632 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.632 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.632 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.632 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.632 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.632 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.632 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.632 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.632 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.633 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.633 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption2": { 2024-09-11T23:34:37.633 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption2", 2024-09-11T23:34:37.633 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:37.633 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.633 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.633 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.633 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.633 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.633 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.633 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.633 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.633 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.634 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.634 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.634 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption3": { 2024-09-11T23:34:37.634 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption3", 2024-09-11T23:34:37.634 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-09-11T23:34:37.634 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.634 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.634 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.634 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.634 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.634 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.634 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.635 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.635 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.635 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.635 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.635 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption4": { 2024-09-11T23:34:37.635 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption4", 2024-09-11T23:34:37.635 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.635 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.635 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.635 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.635 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.635 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.635 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.636 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.636 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.636 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.636 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.636 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.636 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption5": { 2024-09-11T23:34:37.636 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption5", 2024-09-11T23:34:37.636 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.636 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.636 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.636 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.636 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.637 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.637 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.637 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.637 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.637 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.637 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.637 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.637 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption6": { 2024-09-11T23:34:37.637 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption6", 2024-09-11T23:34:37.637 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.637 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.637 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.637 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:37.638 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.638 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.638 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.638 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.638 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.638 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.638 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.638 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.638 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption7": { 2024-09-11T23:34:37.638 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption7", 2024-09-11T23:34:37.638 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:37.638 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.638 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.639 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.639 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "1", 2024-09-11T23:34:37.639 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "42", 2024-09-11T23:34:37.639 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.639 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.639 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.639 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.639 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.639 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.639 INFO:teuthology.orchestra.run.smithi037.stdout: "testkey": { 2024-09-11T23:34:37.639 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "testkey", 2024-09-11T23:34:37.639 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.639 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.640 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.640 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.640 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.640 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.640 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.640 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.640 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.640 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.640 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.640 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.640 INFO:teuthology.orchestra.run.smithi037.stdout: "testlkey": { 2024-09-11T23:34:37.641 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "testlkey", 2024-09-11T23:34:37.641 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.641 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.641 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.641 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.641 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.641 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.641 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.641 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.641 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.641 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.641 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.642 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.642 INFO:teuthology.orchestra.run.smithi037.stdout: "testnewline": { 2024-09-11T23:34:37.642 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "testnewline", 2024-09-11T23:34:37.642 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.642 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.642 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.642 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.642 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.642 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.642 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.642 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.642 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.642 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.643 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.643 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.643 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.643 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.643 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:34:37.643 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "snap_schedule", 2024-09-11T23:34:37.643 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-11T23:34:37.643 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-11T23:34:37.643 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-11T23:34:37.643 INFO:teuthology.orchestra.run.smithi037.stdout: "allow_m_granularity": { 2024-09-11T23:34:37.643 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "allow_m_granularity", 2024-09-11T23:34:37.643 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.644 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.644 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.644 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.644 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.644 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.644 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.644 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "allow minute scheduled snapshots", 2024-09-11T23:34:37.644 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.644 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.644 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.644 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.644 INFO:teuthology.orchestra.run.smithi037.stdout: "dump_on_update": { 2024-09-11T23:34:37.644 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "dump_on_update", 2024-09-11T23:34:37.645 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.645 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.645 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.645 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.645 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.645 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.645 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.645 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "dump database to debug log on update", 2024-09-11T23:34:37.645 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.645 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.645 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.645 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.646 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-11T23:34:37.646 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-11T23:34:37.646 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.646 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.646 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.646 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.646 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.646 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.646 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.646 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.646 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.646 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.646 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.647 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.647 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.647 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.647 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.647 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.647 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.647 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.647 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.647 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-11T23:34:37.647 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-11T23:34:37.647 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.647 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.647 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.648 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.648 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.648 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.648 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.648 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.648 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.648 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.648 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.648 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.648 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-11T23:34:37.648 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-11T23:34:37.648 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.649 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.649 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.649 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-11T23:34:37.649 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.649 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.649 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.649 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.649 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.649 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.649 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.649 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.649 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.649 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.650 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.650 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.650 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.650 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.650 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.650 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-11T23:34:37.650 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-11T23:34:37.650 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.650 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.650 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.650 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.650 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.650 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.651 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.651 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.651 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.651 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.651 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.651 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.651 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.651 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.651 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:34:37.651 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "stats", 2024-09-11T23:34:37.651 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-11T23:34:37.651 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-11T23:34:37.652 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-11T23:34:37.652 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-11T23:34:37.652 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-11T23:34:37.652 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.652 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.652 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.652 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.652 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.652 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.652 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.652 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.652 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.652 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.653 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.653 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.653 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.653 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.653 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.653 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.653 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.653 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.653 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.653 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-11T23:34:37.653 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-11T23:34:37.653 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.654 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.654 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.654 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.654 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.654 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.654 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.654 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.654 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.654 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.654 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.654 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.654 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-11T23:34:37.655 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-11T23:34:37.655 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.655 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.655 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.655 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-11T23:34:37.655 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.655 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.655 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.655 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.655 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.655 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.655 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.655 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.655 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.656 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.656 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.656 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.656 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.656 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.656 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.656 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-11T23:34:37.656 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-11T23:34:37.656 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.656 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.656 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.656 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.656 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.657 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.657 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.657 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.657 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.657 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.657 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.657 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.657 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.657 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.657 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:34:37.657 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "status", 2024-09-11T23:34:37.657 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-11T23:34:37.658 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-11T23:34:37.658 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-11T23:34:37.658 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-11T23:34:37.658 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-11T23:34:37.658 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.658 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.658 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.658 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.658 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.658 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.658 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.658 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.658 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.659 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.659 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.659 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.659 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.659 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.659 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.659 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.659 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.659 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.659 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.659 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-11T23:34:37.659 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-11T23:34:37.659 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.660 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.660 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.660 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.660 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.660 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.660 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.660 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.660 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.660 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.660 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.660 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.660 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-11T23:34:37.660 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-11T23:34:37.661 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.661 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.661 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.661 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-11T23:34:37.661 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.661 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.661 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.661 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.661 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.661 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.661 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.661 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.661 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.662 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.662 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.662 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.662 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.662 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.662 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.662 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-11T23:34:37.662 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-11T23:34:37.662 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.662 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.662 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.662 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.662 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.663 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.663 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.663 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.663 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.663 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.663 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.663 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.663 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.663 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.663 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:34:37.663 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "telegraf", 2024-09-11T23:34:37.663 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-11T23:34:37.663 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-11T23:34:37.663 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-11T23:34:37.664 INFO:teuthology.orchestra.run.smithi037.stdout: "address": { 2024-09-11T23:34:37.664 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "address", 2024-09-11T23:34:37.664 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.664 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.664 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.664 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-11T23:34:37.664 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.664 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.664 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.664 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.664 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.664 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.664 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.665 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.665 INFO:teuthology.orchestra.run.smithi037.stdout: "interval": { 2024-09-11T23:34:37.665 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "interval", 2024-09-11T23:34:37.665 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-11T23:34:37.665 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.665 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.665 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "15", 2024-09-11T23:34:37.665 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.665 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.665 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.665 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.665 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.666 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.666 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.666 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.666 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-11T23:34:37.666 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-11T23:34:37.666 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.666 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.666 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.666 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.666 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.666 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.666 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.666 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.666 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.667 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.667 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.667 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.667 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.667 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.667 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.667 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.667 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.667 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.667 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.667 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-11T23:34:37.667 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-11T23:34:37.667 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.668 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.668 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.668 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.668 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.668 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.668 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.668 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.668 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.668 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.668 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.668 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.668 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-11T23:34:37.668 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-11T23:34:37.669 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.669 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.669 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.669 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-11T23:34:37.669 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.669 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.669 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.669 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.669 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.669 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.669 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.669 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.670 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.670 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.670 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.670 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.670 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.670 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.670 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.670 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-11T23:34:37.670 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-11T23:34:37.670 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.670 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.670 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.670 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.671 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.671 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.671 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.671 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.671 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.671 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.671 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.671 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.671 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.671 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.671 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:34:37.671 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "telemetry", 2024-09-11T23:34:37.671 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-11T23:34:37.672 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-11T23:34:37.672 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-11T23:34:37.672 INFO:teuthology.orchestra.run.smithi037.stdout: "channel_basic": { 2024-09-11T23:34:37.672 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "channel_basic", 2024-09-11T23:34:37.672 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.672 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.672 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.672 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:37.672 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.672 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.672 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.672 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-11T23:34:37.673 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.673 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.673 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.673 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.673 INFO:teuthology.orchestra.run.smithi037.stdout: "channel_crash": { 2024-09-11T23:34:37.673 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "channel_crash", 2024-09-11T23:34:37.673 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.673 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.673 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.673 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:37.673 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.673 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.673 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.674 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-11T23:34:37.674 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.674 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.674 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.674 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.674 INFO:teuthology.orchestra.run.smithi037.stdout: "channel_device": { 2024-09-11T23:34:37.674 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "channel_device", 2024-09-11T23:34:37.674 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.674 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.674 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.674 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:37.674 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.674 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.675 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.675 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-11T23:34:37.675 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.675 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.675 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.675 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.675 INFO:teuthology.orchestra.run.smithi037.stdout: "channel_ident": { 2024-09-11T23:34:37.675 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "channel_ident", 2024-09-11T23:34:37.675 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.675 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.675 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.675 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.675 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.676 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.676 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.676 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-11T23:34:37.676 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.676 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.676 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.676 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.676 INFO:teuthology.orchestra.run.smithi037.stdout: "channel_perf": { 2024-09-11T23:34:37.676 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "channel_perf", 2024-09-11T23:34:37.676 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.676 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.676 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.676 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.677 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.677 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.677 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.677 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-11T23:34:37.677 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.677 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.677 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.677 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.677 INFO:teuthology.orchestra.run.smithi037.stdout: "contact": { 2024-09-11T23:34:37.677 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "contact", 2024-09-11T23:34:37.677 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.677 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.677 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.678 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.678 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.678 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.678 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.678 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.678 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.678 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.678 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.678 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.678 INFO:teuthology.orchestra.run.smithi037.stdout: "description": { 2024-09-11T23:34:37.678 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "description", 2024-09-11T23:34:37.678 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.678 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.679 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.679 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.679 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.679 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.679 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.679 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.679 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.679 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.679 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.679 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.679 INFO:teuthology.orchestra.run.smithi037.stdout: "device_url": { 2024-09-11T23:34:37.679 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "device_url", 2024-09-11T23:34:37.679 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.680 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.680 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.680 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-11T23:34:37.680 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.680 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.680 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.680 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.680 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.680 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.680 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.680 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.680 INFO:teuthology.orchestra.run.smithi037.stdout: "enabled": { 2024-09-11T23:34:37.681 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "enabled", 2024-09-11T23:34:37.681 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.681 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.681 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.681 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.681 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.681 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.681 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.681 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.681 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.681 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.681 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.681 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.682 INFO:teuthology.orchestra.run.smithi037.stdout: "interval": { 2024-09-11T23:34:37.682 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "interval", 2024-09-11T23:34:37.682 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:37.682 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.682 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.682 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "24", 2024-09-11T23:34:37.682 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "8", 2024-09-11T23:34:37.682 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.682 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.682 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.682 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.682 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.682 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.683 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.683 INFO:teuthology.orchestra.run.smithi037.stdout: "last_opt_revision": { 2024-09-11T23:34:37.683 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "last_opt_revision", 2024-09-11T23:34:37.683 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:37.683 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.683 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.683 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "1", 2024-09-11T23:34:37.683 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.683 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.683 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.683 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.683 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.683 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.684 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.684 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.684 INFO:teuthology.orchestra.run.smithi037.stdout: "leaderboard": { 2024-09-11T23:34:37.684 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "leaderboard", 2024-09-11T23:34:37.684 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.684 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.684 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.684 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.684 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.684 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.684 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.684 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.685 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.685 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.685 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.685 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.685 INFO:teuthology.orchestra.run.smithi037.stdout: "leaderboard_description": { 2024-09-11T23:34:37.685 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "leaderboard_description", 2024-09-11T23:34:37.685 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.685 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.685 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.685 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.685 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.685 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.685 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.686 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.686 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.686 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.686 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.686 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.686 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-11T23:34:37.686 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-11T23:34:37.686 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.686 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.686 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.686 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.686 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.686 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.686 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.687 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.687 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.687 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.687 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.687 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.687 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.687 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.687 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.687 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.687 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.687 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.687 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.687 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-11T23:34:37.688 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-11T23:34:37.688 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.688 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.688 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.688 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.688 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.688 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.688 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.688 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.688 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.688 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.688 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.688 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.689 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-11T23:34:37.689 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-11T23:34:37.689 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.689 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.689 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.689 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-11T23:34:37.689 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.689 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.689 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.689 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.689 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.689 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.689 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.690 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.690 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.690 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.690 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.690 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.690 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.690 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.690 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.690 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-11T23:34:37.690 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-11T23:34:37.690 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.690 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.690 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.690 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.691 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.691 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.691 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.691 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.691 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.691 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.691 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.691 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.691 INFO:teuthology.orchestra.run.smithi037.stdout: "organization": { 2024-09-11T23:34:37.691 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "organization", 2024-09-11T23:34:37.691 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.691 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.691 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.692 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.692 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.692 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.692 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.692 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.692 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.692 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.692 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.692 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.692 INFO:teuthology.orchestra.run.smithi037.stdout: "proxy": { 2024-09-11T23:34:37.692 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "proxy", 2024-09-11T23:34:37.692 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.692 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.692 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.693 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.693 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.693 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.693 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.693 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.693 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.693 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.693 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.693 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.693 INFO:teuthology.orchestra.run.smithi037.stdout: "url": { 2024-09-11T23:34:37.693 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "url", 2024-09-11T23:34:37.693 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.693 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.694 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.694 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-11T23:34:37.694 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.694 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.694 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.694 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.694 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.694 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.694 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.694 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.694 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.694 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.695 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:34:37.695 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "test_orchestrator", 2024-09-11T23:34:37.695 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-11T23:34:37.695 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-11T23:34:37.695 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-11T23:34:37.695 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-11T23:34:37.695 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-11T23:34:37.695 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.695 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.695 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.695 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.695 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.695 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.695 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.696 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.696 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.696 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.696 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.696 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.696 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.696 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.696 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.696 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.696 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.696 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.696 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.697 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-11T23:34:37.697 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-11T23:34:37.697 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.697 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.697 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.697 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.697 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.697 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.697 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.697 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.697 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.697 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.697 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.698 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.698 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-11T23:34:37.698 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-11T23:34:37.698 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.698 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.698 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.698 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-11T23:34:37.698 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.698 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.698 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.698 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.698 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.698 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.699 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.699 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.699 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.699 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.699 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.699 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.699 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.699 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.699 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.699 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-11T23:34:37.699 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-11T23:34:37.699 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.699 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.700 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.700 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.700 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.700 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.700 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.700 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.700 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.700 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.700 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.700 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.700 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.700 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.700 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:34:37.701 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "volumes", 2024-09-11T23:34:37.701 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-11T23:34:37.701 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-11T23:34:37.701 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-11T23:34:37.701 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-11T23:34:37.701 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-11T23:34:37.701 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.701 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.701 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.701 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.701 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.701 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.701 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.701 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.702 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.702 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.702 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.702 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.702 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.702 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.702 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.702 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.702 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.702 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.702 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.702 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-11T23:34:37.702 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-11T23:34:37.703 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.703 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.703 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.704 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.704 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.705 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.705 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.705 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.705 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.705 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.705 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.705 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.705 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-11T23:34:37.705 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-11T23:34:37.705 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.705 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.705 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.705 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-11T23:34:37.706 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.706 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.706 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.706 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.706 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.706 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.706 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.706 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.706 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.706 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.706 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.706 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.706 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.707 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.707 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.707 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-11T23:34:37.707 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-11T23:34:37.707 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.707 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.707 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.707 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.707 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.707 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.707 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.707 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.707 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.708 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.708 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.708 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.708 INFO:teuthology.orchestra.run.smithi037.stdout: "max_concurrent_clones": { 2024-09-11T23:34:37.708 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "max_concurrent_clones", 2024-09-11T23:34:37.708 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:37.708 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.708 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.708 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "4", 2024-09-11T23:34:37.708 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.708 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.708 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.708 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-11T23:34:37.709 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.709 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.709 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.709 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.709 INFO:teuthology.orchestra.run.smithi037.stdout: "periodic_async_work": { 2024-09-11T23:34:37.709 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "periodic_async_work", 2024-09-11T23:34:37.709 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.709 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.709 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.709 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.709 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.709 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.709 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.710 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Periodically check for async work", 2024-09-11T23:34:37.710 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.710 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.710 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.710 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.710 INFO:teuthology.orchestra.run.smithi037.stdout: "snapshot_clone_delay": { 2024-09-11T23:34:37.710 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "snapshot_clone_delay", 2024-09-11T23:34:37.710 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:37.710 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.710 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.710 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-11T23:34:37.710 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.710 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.711 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.711 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-11T23:34:37.711 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.711 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.711 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.711 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.711 INFO:teuthology.orchestra.run.smithi037.stdout: "snapshot_clone_no_wait": { 2024-09-11T23:34:37.711 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "snapshot_clone_no_wait", 2024-09-11T23:34:37.711 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.711 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.711 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.712 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:37.712 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.712 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.712 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.712 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-11T23:34:37.712 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.712 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.712 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.712 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.712 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.712 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.712 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:34:37.712 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "zabbix", 2024-09-11T23:34:37.713 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-11T23:34:37.713 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-11T23:34:37.713 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-11T23:34:37.713 INFO:teuthology.orchestra.run.smithi037.stdout: "discovery_interval": { 2024-09-11T23:34:37.713 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "discovery_interval", 2024-09-11T23:34:37.713 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "uint", 2024-09-11T23:34:37.713 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.713 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.713 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "100", 2024-09-11T23:34:37.713 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.713 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.713 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.713 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.714 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.714 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.714 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.714 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.714 INFO:teuthology.orchestra.run.smithi037.stdout: "identifier": { 2024-09-11T23:34:37.714 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "identifier", 2024-09-11T23:34:37.714 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.714 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.714 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.714 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.714 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.714 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.714 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.715 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.715 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.715 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.715 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.715 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.715 INFO:teuthology.orchestra.run.smithi037.stdout: "interval": { 2024-09-11T23:34:37.715 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "interval", 2024-09-11T23:34:37.715 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-11T23:34:37.715 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.715 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.715 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "60", 2024-09-11T23:34:37.715 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.715 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.716 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.716 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.716 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.716 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.716 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.716 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.716 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-11T23:34:37.716 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-11T23:34:37.716 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.716 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.716 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.716 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.716 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.717 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.717 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.717 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.717 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.717 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.717 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.717 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.717 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.717 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.717 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.717 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.717 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.717 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.718 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.718 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-11T23:34:37.718 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-11T23:34:37.718 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.718 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.718 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.718 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.718 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.718 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.718 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.718 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.718 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.718 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.719 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.719 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.719 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-11T23:34:37.719 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-11T23:34:37.719 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.719 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.719 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.719 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-11T23:34:37.719 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.719 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.719 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.719 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.719 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.720 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.720 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.720 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.720 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.720 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.720 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.720 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.720 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.720 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.720 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.720 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-11T23:34:37.720 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-11T23:34:37.720 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.721 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.721 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.721 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.721 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.721 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.721 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.721 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.721 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.721 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.721 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.721 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.721 INFO:teuthology.orchestra.run.smithi037.stdout: "zabbix_host": { 2024-09-11T23:34:37.721 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "zabbix_host", 2024-09-11T23:34:37.722 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.722 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.722 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.722 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.722 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.722 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.722 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.722 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.722 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.722 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.722 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.722 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.722 INFO:teuthology.orchestra.run.smithi037.stdout: "zabbix_port": { 2024-09-11T23:34:37.723 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "zabbix_port", 2024-09-11T23:34:37.723 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:37.723 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.723 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.723 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10051", 2024-09-11T23:34:37.723 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.723 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.723 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.723 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.723 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.723 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.723 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.723 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.723 INFO:teuthology.orchestra.run.smithi037.stdout: "zabbix_sender": { 2024-09-11T23:34:37.724 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "zabbix_sender", 2024-09-11T23:34:37.724 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.724 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.724 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.724 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-11T23:34:37.724 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.724 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.724 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.724 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.724 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.724 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.724 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.724 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.725 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.725 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.725 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2024-09-11T23:34:37.725 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.725 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.725 INFO:teuthology.orchestra.run.smithi037.stdout: "modules": [ 2024-09-11T23:34:37.725 INFO:teuthology.orchestra.run.smithi037.stdout: "cephadm", 2024-09-11T23:34:37.725 INFO:teuthology.orchestra.run.smithi037.stdout: "dashboard", 2024-09-11T23:34:37.725 INFO:teuthology.orchestra.run.smithi037.stdout: "iostat", 2024-09-11T23:34:37.725 INFO:teuthology.orchestra.run.smithi037.stdout: "nfs", 2024-09-11T23:34:37.725 INFO:teuthology.orchestra.run.smithi037.stdout: "restful" 2024-09-11T23:34:37.725 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.725 INFO:teuthology.orchestra.run.smithi037.stdout: "available_modules": [ 2024-09-11T23:34:37.726 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:34:37.726 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "alerts", 2024-09-11T23:34:37.726 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-11T23:34:37.726 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-11T23:34:37.726 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-11T23:34:37.726 INFO:teuthology.orchestra.run.smithi037.stdout: "interval": { 2024-09-11T23:34:37.726 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "interval", 2024-09-11T23:34:37.726 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-11T23:34:37.726 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.726 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.726 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "60", 2024-09-11T23:34:37.726 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.726 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.727 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.727 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "How frequently to reexamine health status", 2024-09-11T23:34:37.727 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.727 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.727 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.727 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.727 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-11T23:34:37.727 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-11T23:34:37.727 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.727 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.727 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.727 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.727 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.728 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.728 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.728 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.728 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.728 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.728 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.728 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.728 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.728 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.728 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.728 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.728 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.729 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.729 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.729 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-11T23:34:37.729 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-11T23:34:37.729 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.729 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.729 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.729 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.729 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.729 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.729 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.729 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.729 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.729 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.730 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.730 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.730 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-11T23:34:37.730 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-11T23:34:37.730 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.730 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.730 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.730 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-11T23:34:37.730 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.730 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.730 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.730 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.730 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.731 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.731 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.731 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.731 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.731 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.731 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.731 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.731 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.731 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.731 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.731 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-11T23:34:37.731 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-11T23:34:37.731 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.732 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.732 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.732 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.732 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.732 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.732 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.732 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.732 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.732 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.732 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.732 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.732 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_destination": { 2024-09-11T23:34:37.732 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_destination", 2024-09-11T23:34:37.733 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.733 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.733 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.733 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.733 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.733 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.733 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.733 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Email address to send alerts to", 2024-09-11T23:34:37.733 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.733 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.733 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.733 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.733 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_from_name": { 2024-09-11T23:34:37.734 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_from_name", 2024-09-11T23:34:37.734 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.734 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.734 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.734 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "Ceph", 2024-09-11T23:34:37.734 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.734 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.734 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.734 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Email From: name", 2024-09-11T23:34:37.734 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.734 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.734 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.734 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.735 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_host": { 2024-09-11T23:34:37.735 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_host", 2024-09-11T23:34:37.735 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.735 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.735 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.735 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.735 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.735 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.735 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.735 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "SMTP server", 2024-09-11T23:34:37.735 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.735 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.735 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.735 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.736 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_password": { 2024-09-11T23:34:37.736 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_password", 2024-09-11T23:34:37.736 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.736 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.736 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.736 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.736 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.736 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.736 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.736 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Password to authenticate with", 2024-09-11T23:34:37.736 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.736 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.736 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.737 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.737 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_port": { 2024-09-11T23:34:37.737 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_port", 2024-09-11T23:34:37.737 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:37.737 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.737 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.737 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "465", 2024-09-11T23:34:37.737 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.737 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.737 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.737 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "SMTP port", 2024-09-11T23:34:37.737 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.737 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.738 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.738 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.738 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_sender": { 2024-09-11T23:34:37.738 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_sender", 2024-09-11T23:34:37.738 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.738 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.738 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.738 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.738 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.738 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.738 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.738 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "SMTP envelope sender", 2024-09-11T23:34:37.738 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.739 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.739 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.739 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.739 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_ssl": { 2024-09-11T23:34:37.739 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_ssl", 2024-09-11T23:34:37.739 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.739 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.739 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.739 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:37.739 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.739 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.739 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.739 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-11T23:34:37.739 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.740 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.740 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.740 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.740 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_user": { 2024-09-11T23:34:37.740 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_user", 2024-09-11T23:34:37.740 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.740 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.740 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.740 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.740 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.740 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.740 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.740 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "User to authenticate as", 2024-09-11T23:34:37.741 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.741 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.741 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.741 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.741 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.741 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.741 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:34:37.741 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "balancer", 2024-09-11T23:34:37.741 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-11T23:34:37.741 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-11T23:34:37.741 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-11T23:34:37.741 INFO:teuthology.orchestra.run.smithi037.stdout: "active": { 2024-09-11T23:34:37.741 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "active", 2024-09-11T23:34:37.741 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.742 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.742 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.742 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:37.742 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.742 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.742 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.742 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "automatically balance PGs across cluster", 2024-09-11T23:34:37.742 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.742 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.742 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.742 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.742 INFO:teuthology.orchestra.run.smithi037.stdout: "begin_time": { 2024-09-11T23:34:37.743 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "begin_time", 2024-09-11T23:34:37.743 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.743 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.743 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.743 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0000", 2024-09-11T23:34:37.743 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.743 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.743 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.743 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "beginning time of day to automatically balance", 2024-09-11T23:34:37.743 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-11T23:34:37.743 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.743 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.743 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.743 INFO:teuthology.orchestra.run.smithi037.stdout: "begin_weekday": { 2024-09-11T23:34:37.744 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "begin_weekday", 2024-09-11T23:34:37.744 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "uint", 2024-09-11T23:34:37.744 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.744 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.744 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-11T23:34:37.744 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "0", 2024-09-11T23:34:37.744 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "6", 2024-09-11T23:34:37.744 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.744 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-11T23:34:37.744 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-11T23:34:37.744 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.745 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.745 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.745 INFO:teuthology.orchestra.run.smithi037.stdout: "crush_compat_max_iterations": { 2024-09-11T23:34:37.745 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "crush_compat_max_iterations", 2024-09-11T23:34:37.745 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "uint", 2024-09-11T23:34:37.745 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.745 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.745 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "25", 2024-09-11T23:34:37.745 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "1", 2024-09-11T23:34:37.745 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "250", 2024-09-11T23:34:37.745 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.745 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-11T23:34:37.745 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.746 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.746 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.746 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.746 INFO:teuthology.orchestra.run.smithi037.stdout: "crush_compat_metrics": { 2024-09-11T23:34:37.746 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "crush_compat_metrics", 2024-09-11T23:34:37.746 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.746 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.746 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.746 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "pgs,objects,bytes", 2024-09-11T23:34:37.746 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.746 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.746 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.746 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-11T23:34:37.747 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-11T23:34:37.747 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.747 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.747 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.747 INFO:teuthology.orchestra.run.smithi037.stdout: "crush_compat_step": { 2024-09-11T23:34:37.747 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "crush_compat_step", 2024-09-11T23:34:37.747 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-09-11T23:34:37.747 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.747 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.747 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0.5", 2024-09-11T23:34:37.747 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "0.001", 2024-09-11T23:34:37.747 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "0.999", 2024-09-11T23:34:37.748 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.748 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "aggressiveness of optimization", 2024-09-11T23:34:37.748 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-11T23:34:37.748 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.748 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.748 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.748 INFO:teuthology.orchestra.run.smithi037.stdout: "end_time": { 2024-09-11T23:34:37.748 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "end_time", 2024-09-11T23:34:37.748 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.748 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.748 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.748 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "2359", 2024-09-11T23:34:37.748 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.749 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.749 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.749 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "ending time of day to automatically balance", 2024-09-11T23:34:37.749 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-11T23:34:37.749 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.749 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.749 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.749 INFO:teuthology.orchestra.run.smithi037.stdout: "end_weekday": { 2024-09-11T23:34:37.749 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "end_weekday", 2024-09-11T23:34:37.749 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "uint", 2024-09-11T23:34:37.749 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.749 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.749 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-11T23:34:37.750 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "0", 2024-09-11T23:34:37.750 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "6", 2024-09-11T23:34:37.750 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.750 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-11T23:34:37.750 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-11T23:34:37.750 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.750 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.750 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.750 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-11T23:34:37.750 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-11T23:34:37.750 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.750 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.751 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.751 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.751 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.751 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.751 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.751 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.751 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.751 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.751 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.751 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.751 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.751 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.751 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.751 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.752 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.752 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.752 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.752 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-11T23:34:37.752 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-11T23:34:37.752 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.752 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.752 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.752 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.752 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.752 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.752 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.753 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.753 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.753 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.753 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.753 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.753 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-11T23:34:37.753 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-11T23:34:37.753 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.753 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.753 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.753 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-11T23:34:37.753 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.753 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.754 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.754 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.754 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.754 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.754 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.754 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.754 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.754 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.754 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.754 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.754 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.754 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.754 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.754 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-11T23:34:37.755 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-11T23:34:37.755 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.755 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.755 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.755 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.755 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.755 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.755 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.755 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.755 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.755 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.755 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.755 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.756 INFO:teuthology.orchestra.run.smithi037.stdout: "min_score": { 2024-09-11T23:34:37.756 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "min_score", 2024-09-11T23:34:37.756 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-09-11T23:34:37.756 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.756 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.756 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-11T23:34:37.756 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.756 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.756 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.756 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-11T23:34:37.756 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.756 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.756 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.757 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.757 INFO:teuthology.orchestra.run.smithi037.stdout: "mode": { 2024-09-11T23:34:37.757 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mode", 2024-09-11T23:34:37.757 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.757 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.757 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.757 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "upmap", 2024-09-11T23:34:37.757 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.757 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.757 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.757 INFO:teuthology.orchestra.run.smithi037.stdout: "crush-compat", 2024-09-11T23:34:37.757 INFO:teuthology.orchestra.run.smithi037.stdout: "none", 2024-09-11T23:34:37.757 INFO:teuthology.orchestra.run.smithi037.stdout: "read", 2024-09-11T23:34:37.758 INFO:teuthology.orchestra.run.smithi037.stdout: "upmap", 2024-09-11T23:34:37.758 INFO:teuthology.orchestra.run.smithi037.stdout: "upmap-read" 2024-09-11T23:34:37.758 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.758 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Balancer mode", 2024-09-11T23:34:37.758 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.758 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.758 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.758 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.758 INFO:teuthology.orchestra.run.smithi037.stdout: "pool_ids": { 2024-09-11T23:34:37.758 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "pool_ids", 2024-09-11T23:34:37.758 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.758 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.759 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.759 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.759 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.759 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.759 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.759 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-11T23:34:37.759 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.759 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.759 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.759 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.759 INFO:teuthology.orchestra.run.smithi037.stdout: "sleep_interval": { 2024-09-11T23:34:37.759 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sleep_interval", 2024-09-11T23:34:37.759 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-11T23:34:37.760 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.760 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.760 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "60", 2024-09-11T23:34:37.760 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.760 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.760 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.760 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-11T23:34:37.760 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.760 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.760 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.760 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.760 INFO:teuthology.orchestra.run.smithi037.stdout: "upmap_max_deviation": { 2024-09-11T23:34:37.760 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "upmap_max_deviation", 2024-09-11T23:34:37.761 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:37.761 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.761 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.761 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5", 2024-09-11T23:34:37.761 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "1", 2024-09-11T23:34:37.761 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.761 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.761 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-11T23:34:37.761 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-11T23:34:37.761 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.761 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.761 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.761 INFO:teuthology.orchestra.run.smithi037.stdout: "upmap_max_optimizations": { 2024-09-11T23:34:37.762 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "upmap_max_optimizations", 2024-09-11T23:34:37.762 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "uint", 2024-09-11T23:34:37.762 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.762 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.762 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-09-11T23:34:37.762 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.762 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.762 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.762 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-11T23:34:37.762 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.762 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.762 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.762 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.763 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.763 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.763 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:34:37.763 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cephadm", 2024-09-11T23:34:37.763 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-11T23:34:37.763 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-11T23:34:37.763 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-11T23:34:37.763 INFO:teuthology.orchestra.run.smithi037.stdout: "agent_down_multiplier": { 2024-09-11T23:34:37.763 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "agent_down_multiplier", 2024-09-11T23:34:37.763 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-09-11T23:34:37.763 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.763 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.763 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "3.0", 2024-09-11T23:34:37.764 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.764 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.764 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.764 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-11T23:34:37.764 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.764 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.764 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.764 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.764 INFO:teuthology.orchestra.run.smithi037.stdout: "agent_refresh_rate": { 2024-09-11T23:34:37.764 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "agent_refresh_rate", 2024-09-11T23:34:37.764 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-11T23:34:37.764 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.764 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.764 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "20", 2024-09-11T23:34:37.765 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.765 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.765 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.765 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-11T23:34:37.765 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.765 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.765 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.765 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.765 INFO:teuthology.orchestra.run.smithi037.stdout: "agent_starting_port": { 2024-09-11T23:34:37.765 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "agent_starting_port", 2024-09-11T23:34:37.765 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:37.765 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.766 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.766 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "4721", 2024-09-11T23:34:37.766 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.766 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.766 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.766 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-11T23:34:37.766 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.766 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.766 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.766 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.766 INFO:teuthology.orchestra.run.smithi037.stdout: "allow_ptrace": { 2024-09-11T23:34:37.766 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "allow_ptrace", 2024-09-11T23:34:37.766 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.766 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.767 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.767 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.767 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.767 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.767 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.767 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-11T23:34:37.767 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-11T23:34:37.767 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.767 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.767 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.767 INFO:teuthology.orchestra.run.smithi037.stdout: "autotune_interval": { 2024-09-11T23:34:37.767 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "autotune_interval", 2024-09-11T23:34:37.767 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-11T23:34:37.767 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.768 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.768 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "600", 2024-09-11T23:34:37.768 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.768 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.768 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.768 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-11T23:34:37.768 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.768 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.768 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.768 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.768 INFO:teuthology.orchestra.run.smithi037.stdout: "autotune_memory_target_ratio": { 2024-09-11T23:34:37.768 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "autotune_memory_target_ratio", 2024-09-11T23:34:37.769 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-09-11T23:34:37.769 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.769 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.769 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0.7", 2024-09-11T23:34:37.769 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.769 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.769 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.769 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-11T23:34:37.769 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.769 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.769 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.769 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.770 INFO:teuthology.orchestra.run.smithi037.stdout: "cephadm_log_destination": { 2024-09-11T23:34:37.770 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cephadm_log_destination", 2024-09-11T23:34:37.770 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.770 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.770 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.770 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.770 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.770 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.770 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.770 INFO:teuthology.orchestra.run.smithi037.stdout: "file", 2024-09-11T23:34:37.770 INFO:teuthology.orchestra.run.smithi037.stdout: "file,syslog", 2024-09-11T23:34:37.770 INFO:teuthology.orchestra.run.smithi037.stdout: "syslog" 2024-09-11T23:34:37.770 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.771 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-11T23:34:37.771 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.771 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.771 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.771 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.771 INFO:teuthology.orchestra.run.smithi037.stdout: "cgroups_split": { 2024-09-11T23:34:37.771 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cgroups_split", 2024-09-11T23:34:37.771 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.771 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.771 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.771 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:37.771 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.771 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.772 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.772 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-11T23:34:37.772 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.772 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.772 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.772 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.772 INFO:teuthology.orchestra.run.smithi037.stdout: "config_checks_enabled": { 2024-09-11T23:34:37.772 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "config_checks_enabled", 2024-09-11T23:34:37.772 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.772 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.772 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.772 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.772 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.773 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.773 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.773 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-11T23:34:37.773 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.773 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.773 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.773 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.773 INFO:teuthology.orchestra.run.smithi037.stdout: "config_dashboard": { 2024-09-11T23:34:37.773 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "config_dashboard", 2024-09-11T23:34:37.773 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.773 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.773 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.773 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:37.774 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.774 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.774 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.774 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-11T23:34:37.774 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.774 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.774 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.774 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.774 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_alertmanager": { 2024-09-11T23:34:37.774 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_alertmanager", 2024-09-11T23:34:37.774 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.774 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.774 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.774 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-11T23:34:37.775 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.775 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.775 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.775 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Prometheus container image", 2024-09-11T23:34:37.775 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.775 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.775 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.775 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.775 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_base": { 2024-09-11T23:34:37.775 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_base", 2024-09-11T23:34:37.775 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.775 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.775 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.776 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-11T23:34:37.776 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.776 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.776 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.776 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Container image name, without the tag", 2024-09-11T23:34:37.776 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.776 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.776 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.776 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.776 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_elasticsearch": { 2024-09-11T23:34:37.776 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_elasticsearch", 2024-09-11T23:34:37.776 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.777 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.777 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.777 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-11T23:34:37.777 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.777 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.777 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.777 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "elasticsearch container image", 2024-09-11T23:34:37.777 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.777 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.777 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.777 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.777 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_grafana": { 2024-09-11T23:34:37.777 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_grafana", 2024-09-11T23:34:37.778 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.778 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.778 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.778 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-11T23:34:37.778 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.778 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.778 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.778 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Prometheus container image", 2024-09-11T23:34:37.778 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.778 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.778 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.778 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.778 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_haproxy": { 2024-09-11T23:34:37.779 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_haproxy", 2024-09-11T23:34:37.779 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.779 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.779 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.779 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-11T23:34:37.779 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.779 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.779 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.779 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "HAproxy container image", 2024-09-11T23:34:37.779 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.779 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.779 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.780 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.780 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_jaeger_agent": { 2024-09-11T23:34:37.780 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_jaeger_agent", 2024-09-11T23:34:37.780 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.780 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.780 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.780 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-11T23:34:37.780 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.780 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.780 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.780 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Jaeger agent container image", 2024-09-11T23:34:37.780 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.780 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.781 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.781 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.781 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_jaeger_collector": { 2024-09-11T23:34:37.781 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_jaeger_collector", 2024-09-11T23:34:37.781 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.781 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.781 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.781 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-11T23:34:37.781 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.781 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.781 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.781 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Jaeger collector container image", 2024-09-11T23:34:37.781 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.782 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.782 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.782 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.782 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_jaeger_query": { 2024-09-11T23:34:37.782 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_jaeger_query", 2024-09-11T23:34:37.782 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.782 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.782 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.782 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-11T23:34:37.782 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.782 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.782 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.782 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Jaeger query container image", 2024-09-11T23:34:37.783 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.783 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.783 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.783 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.783 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_keepalived": { 2024-09-11T23:34:37.783 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_keepalived", 2024-09-11T23:34:37.783 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.783 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.783 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.783 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-11T23:34:37.783 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.783 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.783 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.784 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Keepalived container image", 2024-09-11T23:34:37.784 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.784 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.784 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.784 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.784 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_loki": { 2024-09-11T23:34:37.784 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_loki", 2024-09-11T23:34:37.784 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.784 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.784 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.784 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-11T23:34:37.784 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.784 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.784 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.785 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Loki container image", 2024-09-11T23:34:37.785 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.785 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.785 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.785 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.785 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_node_exporter": { 2024-09-11T23:34:37.785 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_node_exporter", 2024-09-11T23:34:37.785 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.785 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.785 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.785 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-11T23:34:37.785 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.785 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.786 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.786 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Prometheus container image", 2024-09-11T23:34:37.786 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.786 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.786 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.786 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.786 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_nvmeof": { 2024-09-11T23:34:37.786 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_nvmeof", 2024-09-11T23:34:37.786 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.786 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.786 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.786 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-11T23:34:37.786 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.787 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.787 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.787 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Nvme-of container image", 2024-09-11T23:34:37.787 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.787 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.787 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.787 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.787 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_prometheus": { 2024-09-11T23:34:37.787 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_prometheus", 2024-09-11T23:34:37.787 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.787 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.787 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.787 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-11T23:34:37.788 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.788 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.788 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.788 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Prometheus container image", 2024-09-11T23:34:37.788 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.788 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.788 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.788 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.788 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_promtail": { 2024-09-11T23:34:37.788 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_promtail", 2024-09-11T23:34:37.788 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.788 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.788 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.789 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-11T23:34:37.789 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.789 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.789 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.789 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Promtail container image", 2024-09-11T23:34:37.789 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.789 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.789 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.789 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.789 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_samba": { 2024-09-11T23:34:37.789 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_samba", 2024-09-11T23:34:37.789 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.789 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.790 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.790 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-11T23:34:37.790 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.790 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.790 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.790 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Samba/SMB container image", 2024-09-11T23:34:37.790 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.790 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.790 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.790 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.790 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_snmp_gateway": { 2024-09-11T23:34:37.790 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_snmp_gateway", 2024-09-11T23:34:37.790 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.791 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.791 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.791 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-11T23:34:37.791 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.791 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.791 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.791 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "SNMP Gateway container image", 2024-09-11T23:34:37.791 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.791 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.791 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.791 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.792 INFO:teuthology.orchestra.run.smithi037.stdout: "container_init": { 2024-09-11T23:34:37.792 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_init", 2024-09-11T23:34:37.792 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.792 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.792 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.792 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:37.792 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.792 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.792 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.792 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Run podman/docker with `--init`", 2024-09-11T23:34:37.792 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.792 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.792 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.793 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.793 INFO:teuthology.orchestra.run.smithi037.stdout: "daemon_cache_timeout": { 2024-09-11T23:34:37.793 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "daemon_cache_timeout", 2024-09-11T23:34:37.793 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-11T23:34:37.793 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.793 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.793 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "600", 2024-09-11T23:34:37.793 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.793 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.793 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.793 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-11T23:34:37.793 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.794 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.794 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.794 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.794 INFO:teuthology.orchestra.run.smithi037.stdout: "default_cephadm_command_timeout": { 2024-09-11T23:34:37.794 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "default_cephadm_command_timeout", 2024-09-11T23:34:37.794 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:37.794 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.794 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.794 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "900", 2024-09-11T23:34:37.794 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.794 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.794 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.795 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-11T23:34:37.795 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.795 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.795 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.795 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.795 INFO:teuthology.orchestra.run.smithi037.stdout: "default_registry": { 2024-09-11T23:34:37.795 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "default_registry", 2024-09-11T23:34:37.795 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.795 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.795 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.795 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "docker.io", 2024-09-11T23:34:37.795 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.796 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.796 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.796 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-11T23:34:37.796 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.796 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.796 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.796 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.796 INFO:teuthology.orchestra.run.smithi037.stdout: "device_cache_timeout": { 2024-09-11T23:34:37.796 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "device_cache_timeout", 2024-09-11T23:34:37.796 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-11T23:34:37.796 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.796 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.797 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "1800", 2024-09-11T23:34:37.797 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.797 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.797 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.797 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "seconds to cache device inventory", 2024-09-11T23:34:37.797 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.797 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.797 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.797 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.797 INFO:teuthology.orchestra.run.smithi037.stdout: "device_enhanced_scan": { 2024-09-11T23:34:37.797 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "device_enhanced_scan", 2024-09-11T23:34:37.797 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.798 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.798 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.798 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.798 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.798 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.798 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.798 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-11T23:34:37.798 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.798 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.798 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.798 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.798 INFO:teuthology.orchestra.run.smithi037.stdout: "facts_cache_timeout": { 2024-09-11T23:34:37.798 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "facts_cache_timeout", 2024-09-11T23:34:37.799 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-11T23:34:37.799 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.799 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.799 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "60", 2024-09-11T23:34:37.799 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.799 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.799 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.799 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "seconds to cache host facts data", 2024-09-11T23:34:37.799 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.799 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.799 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.799 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.799 INFO:teuthology.orchestra.run.smithi037.stdout: "grafana_dashboards_path": { 2024-09-11T23:34:37.800 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "grafana_dashboards_path", 2024-09-11T23:34:37.800 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.800 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.800 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.800 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-11T23:34:37.800 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.800 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.800 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.800 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-11T23:34:37.800 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.800 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.800 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.800 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.801 INFO:teuthology.orchestra.run.smithi037.stdout: "host_check_interval": { 2024-09-11T23:34:37.801 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "host_check_interval", 2024-09-11T23:34:37.801 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-11T23:34:37.801 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.801 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.801 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "600", 2024-09-11T23:34:37.801 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.801 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.801 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.801 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how frequently to perform a host check", 2024-09-11T23:34:37.801 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.801 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.801 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.802 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.802 INFO:teuthology.orchestra.run.smithi037.stdout: "hw_monitoring": { 2024-09-11T23:34:37.802 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "hw_monitoring", 2024-09-11T23:34:37.802 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.802 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.802 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.802 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.802 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.802 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.802 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.802 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-11T23:34:37.802 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.802 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.803 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.803 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.803 INFO:teuthology.orchestra.run.smithi037.stdout: "inventory_list_all": { 2024-09-11T23:34:37.803 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "inventory_list_all", 2024-09-11T23:34:37.803 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.803 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.803 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.803 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.803 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.803 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.803 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.803 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-11T23:34:37.803 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.803 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.804 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.804 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.804 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-11T23:34:37.804 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-11T23:34:37.804 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.804 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.804 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.804 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.804 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.804 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.804 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.804 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.804 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.805 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.805 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.805 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.805 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.805 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.805 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.805 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.805 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.805 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.805 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.805 INFO:teuthology.orchestra.run.smithi037.stdout: "log_refresh_metadata": { 2024-09-11T23:34:37.805 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_refresh_metadata", 2024-09-11T23:34:37.805 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.806 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.806 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.806 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.806 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.806 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.806 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.806 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-11T23:34:37.806 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.806 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.806 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.806 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.806 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-11T23:34:37.806 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-11T23:34:37.806 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.807 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.807 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.807 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:37.807 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.807 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.807 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.807 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-11T23:34:37.807 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.807 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.807 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.807 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.807 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-11T23:34:37.807 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-11T23:34:37.808 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.808 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.808 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.808 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-11T23:34:37.808 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.808 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.808 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.808 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.808 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.808 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.808 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.808 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.809 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.809 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.809 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.809 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.809 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.809 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.809 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.809 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-11T23:34:37.809 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-11T23:34:37.809 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.809 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.809 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.809 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.810 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.810 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.810 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.810 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.810 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.810 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.810 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.810 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.810 INFO:teuthology.orchestra.run.smithi037.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-11T23:34:37.810 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-11T23:34:37.810 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.810 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.810 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.811 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.811 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.811 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.811 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.811 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-11T23:34:37.811 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.811 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.811 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.811 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.811 INFO:teuthology.orchestra.run.smithi037.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-11T23:34:37.811 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-11T23:34:37.811 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.811 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.811 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.812 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "*", 2024-09-11T23:34:37.812 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.812 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.812 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.812 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-11T23:34:37.812 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.812 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.812 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.812 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.812 INFO:teuthology.orchestra.run.smithi037.stdout: "max_count_per_host": { 2024-09-11T23:34:37.812 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "max_count_per_host", 2024-09-11T23:34:37.812 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:37.813 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.813 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.813 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-09-11T23:34:37.813 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.813 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.813 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.813 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "max number of daemons per service per host", 2024-09-11T23:34:37.813 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.813 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.813 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.813 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.813 INFO:teuthology.orchestra.run.smithi037.stdout: "max_osd_draining_count": { 2024-09-11T23:34:37.813 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "max_osd_draining_count", 2024-09-11T23:34:37.813 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:37.814 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.814 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.814 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-09-11T23:34:37.814 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.814 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.814 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.814 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-11T23:34:37.814 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.814 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.814 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.814 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.814 INFO:teuthology.orchestra.run.smithi037.stdout: "migration_current": { 2024-09-11T23:34:37.814 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "migration_current", 2024-09-11T23:34:37.815 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:37.815 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.815 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.815 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.815 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.815 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.815 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.815 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "internal - do not modify", 2024-09-11T23:34:37.815 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.815 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.815 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.815 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.815 INFO:teuthology.orchestra.run.smithi037.stdout: "mode": { 2024-09-11T23:34:37.815 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mode", 2024-09-11T23:34:37.816 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.816 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.816 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.816 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "root", 2024-09-11T23:34:37.816 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.816 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.816 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.816 INFO:teuthology.orchestra.run.smithi037.stdout: "cephadm-package", 2024-09-11T23:34:37.816 INFO:teuthology.orchestra.run.smithi037.stdout: "root" 2024-09-11T23:34:37.816 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.816 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "mode for remote execution of cephadm", 2024-09-11T23:34:37.816 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.816 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.817 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.817 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.817 INFO:teuthology.orchestra.run.smithi037.stdout: "oob_default_addr": { 2024-09-11T23:34:37.817 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "oob_default_addr", 2024-09-11T23:34:37.817 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.817 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.817 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.817 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "169.254.1.1", 2024-09-11T23:34:37.817 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.817 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.817 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.817 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-11T23:34:37.817 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.818 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.818 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.818 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.818 INFO:teuthology.orchestra.run.smithi037.stdout: "prometheus_alerts_path": { 2024-09-11T23:34:37.818 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "prometheus_alerts_path", 2024-09-11T23:34:37.818 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.818 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.818 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.818 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-11T23:34:37.818 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.818 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.818 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.819 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-11T23:34:37.819 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.819 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.819 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.819 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.819 INFO:teuthology.orchestra.run.smithi037.stdout: "registry_insecure": { 2024-09-11T23:34:37.819 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "registry_insecure", 2024-09-11T23:34:37.819 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.819 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.819 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.819 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.819 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.819 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.819 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.820 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-11T23:34:37.820 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.820 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.820 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.820 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.820 INFO:teuthology.orchestra.run.smithi037.stdout: "registry_password": { 2024-09-11T23:34:37.820 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "registry_password", 2024-09-11T23:34:37.820 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.820 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.820 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.820 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.820 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.821 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.821 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.821 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-11T23:34:37.821 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.821 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.821 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.821 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.821 INFO:teuthology.orchestra.run.smithi037.stdout: "registry_url": { 2024-09-11T23:34:37.821 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "registry_url", 2024-09-11T23:34:37.821 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.821 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.821 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.821 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.821 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.822 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.822 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.822 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-11T23:34:37.822 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.822 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.822 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.822 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.822 INFO:teuthology.orchestra.run.smithi037.stdout: "registry_username": { 2024-09-11T23:34:37.822 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "registry_username", 2024-09-11T23:34:37.822 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.822 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.822 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.822 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.823 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.823 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.823 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.823 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-11T23:34:37.823 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.823 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.823 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.823 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.823 INFO:teuthology.orchestra.run.smithi037.stdout: "secure_monitoring_stack": { 2024-09-11T23:34:37.823 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "secure_monitoring_stack", 2024-09-11T23:34:37.823 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.823 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.823 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.824 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.824 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.824 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.824 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.824 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-11T23:34:37.824 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.824 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.824 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.824 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.824 INFO:teuthology.orchestra.run.smithi037.stdout: "service_discovery_port": { 2024-09-11T23:34:37.824 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "service_discovery_port", 2024-09-11T23:34:37.824 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:37.824 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.825 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.825 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "8765", 2024-09-11T23:34:37.825 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.825 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.825 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.825 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "cephadm service discovery port", 2024-09-11T23:34:37.825 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.825 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.825 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.825 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.825 INFO:teuthology.orchestra.run.smithi037.stdout: "ssh_config_file": { 2024-09-11T23:34:37.825 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ssh_config_file", 2024-09-11T23:34:37.826 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.826 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.826 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.826 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.826 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.826 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.826 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.826 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-11T23:34:37.826 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.826 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.826 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.826 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.826 INFO:teuthology.orchestra.run.smithi037.stdout: "use_agent": { 2024-09-11T23:34:37.827 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "use_agent", 2024-09-11T23:34:37.827 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.827 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.827 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.827 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.827 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.827 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.827 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.827 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-11T23:34:37.827 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.827 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.827 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.828 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.828 INFO:teuthology.orchestra.run.smithi037.stdout: "use_repo_digest": { 2024-09-11T23:34:37.828 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "use_repo_digest", 2024-09-11T23:34:37.828 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.828 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.828 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.828 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:37.828 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.828 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.828 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.828 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-11T23:34:37.828 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.828 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.829 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.829 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.829 INFO:teuthology.orchestra.run.smithi037.stdout: "warn_on_failed_host_check": { 2024-09-11T23:34:37.829 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "warn_on_failed_host_check", 2024-09-11T23:34:37.829 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.829 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.829 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.829 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:37.829 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.829 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.829 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.829 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "raise a health warning if the host check fails", 2024-09-11T23:34:37.830 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.830 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.830 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.830 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.830 INFO:teuthology.orchestra.run.smithi037.stdout: "warn_on_stray_daemons": { 2024-09-11T23:34:37.830 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "warn_on_stray_daemons", 2024-09-11T23:34:37.830 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.830 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.830 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.830 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:37.830 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.830 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.830 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.831 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-11T23:34:37.831 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.831 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.831 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.831 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.831 INFO:teuthology.orchestra.run.smithi037.stdout: "warn_on_stray_hosts": { 2024-09-11T23:34:37.831 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "warn_on_stray_hosts", 2024-09-11T23:34:37.831 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.831 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.831 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.831 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:37.831 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.832 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.832 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.832 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-11T23:34:37.832 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.832 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.832 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.832 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.832 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.832 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.832 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:34:37.832 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "crash", 2024-09-11T23:34:37.832 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-11T23:34:37.832 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-11T23:34:37.833 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-11T23:34:37.833 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-11T23:34:37.833 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-11T23:34:37.833 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.833 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.833 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.833 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.833 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.833 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.833 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.833 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.833 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.833 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.834 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.834 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.834 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.834 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.834 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.834 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.834 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.834 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.834 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.834 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-11T23:34:37.834 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-11T23:34:37.834 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.834 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.835 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.835 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.835 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.835 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.835 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.835 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.835 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.835 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.835 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.835 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.835 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-11T23:34:37.835 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-11T23:34:37.835 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.836 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.836 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.836 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-11T23:34:37.836 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.836 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.836 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.836 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.836 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.836 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.836 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.836 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.836 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.836 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.837 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.837 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.837 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.837 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.837 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.837 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-11T23:34:37.837 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-11T23:34:37.837 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.837 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.837 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.837 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.837 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.837 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.837 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.838 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.838 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.838 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.838 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.838 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.838 INFO:teuthology.orchestra.run.smithi037.stdout: "retain_interval": { 2024-09-11T23:34:37.838 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "retain_interval", 2024-09-11T23:34:37.838 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-11T23:34:37.838 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.838 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.838 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "31536000", 2024-09-11T23:34:37.838 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.838 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.839 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.839 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-11T23:34:37.839 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.839 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.839 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.839 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.839 INFO:teuthology.orchestra.run.smithi037.stdout: "warn_recent_interval": { 2024-09-11T23:34:37.839 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "warn_recent_interval", 2024-09-11T23:34:37.839 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-11T23:34:37.839 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.839 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.839 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "1209600", 2024-09-11T23:34:37.839 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.840 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.840 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.840 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-11T23:34:37.840 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.840 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.840 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.840 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.840 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.840 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.840 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:34:37.840 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "dashboard", 2024-09-11T23:34:37.840 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-11T23:34:37.841 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-11T23:34:37.841 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-11T23:34:37.841 INFO:teuthology.orchestra.run.smithi037.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-11T23:34:37.841 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-11T23:34:37.841 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:37.841 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.841 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.841 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-09-11T23:34:37.841 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.841 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.841 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.841 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.841 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.842 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.842 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.842 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.842 INFO:teuthology.orchestra.run.smithi037.stdout: "ALERTMANAGER_API_HOST": { 2024-09-11T23:34:37.842 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-11T23:34:37.842 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.842 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.842 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.842 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.842 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.842 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.842 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.842 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.843 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.843 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.843 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.843 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.843 INFO:teuthology.orchestra.run.smithi037.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-11T23:34:37.843 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-11T23:34:37.843 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.843 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.843 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.843 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:37.843 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.843 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.843 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.844 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.844 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.844 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.844 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.844 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.844 INFO:teuthology.orchestra.run.smithi037.stdout: "AUDIT_API_ENABLED": { 2024-09-11T23:34:37.844 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "AUDIT_API_ENABLED", 2024-09-11T23:34:37.844 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.844 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.844 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.844 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.844 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.844 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.845 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.845 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.845 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.845 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.845 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.845 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.845 INFO:teuthology.orchestra.run.smithi037.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-11T23:34:37.845 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-11T23:34:37.845 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.845 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.845 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.845 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:37.846 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.846 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.846 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.846 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.846 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.846 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.846 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.846 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.846 INFO:teuthology.orchestra.run.smithi037.stdout: "ENABLE_BROWSABLE_API": { 2024-09-11T23:34:37.846 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-11T23:34:37.846 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.846 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.846 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.847 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:37.847 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.847 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.847 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.847 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.847 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.847 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.847 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.847 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.847 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-11T23:34:37.847 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-11T23:34:37.847 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.847 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.847 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.848 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:37.848 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.848 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.848 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.848 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.848 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.848 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.848 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.848 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.848 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-11T23:34:37.848 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-11T23:34:37.848 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.848 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.849 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.849 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:37.849 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.849 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.849 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.849 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.849 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.849 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.849 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.849 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.849 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-11T23:34:37.849 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-11T23:34:37.849 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.850 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.850 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.850 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:37.850 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.850 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.850 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.850 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.850 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.850 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.850 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.850 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.850 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-11T23:34:37.850 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-11T23:34:37.850 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.851 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.851 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.851 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:37.851 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.851 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.851 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.851 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.851 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.851 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.851 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.851 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.851 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-11T23:34:37.851 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-11T23:34:37.852 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.852 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.852 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.852 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:37.852 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.852 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.852 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.852 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.852 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.852 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.852 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.852 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.852 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-11T23:34:37.853 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-11T23:34:37.853 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.853 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.853 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.853 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:37.853 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.853 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.853 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.853 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.853 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.853 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.853 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.853 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.854 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-11T23:34:37.854 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-11T23:34:37.854 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.854 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.854 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.854 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:37.854 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.854 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.854 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.854 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.854 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.854 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.854 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.855 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.855 INFO:teuthology.orchestra.run.smithi037.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-11T23:34:37.855 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-11T23:34:37.855 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.855 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.855 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.855 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.855 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.855 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.855 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.855 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.855 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.855 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.856 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.856 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.856 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_API_PASSWORD": { 2024-09-11T23:34:37.856 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-11T23:34:37.856 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.856 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.856 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.856 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "admin", 2024-09-11T23:34:37.856 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.856 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.856 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.856 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.856 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.857 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.857 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.857 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.857 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-11T23:34:37.857 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-11T23:34:37.857 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.857 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.857 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.857 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:37.857 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.857 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.857 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.857 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.858 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.858 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.858 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.858 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.858 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_API_URL": { 2024-09-11T23:34:37.858 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_API_URL", 2024-09-11T23:34:37.858 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.858 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.858 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.858 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.858 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.858 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.858 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.859 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.859 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.859 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.859 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.859 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.859 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_API_USERNAME": { 2024-09-11T23:34:37.859 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-11T23:34:37.859 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.859 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.859 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.859 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "admin", 2024-09-11T23:34:37.859 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.859 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.860 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.860 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.860 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.860 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.860 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.860 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.860 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-11T23:34:37.860 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-11T23:34:37.860 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.860 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.860 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.860 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.860 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.861 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.861 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.861 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.861 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.861 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.861 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.861 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.861 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-11T23:34:37.861 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-11T23:34:37.861 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.861 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.861 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.861 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.861 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.862 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.862 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.862 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.862 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.862 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.862 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.862 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.862 INFO:teuthology.orchestra.run.smithi037.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-11T23:34:37.862 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-11T23:34:37.862 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.862 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.862 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.862 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:37.863 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.863 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.863 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.863 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.863 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.863 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.863 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.863 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.863 INFO:teuthology.orchestra.run.smithi037.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-11T23:34:37.863 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-11T23:34:37.863 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.863 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.863 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.864 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.864 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.864 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.864 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.864 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.864 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.864 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.864 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.864 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.864 INFO:teuthology.orchestra.run.smithi037.stdout: "PROMETHEUS_API_HOST": { 2024-09-11T23:34:37.864 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-11T23:34:37.864 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.864 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.865 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.865 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.865 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.865 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.865 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.865 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.865 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.865 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.865 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.865 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.865 INFO:teuthology.orchestra.run.smithi037.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-11T23:34:37.865 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-11T23:34:37.865 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.866 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.866 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.866 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:37.866 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.866 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.866 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.866 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.866 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.866 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.866 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.866 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.866 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-11T23:34:37.867 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-11T23:34:37.867 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.867 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.867 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.867 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.867 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.867 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.867 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.867 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.867 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.867 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.867 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.867 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.868 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-11T23:34:37.868 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-11T23:34:37.868 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.868 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.868 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.868 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.868 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.868 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.868 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.868 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.868 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.868 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.868 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.869 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.869 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-11T23:34:37.869 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-11T23:34:37.869 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.869 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.869 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.869 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:37.869 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.869 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.869 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.869 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.869 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.869 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.870 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.870 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.870 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-11T23:34:37.870 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-11T23:34:37.870 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.870 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.870 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.870 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:37.870 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.870 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.870 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.870 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.870 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.871 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.871 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.871 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.871 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-11T23:34:37.871 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-11T23:34:37.871 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.871 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.871 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.871 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.871 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.871 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.871 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.871 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.872 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.872 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.872 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.872 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.872 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-11T23:34:37.872 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-11T23:34:37.872 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.872 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.872 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.872 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.872 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.872 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.872 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.873 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.873 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.873 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.873 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.873 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.873 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-11T23:34:37.873 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-11T23:34:37.873 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.873 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.873 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.873 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.873 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.873 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.873 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.874 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.874 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.874 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.874 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.874 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.874 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_ENABLED": { 2024-09-11T23:34:37.874 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-11T23:34:37.874 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.874 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.874 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.874 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:37.874 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.874 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.874 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.875 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.875 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.875 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.875 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.875 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.875 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-11T23:34:37.875 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-11T23:34:37.875 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.875 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.875 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.875 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-11T23:34:37.875 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.876 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.876 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.876 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.876 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.876 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.876 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.876 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.876 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-11T23:34:37.876 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-11T23:34:37.876 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:37.876 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.876 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.876 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-09-11T23:34:37.876 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.877 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.877 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.877 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.877 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.877 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.877 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.877 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.877 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-11T23:34:37.877 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-11T23:34:37.877 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:37.877 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.877 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.878 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "8", 2024-09-11T23:34:37.878 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.878 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.878 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.878 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.878 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.878 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.878 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.878 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.878 INFO:teuthology.orchestra.run.smithi037.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-11T23:34:37.878 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-11T23:34:37.878 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:37.878 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.878 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.879 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "45", 2024-09-11T23:34:37.879 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.879 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.879 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.879 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.879 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.879 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.879 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.879 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.879 INFO:teuthology.orchestra.run.smithi037.stdout: "RGW_API_ACCESS_KEY": { 2024-09-11T23:34:37.879 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-11T23:34:37.879 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.880 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.880 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.880 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.880 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.880 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.880 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.880 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.880 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.880 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.880 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.880 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.880 INFO:teuthology.orchestra.run.smithi037.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-11T23:34:37.880 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-11T23:34:37.881 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.881 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.881 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.881 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "admin", 2024-09-11T23:34:37.881 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.881 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.881 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.881 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.881 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.881 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.881 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.881 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.881 INFO:teuthology.orchestra.run.smithi037.stdout: "RGW_API_SECRET_KEY": { 2024-09-11T23:34:37.882 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-11T23:34:37.882 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.882 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.882 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.882 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.882 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.882 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.882 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.882 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.882 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.882 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.882 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.882 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.883 INFO:teuthology.orchestra.run.smithi037.stdout: "RGW_API_SSL_VERIFY": { 2024-09-11T23:34:37.883 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-11T23:34:37.883 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.883 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.883 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.883 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:37.883 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.883 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.883 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.883 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.883 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.883 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.883 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.884 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.884 INFO:teuthology.orchestra.run.smithi037.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-11T23:34:37.884 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-11T23:34:37.884 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:37.884 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.884 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.884 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-11T23:34:37.884 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.884 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.884 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.884 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.884 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.884 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.885 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.885 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.885 INFO:teuthology.orchestra.run.smithi037.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-11T23:34:37.885 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-11T23:34:37.885 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:37.885 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.885 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.885 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-09-11T23:34:37.885 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.885 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.885 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.885 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.885 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.885 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.886 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.886 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.886 INFO:teuthology.orchestra.run.smithi037.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-11T23:34:37.886 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-11T23:34:37.886 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:37.886 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.886 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.886 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5", 2024-09-11T23:34:37.886 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.886 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.886 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.886 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.886 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.887 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.887 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.887 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.887 INFO:teuthology.orchestra.run.smithi037.stdout: "cross_origin_url": { 2024-09-11T23:34:37.887 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cross_origin_url", 2024-09-11T23:34:37.887 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.887 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.887 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.887 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.887 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.887 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.887 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.888 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.888 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.888 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.888 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.888 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.888 INFO:teuthology.orchestra.run.smithi037.stdout: "crt_file": { 2024-09-11T23:34:37.888 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "crt_file", 2024-09-11T23:34:37.888 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.888 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.888 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.888 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.888 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.888 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.889 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.889 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.889 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.889 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.889 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.889 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.889 INFO:teuthology.orchestra.run.smithi037.stdout: "debug": { 2024-09-11T23:34:37.889 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "debug", 2024-09-11T23:34:37.889 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.889 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.889 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.889 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.889 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.890 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.890 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.890 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Enable/disable debug options", 2024-09-11T23:34:37.890 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.890 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.890 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.890 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.890 INFO:teuthology.orchestra.run.smithi037.stdout: "jwt_token_ttl": { 2024-09-11T23:34:37.890 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "jwt_token_ttl", 2024-09-11T23:34:37.890 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:37.890 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.890 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.890 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "28800", 2024-09-11T23:34:37.891 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.891 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.891 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.891 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.891 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.891 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.891 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.891 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.891 INFO:teuthology.orchestra.run.smithi037.stdout: "key_file": { 2024-09-11T23:34:37.891 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "key_file", 2024-09-11T23:34:37.891 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.891 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.891 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.891 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.892 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.892 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.892 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.892 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.892 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.892 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.892 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.892 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.892 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-11T23:34:37.892 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-11T23:34:37.892 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.892 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.893 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.893 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.893 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.893 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.893 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.893 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.893 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.893 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.893 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.893 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.893 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.893 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.893 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.894 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.894 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.894 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.894 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.894 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-11T23:34:37.894 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-11T23:34:37.894 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.894 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.894 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.894 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.894 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.894 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.894 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.895 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.895 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.895 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.895 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.895 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.895 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-11T23:34:37.895 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-11T23:34:37.895 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.895 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.895 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.895 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-11T23:34:37.895 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.895 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.895 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.896 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.896 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.896 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.896 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.896 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.896 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.896 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.896 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.896 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.896 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.896 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.896 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.896 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-11T23:34:37.897 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-11T23:34:37.897 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.897 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.897 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.897 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.897 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.897 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.897 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.897 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.897 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.897 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.897 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.898 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.898 INFO:teuthology.orchestra.run.smithi037.stdout: "motd": { 2024-09-11T23:34:37.898 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "motd", 2024-09-11T23:34:37.898 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.898 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.898 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.898 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.898 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.898 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.898 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.898 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "The message of the day", 2024-09-11T23:34:37.898 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.898 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.898 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.899 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.899 INFO:teuthology.orchestra.run.smithi037.stdout: "redirect_resolve_ip_addr": { 2024-09-11T23:34:37.899 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "redirect_resolve_ip_addr", 2024-09-11T23:34:37.899 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.899 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.899 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.899 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.899 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.899 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.899 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.899 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.899 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.899 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.900 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.900 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.900 INFO:teuthology.orchestra.run.smithi037.stdout: "server_addr": { 2024-09-11T23:34:37.900 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_addr", 2024-09-11T23:34:37.900 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.900 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.900 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.900 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "::", 2024-09-11T23:34:37.900 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.900 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.900 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.900 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.900 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.901 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.901 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.901 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.901 INFO:teuthology.orchestra.run.smithi037.stdout: "server_port": { 2024-09-11T23:34:37.901 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_port", 2024-09-11T23:34:37.901 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:37.901 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.901 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.901 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "8080", 2024-09-11T23:34:37.901 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.901 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.901 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.901 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.902 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.902 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.902 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.902 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.902 INFO:teuthology.orchestra.run.smithi037.stdout: "ssl": { 2024-09-11T23:34:37.902 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ssl", 2024-09-11T23:34:37.902 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.902 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.902 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.902 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:37.902 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.902 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.902 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.903 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.903 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.903 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.903 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.903 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.903 INFO:teuthology.orchestra.run.smithi037.stdout: "ssl_server_port": { 2024-09-11T23:34:37.903 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ssl_server_port", 2024-09-11T23:34:37.903 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:37.903 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.903 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.903 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "8443", 2024-09-11T23:34:37.903 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.903 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.904 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.904 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.904 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.904 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.904 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.904 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.904 INFO:teuthology.orchestra.run.smithi037.stdout: "standby_behaviour": { 2024-09-11T23:34:37.904 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "standby_behaviour", 2024-09-11T23:34:37.904 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.904 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.904 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.904 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "redirect", 2024-09-11T23:34:37.905 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.905 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.905 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.905 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.905 INFO:teuthology.orchestra.run.smithi037.stdout: "redirect" 2024-09-11T23:34:37.905 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.905 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.905 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.905 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.905 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.905 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.905 INFO:teuthology.orchestra.run.smithi037.stdout: "standby_error_status_code": { 2024-09-11T23:34:37.905 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "standby_error_status_code", 2024-09-11T23:34:37.905 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:37.906 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.906 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.906 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "500", 2024-09-11T23:34:37.906 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "400", 2024-09-11T23:34:37.906 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "599", 2024-09-11T23:34:37.906 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.906 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.906 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.906 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.906 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.906 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.906 INFO:teuthology.orchestra.run.smithi037.stdout: "url_prefix": { 2024-09-11T23:34:37.906 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "url_prefix", 2024-09-11T23:34:37.907 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.907 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.907 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.907 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.907 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.907 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.907 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.907 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.907 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.907 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.907 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.907 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.907 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.907 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.908 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:34:37.908 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "devicehealth", 2024-09-11T23:34:37.908 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-11T23:34:37.908 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-11T23:34:37.908 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-11T23:34:37.908 INFO:teuthology.orchestra.run.smithi037.stdout: "enable_monitoring": { 2024-09-11T23:34:37.908 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "enable_monitoring", 2024-09-11T23:34:37.908 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.908 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.908 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.908 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:37.908 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.908 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.909 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.909 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "monitor device health metrics", 2024-09-11T23:34:37.909 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.909 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.909 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.909 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.909 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-11T23:34:37.909 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-11T23:34:37.909 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.909 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.909 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.909 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.909 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.910 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.910 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.910 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.910 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.910 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.910 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.910 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.910 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.910 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.910 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.910 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.910 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.910 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.910 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.911 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-11T23:34:37.911 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-11T23:34:37.911 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.911 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.911 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.911 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.911 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.911 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.911 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.911 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.911 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.911 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.911 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.912 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.912 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-11T23:34:37.912 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-11T23:34:37.912 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.912 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.912 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.912 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-11T23:34:37.912 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.912 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.912 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.912 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.912 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.912 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.913 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.913 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.913 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.913 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.913 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.913 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.913 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.913 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.913 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.913 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-11T23:34:37.913 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-11T23:34:37.913 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.913 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.914 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.914 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.914 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.914 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.914 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.914 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.914 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.914 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.914 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.914 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.914 INFO:teuthology.orchestra.run.smithi037.stdout: "mark_out_threshold": { 2024-09-11T23:34:37.914 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mark_out_threshold", 2024-09-11T23:34:37.914 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-11T23:34:37.915 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.915 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.915 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "2419200", 2024-09-11T23:34:37.915 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.915 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.915 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.915 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-11T23:34:37.915 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.915 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.915 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.915 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.915 INFO:teuthology.orchestra.run.smithi037.stdout: "pool_name": { 2024-09-11T23:34:37.915 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "pool_name", 2024-09-11T23:34:37.916 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.916 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.916 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.916 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "device_health_metrics", 2024-09-11T23:34:37.916 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.916 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.916 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.916 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-11T23:34:37.916 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.916 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.916 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.916 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.917 INFO:teuthology.orchestra.run.smithi037.stdout: "retention_period": { 2024-09-11T23:34:37.917 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "retention_period", 2024-09-11T23:34:37.917 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-11T23:34:37.917 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.917 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.917 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "15552000", 2024-09-11T23:34:37.917 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.917 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.917 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.917 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how long to retain device health metrics", 2024-09-11T23:34:37.917 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.917 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.917 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.918 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.918 INFO:teuthology.orchestra.run.smithi037.stdout: "scrape_frequency": { 2024-09-11T23:34:37.918 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "scrape_frequency", 2024-09-11T23:34:37.918 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-11T23:34:37.918 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.918 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.918 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "86400", 2024-09-11T23:34:37.918 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.918 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.918 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.918 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-11T23:34:37.918 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.918 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.919 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.919 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.919 INFO:teuthology.orchestra.run.smithi037.stdout: "self_heal": { 2024-09-11T23:34:37.919 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "self_heal", 2024-09-11T23:34:37.919 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.919 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.919 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.919 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:37.919 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.919 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.919 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.919 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-11T23:34:37.919 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.919 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.920 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.920 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.920 INFO:teuthology.orchestra.run.smithi037.stdout: "sleep_interval": { 2024-09-11T23:34:37.920 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sleep_interval", 2024-09-11T23:34:37.920 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-11T23:34:37.920 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.920 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.920 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "600", 2024-09-11T23:34:37.920 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.920 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.920 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.920 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how frequently to wake up and check device health", 2024-09-11T23:34:37.920 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.921 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.921 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.921 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.921 INFO:teuthology.orchestra.run.smithi037.stdout: "warn_threshold": { 2024-09-11T23:34:37.921 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "warn_threshold", 2024-09-11T23:34:37.921 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-11T23:34:37.921 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.921 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.921 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "7257600", 2024-09-11T23:34:37.921 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.921 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.921 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.921 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-11T23:34:37.922 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.922 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.922 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.922 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.922 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.922 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.922 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:34:37.922 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "diskprediction_local", 2024-09-11T23:34:37.922 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-11T23:34:37.922 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-11T23:34:37.922 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-11T23:34:37.922 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-11T23:34:37.922 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-11T23:34:37.923 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.923 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.923 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.923 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.923 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.923 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.923 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.923 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.923 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.923 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.923 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.923 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.923 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.923 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.924 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.924 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.924 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.924 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.924 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.924 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-11T23:34:37.924 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-11T23:34:37.924 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.924 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.924 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.924 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.924 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.924 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.925 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.925 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.925 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.925 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.925 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.925 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.925 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-11T23:34:37.925 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-11T23:34:37.925 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.925 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.925 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.925 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-11T23:34:37.925 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.926 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.926 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.926 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.926 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.926 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.926 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.926 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.926 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.926 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.926 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.926 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.926 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.926 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.926 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.927 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-11T23:34:37.927 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-11T23:34:37.927 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.927 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.927 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.927 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.927 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.927 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.927 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.927 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.927 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.927 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.927 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.927 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.928 INFO:teuthology.orchestra.run.smithi037.stdout: "predict_interval": { 2024-09-11T23:34:37.928 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "predict_interval", 2024-09-11T23:34:37.928 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.928 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.928 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.928 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "86400", 2024-09-11T23:34:37.928 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.928 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.928 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.928 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.929 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.929 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.929 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.929 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.929 INFO:teuthology.orchestra.run.smithi037.stdout: "predictor_model": { 2024-09-11T23:34:37.929 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "predictor_model", 2024-09-11T23:34:37.929 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.929 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.929 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.929 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "prophetstor", 2024-09-11T23:34:37.929 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.929 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.929 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.930 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.930 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.930 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.930 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.930 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.930 INFO:teuthology.orchestra.run.smithi037.stdout: "sleep_interval": { 2024-09-11T23:34:37.930 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sleep_interval", 2024-09-11T23:34:37.930 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.930 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.930 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.930 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "600", 2024-09-11T23:34:37.930 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.930 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.930 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.931 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.931 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.931 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.931 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.931 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.931 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.931 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.931 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:34:37.931 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "influx", 2024-09-11T23:34:37.931 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": false, 2024-09-11T23:34:37.931 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "influxdb python module not found", 2024-09-11T23:34:37.931 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-11T23:34:37.931 INFO:teuthology.orchestra.run.smithi037.stdout: "batch_size": { 2024-09-11T23:34:37.932 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "batch_size", 2024-09-11T23:34:37.932 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:37.932 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.932 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.932 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5000", 2024-09-11T23:34:37.932 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.932 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.932 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.932 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-11T23:34:37.932 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.932 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.932 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.933 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.933 INFO:teuthology.orchestra.run.smithi037.stdout: "database": { 2024-09-11T23:34:37.933 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "database", 2024-09-11T23:34:37.933 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.933 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.933 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.933 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "ceph", 2024-09-11T23:34:37.933 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.933 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.933 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.933 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-11T23:34:37.933 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.933 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.934 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.934 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.934 INFO:teuthology.orchestra.run.smithi037.stdout: "hostname": { 2024-09-11T23:34:37.934 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "hostname", 2024-09-11T23:34:37.934 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.934 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.934 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.934 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.934 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.934 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.934 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.934 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "InfluxDB server hostname", 2024-09-11T23:34:37.934 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.935 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.935 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.935 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.935 INFO:teuthology.orchestra.run.smithi037.stdout: "interval": { 2024-09-11T23:34:37.935 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "interval", 2024-09-11T23:34:37.935 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-11T23:34:37.935 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.935 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.935 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "30", 2024-09-11T23:34:37.935 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "5", 2024-09-11T23:34:37.935 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.935 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.935 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-11T23:34:37.936 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.936 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.936 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.936 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.936 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-11T23:34:37.936 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-11T23:34:37.936 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.936 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.936 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.936 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.936 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.936 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.936 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.936 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.937 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.937 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.937 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.937 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.937 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.937 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.937 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.937 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.937 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.937 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.937 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.937 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-11T23:34:37.937 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-11T23:34:37.938 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.938 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.938 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.938 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.938 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.938 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.938 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.938 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.938 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.938 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.938 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.938 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.938 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-11T23:34:37.939 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-11T23:34:37.939 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.939 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.939 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.939 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-11T23:34:37.939 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.939 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.939 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.939 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.939 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.939 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.939 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.939 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.940 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.940 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.940 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.940 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.940 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.940 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.940 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.940 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-11T23:34:37.940 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-11T23:34:37.940 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.940 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.940 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.940 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.941 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.941 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.941 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.941 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.941 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.941 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.941 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.941 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.941 INFO:teuthology.orchestra.run.smithi037.stdout: "password": { 2024-09-11T23:34:37.941 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "password", 2024-09-11T23:34:37.941 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.941 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.941 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.942 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.942 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.942 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.942 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.942 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "password of InfluxDB server user", 2024-09-11T23:34:37.942 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.942 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.942 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.942 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.942 INFO:teuthology.orchestra.run.smithi037.stdout: "port": { 2024-09-11T23:34:37.942 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "port", 2024-09-11T23:34:37.942 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:37.942 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.943 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.943 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "8086", 2024-09-11T23:34:37.943 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.943 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.943 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.943 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "InfluxDB server port", 2024-09-11T23:34:37.943 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.943 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.943 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.943 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.943 INFO:teuthology.orchestra.run.smithi037.stdout: "ssl": { 2024-09-11T23:34:37.943 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ssl", 2024-09-11T23:34:37.943 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.944 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.944 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.944 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "false", 2024-09-11T23:34:37.944 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.944 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.944 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.944 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-11T23:34:37.944 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.944 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.944 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.944 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.944 INFO:teuthology.orchestra.run.smithi037.stdout: "threads": { 2024-09-11T23:34:37.944 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "threads", 2024-09-11T23:34:37.945 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:37.945 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.945 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.945 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5", 2024-09-11T23:34:37.945 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "1", 2024-09-11T23:34:37.945 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "32", 2024-09-11T23:34:37.945 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.945 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-11T23:34:37.945 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.945 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.945 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.945 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.945 INFO:teuthology.orchestra.run.smithi037.stdout: "username": { 2024-09-11T23:34:37.946 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "username", 2024-09-11T23:34:37.946 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.946 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.946 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.946 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.946 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.946 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.946 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.946 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "username of InfluxDB server user", 2024-09-11T23:34:37.946 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.946 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.946 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.946 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.947 INFO:teuthology.orchestra.run.smithi037.stdout: "verify_ssl": { 2024-09-11T23:34:37.947 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "verify_ssl", 2024-09-11T23:34:37.947 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.947 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.947 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.947 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "true", 2024-09-11T23:34:37.947 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.947 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.947 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.947 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-11T23:34:37.947 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.947 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.947 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.948 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.948 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.948 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.948 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:34:37.948 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "insights", 2024-09-11T23:34:37.948 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-11T23:34:37.948 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-11T23:34:37.948 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-11T23:34:37.948 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-11T23:34:37.948 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-11T23:34:37.948 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.948 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.948 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.949 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.949 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.949 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.949 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.949 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.949 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.949 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.949 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.949 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.949 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.949 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.949 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.949 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.950 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.950 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.950 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.950 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-11T23:34:37.950 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-11T23:34:37.950 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.950 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.950 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.950 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.950 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.950 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.950 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.950 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.950 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.951 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.951 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.951 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.951 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-11T23:34:37.951 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-11T23:34:37.951 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.951 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.951 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.951 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-11T23:34:37.951 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.951 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.951 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.952 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.952 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.952 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.952 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.952 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.952 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.952 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.952 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.952 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.952 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.952 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.952 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.953 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-11T23:34:37.953 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-11T23:34:37.953 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.953 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.953 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.953 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.953 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.953 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.953 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.953 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.953 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.953 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.953 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.953 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.954 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.954 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.954 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:34:37.954 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "iostat", 2024-09-11T23:34:37.954 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-11T23:34:37.954 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-11T23:34:37.954 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-11T23:34:37.954 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-11T23:34:37.954 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-11T23:34:37.954 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.954 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.954 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.954 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.955 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.955 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.955 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.955 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.955 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.955 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.955 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.955 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.955 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.955 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.955 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.955 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.955 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.956 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.956 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.956 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-11T23:34:37.956 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-11T23:34:37.956 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.956 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.956 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.956 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.956 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.956 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.956 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.956 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.956 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.957 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.957 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.957 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.957 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-11T23:34:37.957 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-11T23:34:37.957 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.957 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.957 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.957 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-11T23:34:37.957 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.957 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.957 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.957 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.957 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.958 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.958 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.958 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.958 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.958 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.958 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.958 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.958 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.958 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.958 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.958 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-11T23:34:37.958 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-11T23:34:37.958 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.959 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.959 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.959 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.959 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.959 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.959 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.959 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.959 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.959 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.959 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.959 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.959 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.959 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.959 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:34:37.960 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "k8sevents", 2024-09-11T23:34:37.960 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-11T23:34:37.960 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-11T23:34:37.960 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-11T23:34:37.960 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_event_retention_days": { 2024-09-11T23:34:37.960 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ceph_event_retention_days", 2024-09-11T23:34:37.960 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:37.960 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.960 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.960 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "7", 2024-09-11T23:34:37.960 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.960 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.960 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.961 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-11T23:34:37.961 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.961 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.961 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.961 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.961 INFO:teuthology.orchestra.run.smithi037.stdout: "config_check_secs": { 2024-09-11T23:34:37.961 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "config_check_secs", 2024-09-11T23:34:37.961 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:37.961 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.961 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.961 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-09-11T23:34:37.961 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "10", 2024-09-11T23:34:37.961 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.962 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.962 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-11T23:34:37.962 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.962 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.962 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.962 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.962 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-11T23:34:37.962 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-11T23:34:37.962 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.962 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.962 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.962 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.962 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.963 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.963 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.963 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.963 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.963 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.963 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.963 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.963 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.963 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.963 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.963 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.963 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.963 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.963 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.964 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-11T23:34:37.964 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-11T23:34:37.964 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.964 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.964 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.964 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.964 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.964 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.964 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.964 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.964 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.964 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.964 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.965 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.965 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-11T23:34:37.965 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-11T23:34:37.965 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.965 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.965 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.965 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-11T23:34:37.965 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.965 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.965 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.965 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.965 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.966 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.966 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.966 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.966 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.966 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.966 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.966 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.966 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.966 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.966 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.966 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-11T23:34:37.966 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-11T23:34:37.966 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.967 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.967 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.967 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.967 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.967 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.967 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.967 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.967 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.967 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.967 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.967 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.967 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.967 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.967 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:34:37.968 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "localpool", 2024-09-11T23:34:37.968 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-11T23:34:37.968 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-11T23:34:37.968 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-11T23:34:37.968 INFO:teuthology.orchestra.run.smithi037.stdout: "failure_domain": { 2024-09-11T23:34:37.968 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "failure_domain", 2024-09-11T23:34:37.968 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.968 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.968 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.968 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "host", 2024-09-11T23:34:37.968 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.968 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.968 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.969 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "failure domain for any created local pool", 2024-09-11T23:34:37.969 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-11T23:34:37.969 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.969 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.969 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.969 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-11T23:34:37.969 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-11T23:34:37.969 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.969 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.969 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.969 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.969 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.970 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.970 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.970 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.970 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.970 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.970 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.970 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.970 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.970 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.970 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.970 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.970 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.970 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.971 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.971 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-11T23:34:37.971 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-11T23:34:37.971 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.971 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.971 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.971 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.971 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.971 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.971 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.971 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.971 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.971 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.971 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.972 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.972 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-11T23:34:37.972 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-11T23:34:37.972 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.972 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.972 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.972 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-11T23:34:37.972 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.972 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.972 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.972 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.972 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.973 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.973 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.973 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.973 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.973 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.973 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.973 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.973 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.973 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.973 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.973 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-11T23:34:37.973 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-11T23:34:37.974 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.974 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.974 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.974 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.974 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.974 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.974 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.974 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.974 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.974 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.974 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.974 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.975 INFO:teuthology.orchestra.run.smithi037.stdout: "min_size": { 2024-09-11T23:34:37.975 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "min_size", 2024-09-11T23:34:37.975 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:37.975 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.975 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.975 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.975 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.975 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.975 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.975 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "default min_size for any created local pool", 2024-09-11T23:34:37.975 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-11T23:34:37.975 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.975 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.976 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.976 INFO:teuthology.orchestra.run.smithi037.stdout: "num_rep": { 2024-09-11T23:34:37.976 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "num_rep", 2024-09-11T23:34:37.976 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:37.976 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.976 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.976 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "3", 2024-09-11T23:34:37.976 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.976 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.976 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.976 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "default replica count for any created local pool", 2024-09-11T23:34:37.976 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.976 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.977 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.977 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.977 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_num": { 2024-09-11T23:34:37.977 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "pg_num", 2024-09-11T23:34:37.977 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:37.977 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.977 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.977 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "128", 2024-09-11T23:34:37.977 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.977 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.977 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.977 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "default pg_num for any created local pool", 2024-09-11T23:34:37.977 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.978 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.978 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.978 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.978 INFO:teuthology.orchestra.run.smithi037.stdout: "prefix": { 2024-09-11T23:34:37.978 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "prefix", 2024-09-11T23:34:37.978 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.978 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.978 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.978 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.978 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.978 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.978 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.978 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "name prefix for any created local pool", 2024-09-11T23:34:37.978 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.979 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.979 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.979 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.979 INFO:teuthology.orchestra.run.smithi037.stdout: "subtree": { 2024-09-11T23:34:37.979 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "subtree", 2024-09-11T23:34:37.979 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.979 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.979 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.979 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "rack", 2024-09-11T23:34:37.979 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.979 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.979 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.979 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-11T23:34:37.980 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-11T23:34:37.980 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.980 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.980 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.980 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.980 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.980 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:34:37.980 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mds_autoscaler", 2024-09-11T23:34:37.980 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-11T23:34:37.980 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-11T23:34:37.980 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-11T23:34:37.980 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-11T23:34:37.980 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-11T23:34:37.980 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.981 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.981 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.981 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.981 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.981 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.981 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.981 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.981 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.981 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.981 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.981 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.982 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.982 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.982 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.982 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.982 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.982 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.982 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.982 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-11T23:34:37.982 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-11T23:34:37.982 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.982 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.982 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.982 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.982 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.983 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.983 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.983 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.983 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.983 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.983 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.983 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.983 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-11T23:34:37.983 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-11T23:34:37.983 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.983 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.983 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.984 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-11T23:34:37.984 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.984 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.984 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.984 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.984 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.984 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.984 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.984 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.984 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.984 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.984 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.984 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.985 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.985 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.985 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.985 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-11T23:34:37.985 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-11T23:34:37.985 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.985 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.985 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.985 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.985 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.985 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.985 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.985 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.985 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.986 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.986 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.986 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.986 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.986 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.986 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:34:37.986 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mirroring", 2024-09-11T23:34:37.986 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-11T23:34:37.986 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-11T23:34:37.986 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-11T23:34:37.986 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-11T23:34:37.986 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-11T23:34:37.986 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.987 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.987 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.987 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.987 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.987 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.987 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.987 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.987 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.987 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.987 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.987 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.987 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.987 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.988 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.988 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.988 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.988 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.988 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.988 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-11T23:34:37.988 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-11T23:34:37.988 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.988 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.988 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.988 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.988 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.988 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.989 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.989 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.989 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.989 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.989 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.989 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.989 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-11T23:34:37.989 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-11T23:34:37.989 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.989 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.989 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.989 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-11T23:34:37.989 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.990 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.990 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.990 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.990 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.990 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.990 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.990 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.990 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.990 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.990 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.990 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.991 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.991 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.991 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.991 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-11T23:34:37.991 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-11T23:34:37.991 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.991 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.991 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.991 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.991 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.991 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.991 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.991 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.991 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.992 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.992 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.992 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.992 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.992 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.992 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:34:37.992 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "nfs", 2024-09-11T23:34:37.992 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-11T23:34:37.992 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-11T23:34:37.992 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-11T23:34:37.992 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-11T23:34:37.992 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-11T23:34:37.992 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.993 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.993 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.993 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:37.993 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.993 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.993 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.993 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.993 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.993 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.993 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.993 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.993 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.993 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.994 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.994 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.994 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.994 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.994 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.994 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-11T23:34:37.994 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-11T23:34:37.994 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.994 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.994 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.994 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.994 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.994 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.995 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.995 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.995 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.995 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.995 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.995 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.995 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-11T23:34:37.995 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-11T23:34:37.995 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.995 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.995 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.995 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-11T23:34:37.995 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.995 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.996 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:37.996 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:37.996 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:37.996 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:37.996 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:37.996 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:37.996 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:37.996 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:37.996 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.996 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.996 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.996 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.996 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.997 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-11T23:34:37.997 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-11T23:34:37.997 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.997 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.997 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:37.997 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.997 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.997 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.997 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.997 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:37.997 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.997 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.998 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.998 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.998 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:37.998 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.998 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:34:37.998 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "orchestrator", 2024-09-11T23:34:37.998 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-11T23:34:37.998 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-11T23:34:37.998 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-11T23:34:37.998 INFO:teuthology.orchestra.run.smithi037.stdout: "fail_fs": { 2024-09-11T23:34:37.998 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "fail_fs", 2024-09-11T23:34:37.998 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:37.998 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.998 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:37.999 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:37.999 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:37.999 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:37.999 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:37.999 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-11T23:34:37.999 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:37.999 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:37.999 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:37.999 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:37.999 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-11T23:34:37.999 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-11T23:34:37.999 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:37.999 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:37.999 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:38.000 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:38.000 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.000 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.000 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:38.000 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:38.000 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:38.000 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:38.000 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:38.000 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:38.000 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:38.000 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:38.000 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.001 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.001 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.001 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.001 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.001 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-11T23:34:38.001 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-11T23:34:38.001 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:38.001 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.001 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:38.001 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:38.001 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.001 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.001 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:38.002 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.002 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.002 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.002 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.002 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.002 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-11T23:34:38.002 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-11T23:34:38.002 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:38.002 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.002 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:38.002 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-11T23:34:38.002 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.002 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.003 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:38.003 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:38.003 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:38.003 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:38.003 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:38.003 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:38.003 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:38.003 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:38.003 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.003 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.003 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.003 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.003 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.003 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-11T23:34:38.004 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-11T23:34:38.004 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:38.004 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.004 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:38.004 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:38.004 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.004 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.004 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:38.004 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.004 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.004 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.004 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.004 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.005 INFO:teuthology.orchestra.run.smithi037.stdout: "orchestrator": { 2024-09-11T23:34:38.005 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "orchestrator", 2024-09-11T23:34:38.005 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:38.005 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.005 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:38.005 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:38.005 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.005 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.005 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:38.005 INFO:teuthology.orchestra.run.smithi037.stdout: "cephadm", 2024-09-11T23:34:38.005 INFO:teuthology.orchestra.run.smithi037.stdout: "rook", 2024-09-11T23:34:38.005 INFO:teuthology.orchestra.run.smithi037.stdout: "test_orchestrator" 2024-09-11T23:34:38.006 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:38.006 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Orchestrator backend", 2024-09-11T23:34:38.006 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.006 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.006 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.006 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:38.006 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:38.006 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.006 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:34:38.006 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "osd_perf_query", 2024-09-11T23:34:38.006 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-11T23:34:38.006 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-11T23:34:38.006 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-11T23:34:38.006 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-11T23:34:38.007 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-11T23:34:38.007 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:38.007 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.007 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:38.007 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:38.007 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.007 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.007 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:38.007 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:38.007 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:38.007 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:38.007 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:38.008 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:38.008 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:38.008 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:38.008 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.008 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.008 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.008 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.008 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.008 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-11T23:34:38.008 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-11T23:34:38.008 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:38.008 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.008 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:38.009 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:38.009 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.009 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.009 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:38.009 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.009 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.009 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.009 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.009 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.009 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-11T23:34:38.009 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-11T23:34:38.009 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:38.009 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.010 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:38.010 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-11T23:34:38.010 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.010 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.010 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:38.010 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:38.010 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:38.010 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:38.010 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:38.010 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:38.010 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:38.010 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:38.010 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.011 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.011 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.011 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.011 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.011 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-11T23:34:38.011 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-11T23:34:38.011 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:38.011 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.011 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:38.011 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:38.011 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.011 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.011 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:38.011 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.012 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.012 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.012 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.012 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:38.012 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:38.012 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.012 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:34:38.012 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "osd_support", 2024-09-11T23:34:38.012 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-11T23:34:38.012 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-11T23:34:38.012 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-11T23:34:38.012 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-11T23:34:38.013 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-11T23:34:38.013 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:38.013 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.013 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:38.013 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:38.013 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.013 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.013 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:38.013 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:38.013 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:38.013 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:38.013 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:38.013 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:38.014 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:38.014 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:38.014 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.014 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.014 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.014 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.014 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.014 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-11T23:34:38.014 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-11T23:34:38.014 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:38.014 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.014 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:38.014 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:38.015 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.015 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.015 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:38.015 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.015 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.015 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.015 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.015 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.015 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-11T23:34:38.015 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-11T23:34:38.015 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:38.015 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.015 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:38.015 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-11T23:34:38.016 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.016 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.016 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:38.016 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:38.016 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:38.016 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:38.016 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:38.016 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:38.016 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:38.016 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:38.016 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.016 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.016 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.017 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.017 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.017 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-11T23:34:38.017 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-11T23:34:38.017 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:38.017 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.017 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:38.017 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:38.017 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.017 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.017 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:38.017 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.017 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.017 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.018 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.018 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:38.018 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:38.018 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.018 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:34:38.018 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "pg_autoscaler", 2024-09-11T23:34:38.018 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-11T23:34:38.018 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-11T23:34:38.018 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-11T23:34:38.018 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-11T23:34:38.018 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-11T23:34:38.018 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:38.018 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.018 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:38.019 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:38.019 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.019 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.019 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:38.019 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:38.019 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:38.019 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:38.019 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:38.019 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:38.019 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:38.019 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:38.019 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.019 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.020 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.020 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.020 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.020 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-11T23:34:38.020 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-11T23:34:38.020 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:38.020 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.020 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:38.020 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:38.020 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.020 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.020 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:38.021 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.021 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.021 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.021 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.021 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.021 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-11T23:34:38.021 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-11T23:34:38.021 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:38.021 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.021 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:38.021 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-11T23:34:38.021 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.021 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.022 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:38.022 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:38.022 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:38.022 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:38.022 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:38.022 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:38.022 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:38.022 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:38.022 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.022 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.022 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.022 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.022 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.023 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-11T23:34:38.023 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-11T23:34:38.023 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:38.023 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.023 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:38.023 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:38.023 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.023 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.023 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:38.023 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.023 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.023 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.023 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.024 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.024 INFO:teuthology.orchestra.run.smithi037.stdout: "sleep_interval": { 2024-09-11T23:34:38.024 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sleep_interval", 2024-09-11T23:34:38.024 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-11T23:34:38.024 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.024 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:38.024 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "60", 2024-09-11T23:34:38.024 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.024 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.024 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:38.024 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.024 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.024 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.025 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.025 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.025 INFO:teuthology.orchestra.run.smithi037.stdout: "threshold": { 2024-09-11T23:34:38.025 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "threshold", 2024-09-11T23:34:38.025 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-09-11T23:34:38.025 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.025 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:38.025 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "3.0", 2024-09-11T23:34:38.025 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "1.0", 2024-09-11T23:34:38.025 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.025 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:38.025 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "scaling threshold", 2024-09-11T23:34:38.025 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-11T23:34:38.026 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.026 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.026 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:38.026 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:38.026 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.026 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:34:38.026 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "progress", 2024-09-11T23:34:38.026 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-11T23:34:38.026 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-11T23:34:38.026 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-11T23:34:38.026 INFO:teuthology.orchestra.run.smithi037.stdout: "allow_pg_recovery_event": { 2024-09-11T23:34:38.026 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "allow_pg_recovery_event", 2024-09-11T23:34:38.026 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:38.027 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.027 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:38.027 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:38.027 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.027 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.027 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:38.027 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-11T23:34:38.027 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.027 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.027 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.027 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.027 INFO:teuthology.orchestra.run.smithi037.stdout: "enabled": { 2024-09-11T23:34:38.027 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "enabled", 2024-09-11T23:34:38.027 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:38.028 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.028 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:38.028 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:38.028 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.028 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.028 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:38.028 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.028 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.028 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.028 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.028 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.028 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-11T23:34:38.028 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-11T23:34:38.029 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:38.029 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.029 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:38.029 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:38.029 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.029 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.029 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:38.029 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:38.029 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:38.029 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:38.029 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:38.029 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:38.029 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:38.030 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:38.030 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.030 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.030 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.030 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.030 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.030 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-11T23:34:38.030 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-11T23:34:38.030 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:38.030 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.030 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:38.030 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:38.030 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.031 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.031 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:38.031 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.031 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.031 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.031 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.031 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.031 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-11T23:34:38.031 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-11T23:34:38.031 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:38.031 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.031 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:38.032 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-11T23:34:38.032 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.032 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.032 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:38.032 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:38.032 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:38.032 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:38.032 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:38.032 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:38.032 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:38.032 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:38.032 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.032 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.033 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.033 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.033 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.033 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-11T23:34:38.033 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-11T23:34:38.033 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:38.033 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.033 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:38.033 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:38.033 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.033 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.033 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:38.033 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.034 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.034 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.034 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.034 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.034 INFO:teuthology.orchestra.run.smithi037.stdout: "max_completed_events": { 2024-09-11T23:34:38.034 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "max_completed_events", 2024-09-11T23:34:38.034 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:38.034 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.034 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:38.034 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "50", 2024-09-11T23:34:38.034 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.034 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.034 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:38.035 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "number of past completed events to remember", 2024-09-11T23:34:38.035 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.035 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.035 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.035 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.035 INFO:teuthology.orchestra.run.smithi037.stdout: "sleep_interval": { 2024-09-11T23:34:38.035 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sleep_interval", 2024-09-11T23:34:38.035 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-11T23:34:38.035 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.035 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:38.035 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5", 2024-09-11T23:34:38.035 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.035 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.036 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:38.036 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how long the module is going to sleep", 2024-09-11T23:34:38.036 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.036 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.036 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.036 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:38.036 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:38.036 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.036 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:34:38.036 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "prometheus", 2024-09-11T23:34:38.036 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-11T23:34:38.036 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-11T23:34:38.036 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-11T23:34:38.036 INFO:teuthology.orchestra.run.smithi037.stdout: "cache": { 2024-09-11T23:34:38.037 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cache", 2024-09-11T23:34:38.037 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:38.037 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.037 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:38.037 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:38.037 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.037 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.037 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:38.037 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.037 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.037 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.037 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.038 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.038 INFO:teuthology.orchestra.run.smithi037.stdout: "exclude_perf_counters": { 2024-09-11T23:34:38.038 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "exclude_perf_counters", 2024-09-11T23:34:38.038 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:38.038 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.038 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:38.038 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:38.038 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.038 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.038 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:38.038 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-11T23:34:38.038 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-11T23:34:38.038 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.039 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.039 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.039 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-11T23:34:38.039 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-11T23:34:38.039 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:38.039 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.039 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:38.039 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:38.039 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.039 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.039 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:38.039 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:38.039 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:38.040 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:38.040 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:38.040 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:38.040 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:38.040 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:38.040 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.040 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.040 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.040 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.040 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.040 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-11T23:34:38.040 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-11T23:34:38.040 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:38.041 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.041 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:38.041 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:38.041 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.041 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.041 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:38.041 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.041 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.041 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.041 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.041 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.041 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-11T23:34:38.041 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-11T23:34:38.042 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:38.042 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.042 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:38.042 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-11T23:34:38.042 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.042 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.042 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:38.042 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:38.042 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:38.042 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:38.042 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:38.042 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:38.042 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:38.042 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:38.043 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.043 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.043 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.043 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.043 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.043 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-11T23:34:38.043 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-11T23:34:38.043 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:38.043 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.043 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:38.043 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:38.043 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.043 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.044 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:38.044 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.044 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.044 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.044 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.044 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.044 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_stats_pools": { 2024-09-11T23:34:38.044 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rbd_stats_pools", 2024-09-11T23:34:38.044 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:38.044 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.044 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:38.044 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:38.045 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.045 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.045 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:38.045 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.045 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.045 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.045 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.045 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.045 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-11T23:34:38.045 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-11T23:34:38.045 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:38.045 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.045 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:38.046 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "300", 2024-09-11T23:34:38.046 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.046 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.046 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:38.046 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.046 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.046 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.046 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.046 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.046 INFO:teuthology.orchestra.run.smithi037.stdout: "scrape_interval": { 2024-09-11T23:34:38.046 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "scrape_interval", 2024-09-11T23:34:38.046 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-09-11T23:34:38.046 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.047 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:38.047 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "15.0", 2024-09-11T23:34:38.047 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.047 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.047 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:38.047 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.047 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.047 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.047 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.047 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.047 INFO:teuthology.orchestra.run.smithi037.stdout: "server_addr": { 2024-09-11T23:34:38.047 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_addr", 2024-09-11T23:34:38.048 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:38.048 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.048 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:38.048 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "::", 2024-09-11T23:34:38.048 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.048 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.048 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:38.048 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-11T23:34:38.048 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.048 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.048 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.048 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.048 INFO:teuthology.orchestra.run.smithi037.stdout: "server_port": { 2024-09-11T23:34:38.049 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_port", 2024-09-11T23:34:38.049 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:38.049 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.049 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:38.049 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "9283", 2024-09-11T23:34:38.049 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.049 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.049 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:38.049 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-11T23:34:38.049 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.049 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.049 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.049 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.050 INFO:teuthology.orchestra.run.smithi037.stdout: "stale_cache_strategy": { 2024-09-11T23:34:38.050 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "stale_cache_strategy", 2024-09-11T23:34:38.050 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:38.050 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.050 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:38.050 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "log", 2024-09-11T23:34:38.050 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.050 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.050 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:38.050 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.050 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.050 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.050 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.050 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.051 INFO:teuthology.orchestra.run.smithi037.stdout: "standby_behaviour": { 2024-09-11T23:34:38.051 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "standby_behaviour", 2024-09-11T23:34:38.051 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:38.051 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.051 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:38.051 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "default", 2024-09-11T23:34:38.051 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.051 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.051 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:38.051 INFO:teuthology.orchestra.run.smithi037.stdout: "default", 2024-09-11T23:34:38.051 INFO:teuthology.orchestra.run.smithi037.stdout: "error" 2024-09-11T23:34:38.051 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:38.051 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.051 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.052 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.052 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.052 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.052 INFO:teuthology.orchestra.run.smithi037.stdout: "standby_error_status_code": { 2024-09-11T23:34:38.052 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "standby_error_status_code", 2024-09-11T23:34:38.052 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:38.052 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.052 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:38.052 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "500", 2024-09-11T23:34:38.052 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "400", 2024-09-11T23:34:38.052 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "599", 2024-09-11T23:34:38.052 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:38.052 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.053 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.053 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.053 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.053 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:38.053 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:38.053 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.053 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:34:38.053 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rbd_support", 2024-09-11T23:34:38.053 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-11T23:34:38.053 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-11T23:34:38.053 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-11T23:34:38.053 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-11T23:34:38.053 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-11T23:34:38.054 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:38.054 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.054 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:38.054 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:38.054 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.054 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.054 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:38.054 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:38.054 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:38.054 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:38.054 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:38.054 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:38.054 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:38.055 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:38.055 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.055 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.055 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.055 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.055 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.055 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-11T23:34:38.055 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-11T23:34:38.055 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:38.055 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.055 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:38.055 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:38.055 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.056 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.056 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:38.056 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.056 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.056 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.056 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.056 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.056 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-11T23:34:38.056 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-11T23:34:38.056 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:38.056 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.056 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:38.057 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-11T23:34:38.057 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.057 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.057 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:38.057 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:38.057 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:38.057 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:38.057 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:38.057 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:38.057 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:38.057 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:38.057 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.057 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.058 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.058 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.058 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.058 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-11T23:34:38.058 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-11T23:34:38.058 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:38.058 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.058 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:38.058 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:38.058 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.058 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.058 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:38.058 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.059 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.059 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.059 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.059 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.059 INFO:teuthology.orchestra.run.smithi037.stdout: "max_concurrent_snap_create": { 2024-09-11T23:34:38.059 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "max_concurrent_snap_create", 2024-09-11T23:34:38.059 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:38.059 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.059 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:38.059 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-09-11T23:34:38.059 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.059 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.059 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:38.060 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.060 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.060 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.060 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.060 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.060 INFO:teuthology.orchestra.run.smithi037.stdout: "mirror_snapshot_schedule": { 2024-09-11T23:34:38.060 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mirror_snapshot_schedule", 2024-09-11T23:34:38.060 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:38.060 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.060 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:38.060 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:38.060 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.060 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.061 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:38.061 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.061 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.061 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.061 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.061 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.061 INFO:teuthology.orchestra.run.smithi037.stdout: "trash_purge_schedule": { 2024-09-11T23:34:38.061 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "trash_purge_schedule", 2024-09-11T23:34:38.061 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:38.061 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.061 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:38.061 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:38.061 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.062 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.062 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:38.062 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.062 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.062 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.062 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.062 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:38.062 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:38.062 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.062 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:34:38.062 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "restful", 2024-09-11T23:34:38.062 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-11T23:34:38.062 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-11T23:34:38.063 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-11T23:34:38.063 INFO:teuthology.orchestra.run.smithi037.stdout: "enable_auth": { 2024-09-11T23:34:38.063 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "enable_auth", 2024-09-11T23:34:38.063 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:38.063 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.063 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:38.063 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:38.063 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.063 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.063 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:38.063 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.063 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.063 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.063 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.064 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.064 INFO:teuthology.orchestra.run.smithi037.stdout: "key_file": { 2024-09-11T23:34:38.064 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "key_file", 2024-09-11T23:34:38.064 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:38.064 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.064 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:38.064 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:38.064 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.064 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.064 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:38.064 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.064 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.064 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.065 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.065 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.065 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-11T23:34:38.065 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-11T23:34:38.065 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:38.065 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.065 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:38.065 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:38.065 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.065 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.065 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:38.065 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:38.065 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:38.065 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:38.066 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:38.066 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:38.066 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:38.066 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:38.066 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.066 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.066 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.066 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.066 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.066 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-11T23:34:38.066 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-11T23:34:38.066 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:38.066 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.067 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:38.067 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:38.067 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.067 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.067 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:38.067 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.067 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.067 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.067 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.067 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.067 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-11T23:34:38.067 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-11T23:34:38.067 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:38.068 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.068 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:38.068 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-11T23:34:38.068 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.068 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.068 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:38.068 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:38.068 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:38.068 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:38.068 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:38.068 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:38.068 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:38.068 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:38.069 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.069 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.069 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.069 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.069 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.069 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-11T23:34:38.069 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-11T23:34:38.069 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:38.069 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.069 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:38.069 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:38.069 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.069 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.069 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:38.070 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.070 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.070 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.070 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.070 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.070 INFO:teuthology.orchestra.run.smithi037.stdout: "server_addr": { 2024-09-11T23:34:38.070 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_addr", 2024-09-11T23:34:38.070 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:38.070 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.070 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:38.070 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:38.070 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.070 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.071 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:38.071 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.071 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.071 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.071 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.071 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.071 INFO:teuthology.orchestra.run.smithi037.stdout: "server_port": { 2024-09-11T23:34:38.071 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_port", 2024-09-11T23:34:38.071 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:38.071 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.071 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:38.071 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:38.071 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.072 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.072 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:38.072 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.072 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.072 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.072 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.072 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:38.072 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:38.072 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.072 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:34:38.072 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rgw", 2024-09-11T23:34:38.072 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-11T23:34:38.072 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-11T23:34:38.073 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-11T23:34:38.073 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-11T23:34:38.073 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-11T23:34:38.073 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:38.073 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.073 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:38.073 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:38.073 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.073 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.073 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:38.073 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:38.073 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:38.073 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:38.074 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:38.074 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:38.074 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:38.074 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:38.074 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.074 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.074 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.074 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.074 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.074 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-11T23:34:38.074 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-11T23:34:38.074 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:38.074 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.075 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:38.075 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:38.075 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.075 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.075 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:38.075 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.075 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.075 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.075 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.075 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.075 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-11T23:34:38.075 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-11T23:34:38.075 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:38.075 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.076 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:38.076 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-11T23:34:38.076 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.076 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.076 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:38.076 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:38.076 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:38.076 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:38.076 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:38.076 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:38.076 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:38.076 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:38.076 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.077 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.077 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.077 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.077 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.077 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-11T23:34:38.077 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-11T23:34:38.077 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:38.077 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.077 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:38.077 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:38.077 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.077 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.078 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:38.078 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.078 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.078 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.078 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.078 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:38.078 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:38.078 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.078 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:34:38.078 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rook", 2024-09-11T23:34:38.078 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-11T23:34:38.078 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-11T23:34:38.078 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-11T23:34:38.078 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-11T23:34:38.079 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-11T23:34:38.079 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:38.079 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.079 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:38.079 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:38.079 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.079 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.079 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:38.079 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:38.079 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:38.079 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:38.079 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:38.079 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:38.080 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:38.080 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:38.080 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.080 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.080 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.080 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.080 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.080 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-11T23:34:38.080 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-11T23:34:38.080 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:38.080 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.080 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:38.081 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:38.081 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.081 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.081 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:38.081 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.081 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.081 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.081 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.081 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.081 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-11T23:34:38.081 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-11T23:34:38.081 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:38.081 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.082 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:38.082 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-11T23:34:38.082 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.082 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.082 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:38.082 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:38.082 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:38.082 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:38.082 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:38.082 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:38.082 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:38.082 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:38.082 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.083 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.083 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.083 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.083 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.083 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-11T23:34:38.083 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-11T23:34:38.083 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:38.083 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.083 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:38.083 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:38.083 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.083 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.084 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:38.084 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.084 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.084 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.084 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.084 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.084 INFO:teuthology.orchestra.run.smithi037.stdout: "storage_class": { 2024-09-11T23:34:38.084 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "storage_class", 2024-09-11T23:34:38.084 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:38.084 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.084 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:38.084 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "local", 2024-09-11T23:34:38.084 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.085 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.085 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:38.085 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-11T23:34:38.085 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.085 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.085 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.085 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:38.085 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:38.085 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.085 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:34:38.085 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "selftest", 2024-09-11T23:34:38.085 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-11T23:34:38.085 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-11T23:34:38.086 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-11T23:34:38.086 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-11T23:34:38.086 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-11T23:34:38.086 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:38.086 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.086 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:38.086 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:38.086 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.086 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.086 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:38.086 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:38.086 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:38.086 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:38.086 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:38.087 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:38.087 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:38.087 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:38.087 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.087 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.087 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.087 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.087 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.087 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-11T23:34:38.087 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-11T23:34:38.087 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:38.087 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.087 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:38.088 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:38.088 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.088 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.088 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:38.088 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.088 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.088 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.088 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.088 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.088 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-11T23:34:38.088 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-11T23:34:38.088 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:38.088 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.089 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:38.089 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-11T23:34:38.089 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.089 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.089 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:38.089 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:38.089 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:38.089 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:38.089 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:38.089 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:38.089 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:38.089 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:38.089 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.089 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.090 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.090 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.090 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.090 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-11T23:34:38.090 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-11T23:34:38.090 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:38.090 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.090 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:38.090 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:38.090 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.090 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.090 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:38.090 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.091 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.091 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.091 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.091 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.091 INFO:teuthology.orchestra.run.smithi037.stdout: "roption1": { 2024-09-11T23:34:38.091 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "roption1", 2024-09-11T23:34:38.091 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:38.091 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.091 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:38.091 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:38.091 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.091 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.091 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:38.092 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.092 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.092 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.092 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.092 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.092 INFO:teuthology.orchestra.run.smithi037.stdout: "roption2": { 2024-09-11T23:34:38.092 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "roption2", 2024-09-11T23:34:38.092 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:38.092 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.092 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:38.092 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "xyz", 2024-09-11T23:34:38.092 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.092 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.093 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:38.093 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.093 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.093 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.093 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.093 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.093 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption1": { 2024-09-11T23:34:38.093 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption1", 2024-09-11T23:34:38.093 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:38.093 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.093 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:38.093 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:38.093 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.094 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.094 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:38.094 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.094 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.094 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.094 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.094 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.094 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption2": { 2024-09-11T23:34:38.094 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption2", 2024-09-11T23:34:38.094 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:38.094 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.094 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:38.094 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:38.094 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.095 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.095 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:38.095 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.095 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.095 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.095 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.095 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.095 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption3": { 2024-09-11T23:34:38.095 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption3", 2024-09-11T23:34:38.095 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-09-11T23:34:38.095 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.095 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:38.095 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:38.096 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.096 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.096 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:38.096 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.096 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.096 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.096 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.096 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.096 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption4": { 2024-09-11T23:34:38.096 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption4", 2024-09-11T23:34:38.096 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:38.096 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.096 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:38.097 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:38.097 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.097 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.097 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:38.097 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.097 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.097 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.097 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.097 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.097 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption5": { 2024-09-11T23:34:38.097 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption5", 2024-09-11T23:34:38.097 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:38.097 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.098 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:38.098 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:38.098 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.098 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.098 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:38.098 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.098 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.098 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.098 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.098 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.098 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption6": { 2024-09-11T23:34:38.098 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption6", 2024-09-11T23:34:38.098 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:38.099 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.099 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:38.099 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:38.099 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.099 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.099 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:38.099 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.099 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.099 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.099 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.099 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.099 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption7": { 2024-09-11T23:34:38.099 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption7", 2024-09-11T23:34:38.100 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:38.100 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.100 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:38.100 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:38.100 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "1", 2024-09-11T23:34:38.100 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "42", 2024-09-11T23:34:38.100 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:38.100 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.100 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.100 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.100 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.100 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.100 INFO:teuthology.orchestra.run.smithi037.stdout: "testkey": { 2024-09-11T23:34:38.101 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "testkey", 2024-09-11T23:34:38.101 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:38.101 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.101 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:38.101 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:38.101 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.101 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.101 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:38.101 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.101 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.101 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.101 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.101 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.101 INFO:teuthology.orchestra.run.smithi037.stdout: "testlkey": { 2024-09-11T23:34:38.102 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "testlkey", 2024-09-11T23:34:38.102 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:38.102 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.102 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:38.102 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:38.102 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.102 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.102 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:38.102 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.102 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.102 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.102 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.102 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.102 INFO:teuthology.orchestra.run.smithi037.stdout: "testnewline": { 2024-09-11T23:34:38.103 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "testnewline", 2024-09-11T23:34:38.103 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:38.103 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.103 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:38.103 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:38.103 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.103 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.103 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:38.103 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.103 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.103 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.103 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.103 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:38.103 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:38.104 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.104 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:34:38.104 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "snap_schedule", 2024-09-11T23:34:38.104 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-11T23:34:38.104 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-11T23:34:38.104 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-11T23:34:38.104 INFO:teuthology.orchestra.run.smithi037.stdout: "allow_m_granularity": { 2024-09-11T23:34:38.104 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "allow_m_granularity", 2024-09-11T23:34:38.104 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:38.104 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.104 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:38.104 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:38.104 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.105 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.105 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:38.105 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "allow minute scheduled snapshots", 2024-09-11T23:34:38.105 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.105 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.105 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.105 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.105 INFO:teuthology.orchestra.run.smithi037.stdout: "dump_on_update": { 2024-09-11T23:34:38.105 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "dump_on_update", 2024-09-11T23:34:38.105 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:38.105 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.105 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:38.105 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:38.105 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.106 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.106 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:38.106 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "dump database to debug log on update", 2024-09-11T23:34:38.106 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.106 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.106 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.106 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.106 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-11T23:34:38.106 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-11T23:34:38.106 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:38.106 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.106 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:38.106 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:38.107 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.107 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.107 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:38.107 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:38.107 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:38.107 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:38.107 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:38.107 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:38.107 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:38.107 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:38.107 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.107 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.107 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.107 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.108 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.108 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-11T23:34:38.108 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-11T23:34:38.108 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:38.108 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.108 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:38.108 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:38.108 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.108 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.108 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:38.108 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.108 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.108 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.109 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.109 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.109 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-11T23:34:38.109 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-11T23:34:38.109 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:38.109 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.109 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:38.109 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-11T23:34:38.109 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.109 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.109 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:38.109 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:38.109 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:38.109 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:38.110 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:38.110 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:38.110 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:38.110 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:38.110 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.110 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.110 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.110 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.110 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.110 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-11T23:34:38.110 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-11T23:34:38.110 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:38.110 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.111 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:38.111 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:38.111 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.111 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.111 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:38.111 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.111 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.111 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.111 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.111 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:38.111 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:38.111 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.111 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:34:38.112 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "stats", 2024-09-11T23:34:38.112 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-11T23:34:38.112 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-11T23:34:38.112 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-11T23:34:38.112 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-11T23:34:38.112 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-11T23:34:38.112 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:38.112 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.112 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:38.112 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:38.112 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.112 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.112 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:38.113 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:38.113 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:38.113 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:38.116 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:38.116 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:38.117 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:38.117 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:38.117 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.117 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.117 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.117 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.117 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.117 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-11T23:34:38.117 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-11T23:34:38.117 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:38.117 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.117 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:38.117 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:38.117 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.118 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.118 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:38.118 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.118 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.118 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.118 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.118 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.118 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-11T23:34:38.118 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-11T23:34:38.118 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:38.118 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.118 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:38.118 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-11T23:34:38.119 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.119 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.119 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:38.119 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:38.119 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:38.119 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:38.119 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:38.119 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:38.119 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:38.119 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:38.119 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.119 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.119 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.120 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.120 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.120 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-11T23:34:38.120 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-11T23:34:38.120 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:38.120 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.120 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:38.120 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:38.120 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.120 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.120 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:38.120 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.120 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.121 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.121 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.121 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:38.121 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:38.121 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.121 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:34:38.121 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "status", 2024-09-11T23:34:38.121 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-11T23:34:38.121 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-11T23:34:38.121 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-11T23:34:38.121 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-11T23:34:38.121 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-11T23:34:38.122 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:38.122 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.122 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:38.122 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:38.122 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.122 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.122 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:38.122 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:38.122 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:38.122 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:38.122 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:38.122 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:38.122 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:38.122 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:38.123 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.123 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.123 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.123 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.123 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.123 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-11T23:34:38.123 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-11T23:34:38.123 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:38.123 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.123 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:38.123 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:38.123 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.123 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.124 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:38.124 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.124 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.124 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.124 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.124 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.124 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-11T23:34:38.124 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-11T23:34:38.124 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:38.124 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.124 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:38.124 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-11T23:34:38.124 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.124 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.125 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:38.125 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:38.125 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:38.125 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:38.125 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:38.125 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:38.125 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:38.125 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:38.125 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.125 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.125 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.125 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.125 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.126 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-11T23:34:38.126 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-11T23:34:38.126 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:38.126 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.126 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:38.126 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:38.126 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.126 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.126 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:38.126 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.126 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.126 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.126 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.126 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:38.127 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:38.127 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.127 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:34:38.127 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "telegraf", 2024-09-11T23:34:38.127 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-11T23:34:38.127 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-11T23:34:38.127 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-11T23:34:38.127 INFO:teuthology.orchestra.run.smithi037.stdout: "address": { 2024-09-11T23:34:38.127 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "address", 2024-09-11T23:34:38.127 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:38.127 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.127 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:38.127 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-11T23:34:38.127 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.128 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.128 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:38.128 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.128 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.128 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.128 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.128 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.128 INFO:teuthology.orchestra.run.smithi037.stdout: "interval": { 2024-09-11T23:34:38.128 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "interval", 2024-09-11T23:34:38.128 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-11T23:34:38.128 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.128 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:38.128 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "15", 2024-09-11T23:34:38.128 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.129 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.129 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:38.129 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.129 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.129 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.129 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.129 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.129 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-11T23:34:38.129 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-11T23:34:38.129 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:38.129 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.129 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:38.129 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:38.130 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.130 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.130 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:38.130 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:38.130 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:38.130 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:38.130 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:38.130 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:38.130 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:38.130 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:38.130 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.130 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.130 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.130 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.131 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.131 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-11T23:34:38.131 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-11T23:34:38.131 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:38.131 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.131 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:38.131 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:38.131 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.131 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.131 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:38.131 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.131 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.131 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.132 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.132 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.132 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-11T23:34:38.132 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-11T23:34:38.132 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:38.132 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.132 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:38.132 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-11T23:34:38.132 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.132 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.132 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:38.132 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:38.132 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:38.133 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:38.133 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:38.133 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:38.133 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:38.133 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:38.133 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.133 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.133 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.133 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.133 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.133 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-11T23:34:38.133 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-11T23:34:38.133 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:38.134 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.134 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:38.134 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:38.134 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.134 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.134 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:38.134 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.134 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.134 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.134 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.134 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:38.134 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:38.134 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.135 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:34:38.135 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "telemetry", 2024-09-11T23:34:38.135 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-11T23:34:38.135 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-11T23:34:38.135 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-11T23:34:38.135 INFO:teuthology.orchestra.run.smithi037.stdout: "channel_basic": { 2024-09-11T23:34:38.135 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "channel_basic", 2024-09-11T23:34:38.135 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:38.135 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.135 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:38.135 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:38.135 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.135 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.135 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:38.136 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-11T23:34:38.136 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.136 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.136 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.136 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.136 INFO:teuthology.orchestra.run.smithi037.stdout: "channel_crash": { 2024-09-11T23:34:38.136 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "channel_crash", 2024-09-11T23:34:38.136 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:38.136 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.136 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:38.136 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:38.136 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.136 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.137 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:38.137 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-11T23:34:38.137 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.137 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.137 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.137 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.137 INFO:teuthology.orchestra.run.smithi037.stdout: "channel_device": { 2024-09-11T23:34:38.137 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "channel_device", 2024-09-11T23:34:38.137 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:38.137 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.137 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:38.137 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:38.137 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.138 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.138 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:38.138 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-11T23:34:38.138 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.138 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.138 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.138 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.138 INFO:teuthology.orchestra.run.smithi037.stdout: "channel_ident": { 2024-09-11T23:34:38.138 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "channel_ident", 2024-09-11T23:34:38.138 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:38.138 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.138 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:38.138 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:38.139 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.139 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.139 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:38.139 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-11T23:34:38.139 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.139 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.139 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.139 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.139 INFO:teuthology.orchestra.run.smithi037.stdout: "channel_perf": { 2024-09-11T23:34:38.139 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "channel_perf", 2024-09-11T23:34:38.139 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:38.139 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.139 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:38.139 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:38.140 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.140 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.140 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:38.140 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-11T23:34:38.140 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.140 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.140 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.140 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.140 INFO:teuthology.orchestra.run.smithi037.stdout: "contact": { 2024-09-11T23:34:38.140 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "contact", 2024-09-11T23:34:38.140 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:38.140 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.140 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:38.141 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:38.141 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.141 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.141 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:38.141 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.141 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.141 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.141 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.141 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.141 INFO:teuthology.orchestra.run.smithi037.stdout: "description": { 2024-09-11T23:34:38.141 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "description", 2024-09-11T23:34:38.141 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:38.141 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.142 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:38.142 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:38.142 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.142 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.142 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:38.142 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.142 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.142 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.142 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.142 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.142 INFO:teuthology.orchestra.run.smithi037.stdout: "device_url": { 2024-09-11T23:34:38.142 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "device_url", 2024-09-11T23:34:38.142 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:38.142 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.143 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:38.143 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-11T23:34:38.143 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.143 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.143 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:38.143 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.143 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.143 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.143 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.143 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.143 INFO:teuthology.orchestra.run.smithi037.stdout: "enabled": { 2024-09-11T23:34:38.143 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "enabled", 2024-09-11T23:34:38.143 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:38.144 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.144 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:38.144 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:38.144 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.144 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.144 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:38.144 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.144 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.144 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.144 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.144 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.144 INFO:teuthology.orchestra.run.smithi037.stdout: "interval": { 2024-09-11T23:34:38.144 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "interval", 2024-09-11T23:34:38.145 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:38.145 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.145 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:38.145 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "24", 2024-09-11T23:34:38.145 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "8", 2024-09-11T23:34:38.145 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.145 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:38.145 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.145 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.145 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.145 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.145 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.145 INFO:teuthology.orchestra.run.smithi037.stdout: "last_opt_revision": { 2024-09-11T23:34:38.145 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "last_opt_revision", 2024-09-11T23:34:38.146 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:38.146 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.146 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:38.146 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "1", 2024-09-11T23:34:38.146 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.146 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.146 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:38.146 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.146 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.146 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.146 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.146 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.146 INFO:teuthology.orchestra.run.smithi037.stdout: "leaderboard": { 2024-09-11T23:34:38.146 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "leaderboard", 2024-09-11T23:34:38.147 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:38.147 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.147 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:38.147 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:38.147 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.147 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.147 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:38.147 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.147 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.147 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.147 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.147 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.148 INFO:teuthology.orchestra.run.smithi037.stdout: "leaderboard_description": { 2024-09-11T23:34:38.148 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "leaderboard_description", 2024-09-11T23:34:38.148 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:38.148 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.148 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:38.148 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:38.148 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.148 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.148 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:38.148 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.148 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.148 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.148 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.149 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.149 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-11T23:34:38.149 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-11T23:34:38.149 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:38.149 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.149 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:38.149 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:38.149 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.149 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.149 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:38.149 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:38.149 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:38.149 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:38.150 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:38.150 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:38.150 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:38.150 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:38.150 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.150 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.150 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.150 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.150 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.150 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-11T23:34:38.150 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-11T23:34:38.150 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:38.150 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.151 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:38.151 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:38.151 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.151 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.151 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:38.151 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.151 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.151 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.151 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.151 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.151 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-11T23:34:38.151 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-11T23:34:38.151 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:38.151 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.152 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:38.152 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-11T23:34:38.152 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.152 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.152 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:38.152 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:38.152 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:38.152 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:38.152 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:38.152 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:38.152 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:38.152 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:38.153 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.153 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.153 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.153 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.153 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.153 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-11T23:34:38.153 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-11T23:34:38.153 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:38.153 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.153 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:38.153 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:38.153 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.153 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.153 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:38.154 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.154 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.154 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.154 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.154 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.154 INFO:teuthology.orchestra.run.smithi037.stdout: "organization": { 2024-09-11T23:34:38.154 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "organization", 2024-09-11T23:34:38.154 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:38.154 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.154 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:38.154 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:38.154 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.154 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.155 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:38.155 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.155 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.155 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.155 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.155 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.155 INFO:teuthology.orchestra.run.smithi037.stdout: "proxy": { 2024-09-11T23:34:38.155 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "proxy", 2024-09-11T23:34:38.155 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:38.155 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.155 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:38.155 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:38.156 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.156 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.156 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:38.156 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.156 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.156 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.156 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.156 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.156 INFO:teuthology.orchestra.run.smithi037.stdout: "url": { 2024-09-11T23:34:38.156 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "url", 2024-09-11T23:34:38.156 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:38.156 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.156 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:38.157 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-11T23:34:38.157 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.157 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.157 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:38.157 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.157 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.157 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.157 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.157 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:38.157 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:38.157 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.157 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:34:38.158 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "test_orchestrator", 2024-09-11T23:34:38.158 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-11T23:34:38.158 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-11T23:34:38.158 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-11T23:34:38.158 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-11T23:34:38.158 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-11T23:34:38.158 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:38.158 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.158 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:38.158 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:38.158 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.158 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.158 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:38.158 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:38.159 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:38.159 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:38.159 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:38.159 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:38.159 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:38.159 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:38.159 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.159 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.159 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.159 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.159 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.159 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-11T23:34:38.159 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-11T23:34:38.160 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:38.160 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.160 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:38.160 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:38.160 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.160 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.160 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:38.160 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.160 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.160 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.160 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.160 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.161 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-11T23:34:38.161 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-11T23:34:38.161 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:38.161 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.161 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:38.161 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-11T23:34:38.161 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.161 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.161 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:38.161 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:38.161 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:38.161 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:38.161 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:38.162 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:38.162 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:38.162 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:38.162 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.162 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.162 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.162 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.162 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.162 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-11T23:34:38.162 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-11T23:34:38.162 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:38.162 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.163 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:38.163 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:38.163 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.163 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.163 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:38.163 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.163 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.163 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.163 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.163 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:38.163 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:38.163 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.163 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:34:38.163 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "volumes", 2024-09-11T23:34:38.164 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-11T23:34:38.164 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-11T23:34:38.164 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-11T23:34:38.164 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-11T23:34:38.164 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-11T23:34:38.164 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:38.164 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.164 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:38.164 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:38.164 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.164 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.164 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:38.165 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:38.165 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:38.165 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:38.165 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:38.165 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:38.165 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:38.165 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:38.165 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.165 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.165 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.165 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.165 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.166 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-11T23:34:38.166 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-11T23:34:38.166 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:38.166 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.166 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:38.166 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:38.166 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.166 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.166 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:38.166 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.166 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.166 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.166 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.167 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.167 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-11T23:34:38.167 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-11T23:34:38.167 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:38.167 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.167 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:38.167 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-11T23:34:38.167 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.167 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.167 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:38.167 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:38.167 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:38.167 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:38.167 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:38.168 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:38.168 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:38.168 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:38.168 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.168 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.168 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.168 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.168 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.168 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-11T23:34:38.168 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-11T23:34:38.168 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:38.168 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.168 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:38.169 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:38.169 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.169 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.169 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:38.169 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.169 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.169 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.169 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.169 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.169 INFO:teuthology.orchestra.run.smithi037.stdout: "max_concurrent_clones": { 2024-09-11T23:34:38.169 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "max_concurrent_clones", 2024-09-11T23:34:38.169 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:38.169 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.170 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:38.170 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "4", 2024-09-11T23:34:38.170 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.170 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.170 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:38.170 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-11T23:34:38.170 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.170 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.170 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.170 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.170 INFO:teuthology.orchestra.run.smithi037.stdout: "periodic_async_work": { 2024-09-11T23:34:38.170 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "periodic_async_work", 2024-09-11T23:34:38.170 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:38.171 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.171 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:38.171 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:38.171 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.171 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.171 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:38.171 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Periodically check for async work", 2024-09-11T23:34:38.171 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.171 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.171 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.171 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.171 INFO:teuthology.orchestra.run.smithi037.stdout: "snapshot_clone_delay": { 2024-09-11T23:34:38.171 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "snapshot_clone_delay", 2024-09-11T23:34:38.172 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:38.172 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.172 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:38.172 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-11T23:34:38.172 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.172 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.172 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:38.172 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-11T23:34:38.172 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.172 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.172 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.172 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.173 INFO:teuthology.orchestra.run.smithi037.stdout: "snapshot_clone_no_wait": { 2024-09-11T23:34:38.173 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "snapshot_clone_no_wait", 2024-09-11T23:34:38.173 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:38.173 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.173 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:38.173 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-11T23:34:38.173 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.173 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.173 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:38.173 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-11T23:34:38.173 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.173 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.173 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.173 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:38.174 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:38.174 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.174 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:34:38.174 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "zabbix", 2024-09-11T23:34:38.174 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-11T23:34:38.174 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-11T23:34:38.174 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-11T23:34:38.174 INFO:teuthology.orchestra.run.smithi037.stdout: "discovery_interval": { 2024-09-11T23:34:38.174 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "discovery_interval", 2024-09-11T23:34:38.174 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "uint", 2024-09-11T23:34:38.174 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.174 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:38.174 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "100", 2024-09-11T23:34:38.175 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.175 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.175 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:38.175 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.175 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.175 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.175 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.175 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.175 INFO:teuthology.orchestra.run.smithi037.stdout: "identifier": { 2024-09-11T23:34:38.175 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "identifier", 2024-09-11T23:34:38.175 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:38.175 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.175 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:38.175 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:38.176 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.176 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.176 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:38.176 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.176 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.176 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.176 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.176 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.176 INFO:teuthology.orchestra.run.smithi037.stdout: "interval": { 2024-09-11T23:34:38.176 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "interval", 2024-09-11T23:34:38.176 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-11T23:34:38.176 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.176 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:38.177 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "60", 2024-09-11T23:34:38.177 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.177 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.177 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:38.177 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.177 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.177 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.177 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.177 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.177 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-11T23:34:38.177 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-11T23:34:38.177 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:38.177 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.178 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:38.178 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:38.178 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.178 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.178 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:38.178 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:38.178 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:38.178 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:38.178 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:38.178 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:38.178 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:38.178 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:38.178 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.179 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.179 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.179 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.179 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.179 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-11T23:34:38.179 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-11T23:34:38.179 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:38.179 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.179 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:38.179 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:38.179 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.179 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.179 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:38.179 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.180 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.180 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.180 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.180 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.180 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-11T23:34:38.180 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-11T23:34:38.180 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:38.180 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.180 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:38.180 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-11T23:34:38.180 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.180 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.181 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-11T23:34:38.181 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-11T23:34:38.181 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-11T23:34:38.181 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-11T23:34:38.181 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-11T23:34:38.181 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-11T23:34:38.181 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-11T23:34:38.181 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:38.181 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.181 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.181 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.181 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.181 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.182 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-11T23:34:38.182 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-11T23:34:38.182 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-11T23:34:38.182 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.182 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-11T23:34:38.182 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-11T23:34:38.182 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.182 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.182 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:38.182 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.182 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.182 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.182 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.182 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.183 INFO:teuthology.orchestra.run.smithi037.stdout: "zabbix_host": { 2024-09-11T23:34:38.183 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "zabbix_host", 2024-09-11T23:34:38.183 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:38.183 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.183 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:38.183 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-11T23:34:38.183 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.183 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.183 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:38.183 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.183 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.183 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.183 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.184 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.184 INFO:teuthology.orchestra.run.smithi037.stdout: "zabbix_port": { 2024-09-11T23:34:38.184 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "zabbix_port", 2024-09-11T23:34:38.184 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-11T23:34:38.184 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.184 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:38.184 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10051", 2024-09-11T23:34:38.184 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.184 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.184 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:38.184 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.184 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.184 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.185 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.185 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.185 INFO:teuthology.orchestra.run.smithi037.stdout: "zabbix_sender": { 2024-09-11T23:34:38.185 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "zabbix_sender", 2024-09-11T23:34:38.185 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-11T23:34:38.185 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-11T23:34:38.185 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-11T23:34:38.185 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-11T23:34:38.185 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-11T23:34:38.185 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-11T23:34:38.185 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-11T23:34:38.185 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-11T23:34:38.185 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-11T23:34:38.186 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-11T23:34:38.186 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-11T23:34:38.186 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:38.186 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:38.186 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:38.186 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:38.186 INFO:teuthology.orchestra.run.smithi037.stdout: "services": { 2024-09-11T23:34:38.186 INFO:teuthology.orchestra.run.smithi037.stdout: "dashboard": "https://172.21.15.37:8443/" 2024-09-11T23:34:38.186 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.186 INFO:teuthology.orchestra.run.smithi037.stdout: "always_on_modules": { 2024-09-11T23:34:38.186 INFO:teuthology.orchestra.run.smithi037.stdout: "octopus": [ 2024-09-11T23:34:38.186 INFO:teuthology.orchestra.run.smithi037.stdout: "balancer", 2024-09-11T23:34:38.187 INFO:teuthology.orchestra.run.smithi037.stdout: "crash", 2024-09-11T23:34:38.187 INFO:teuthology.orchestra.run.smithi037.stdout: "devicehealth", 2024-09-11T23:34:38.187 INFO:teuthology.orchestra.run.smithi037.stdout: "orchestrator", 2024-09-11T23:34:38.187 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_autoscaler", 2024-09-11T23:34:38.187 INFO:teuthology.orchestra.run.smithi037.stdout: "progress", 2024-09-11T23:34:38.187 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_support", 2024-09-11T23:34:38.187 INFO:teuthology.orchestra.run.smithi037.stdout: "status", 2024-09-11T23:34:38.187 INFO:teuthology.orchestra.run.smithi037.stdout: "telemetry", 2024-09-11T23:34:38.187 INFO:teuthology.orchestra.run.smithi037.stdout: "volumes" 2024-09-11T23:34:38.187 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:38.187 INFO:teuthology.orchestra.run.smithi037.stdout: "pacific": [ 2024-09-11T23:34:38.187 INFO:teuthology.orchestra.run.smithi037.stdout: "balancer", 2024-09-11T23:34:38.187 INFO:teuthology.orchestra.run.smithi037.stdout: "crash", 2024-09-11T23:34:38.187 INFO:teuthology.orchestra.run.smithi037.stdout: "devicehealth", 2024-09-11T23:34:38.188 INFO:teuthology.orchestra.run.smithi037.stdout: "orchestrator", 2024-09-11T23:34:38.188 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_autoscaler", 2024-09-11T23:34:38.188 INFO:teuthology.orchestra.run.smithi037.stdout: "progress", 2024-09-11T23:34:38.188 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_support", 2024-09-11T23:34:38.188 INFO:teuthology.orchestra.run.smithi037.stdout: "status", 2024-09-11T23:34:38.188 INFO:teuthology.orchestra.run.smithi037.stdout: "telemetry", 2024-09-11T23:34:38.188 INFO:teuthology.orchestra.run.smithi037.stdout: "volumes" 2024-09-11T23:34:38.188 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:38.188 INFO:teuthology.orchestra.run.smithi037.stdout: "quincy": [ 2024-09-11T23:34:38.188 INFO:teuthology.orchestra.run.smithi037.stdout: "balancer", 2024-09-11T23:34:38.188 INFO:teuthology.orchestra.run.smithi037.stdout: "crash", 2024-09-11T23:34:38.188 INFO:teuthology.orchestra.run.smithi037.stdout: "devicehealth", 2024-09-11T23:34:38.188 INFO:teuthology.orchestra.run.smithi037.stdout: "orchestrator", 2024-09-11T23:34:38.189 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_autoscaler", 2024-09-11T23:34:38.189 INFO:teuthology.orchestra.run.smithi037.stdout: "progress", 2024-09-11T23:34:38.189 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_support", 2024-09-11T23:34:38.189 INFO:teuthology.orchestra.run.smithi037.stdout: "status", 2024-09-11T23:34:38.189 INFO:teuthology.orchestra.run.smithi037.stdout: "telemetry", 2024-09-11T23:34:38.189 INFO:teuthology.orchestra.run.smithi037.stdout: "volumes" 2024-09-11T23:34:38.189 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:38.189 INFO:teuthology.orchestra.run.smithi037.stdout: "reef": [ 2024-09-11T23:34:38.189 INFO:teuthology.orchestra.run.smithi037.stdout: "balancer", 2024-09-11T23:34:38.189 INFO:teuthology.orchestra.run.smithi037.stdout: "crash", 2024-09-11T23:34:38.189 INFO:teuthology.orchestra.run.smithi037.stdout: "devicehealth", 2024-09-11T23:34:38.189 INFO:teuthology.orchestra.run.smithi037.stdout: "orchestrator", 2024-09-11T23:34:38.189 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_autoscaler", 2024-09-11T23:34:38.190 INFO:teuthology.orchestra.run.smithi037.stdout: "progress", 2024-09-11T23:34:38.190 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_support", 2024-09-11T23:34:38.190 INFO:teuthology.orchestra.run.smithi037.stdout: "status", 2024-09-11T23:34:38.190 INFO:teuthology.orchestra.run.smithi037.stdout: "telemetry", 2024-09-11T23:34:38.190 INFO:teuthology.orchestra.run.smithi037.stdout: "volumes" 2024-09-11T23:34:38.190 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-11T23:34:38.190 INFO:teuthology.orchestra.run.smithi037.stdout: "squid": [ 2024-09-11T23:34:38.190 INFO:teuthology.orchestra.run.smithi037.stdout: "balancer", 2024-09-11T23:34:38.190 INFO:teuthology.orchestra.run.smithi037.stdout: "crash", 2024-09-11T23:34:38.190 INFO:teuthology.orchestra.run.smithi037.stdout: "devicehealth", 2024-09-11T23:34:38.190 INFO:teuthology.orchestra.run.smithi037.stdout: "orchestrator", 2024-09-11T23:34:38.190 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_autoscaler", 2024-09-11T23:34:38.190 INFO:teuthology.orchestra.run.smithi037.stdout: "progress", 2024-09-11T23:34:38.190 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_support", 2024-09-11T23:34:38.191 INFO:teuthology.orchestra.run.smithi037.stdout: "status", 2024-09-11T23:34:38.191 INFO:teuthology.orchestra.run.smithi037.stdout: "telemetry", 2024-09-11T23:34:38.191 INFO:teuthology.orchestra.run.smithi037.stdout: "volumes" 2024-09-11T23:34:38.191 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2024-09-11T23:34:38.191 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.191 INFO:teuthology.orchestra.run.smithi037.stdout: "last_failure_osd_epoch": 3, 2024-09-11T23:34:38.191 INFO:teuthology.orchestra.run.smithi037.stdout: "active_clients": [ 2024-09-11T23:34:38.191 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:34:38.191 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "devicehealth", 2024-09-11T23:34:38.191 INFO:teuthology.orchestra.run.smithi037.stdout: "addrvec": [ 2024-09-11T23:34:38.191 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:34:38.191 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v2", 2024-09-11T23:34:38.191 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.37:0", 2024-09-11T23:34:38.191 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 2972484732 2024-09-11T23:34:38.192 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:38.192 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2024-09-11T23:34:38.192 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.192 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:34:38.192 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "libcephsqlite", 2024-09-11T23:34:38.192 INFO:teuthology.orchestra.run.smithi037.stdout: "addrvec": [ 2024-09-11T23:34:38.192 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:34:38.192 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v2", 2024-09-11T23:34:38.192 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.37:0", 2024-09-11T23:34:38.192 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 697451617 2024-09-11T23:34:38.192 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:38.192 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2024-09-11T23:34:38.192 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.193 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:34:38.193 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rbd_support", 2024-09-11T23:34:38.193 INFO:teuthology.orchestra.run.smithi037.stdout: "addrvec": [ 2024-09-11T23:34:38.193 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:34:38.193 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v2", 2024-09-11T23:34:38.193 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.37:0", 2024-09-11T23:34:38.193 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 78478380 2024-09-11T23:34:38.193 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:38.193 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2024-09-11T23:34:38.193 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:38.193 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:34:38.193 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "volumes", 2024-09-11T23:34:38.193 INFO:teuthology.orchestra.run.smithi037.stdout: "addrvec": [ 2024-09-11T23:34:38.193 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-11T23:34:38.194 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v2", 2024-09-11T23:34:38.194 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.37:0", 2024-09-11T23:34:38.194 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 21877475 2024-09-11T23:34:38.194 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:38.194 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2024-09-11T23:34:38.194 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:38.194 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2024-09-11T23:34:38.194 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-11T23:34:38.195 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:34:36 smithi123 ceph-mon[35438]: from='client.? 172.21.15.37:0/1483159258' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-11T23:34:38.195 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:34:36 smithi123 ceph-mon[35438]: from='client.? 172.21.15.37:0/3683466141' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-11T23:34:38.196 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:34:36 smithi123 ceph-mon[35438]: from='client.? 172.21.15.37:0/1659108324' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-11T23:34:38.196 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:34:36 smithi160 ceph-mon[35055]: from='client.? 172.21.15.37:0/1483159258' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-11T23:34:38.196 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:34:36 smithi160 ceph-mon[35055]: from='client.? 172.21.15.37:0/3683466141' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-11T23:34:38.196 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:34:36 smithi160 ceph-mon[35055]: from='client.? 172.21.15.37:0/1659108324' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-11T23:34:38.196 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:34:37 smithi160 ceph-mon[35055]: pgmap v857: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 6.0 MiB/s wr, 665 op/s 2024-09-11T23:34:38.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:36.792+0000 7f8cd8000640 1 -- 172.21.15.37:0/1659108324 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f8cb80a2b90 msgr2=0x7f8cb80a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:34:38.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:36.792+0000 7f8cd8000640 1 --2- 172.21.15.37:0/1659108324 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f8cb80a2b90 0x7f8cb80a5050 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f8cd019b560 tx=0x7f8cbc005f90 comp rx=0 tx=0).stop 2024-09-11T23:34:38.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:36.792+0000 7f8cd8000640 1 -- 172.21.15.37:0/1659108324 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8cd0103d30 msgr2=0x7f8cd019a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:34:38.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:36.792+0000 7f8cd8000640 1 --2- 172.21.15.37:0/1659108324 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8cd0103d30 0x7f8cd019a050 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f8cc4009bf0 tx=0x7f8cc4031ee0 comp rx=0 tx=0).stop 2024-09-11T23:34:38.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:36.792+0000 7f8cd8000640 1 -- 172.21.15.37:0/1659108324 shutdown_connections 2024-09-11T23:34:38.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:36.792+0000 7f8cd8000640 1 --2- 172.21.15.37:0/1659108324 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f8cb80a2b90 0x7f8cb80a5050 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:34:38.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:36.792+0000 7f8cd8000640 1 --2- 172.21.15.37:0/1659108324 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8cd0104f20 0x7f8cd019a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:34:38.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:36.792+0000 7f8cd8000640 1 --2- 172.21.15.37:0/1659108324 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8cd01058e0 0x7f8cd01a1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:34:38.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:36.792+0000 7f8cd8000640 1 --2- 172.21.15.37:0/1659108324 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8cd0103d30 0x7f8cd019a050 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:34:38.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:36.792+0000 7f8cd8000640 1 -- 172.21.15.37:0/1659108324 >> 172.21.15.37:0/1659108324 conn(0x7f8cd00ff4b0 msgr2=0x7f8cd0108390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:34:38.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:36.792+0000 7f8cd8000640 1 -- 172.21.15.37:0/1659108324 shutdown_connections 2024-09-11T23:34:38.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:34:36.792+0000 7f8cd8000640 1 -- 172.21.15.37:0/1659108324 wait complete. 2024-09-11T23:34:38.204 DEBUG:tasks.check_counter:Getting stats from a 2024-09-11T23:34:38.204 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph daemon mds.a perf dump 2024-09-11T23:34:38.205 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:34:36 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/1483159258' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-11T23:34:38.205 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:34:36 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/3683466141' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-11T23:34:38.205 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:34:36 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/1659108324' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-11T23:34:38.205 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:34:37 smithi037 ceph-mon[30630]: pgmap v857: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 6.0 MiB/s wr, 665 op/s 2024-09-11T23:34:38.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:34:37 smithi123 ceph-mon[35438]: pgmap v857: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 6.0 MiB/s wr, 665 op/s 2024-09-11T23:34:38.596 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:34:39.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:34:38 smithi037 ceph-mon[30630]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-11T23:34:39.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:34:38 smithi160 ceph-mon[35055]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-11T23:34:39.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:34:38 smithi123 ceph-mon[35438]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-11T23:34:39.331 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-11T23:34:39.331 INFO:teuthology.orchestra.run.smithi037.stdout: "AsyncMessenger::Worker-0": { 2024-09-11T23:34:39.331 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_messages": 2105, 2024-09-11T23:34:39.331 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages": 2107, 2024-09-11T23:34:39.331 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_bytes": 630598, 2024-09-11T23:34:39.331 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_bytes": 669391, 2024-09-11T23:34:39.332 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_created_connections": 6, 2024-09-11T23:34:39.332 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_active_connections": 2, 2024-09-11T23:34:39.332 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_total_time": 0.307983584, 2024-09-11T23:34:39.332 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_send_time": 0.090725906, 2024-09-11T23:34:39.332 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_recv_time": 0.070682296, 2024-09-11T23:34:39.332 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_fast_dispatch_time": 0.104151705, 2024-09-11T23:34:39.332 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T23:34:39.332 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 2105, 2024-09-11T23:34:39.332 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.389473264, 2024-09-11T23:34:39.332 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000185022 2024-09-11T23:34:39.332 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:39.332 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_handle_ack_lat": { 2024-09-11T23:34:39.332 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-11T23:34:39.333 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-11T23:34:39.333 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-11T23:34:39.333 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:39.333 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-11T23:34:39.333 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_encrypted_bytes": 0 2024-09-11T23:34:39.333 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:39.333 INFO:teuthology.orchestra.run.smithi037.stdout: "AsyncMessenger::Worker-1": { 2024-09-11T23:34:39.333 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_messages": 1291, 2024-09-11T23:34:39.333 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages": 1282, 2024-09-11T23:34:39.333 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_bytes": 1052560, 2024-09-11T23:34:39.333 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_bytes": 495672, 2024-09-11T23:34:39.333 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_created_connections": 5, 2024-09-11T23:34:39.334 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_active_connections": 3, 2024-09-11T23:34:39.334 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_total_time": 0.231715561, 2024-09-11T23:34:39.334 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_send_time": 0.084633652, 2024-09-11T23:34:39.334 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_recv_time": 0.076638141, 2024-09-11T23:34:39.334 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_fast_dispatch_time": 0.059357955, 2024-09-11T23:34:39.334 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T23:34:39.334 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 1282, 2024-09-11T23:34:39.334 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.265455238, 2024-09-11T23:34:39.334 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000207063 2024-09-11T23:34:39.334 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:39.334 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_handle_ack_lat": { 2024-09-11T23:34:39.334 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-11T23:34:39.334 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-11T23:34:39.335 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-11T23:34:39.335 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:39.335 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_encrypted_bytes": 812304, 2024-09-11T23:34:39.335 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_encrypted_bytes": 185872 2024-09-11T23:34:39.335 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:39.335 INFO:teuthology.orchestra.run.smithi037.stdout: "AsyncMessenger::Worker-2": { 2024-09-11T23:34:39.335 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_messages": 3, 2024-09-11T23:34:39.335 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages": 229, 2024-09-11T23:34:39.335 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_bytes": 588, 2024-09-11T23:34:39.335 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_bytes": 557422, 2024-09-11T23:34:39.335 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_created_connections": 6, 2024-09-11T23:34:39.335 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_active_connections": 3, 2024-09-11T23:34:39.335 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_total_time": 0.034809813, 2024-09-11T23:34:39.336 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_send_time": 0.028406836, 2024-09-11T23:34:39.336 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_recv_time": 0.003373745, 2024-09-11T23:34:39.336 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_fast_dispatch_time": 0.000029653, 2024-09-11T23:34:39.336 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T23:34:39.336 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 227, 2024-09-11T23:34:39.336 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.069690141, 2024-09-11T23:34:39.336 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000307005 2024-09-11T23:34:39.336 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:39.336 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_handle_ack_lat": { 2024-09-11T23:34:39.336 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-11T23:34:39.336 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-11T23:34:39.337 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-11T23:34:39.337 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:39.337 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-11T23:34:39.337 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_encrypted_bytes": 557104 2024-09-11T23:34:39.337 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:39.337 INFO:teuthology.orchestra.run.smithi037.stdout: "cct": { 2024-09-11T23:34:39.341 INFO:teuthology.orchestra.run.smithi037.stdout: "total_workers": 1, 2024-09-11T23:34:39.342 INFO:teuthology.orchestra.run.smithi037.stdout: "unhealthy_workers": 0 2024-09-11T23:34:39.342 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:39.342 INFO:teuthology.orchestra.run.smithi037.stdout: "finisher-MDSRank": { 2024-09-11T23:34:39.342 INFO:teuthology.orchestra.run.smithi037.stdout: "queue_len": 0, 2024-09-11T23:34:39.342 INFO:teuthology.orchestra.run.smithi037.stdout: "complete_latency": { 2024-09-11T23:34:39.342 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 4885, 2024-09-11T23:34:39.342 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.208694405, 2024-09-11T23:34:39.342 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000042721 2024-09-11T23:34:39.342 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:39.342 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:39.342 INFO:teuthology.orchestra.run.smithi037.stdout: "finisher-PurgeQueue": { 2024-09-11T23:34:39.342 INFO:teuthology.orchestra.run.smithi037.stdout: "queue_len": 0, 2024-09-11T23:34:39.342 INFO:teuthology.orchestra.run.smithi037.stdout: "complete_latency": { 2024-09-11T23:34:39.343 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-11T23:34:39.343 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-11T23:34:39.343 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-11T23:34:39.343 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:39.343 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:39.343 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": { 2024-09-11T23:34:39.343 INFO:teuthology.orchestra.run.smithi037.stdout: "request": 0, 2024-09-11T23:34:39.343 INFO:teuthology.orchestra.run.smithi037.stdout: "reply": 0, 2024-09-11T23:34:39.343 INFO:teuthology.orchestra.run.smithi037.stdout: "reply_latency": { 2024-09-11T23:34:39.343 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-11T23:34:39.343 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-11T23:34:39.343 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-11T23:34:39.343 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:39.343 INFO:teuthology.orchestra.run.smithi037.stdout: "slow_reply": 0, 2024-09-11T23:34:39.344 INFO:teuthology.orchestra.run.smithi037.stdout: "forward": 0, 2024-09-11T23:34:39.344 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_fetch_complete": 0, 2024-09-11T23:34:39.344 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_fetch_keys": 0, 2024-09-11T23:34:39.344 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_commit": 0, 2024-09-11T23:34:39.344 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_split": 0, 2024-09-11T23:34:39.344 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_merge": 0, 2024-09-11T23:34:39.344 INFO:teuthology.orchestra.run.smithi037.stdout: "inodes": 0, 2024-09-11T23:34:39.344 INFO:teuthology.orchestra.run.smithi037.stdout: "inodes_top": 0, 2024-09-11T23:34:39.344 INFO:teuthology.orchestra.run.smithi037.stdout: "inodes_bottom": 0, 2024-09-11T23:34:39.344 INFO:teuthology.orchestra.run.smithi037.stdout: "inodes_pin_tail": 0, 2024-09-11T23:34:39.344 INFO:teuthology.orchestra.run.smithi037.stdout: "inodes_pinned": 0, 2024-09-11T23:34:39.344 INFO:teuthology.orchestra.run.smithi037.stdout: "inodes_expired": 0, 2024-09-11T23:34:39.344 INFO:teuthology.orchestra.run.smithi037.stdout: "inodes_with_caps": 0, 2024-09-11T23:34:39.345 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": 0, 2024-09-11T23:34:39.345 INFO:teuthology.orchestra.run.smithi037.stdout: "subtrees": 1, 2024-09-11T23:34:39.345 INFO:teuthology.orchestra.run.smithi037.stdout: "traverse": 0, 2024-09-11T23:34:39.345 INFO:teuthology.orchestra.run.smithi037.stdout: "traverse_hit": 0, 2024-09-11T23:34:39.345 INFO:teuthology.orchestra.run.smithi037.stdout: "traverse_forward": 0, 2024-09-11T23:34:39.345 INFO:teuthology.orchestra.run.smithi037.stdout: "traverse_discover": 0, 2024-09-11T23:34:39.345 INFO:teuthology.orchestra.run.smithi037.stdout: "traverse_dir_fetch": 0, 2024-09-11T23:34:39.345 INFO:teuthology.orchestra.run.smithi037.stdout: "traverse_remote_ino": 0, 2024-09-11T23:34:39.345 INFO:teuthology.orchestra.run.smithi037.stdout: "traverse_lock": 0, 2024-09-11T23:34:39.345 INFO:teuthology.orchestra.run.smithi037.stdout: "load_cent": 0, 2024-09-11T23:34:39.345 INFO:teuthology.orchestra.run.smithi037.stdout: "q": 0, 2024-09-11T23:34:39.345 INFO:teuthology.orchestra.run.smithi037.stdout: "exported": 0, 2024-09-11T23:34:39.345 INFO:teuthology.orchestra.run.smithi037.stdout: "exported_inodes": 0, 2024-09-11T23:34:39.345 INFO:teuthology.orchestra.run.smithi037.stdout: "imported": 0, 2024-09-11T23:34:39.346 INFO:teuthology.orchestra.run.smithi037.stdout: "imported_inodes": 0, 2024-09-11T23:34:39.346 INFO:teuthology.orchestra.run.smithi037.stdout: "openino_dir_fetch": 0, 2024-09-11T23:34:39.346 INFO:teuthology.orchestra.run.smithi037.stdout: "openino_backtrace_fetch": 0, 2024-09-11T23:34:39.346 INFO:teuthology.orchestra.run.smithi037.stdout: "openino_peer_discover": 0, 2024-09-11T23:34:39.346 INFO:teuthology.orchestra.run.smithi037.stdout: "root_rfiles": 0, 2024-09-11T23:34:39.346 INFO:teuthology.orchestra.run.smithi037.stdout: "root_rbytes": 0, 2024-09-11T23:34:39.346 INFO:teuthology.orchestra.run.smithi037.stdout: "root_rsnaps": 0, 2024-09-11T23:34:39.346 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_backtrace_fetch": 0, 2024-09-11T23:34:39.346 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_set_tag": 0, 2024-09-11T23:34:39.346 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_backtrace_repaired": 0, 2024-09-11T23:34:39.346 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_inotable_repaired": 0, 2024-09-11T23:34:39.346 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_dir_inodes": 0, 2024-09-11T23:34:39.346 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_dir_base_inodes": 0, 2024-09-11T23:34:39.347 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_dirfrag_rstats": 0, 2024-09-11T23:34:39.347 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_file_inodes": 0, 2024-09-11T23:34:39.347 INFO:teuthology.orchestra.run.smithi037.stdout: "handle_inode_file_caps": 0, 2024-09-11T23:34:39.347 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_cap_op_revoke": 0, 2024-09-11T23:34:39.347 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_cap_op_grant": 0, 2024-09-11T23:34:39.347 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_cap_op_trunc": 0, 2024-09-11T23:34:39.347 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-11T23:34:39.347 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-11T23:34:39.347 INFO:teuthology.orchestra.run.smithi037.stdout: "handle_client_caps": 0, 2024-09-11T23:34:39.347 INFO:teuthology.orchestra.run.smithi037.stdout: "handle_client_caps_dirty": 0, 2024-09-11T23:34:39.348 INFO:teuthology.orchestra.run.smithi037.stdout: "handle_client_cap_release": 0, 2024-09-11T23:34:39.348 INFO:teuthology.orchestra.run.smithi037.stdout: "process_request_cap_release": 0 2024-09-11T23:34:39.348 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:39.348 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_cache": { 2024-09-11T23:34:39.348 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_update": 0, 2024-09-11T23:34:39.348 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_update_receipt": 0, 2024-09-11T23:34:39.348 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_try_discover": 0, 2024-09-11T23:34:39.348 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_send_discover": 0, 2024-09-11T23:34:39.348 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_handle_discover": 0, 2024-09-11T23:34:39.348 INFO:teuthology.orchestra.run.smithi037.stdout: "num_strays": 0, 2024-09-11T23:34:39.348 INFO:teuthology.orchestra.run.smithi037.stdout: "num_strays_delayed": 0, 2024-09-11T23:34:39.348 INFO:teuthology.orchestra.run.smithi037.stdout: "num_strays_enqueuing": 0, 2024-09-11T23:34:39.348 INFO:teuthology.orchestra.run.smithi037.stdout: "strays_created": 0, 2024-09-11T23:34:39.349 INFO:teuthology.orchestra.run.smithi037.stdout: "strays_enqueued": 0, 2024-09-11T23:34:39.349 INFO:teuthology.orchestra.run.smithi037.stdout: "strays_reintegrated": 0, 2024-09-11T23:34:39.349 INFO:teuthology.orchestra.run.smithi037.stdout: "strays_migrated": 0, 2024-09-11T23:34:39.349 INFO:teuthology.orchestra.run.smithi037.stdout: "num_recovering_processing": 0, 2024-09-11T23:34:39.349 INFO:teuthology.orchestra.run.smithi037.stdout: "num_recovering_enqueued": 0, 2024-09-11T23:34:39.349 INFO:teuthology.orchestra.run.smithi037.stdout: "num_recovering_prioritized": 0, 2024-09-11T23:34:39.349 INFO:teuthology.orchestra.run.smithi037.stdout: "recovery_started": 0, 2024-09-11T23:34:39.349 INFO:teuthology.orchestra.run.smithi037.stdout: "recovery_completed": 0, 2024-09-11T23:34:39.349 INFO:teuthology.orchestra.run.smithi037.stdout: "ireq_quiesce_path": 0, 2024-09-11T23:34:39.349 INFO:teuthology.orchestra.run.smithi037.stdout: "ireq_quiesce_inode": 0, 2024-09-11T23:34:39.349 INFO:teuthology.orchestra.run.smithi037.stdout: "ireq_enqueue_scrub": 0, 2024-09-11T23:34:39.349 INFO:teuthology.orchestra.run.smithi037.stdout: "ireq_exportdir": 0, 2024-09-11T23:34:39.349 INFO:teuthology.orchestra.run.smithi037.stdout: "ireq_flush": 0, 2024-09-11T23:34:39.350 INFO:teuthology.orchestra.run.smithi037.stdout: "ireq_fragmentdir": 0, 2024-09-11T23:34:39.350 INFO:teuthology.orchestra.run.smithi037.stdout: "ireq_fragstats": 0, 2024-09-11T23:34:39.350 INFO:teuthology.orchestra.run.smithi037.stdout: "ireq_inodestats": 0 2024-09-11T23:34:39.350 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:39.350 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_log": { 2024-09-11T23:34:39.350 INFO:teuthology.orchestra.run.smithi037.stdout: "evlrg": 0, 2024-09-11T23:34:39.350 INFO:teuthology.orchestra.run.smithi037.stdout: "evadd": 0, 2024-09-11T23:34:39.350 INFO:teuthology.orchestra.run.smithi037.stdout: "evex": 0, 2024-09-11T23:34:39.350 INFO:teuthology.orchestra.run.smithi037.stdout: "evtrm": 0, 2024-09-11T23:34:39.351 INFO:teuthology.orchestra.run.smithi037.stdout: "ev": 5, 2024-09-11T23:34:39.351 INFO:teuthology.orchestra.run.smithi037.stdout: "evexg": 0, 2024-09-11T23:34:39.351 INFO:teuthology.orchestra.run.smithi037.stdout: "evexd": 0, 2024-09-11T23:34:39.351 INFO:teuthology.orchestra.run.smithi037.stdout: "segadd": 0, 2024-09-11T23:34:39.351 INFO:teuthology.orchestra.run.smithi037.stdout: "segex": 0, 2024-09-11T23:34:39.351 INFO:teuthology.orchestra.run.smithi037.stdout: "segtrm": 0, 2024-09-11T23:34:39.351 INFO:teuthology.orchestra.run.smithi037.stdout: "seg": 2, 2024-09-11T23:34:39.351 INFO:teuthology.orchestra.run.smithi037.stdout: "segmjr": 2, 2024-09-11T23:34:39.351 INFO:teuthology.orchestra.run.smithi037.stdout: "segexg": 0, 2024-09-11T23:34:39.352 INFO:teuthology.orchestra.run.smithi037.stdout: "segexd": 0, 2024-09-11T23:34:39.352 INFO:teuthology.orchestra.run.smithi037.stdout: "expos": 4194304, 2024-09-11T23:34:39.352 INFO:teuthology.orchestra.run.smithi037.stdout: "wrpos": 4195737, 2024-09-11T23:34:39.352 INFO:teuthology.orchestra.run.smithi037.stdout: "rdpos": 4195426, 2024-09-11T23:34:39.352 INFO:teuthology.orchestra.run.smithi037.stdout: "jlat": { 2024-09-11T23:34:39.352 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-11T23:34:39.352 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-11T23:34:39.352 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-11T23:34:39.352 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:39.352 INFO:teuthology.orchestra.run.smithi037.stdout: "replayed": 5 2024-09-11T23:34:39.352 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:39.352 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_mem": { 2024-09-11T23:34:39.353 INFO:teuthology.orchestra.run.smithi037.stdout: "ino": 3, 2024-09-11T23:34:39.353 INFO:teuthology.orchestra.run.smithi037.stdout: "ino+": 3, 2024-09-11T23:34:39.353 INFO:teuthology.orchestra.run.smithi037.stdout: "ino-": 0, 2024-09-11T23:34:39.353 INFO:teuthology.orchestra.run.smithi037.stdout: "dir": 1, 2024-09-11T23:34:39.353 INFO:teuthology.orchestra.run.smithi037.stdout: "dir+": 1, 2024-09-11T23:34:39.353 INFO:teuthology.orchestra.run.smithi037.stdout: "dir-": 0, 2024-09-11T23:34:39.353 INFO:teuthology.orchestra.run.smithi037.stdout: "dn": 0, 2024-09-11T23:34:39.353 INFO:teuthology.orchestra.run.smithi037.stdout: "dn+": 0, 2024-09-11T23:34:39.353 INFO:teuthology.orchestra.run.smithi037.stdout: "dn-": 0, 2024-09-11T23:34:39.353 INFO:teuthology.orchestra.run.smithi037.stdout: "cap": 0, 2024-09-11T23:34:39.353 INFO:teuthology.orchestra.run.smithi037.stdout: "cap+": 0, 2024-09-11T23:34:39.353 INFO:teuthology.orchestra.run.smithi037.stdout: "cap-": 0, 2024-09-11T23:34:39.353 INFO:teuthology.orchestra.run.smithi037.stdout: "rss": 47360, 2024-09-11T23:34:39.353 INFO:teuthology.orchestra.run.smithi037.stdout: "heap": 215328 2024-09-11T23:34:39.354 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:39.354 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_server": { 2024-09-11T23:34:39.354 INFO:teuthology.orchestra.run.smithi037.stdout: "dispatch_client_request": 0, 2024-09-11T23:34:39.354 INFO:teuthology.orchestra.run.smithi037.stdout: "dispatch_server_request": 0, 2024-09-11T23:34:39.354 INFO:teuthology.orchestra.run.smithi037.stdout: "handle_client_request": 0, 2024-09-11T23:34:39.354 INFO:teuthology.orchestra.run.smithi037.stdout: "handle_client_session": 0, 2024-09-11T23:34:39.354 INFO:teuthology.orchestra.run.smithi037.stdout: "handle_peer_request": 0, 2024-09-11T23:34:39.354 INFO:teuthology.orchestra.run.smithi037.stdout: "req_create_latency": { 2024-09-11T23:34:39.354 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-11T23:34:39.354 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-11T23:34:39.354 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-11T23:34:39.354 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:39.354 INFO:teuthology.orchestra.run.smithi037.stdout: "req_getattr_latency": { 2024-09-11T23:34:39.355 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-11T23:34:39.355 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-11T23:34:39.355 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-11T23:34:39.355 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:39.355 INFO:teuthology.orchestra.run.smithi037.stdout: "req_getfilelock_latency": { 2024-09-11T23:34:39.355 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-11T23:34:39.355 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-11T23:34:39.355 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-11T23:34:39.355 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:39.355 INFO:teuthology.orchestra.run.smithi037.stdout: "req_link_latency": { 2024-09-11T23:34:39.355 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-11T23:34:39.355 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-11T23:34:39.355 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-11T23:34:39.355 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:39.356 INFO:teuthology.orchestra.run.smithi037.stdout: "req_lookup_latency": { 2024-09-11T23:34:39.356 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-11T23:34:39.356 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-11T23:34:39.356 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-11T23:34:39.356 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:39.356 INFO:teuthology.orchestra.run.smithi037.stdout: "req_lookuphash_latency": { 2024-09-11T23:34:39.356 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-11T23:34:39.356 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-11T23:34:39.356 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-11T23:34:39.356 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:39.356 INFO:teuthology.orchestra.run.smithi037.stdout: "req_lookupino_latency": { 2024-09-11T23:34:39.356 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-11T23:34:39.357 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-11T23:34:39.357 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-11T23:34:39.357 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:39.357 INFO:teuthology.orchestra.run.smithi037.stdout: "req_lookupname_latency": { 2024-09-11T23:34:39.357 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-11T23:34:39.357 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-11T23:34:39.357 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-11T23:34:39.357 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:39.357 INFO:teuthology.orchestra.run.smithi037.stdout: "req_lookupparent_latency": { 2024-09-11T23:34:39.357 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-11T23:34:39.357 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-11T23:34:39.357 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-11T23:34:39.357 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:39.358 INFO:teuthology.orchestra.run.smithi037.stdout: "req_lookupsnap_latency": { 2024-09-11T23:34:39.358 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-11T23:34:39.358 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-11T23:34:39.358 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-11T23:34:39.358 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:39.358 INFO:teuthology.orchestra.run.smithi037.stdout: "req_lssnap_latency": { 2024-09-11T23:34:39.358 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-11T23:34:39.358 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-11T23:34:39.358 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-11T23:34:39.358 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:39.358 INFO:teuthology.orchestra.run.smithi037.stdout: "req_mkdir_latency": { 2024-09-11T23:34:39.358 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-11T23:34:39.359 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-11T23:34:39.359 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-11T23:34:39.359 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:39.359 INFO:teuthology.orchestra.run.smithi037.stdout: "req_mknod_latency": { 2024-09-11T23:34:39.360 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-11T23:34:39.360 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-11T23:34:39.360 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-11T23:34:39.360 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:39.360 INFO:teuthology.orchestra.run.smithi037.stdout: "req_mksnap_latency": { 2024-09-11T23:34:39.360 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-11T23:34:39.360 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-11T23:34:39.360 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-11T23:34:39.360 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:39.360 INFO:teuthology.orchestra.run.smithi037.stdout: "req_open_latency": { 2024-09-11T23:34:39.360 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-11T23:34:39.361 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-11T23:34:39.361 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-11T23:34:39.361 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:39.361 INFO:teuthology.orchestra.run.smithi037.stdout: "req_readdir_latency": { 2024-09-11T23:34:39.361 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-11T23:34:39.361 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-11T23:34:39.361 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-11T23:34:39.361 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:39.361 INFO:teuthology.orchestra.run.smithi037.stdout: "req_rename_latency": { 2024-09-11T23:34:39.361 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-11T23:34:39.361 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-11T23:34:39.361 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-11T23:34:39.362 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:39.362 INFO:teuthology.orchestra.run.smithi037.stdout: "req_renamesnap_latency": { 2024-09-11T23:34:39.362 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-11T23:34:39.362 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-11T23:34:39.362 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-11T23:34:39.362 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:39.362 INFO:teuthology.orchestra.run.smithi037.stdout: "req_snapdiff_latency": { 2024-09-11T23:34:39.362 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-11T23:34:39.362 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-11T23:34:39.362 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-11T23:34:39.363 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:39.363 INFO:teuthology.orchestra.run.smithi037.stdout: "req_rmdir_latency": { 2024-09-11T23:34:39.363 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-11T23:34:39.363 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-11T23:34:39.363 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-11T23:34:39.363 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:39.363 INFO:teuthology.orchestra.run.smithi037.stdout: "req_rmsnap_latency": { 2024-09-11T23:34:39.363 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-11T23:34:39.363 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-11T23:34:39.363 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-11T23:34:39.363 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:39.363 INFO:teuthology.orchestra.run.smithi037.stdout: "req_rmxattr_latency": { 2024-09-11T23:34:39.364 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-11T23:34:39.364 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-11T23:34:39.364 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-11T23:34:39.364 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:39.364 INFO:teuthology.orchestra.run.smithi037.stdout: "req_setattr_latency": { 2024-09-11T23:34:39.364 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-11T23:34:39.364 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-11T23:34:39.365 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-11T23:34:39.365 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:39.365 INFO:teuthology.orchestra.run.smithi037.stdout: "req_setdirlayout_latency": { 2024-09-11T23:34:39.365 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-11T23:34:39.365 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-11T23:34:39.365 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-11T23:34:39.365 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:39.365 INFO:teuthology.orchestra.run.smithi037.stdout: "req_setfilelock_latency": { 2024-09-11T23:34:39.365 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-11T23:34:39.365 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-11T23:34:39.366 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-11T23:34:39.366 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:39.366 INFO:teuthology.orchestra.run.smithi037.stdout: "req_setlayout_latency": { 2024-09-11T23:34:39.366 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-11T23:34:39.366 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-11T23:34:39.366 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-11T23:34:39.366 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:39.366 INFO:teuthology.orchestra.run.smithi037.stdout: "req_setxattr_latency": { 2024-09-11T23:34:39.366 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-11T23:34:39.366 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-11T23:34:39.367 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-11T23:34:39.367 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:39.367 INFO:teuthology.orchestra.run.smithi037.stdout: "req_symlink_latency": { 2024-09-11T23:34:39.367 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-11T23:34:39.367 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-11T23:34:39.367 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-11T23:34:39.367 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:39.367 INFO:teuthology.orchestra.run.smithi037.stdout: "req_unlink_latency": { 2024-09-11T23:34:39.367 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-11T23:34:39.367 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-11T23:34:39.367 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-11T23:34:39.368 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:39.368 INFO:teuthology.orchestra.run.smithi037.stdout: "cap_revoke_eviction": 0, 2024-09-11T23:34:39.368 INFO:teuthology.orchestra.run.smithi037.stdout: "cap_acquisition_throttle": 0, 2024-09-11T23:34:39.368 INFO:teuthology.orchestra.run.smithi037.stdout: "req_getvxattr_latency": { 2024-09-11T23:34:39.368 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-11T23:34:39.368 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-11T23:34:39.368 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-11T23:34:39.369 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:39.369 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:39.369 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_sessions": { 2024-09-11T23:34:39.369 INFO:teuthology.orchestra.run.smithi037.stdout: "session_count": 1, 2024-09-11T23:34:39.369 INFO:teuthology.orchestra.run.smithi037.stdout: "session_add": 2, 2024-09-11T23:34:39.369 INFO:teuthology.orchestra.run.smithi037.stdout: "session_remove": 1, 2024-09-11T23:34:39.369 INFO:teuthology.orchestra.run.smithi037.stdout: "sessions_open": 1, 2024-09-11T23:34:39.369 INFO:teuthology.orchestra.run.smithi037.stdout: "sessions_stale": 0, 2024-09-11T23:34:39.369 INFO:teuthology.orchestra.run.smithi037.stdout: "total_load": 0, 2024-09-11T23:34:39.369 INFO:teuthology.orchestra.run.smithi037.stdout: "average_load": 0, 2024-09-11T23:34:39.369 INFO:teuthology.orchestra.run.smithi037.stdout: "avg_session_uptime": 2118, 2024-09-11T23:34:39.369 INFO:teuthology.orchestra.run.smithi037.stdout: "mdthresh_evicted": 0 2024-09-11T23:34:39.370 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:39.370 INFO:teuthology.orchestra.run.smithi037.stdout: "mempool": { 2024-09-11T23:34:39.370 INFO:teuthology.orchestra.run.smithi037.stdout: "bloom_filter_bytes": 0, 2024-09-11T23:34:39.370 INFO:teuthology.orchestra.run.smithi037.stdout: "bloom_filter_items": 0, 2024-09-11T23:34:39.370 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_alloc_bytes": 0, 2024-09-11T23:34:39.370 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_alloc_items": 0, 2024-09-11T23:34:39.370 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_data_bytes": 0, 2024-09-11T23:34:39.370 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_data_items": 0, 2024-09-11T23:34:39.370 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-11T23:34:39.370 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_onode_items": 0, 2024-09-11T23:34:39.370 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-11T23:34:39.371 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_meta_items": 0, 2024-09-11T23:34:39.371 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_other_bytes": 0, 2024-09-11T23:34:39.371 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_other_items": 0, 2024-09-11T23:34:39.371 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-11T23:34:39.371 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_buffer_items": 0, 2024-09-11T23:34:39.371 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_extent_bytes": 0, 2024-09-11T23:34:39.371 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_extent_items": 0, 2024-09-11T23:34:39.371 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_blob_bytes": 0, 2024-09-11T23:34:39.371 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_blob_items": 0, 2024-09-11T23:34:39.371 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-11T23:34:39.371 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_shared_blob_items": 0, 2024-09-11T23:34:39.372 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-11T23:34:39.372 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_inline_bl_items": 0, 2024-09-11T23:34:39.372 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_fsck_bytes": 0, 2024-09-11T23:34:39.372 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_fsck_items": 0, 2024-09-11T23:34:39.372 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_txc_bytes": 0, 2024-09-11T23:34:39.372 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_txc_items": 0, 2024-09-11T23:34:39.372 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-11T23:34:39.372 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_writing_deferred_items": 0, 2024-09-11T23:34:39.373 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_writing_bytes": 0, 2024-09-11T23:34:39.373 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_writing_items": 0, 2024-09-11T23:34:39.373 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_bytes": 0, 2024-09-11T23:34:39.373 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_items": 0, 2024-09-11T23:34:39.373 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_file_reader_bytes": 0, 2024-09-11T23:34:39.373 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_file_reader_items": 0, 2024-09-11T23:34:39.373 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_file_writer_bytes": 0, 2024-09-11T23:34:39.373 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_file_writer_items": 0, 2024-09-11T23:34:39.373 INFO:teuthology.orchestra.run.smithi037.stdout: "buffer_anon_bytes": 190184, 2024-09-11T23:34:39.373 INFO:teuthology.orchestra.run.smithi037.stdout: "buffer_anon_items": 53, 2024-09-11T23:34:39.373 INFO:teuthology.orchestra.run.smithi037.stdout: "buffer_meta_bytes": 0, 2024-09-11T23:34:39.374 INFO:teuthology.orchestra.run.smithi037.stdout: "buffer_meta_items": 0, 2024-09-11T23:34:39.374 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_bytes": 0, 2024-09-11T23:34:39.374 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_items": 0, 2024-09-11T23:34:39.374 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mapbl_bytes": 0, 2024-09-11T23:34:39.374 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mapbl_items": 0, 2024-09-11T23:34:39.374 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pglog_bytes": 0, 2024-09-11T23:34:39.374 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pglog_items": 0, 2024-09-11T23:34:39.374 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_bytes": 9336, 2024-09-11T23:34:39.374 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_items": 176, 2024-09-11T23:34:39.374 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_mapping_bytes": 0, 2024-09-11T23:34:39.374 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_mapping_items": 0, 2024-09-11T23:34:39.375 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap_bytes": 0, 2024-09-11T23:34:39.375 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap_items": 0, 2024-09-11T23:34:39.375 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_co_bytes": 8512, 2024-09-11T23:34:39.375 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_co_items": 13, 2024-09-11T23:34:39.375 INFO:teuthology.orchestra.run.smithi037.stdout: "unittest_1_bytes": 0, 2024-09-11T23:34:39.375 INFO:teuthology.orchestra.run.smithi037.stdout: "unittest_1_items": 0, 2024-09-11T23:34:39.375 INFO:teuthology.orchestra.run.smithi037.stdout: "unittest_2_bytes": 0, 2024-09-11T23:34:39.375 INFO:teuthology.orchestra.run.smithi037.stdout: "unittest_2_items": 0 2024-09-11T23:34:39.375 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:39.375 INFO:teuthology.orchestra.run.smithi037.stdout: "objecter": { 2024-09-11T23:34:39.376 INFO:teuthology.orchestra.run.smithi037.stdout: "op_active": 0, 2024-09-11T23:34:39.376 INFO:teuthology.orchestra.run.smithi037.stdout: "op_laggy": 0, 2024-09-11T23:34:39.376 INFO:teuthology.orchestra.run.smithi037.stdout: "op_send": 3080, 2024-09-11T23:34:39.376 INFO:teuthology.orchestra.run.smithi037.stdout: "op_send_bytes": 21, 2024-09-11T23:34:39.376 INFO:teuthology.orchestra.run.smithi037.stdout: "op_resend": 3, 2024-09-11T23:34:39.376 INFO:teuthology.orchestra.run.smithi037.stdout: "op_reply": 3080, 2024-09-11T23:34:39.376 INFO:teuthology.orchestra.run.smithi037.stdout: "op_latency": { 2024-09-11T23:34:39.376 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 3080, 2024-09-11T23:34:39.376 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 6.283922441, 2024-09-11T23:34:39.377 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.002040234 2024-09-11T23:34:39.377 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:39.377 INFO:teuthology.orchestra.run.smithi037.stdout: "op_inflight": 0, 2024-09-11T23:34:39.377 INFO:teuthology.orchestra.run.smithi037.stdout: "oplen_avg": { 2024-09-11T23:34:39.377 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 3080, 2024-09-11T23:34:39.377 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 3081 2024-09-11T23:34:39.377 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:39.377 INFO:teuthology.orchestra.run.smithi037.stdout: "op": 3080, 2024-09-11T23:34:39.377 INFO:teuthology.orchestra.run.smithi037.stdout: "op_r": 3080, 2024-09-11T23:34:39.377 INFO:teuthology.orchestra.run.smithi037.stdout: "op_w": 0, 2024-09-11T23:34:39.378 INFO:teuthology.orchestra.run.smithi037.stdout: "op_rmw": 0, 2024-09-11T23:34:39.378 INFO:teuthology.orchestra.run.smithi037.stdout: "op_pg": 0, 2024-09-11T23:34:39.378 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_stat": 2021, 2024-09-11T23:34:39.378 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_create": 0, 2024-09-11T23:34:39.378 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_read": 1057, 2024-09-11T23:34:39.378 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_write": 0, 2024-09-11T23:34:39.378 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_writefull": 0, 2024-09-11T23:34:39.378 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_writesame": 0, 2024-09-11T23:34:39.378 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_append": 0, 2024-09-11T23:34:39.378 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_zero": 0, 2024-09-11T23:34:39.379 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_truncate": 0, 2024-09-11T23:34:39.379 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_delete": 0, 2024-09-11T23:34:39.379 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_mapext": 0, 2024-09-11T23:34:39.379 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_sparse_read": 0, 2024-09-11T23:34:39.379 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_clonerange": 0, 2024-09-11T23:34:39.379 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_getxattr": 1, 2024-09-11T23:34:39.379 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_setxattr": 0, 2024-09-11T23:34:39.379 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_cmpxattr": 0, 2024-09-11T23:34:39.379 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_rmxattr": 0, 2024-09-11T23:34:39.379 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_resetxattrs": 0, 2024-09-11T23:34:39.379 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_call": 0, 2024-09-11T23:34:39.379 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_watch": 0, 2024-09-11T23:34:39.379 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_notify": 0, 2024-09-11T23:34:39.379 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_src_cmpxattr": 0, 2024-09-11T23:34:39.380 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_pgls": 0, 2024-09-11T23:34:39.380 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_pgls_filter": 0, 2024-09-11T23:34:39.380 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_other": 0, 2024-09-11T23:34:39.380 INFO:teuthology.orchestra.run.smithi037.stdout: "linger_active": 0, 2024-09-11T23:34:39.380 INFO:teuthology.orchestra.run.smithi037.stdout: "linger_send": 0, 2024-09-11T23:34:39.380 INFO:teuthology.orchestra.run.smithi037.stdout: "linger_resend": 0, 2024-09-11T23:34:39.380 INFO:teuthology.orchestra.run.smithi037.stdout: "linger_ping": 0, 2024-09-11T23:34:39.380 INFO:teuthology.orchestra.run.smithi037.stdout: "poolop_active": 0, 2024-09-11T23:34:39.380 INFO:teuthology.orchestra.run.smithi037.stdout: "poolop_send": 0, 2024-09-11T23:34:39.380 INFO:teuthology.orchestra.run.smithi037.stdout: "poolop_resend": 0, 2024-09-11T23:34:39.380 INFO:teuthology.orchestra.run.smithi037.stdout: "poolstat_active": 0, 2024-09-11T23:34:39.380 INFO:teuthology.orchestra.run.smithi037.stdout: "poolstat_send": 0, 2024-09-11T23:34:39.380 INFO:teuthology.orchestra.run.smithi037.stdout: "poolstat_resend": 0, 2024-09-11T23:34:39.381 INFO:teuthology.orchestra.run.smithi037.stdout: "statfs_active": 0, 2024-09-11T23:34:39.381 INFO:teuthology.orchestra.run.smithi037.stdout: "statfs_send": 0, 2024-09-11T23:34:39.381 INFO:teuthology.orchestra.run.smithi037.stdout: "statfs_resend": 0, 2024-09-11T23:34:39.381 INFO:teuthology.orchestra.run.smithi037.stdout: "command_active": 0, 2024-09-11T23:34:39.381 INFO:teuthology.orchestra.run.smithi037.stdout: "command_send": 0, 2024-09-11T23:34:39.381 INFO:teuthology.orchestra.run.smithi037.stdout: "command_resend": 0, 2024-09-11T23:34:39.381 INFO:teuthology.orchestra.run.smithi037.stdout: "map_epoch": 95, 2024-09-11T23:34:39.381 INFO:teuthology.orchestra.run.smithi037.stdout: "map_full": 0, 2024-09-11T23:34:39.381 INFO:teuthology.orchestra.run.smithi037.stdout: "map_inc": 2, 2024-09-11T23:34:39.381 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_sessions": 5, 2024-09-11T23:34:39.381 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_session_open": 7, 2024-09-11T23:34:39.381 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_session_close": 2, 2024-09-11T23:34:39.381 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_laggy": 0, 2024-09-11T23:34:39.382 INFO:teuthology.orchestra.run.smithi037.stdout: "omap_wr": 0, 2024-09-11T23:34:39.382 INFO:teuthology.orchestra.run.smithi037.stdout: "omap_rd": 2, 2024-09-11T23:34:39.382 INFO:teuthology.orchestra.run.smithi037.stdout: "omap_del": 0 2024-09-11T23:34:39.382 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:39.382 INFO:teuthology.orchestra.run.smithi037.stdout: "oft": { 2024-09-11T23:34:39.382 INFO:teuthology.orchestra.run.smithi037.stdout: "omap_total_objs": 0, 2024-09-11T23:34:39.382 INFO:teuthology.orchestra.run.smithi037.stdout: "omap_total_kv_pairs": 0, 2024-09-11T23:34:39.382 INFO:teuthology.orchestra.run.smithi037.stdout: "omap_total_updates": 0, 2024-09-11T23:34:39.382 INFO:teuthology.orchestra.run.smithi037.stdout: "omap_total_removes": 0 2024-09-11T23:34:39.382 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:39.382 INFO:teuthology.orchestra.run.smithi037.stdout: "osd-slow-ops": { 2024-09-11T23:34:39.382 INFO:teuthology.orchestra.run.smithi037.stdout: "slow_ops_count": 0 2024-09-11T23:34:39.382 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:39.383 INFO:teuthology.orchestra.run.smithi037.stdout: "purge_queue": { 2024-09-11T23:34:39.383 INFO:teuthology.orchestra.run.smithi037.stdout: "pq_executing_ops": 0, 2024-09-11T23:34:39.383 INFO:teuthology.orchestra.run.smithi037.stdout: "pq_executing_ops_high_water": 0, 2024-09-11T23:34:39.383 INFO:teuthology.orchestra.run.smithi037.stdout: "pq_executing": 0, 2024-09-11T23:34:39.383 INFO:teuthology.orchestra.run.smithi037.stdout: "pq_executing_high_water": 0, 2024-09-11T23:34:39.383 INFO:teuthology.orchestra.run.smithi037.stdout: "pq_executed_ops": 0, 2024-09-11T23:34:39.383 INFO:teuthology.orchestra.run.smithi037.stdout: "pq_executed": 0, 2024-09-11T23:34:39.383 INFO:teuthology.orchestra.run.smithi037.stdout: "pq_item_in_journal": 0 2024-09-11T23:34:39.383 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:39.383 INFO:teuthology.orchestra.run.smithi037.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-11T23:34:39.383 INFO:teuthology.orchestra.run.smithi037.stdout: "val": 0, 2024-09-11T23:34:39.383 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 104857600, 2024-09-11T23:34:39.383 INFO:teuthology.orchestra.run.smithi037.stdout: "get_started": 0, 2024-09-11T23:34:39.383 INFO:teuthology.orchestra.run.smithi037.stdout: "get": 3395, 2024-09-11T23:34:39.384 INFO:teuthology.orchestra.run.smithi037.stdout: "get_sum": 1359050, 2024-09-11T23:34:39.384 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_fail": 0, 2024-09-11T23:34:39.384 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_success": 3395, 2024-09-11T23:34:39.384 INFO:teuthology.orchestra.run.smithi037.stdout: "take": 0, 2024-09-11T23:34:39.384 INFO:teuthology.orchestra.run.smithi037.stdout: "take_sum": 0, 2024-09-11T23:34:39.384 INFO:teuthology.orchestra.run.smithi037.stdout: "put": 3395, 2024-09-11T23:34:39.384 INFO:teuthology.orchestra.run.smithi037.stdout: "put_sum": 1359050, 2024-09-11T23:34:39.384 INFO:teuthology.orchestra.run.smithi037.stdout: "wait": { 2024-09-11T23:34:39.384 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-11T23:34:39.384 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-11T23:34:39.384 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-11T23:34:39.384 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:39.384 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:39.384 INFO:teuthology.orchestra.run.smithi037.stdout: "throttle-objecter_bytes": { 2024-09-11T23:34:39.385 INFO:teuthology.orchestra.run.smithi037.stdout: "val": 0, 2024-09-11T23:34:39.385 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 104857600, 2024-09-11T23:34:39.385 INFO:teuthology.orchestra.run.smithi037.stdout: "get_started": 0, 2024-09-11T23:34:39.385 INFO:teuthology.orchestra.run.smithi037.stdout: "get": 0, 2024-09-11T23:34:39.385 INFO:teuthology.orchestra.run.smithi037.stdout: "get_sum": 0, 2024-09-11T23:34:39.385 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_fail": 0, 2024-09-11T23:34:39.385 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_success": 0, 2024-09-11T23:34:39.385 INFO:teuthology.orchestra.run.smithi037.stdout: "take": 3080, 2024-09-11T23:34:39.385 INFO:teuthology.orchestra.run.smithi037.stdout: "take_sum": 1438, 2024-09-11T23:34:39.385 INFO:teuthology.orchestra.run.smithi037.stdout: "put": 3080, 2024-09-11T23:34:39.385 INFO:teuthology.orchestra.run.smithi037.stdout: "put_sum": 1438, 2024-09-11T23:34:39.385 INFO:teuthology.orchestra.run.smithi037.stdout: "wait": { 2024-09-11T23:34:39.385 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-11T23:34:39.385 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-11T23:34:39.386 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-11T23:34:39.386 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:39.386 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:39.386 INFO:teuthology.orchestra.run.smithi037.stdout: "throttle-objecter_ops": { 2024-09-11T23:34:39.386 INFO:teuthology.orchestra.run.smithi037.stdout: "val": 0, 2024-09-11T23:34:39.386 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 1024, 2024-09-11T23:34:39.386 INFO:teuthology.orchestra.run.smithi037.stdout: "get_started": 0, 2024-09-11T23:34:39.386 INFO:teuthology.orchestra.run.smithi037.stdout: "get": 0, 2024-09-11T23:34:39.386 INFO:teuthology.orchestra.run.smithi037.stdout: "get_sum": 0, 2024-09-11T23:34:39.386 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_fail": 0, 2024-09-11T23:34:39.386 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_success": 0, 2024-09-11T23:34:39.386 INFO:teuthology.orchestra.run.smithi037.stdout: "take": 3080, 2024-09-11T23:34:39.386 INFO:teuthology.orchestra.run.smithi037.stdout: "take_sum": 3080, 2024-09-11T23:34:39.386 INFO:teuthology.orchestra.run.smithi037.stdout: "put": 3080, 2024-09-11T23:34:39.387 INFO:teuthology.orchestra.run.smithi037.stdout: "put_sum": 3080, 2024-09-11T23:34:39.387 INFO:teuthology.orchestra.run.smithi037.stdout: "wait": { 2024-09-11T23:34:39.387 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-11T23:34:39.387 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-11T23:34:39.387 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-11T23:34:39.387 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:39.387 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:39.387 INFO:teuthology.orchestra.run.smithi037.stdout: "throttle-write_buf_throttle": { 2024-09-11T23:34:39.387 INFO:teuthology.orchestra.run.smithi037.stdout: "val": 0, 2024-09-11T23:34:39.387 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 3758096384, 2024-09-11T23:34:39.387 INFO:teuthology.orchestra.run.smithi037.stdout: "get_started": 0, 2024-09-11T23:34:39.387 INFO:teuthology.orchestra.run.smithi037.stdout: "get": 0, 2024-09-11T23:34:39.387 INFO:teuthology.orchestra.run.smithi037.stdout: "get_sum": 0, 2024-09-11T23:34:39.388 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_fail": 0, 2024-09-11T23:34:39.388 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_success": 0, 2024-09-11T23:34:39.388 INFO:teuthology.orchestra.run.smithi037.stdout: "take": 0, 2024-09-11T23:34:39.388 INFO:teuthology.orchestra.run.smithi037.stdout: "take_sum": 0, 2024-09-11T23:34:39.388 INFO:teuthology.orchestra.run.smithi037.stdout: "put": 0, 2024-09-11T23:34:39.388 INFO:teuthology.orchestra.run.smithi037.stdout: "put_sum": 0, 2024-09-11T23:34:39.388 INFO:teuthology.orchestra.run.smithi037.stdout: "wait": { 2024-09-11T23:34:39.388 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-11T23:34:39.388 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-11T23:34:39.388 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-11T23:34:39.388 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:39.388 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:39.388 INFO:teuthology.orchestra.run.smithi037.stdout: "throttle-write_buf_throttle-0x5650955e0be0": { 2024-09-11T23:34:39.388 INFO:teuthology.orchestra.run.smithi037.stdout: "val": 0, 2024-09-11T23:34:39.389 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 3758096384, 2024-09-11T23:34:39.389 INFO:teuthology.orchestra.run.smithi037.stdout: "get_started": 0, 2024-09-11T23:34:39.389 INFO:teuthology.orchestra.run.smithi037.stdout: "get": 0, 2024-09-11T23:34:39.389 INFO:teuthology.orchestra.run.smithi037.stdout: "get_sum": 0, 2024-09-11T23:34:39.389 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_fail": 0, 2024-09-11T23:34:39.389 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_success": 0, 2024-09-11T23:34:39.389 INFO:teuthology.orchestra.run.smithi037.stdout: "take": 0, 2024-09-11T23:34:39.389 INFO:teuthology.orchestra.run.smithi037.stdout: "take_sum": 0, 2024-09-11T23:34:39.389 INFO:teuthology.orchestra.run.smithi037.stdout: "put": 0, 2024-09-11T23:34:39.389 INFO:teuthology.orchestra.run.smithi037.stdout: "put_sum": 0, 2024-09-11T23:34:39.389 INFO:teuthology.orchestra.run.smithi037.stdout: "wait": { 2024-09-11T23:34:39.389 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-11T23:34:39.389 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-11T23:34:39.390 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-11T23:34:39.390 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:39.390 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:39.390 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-11T23:34:40.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:34:39 smithi160 ceph-mon[35055]: pgmap v858: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 4.4 MiB/s wr, 487 op/s 2024-09-11T23:34:40.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:34:39 smithi123 ceph-mon[35438]: pgmap v858: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 4.4 MiB/s wr, 487 op/s 2024-09-11T23:34:40.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:34:39 smithi037 ceph-mon[30630]: pgmap v858: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 4.4 MiB/s wr, 487 op/s 2024-09-11T23:34:42.075 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:34:41 smithi037 ceph-mon[30630]: pgmap v859: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 3.8 MiB/s wr, 424 op/s 2024-09-11T23:34:42.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:34:41 smithi160 ceph-mon[35055]: pgmap v859: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 3.8 MiB/s wr, 424 op/s 2024-09-11T23:34:42.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:34:41 smithi123 ceph-mon[35438]: pgmap v859: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 3.8 MiB/s wr, 424 op/s 2024-09-11T23:34:42.486 INFO:tasks.check_counter:Daemon mds.a mds.exported=0 2024-09-11T23:34:42.486 INFO:tasks.check_counter:Daemon mds.a mds.imported=0 2024-09-11T23:34:42.486 DEBUG:tasks.check_counter:Getting stats from d 2024-09-11T23:34:42.487 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph daemon mds.d perf dump 2024-09-11T23:34:42.872 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:34:43.610 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-11T23:34:43.611 INFO:teuthology.orchestra.run.smithi037.stdout: "AsyncMessenger::Worker-0": { 2024-09-11T23:34:43.611 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_messages": 315, 2024-09-11T23:34:43.611 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages": 308, 2024-09-11T23:34:43.611 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_bytes": 783168, 2024-09-11T23:34:43.611 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_bytes": 189168, 2024-09-11T23:34:43.611 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_created_connections": 4, 2024-09-11T23:34:43.611 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_active_connections": 0, 2024-09-11T23:34:43.611 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_total_time": 0.119399767, 2024-09-11T23:34:43.611 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_send_time": 0.074367696, 2024-09-11T23:34:43.611 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_recv_time": 0.049639448, 2024-09-11T23:34:43.612 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T23:34:43.612 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T23:34:43.612 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 308, 2024-09-11T23:34:43.612 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.086328481, 2024-09-11T23:34:43.612 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000280287 2024-09-11T23:34:43.612 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:43.612 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_handle_ack_lat": { 2024-09-11T23:34:43.612 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-11T23:34:43.612 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-11T23:34:43.612 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-11T23:34:43.612 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:43.613 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_encrypted_bytes": 783168, 2024-09-11T23:34:43.613 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_encrypted_bytes": 189168 2024-09-11T23:34:43.613 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:43.613 INFO:teuthology.orchestra.run.smithi037.stdout: "AsyncMessenger::Worker-1": { 2024-09-11T23:34:43.613 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_messages": 2, 2024-09-11T23:34:43.613 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages": 233, 2024-09-11T23:34:43.613 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_bytes": 320, 2024-09-11T23:34:43.613 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_bytes": 198448, 2024-09-11T23:34:43.613 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_created_connections": 4, 2024-09-11T23:34:43.613 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_active_connections": 2, 2024-09-11T23:34:43.614 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_total_time": 0.032899479, 2024-09-11T23:34:43.614 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_send_time": 0.027007519, 2024-09-11T23:34:43.614 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_recv_time": 0.003122078, 2024-09-11T23:34:43.614 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T23:34:43.614 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T23:34:43.614 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 231, 2024-09-11T23:34:43.614 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.050002810, 2024-09-11T23:34:43.614 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000216462 2024-09-11T23:34:43.614 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:43.614 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_handle_ack_lat": { 2024-09-11T23:34:43.614 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-11T23:34:43.615 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-11T23:34:43.615 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-11T23:34:43.615 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:43.615 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-11T23:34:43.615 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_encrypted_bytes": 198448 2024-09-11T23:34:43.615 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:43.615 INFO:teuthology.orchestra.run.smithi037.stdout: "AsyncMessenger::Worker-2": { 2024-09-11T23:34:43.615 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_messages": 0, 2024-09-11T23:34:43.615 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages": 2, 2024-09-11T23:34:43.615 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_bytes": 0, 2024-09-11T23:34:43.616 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_bytes": 0, 2024-09-11T23:34:43.616 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_created_connections": 2, 2024-09-11T23:34:43.616 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_active_connections": 1, 2024-09-11T23:34:43.616 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_total_time": 0.000814511, 2024-09-11T23:34:43.616 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_send_time": 0.000000000, 2024-09-11T23:34:43.616 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_recv_time": 0.000626352, 2024-09-11T23:34:43.616 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T23:34:43.616 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T23:34:43.616 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-11T23:34:43.616 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-11T23:34:43.616 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-11T23:34:43.616 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:43.616 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_handle_ack_lat": { 2024-09-11T23:34:43.617 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-11T23:34:43.617 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-11T23:34:43.617 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-11T23:34:43.617 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:43.617 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-11T23:34:43.617 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_encrypted_bytes": 0 2024-09-11T23:34:43.617 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:43.617 INFO:teuthology.orchestra.run.smithi037.stdout: "cct": { 2024-09-11T23:34:43.617 INFO:teuthology.orchestra.run.smithi037.stdout: "total_workers": 0, 2024-09-11T23:34:43.617 INFO:teuthology.orchestra.run.smithi037.stdout: "unhealthy_workers": 0 2024-09-11T23:34:43.617 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:43.617 INFO:teuthology.orchestra.run.smithi037.stdout: "mempool": { 2024-09-11T23:34:43.617 INFO:teuthology.orchestra.run.smithi037.stdout: "bloom_filter_bytes": 0, 2024-09-11T23:34:43.618 INFO:teuthology.orchestra.run.smithi037.stdout: "bloom_filter_items": 0, 2024-09-11T23:34:43.618 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_alloc_bytes": 0, 2024-09-11T23:34:43.618 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_alloc_items": 0, 2024-09-11T23:34:43.618 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_data_bytes": 0, 2024-09-11T23:34:43.618 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_data_items": 0, 2024-09-11T23:34:43.618 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-11T23:34:43.618 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_onode_items": 0, 2024-09-11T23:34:43.618 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-11T23:34:43.618 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_meta_items": 0, 2024-09-11T23:34:43.618 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_other_bytes": 0, 2024-09-11T23:34:43.618 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_other_items": 0, 2024-09-11T23:34:43.618 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-11T23:34:43.618 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_buffer_items": 0, 2024-09-11T23:34:43.618 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_extent_bytes": 0, 2024-09-11T23:34:43.619 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_extent_items": 0, 2024-09-11T23:34:43.619 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_blob_bytes": 0, 2024-09-11T23:34:43.619 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_blob_items": 0, 2024-09-11T23:34:43.619 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-11T23:34:43.619 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_shared_blob_items": 0, 2024-09-11T23:34:43.619 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-11T23:34:43.619 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_inline_bl_items": 0, 2024-09-11T23:34:43.619 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_fsck_bytes": 0, 2024-09-11T23:34:43.619 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_fsck_items": 0, 2024-09-11T23:34:43.619 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_txc_bytes": 0, 2024-09-11T23:34:43.619 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_txc_items": 0, 2024-09-11T23:34:43.619 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-11T23:34:43.620 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_writing_deferred_items": 0, 2024-09-11T23:34:43.620 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_writing_bytes": 0, 2024-09-11T23:34:43.620 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_writing_items": 0, 2024-09-11T23:34:43.620 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_bytes": 0, 2024-09-11T23:34:43.620 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_items": 0, 2024-09-11T23:34:43.621 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_file_reader_bytes": 0, 2024-09-11T23:34:43.621 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_file_reader_items": 0, 2024-09-11T23:34:43.621 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_file_writer_bytes": 0, 2024-09-11T23:34:43.621 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_file_writer_items": 0, 2024-09-11T23:34:43.621 INFO:teuthology.orchestra.run.smithi037.stdout: "buffer_anon_bytes": 148704, 2024-09-11T23:34:43.621 INFO:teuthology.orchestra.run.smithi037.stdout: "buffer_anon_items": 29, 2024-09-11T23:34:43.621 INFO:teuthology.orchestra.run.smithi037.stdout: "buffer_meta_bytes": 0, 2024-09-11T23:34:43.621 INFO:teuthology.orchestra.run.smithi037.stdout: "buffer_meta_items": 0, 2024-09-11T23:34:43.621 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_bytes": 0, 2024-09-11T23:34:43.622 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_items": 0, 2024-09-11T23:34:43.622 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mapbl_bytes": 0, 2024-09-11T23:34:43.622 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mapbl_items": 0, 2024-09-11T23:34:43.622 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pglog_bytes": 0, 2024-09-11T23:34:43.622 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pglog_items": 0, 2024-09-11T23:34:43.622 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_bytes": 0, 2024-09-11T23:34:43.622 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_items": 0, 2024-09-11T23:34:43.622 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_mapping_bytes": 0, 2024-09-11T23:34:43.622 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_mapping_items": 0, 2024-09-11T23:34:43.622 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap_bytes": 0, 2024-09-11T23:34:43.622 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap_items": 0, 2024-09-11T23:34:43.623 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_co_bytes": 928, 2024-09-11T23:34:43.623 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_co_items": 2, 2024-09-11T23:34:43.623 INFO:teuthology.orchestra.run.smithi037.stdout: "unittest_1_bytes": 0, 2024-09-11T23:34:43.623 INFO:teuthology.orchestra.run.smithi037.stdout: "unittest_1_items": 0, 2024-09-11T23:34:43.623 INFO:teuthology.orchestra.run.smithi037.stdout: "unittest_2_bytes": 0, 2024-09-11T23:34:43.623 INFO:teuthology.orchestra.run.smithi037.stdout: "unittest_2_items": 0 2024-09-11T23:34:43.623 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:43.623 INFO:teuthology.orchestra.run.smithi037.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-11T23:34:43.623 INFO:teuthology.orchestra.run.smithi037.stdout: "val": 0, 2024-09-11T23:34:43.624 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 104857600, 2024-09-11T23:34:43.624 INFO:teuthology.orchestra.run.smithi037.stdout: "get_started": 0, 2024-09-11T23:34:43.624 INFO:teuthology.orchestra.run.smithi037.stdout: "get": 313, 2024-09-11T23:34:43.624 INFO:teuthology.orchestra.run.smithi037.stdout: "get_sum": 736220, 2024-09-11T23:34:43.624 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_fail": 0, 2024-09-11T23:34:43.624 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_success": 313, 2024-09-11T23:34:43.624 INFO:teuthology.orchestra.run.smithi037.stdout: "take": 0, 2024-09-11T23:34:43.624 INFO:teuthology.orchestra.run.smithi037.stdout: "take_sum": 0, 2024-09-11T23:34:43.624 INFO:teuthology.orchestra.run.smithi037.stdout: "put": 313, 2024-09-11T23:34:43.624 INFO:teuthology.orchestra.run.smithi037.stdout: "put_sum": 736220, 2024-09-11T23:34:43.625 INFO:teuthology.orchestra.run.smithi037.stdout: "wait": { 2024-09-11T23:34:43.625 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-11T23:34:43.625 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-11T23:34:43.625 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-11T23:34:43.625 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:43.625 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:43.625 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-11T23:34:44.012 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:34:43 smithi037 ceph-mon[30630]: pgmap v860: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 2.6 MiB/s wr, 324 op/s 2024-09-11T23:34:44.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:34:43 smithi160 ceph-mon[35055]: pgmap v860: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 2.6 MiB/s wr, 324 op/s 2024-09-11T23:34:44.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:34:43 smithi123 ceph-mon[35438]: pgmap v860: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 2.6 MiB/s wr, 324 op/s 2024-09-11T23:34:44.320 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-09-11T23:34:44.320 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-09-11T23:34:44.320 DEBUG:tasks.check_counter:Getting stats from g 2024-09-11T23:34:44.321 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph daemon mds.g perf dump 2024-09-11T23:34:44.700 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:34:45.427 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-11T23:34:45.427 INFO:teuthology.orchestra.run.smithi037.stdout: "AsyncMessenger::Worker-0": { 2024-09-11T23:34:45.428 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_messages": 1002, 2024-09-11T23:34:45.428 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages": 1003, 2024-09-11T23:34:45.428 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_bytes": 336715, 2024-09-11T23:34:45.428 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_bytes": 318319, 2024-09-11T23:34:45.428 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_created_connections": 7, 2024-09-11T23:34:45.428 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_active_connections": 2, 2024-09-11T23:34:45.428 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_total_time": 0.205619658, 2024-09-11T23:34:45.428 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_send_time": 0.079185646, 2024-09-11T23:34:45.428 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_recv_time": 0.042978018, 2024-09-11T23:34:45.428 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_fast_dispatch_time": 0.060516142, 2024-09-11T23:34:45.428 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T23:34:45.428 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 1001, 2024-09-11T23:34:45.429 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.254590754, 2024-09-11T23:34:45.429 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000254336 2024-09-11T23:34:45.429 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:45.429 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_handle_ack_lat": { 2024-09-11T23:34:45.429 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-11T23:34:45.429 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-11T23:34:45.429 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-11T23:34:45.429 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:45.429 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-11T23:34:45.429 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_encrypted_bytes": 0 2024-09-11T23:34:45.429 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:45.429 INFO:teuthology.orchestra.run.smithi037.stdout: "AsyncMessenger::Worker-1": { 2024-09-11T23:34:45.430 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_messages": 2245, 2024-09-11T23:34:45.430 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages": 2236, 2024-09-11T23:34:45.430 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_bytes": 1303856, 2024-09-11T23:34:45.430 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_bytes": 799999, 2024-09-11T23:34:45.430 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_created_connections": 4, 2024-09-11T23:34:45.430 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_active_connections": 3, 2024-09-11T23:34:45.430 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_total_time": 0.310083372, 2024-09-11T23:34:45.430 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_send_time": 0.116816295, 2024-09-11T23:34:45.430 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_recv_time": 0.092092790, 2024-09-11T23:34:45.430 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_fast_dispatch_time": 0.093213295, 2024-09-11T23:34:45.430 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T23:34:45.430 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 2236, 2024-09-11T23:34:45.430 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.322983671, 2024-09-11T23:34:45.431 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000144447 2024-09-11T23:34:45.431 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:45.431 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_handle_ack_lat": { 2024-09-11T23:34:45.431 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-11T23:34:45.431 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-11T23:34:45.431 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-11T23:34:45.431 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:45.431 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_encrypted_bytes": 813120, 2024-09-11T23:34:45.431 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_encrypted_bytes": 187792 2024-09-11T23:34:45.431 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:45.431 INFO:teuthology.orchestra.run.smithi037.stdout: "AsyncMessenger::Worker-2": { 2024-09-11T23:34:45.431 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_messages": 5, 2024-09-11T23:34:45.431 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages": 233, 2024-09-11T23:34:45.432 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_bytes": 1668, 2024-09-11T23:34:45.432 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_bytes": 560037, 2024-09-11T23:34:45.432 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_created_connections": 8, 2024-09-11T23:34:45.432 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_active_connections": 4, 2024-09-11T23:34:45.432 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_total_time": 0.040451461, 2024-09-11T23:34:45.432 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_send_time": 0.028491097, 2024-09-11T23:34:45.432 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_recv_time": 0.006222153, 2024-09-11T23:34:45.432 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_fast_dispatch_time": 0.000063003, 2024-09-11T23:34:45.432 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T23:34:45.432 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 231, 2024-09-11T23:34:45.432 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.060689828, 2024-09-11T23:34:45.433 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000262726 2024-09-11T23:34:45.433 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:45.433 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_handle_ack_lat": { 2024-09-11T23:34:45.433 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-11T23:34:45.433 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-11T23:34:45.433 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-11T23:34:45.433 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:45.433 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-11T23:34:45.433 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_encrypted_bytes": 559072 2024-09-11T23:34:45.433 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:45.433 INFO:teuthology.orchestra.run.smithi037.stdout: "cct": { 2024-09-11T23:34:45.433 INFO:teuthology.orchestra.run.smithi037.stdout: "total_workers": 1, 2024-09-11T23:34:45.434 INFO:teuthology.orchestra.run.smithi037.stdout: "unhealthy_workers": 0 2024-09-11T23:34:45.434 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:45.434 INFO:teuthology.orchestra.run.smithi037.stdout: "finisher-MDSRank": { 2024-09-11T23:34:45.434 INFO:teuthology.orchestra.run.smithi037.stdout: "queue_len": 0, 2024-09-11T23:34:45.434 INFO:teuthology.orchestra.run.smithi037.stdout: "complete_latency": { 2024-09-11T23:34:45.434 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 4574, 2024-09-11T23:34:45.434 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.182806620, 2024-09-11T23:34:45.434 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000039966 2024-09-11T23:34:45.434 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:45.434 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:45.434 INFO:teuthology.orchestra.run.smithi037.stdout: "finisher-PurgeQueue": { 2024-09-11T23:34:45.434 INFO:teuthology.orchestra.run.smithi037.stdout: "queue_len": 0, 2024-09-11T23:34:45.434 INFO:teuthology.orchestra.run.smithi037.stdout: "complete_latency": { 2024-09-11T23:34:45.435 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-11T23:34:45.435 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-11T23:34:45.435 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-11T23:34:45.435 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:45.435 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:45.435 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": { 2024-09-11T23:34:45.435 INFO:teuthology.orchestra.run.smithi037.stdout: "request": 0, 2024-09-11T23:34:45.435 INFO:teuthology.orchestra.run.smithi037.stdout: "reply": 0, 2024-09-11T23:34:45.435 INFO:teuthology.orchestra.run.smithi037.stdout: "reply_latency": { 2024-09-11T23:34:45.435 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-11T23:34:45.435 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-11T23:34:45.435 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-11T23:34:45.436 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:45.436 INFO:teuthology.orchestra.run.smithi037.stdout: "slow_reply": 0, 2024-09-11T23:34:45.436 INFO:teuthology.orchestra.run.smithi037.stdout: "forward": 0, 2024-09-11T23:34:45.436 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_fetch_complete": 0, 2024-09-11T23:34:45.436 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_fetch_keys": 0, 2024-09-11T23:34:45.436 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_commit": 0, 2024-09-11T23:34:45.436 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_split": 0, 2024-09-11T23:34:45.436 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_merge": 0, 2024-09-11T23:34:45.436 INFO:teuthology.orchestra.run.smithi037.stdout: "inodes": 0, 2024-09-11T23:34:45.436 INFO:teuthology.orchestra.run.smithi037.stdout: "inodes_top": 0, 2024-09-11T23:34:45.436 INFO:teuthology.orchestra.run.smithi037.stdout: "inodes_bottom": 0, 2024-09-11T23:34:45.436 INFO:teuthology.orchestra.run.smithi037.stdout: "inodes_pin_tail": 0, 2024-09-11T23:34:45.436 INFO:teuthology.orchestra.run.smithi037.stdout: "inodes_pinned": 0, 2024-09-11T23:34:45.437 INFO:teuthology.orchestra.run.smithi037.stdout: "inodes_expired": 0, 2024-09-11T23:34:45.437 INFO:teuthology.orchestra.run.smithi037.stdout: "inodes_with_caps": 0, 2024-09-11T23:34:45.437 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": 0, 2024-09-11T23:34:45.437 INFO:teuthology.orchestra.run.smithi037.stdout: "subtrees": 1, 2024-09-11T23:34:45.437 INFO:teuthology.orchestra.run.smithi037.stdout: "traverse": 0, 2024-09-11T23:34:45.437 INFO:teuthology.orchestra.run.smithi037.stdout: "traverse_hit": 0, 2024-09-11T23:34:45.437 INFO:teuthology.orchestra.run.smithi037.stdout: "traverse_forward": 0, 2024-09-11T23:34:45.437 INFO:teuthology.orchestra.run.smithi037.stdout: "traverse_discover": 0, 2024-09-11T23:34:45.437 INFO:teuthology.orchestra.run.smithi037.stdout: "traverse_dir_fetch": 0, 2024-09-11T23:34:45.437 INFO:teuthology.orchestra.run.smithi037.stdout: "traverse_remote_ino": 0, 2024-09-11T23:34:45.437 INFO:teuthology.orchestra.run.smithi037.stdout: "traverse_lock": 0, 2024-09-11T23:34:45.437 INFO:teuthology.orchestra.run.smithi037.stdout: "load_cent": 0, 2024-09-11T23:34:45.438 INFO:teuthology.orchestra.run.smithi037.stdout: "q": 0, 2024-09-11T23:34:45.438 INFO:teuthology.orchestra.run.smithi037.stdout: "exported": 0, 2024-09-11T23:34:45.438 INFO:teuthology.orchestra.run.smithi037.stdout: "exported_inodes": 0, 2024-09-11T23:34:45.438 INFO:teuthology.orchestra.run.smithi037.stdout: "imported": 0, 2024-09-11T23:34:45.438 INFO:teuthology.orchestra.run.smithi037.stdout: "imported_inodes": 0, 2024-09-11T23:34:45.438 INFO:teuthology.orchestra.run.smithi037.stdout: "openino_dir_fetch": 0, 2024-09-11T23:34:45.438 INFO:teuthology.orchestra.run.smithi037.stdout: "openino_backtrace_fetch": 0, 2024-09-11T23:34:45.438 INFO:teuthology.orchestra.run.smithi037.stdout: "openino_peer_discover": 0, 2024-09-11T23:34:45.438 INFO:teuthology.orchestra.run.smithi037.stdout: "root_rfiles": 0, 2024-09-11T23:34:45.438 INFO:teuthology.orchestra.run.smithi037.stdout: "root_rbytes": 0, 2024-09-11T23:34:45.438 INFO:teuthology.orchestra.run.smithi037.stdout: "root_rsnaps": 0, 2024-09-11T23:34:45.438 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_backtrace_fetch": 0, 2024-09-11T23:34:45.438 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_set_tag": 0, 2024-09-11T23:34:45.438 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_backtrace_repaired": 0, 2024-09-11T23:34:45.439 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_inotable_repaired": 0, 2024-09-11T23:34:45.439 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_dir_inodes": 0, 2024-09-11T23:34:45.439 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_dir_base_inodes": 0, 2024-09-11T23:34:45.439 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_dirfrag_rstats": 0, 2024-09-11T23:34:45.439 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_file_inodes": 0, 2024-09-11T23:34:45.439 INFO:teuthology.orchestra.run.smithi037.stdout: "handle_inode_file_caps": 0, 2024-09-11T23:34:45.439 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_cap_op_revoke": 0, 2024-09-11T23:34:45.439 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_cap_op_grant": 0, 2024-09-11T23:34:45.439 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_cap_op_trunc": 0, 2024-09-11T23:34:45.439 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-11T23:34:45.439 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-11T23:34:45.439 INFO:teuthology.orchestra.run.smithi037.stdout: "handle_client_caps": 0, 2024-09-11T23:34:45.440 INFO:teuthology.orchestra.run.smithi037.stdout: "handle_client_caps_dirty": 0, 2024-09-11T23:34:45.440 INFO:teuthology.orchestra.run.smithi037.stdout: "handle_client_cap_release": 0, 2024-09-11T23:34:45.440 INFO:teuthology.orchestra.run.smithi037.stdout: "process_request_cap_release": 0 2024-09-11T23:34:45.440 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:45.440 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_cache": { 2024-09-11T23:34:45.440 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_update": 0, 2024-09-11T23:34:45.440 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_update_receipt": 0, 2024-09-11T23:34:45.440 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_try_discover": 0, 2024-09-11T23:34:45.440 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_send_discover": 0, 2024-09-11T23:34:45.440 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_handle_discover": 0, 2024-09-11T23:34:45.440 INFO:teuthology.orchestra.run.smithi037.stdout: "num_strays": 0, 2024-09-11T23:34:45.440 INFO:teuthology.orchestra.run.smithi037.stdout: "num_strays_delayed": 0, 2024-09-11T23:34:45.440 INFO:teuthology.orchestra.run.smithi037.stdout: "num_strays_enqueuing": 0, 2024-09-11T23:34:45.441 INFO:teuthology.orchestra.run.smithi037.stdout: "strays_created": 0, 2024-09-11T23:34:45.441 INFO:teuthology.orchestra.run.smithi037.stdout: "strays_enqueued": 0, 2024-09-11T23:34:45.441 INFO:teuthology.orchestra.run.smithi037.stdout: "strays_reintegrated": 0, 2024-09-11T23:34:45.441 INFO:teuthology.orchestra.run.smithi037.stdout: "strays_migrated": 0, 2024-09-11T23:34:45.441 INFO:teuthology.orchestra.run.smithi037.stdout: "num_recovering_processing": 0, 2024-09-11T23:34:45.441 INFO:teuthology.orchestra.run.smithi037.stdout: "num_recovering_enqueued": 0, 2024-09-11T23:34:45.441 INFO:teuthology.orchestra.run.smithi037.stdout: "num_recovering_prioritized": 0, 2024-09-11T23:34:45.441 INFO:teuthology.orchestra.run.smithi037.stdout: "recovery_started": 0, 2024-09-11T23:34:45.441 INFO:teuthology.orchestra.run.smithi037.stdout: "recovery_completed": 0, 2024-09-11T23:34:45.441 INFO:teuthology.orchestra.run.smithi037.stdout: "ireq_quiesce_path": 0, 2024-09-11T23:34:45.441 INFO:teuthology.orchestra.run.smithi037.stdout: "ireq_quiesce_inode": 0, 2024-09-11T23:34:45.441 INFO:teuthology.orchestra.run.smithi037.stdout: "ireq_enqueue_scrub": 0, 2024-09-11T23:34:45.441 INFO:teuthology.orchestra.run.smithi037.stdout: "ireq_exportdir": 0, 2024-09-11T23:34:45.442 INFO:teuthology.orchestra.run.smithi037.stdout: "ireq_flush": 0, 2024-09-11T23:34:45.442 INFO:teuthology.orchestra.run.smithi037.stdout: "ireq_fragmentdir": 0, 2024-09-11T23:34:45.442 INFO:teuthology.orchestra.run.smithi037.stdout: "ireq_fragstats": 0, 2024-09-11T23:34:45.442 INFO:teuthology.orchestra.run.smithi037.stdout: "ireq_inodestats": 0 2024-09-11T23:34:45.442 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:45.442 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_log": { 2024-09-11T23:34:45.442 INFO:teuthology.orchestra.run.smithi037.stdout: "evlrg": 0, 2024-09-11T23:34:45.442 INFO:teuthology.orchestra.run.smithi037.stdout: "evadd": 0, 2024-09-11T23:34:45.442 INFO:teuthology.orchestra.run.smithi037.stdout: "evex": 0, 2024-09-11T23:34:45.442 INFO:teuthology.orchestra.run.smithi037.stdout: "evtrm": 0, 2024-09-11T23:34:45.442 INFO:teuthology.orchestra.run.smithi037.stdout: "ev": 4, 2024-09-11T23:34:45.442 INFO:teuthology.orchestra.run.smithi037.stdout: "evexg": 0, 2024-09-11T23:34:45.442 INFO:teuthology.orchestra.run.smithi037.stdout: "evexd": 0, 2024-09-11T23:34:45.442 INFO:teuthology.orchestra.run.smithi037.stdout: "segadd": 0, 2024-09-11T23:34:45.443 INFO:teuthology.orchestra.run.smithi037.stdout: "segex": 0, 2024-09-11T23:34:45.443 INFO:teuthology.orchestra.run.smithi037.stdout: "segtrm": 0, 2024-09-11T23:34:45.443 INFO:teuthology.orchestra.run.smithi037.stdout: "seg": 2, 2024-09-11T23:34:45.443 INFO:teuthology.orchestra.run.smithi037.stdout: "segmjr": 2, 2024-09-11T23:34:45.443 INFO:teuthology.orchestra.run.smithi037.stdout: "segexg": 0, 2024-09-11T23:34:45.443 INFO:teuthology.orchestra.run.smithi037.stdout: "segexd": 0, 2024-09-11T23:34:45.443 INFO:teuthology.orchestra.run.smithi037.stdout: "expos": 4194304, 2024-09-11T23:34:45.443 INFO:teuthology.orchestra.run.smithi037.stdout: "wrpos": 4195426, 2024-09-11T23:34:45.443 INFO:teuthology.orchestra.run.smithi037.stdout: "rdpos": 4195285, 2024-09-11T23:34:45.443 INFO:teuthology.orchestra.run.smithi037.stdout: "jlat": { 2024-09-11T23:34:45.443 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-11T23:34:45.443 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-11T23:34:45.443 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-11T23:34:45.444 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:45.444 INFO:teuthology.orchestra.run.smithi037.stdout: "replayed": 4 2024-09-11T23:34:45.444 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:45.444 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_mem": { 2024-09-11T23:34:45.444 INFO:teuthology.orchestra.run.smithi037.stdout: "ino": 3, 2024-09-11T23:34:45.444 INFO:teuthology.orchestra.run.smithi037.stdout: "ino+": 3, 2024-09-11T23:34:45.444 INFO:teuthology.orchestra.run.smithi037.stdout: "ino-": 0, 2024-09-11T23:34:45.444 INFO:teuthology.orchestra.run.smithi037.stdout: "dir": 1, 2024-09-11T23:34:45.444 INFO:teuthology.orchestra.run.smithi037.stdout: "dir+": 1, 2024-09-11T23:34:45.444 INFO:teuthology.orchestra.run.smithi037.stdout: "dir-": 0, 2024-09-11T23:34:45.444 INFO:teuthology.orchestra.run.smithi037.stdout: "dn": 0, 2024-09-11T23:34:45.444 INFO:teuthology.orchestra.run.smithi037.stdout: "dn+": 0, 2024-09-11T23:34:45.444 INFO:teuthology.orchestra.run.smithi037.stdout: "dn-": 0, 2024-09-11T23:34:45.445 INFO:teuthology.orchestra.run.smithi037.stdout: "cap": 0, 2024-09-11T23:34:45.445 INFO:teuthology.orchestra.run.smithi037.stdout: "cap+": 0, 2024-09-11T23:34:45.445 INFO:teuthology.orchestra.run.smithi037.stdout: "cap-": 0, 2024-09-11T23:34:45.445 INFO:teuthology.orchestra.run.smithi037.stdout: "rss": 47316, 2024-09-11T23:34:45.445 INFO:teuthology.orchestra.run.smithi037.stdout: "heap": 215328 2024-09-11T23:34:45.445 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:45.445 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_server": { 2024-09-11T23:34:45.445 INFO:teuthology.orchestra.run.smithi037.stdout: "dispatch_client_request": 0, 2024-09-11T23:34:45.445 INFO:teuthology.orchestra.run.smithi037.stdout: "dispatch_server_request": 0, 2024-09-11T23:34:45.445 INFO:teuthology.orchestra.run.smithi037.stdout: "handle_client_request": 0, 2024-09-11T23:34:45.445 INFO:teuthology.orchestra.run.smithi037.stdout: "handle_client_session": 0, 2024-09-11T23:34:45.445 INFO:teuthology.orchestra.run.smithi037.stdout: "handle_peer_request": 0, 2024-09-11T23:34:45.445 INFO:teuthology.orchestra.run.smithi037.stdout: "req_create_latency": { 2024-09-11T23:34:45.446 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-11T23:34:45.446 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-11T23:34:45.446 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-11T23:34:45.446 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:45.446 INFO:teuthology.orchestra.run.smithi037.stdout: "req_getattr_latency": { 2024-09-11T23:34:45.446 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-11T23:34:45.446 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-11T23:34:45.446 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-11T23:34:45.446 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:45.446 INFO:teuthology.orchestra.run.smithi037.stdout: "req_getfilelock_latency": { 2024-09-11T23:34:45.446 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-11T23:34:45.446 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-11T23:34:45.446 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-11T23:34:45.446 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:45.447 INFO:teuthology.orchestra.run.smithi037.stdout: "req_link_latency": { 2024-09-11T23:34:45.447 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-11T23:34:45.447 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-11T23:34:45.447 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-11T23:34:45.447 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:45.447 INFO:teuthology.orchestra.run.smithi037.stdout: "req_lookup_latency": { 2024-09-11T23:34:45.447 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-11T23:34:45.447 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-11T23:34:45.447 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-11T23:34:45.447 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:45.447 INFO:teuthology.orchestra.run.smithi037.stdout: "req_lookuphash_latency": { 2024-09-11T23:34:45.447 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-11T23:34:45.448 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-11T23:34:45.448 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-11T23:34:45.448 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:45.448 INFO:teuthology.orchestra.run.smithi037.stdout: "req_lookupino_latency": { 2024-09-11T23:34:45.448 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-11T23:34:45.448 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-11T23:34:45.448 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-11T23:34:45.448 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:45.448 INFO:teuthology.orchestra.run.smithi037.stdout: "req_lookupname_latency": { 2024-09-11T23:34:45.448 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-11T23:34:45.448 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-11T23:34:45.449 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-11T23:34:45.449 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:45.449 INFO:teuthology.orchestra.run.smithi037.stdout: "req_lookupparent_latency": { 2024-09-11T23:34:45.449 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-11T23:34:45.449 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-11T23:34:45.449 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-11T23:34:45.449 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:45.449 INFO:teuthology.orchestra.run.smithi037.stdout: "req_lookupsnap_latency": { 2024-09-11T23:34:45.449 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-11T23:34:45.449 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-11T23:34:45.449 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-11T23:34:45.449 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:45.449 INFO:teuthology.orchestra.run.smithi037.stdout: "req_lssnap_latency": { 2024-09-11T23:34:45.450 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-11T23:34:45.450 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-11T23:34:45.450 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-11T23:34:45.450 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:45.450 INFO:teuthology.orchestra.run.smithi037.stdout: "req_mkdir_latency": { 2024-09-11T23:34:45.450 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-11T23:34:45.451 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-11T23:34:45.451 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-11T23:34:45.451 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:45.451 INFO:teuthology.orchestra.run.smithi037.stdout: "req_mknod_latency": { 2024-09-11T23:34:45.451 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-11T23:34:45.451 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-11T23:34:45.451 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-11T23:34:45.451 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:45.451 INFO:teuthology.orchestra.run.smithi037.stdout: "req_mksnap_latency": { 2024-09-11T23:34:45.451 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-11T23:34:45.451 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-11T23:34:45.452 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-11T23:34:45.452 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:45.452 INFO:teuthology.orchestra.run.smithi037.stdout: "req_open_latency": { 2024-09-11T23:34:45.452 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-11T23:34:45.452 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-11T23:34:45.452 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-11T23:34:45.452 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:45.452 INFO:teuthology.orchestra.run.smithi037.stdout: "req_readdir_latency": { 2024-09-11T23:34:45.452 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-11T23:34:45.452 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-11T23:34:45.452 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-11T23:34:45.452 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:45.453 INFO:teuthology.orchestra.run.smithi037.stdout: "req_rename_latency": { 2024-09-11T23:34:45.453 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-11T23:34:45.453 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-11T23:34:45.453 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-11T23:34:45.453 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:45.453 INFO:teuthology.orchestra.run.smithi037.stdout: "req_renamesnap_latency": { 2024-09-11T23:34:45.453 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-11T23:34:45.453 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-11T23:34:45.453 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-11T23:34:45.453 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:45.453 INFO:teuthology.orchestra.run.smithi037.stdout: "req_snapdiff_latency": { 2024-09-11T23:34:45.453 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-11T23:34:45.453 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-11T23:34:45.454 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-11T23:34:45.454 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:45.454 INFO:teuthology.orchestra.run.smithi037.stdout: "req_rmdir_latency": { 2024-09-11T23:34:45.454 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-11T23:34:45.454 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-11T23:34:45.454 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-11T23:34:45.454 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:45.454 INFO:teuthology.orchestra.run.smithi037.stdout: "req_rmsnap_latency": { 2024-09-11T23:34:45.454 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-11T23:34:45.454 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-11T23:34:45.454 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-11T23:34:45.454 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:45.454 INFO:teuthology.orchestra.run.smithi037.stdout: "req_rmxattr_latency": { 2024-09-11T23:34:45.454 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-11T23:34:45.455 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-11T23:34:45.455 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-11T23:34:45.455 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:45.455 INFO:teuthology.orchestra.run.smithi037.stdout: "req_setattr_latency": { 2024-09-11T23:34:45.455 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-11T23:34:45.455 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-11T23:34:45.455 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-11T23:34:45.455 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:45.455 INFO:teuthology.orchestra.run.smithi037.stdout: "req_setdirlayout_latency": { 2024-09-11T23:34:45.455 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-11T23:34:45.455 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-11T23:34:45.455 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-11T23:34:45.455 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:45.456 INFO:teuthology.orchestra.run.smithi037.stdout: "req_setfilelock_latency": { 2024-09-11T23:34:45.456 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-11T23:34:45.456 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-11T23:34:45.456 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-11T23:34:45.456 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:45.456 INFO:teuthology.orchestra.run.smithi037.stdout: "req_setlayout_latency": { 2024-09-11T23:34:45.456 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-11T23:34:45.456 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-11T23:34:45.456 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-11T23:34:45.456 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:45.456 INFO:teuthology.orchestra.run.smithi037.stdout: "req_setxattr_latency": { 2024-09-11T23:34:45.456 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-11T23:34:45.456 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-11T23:34:45.457 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-11T23:34:45.457 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:45.457 INFO:teuthology.orchestra.run.smithi037.stdout: "req_symlink_latency": { 2024-09-11T23:34:45.457 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-11T23:34:45.457 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-11T23:34:45.457 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-11T23:34:45.457 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:45.457 INFO:teuthology.orchestra.run.smithi037.stdout: "req_unlink_latency": { 2024-09-11T23:34:45.457 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-11T23:34:45.457 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-11T23:34:45.457 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-11T23:34:45.457 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:45.458 INFO:teuthology.orchestra.run.smithi037.stdout: "cap_revoke_eviction": 0, 2024-09-11T23:34:45.458 INFO:teuthology.orchestra.run.smithi037.stdout: "cap_acquisition_throttle": 0, 2024-09-11T23:34:45.458 INFO:teuthology.orchestra.run.smithi037.stdout: "req_getvxattr_latency": { 2024-09-11T23:34:45.458 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-11T23:34:45.458 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-11T23:34:45.458 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-11T23:34:45.458 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:45.458 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:45.458 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_sessions": { 2024-09-11T23:34:45.458 INFO:teuthology.orchestra.run.smithi037.stdout: "session_count": 0, 2024-09-11T23:34:45.458 INFO:teuthology.orchestra.run.smithi037.stdout: "session_add": 1, 2024-09-11T23:34:45.458 INFO:teuthology.orchestra.run.smithi037.stdout: "session_remove": 1, 2024-09-11T23:34:45.458 INFO:teuthology.orchestra.run.smithi037.stdout: "sessions_open": 1, 2024-09-11T23:34:45.459 INFO:teuthology.orchestra.run.smithi037.stdout: "sessions_stale": 0, 2024-09-11T23:34:45.459 INFO:teuthology.orchestra.run.smithi037.stdout: "total_load": 0, 2024-09-11T23:34:45.459 INFO:teuthology.orchestra.run.smithi037.stdout: "average_load": 0, 2024-09-11T23:34:45.459 INFO:teuthology.orchestra.run.smithi037.stdout: "avg_session_uptime": 1145, 2024-09-11T23:34:45.459 INFO:teuthology.orchestra.run.smithi037.stdout: "mdthresh_evicted": 0 2024-09-11T23:34:45.459 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:45.459 INFO:teuthology.orchestra.run.smithi037.stdout: "mempool": { 2024-09-11T23:34:45.459 INFO:teuthology.orchestra.run.smithi037.stdout: "bloom_filter_bytes": 0, 2024-09-11T23:34:45.459 INFO:teuthology.orchestra.run.smithi037.stdout: "bloom_filter_items": 0, 2024-09-11T23:34:45.459 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_alloc_bytes": 0, 2024-09-11T23:34:45.459 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_alloc_items": 0, 2024-09-11T23:34:45.459 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_data_bytes": 0, 2024-09-11T23:34:45.459 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_data_items": 0, 2024-09-11T23:34:45.460 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-11T23:34:45.460 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_onode_items": 0, 2024-09-11T23:34:45.460 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-11T23:34:45.460 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_meta_items": 0, 2024-09-11T23:34:45.460 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_other_bytes": 0, 2024-09-11T23:34:45.460 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_other_items": 0, 2024-09-11T23:34:45.460 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-11T23:34:45.460 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_buffer_items": 0, 2024-09-11T23:34:45.460 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_extent_bytes": 0, 2024-09-11T23:34:45.460 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_extent_items": 0, 2024-09-11T23:34:45.460 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_blob_bytes": 0, 2024-09-11T23:34:45.460 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_blob_items": 0, 2024-09-11T23:34:45.461 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-11T23:34:45.461 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_shared_blob_items": 0, 2024-09-11T23:34:45.461 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-11T23:34:45.461 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_inline_bl_items": 0, 2024-09-11T23:34:45.461 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_fsck_bytes": 0, 2024-09-11T23:34:45.461 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_fsck_items": 0, 2024-09-11T23:34:45.461 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_txc_bytes": 0, 2024-09-11T23:34:45.461 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_txc_items": 0, 2024-09-11T23:34:45.461 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-11T23:34:45.461 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_writing_deferred_items": 0, 2024-09-11T23:34:45.461 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_writing_bytes": 0, 2024-09-11T23:34:45.461 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_writing_items": 0, 2024-09-11T23:34:45.461 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_bytes": 0, 2024-09-11T23:34:45.461 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_items": 0, 2024-09-11T23:34:45.462 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_file_reader_bytes": 0, 2024-09-11T23:34:45.462 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_file_reader_items": 0, 2024-09-11T23:34:45.462 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_file_writer_bytes": 0, 2024-09-11T23:34:45.462 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_file_writer_items": 0, 2024-09-11T23:34:45.462 INFO:teuthology.orchestra.run.smithi037.stdout: "buffer_anon_bytes": 199015, 2024-09-11T23:34:45.462 INFO:teuthology.orchestra.run.smithi037.stdout: "buffer_anon_items": 57, 2024-09-11T23:34:45.462 INFO:teuthology.orchestra.run.smithi037.stdout: "buffer_meta_bytes": 0, 2024-09-11T23:34:45.462 INFO:teuthology.orchestra.run.smithi037.stdout: "buffer_meta_items": 0, 2024-09-11T23:34:45.462 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_bytes": 0, 2024-09-11T23:34:45.462 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_items": 0, 2024-09-11T23:34:45.462 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mapbl_bytes": 0, 2024-09-11T23:34:45.462 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mapbl_items": 0, 2024-09-11T23:34:45.463 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pglog_bytes": 0, 2024-09-11T23:34:45.463 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pglog_items": 0, 2024-09-11T23:34:45.463 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_bytes": 9336, 2024-09-11T23:34:45.463 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_items": 176, 2024-09-11T23:34:45.463 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_mapping_bytes": 0, 2024-09-11T23:34:45.463 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_mapping_items": 0, 2024-09-11T23:34:45.463 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap_bytes": 0, 2024-09-11T23:34:45.463 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap_items": 0, 2024-09-11T23:34:45.463 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_co_bytes": 8512, 2024-09-11T23:34:45.463 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_co_items": 13, 2024-09-11T23:34:45.463 INFO:teuthology.orchestra.run.smithi037.stdout: "unittest_1_bytes": 0, 2024-09-11T23:34:45.463 INFO:teuthology.orchestra.run.smithi037.stdout: "unittest_1_items": 0, 2024-09-11T23:34:45.463 INFO:teuthology.orchestra.run.smithi037.stdout: "unittest_2_bytes": 0, 2024-09-11T23:34:45.463 INFO:teuthology.orchestra.run.smithi037.stdout: "unittest_2_items": 0 2024-09-11T23:34:45.464 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:45.464 INFO:teuthology.orchestra.run.smithi037.stdout: "objecter": { 2024-09-11T23:34:45.464 INFO:teuthology.orchestra.run.smithi037.stdout: "op_active": 0, 2024-09-11T23:34:45.464 INFO:teuthology.orchestra.run.smithi037.stdout: "op_laggy": 0, 2024-09-11T23:34:45.464 INFO:teuthology.orchestra.run.smithi037.stdout: "op_send": 2929, 2024-09-11T23:34:45.464 INFO:teuthology.orchestra.run.smithi037.stdout: "op_send_bytes": 21, 2024-09-11T23:34:45.464 INFO:teuthology.orchestra.run.smithi037.stdout: "op_resend": 3, 2024-09-11T23:34:45.464 INFO:teuthology.orchestra.run.smithi037.stdout: "op_reply": 2929, 2024-09-11T23:34:45.464 INFO:teuthology.orchestra.run.smithi037.stdout: "op_latency": { 2024-09-11T23:34:45.464 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 2929, 2024-09-11T23:34:45.464 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 62.288232753, 2024-09-11T23:34:45.464 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.021266040 2024-09-11T23:34:45.465 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:45.465 INFO:teuthology.orchestra.run.smithi037.stdout: "op_inflight": 0, 2024-09-11T23:34:45.465 INFO:teuthology.orchestra.run.smithi037.stdout: "oplen_avg": { 2024-09-11T23:34:45.465 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 2929, 2024-09-11T23:34:45.465 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 2930 2024-09-11T23:34:45.465 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:45.465 INFO:teuthology.orchestra.run.smithi037.stdout: "op": 2929, 2024-09-11T23:34:45.465 INFO:teuthology.orchestra.run.smithi037.stdout: "op_r": 2929, 2024-09-11T23:34:45.465 INFO:teuthology.orchestra.run.smithi037.stdout: "op_w": 0, 2024-09-11T23:34:45.465 INFO:teuthology.orchestra.run.smithi037.stdout: "op_rmw": 0, 2024-09-11T23:34:45.465 INFO:teuthology.orchestra.run.smithi037.stdout: "op_pg": 0, 2024-09-11T23:34:45.465 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_stat": 1921, 2024-09-11T23:34:45.465 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_create": 0, 2024-09-11T23:34:45.466 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_read": 1006, 2024-09-11T23:34:45.466 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_write": 0, 2024-09-11T23:34:45.466 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_writefull": 0, 2024-09-11T23:34:45.466 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_writesame": 0, 2024-09-11T23:34:45.466 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_append": 0, 2024-09-11T23:34:45.466 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_zero": 0, 2024-09-11T23:34:45.466 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_truncate": 0, 2024-09-11T23:34:45.466 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_delete": 0, 2024-09-11T23:34:45.466 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_mapext": 0, 2024-09-11T23:34:45.466 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_sparse_read": 0, 2024-09-11T23:34:45.466 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_clonerange": 0, 2024-09-11T23:34:45.466 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_getxattr": 1, 2024-09-11T23:34:45.466 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_setxattr": 0, 2024-09-11T23:34:45.466 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_cmpxattr": 0, 2024-09-11T23:34:45.467 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_rmxattr": 0, 2024-09-11T23:34:45.467 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_resetxattrs": 0, 2024-09-11T23:34:45.467 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_call": 0, 2024-09-11T23:34:45.467 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_watch": 0, 2024-09-11T23:34:45.467 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_notify": 0, 2024-09-11T23:34:45.467 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_src_cmpxattr": 0, 2024-09-11T23:34:45.467 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_pgls": 0, 2024-09-11T23:34:45.467 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_pgls_filter": 0, 2024-09-11T23:34:45.467 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_other": 0, 2024-09-11T23:34:45.467 INFO:teuthology.orchestra.run.smithi037.stdout: "linger_active": 0, 2024-09-11T23:34:45.467 INFO:teuthology.orchestra.run.smithi037.stdout: "linger_send": 0, 2024-09-11T23:34:45.467 INFO:teuthology.orchestra.run.smithi037.stdout: "linger_resend": 0, 2024-09-11T23:34:45.468 INFO:teuthology.orchestra.run.smithi037.stdout: "linger_ping": 0, 2024-09-11T23:34:45.468 INFO:teuthology.orchestra.run.smithi037.stdout: "poolop_active": 0, 2024-09-11T23:34:45.468 INFO:teuthology.orchestra.run.smithi037.stdout: "poolop_send": 0, 2024-09-11T23:34:45.468 INFO:teuthology.orchestra.run.smithi037.stdout: "poolop_resend": 0, 2024-09-11T23:34:45.468 INFO:teuthology.orchestra.run.smithi037.stdout: "poolstat_active": 0, 2024-09-11T23:34:45.468 INFO:teuthology.orchestra.run.smithi037.stdout: "poolstat_send": 0, 2024-09-11T23:34:45.468 INFO:teuthology.orchestra.run.smithi037.stdout: "poolstat_resend": 0, 2024-09-11T23:34:45.468 INFO:teuthology.orchestra.run.smithi037.stdout: "statfs_active": 0, 2024-09-11T23:34:45.468 INFO:teuthology.orchestra.run.smithi037.stdout: "statfs_send": 0, 2024-09-11T23:34:45.468 INFO:teuthology.orchestra.run.smithi037.stdout: "statfs_resend": 0, 2024-09-11T23:34:45.468 INFO:teuthology.orchestra.run.smithi037.stdout: "command_active": 0, 2024-09-11T23:34:45.468 INFO:teuthology.orchestra.run.smithi037.stdout: "command_send": 0, 2024-09-11T23:34:45.468 INFO:teuthology.orchestra.run.smithi037.stdout: "command_resend": 0, 2024-09-11T23:34:45.469 INFO:teuthology.orchestra.run.smithi037.stdout: "map_epoch": 95, 2024-09-11T23:34:45.469 INFO:teuthology.orchestra.run.smithi037.stdout: "map_full": 0, 2024-09-11T23:34:45.469 INFO:teuthology.orchestra.run.smithi037.stdout: "map_inc": 2, 2024-09-11T23:34:45.469 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_sessions": 6, 2024-09-11T23:34:45.469 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_session_open": 9, 2024-09-11T23:34:45.469 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_session_close": 3, 2024-09-11T23:34:45.469 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_laggy": 0, 2024-09-11T23:34:45.469 INFO:teuthology.orchestra.run.smithi037.stdout: "omap_wr": 0, 2024-09-11T23:34:45.469 INFO:teuthology.orchestra.run.smithi037.stdout: "omap_rd": 2, 2024-09-11T23:34:45.469 INFO:teuthology.orchestra.run.smithi037.stdout: "omap_del": 0 2024-09-11T23:34:45.469 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:45.469 INFO:teuthology.orchestra.run.smithi037.stdout: "oft": { 2024-09-11T23:34:45.469 INFO:teuthology.orchestra.run.smithi037.stdout: "omap_total_objs": 0, 2024-09-11T23:34:45.469 INFO:teuthology.orchestra.run.smithi037.stdout: "omap_total_kv_pairs": 0, 2024-09-11T23:34:45.470 INFO:teuthology.orchestra.run.smithi037.stdout: "omap_total_updates": 0, 2024-09-11T23:34:45.470 INFO:teuthology.orchestra.run.smithi037.stdout: "omap_total_removes": 0 2024-09-11T23:34:45.470 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:45.470 INFO:teuthology.orchestra.run.smithi037.stdout: "osd-slow-ops": { 2024-09-11T23:34:45.470 INFO:teuthology.orchestra.run.smithi037.stdout: "slow_ops_count": 0 2024-09-11T23:34:45.470 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:45.470 INFO:teuthology.orchestra.run.smithi037.stdout: "purge_queue": { 2024-09-11T23:34:45.470 INFO:teuthology.orchestra.run.smithi037.stdout: "pq_executing_ops": 0, 2024-09-11T23:34:45.470 INFO:teuthology.orchestra.run.smithi037.stdout: "pq_executing_ops_high_water": 0, 2024-09-11T23:34:45.470 INFO:teuthology.orchestra.run.smithi037.stdout: "pq_executing": 0, 2024-09-11T23:34:45.470 INFO:teuthology.orchestra.run.smithi037.stdout: "pq_executing_high_water": 0, 2024-09-11T23:34:45.470 INFO:teuthology.orchestra.run.smithi037.stdout: "pq_executed_ops": 0, 2024-09-11T23:34:45.470 INFO:teuthology.orchestra.run.smithi037.stdout: "pq_executed": 0, 2024-09-11T23:34:45.470 INFO:teuthology.orchestra.run.smithi037.stdout: "pq_item_in_journal": 0 2024-09-11T23:34:45.471 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:45.471 INFO:teuthology.orchestra.run.smithi037.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-11T23:34:45.471 INFO:teuthology.orchestra.run.smithi037.stdout: "val": 0, 2024-09-11T23:34:45.471 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 104857600, 2024-09-11T23:34:45.471 INFO:teuthology.orchestra.run.smithi037.stdout: "get_started": 0, 2024-09-11T23:34:45.471 INFO:teuthology.orchestra.run.smithi037.stdout: "get": 3248, 2024-09-11T23:34:45.471 INFO:teuthology.orchestra.run.smithi037.stdout: "get_sum": 1330617, 2024-09-11T23:34:45.471 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_fail": 0, 2024-09-11T23:34:45.471 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_success": 3248, 2024-09-11T23:34:45.471 INFO:teuthology.orchestra.run.smithi037.stdout: "take": 0, 2024-09-11T23:34:45.471 INFO:teuthology.orchestra.run.smithi037.stdout: "take_sum": 0, 2024-09-11T23:34:45.471 INFO:teuthology.orchestra.run.smithi037.stdout: "put": 3248, 2024-09-11T23:34:45.471 INFO:teuthology.orchestra.run.smithi037.stdout: "put_sum": 1330617, 2024-09-11T23:34:45.472 INFO:teuthology.orchestra.run.smithi037.stdout: "wait": { 2024-09-11T23:34:45.472 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-11T23:34:45.472 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-11T23:34:45.472 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-11T23:34:45.472 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:45.472 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:45.472 INFO:teuthology.orchestra.run.smithi037.stdout: "throttle-objecter_bytes": { 2024-09-11T23:34:45.472 INFO:teuthology.orchestra.run.smithi037.stdout: "val": 0, 2024-09-11T23:34:45.472 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 104857600, 2024-09-11T23:34:45.472 INFO:teuthology.orchestra.run.smithi037.stdout: "get_started": 0, 2024-09-11T23:34:45.472 INFO:teuthology.orchestra.run.smithi037.stdout: "get": 0, 2024-09-11T23:34:45.472 INFO:teuthology.orchestra.run.smithi037.stdout: "get_sum": 0, 2024-09-11T23:34:45.472 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_fail": 0, 2024-09-11T23:34:45.473 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_success": 0, 2024-09-11T23:34:45.473 INFO:teuthology.orchestra.run.smithi037.stdout: "take": 2929, 2024-09-11T23:34:45.473 INFO:teuthology.orchestra.run.smithi037.stdout: "take_sum": 1127, 2024-09-11T23:34:45.473 INFO:teuthology.orchestra.run.smithi037.stdout: "put": 2929, 2024-09-11T23:34:45.473 INFO:teuthology.orchestra.run.smithi037.stdout: "put_sum": 1127, 2024-09-11T23:34:45.473 INFO:teuthology.orchestra.run.smithi037.stdout: "wait": { 2024-09-11T23:34:45.473 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-11T23:34:45.473 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-11T23:34:45.473 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-11T23:34:45.473 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:45.473 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:45.473 INFO:teuthology.orchestra.run.smithi037.stdout: "throttle-objecter_ops": { 2024-09-11T23:34:45.473 INFO:teuthology.orchestra.run.smithi037.stdout: "val": 0, 2024-09-11T23:34:45.473 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 1024, 2024-09-11T23:34:45.474 INFO:teuthology.orchestra.run.smithi037.stdout: "get_started": 0, 2024-09-11T23:34:45.474 INFO:teuthology.orchestra.run.smithi037.stdout: "get": 0, 2024-09-11T23:34:45.474 INFO:teuthology.orchestra.run.smithi037.stdout: "get_sum": 0, 2024-09-11T23:34:45.474 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_fail": 0, 2024-09-11T23:34:45.474 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_success": 0, 2024-09-11T23:34:45.474 INFO:teuthology.orchestra.run.smithi037.stdout: "take": 2929, 2024-09-11T23:34:45.474 INFO:teuthology.orchestra.run.smithi037.stdout: "take_sum": 2929, 2024-09-11T23:34:45.474 INFO:teuthology.orchestra.run.smithi037.stdout: "put": 2929, 2024-09-11T23:34:45.474 INFO:teuthology.orchestra.run.smithi037.stdout: "put_sum": 2929, 2024-09-11T23:34:45.474 INFO:teuthology.orchestra.run.smithi037.stdout: "wait": { 2024-09-11T23:34:45.474 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-11T23:34:45.474 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-11T23:34:45.474 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-11T23:34:45.475 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:45.475 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:45.475 INFO:teuthology.orchestra.run.smithi037.stdout: "throttle-write_buf_throttle": { 2024-09-11T23:34:45.475 INFO:teuthology.orchestra.run.smithi037.stdout: "val": 0, 2024-09-11T23:34:45.475 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 3758096384, 2024-09-11T23:34:45.475 INFO:teuthology.orchestra.run.smithi037.stdout: "get_started": 0, 2024-09-11T23:34:45.475 INFO:teuthology.orchestra.run.smithi037.stdout: "get": 0, 2024-09-11T23:34:45.475 INFO:teuthology.orchestra.run.smithi037.stdout: "get_sum": 0, 2024-09-11T23:34:45.475 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_fail": 0, 2024-09-11T23:34:45.475 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_success": 0, 2024-09-11T23:34:45.475 INFO:teuthology.orchestra.run.smithi037.stdout: "take": 0, 2024-09-11T23:34:45.475 INFO:teuthology.orchestra.run.smithi037.stdout: "take_sum": 0, 2024-09-11T23:34:45.475 INFO:teuthology.orchestra.run.smithi037.stdout: "put": 0, 2024-09-11T23:34:45.476 INFO:teuthology.orchestra.run.smithi037.stdout: "put_sum": 0, 2024-09-11T23:34:45.476 INFO:teuthology.orchestra.run.smithi037.stdout: "wait": { 2024-09-11T23:34:45.476 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-11T23:34:45.476 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-11T23:34:45.476 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-11T23:34:45.476 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:45.476 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:45.476 INFO:teuthology.orchestra.run.smithi037.stdout: "throttle-write_buf_throttle-0x563ae201abe0": { 2024-09-11T23:34:45.476 INFO:teuthology.orchestra.run.smithi037.stdout: "val": 0, 2024-09-11T23:34:45.476 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 3758096384, 2024-09-11T23:34:45.476 INFO:teuthology.orchestra.run.smithi037.stdout: "get_started": 0, 2024-09-11T23:34:45.476 INFO:teuthology.orchestra.run.smithi037.stdout: "get": 0, 2024-09-11T23:34:45.476 INFO:teuthology.orchestra.run.smithi037.stdout: "get_sum": 0, 2024-09-11T23:34:45.476 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_fail": 0, 2024-09-11T23:34:45.477 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_success": 0, 2024-09-11T23:34:45.477 INFO:teuthology.orchestra.run.smithi037.stdout: "take": 0, 2024-09-11T23:34:45.477 INFO:teuthology.orchestra.run.smithi037.stdout: "take_sum": 0, 2024-09-11T23:34:45.477 INFO:teuthology.orchestra.run.smithi037.stdout: "put": 0, 2024-09-11T23:34:45.477 INFO:teuthology.orchestra.run.smithi037.stdout: "put_sum": 0, 2024-09-11T23:34:45.477 INFO:teuthology.orchestra.run.smithi037.stdout: "wait": { 2024-09-11T23:34:45.477 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-11T23:34:45.477 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-11T23:34:45.477 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-11T23:34:45.477 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:45.477 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:45.477 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-11T23:34:46.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:34:45 smithi037 ceph-mon[30630]: pgmap v861: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 1017 KiB/s wr, 129 op/s 2024-09-11T23:34:46.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:34:45 smithi160 ceph-mon[35055]: pgmap v861: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 1017 KiB/s wr, 129 op/s 2024-09-11T23:34:46.214 INFO:tasks.check_counter:Daemon mds.g mds.exported=0 2024-09-11T23:34:46.214 INFO:tasks.check_counter:Daemon mds.g mds.imported=0 2024-09-11T23:34:46.214 DEBUG:tasks.check_counter:Getting stats from j 2024-09-11T23:34:46.214 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph daemon mds.j perf dump 2024-09-11T23:34:46.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:34:45 smithi123 ceph-mon[35438]: pgmap v861: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 1017 KiB/s wr, 129 op/s 2024-09-11T23:34:46.590 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:34:47.444 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-11T23:34:47.444 INFO:teuthology.orchestra.run.smithi037.stdout: "AsyncMessenger::Worker-0": { 2024-09-11T23:34:47.444 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_messages": 0, 2024-09-11T23:34:47.445 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages": 2, 2024-09-11T23:34:47.445 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_bytes": 0, 2024-09-11T23:34:47.445 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_bytes": 0, 2024-09-11T23:34:47.445 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_created_connections": 4, 2024-09-11T23:34:47.445 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_active_connections": 0, 2024-09-11T23:34:47.445 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_total_time": 0.003020546, 2024-09-11T23:34:47.445 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_send_time": 0.000000000, 2024-09-11T23:34:47.445 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_recv_time": 0.000523809, 2024-09-11T23:34:47.445 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T23:34:47.445 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T23:34:47.445 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-11T23:34:47.445 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-11T23:34:47.446 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-11T23:34:47.446 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:47.446 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_handle_ack_lat": { 2024-09-11T23:34:47.446 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-11T23:34:47.446 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-11T23:34:47.446 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-11T23:34:47.446 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:47.446 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-11T23:34:47.446 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_encrypted_bytes": 0 2024-09-11T23:34:47.446 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:47.446 INFO:teuthology.orchestra.run.smithi037.stdout: "AsyncMessenger::Worker-1": { 2024-09-11T23:34:47.446 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_messages": 313, 2024-09-11T23:34:47.446 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages": 308, 2024-09-11T23:34:47.446 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_bytes": 780688, 2024-09-11T23:34:47.447 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_bytes": 190000, 2024-09-11T23:34:47.447 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_created_connections": 2, 2024-09-11T23:34:47.447 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_active_connections": 1, 2024-09-11T23:34:47.447 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_total_time": 0.100836225, 2024-09-11T23:34:47.447 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_send_time": 0.053542589, 2024-09-11T23:34:47.447 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_recv_time": 0.052820859, 2024-09-11T23:34:47.448 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T23:34:47.448 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T23:34:47.448 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 307, 2024-09-11T23:34:47.448 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.063397361, 2024-09-11T23:34:47.449 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000206506 2024-09-11T23:34:47.449 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:47.449 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_handle_ack_lat": { 2024-09-11T23:34:47.449 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-11T23:34:47.449 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-11T23:34:47.449 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-11T23:34:47.450 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:47.450 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_encrypted_bytes": 780688, 2024-09-11T23:34:47.450 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_encrypted_bytes": 190000 2024-09-11T23:34:47.450 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:47.450 INFO:teuthology.orchestra.run.smithi037.stdout: "AsyncMessenger::Worker-2": { 2024-09-11T23:34:47.450 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_messages": 6, 2024-09-11T23:34:47.451 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages": 237, 2024-09-11T23:34:47.451 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_bytes": 3344, 2024-09-11T23:34:47.451 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_bytes": 199248, 2024-09-11T23:34:47.451 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_created_connections": 4, 2024-09-11T23:34:47.451 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_active_connections": 2, 2024-09-11T23:34:47.451 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_total_time": 0.036345054, 2024-09-11T23:34:47.451 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_send_time": 0.027853868, 2024-09-11T23:34:47.451 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_recv_time": 0.005767703, 2024-09-11T23:34:47.452 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T23:34:47.452 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T23:34:47.452 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 236, 2024-09-11T23:34:47.452 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.061172932, 2024-09-11T23:34:47.452 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000259207 2024-09-11T23:34:47.452 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:47.453 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_handle_ack_lat": { 2024-09-11T23:34:47.453 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-11T23:34:47.453 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-11T23:34:47.453 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-11T23:34:47.453 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:47.453 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_encrypted_bytes": 3344, 2024-09-11T23:34:47.454 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_encrypted_bytes": 199248 2024-09-11T23:34:47.454 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:47.454 INFO:teuthology.orchestra.run.smithi037.stdout: "cct": { 2024-09-11T23:34:47.454 INFO:teuthology.orchestra.run.smithi037.stdout: "total_workers": 0, 2024-09-11T23:34:47.454 INFO:teuthology.orchestra.run.smithi037.stdout: "unhealthy_workers": 0 2024-09-11T23:34:47.454 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:47.455 INFO:teuthology.orchestra.run.smithi037.stdout: "mempool": { 2024-09-11T23:34:47.455 INFO:teuthology.orchestra.run.smithi037.stdout: "bloom_filter_bytes": 0, 2024-09-11T23:34:47.455 INFO:teuthology.orchestra.run.smithi037.stdout: "bloom_filter_items": 0, 2024-09-11T23:34:47.455 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_alloc_bytes": 0, 2024-09-11T23:34:47.455 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_alloc_items": 0, 2024-09-11T23:34:47.455 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_data_bytes": 0, 2024-09-11T23:34:47.455 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_data_items": 0, 2024-09-11T23:34:47.455 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-11T23:34:47.455 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_onode_items": 0, 2024-09-11T23:34:47.455 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-11T23:34:47.455 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_meta_items": 0, 2024-09-11T23:34:47.455 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_other_bytes": 0, 2024-09-11T23:34:47.456 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_other_items": 0, 2024-09-11T23:34:47.456 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-11T23:34:47.456 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_buffer_items": 0, 2024-09-11T23:34:47.456 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_extent_bytes": 0, 2024-09-11T23:34:47.456 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_extent_items": 0, 2024-09-11T23:34:47.456 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_blob_bytes": 0, 2024-09-11T23:34:47.456 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_blob_items": 0, 2024-09-11T23:34:47.456 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-11T23:34:47.456 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_shared_blob_items": 0, 2024-09-11T23:34:47.456 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-11T23:34:47.456 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_inline_bl_items": 0, 2024-09-11T23:34:47.456 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_fsck_bytes": 0, 2024-09-11T23:34:47.456 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_fsck_items": 0, 2024-09-11T23:34:47.457 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_txc_bytes": 0, 2024-09-11T23:34:47.457 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_txc_items": 0, 2024-09-11T23:34:47.457 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-11T23:34:47.457 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_writing_deferred_items": 0, 2024-09-11T23:34:47.457 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_writing_bytes": 0, 2024-09-11T23:34:47.457 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_writing_items": 0, 2024-09-11T23:34:47.457 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_bytes": 0, 2024-09-11T23:34:47.457 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_items": 0, 2024-09-11T23:34:47.457 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_file_reader_bytes": 0, 2024-09-11T23:34:47.457 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_file_reader_items": 0, 2024-09-11T23:34:47.457 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_file_writer_bytes": 0, 2024-09-11T23:34:47.457 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_file_writer_items": 0, 2024-09-11T23:34:47.457 INFO:teuthology.orchestra.run.smithi037.stdout: "buffer_anon_bytes": 148721, 2024-09-11T23:34:47.458 INFO:teuthology.orchestra.run.smithi037.stdout: "buffer_anon_items": 30, 2024-09-11T23:34:47.458 INFO:teuthology.orchestra.run.smithi037.stdout: "buffer_meta_bytes": 0, 2024-09-11T23:34:47.458 INFO:teuthology.orchestra.run.smithi037.stdout: "buffer_meta_items": 0, 2024-09-11T23:34:47.458 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_bytes": 0, 2024-09-11T23:34:47.458 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_items": 0, 2024-09-11T23:34:47.458 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mapbl_bytes": 0, 2024-09-11T23:34:47.458 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mapbl_items": 0, 2024-09-11T23:34:47.458 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pglog_bytes": 0, 2024-09-11T23:34:47.458 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pglog_items": 0, 2024-09-11T23:34:47.458 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_bytes": 0, 2024-09-11T23:34:47.458 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_items": 0, 2024-09-11T23:34:47.458 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_mapping_bytes": 0, 2024-09-11T23:34:47.458 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_mapping_items": 0, 2024-09-11T23:34:47.458 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap_bytes": 0, 2024-09-11T23:34:47.458 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap_items": 0, 2024-09-11T23:34:47.459 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_co_bytes": 928, 2024-09-11T23:34:47.459 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_co_items": 2, 2024-09-11T23:34:47.459 INFO:teuthology.orchestra.run.smithi037.stdout: "unittest_1_bytes": 0, 2024-09-11T23:34:47.459 INFO:teuthology.orchestra.run.smithi037.stdout: "unittest_1_items": 0, 2024-09-11T23:34:47.459 INFO:teuthology.orchestra.run.smithi037.stdout: "unittest_2_bytes": 0, 2024-09-11T23:34:47.459 INFO:teuthology.orchestra.run.smithi037.stdout: "unittest_2_items": 0 2024-09-11T23:34:47.459 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-11T23:34:47.459 INFO:teuthology.orchestra.run.smithi037.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-11T23:34:47.459 INFO:teuthology.orchestra.run.smithi037.stdout: "val": 0, 2024-09-11T23:34:47.459 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 104857600, 2024-09-11T23:34:47.459 INFO:teuthology.orchestra.run.smithi037.stdout: "get_started": 0, 2024-09-11T23:34:47.459 INFO:teuthology.orchestra.run.smithi037.stdout: "get": 315, 2024-09-11T23:34:47.459 INFO:teuthology.orchestra.run.smithi037.stdout: "get_sum": 736480, 2024-09-11T23:34:47.459 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_fail": 0, 2024-09-11T23:34:47.460 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_success": 315, 2024-09-11T23:34:47.460 INFO:teuthology.orchestra.run.smithi037.stdout: "take": 0, 2024-09-11T23:34:47.460 INFO:teuthology.orchestra.run.smithi037.stdout: "take_sum": 0, 2024-09-11T23:34:47.460 INFO:teuthology.orchestra.run.smithi037.stdout: "put": 315, 2024-09-11T23:34:47.460 INFO:teuthology.orchestra.run.smithi037.stdout: "put_sum": 736480, 2024-09-11T23:34:47.460 INFO:teuthology.orchestra.run.smithi037.stdout: "wait": { 2024-09-11T23:34:47.460 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-11T23:34:47.460 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-11T23:34:47.460 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-11T23:34:47.461 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:47.461 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-11T23:34:47.461 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-11T23:34:48.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:34:47 smithi160 ceph-mon[35055]: pgmap v862: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 462 KiB/s wr, 68 op/s 2024-09-11T23:34:48.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:34:47 smithi123 ceph-mon[35438]: pgmap v862: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 462 KiB/s wr, 68 op/s 2024-09-11T23:34:48.303 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:34:47 smithi037 ceph-mon[30630]: pgmap v862: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 462 KiB/s wr, 68 op/s 2024-09-11T23:34:48.342 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-09-11T23:34:48.342 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-09-11T23:34:48.342 DEBUG:tasks.check_counter:Getting stats from b 2024-09-11T23:34:48.343 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph daemon mds.b perf dump 2024-09-11T23:34:48.634 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T23:34:49.282 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-11T23:34:49.282 INFO:teuthology.orchestra.run.smithi123.stdout: "AsyncMessenger::Worker-0": { 2024-09-11T23:34:49.282 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_messages": 2292, 2024-09-11T23:34:49.282 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages": 1767, 2024-09-11T23:34:49.283 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_bytes": 1411681, 2024-09-11T23:34:49.283 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_bytes": 2984727, 2024-09-11T23:34:49.283 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_created_connections": 9, 2024-09-11T23:34:49.283 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_active_connections": 4, 2024-09-11T23:34:49.283 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_total_time": 0.183059192, 2024-09-11T23:34:49.284 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_send_time": 0.068215591, 2024-09-11T23:34:49.284 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_recv_time": 0.124710925, 2024-09-11T23:34:49.284 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_fast_dispatch_time": 0.018636985, 2024-09-11T23:34:49.284 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T23:34:49.284 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 1770, 2024-09-11T23:34:49.284 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.260695709, 2024-09-11T23:34:49.284 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000147285 2024-09-11T23:34:49.284 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:49.284 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_handle_ack_lat": { 2024-09-11T23:34:49.284 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 1828, 2024-09-11T23:34:49.284 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000324412, 2024-09-11T23:34:49.284 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000177 2024-09-11T23:34:49.285 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:49.285 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_encrypted_bytes": 853600, 2024-09-11T23:34:49.285 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_encrypted_bytes": 193392 2024-09-11T23:34:49.285 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:49.285 INFO:teuthology.orchestra.run.smithi123.stdout: "AsyncMessenger::Worker-1": { 2024-09-11T23:34:49.285 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_messages": 1982, 2024-09-11T23:34:49.285 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages": 2195, 2024-09-11T23:34:49.285 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_bytes": 643213, 2024-09-11T23:34:49.285 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_bytes": 5418406, 2024-09-11T23:34:49.285 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_created_connections": 10, 2024-09-11T23:34:49.285 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_active_connections": 6, 2024-09-11T23:34:49.285 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_total_time": 0.167413365, 2024-09-11T23:34:49.286 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_send_time": 0.068742699, 2024-09-11T23:34:49.286 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_recv_time": 0.068704930, 2024-09-11T23:34:49.286 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_fast_dispatch_time": 0.031679338, 2024-09-11T23:34:49.286 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T23:34:49.286 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 2193, 2024-09-11T23:34:49.286 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.371215151, 2024-09-11T23:34:49.286 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000169272 2024-09-11T23:34:49.286 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:49.286 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_handle_ack_lat": { 2024-09-11T23:34:49.286 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 1333, 2024-09-11T23:34:49.286 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000270535, 2024-09-11T23:34:49.286 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000202 2024-09-11T23:34:49.286 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:49.287 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-11T23:34:49.287 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_encrypted_bytes": 492048 2024-09-11T23:34:49.287 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:49.287 INFO:teuthology.orchestra.run.smithi123.stdout: "AsyncMessenger::Worker-2": { 2024-09-11T23:34:49.287 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_messages": 11948, 2024-09-11T23:34:49.287 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages": 12956, 2024-09-11T23:34:49.287 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_bytes": 3673597, 2024-09-11T23:34:49.287 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_bytes": 15031038, 2024-09-11T23:34:49.287 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_created_connections": 19, 2024-09-11T23:34:49.287 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_active_connections": 10, 2024-09-11T23:34:49.287 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_total_time": 0.699572805, 2024-09-11T23:34:49.287 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_send_time": 0.267045548, 2024-09-11T23:34:49.287 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_recv_time": 0.417677637, 2024-09-11T23:34:49.288 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_fast_dispatch_time": 0.104701481, 2024-09-11T23:34:49.288 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T23:34:49.288 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 12951, 2024-09-11T23:34:49.288 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.732742238, 2024-09-11T23:34:49.288 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000056578 2024-09-11T23:34:49.288 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:49.288 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_handle_ack_lat": { 2024-09-11T23:34:49.288 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 10460, 2024-09-11T23:34:49.288 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.002903084, 2024-09-11T23:34:49.288 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000277 2024-09-11T23:34:49.288 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:49.288 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_encrypted_bytes": 91328, 2024-09-11T23:34:49.289 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_encrypted_bytes": 31744 2024-09-11T23:34:49.289 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:49.289 INFO:teuthology.orchestra.run.smithi123.stdout: "cct": { 2024-09-11T23:34:49.289 INFO:teuthology.orchestra.run.smithi123.stdout: "total_workers": 1, 2024-09-11T23:34:49.289 INFO:teuthology.orchestra.run.smithi123.stdout: "unhealthy_workers": 0 2024-09-11T23:34:49.289 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:49.289 INFO:teuthology.orchestra.run.smithi123.stdout: "finisher-MDSRank": { 2024-09-11T23:34:49.289 INFO:teuthology.orchestra.run.smithi123.stdout: "queue_len": 0, 2024-09-11T23:34:49.289 INFO:teuthology.orchestra.run.smithi123.stdout: "complete_latency": { 2024-09-11T23:34:49.289 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 3843, 2024-09-11T23:34:49.289 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 2.608857056, 2024-09-11T23:34:49.289 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000678859 2024-09-11T23:34:49.290 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-11T23:34:49.290 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:49.290 INFO:teuthology.orchestra.run.smithi123.stdout: "finisher-PurgeQueue": { 2024-09-11T23:34:49.290 INFO:teuthology.orchestra.run.smithi123.stdout: "queue_len": 0, 2024-09-11T23:34:49.290 INFO:teuthology.orchestra.run.smithi123.stdout: "complete_latency": { 2024-09-11T23:34:49.290 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 856, 2024-09-11T23:34:49.290 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.042643509, 2024-09-11T23:34:49.290 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000049817 2024-09-11T23:34:49.290 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-11T23:34:49.290 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:49.290 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": { 2024-09-11T23:34:49.291 INFO:teuthology.orchestra.run.smithi123.stdout: "request": 3753, 2024-09-11T23:34:49.291 INFO:teuthology.orchestra.run.smithi123.stdout: "reply": 3753, 2024-09-11T23:34:49.291 INFO:teuthology.orchestra.run.smithi123.stdout: "reply_latency": { 2024-09-11T23:34:49.291 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 3753, 2024-09-11T23:34:49.291 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 15.369275419, 2024-09-11T23:34:49.291 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.004095197 2024-09-11T23:34:49.291 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:49.291 INFO:teuthology.orchestra.run.smithi123.stdout: "slow_reply": 0, 2024-09-11T23:34:49.291 INFO:teuthology.orchestra.run.smithi123.stdout: "forward": 0, 2024-09-11T23:34:49.291 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_fetch_complete": 0, 2024-09-11T23:34:49.291 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_fetch_keys": 0, 2024-09-11T23:34:49.292 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_commit": 39, 2024-09-11T23:34:49.292 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_split": 3, 2024-09-11T23:34:49.292 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_merge": 0, 2024-09-11T23:34:49.292 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes": 1388, 2024-09-11T23:34:49.292 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes_top": 0, 2024-09-11T23:34:49.292 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes_bottom": 0, 2024-09-11T23:34:49.292 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes_pin_tail": 1388, 2024-09-11T23:34:49.292 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes_pinned": 1388, 2024-09-11T23:34:49.292 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes_expired": 7, 2024-09-11T23:34:49.292 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes_with_caps": 1044, 2024-09-11T23:34:49.292 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": 1044, 2024-09-11T23:34:49.293 INFO:teuthology.orchestra.run.smithi123.stdout: "subtrees": 4, 2024-09-11T23:34:49.293 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse": 6154, 2024-09-11T23:34:49.293 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse_hit": 5026, 2024-09-11T23:34:49.293 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse_forward": 0, 2024-09-11T23:34:49.293 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse_discover": 0, 2024-09-11T23:34:49.293 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse_dir_fetch": 0, 2024-09-11T23:34:49.293 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse_remote_ino": 0, 2024-09-11T23:34:49.293 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse_lock": 329, 2024-09-11T23:34:49.293 INFO:teuthology.orchestra.run.smithi123.stdout: "load_cent": 0, 2024-09-11T23:34:49.293 INFO:teuthology.orchestra.run.smithi123.stdout: "q": 0, 2024-09-11T23:34:49.294 INFO:teuthology.orchestra.run.smithi123.stdout: "exported": 1, 2024-09-11T23:34:49.294 INFO:teuthology.orchestra.run.smithi123.stdout: "exported_inodes": 6, 2024-09-11T23:34:49.294 INFO:teuthology.orchestra.run.smithi123.stdout: "imported": 0, 2024-09-11T23:34:49.294 INFO:teuthology.orchestra.run.smithi123.stdout: "imported_inodes": 0, 2024-09-11T23:34:49.294 INFO:teuthology.orchestra.run.smithi123.stdout: "openino_dir_fetch": 0, 2024-09-11T23:34:49.294 INFO:teuthology.orchestra.run.smithi123.stdout: "openino_backtrace_fetch": 0, 2024-09-11T23:34:49.294 INFO:teuthology.orchestra.run.smithi123.stdout: "openino_peer_discover": 0, 2024-09-11T23:34:49.294 INFO:teuthology.orchestra.run.smithi123.stdout: "root_rfiles": 1020, 2024-09-11T23:34:49.294 INFO:teuthology.orchestra.run.smithi123.stdout: "root_rbytes": 1554488780, 2024-09-11T23:34:49.294 INFO:teuthology.orchestra.run.smithi123.stdout: "root_rsnaps": 0, 2024-09-11T23:34:49.294 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_backtrace_fetch": 0, 2024-09-11T23:34:49.294 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_set_tag": 0, 2024-09-11T23:34:49.294 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_backtrace_repaired": 0, 2024-09-11T23:34:49.295 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_inotable_repaired": 0, 2024-09-11T23:34:49.295 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_dir_inodes": 0, 2024-09-11T23:34:49.295 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_dir_base_inodes": 0, 2024-09-11T23:34:49.295 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_dirfrag_rstats": 0, 2024-09-11T23:34:49.295 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_file_inodes": 0, 2024-09-11T23:34:49.295 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_inode_file_caps": 1, 2024-09-11T23:34:49.295 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_cap_op_revoke": 403, 2024-09-11T23:34:49.295 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_cap_op_grant": 2811, 2024-09-11T23:34:49.295 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_cap_op_trunc": 0, 2024-09-11T23:34:49.295 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-11T23:34:49.295 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-11T23:34:49.295 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_client_caps": 4376, 2024-09-11T23:34:49.295 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_client_caps_dirty": 2129, 2024-09-11T23:34:49.296 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_client_cap_release": 148, 2024-09-11T23:34:49.296 INFO:teuthology.orchestra.run.smithi123.stdout: "process_request_cap_release": 1437 2024-09-11T23:34:49.296 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:49.296 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_cache": { 2024-09-11T23:34:49.296 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_update": 0, 2024-09-11T23:34:49.296 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_update_receipt": 0, 2024-09-11T23:34:49.296 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_try_discover": 0, 2024-09-11T23:34:49.296 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_send_discover": 0, 2024-09-11T23:34:49.296 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_handle_discover": 8, 2024-09-11T23:34:49.296 INFO:teuthology.orchestra.run.smithi123.stdout: "num_strays": 0, 2024-09-11T23:34:49.296 INFO:teuthology.orchestra.run.smithi123.stdout: "num_strays_delayed": 0, 2024-09-11T23:34:49.296 INFO:teuthology.orchestra.run.smithi123.stdout: "num_strays_enqueuing": 0, 2024-09-11T23:34:49.296 INFO:teuthology.orchestra.run.smithi123.stdout: "strays_created": 414, 2024-09-11T23:34:49.297 INFO:teuthology.orchestra.run.smithi123.stdout: "strays_enqueued": 255, 2024-09-11T23:34:49.297 INFO:teuthology.orchestra.run.smithi123.stdout: "strays_reintegrated": 159, 2024-09-11T23:34:49.297 INFO:teuthology.orchestra.run.smithi123.stdout: "strays_migrated": 0, 2024-09-11T23:34:49.297 INFO:teuthology.orchestra.run.smithi123.stdout: "num_recovering_processing": 0, 2024-09-11T23:34:49.297 INFO:teuthology.orchestra.run.smithi123.stdout: "num_recovering_enqueued": 0, 2024-09-11T23:34:49.297 INFO:teuthology.orchestra.run.smithi123.stdout: "num_recovering_prioritized": 0, 2024-09-11T23:34:49.297 INFO:teuthology.orchestra.run.smithi123.stdout: "recovery_started": 0, 2024-09-11T23:34:49.297 INFO:teuthology.orchestra.run.smithi123.stdout: "recovery_completed": 0, 2024-09-11T23:34:49.297 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_quiesce_path": 0, 2024-09-11T23:34:49.297 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_quiesce_inode": 0, 2024-09-11T23:34:49.297 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_enqueue_scrub": 0, 2024-09-11T23:34:49.297 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_exportdir": 1, 2024-09-11T23:34:49.297 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_flush": 0, 2024-09-11T23:34:49.298 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_fragmentdir": 3, 2024-09-11T23:34:49.298 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_fragstats": 0, 2024-09-11T23:34:49.298 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_inodestats": 0 2024-09-11T23:34:49.298 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:49.298 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_log": { 2024-09-11T23:34:49.298 INFO:teuthology.orchestra.run.smithi123.stdout: "evlrg": 0, 2024-09-11T23:34:49.298 INFO:teuthology.orchestra.run.smithi123.stdout: "evadd": 6628, 2024-09-11T23:34:49.298 INFO:teuthology.orchestra.run.smithi123.stdout: "evex": 0, 2024-09-11T23:34:49.298 INFO:teuthology.orchestra.run.smithi123.stdout: "evtrm": 0, 2024-09-11T23:34:49.298 INFO:teuthology.orchestra.run.smithi123.stdout: "ev": 6628, 2024-09-11T23:34:49.298 INFO:teuthology.orchestra.run.smithi123.stdout: "evexg": 0, 2024-09-11T23:34:49.298 INFO:teuthology.orchestra.run.smithi123.stdout: "evexd": 0, 2024-09-11T23:34:49.299 INFO:teuthology.orchestra.run.smithi123.stdout: "segadd": 9, 2024-09-11T23:34:49.299 INFO:teuthology.orchestra.run.smithi123.stdout: "segex": 0, 2024-09-11T23:34:49.299 INFO:teuthology.orchestra.run.smithi123.stdout: "segtrm": 0, 2024-09-11T23:34:49.299 INFO:teuthology.orchestra.run.smithi123.stdout: "seg": 9, 2024-09-11T23:34:49.299 INFO:teuthology.orchestra.run.smithi123.stdout: "segmjr": 2, 2024-09-11T23:34:49.299 INFO:teuthology.orchestra.run.smithi123.stdout: "segexg": 0, 2024-09-11T23:34:49.299 INFO:teuthology.orchestra.run.smithi123.stdout: "segexd": 0, 2024-09-11T23:34:49.299 INFO:teuthology.orchestra.run.smithi123.stdout: "expos": 4194304, 2024-09-11T23:34:49.299 INFO:teuthology.orchestra.run.smithi123.stdout: "wrpos": 20767602, 2024-09-11T23:34:49.299 INFO:teuthology.orchestra.run.smithi123.stdout: "rdpos": 0, 2024-09-11T23:34:49.299 INFO:teuthology.orchestra.run.smithi123.stdout: "jlat": { 2024-09-11T23:34:49.299 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 2168, 2024-09-11T23:34:49.299 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 50.095815145, 2024-09-11T23:34:49.300 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.023106925 2024-09-11T23:34:49.300 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:49.300 INFO:teuthology.orchestra.run.smithi123.stdout: "replayed": 0 2024-09-11T23:34:49.300 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:49.300 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_mem": { 2024-09-11T23:34:49.300 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1064, 2024-09-11T23:34:49.300 INFO:teuthology.orchestra.run.smithi123.stdout: "ino+": 1322, 2024-09-11T23:34:49.300 INFO:teuthology.orchestra.run.smithi123.stdout: "ino-": 258, 2024-09-11T23:34:49.300 INFO:teuthology.orchestra.run.smithi123.stdout: "dir": 68, 2024-09-11T23:34:49.300 INFO:teuthology.orchestra.run.smithi123.stdout: "dir+": 73, 2024-09-11T23:34:49.300 INFO:teuthology.orchestra.run.smithi123.stdout: "dir-": 5, 2024-09-11T23:34:49.300 INFO:teuthology.orchestra.run.smithi123.stdout: "dn": 1388, 2024-09-11T23:34:49.300 INFO:teuthology.orchestra.run.smithi123.stdout: "dn+": 1929, 2024-09-11T23:34:49.301 INFO:teuthology.orchestra.run.smithi123.stdout: "dn-": 541, 2024-09-11T23:34:49.301 INFO:teuthology.orchestra.run.smithi123.stdout: "cap": 1044, 2024-09-11T23:34:49.301 INFO:teuthology.orchestra.run.smithi123.stdout: "cap+": 1533, 2024-09-11T23:34:49.301 INFO:teuthology.orchestra.run.smithi123.stdout: "cap-": 489, 2024-09-11T23:34:49.301 INFO:teuthology.orchestra.run.smithi123.stdout: "rss": 67920, 2024-09-11T23:34:49.301 INFO:teuthology.orchestra.run.smithi123.stdout: "heap": 231712 2024-09-11T23:34:49.301 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:49.301 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_server": { 2024-09-11T23:34:49.301 INFO:teuthology.orchestra.run.smithi123.stdout: "dispatch_client_request": 4438, 2024-09-11T23:34:49.302 INFO:teuthology.orchestra.run.smithi123.stdout: "dispatch_server_request": 1, 2024-09-11T23:34:49.302 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_client_request": 3753, 2024-09-11T23:34:49.302 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_client_session": 350, 2024-09-11T23:34:49.302 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_peer_request": 2, 2024-09-11T23:34:49.302 INFO:teuthology.orchestra.run.smithi123.stdout: "req_create_latency": { 2024-09-11T23:34:49.302 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 1273, 2024-09-11T23:34:49.302 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 3.047520238, 2024-09-11T23:34:49.302 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.002393967 2024-09-11T23:34:49.302 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:49.302 INFO:teuthology.orchestra.run.smithi123.stdout: "req_getattr_latency": { 2024-09-11T23:34:49.302 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 29, 2024-09-11T23:34:49.302 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.006592042, 2024-09-11T23:34:49.302 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000227311 2024-09-11T23:34:49.303 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:49.303 INFO:teuthology.orchestra.run.smithi123.stdout: "req_getfilelock_latency": { 2024-09-11T23:34:49.303 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:49.303 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:49.303 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:49.303 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:49.303 INFO:teuthology.orchestra.run.smithi123.stdout: "req_link_latency": { 2024-09-11T23:34:49.303 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 159, 2024-09-11T23:34:49.303 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.294138728, 2024-09-11T23:34:49.303 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.001849929 2024-09-11T23:34:49.303 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:49.303 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lookup_latency": { 2024-09-11T23:34:49.303 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 981, 2024-09-11T23:34:49.304 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 9.354592988, 2024-09-11T23:34:49.304 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.009535772 2024-09-11T23:34:49.304 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:49.304 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lookuphash_latency": { 2024-09-11T23:34:49.304 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:49.304 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:49.304 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:49.304 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:49.304 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lookupino_latency": { 2024-09-11T23:34:49.305 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 2, 2024-09-11T23:34:49.305 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000285523, 2024-09-11T23:34:49.305 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000142761 2024-09-11T23:34:49.305 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:49.305 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lookupname_latency": { 2024-09-11T23:34:49.305 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:49.305 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:49.305 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:49.305 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:49.305 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lookupparent_latency": { 2024-09-11T23:34:49.305 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:49.306 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:49.306 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:49.306 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:49.306 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lookupsnap_latency": { 2024-09-11T23:34:49.306 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:49.306 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:49.306 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:49.306 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:49.306 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lssnap_latency": { 2024-09-11T23:34:49.306 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:49.307 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:49.307 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:49.307 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:49.307 INFO:teuthology.orchestra.run.smithi123.stdout: "req_mkdir_latency": { 2024-09-11T23:34:49.307 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 37, 2024-09-11T23:34:49.307 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.335060374, 2024-09-11T23:34:49.307 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.009055685 2024-09-11T23:34:49.307 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:49.308 INFO:teuthology.orchestra.run.smithi123.stdout: "req_mknod_latency": { 2024-09-11T23:34:49.308 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:49.308 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:49.308 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:49.308 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:49.308 INFO:teuthology.orchestra.run.smithi123.stdout: "req_mksnap_latency": { 2024-09-11T23:34:49.308 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:49.308 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:49.308 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:49.308 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:49.308 INFO:teuthology.orchestra.run.smithi123.stdout: "req_open_latency": { 2024-09-11T23:34:49.308 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 611, 2024-09-11T23:34:49.308 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.194676757, 2024-09-11T23:34:49.309 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000318619 2024-09-11T23:34:49.309 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:49.309 INFO:teuthology.orchestra.run.smithi123.stdout: "req_readdir_latency": { 2024-09-11T23:34:49.309 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 63, 2024-09-11T23:34:49.309 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.096011612, 2024-09-11T23:34:49.309 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.001523993 2024-09-11T23:34:49.309 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:49.309 INFO:teuthology.orchestra.run.smithi123.stdout: "req_rename_latency": { 2024-09-11T23:34:49.309 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 393, 2024-09-11T23:34:49.309 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 1.705766609, 2024-09-11T23:34:49.309 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.004340373 2024-09-11T23:34:49.309 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:49.310 INFO:teuthology.orchestra.run.smithi123.stdout: "req_renamesnap_latency": { 2024-09-11T23:34:49.310 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:49.310 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:49.310 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:49.310 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:49.310 INFO:teuthology.orchestra.run.smithi123.stdout: "req_snapdiff_latency": { 2024-09-11T23:34:49.310 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:49.310 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:49.310 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:49.311 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:49.311 INFO:teuthology.orchestra.run.smithi123.stdout: "req_rmdir_latency": { 2024-09-11T23:34:49.311 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 2, 2024-09-11T23:34:49.311 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.011566070, 2024-09-11T23:34:49.311 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.005783035 2024-09-11T23:34:49.311 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:49.311 INFO:teuthology.orchestra.run.smithi123.stdout: "req_rmsnap_latency": { 2024-09-11T23:34:49.311 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:49.311 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:49.311 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:49.311 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:49.311 INFO:teuthology.orchestra.run.smithi123.stdout: "req_rmxattr_latency": { 2024-09-11T23:34:49.312 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:49.312 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:49.312 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:49.312 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:49.312 INFO:teuthology.orchestra.run.smithi123.stdout: "req_setattr_latency": { 2024-09-11T23:34:49.312 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 2, 2024-09-11T23:34:49.312 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.001420194, 2024-09-11T23:34:49.312 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000710097 2024-09-11T23:34:49.312 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:49.312 INFO:teuthology.orchestra.run.smithi123.stdout: "req_setdirlayout_latency": { 2024-09-11T23:34:49.312 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:49.312 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:49.313 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:49.313 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:49.313 INFO:teuthology.orchestra.run.smithi123.stdout: "req_setfilelock_latency": { 2024-09-11T23:34:49.313 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:49.313 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:49.313 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:49.313 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:49.313 INFO:teuthology.orchestra.run.smithi123.stdout: "req_setlayout_latency": { 2024-09-11T23:34:49.313 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:49.313 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:49.313 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:49.313 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:49.313 INFO:teuthology.orchestra.run.smithi123.stdout: "req_setxattr_latency": { 2024-09-11T23:34:49.314 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 9, 2024-09-11T23:34:49.314 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.023028581, 2024-09-11T23:34:49.314 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.002558731 2024-09-11T23:34:49.314 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:49.314 INFO:teuthology.orchestra.run.smithi123.stdout: "req_symlink_latency": { 2024-09-11T23:34:49.314 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:49.314 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:49.314 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:49.314 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:49.314 INFO:teuthology.orchestra.run.smithi123.stdout: "req_unlink_latency": { 2024-09-11T23:34:49.314 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 192, 2024-09-11T23:34:49.314 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.298615703, 2024-09-11T23:34:49.314 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.001555290 2024-09-11T23:34:49.315 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:49.315 INFO:teuthology.orchestra.run.smithi123.stdout: "cap_revoke_eviction": 0, 2024-09-11T23:34:49.315 INFO:teuthology.orchestra.run.smithi123.stdout: "cap_acquisition_throttle": 0, 2024-09-11T23:34:49.315 INFO:teuthology.orchestra.run.smithi123.stdout: "req_getvxattr_latency": { 2024-09-11T23:34:49.315 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:49.315 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:49.315 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:49.315 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-11T23:34:49.315 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:49.315 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_sessions": { 2024-09-11T23:34:49.315 INFO:teuthology.orchestra.run.smithi123.stdout: "session_count": 1, 2024-09-11T23:34:49.315 INFO:teuthology.orchestra.run.smithi123.stdout: "session_add": 4, 2024-09-11T23:34:49.316 INFO:teuthology.orchestra.run.smithi123.stdout: "session_remove": 3, 2024-09-11T23:34:49.316 INFO:teuthology.orchestra.run.smithi123.stdout: "sessions_open": 1, 2024-09-11T23:34:49.316 INFO:teuthology.orchestra.run.smithi123.stdout: "sessions_stale": 0, 2024-09-11T23:34:49.316 INFO:teuthology.orchestra.run.smithi123.stdout: "total_load": 578, 2024-09-11T23:34:49.316 INFO:teuthology.orchestra.run.smithi123.stdout: "average_load": 578, 2024-09-11T23:34:49.316 INFO:teuthology.orchestra.run.smithi123.stdout: "avg_session_uptime": 949, 2024-09-11T23:34:49.316 INFO:teuthology.orchestra.run.smithi123.stdout: "mdthresh_evicted": 0 2024-09-11T23:34:49.317 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:49.317 INFO:teuthology.orchestra.run.smithi123.stdout: "mempool": { 2024-09-11T23:34:49.317 INFO:teuthology.orchestra.run.smithi123.stdout: "bloom_filter_bytes": 0, 2024-09-11T23:34:49.317 INFO:teuthology.orchestra.run.smithi123.stdout: "bloom_filter_items": 0, 2024-09-11T23:34:49.317 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_alloc_bytes": 0, 2024-09-11T23:34:49.317 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_alloc_items": 0, 2024-09-11T23:34:49.317 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_data_bytes": 0, 2024-09-11T23:34:49.317 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_data_items": 0, 2024-09-11T23:34:49.317 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-11T23:34:49.317 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_onode_items": 0, 2024-09-11T23:34:49.317 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-11T23:34:49.318 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_meta_items": 0, 2024-09-11T23:34:49.318 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_other_bytes": 0, 2024-09-11T23:34:49.318 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_other_items": 0, 2024-09-11T23:34:49.318 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-11T23:34:49.318 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_buffer_items": 0, 2024-09-11T23:34:49.318 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_extent_bytes": 0, 2024-09-11T23:34:49.318 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_extent_items": 0, 2024-09-11T23:34:49.318 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_blob_bytes": 0, 2024-09-11T23:34:49.318 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_blob_items": 0, 2024-09-11T23:34:49.318 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-11T23:34:49.318 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_shared_blob_items": 0, 2024-09-11T23:34:49.318 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-11T23:34:49.318 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_inline_bl_items": 0, 2024-09-11T23:34:49.318 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_fsck_bytes": 0, 2024-09-11T23:34:49.319 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_fsck_items": 0, 2024-09-11T23:34:49.319 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_txc_bytes": 0, 2024-09-11T23:34:49.319 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_txc_items": 0, 2024-09-11T23:34:49.319 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-11T23:34:49.319 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_writing_deferred_items": 0, 2024-09-11T23:34:49.319 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_writing_bytes": 0, 2024-09-11T23:34:49.319 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_writing_items": 0, 2024-09-11T23:34:49.319 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_bytes": 0, 2024-09-11T23:34:49.319 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_items": 0, 2024-09-11T23:34:49.319 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_file_reader_bytes": 0, 2024-09-11T23:34:49.319 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_file_reader_items": 0, 2024-09-11T23:34:49.319 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_file_writer_bytes": 0, 2024-09-11T23:34:49.320 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_file_writer_items": 0, 2024-09-11T23:34:49.320 INFO:teuthology.orchestra.run.smithi123.stdout: "buffer_anon_bytes": 346765, 2024-09-11T23:34:49.320 INFO:teuthology.orchestra.run.smithi123.stdout: "buffer_anon_items": 1177, 2024-09-11T23:34:49.320 INFO:teuthology.orchestra.run.smithi123.stdout: "buffer_meta_bytes": 528, 2024-09-11T23:34:49.320 INFO:teuthology.orchestra.run.smithi123.stdout: "buffer_meta_items": 6, 2024-09-11T23:34:49.320 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_bytes": 0, 2024-09-11T23:34:49.320 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_items": 0, 2024-09-11T23:34:49.320 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_mapbl_bytes": 0, 2024-09-11T23:34:49.320 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_mapbl_items": 0, 2024-09-11T23:34:49.320 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_pglog_bytes": 0, 2024-09-11T23:34:49.320 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_pglog_items": 0, 2024-09-11T23:34:49.320 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_bytes": 9336, 2024-09-11T23:34:49.321 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_items": 176, 2024-09-11T23:34:49.321 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_mapping_bytes": 0, 2024-09-11T23:34:49.321 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_mapping_items": 0, 2024-09-11T23:34:49.321 INFO:teuthology.orchestra.run.smithi123.stdout: "pgmap_bytes": 0, 2024-09-11T23:34:49.321 INFO:teuthology.orchestra.run.smithi123.stdout: "pgmap_items": 0, 2024-09-11T23:34:49.321 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_co_bytes": 4043661, 2024-09-11T23:34:49.321 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_co_items": 56162, 2024-09-11T23:34:49.322 INFO:teuthology.orchestra.run.smithi123.stdout: "unittest_1_bytes": 0, 2024-09-11T23:34:49.322 INFO:teuthology.orchestra.run.smithi123.stdout: "unittest_1_items": 0, 2024-09-11T23:34:49.322 INFO:teuthology.orchestra.run.smithi123.stdout: "unittest_2_bytes": 0, 2024-09-11T23:34:49.322 INFO:teuthology.orchestra.run.smithi123.stdout: "unittest_2_items": 0 2024-09-11T23:34:49.322 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:49.322 INFO:teuthology.orchestra.run.smithi123.stdout: "objecter": { 2024-09-11T23:34:49.323 INFO:teuthology.orchestra.run.smithi123.stdout: "op_active": 0, 2024-09-11T23:34:49.323 INFO:teuthology.orchestra.run.smithi123.stdout: "op_laggy": 0, 2024-09-11T23:34:49.323 INFO:teuthology.orchestra.run.smithi123.stdout: "op_send": 3858, 2024-09-11T23:34:49.323 INFO:teuthology.orchestra.run.smithi123.stdout: "op_send_bytes": 17086261, 2024-09-11T23:34:49.323 INFO:teuthology.orchestra.run.smithi123.stdout: "op_resend": 32, 2024-09-11T23:34:49.323 INFO:teuthology.orchestra.run.smithi123.stdout: "op_reply": 3858, 2024-09-11T23:34:49.324 INFO:teuthology.orchestra.run.smithi123.stdout: "op_latency": { 2024-09-11T23:34:49.324 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 3858, 2024-09-11T23:34:49.324 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 118.053398362, 2024-09-11T23:34:49.324 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.030599636 2024-09-11T23:34:49.324 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:49.325 INFO:teuthology.orchestra.run.smithi123.stdout: "op_inflight": 0, 2024-09-11T23:34:49.325 INFO:teuthology.orchestra.run.smithi123.stdout: "oplen_avg": { 2024-09-11T23:34:49.325 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 3858, 2024-09-11T23:34:49.325 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 4207 2024-09-11T23:34:49.325 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:49.325 INFO:teuthology.orchestra.run.smithi123.stdout: "op": 3858, 2024-09-11T23:34:49.326 INFO:teuthology.orchestra.run.smithi123.stdout: "op_r": 93, 2024-09-11T23:34:49.326 INFO:teuthology.orchestra.run.smithi123.stdout: "op_w": 3765, 2024-09-11T23:34:49.326 INFO:teuthology.orchestra.run.smithi123.stdout: "op_rmw": 0, 2024-09-11T23:34:49.326 INFO:teuthology.orchestra.run.smithi123.stdout: "op_pg": 0, 2024-09-11T23:34:49.326 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_stat": 0, 2024-09-11T23:34:49.326 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_create": 11, 2024-09-11T23:34:49.327 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_read": 93, 2024-09-11T23:34:49.327 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_write": 2261, 2024-09-11T23:34:49.327 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_writefull": 139, 2024-09-11T23:34:49.327 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_writesame": 0, 2024-09-11T23:34:49.327 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_append": 0, 2024-09-11T23:34:49.327 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_zero": 0, 2024-09-11T23:34:49.327 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_truncate": 3, 2024-09-11T23:34:49.328 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_delete": 1043, 2024-09-11T23:34:49.328 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_mapext": 0, 2024-09-11T23:34:49.328 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_sparse_read": 0, 2024-09-11T23:34:49.328 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_clonerange": 0, 2024-09-11T23:34:49.328 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_getxattr": 0, 2024-09-11T23:34:49.329 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_setxattr": 22, 2024-09-11T23:34:49.329 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_cmpxattr": 0, 2024-09-11T23:34:49.329 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_rmxattr": 0, 2024-09-11T23:34:49.329 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_resetxattrs": 0, 2024-09-11T23:34:49.329 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_call": 0, 2024-09-11T23:34:49.329 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_watch": 0, 2024-09-11T23:34:49.330 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_notify": 0, 2024-09-11T23:34:49.330 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_src_cmpxattr": 0, 2024-09-11T23:34:49.330 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_pgls": 0, 2024-09-11T23:34:49.330 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_pgls_filter": 0, 2024-09-11T23:34:49.330 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_other": 0, 2024-09-11T23:34:49.330 INFO:teuthology.orchestra.run.smithi123.stdout: "linger_active": 0, 2024-09-11T23:34:49.331 INFO:teuthology.orchestra.run.smithi123.stdout: "linger_send": 0, 2024-09-11T23:34:49.331 INFO:teuthology.orchestra.run.smithi123.stdout: "linger_resend": 0, 2024-09-11T23:34:49.331 INFO:teuthology.orchestra.run.smithi123.stdout: "linger_ping": 0, 2024-09-11T23:34:49.331 INFO:teuthology.orchestra.run.smithi123.stdout: "poolop_active": 0, 2024-09-11T23:34:49.331 INFO:teuthology.orchestra.run.smithi123.stdout: "poolop_send": 0, 2024-09-11T23:34:49.331 INFO:teuthology.orchestra.run.smithi123.stdout: "poolop_resend": 0, 2024-09-11T23:34:49.332 INFO:teuthology.orchestra.run.smithi123.stdout: "poolstat_active": 0, 2024-09-11T23:34:49.332 INFO:teuthology.orchestra.run.smithi123.stdout: "poolstat_send": 0, 2024-09-11T23:34:49.332 INFO:teuthology.orchestra.run.smithi123.stdout: "poolstat_resend": 0, 2024-09-11T23:34:49.332 INFO:teuthology.orchestra.run.smithi123.stdout: "statfs_active": 0, 2024-09-11T23:34:49.332 INFO:teuthology.orchestra.run.smithi123.stdout: "statfs_send": 0, 2024-09-11T23:34:49.332 INFO:teuthology.orchestra.run.smithi123.stdout: "statfs_resend": 0, 2024-09-11T23:34:49.333 INFO:teuthology.orchestra.run.smithi123.stdout: "command_active": 0, 2024-09-11T23:34:49.333 INFO:teuthology.orchestra.run.smithi123.stdout: "command_send": 0, 2024-09-11T23:34:49.333 INFO:teuthology.orchestra.run.smithi123.stdout: "command_resend": 0, 2024-09-11T23:34:49.333 INFO:teuthology.orchestra.run.smithi123.stdout: "map_epoch": 95, 2024-09-11T23:34:49.333 INFO:teuthology.orchestra.run.smithi123.stdout: "map_full": 0, 2024-09-11T23:34:49.333 INFO:teuthology.orchestra.run.smithi123.stdout: "map_inc": 11, 2024-09-11T23:34:49.334 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_sessions": 12, 2024-09-11T23:34:49.334 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_session_open": 12, 2024-09-11T23:34:49.334 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_session_close": 0, 2024-09-11T23:34:49.334 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_laggy": 0, 2024-09-11T23:34:49.334 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_wr": 522, 2024-09-11T23:34:49.334 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_rd": 0, 2024-09-11T23:34:49.335 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_del": 113 2024-09-11T23:34:49.335 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:49.335 INFO:teuthology.orchestra.run.smithi123.stdout: "oft": { 2024-09-11T23:34:49.335 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_total_objs": 1, 2024-09-11T23:34:49.335 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_total_kv_pairs": 0, 2024-09-11T23:34:49.335 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_total_updates": 0, 2024-09-11T23:34:49.336 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_total_removes": 0 2024-09-11T23:34:49.336 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:49.336 INFO:teuthology.orchestra.run.smithi123.stdout: "osd-slow-ops": { 2024-09-11T23:34:49.336 INFO:teuthology.orchestra.run.smithi123.stdout: "slow_ops_count": 0 2024-09-11T23:34:49.336 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:49.337 INFO:teuthology.orchestra.run.smithi123.stdout: "purge_queue": { 2024-09-11T23:34:49.337 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_executing_ops": 0, 2024-09-11T23:34:49.337 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_executing_ops_high_water": 12, 2024-09-11T23:34:49.337 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_executing": 0, 2024-09-11T23:34:49.337 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_executing_high_water": 5, 2024-09-11T23:34:49.338 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_executed_ops": 528, 2024-09-11T23:34:49.338 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_executed": 255, 2024-09-11T23:34:49.338 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_item_in_journal": 0 2024-09-11T23:34:49.338 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:49.338 INFO:teuthology.orchestra.run.smithi123.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-11T23:34:49.338 INFO:teuthology.orchestra.run.smithi123.stdout: "val": 0, 2024-09-11T23:34:49.339 INFO:teuthology.orchestra.run.smithi123.stdout: "max": 104857600, 2024-09-11T23:34:49.339 INFO:teuthology.orchestra.run.smithi123.stdout: "get_started": 0, 2024-09-11T23:34:49.339 INFO:teuthology.orchestra.run.smithi123.stdout: "get": 16218, 2024-09-11T23:34:49.339 INFO:teuthology.orchestra.run.smithi123.stdout: "get_sum": 4386216, 2024-09-11T23:34:49.339 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_fail": 0, 2024-09-11T23:34:49.340 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_success": 16218, 2024-09-11T23:34:49.340 INFO:teuthology.orchestra.run.smithi123.stdout: "take": 0, 2024-09-11T23:34:49.340 INFO:teuthology.orchestra.run.smithi123.stdout: "take_sum": 0, 2024-09-11T23:34:49.340 INFO:teuthology.orchestra.run.smithi123.stdout: "put": 16218, 2024-09-11T23:34:49.340 INFO:teuthology.orchestra.run.smithi123.stdout: "put_sum": 4386216, 2024-09-11T23:34:49.340 INFO:teuthology.orchestra.run.smithi123.stdout: "wait": { 2024-09-11T23:34:49.341 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:49.341 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:49.341 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:49.341 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-11T23:34:49.341 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:49.342 INFO:teuthology.orchestra.run.smithi123.stdout: "throttle-objecter_bytes": { 2024-09-11T23:34:49.342 INFO:teuthology.orchestra.run.smithi123.stdout: "val": 0, 2024-09-11T23:34:49.342 INFO:teuthology.orchestra.run.smithi123.stdout: "max": 104857600, 2024-09-11T23:34:49.342 INFO:teuthology.orchestra.run.smithi123.stdout: "get_started": 0, 2024-09-11T23:34:49.342 INFO:teuthology.orchestra.run.smithi123.stdout: "get": 0, 2024-09-11T23:34:49.343 INFO:teuthology.orchestra.run.smithi123.stdout: "get_sum": 0, 2024-09-11T23:34:49.343 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_fail": 0, 2024-09-11T23:34:49.343 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_success": 0, 2024-09-11T23:34:49.343 INFO:teuthology.orchestra.run.smithi123.stdout: "take": 3858, 2024-09-11T23:34:49.343 INFO:teuthology.orchestra.run.smithi123.stdout: "take_sum": 17114040, 2024-09-11T23:34:49.344 INFO:teuthology.orchestra.run.smithi123.stdout: "put": 3858, 2024-09-11T23:34:49.344 INFO:teuthology.orchestra.run.smithi123.stdout: "put_sum": 17114040, 2024-09-11T23:34:49.344 INFO:teuthology.orchestra.run.smithi123.stdout: "wait": { 2024-09-11T23:34:49.344 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:49.344 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:49.344 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:49.345 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-11T23:34:49.345 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:49.345 INFO:teuthology.orchestra.run.smithi123.stdout: "throttle-objecter_ops": { 2024-09-11T23:34:49.345 INFO:teuthology.orchestra.run.smithi123.stdout: "val": 0, 2024-09-11T23:34:49.345 INFO:teuthology.orchestra.run.smithi123.stdout: "max": 1024, 2024-09-11T23:34:49.345 INFO:teuthology.orchestra.run.smithi123.stdout: "get_started": 0, 2024-09-11T23:34:49.346 INFO:teuthology.orchestra.run.smithi123.stdout: "get": 0, 2024-09-11T23:34:49.346 INFO:teuthology.orchestra.run.smithi123.stdout: "get_sum": 0, 2024-09-11T23:34:49.346 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_fail": 0, 2024-09-11T23:34:49.346 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_success": 0, 2024-09-11T23:34:49.346 INFO:teuthology.orchestra.run.smithi123.stdout: "take": 3858, 2024-09-11T23:34:49.347 INFO:teuthology.orchestra.run.smithi123.stdout: "take_sum": 3858, 2024-09-11T23:34:49.347 INFO:teuthology.orchestra.run.smithi123.stdout: "put": 3858, 2024-09-11T23:34:49.347 INFO:teuthology.orchestra.run.smithi123.stdout: "put_sum": 3858, 2024-09-11T23:34:49.347 INFO:teuthology.orchestra.run.smithi123.stdout: "wait": { 2024-09-11T23:34:49.347 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:49.347 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:49.348 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:49.348 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-11T23:34:49.348 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:49.348 INFO:teuthology.orchestra.run.smithi123.stdout: "throttle-write_buf_throttle": { 2024-09-11T23:34:49.348 INFO:teuthology.orchestra.run.smithi123.stdout: "val": 0, 2024-09-11T23:34:49.349 INFO:teuthology.orchestra.run.smithi123.stdout: "max": 3758096384, 2024-09-11T23:34:49.349 INFO:teuthology.orchestra.run.smithi123.stdout: "get_started": 0, 2024-09-11T23:34:49.349 INFO:teuthology.orchestra.run.smithi123.stdout: "get": 255, 2024-09-11T23:34:49.349 INFO:teuthology.orchestra.run.smithi123.stdout: "get_sum": 27779, 2024-09-11T23:34:49.349 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_fail": 0, 2024-09-11T23:34:49.349 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_success": 255, 2024-09-11T23:34:49.350 INFO:teuthology.orchestra.run.smithi123.stdout: "take": 0, 2024-09-11T23:34:49.350 INFO:teuthology.orchestra.run.smithi123.stdout: "take_sum": 0, 2024-09-11T23:34:49.350 INFO:teuthology.orchestra.run.smithi123.stdout: "put": 93, 2024-09-11T23:34:49.350 INFO:teuthology.orchestra.run.smithi123.stdout: "put_sum": 27779, 2024-09-11T23:34:49.350 INFO:teuthology.orchestra.run.smithi123.stdout: "wait": { 2024-09-11T23:34:49.351 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:49.351 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:49.351 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:49.351 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-11T23:34:49.351 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:49.351 INFO:teuthology.orchestra.run.smithi123.stdout: "throttle-write_buf_throttle-0x55c30fc8c960": { 2024-09-11T23:34:49.352 INFO:teuthology.orchestra.run.smithi123.stdout: "val": 0, 2024-09-11T23:34:49.352 INFO:teuthology.orchestra.run.smithi123.stdout: "max": 3758096384, 2024-09-11T23:34:49.352 INFO:teuthology.orchestra.run.smithi123.stdout: "get_started": 0, 2024-09-11T23:34:49.352 INFO:teuthology.orchestra.run.smithi123.stdout: "get": 6628, 2024-09-11T23:34:49.353 INFO:teuthology.orchestra.run.smithi123.stdout: "get_sum": 16573298, 2024-09-11T23:34:49.353 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_fail": 0, 2024-09-11T23:34:49.353 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_success": 6628, 2024-09-11T23:34:49.353 INFO:teuthology.orchestra.run.smithi123.stdout: "take": 0, 2024-09-11T23:34:49.353 INFO:teuthology.orchestra.run.smithi123.stdout: "take_sum": 0, 2024-09-11T23:34:49.353 INFO:teuthology.orchestra.run.smithi123.stdout: "put": 2168, 2024-09-11T23:34:49.354 INFO:teuthology.orchestra.run.smithi123.stdout: "put_sum": 16573298, 2024-09-11T23:34:49.354 INFO:teuthology.orchestra.run.smithi123.stdout: "wait": { 2024-09-11T23:34:49.354 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:49.354 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:49.354 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:49.355 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-11T23:34:49.355 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-11T23:34:49.355 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-11T23:34:50.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:34:49 smithi160 ceph-mon[35055]: pgmap v863: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 50 KiB/s wr, 17 op/s 2024-09-11T23:34:50.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:34:49 smithi123 ceph-mon[35438]: pgmap v863: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 50 KiB/s wr, 17 op/s 2024-09-11T23:34:50.296 INFO:tasks.check_counter:Daemon mds.b mds.exported=1 2024-09-11T23:34:50.296 INFO:tasks.check_counter:Daemon mds.b mds.imported=0 2024-09-11T23:34:50.296 DEBUG:tasks.check_counter:Getting stats from e 2024-09-11T23:34:50.296 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph daemon mds.e perf dump 2024-09-11T23:34:50.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:34:49 smithi037 ceph-mon[30630]: pgmap v863: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 50 KiB/s wr, 17 op/s 2024-09-11T23:34:50.543 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T23:34:51.059 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-11T23:34:51.059 INFO:teuthology.orchestra.run.smithi123.stdout: "AsyncMessenger::Worker-0": { 2024-09-11T23:34:51.059 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_messages": 1487, 2024-09-11T23:34:51.059 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages": 1487, 2024-09-11T23:34:51.059 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_bytes": 4655657, 2024-09-11T23:34:51.059 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_bytes": 472052, 2024-09-11T23:34:51.059 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_created_connections": 6, 2024-09-11T23:34:51.059 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_active_connections": 2, 2024-09-11T23:34:51.059 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_total_time": 0.132825231, 2024-09-11T23:34:51.060 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_send_time": 0.045814881, 2024-09-11T23:34:51.060 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_recv_time": 0.035048996, 2024-09-11T23:34:51.060 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_fast_dispatch_time": 0.040798023, 2024-09-11T23:34:51.060 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T23:34:51.060 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 1486, 2024-09-11T23:34:51.060 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.072960481, 2024-09-11T23:34:51.060 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000049098 2024-09-11T23:34:51.060 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:51.060 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_handle_ack_lat": { 2024-09-11T23:34:51.060 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:51.060 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:51.061 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:51.061 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:51.061 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_encrypted_bytes": 3024, 2024-09-11T23:34:51.061 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_encrypted_bytes": 448 2024-09-11T23:34:51.061 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:51.061 INFO:teuthology.orchestra.run.smithi123.stdout: "AsyncMessenger::Worker-1": { 2024-09-11T23:34:51.061 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_messages": 1476, 2024-09-11T23:34:51.061 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages": 1708, 2024-09-11T23:34:51.061 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_bytes": 8559502, 2024-09-11T23:34:51.061 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_bytes": 1030190, 2024-09-11T23:34:51.061 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_created_connections": 6, 2024-09-11T23:34:51.062 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_active_connections": 4, 2024-09-11T23:34:51.062 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_total_time": 0.126317806, 2024-09-11T23:34:51.062 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_send_time": 0.033485283, 2024-09-11T23:34:51.062 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_recv_time": 0.040220172, 2024-09-11T23:34:51.062 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_fast_dispatch_time": 0.042962433, 2024-09-11T23:34:51.062 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T23:34:51.062 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 1706, 2024-09-11T23:34:51.062 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.067047040, 2024-09-11T23:34:51.062 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000039300 2024-09-11T23:34:51.062 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:51.062 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_handle_ack_lat": { 2024-09-11T23:34:51.063 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:51.063 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:51.063 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:51.063 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:51.063 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-11T23:34:51.063 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_encrypted_bytes": 561392 2024-09-11T23:34:51.063 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:51.063 INFO:teuthology.orchestra.run.smithi123.stdout: "AsyncMessenger::Worker-2": { 2024-09-11T23:34:51.063 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_messages": 725, 2024-09-11T23:34:51.063 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages": 718, 2024-09-11T23:34:51.063 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_bytes": 5108489, 2024-09-11T23:34:51.063 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_bytes": 318859, 2024-09-11T23:34:51.063 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_created_connections": 3, 2024-09-11T23:34:51.064 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_active_connections": 2, 2024-09-11T23:34:51.064 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_total_time": 0.071324620, 2024-09-11T23:34:51.064 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_send_time": 0.025788743, 2024-09-11T23:34:51.064 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_recv_time": 0.041721539, 2024-09-11T23:34:51.064 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_fast_dispatch_time": 0.009463121, 2024-09-11T23:34:51.064 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T23:34:51.064 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 717, 2024-09-11T23:34:51.064 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.033276056, 2024-09-11T23:34:51.064 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000046410 2024-09-11T23:34:51.064 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:51.064 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_handle_ack_lat": { 2024-09-11T23:34:51.064 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:51.065 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:51.065 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:51.065 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:51.065 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_encrypted_bytes": 811616, 2024-09-11T23:34:51.065 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_encrypted_bytes": 190704 2024-09-11T23:34:51.065 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:51.065 INFO:teuthology.orchestra.run.smithi123.stdout: "cct": { 2024-09-11T23:34:51.065 INFO:teuthology.orchestra.run.smithi123.stdout: "total_workers": 1, 2024-09-11T23:34:51.065 INFO:teuthology.orchestra.run.smithi123.stdout: "unhealthy_workers": 0 2024-09-11T23:34:51.065 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:51.065 INFO:teuthology.orchestra.run.smithi123.stdout: "finisher-MDSRank": { 2024-09-11T23:34:51.065 INFO:teuthology.orchestra.run.smithi123.stdout: "queue_len": 0, 2024-09-11T23:34:51.066 INFO:teuthology.orchestra.run.smithi123.stdout: "complete_latency": { 2024-09-11T23:34:51.066 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 5667, 2024-09-11T23:34:51.066 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.124822503, 2024-09-11T23:34:51.066 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000022026 2024-09-11T23:34:51.066 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-11T23:34:51.066 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:51.066 INFO:teuthology.orchestra.run.smithi123.stdout: "finisher-PurgeQueue": { 2024-09-11T23:34:51.066 INFO:teuthology.orchestra.run.smithi123.stdout: "queue_len": 0, 2024-09-11T23:34:51.066 INFO:teuthology.orchestra.run.smithi123.stdout: "complete_latency": { 2024-09-11T23:34:51.066 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:51.066 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:51.066 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:51.066 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-11T23:34:51.067 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:51.067 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": { 2024-09-11T23:34:51.067 INFO:teuthology.orchestra.run.smithi123.stdout: "request": 0, 2024-09-11T23:34:51.067 INFO:teuthology.orchestra.run.smithi123.stdout: "reply": 0, 2024-09-11T23:34:51.067 INFO:teuthology.orchestra.run.smithi123.stdout: "reply_latency": { 2024-09-11T23:34:51.067 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:51.067 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:51.067 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:51.067 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:51.067 INFO:teuthology.orchestra.run.smithi123.stdout: "slow_reply": 0, 2024-09-11T23:34:51.067 INFO:teuthology.orchestra.run.smithi123.stdout: "forward": 0, 2024-09-11T23:34:51.067 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_fetch_complete": 0, 2024-09-11T23:34:51.067 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_fetch_keys": 0, 2024-09-11T23:34:51.068 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_commit": 0, 2024-09-11T23:34:51.068 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_split": 0, 2024-09-11T23:34:51.068 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_merge": 0, 2024-09-11T23:34:51.068 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes": 1640, 2024-09-11T23:34:51.068 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes_top": 0, 2024-09-11T23:34:51.068 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes_bottom": 1640, 2024-09-11T23:34:51.068 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes_pin_tail": 0, 2024-09-11T23:34:51.068 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes_pinned": 1640, 2024-09-11T23:34:51.068 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes_expired": 0, 2024-09-11T23:34:51.068 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes_with_caps": 0, 2024-09-11T23:34:51.068 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": 0, 2024-09-11T23:34:51.068 INFO:teuthology.orchestra.run.smithi123.stdout: "subtrees": 3, 2024-09-11T23:34:51.069 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse": 0, 2024-09-11T23:34:51.069 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse_hit": 0, 2024-09-11T23:34:51.069 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse_forward": 0, 2024-09-11T23:34:51.069 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse_discover": 0, 2024-09-11T23:34:51.069 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse_dir_fetch": 0, 2024-09-11T23:34:51.069 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse_remote_ino": 0, 2024-09-11T23:34:51.069 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse_lock": 0, 2024-09-11T23:34:51.069 INFO:teuthology.orchestra.run.smithi123.stdout: "load_cent": 0, 2024-09-11T23:34:51.069 INFO:teuthology.orchestra.run.smithi123.stdout: "q": 0, 2024-09-11T23:34:51.069 INFO:teuthology.orchestra.run.smithi123.stdout: "exported": 0, 2024-09-11T23:34:51.069 INFO:teuthology.orchestra.run.smithi123.stdout: "exported_inodes": 0, 2024-09-11T23:34:51.069 INFO:teuthology.orchestra.run.smithi123.stdout: "imported": 0, 2024-09-11T23:34:51.069 INFO:teuthology.orchestra.run.smithi123.stdout: "imported_inodes": 0, 2024-09-11T23:34:51.070 INFO:teuthology.orchestra.run.smithi123.stdout: "openino_dir_fetch": 0, 2024-09-11T23:34:51.070 INFO:teuthology.orchestra.run.smithi123.stdout: "openino_backtrace_fetch": 0, 2024-09-11T23:34:51.070 INFO:teuthology.orchestra.run.smithi123.stdout: "openino_peer_discover": 0, 2024-09-11T23:34:51.070 INFO:teuthology.orchestra.run.smithi123.stdout: "root_rfiles": 1020, 2024-09-11T23:34:51.070 INFO:teuthology.orchestra.run.smithi123.stdout: "root_rbytes": 1554488780, 2024-09-11T23:34:51.070 INFO:teuthology.orchestra.run.smithi123.stdout: "root_rsnaps": 0, 2024-09-11T23:34:51.070 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_backtrace_fetch": 0, 2024-09-11T23:34:51.070 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_set_tag": 0, 2024-09-11T23:34:51.070 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_backtrace_repaired": 0, 2024-09-11T23:34:51.070 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_inotable_repaired": 0, 2024-09-11T23:34:51.070 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_dir_inodes": 0, 2024-09-11T23:34:51.070 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_dir_base_inodes": 0, 2024-09-11T23:34:51.071 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_dirfrag_rstats": 0, 2024-09-11T23:34:51.071 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_file_inodes": 0, 2024-09-11T23:34:51.071 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_inode_file_caps": 0, 2024-09-11T23:34:51.071 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_cap_op_revoke": 0, 2024-09-11T23:34:51.071 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_cap_op_grant": 0, 2024-09-11T23:34:51.071 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_cap_op_trunc": 0, 2024-09-11T23:34:51.071 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-11T23:34:51.071 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-11T23:34:51.071 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_client_caps": 0, 2024-09-11T23:34:51.071 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_client_caps_dirty": 0, 2024-09-11T23:34:51.071 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_client_cap_release": 0, 2024-09-11T23:34:51.071 INFO:teuthology.orchestra.run.smithi123.stdout: "process_request_cap_release": 0 2024-09-11T23:34:51.071 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:51.072 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_cache": { 2024-09-11T23:34:51.072 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_update": 0, 2024-09-11T23:34:51.072 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_update_receipt": 0, 2024-09-11T23:34:51.072 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_try_discover": 0, 2024-09-11T23:34:51.072 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_send_discover": 0, 2024-09-11T23:34:51.072 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_handle_discover": 0, 2024-09-11T23:34:51.072 INFO:teuthology.orchestra.run.smithi123.stdout: "num_strays": 0, 2024-09-11T23:34:51.072 INFO:teuthology.orchestra.run.smithi123.stdout: "num_strays_delayed": 0, 2024-09-11T23:34:51.072 INFO:teuthology.orchestra.run.smithi123.stdout: "num_strays_enqueuing": 0, 2024-09-11T23:34:51.072 INFO:teuthology.orchestra.run.smithi123.stdout: "strays_created": 0, 2024-09-11T23:34:51.072 INFO:teuthology.orchestra.run.smithi123.stdout: "strays_enqueued": 0, 2024-09-11T23:34:51.072 INFO:teuthology.orchestra.run.smithi123.stdout: "strays_reintegrated": 0, 2024-09-11T23:34:51.072 INFO:teuthology.orchestra.run.smithi123.stdout: "strays_migrated": 0, 2024-09-11T23:34:51.072 INFO:teuthology.orchestra.run.smithi123.stdout: "num_recovering_processing": 0, 2024-09-11T23:34:51.073 INFO:teuthology.orchestra.run.smithi123.stdout: "num_recovering_enqueued": 0, 2024-09-11T23:34:51.073 INFO:teuthology.orchestra.run.smithi123.stdout: "num_recovering_prioritized": 0, 2024-09-11T23:34:51.073 INFO:teuthology.orchestra.run.smithi123.stdout: "recovery_started": 0, 2024-09-11T23:34:51.073 INFO:teuthology.orchestra.run.smithi123.stdout: "recovery_completed": 0, 2024-09-11T23:34:51.073 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_quiesce_path": 0, 2024-09-11T23:34:51.073 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_quiesce_inode": 0, 2024-09-11T23:34:51.073 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_enqueue_scrub": 0, 2024-09-11T23:34:51.073 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_exportdir": 0, 2024-09-11T23:34:51.073 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_flush": 0, 2024-09-11T23:34:51.073 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_fragmentdir": 0, 2024-09-11T23:34:51.073 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_fragstats": 0, 2024-09-11T23:34:51.073 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_inodestats": 0 2024-09-11T23:34:51.074 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:51.074 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_log": { 2024-09-11T23:34:51.074 INFO:teuthology.orchestra.run.smithi123.stdout: "evlrg": 0, 2024-09-11T23:34:51.074 INFO:teuthology.orchestra.run.smithi123.stdout: "evadd": 0, 2024-09-11T23:34:51.074 INFO:teuthology.orchestra.run.smithi123.stdout: "evex": 0, 2024-09-11T23:34:51.074 INFO:teuthology.orchestra.run.smithi123.stdout: "evtrm": 0, 2024-09-11T23:34:51.074 INFO:teuthology.orchestra.run.smithi123.stdout: "ev": 6628, 2024-09-11T23:34:51.074 INFO:teuthology.orchestra.run.smithi123.stdout: "evexg": 0, 2024-09-11T23:34:51.074 INFO:teuthology.orchestra.run.smithi123.stdout: "evexd": 0, 2024-09-11T23:34:51.074 INFO:teuthology.orchestra.run.smithi123.stdout: "segadd": 0, 2024-09-11T23:34:51.074 INFO:teuthology.orchestra.run.smithi123.stdout: "segex": 0, 2024-09-11T23:34:51.074 INFO:teuthology.orchestra.run.smithi123.stdout: "segtrm": 0, 2024-09-11T23:34:51.074 INFO:teuthology.orchestra.run.smithi123.stdout: "seg": 9, 2024-09-11T23:34:51.074 INFO:teuthology.orchestra.run.smithi123.stdout: "segmjr": 2, 2024-09-11T23:34:51.074 INFO:teuthology.orchestra.run.smithi123.stdout: "segexg": 0, 2024-09-11T23:34:51.075 INFO:teuthology.orchestra.run.smithi123.stdout: "segexd": 0, 2024-09-11T23:34:51.075 INFO:teuthology.orchestra.run.smithi123.stdout: "expos": 4194304, 2024-09-11T23:34:51.075 INFO:teuthology.orchestra.run.smithi123.stdout: "wrpos": 20767602, 2024-09-11T23:34:51.075 INFO:teuthology.orchestra.run.smithi123.stdout: "rdpos": 20763775, 2024-09-11T23:34:51.075 INFO:teuthology.orchestra.run.smithi123.stdout: "jlat": { 2024-09-11T23:34:51.075 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:51.075 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:51.075 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:51.075 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:51.075 INFO:teuthology.orchestra.run.smithi123.stdout: "replayed": 6628 2024-09-11T23:34:51.075 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:51.075 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_mem": { 2024-09-11T23:34:51.075 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1061, 2024-09-11T23:34:51.075 INFO:teuthology.orchestra.run.smithi123.stdout: "ino+": 1319, 2024-09-11T23:34:51.076 INFO:teuthology.orchestra.run.smithi123.stdout: "ino-": 258, 2024-09-11T23:34:51.076 INFO:teuthology.orchestra.run.smithi123.stdout: "dir": 65, 2024-09-11T23:34:51.076 INFO:teuthology.orchestra.run.smithi123.stdout: "dir+": 70, 2024-09-11T23:34:51.076 INFO:teuthology.orchestra.run.smithi123.stdout: "dir-": 5, 2024-09-11T23:34:51.076 INFO:teuthology.orchestra.run.smithi123.stdout: "dn": 1640, 2024-09-11T23:34:51.076 INFO:teuthology.orchestra.run.smithi123.stdout: "dn+": 1650, 2024-09-11T23:34:51.076 INFO:teuthology.orchestra.run.smithi123.stdout: "dn-": 10, 2024-09-11T23:34:51.076 INFO:teuthology.orchestra.run.smithi123.stdout: "cap": 0, 2024-09-11T23:34:51.076 INFO:teuthology.orchestra.run.smithi123.stdout: "cap+": 0, 2024-09-11T23:34:51.076 INFO:teuthology.orchestra.run.smithi123.stdout: "cap-": 0, 2024-09-11T23:34:51.076 INFO:teuthology.orchestra.run.smithi123.stdout: "rss": 55116, 2024-09-11T23:34:51.076 INFO:teuthology.orchestra.run.smithi123.stdout: "heap": 215328 2024-09-11T23:34:51.076 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:51.077 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_server": { 2024-09-11T23:34:51.077 INFO:teuthology.orchestra.run.smithi123.stdout: "dispatch_client_request": 0, 2024-09-11T23:34:51.077 INFO:teuthology.orchestra.run.smithi123.stdout: "dispatch_server_request": 0, 2024-09-11T23:34:51.077 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_client_request": 0, 2024-09-11T23:34:51.077 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_client_session": 0, 2024-09-11T23:34:51.077 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_peer_request": 0, 2024-09-11T23:34:51.077 INFO:teuthology.orchestra.run.smithi123.stdout: "req_create_latency": { 2024-09-11T23:34:51.077 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:51.077 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:51.077 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:51.078 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:51.078 INFO:teuthology.orchestra.run.smithi123.stdout: "req_getattr_latency": { 2024-09-11T23:34:51.078 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:51.078 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:51.078 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:51.078 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:51.078 INFO:teuthology.orchestra.run.smithi123.stdout: "req_getfilelock_latency": { 2024-09-11T23:34:51.078 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:51.078 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:51.078 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:51.078 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:51.078 INFO:teuthology.orchestra.run.smithi123.stdout: "req_link_latency": { 2024-09-11T23:34:51.078 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:51.079 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:51.079 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:51.079 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:51.079 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lookup_latency": { 2024-09-11T23:34:51.079 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:51.079 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:51.079 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:51.079 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:51.079 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lookuphash_latency": { 2024-09-11T23:34:51.079 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:51.079 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:51.079 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:51.079 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:51.079 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lookupino_latency": { 2024-09-11T23:34:51.080 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:51.080 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:51.080 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:51.080 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:51.080 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lookupname_latency": { 2024-09-11T23:34:51.080 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:51.080 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:51.080 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:51.080 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:51.080 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lookupparent_latency": { 2024-09-11T23:34:51.080 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:51.080 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:51.080 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:51.080 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:51.081 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lookupsnap_latency": { 2024-09-11T23:34:51.081 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:51.081 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:51.081 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:51.081 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:51.081 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lssnap_latency": { 2024-09-11T23:34:51.081 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:51.081 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:51.081 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:51.082 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:51.082 INFO:teuthology.orchestra.run.smithi123.stdout: "req_mkdir_latency": { 2024-09-11T23:34:51.082 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:51.082 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:51.082 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:51.082 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:51.082 INFO:teuthology.orchestra.run.smithi123.stdout: "req_mknod_latency": { 2024-09-11T23:34:51.083 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:51.083 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:51.083 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:51.083 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:51.083 INFO:teuthology.orchestra.run.smithi123.stdout: "req_mksnap_latency": { 2024-09-11T23:34:51.083 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:51.083 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:51.083 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:51.083 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:51.083 INFO:teuthology.orchestra.run.smithi123.stdout: "req_open_latency": { 2024-09-11T23:34:51.083 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:51.083 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:51.083 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:51.083 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:51.084 INFO:teuthology.orchestra.run.smithi123.stdout: "req_readdir_latency": { 2024-09-11T23:34:51.084 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:51.084 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:51.084 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:51.084 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:51.084 INFO:teuthology.orchestra.run.smithi123.stdout: "req_rename_latency": { 2024-09-11T23:34:51.084 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:51.084 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:51.084 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:51.084 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:51.084 INFO:teuthology.orchestra.run.smithi123.stdout: "req_renamesnap_latency": { 2024-09-11T23:34:51.084 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:51.084 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:51.084 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:51.085 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:51.085 INFO:teuthology.orchestra.run.smithi123.stdout: "req_snapdiff_latency": { 2024-09-11T23:34:51.085 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:51.085 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:51.085 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:51.085 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:51.085 INFO:teuthology.orchestra.run.smithi123.stdout: "req_rmdir_latency": { 2024-09-11T23:34:51.085 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:51.085 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:51.085 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:51.085 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:51.085 INFO:teuthology.orchestra.run.smithi123.stdout: "req_rmsnap_latency": { 2024-09-11T23:34:51.085 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:51.085 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:51.086 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:51.086 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:51.086 INFO:teuthology.orchestra.run.smithi123.stdout: "req_rmxattr_latency": { 2024-09-11T23:34:51.086 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:51.086 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:51.086 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:51.086 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:51.086 INFO:teuthology.orchestra.run.smithi123.stdout: "req_setattr_latency": { 2024-09-11T23:34:51.086 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:51.086 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:51.086 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:51.086 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:51.086 INFO:teuthology.orchestra.run.smithi123.stdout: "req_setdirlayout_latency": { 2024-09-11T23:34:51.086 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:51.086 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:51.087 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:51.087 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:51.087 INFO:teuthology.orchestra.run.smithi123.stdout: "req_setfilelock_latency": { 2024-09-11T23:34:51.087 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:51.087 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:51.087 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:51.087 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:51.087 INFO:teuthology.orchestra.run.smithi123.stdout: "req_setlayout_latency": { 2024-09-11T23:34:51.087 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:51.087 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:51.087 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:51.087 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:51.087 INFO:teuthology.orchestra.run.smithi123.stdout: "req_setxattr_latency": { 2024-09-11T23:34:51.087 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:51.088 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:51.088 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:51.088 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:51.088 INFO:teuthology.orchestra.run.smithi123.stdout: "req_symlink_latency": { 2024-09-11T23:34:51.088 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:51.088 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:51.088 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:51.088 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:51.088 INFO:teuthology.orchestra.run.smithi123.stdout: "req_unlink_latency": { 2024-09-11T23:34:51.088 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:51.088 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:51.088 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:51.088 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:51.089 INFO:teuthology.orchestra.run.smithi123.stdout: "cap_revoke_eviction": 0, 2024-09-11T23:34:51.089 INFO:teuthology.orchestra.run.smithi123.stdout: "cap_acquisition_throttle": 0, 2024-09-11T23:34:51.089 INFO:teuthology.orchestra.run.smithi123.stdout: "req_getvxattr_latency": { 2024-09-11T23:34:51.089 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:51.089 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:51.089 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:51.089 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-11T23:34:51.089 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:51.089 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_sessions": { 2024-09-11T23:34:51.089 INFO:teuthology.orchestra.run.smithi123.stdout: "session_count": 1, 2024-09-11T23:34:51.089 INFO:teuthology.orchestra.run.smithi123.stdout: "session_add": 4, 2024-09-11T23:34:51.089 INFO:teuthology.orchestra.run.smithi123.stdout: "session_remove": 3, 2024-09-11T23:34:51.089 INFO:teuthology.orchestra.run.smithi123.stdout: "sessions_open": 2, 2024-09-11T23:34:51.090 INFO:teuthology.orchestra.run.smithi123.stdout: "sessions_stale": 0, 2024-09-11T23:34:51.090 INFO:teuthology.orchestra.run.smithi123.stdout: "total_load": 0, 2024-09-11T23:34:51.090 INFO:teuthology.orchestra.run.smithi123.stdout: "average_load": 0, 2024-09-11T23:34:51.090 INFO:teuthology.orchestra.run.smithi123.stdout: "avg_session_uptime": 3738, 2024-09-11T23:34:51.090 INFO:teuthology.orchestra.run.smithi123.stdout: "mdthresh_evicted": 0 2024-09-11T23:34:51.090 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:51.090 INFO:teuthology.orchestra.run.smithi123.stdout: "mempool": { 2024-09-11T23:34:51.090 INFO:teuthology.orchestra.run.smithi123.stdout: "bloom_filter_bytes": 0, 2024-09-11T23:34:51.090 INFO:teuthology.orchestra.run.smithi123.stdout: "bloom_filter_items": 0, 2024-09-11T23:34:51.090 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_alloc_bytes": 0, 2024-09-11T23:34:51.090 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_alloc_items": 0, 2024-09-11T23:34:51.090 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_data_bytes": 0, 2024-09-11T23:34:51.090 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_data_items": 0, 2024-09-11T23:34:51.090 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-11T23:34:51.091 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_onode_items": 0, 2024-09-11T23:34:51.091 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-11T23:34:51.091 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_meta_items": 0, 2024-09-11T23:34:51.091 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_other_bytes": 0, 2024-09-11T23:34:51.091 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_other_items": 0, 2024-09-11T23:34:51.091 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-11T23:34:51.091 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_buffer_items": 0, 2024-09-11T23:34:51.091 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_extent_bytes": 0, 2024-09-11T23:34:51.091 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_extent_items": 0, 2024-09-11T23:34:51.091 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_blob_bytes": 0, 2024-09-11T23:34:51.091 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_blob_items": 0, 2024-09-11T23:34:51.091 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-11T23:34:51.091 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_shared_blob_items": 0, 2024-09-11T23:34:51.092 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-11T23:34:51.092 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_inline_bl_items": 0, 2024-09-11T23:34:51.092 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_fsck_bytes": 0, 2024-09-11T23:34:51.092 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_fsck_items": 0, 2024-09-11T23:34:51.092 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_txc_bytes": 0, 2024-09-11T23:34:51.092 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_txc_items": 0, 2024-09-11T23:34:51.092 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-11T23:34:51.092 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_writing_deferred_items": 0, 2024-09-11T23:34:51.092 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_writing_bytes": 0, 2024-09-11T23:34:51.092 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_writing_items": 0, 2024-09-11T23:34:51.092 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_bytes": 0, 2024-09-11T23:34:51.092 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_items": 0, 2024-09-11T23:34:51.092 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_file_reader_bytes": 0, 2024-09-11T23:34:51.093 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_file_reader_items": 0, 2024-09-11T23:34:51.093 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_file_writer_bytes": 0, 2024-09-11T23:34:51.093 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_file_writer_items": 0, 2024-09-11T23:34:51.093 INFO:teuthology.orchestra.run.smithi123.stdout: "buffer_anon_bytes": 228646, 2024-09-11T23:34:51.093 INFO:teuthology.orchestra.run.smithi123.stdout: "buffer_anon_items": 1092, 2024-09-11T23:34:51.093 INFO:teuthology.orchestra.run.smithi123.stdout: "buffer_meta_bytes": 0, 2024-09-11T23:34:51.093 INFO:teuthology.orchestra.run.smithi123.stdout: "buffer_meta_items": 0, 2024-09-11T23:34:51.093 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_bytes": 0, 2024-09-11T23:34:51.093 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_items": 0, 2024-09-11T23:34:51.093 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_mapbl_bytes": 0, 2024-09-11T23:34:51.093 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_mapbl_items": 0, 2024-09-11T23:34:51.093 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_pglog_bytes": 0, 2024-09-11T23:34:51.093 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_pglog_items": 0, 2024-09-11T23:34:51.094 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_bytes": 9336, 2024-09-11T23:34:51.094 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_items": 176, 2024-09-11T23:34:51.094 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_mapping_bytes": 0, 2024-09-11T23:34:51.094 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_mapping_items": 0, 2024-09-11T23:34:51.094 INFO:teuthology.orchestra.run.smithi123.stdout: "pgmap_bytes": 0, 2024-09-11T23:34:51.094 INFO:teuthology.orchestra.run.smithi123.stdout: "pgmap_items": 0, 2024-09-11T23:34:51.094 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_co_bytes": 3720077, 2024-09-11T23:34:51.094 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_co_items": 42239, 2024-09-11T23:34:51.094 INFO:teuthology.orchestra.run.smithi123.stdout: "unittest_1_bytes": 0, 2024-09-11T23:34:51.094 INFO:teuthology.orchestra.run.smithi123.stdout: "unittest_1_items": 0, 2024-09-11T23:34:51.094 INFO:teuthology.orchestra.run.smithi123.stdout: "unittest_2_bytes": 0, 2024-09-11T23:34:51.094 INFO:teuthology.orchestra.run.smithi123.stdout: "unittest_2_items": 0 2024-09-11T23:34:51.094 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:51.095 INFO:teuthology.orchestra.run.smithi123.stdout: "objecter": { 2024-09-11T23:34:51.095 INFO:teuthology.orchestra.run.smithi123.stdout: "op_active": 0, 2024-09-11T23:34:51.095 INFO:teuthology.orchestra.run.smithi123.stdout: "op_laggy": 0, 2024-09-11T23:34:51.095 INFO:teuthology.orchestra.run.smithi123.stdout: "op_send": 3360, 2024-09-11T23:34:51.095 INFO:teuthology.orchestra.run.smithi123.stdout: "op_send_bytes": 26, 2024-09-11T23:34:51.095 INFO:teuthology.orchestra.run.smithi123.stdout: "op_resend": 4, 2024-09-11T23:34:51.095 INFO:teuthology.orchestra.run.smithi123.stdout: "op_reply": 3360, 2024-09-11T23:34:51.095 INFO:teuthology.orchestra.run.smithi123.stdout: "op_latency": { 2024-09-11T23:34:51.095 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 3360, 2024-09-11T23:34:51.095 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 58.746706275, 2024-09-11T23:34:51.095 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.017484138 2024-09-11T23:34:51.095 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:51.095 INFO:teuthology.orchestra.run.smithi123.stdout: "op_inflight": 0, 2024-09-11T23:34:51.096 INFO:teuthology.orchestra.run.smithi123.stdout: "oplen_avg": { 2024-09-11T23:34:51.096 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 3360, 2024-09-11T23:34:51.096 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 3361 2024-09-11T23:34:51.096 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:51.096 INFO:teuthology.orchestra.run.smithi123.stdout: "op": 3360, 2024-09-11T23:34:51.096 INFO:teuthology.orchestra.run.smithi123.stdout: "op_r": 3360, 2024-09-11T23:34:51.096 INFO:teuthology.orchestra.run.smithi123.stdout: "op_w": 0, 2024-09-11T23:34:51.096 INFO:teuthology.orchestra.run.smithi123.stdout: "op_rmw": 0, 2024-09-11T23:34:51.096 INFO:teuthology.orchestra.run.smithi123.stdout: "op_pg": 0, 2024-09-11T23:34:51.096 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_stat": 2018, 2024-09-11T23:34:51.096 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_create": 0, 2024-09-11T23:34:51.097 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_read": 1339, 2024-09-11T23:34:51.097 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_write": 0, 2024-09-11T23:34:51.097 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_writefull": 0, 2024-09-11T23:34:51.097 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_writesame": 0, 2024-09-11T23:34:51.097 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_append": 0, 2024-09-11T23:34:51.097 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_zero": 0, 2024-09-11T23:34:51.097 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_truncate": 0, 2024-09-11T23:34:51.097 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_delete": 0, 2024-09-11T23:34:51.097 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_mapext": 0, 2024-09-11T23:34:51.097 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_sparse_read": 0, 2024-09-11T23:34:51.097 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_clonerange": 0, 2024-09-11T23:34:51.097 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_getxattr": 2, 2024-09-11T23:34:51.097 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_setxattr": 0, 2024-09-11T23:34:51.098 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_cmpxattr": 0, 2024-09-11T23:34:51.098 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_rmxattr": 0, 2024-09-11T23:34:51.098 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_resetxattrs": 0, 2024-09-11T23:34:51.098 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_call": 0, 2024-09-11T23:34:51.098 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_watch": 0, 2024-09-11T23:34:51.098 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_notify": 0, 2024-09-11T23:34:51.098 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_src_cmpxattr": 0, 2024-09-11T23:34:51.098 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_pgls": 0, 2024-09-11T23:34:51.098 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_pgls_filter": 0, 2024-09-11T23:34:51.098 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_other": 0, 2024-09-11T23:34:51.098 INFO:teuthology.orchestra.run.smithi123.stdout: "linger_active": 0, 2024-09-11T23:34:51.098 INFO:teuthology.orchestra.run.smithi123.stdout: "linger_send": 0, 2024-09-11T23:34:51.098 INFO:teuthology.orchestra.run.smithi123.stdout: "linger_resend": 0, 2024-09-11T23:34:51.099 INFO:teuthology.orchestra.run.smithi123.stdout: "linger_ping": 0, 2024-09-11T23:34:51.099 INFO:teuthology.orchestra.run.smithi123.stdout: "poolop_active": 0, 2024-09-11T23:34:51.099 INFO:teuthology.orchestra.run.smithi123.stdout: "poolop_send": 0, 2024-09-11T23:34:51.099 INFO:teuthology.orchestra.run.smithi123.stdout: "poolop_resend": 0, 2024-09-11T23:34:51.099 INFO:teuthology.orchestra.run.smithi123.stdout: "poolstat_active": 0, 2024-09-11T23:34:51.099 INFO:teuthology.orchestra.run.smithi123.stdout: "poolstat_send": 0, 2024-09-11T23:34:51.099 INFO:teuthology.orchestra.run.smithi123.stdout: "poolstat_resend": 0, 2024-09-11T23:34:51.099 INFO:teuthology.orchestra.run.smithi123.stdout: "statfs_active": 0, 2024-09-11T23:34:51.099 INFO:teuthology.orchestra.run.smithi123.stdout: "statfs_send": 0, 2024-09-11T23:34:51.099 INFO:teuthology.orchestra.run.smithi123.stdout: "statfs_resend": 0, 2024-09-11T23:34:51.099 INFO:teuthology.orchestra.run.smithi123.stdout: "command_active": 0, 2024-09-11T23:34:51.099 INFO:teuthology.orchestra.run.smithi123.stdout: "command_send": 0, 2024-09-11T23:34:51.099 INFO:teuthology.orchestra.run.smithi123.stdout: "command_resend": 0, 2024-09-11T23:34:51.100 INFO:teuthology.orchestra.run.smithi123.stdout: "map_epoch": 95, 2024-09-11T23:34:51.100 INFO:teuthology.orchestra.run.smithi123.stdout: "map_full": 0, 2024-09-11T23:34:51.100 INFO:teuthology.orchestra.run.smithi123.stdout: "map_inc": 2, 2024-09-11T23:34:51.100 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_sessions": 5, 2024-09-11T23:34:51.100 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_session_open": 5, 2024-09-11T23:34:51.100 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_session_close": 0, 2024-09-11T23:34:51.100 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_laggy": 0, 2024-09-11T23:34:51.100 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_wr": 0, 2024-09-11T23:34:51.101 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_rd": 2, 2024-09-11T23:34:51.101 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_del": 0 2024-09-11T23:34:51.101 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:51.101 INFO:teuthology.orchestra.run.smithi123.stdout: "oft": { 2024-09-11T23:34:51.101 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_total_objs": 0, 2024-09-11T23:34:51.101 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_total_kv_pairs": 0, 2024-09-11T23:34:51.102 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_total_updates": 0, 2024-09-11T23:34:51.102 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_total_removes": 0 2024-09-11T23:34:51.102 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:51.102 INFO:teuthology.orchestra.run.smithi123.stdout: "osd-slow-ops": { 2024-09-11T23:34:51.102 INFO:teuthology.orchestra.run.smithi123.stdout: "slow_ops_count": 0 2024-09-11T23:34:51.102 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:51.103 INFO:teuthology.orchestra.run.smithi123.stdout: "purge_queue": { 2024-09-11T23:34:51.103 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_executing_ops": 0, 2024-09-11T23:34:51.103 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_executing_ops_high_water": 0, 2024-09-11T23:34:51.103 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_executing": 0, 2024-09-11T23:34:51.103 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_executing_high_water": 0, 2024-09-11T23:34:51.103 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_executed_ops": 0, 2024-09-11T23:34:51.104 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_executed": 0, 2024-09-11T23:34:51.104 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_item_in_journal": 0 2024-09-11T23:34:51.104 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:51.104 INFO:teuthology.orchestra.run.smithi123.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-11T23:34:51.104 INFO:teuthology.orchestra.run.smithi123.stdout: "val": 0, 2024-09-11T23:34:51.104 INFO:teuthology.orchestra.run.smithi123.stdout: "max": 104857600, 2024-09-11T23:34:51.105 INFO:teuthology.orchestra.run.smithi123.stdout: "get_started": 0, 2024-09-11T23:34:51.105 INFO:teuthology.orchestra.run.smithi123.stdout: "get": 3684, 2024-09-11T23:34:51.105 INFO:teuthology.orchestra.run.smithi123.stdout: "get_sum": 17972480, 2024-09-11T23:34:51.105 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_fail": 0, 2024-09-11T23:34:51.105 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_success": 3684, 2024-09-11T23:34:51.105 INFO:teuthology.orchestra.run.smithi123.stdout: "take": 0, 2024-09-11T23:34:51.105 INFO:teuthology.orchestra.run.smithi123.stdout: "take_sum": 0, 2024-09-11T23:34:51.106 INFO:teuthology.orchestra.run.smithi123.stdout: "put": 3684, 2024-09-11T23:34:51.106 INFO:teuthology.orchestra.run.smithi123.stdout: "put_sum": 17972480, 2024-09-11T23:34:51.106 INFO:teuthology.orchestra.run.smithi123.stdout: "wait": { 2024-09-11T23:34:51.106 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:51.106 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:51.106 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:51.107 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-11T23:34:51.107 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:51.107 INFO:teuthology.orchestra.run.smithi123.stdout: "throttle-objecter_bytes": { 2024-09-11T23:34:51.107 INFO:teuthology.orchestra.run.smithi123.stdout: "val": 0, 2024-09-11T23:34:51.107 INFO:teuthology.orchestra.run.smithi123.stdout: "max": 104857600, 2024-09-11T23:34:51.107 INFO:teuthology.orchestra.run.smithi123.stdout: "get_started": 0, 2024-09-11T23:34:51.108 INFO:teuthology.orchestra.run.smithi123.stdout: "get": 0, 2024-09-11T23:34:51.108 INFO:teuthology.orchestra.run.smithi123.stdout: "get_sum": 0, 2024-09-11T23:34:51.108 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_fail": 0, 2024-09-11T23:34:51.108 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_success": 0, 2024-09-11T23:34:51.108 INFO:teuthology.orchestra.run.smithi123.stdout: "take": 3360, 2024-09-11T23:34:51.108 INFO:teuthology.orchestra.run.smithi123.stdout: "take_sum": 16573308, 2024-09-11T23:34:51.109 INFO:teuthology.orchestra.run.smithi123.stdout: "put": 3360, 2024-09-11T23:34:51.109 INFO:teuthology.orchestra.run.smithi123.stdout: "put_sum": 16573308, 2024-09-11T23:34:51.109 INFO:teuthology.orchestra.run.smithi123.stdout: "wait": { 2024-09-11T23:34:51.109 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:51.109 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:51.110 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:51.110 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-11T23:34:51.110 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:51.110 INFO:teuthology.orchestra.run.smithi123.stdout: "throttle-objecter_ops": { 2024-09-11T23:34:51.110 INFO:teuthology.orchestra.run.smithi123.stdout: "val": 0, 2024-09-11T23:34:51.110 INFO:teuthology.orchestra.run.smithi123.stdout: "max": 1024, 2024-09-11T23:34:51.111 INFO:teuthology.orchestra.run.smithi123.stdout: "get_started": 0, 2024-09-11T23:34:51.111 INFO:teuthology.orchestra.run.smithi123.stdout: "get": 0, 2024-09-11T23:34:51.111 INFO:teuthology.orchestra.run.smithi123.stdout: "get_sum": 0, 2024-09-11T23:34:51.111 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_fail": 0, 2024-09-11T23:34:51.111 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_success": 0, 2024-09-11T23:34:51.111 INFO:teuthology.orchestra.run.smithi123.stdout: "take": 3360, 2024-09-11T23:34:51.112 INFO:teuthology.orchestra.run.smithi123.stdout: "take_sum": 3360, 2024-09-11T23:34:51.112 INFO:teuthology.orchestra.run.smithi123.stdout: "put": 3360, 2024-09-11T23:34:51.112 INFO:teuthology.orchestra.run.smithi123.stdout: "put_sum": 3360, 2024-09-11T23:34:51.112 INFO:teuthology.orchestra.run.smithi123.stdout: "wait": { 2024-09-11T23:34:51.112 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:51.112 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:51.112 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:51.113 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-11T23:34:51.113 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:51.113 INFO:teuthology.orchestra.run.smithi123.stdout: "throttle-write_buf_throttle": { 2024-09-11T23:34:51.113 INFO:teuthology.orchestra.run.smithi123.stdout: "val": 0, 2024-09-11T23:34:51.113 INFO:teuthology.orchestra.run.smithi123.stdout: "max": 3758096384, 2024-09-11T23:34:51.113 INFO:teuthology.orchestra.run.smithi123.stdout: "get_started": 0, 2024-09-11T23:34:51.114 INFO:teuthology.orchestra.run.smithi123.stdout: "get": 0, 2024-09-11T23:34:51.114 INFO:teuthology.orchestra.run.smithi123.stdout: "get_sum": 0, 2024-09-11T23:34:51.114 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_fail": 0, 2024-09-11T23:34:51.114 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_success": 0, 2024-09-11T23:34:51.114 INFO:teuthology.orchestra.run.smithi123.stdout: "take": 0, 2024-09-11T23:34:51.114 INFO:teuthology.orchestra.run.smithi123.stdout: "take_sum": 0, 2024-09-11T23:34:51.115 INFO:teuthology.orchestra.run.smithi123.stdout: "put": 0, 2024-09-11T23:34:51.115 INFO:teuthology.orchestra.run.smithi123.stdout: "put_sum": 0, 2024-09-11T23:34:51.115 INFO:teuthology.orchestra.run.smithi123.stdout: "wait": { 2024-09-11T23:34:51.115 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:51.115 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:51.116 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:51.116 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-11T23:34:51.116 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:51.116 INFO:teuthology.orchestra.run.smithi123.stdout: "throttle-write_buf_throttle-0x563d651fcb40": { 2024-09-11T23:34:51.116 INFO:teuthology.orchestra.run.smithi123.stdout: "val": 0, 2024-09-11T23:34:51.116 INFO:teuthology.orchestra.run.smithi123.stdout: "max": 3758096384, 2024-09-11T23:34:51.117 INFO:teuthology.orchestra.run.smithi123.stdout: "get_started": 0, 2024-09-11T23:34:51.117 INFO:teuthology.orchestra.run.smithi123.stdout: "get": 0, 2024-09-11T23:34:51.117 INFO:teuthology.orchestra.run.smithi123.stdout: "get_sum": 0, 2024-09-11T23:34:51.117 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_fail": 0, 2024-09-11T23:34:51.117 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_success": 0, 2024-09-11T23:34:51.117 INFO:teuthology.orchestra.run.smithi123.stdout: "take": 0, 2024-09-11T23:34:51.118 INFO:teuthology.orchestra.run.smithi123.stdout: "take_sum": 0, 2024-09-11T23:34:51.118 INFO:teuthology.orchestra.run.smithi123.stdout: "put": 0, 2024-09-11T23:34:51.118 INFO:teuthology.orchestra.run.smithi123.stdout: "put_sum": 0, 2024-09-11T23:34:51.118 INFO:teuthology.orchestra.run.smithi123.stdout: "wait": { 2024-09-11T23:34:51.118 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:51.119 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:51.119 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:51.119 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-11T23:34:51.119 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-11T23:34:51.119 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-11T23:34:51.776 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-09-11T23:34:51.776 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-09-11T23:34:51.776 DEBUG:tasks.check_counter:Getting stats from h 2024-09-11T23:34:51.776 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph daemon mds.h perf dump 2024-09-11T23:34:52.000 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:34:51 smithi123 ceph-mon[35438]: pgmap v864: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 4.4 KiB/s wr, 11 op/s 2024-09-11T23:34:52.021 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T23:34:52.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:34:51 smithi160 ceph-mon[35055]: pgmap v864: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 4.4 KiB/s wr, 11 op/s 2024-09-11T23:34:52.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:34:51 smithi037 ceph-mon[30630]: pgmap v864: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 4.4 KiB/s wr, 11 op/s 2024-09-11T23:34:52.574 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-11T23:34:52.574 INFO:teuthology.orchestra.run.smithi123.stdout: "AsyncMessenger::Worker-0": { 2024-09-11T23:34:52.574 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_messages": 726, 2024-09-11T23:34:52.574 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages": 736, 2024-09-11T23:34:52.574 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_bytes": 172674, 2024-09-11T23:34:52.574 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_bytes": 311383, 2024-09-11T23:34:52.574 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_created_connections": 9, 2024-09-11T23:34:52.574 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_active_connections": 2, 2024-09-11T23:34:52.574 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_total_time": 0.075526199, 2024-09-11T23:34:52.574 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_send_time": 0.032159593, 2024-09-11T23:34:52.575 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_recv_time": 0.040274948, 2024-09-11T23:34:52.575 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_fast_dispatch_time": 0.005149153, 2024-09-11T23:34:52.575 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T23:34:52.575 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 737, 2024-09-11T23:34:52.575 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.067155927, 2024-09-11T23:34:52.575 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000091120 2024-09-11T23:34:52.575 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:52.575 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_handle_ack_lat": { 2024-09-11T23:34:52.575 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 1384, 2024-09-11T23:34:52.575 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000281240, 2024-09-11T23:34:52.575 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000203 2024-09-11T23:34:52.575 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:52.575 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_encrypted_bytes": 3024, 2024-09-11T23:34:52.576 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_encrypted_bytes": 448 2024-09-11T23:34:52.576 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:52.576 INFO:teuthology.orchestra.run.smithi123.stdout: "AsyncMessenger::Worker-1": { 2024-09-11T23:34:52.576 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_messages": 363, 2024-09-11T23:34:52.576 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages": 352, 2024-09-11T23:34:52.576 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_bytes": 832745, 2024-09-11T23:34:52.576 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_bytes": 223794, 2024-09-11T23:34:52.576 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_created_connections": 10, 2024-09-11T23:34:52.576 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_active_connections": 4, 2024-09-11T23:34:52.576 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_total_time": 0.042876250, 2024-09-11T23:34:52.576 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_send_time": 0.017569129, 2024-09-11T23:34:52.576 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_recv_time": 0.034036949, 2024-09-11T23:34:52.576 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_fast_dispatch_time": 0.000209099, 2024-09-11T23:34:52.577 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T23:34:52.577 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 351, 2024-09-11T23:34:52.577 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.031962296, 2024-09-11T23:34:52.577 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000091060 2024-09-11T23:34:52.577 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:52.577 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_handle_ack_lat": { 2024-09-11T23:34:52.577 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 2, 2024-09-11T23:34:52.577 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000149, 2024-09-11T23:34:52.577 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000074 2024-09-11T23:34:52.577 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:52.577 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_encrypted_bytes": 829168, 2024-09-11T23:34:52.577 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_encrypted_bytes": 193424 2024-09-11T23:34:52.578 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:52.578 INFO:teuthology.orchestra.run.smithi123.stdout: "AsyncMessenger::Worker-2": { 2024-09-11T23:34:52.578 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_messages": 29, 2024-09-11T23:34:52.578 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages": 264, 2024-09-11T23:34:52.578 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_bytes": 7898, 2024-09-11T23:34:52.578 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_bytes": 511506, 2024-09-11T23:34:52.578 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_created_connections": 12, 2024-09-11T23:34:52.578 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_active_connections": 5, 2024-09-11T23:34:52.578 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_total_time": 0.021033073, 2024-09-11T23:34:52.578 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_send_time": 0.011520301, 2024-09-11T23:34:52.578 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_recv_time": 0.006881538, 2024-09-11T23:34:52.578 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_fast_dispatch_time": 0.000158560, 2024-09-11T23:34:52.578 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T23:34:52.578 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 260, 2024-09-11T23:34:52.579 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.018300539, 2024-09-11T23:34:52.579 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000070386 2024-09-11T23:34:52.579 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:52.579 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_handle_ack_lat": { 2024-09-11T23:34:52.579 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 27, 2024-09-11T23:34:52.579 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000016323, 2024-09-11T23:34:52.579 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000604 2024-09-11T23:34:52.579 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:52.579 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_encrypted_bytes": 1088, 2024-09-11T23:34:52.579 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_encrypted_bytes": 475216 2024-09-11T23:34:52.579 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:52.579 INFO:teuthology.orchestra.run.smithi123.stdout: "cct": { 2024-09-11T23:34:52.579 INFO:teuthology.orchestra.run.smithi123.stdout: "total_workers": 1, 2024-09-11T23:34:52.580 INFO:teuthology.orchestra.run.smithi123.stdout: "unhealthy_workers": 0 2024-09-11T23:34:52.580 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:52.580 INFO:teuthology.orchestra.run.smithi123.stdout: "finisher-MDSRank": { 2024-09-11T23:34:52.580 INFO:teuthology.orchestra.run.smithi123.stdout: "queue_len": 0, 2024-09-11T23:34:52.580 INFO:teuthology.orchestra.run.smithi123.stdout: "complete_latency": { 2024-09-11T23:34:52.580 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 53, 2024-09-11T23:34:52.580 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.001470966, 2024-09-11T23:34:52.580 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000027754 2024-09-11T23:34:52.580 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-11T23:34:52.580 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:52.580 INFO:teuthology.orchestra.run.smithi123.stdout: "finisher-PurgeQueue": { 2024-09-11T23:34:52.580 INFO:teuthology.orchestra.run.smithi123.stdout: "queue_len": 0, 2024-09-11T23:34:52.581 INFO:teuthology.orchestra.run.smithi123.stdout: "complete_latency": { 2024-09-11T23:34:52.581 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 2, 2024-09-11T23:34:52.581 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000015185, 2024-09-11T23:34:52.581 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000007592 2024-09-11T23:34:52.581 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-11T23:34:52.581 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:52.581 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": { 2024-09-11T23:34:52.581 INFO:teuthology.orchestra.run.smithi123.stdout: "request": 2, 2024-09-11T23:34:52.581 INFO:teuthology.orchestra.run.smithi123.stdout: "reply": 1, 2024-09-11T23:34:52.581 INFO:teuthology.orchestra.run.smithi123.stdout: "reply_latency": { 2024-09-11T23:34:52.581 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 1, 2024-09-11T23:34:52.581 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000814885, 2024-09-11T23:34:52.582 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000814885 2024-09-11T23:34:52.582 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:52.582 INFO:teuthology.orchestra.run.smithi123.stdout: "slow_reply": 0, 2024-09-11T23:34:52.582 INFO:teuthology.orchestra.run.smithi123.stdout: "forward": 1, 2024-09-11T23:34:52.582 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_fetch_complete": 0, 2024-09-11T23:34:52.582 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_fetch_keys": 0, 2024-09-11T23:34:52.582 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_commit": 11, 2024-09-11T23:34:52.582 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_split": 0, 2024-09-11T23:34:52.582 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_merge": 0, 2024-09-11T23:34:52.582 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes": 14, 2024-09-11T23:34:52.582 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes_top": 0, 2024-09-11T23:34:52.582 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes_bottom": 14, 2024-09-11T23:34:52.582 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes_pin_tail": 0, 2024-09-11T23:34:52.583 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes_pinned": 14, 2024-09-11T23:34:52.583 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes_expired": 0, 2024-09-11T23:34:52.583 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes_with_caps": 1, 2024-09-11T23:34:52.583 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": 1, 2024-09-11T23:34:52.583 INFO:teuthology.orchestra.run.smithi123.stdout: "subtrees": 2, 2024-09-11T23:34:52.583 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse": 3, 2024-09-11T23:34:52.583 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse_hit": 1, 2024-09-11T23:34:52.583 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse_forward": 0, 2024-09-11T23:34:52.583 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse_discover": 1, 2024-09-11T23:34:52.583 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse_dir_fetch": 0, 2024-09-11T23:34:52.583 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse_remote_ino": 0, 2024-09-11T23:34:52.583 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse_lock": 0, 2024-09-11T23:34:52.583 INFO:teuthology.orchestra.run.smithi123.stdout: "load_cent": 0, 2024-09-11T23:34:52.584 INFO:teuthology.orchestra.run.smithi123.stdout: "q": 0, 2024-09-11T23:34:52.584 INFO:teuthology.orchestra.run.smithi123.stdout: "exported": 0, 2024-09-11T23:34:52.584 INFO:teuthology.orchestra.run.smithi123.stdout: "exported_inodes": 0, 2024-09-11T23:34:52.584 INFO:teuthology.orchestra.run.smithi123.stdout: "imported": 0, 2024-09-11T23:34:52.584 INFO:teuthology.orchestra.run.smithi123.stdout: "imported_inodes": 0, 2024-09-11T23:34:52.584 INFO:teuthology.orchestra.run.smithi123.stdout: "openino_dir_fetch": 0, 2024-09-11T23:34:52.584 INFO:teuthology.orchestra.run.smithi123.stdout: "openino_backtrace_fetch": 0, 2024-09-11T23:34:52.584 INFO:teuthology.orchestra.run.smithi123.stdout: "openino_peer_discover": 0, 2024-09-11T23:34:52.584 INFO:teuthology.orchestra.run.smithi123.stdout: "root_rfiles": 1022, 2024-09-11T23:34:52.584 INFO:teuthology.orchestra.run.smithi123.stdout: "root_rbytes": 1586967590, 2024-09-11T23:34:52.584 INFO:teuthology.orchestra.run.smithi123.stdout: "root_rsnaps": 0, 2024-09-11T23:34:52.584 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_backtrace_fetch": 0, 2024-09-11T23:34:52.584 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_set_tag": 0, 2024-09-11T23:34:52.585 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_backtrace_repaired": 0, 2024-09-11T23:34:52.585 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_inotable_repaired": 0, 2024-09-11T23:34:52.585 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_dir_inodes": 0, 2024-09-11T23:34:52.585 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_dir_base_inodes": 0, 2024-09-11T23:34:52.585 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_dirfrag_rstats": 0, 2024-09-11T23:34:52.585 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_file_inodes": 0, 2024-09-11T23:34:52.585 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_inode_file_caps": 0, 2024-09-11T23:34:52.585 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_cap_op_revoke": 1, 2024-09-11T23:34:52.585 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_cap_op_grant": 2, 2024-09-11T23:34:52.585 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_cap_op_trunc": 0, 2024-09-11T23:34:52.585 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-11T23:34:52.585 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-11T23:34:52.585 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_client_caps": 1, 2024-09-11T23:34:52.586 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_client_caps_dirty": 0, 2024-09-11T23:34:52.586 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_client_cap_release": 0, 2024-09-11T23:34:52.586 INFO:teuthology.orchestra.run.smithi123.stdout: "process_request_cap_release": 1 2024-09-11T23:34:52.586 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:52.586 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_cache": { 2024-09-11T23:34:52.586 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_update": 0, 2024-09-11T23:34:52.586 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_update_receipt": 0, 2024-09-11T23:34:52.586 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_try_discover": 0, 2024-09-11T23:34:52.586 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_send_discover": 2, 2024-09-11T23:34:52.586 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_handle_discover": 0, 2024-09-11T23:34:52.586 INFO:teuthology.orchestra.run.smithi123.stdout: "num_strays": 0, 2024-09-11T23:34:52.586 INFO:teuthology.orchestra.run.smithi123.stdout: "num_strays_delayed": 0, 2024-09-11T23:34:52.587 INFO:teuthology.orchestra.run.smithi123.stdout: "num_strays_enqueuing": 0, 2024-09-11T23:34:52.587 INFO:teuthology.orchestra.run.smithi123.stdout: "strays_created": 0, 2024-09-11T23:34:52.587 INFO:teuthology.orchestra.run.smithi123.stdout: "strays_enqueued": 0, 2024-09-11T23:34:52.587 INFO:teuthology.orchestra.run.smithi123.stdout: "strays_reintegrated": 0, 2024-09-11T23:34:52.587 INFO:teuthology.orchestra.run.smithi123.stdout: "strays_migrated": 0, 2024-09-11T23:34:52.587 INFO:teuthology.orchestra.run.smithi123.stdout: "num_recovering_processing": 0, 2024-09-11T23:34:52.587 INFO:teuthology.orchestra.run.smithi123.stdout: "num_recovering_enqueued": 0, 2024-09-11T23:34:52.587 INFO:teuthology.orchestra.run.smithi123.stdout: "num_recovering_prioritized": 0, 2024-09-11T23:34:52.587 INFO:teuthology.orchestra.run.smithi123.stdout: "recovery_started": 0, 2024-09-11T23:34:52.587 INFO:teuthology.orchestra.run.smithi123.stdout: "recovery_completed": 0, 2024-09-11T23:34:52.587 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_quiesce_path": 0, 2024-09-11T23:34:52.587 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_quiesce_inode": 0, 2024-09-11T23:34:52.588 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_enqueue_scrub": 0, 2024-09-11T23:34:52.588 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_exportdir": 0, 2024-09-11T23:34:52.588 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_flush": 0, 2024-09-11T23:34:52.588 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_fragmentdir": 0, 2024-09-11T23:34:52.588 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_fragstats": 0, 2024-09-11T23:34:52.588 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_inodestats": 0 2024-09-11T23:34:52.588 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:52.588 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_log": { 2024-09-11T23:34:52.588 INFO:teuthology.orchestra.run.smithi123.stdout: "evlrg": 0, 2024-09-11T23:34:52.588 INFO:teuthology.orchestra.run.smithi123.stdout: "evadd": 5, 2024-09-11T23:34:52.588 INFO:teuthology.orchestra.run.smithi123.stdout: "evex": 0, 2024-09-11T23:34:52.588 INFO:teuthology.orchestra.run.smithi123.stdout: "evtrm": 0, 2024-09-11T23:34:52.588 INFO:teuthology.orchestra.run.smithi123.stdout: "ev": 5, 2024-09-11T23:34:52.589 INFO:teuthology.orchestra.run.smithi123.stdout: "evexg": 0, 2024-09-11T23:34:52.589 INFO:teuthology.orchestra.run.smithi123.stdout: "evexd": 0, 2024-09-11T23:34:52.589 INFO:teuthology.orchestra.run.smithi123.stdout: "segadd": 2, 2024-09-11T23:34:52.589 INFO:teuthology.orchestra.run.smithi123.stdout: "segex": 0, 2024-09-11T23:34:52.589 INFO:teuthology.orchestra.run.smithi123.stdout: "segtrm": 0, 2024-09-11T23:34:52.589 INFO:teuthology.orchestra.run.smithi123.stdout: "seg": 2, 2024-09-11T23:34:52.589 INFO:teuthology.orchestra.run.smithi123.stdout: "segmjr": 2, 2024-09-11T23:34:52.589 INFO:teuthology.orchestra.run.smithi123.stdout: "segexg": 0, 2024-09-11T23:34:52.589 INFO:teuthology.orchestra.run.smithi123.stdout: "segexd": 0, 2024-09-11T23:34:52.589 INFO:teuthology.orchestra.run.smithi123.stdout: "expos": 4194304, 2024-09-11T23:34:52.589 INFO:teuthology.orchestra.run.smithi123.stdout: "wrpos": 4195737, 2024-09-11T23:34:52.589 INFO:teuthology.orchestra.run.smithi123.stdout: "rdpos": 0, 2024-09-11T23:34:52.589 INFO:teuthology.orchestra.run.smithi123.stdout: "jlat": { 2024-09-11T23:34:52.590 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 4, 2024-09-11T23:34:52.590 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.007459889, 2024-09-11T23:34:52.590 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.001864972 2024-09-11T23:34:52.590 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:52.590 INFO:teuthology.orchestra.run.smithi123.stdout: "replayed": 0 2024-09-11T23:34:52.590 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:52.590 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_mem": { 2024-09-11T23:34:52.590 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 17, 2024-09-11T23:34:52.590 INFO:teuthology.orchestra.run.smithi123.stdout: "ino+": 17, 2024-09-11T23:34:52.590 INFO:teuthology.orchestra.run.smithi123.stdout: "ino-": 0, 2024-09-11T23:34:52.590 INFO:teuthology.orchestra.run.smithi123.stdout: "dir": 15, 2024-09-11T23:34:52.590 INFO:teuthology.orchestra.run.smithi123.stdout: "dir+": 16, 2024-09-11T23:34:52.590 INFO:teuthology.orchestra.run.smithi123.stdout: "dir-": 1, 2024-09-11T23:34:52.590 INFO:teuthology.orchestra.run.smithi123.stdout: "dn": 14, 2024-09-11T23:34:52.591 INFO:teuthology.orchestra.run.smithi123.stdout: "dn+": 14, 2024-09-11T23:34:52.591 INFO:teuthology.orchestra.run.smithi123.stdout: "dn-": 0, 2024-09-11T23:34:52.591 INFO:teuthology.orchestra.run.smithi123.stdout: "cap": 1, 2024-09-11T23:34:52.591 INFO:teuthology.orchestra.run.smithi123.stdout: "cap+": 1, 2024-09-11T23:34:52.591 INFO:teuthology.orchestra.run.smithi123.stdout: "cap-": 0, 2024-09-11T23:34:52.591 INFO:teuthology.orchestra.run.smithi123.stdout: "rss": 49420, 2024-09-11T23:34:52.591 INFO:teuthology.orchestra.run.smithi123.stdout: "heap": 223520 2024-09-11T23:34:52.591 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:52.591 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_server": { 2024-09-11T23:34:52.591 INFO:teuthology.orchestra.run.smithi123.stdout: "dispatch_client_request": 3, 2024-09-11T23:34:52.591 INFO:teuthology.orchestra.run.smithi123.stdout: "dispatch_server_request": 0, 2024-09-11T23:34:52.591 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_client_request": 2, 2024-09-11T23:34:52.591 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_client_session": 17, 2024-09-11T23:34:52.592 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_peer_request": 0, 2024-09-11T23:34:52.592 INFO:teuthology.orchestra.run.smithi123.stdout: "req_create_latency": { 2024-09-11T23:34:52.592 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:52.592 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:52.592 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:52.592 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:52.592 INFO:teuthology.orchestra.run.smithi123.stdout: "req_getattr_latency": { 2024-09-11T23:34:52.592 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 1, 2024-09-11T23:34:52.592 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000814885, 2024-09-11T23:34:52.592 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000814885 2024-09-11T23:34:52.592 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:52.592 INFO:teuthology.orchestra.run.smithi123.stdout: "req_getfilelock_latency": { 2024-09-11T23:34:52.593 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:52.593 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:52.593 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:52.593 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:52.593 INFO:teuthology.orchestra.run.smithi123.stdout: "req_link_latency": { 2024-09-11T23:34:52.593 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:52.593 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:52.593 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:52.593 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:52.593 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lookup_latency": { 2024-09-11T23:34:52.593 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:52.593 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:52.593 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:52.593 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:52.594 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lookuphash_latency": { 2024-09-11T23:34:52.594 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:52.594 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:52.594 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:52.594 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:52.594 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lookupino_latency": { 2024-09-11T23:34:52.594 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:52.594 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:52.594 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:52.594 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:52.594 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lookupname_latency": { 2024-09-11T23:34:52.594 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:52.594 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:52.594 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:52.595 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:52.595 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lookupparent_latency": { 2024-09-11T23:34:52.595 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:52.595 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:52.595 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:52.595 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:52.595 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lookupsnap_latency": { 2024-09-11T23:34:52.595 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:52.595 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:52.595 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:52.595 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:52.595 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lssnap_latency": { 2024-09-11T23:34:52.595 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:52.596 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:52.596 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:52.596 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:52.596 INFO:teuthology.orchestra.run.smithi123.stdout: "req_mkdir_latency": { 2024-09-11T23:34:52.596 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:52.596 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:52.596 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:52.596 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:52.596 INFO:teuthology.orchestra.run.smithi123.stdout: "req_mknod_latency": { 2024-09-11T23:34:52.596 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:52.596 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:52.597 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:52.597 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:52.597 INFO:teuthology.orchestra.run.smithi123.stdout: "req_mksnap_latency": { 2024-09-11T23:34:52.597 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:52.597 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:52.597 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:52.597 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:52.597 INFO:teuthology.orchestra.run.smithi123.stdout: "req_open_latency": { 2024-09-11T23:34:52.597 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:52.597 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:52.597 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:52.597 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:52.597 INFO:teuthology.orchestra.run.smithi123.stdout: "req_readdir_latency": { 2024-09-11T23:34:52.597 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:52.598 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:52.598 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:52.598 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:52.598 INFO:teuthology.orchestra.run.smithi123.stdout: "req_rename_latency": { 2024-09-11T23:34:52.598 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:52.598 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:52.598 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:52.598 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:52.598 INFO:teuthology.orchestra.run.smithi123.stdout: "req_renamesnap_latency": { 2024-09-11T23:34:52.598 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:52.598 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:52.598 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:52.598 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:52.599 INFO:teuthology.orchestra.run.smithi123.stdout: "req_snapdiff_latency": { 2024-09-11T23:34:52.599 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:52.599 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:52.599 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:52.599 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:52.599 INFO:teuthology.orchestra.run.smithi123.stdout: "req_rmdir_latency": { 2024-09-11T23:34:52.599 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:52.599 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:52.599 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:52.599 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:52.599 INFO:teuthology.orchestra.run.smithi123.stdout: "req_rmsnap_latency": { 2024-09-11T23:34:52.599 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:52.599 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:52.600 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:52.600 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:52.600 INFO:teuthology.orchestra.run.smithi123.stdout: "req_rmxattr_latency": { 2024-09-11T23:34:52.600 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:52.600 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:52.600 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:52.600 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:52.600 INFO:teuthology.orchestra.run.smithi123.stdout: "req_setattr_latency": { 2024-09-11T23:34:52.600 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:52.600 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:52.600 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:52.600 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:52.601 INFO:teuthology.orchestra.run.smithi123.stdout: "req_setdirlayout_latency": { 2024-09-11T23:34:52.601 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:52.601 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:52.601 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:52.601 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:52.601 INFO:teuthology.orchestra.run.smithi123.stdout: "req_setfilelock_latency": { 2024-09-11T23:34:52.601 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:52.601 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:52.601 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:52.601 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:52.601 INFO:teuthology.orchestra.run.smithi123.stdout: "req_setlayout_latency": { 2024-09-11T23:34:52.601 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:52.602 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:52.602 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:52.602 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:52.602 INFO:teuthology.orchestra.run.smithi123.stdout: "req_setxattr_latency": { 2024-09-11T23:34:52.602 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:52.602 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:52.602 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:52.602 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:52.602 INFO:teuthology.orchestra.run.smithi123.stdout: "req_symlink_latency": { 2024-09-11T23:34:52.602 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:52.602 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:52.602 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:52.602 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:52.603 INFO:teuthology.orchestra.run.smithi123.stdout: "req_unlink_latency": { 2024-09-11T23:34:52.603 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:52.603 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:52.603 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:52.603 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:52.603 INFO:teuthology.orchestra.run.smithi123.stdout: "cap_revoke_eviction": 0, 2024-09-11T23:34:52.603 INFO:teuthology.orchestra.run.smithi123.stdout: "cap_acquisition_throttle": 0, 2024-09-11T23:34:52.603 INFO:teuthology.orchestra.run.smithi123.stdout: "req_getvxattr_latency": { 2024-09-11T23:34:52.603 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:52.603 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:52.603 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:52.603 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-11T23:34:52.604 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:52.604 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_sessions": { 2024-09-11T23:34:52.604 INFO:teuthology.orchestra.run.smithi123.stdout: "session_count": 1, 2024-09-11T23:34:52.604 INFO:teuthology.orchestra.run.smithi123.stdout: "session_add": 2, 2024-09-11T23:34:52.604 INFO:teuthology.orchestra.run.smithi123.stdout: "session_remove": 1, 2024-09-11T23:34:52.604 INFO:teuthology.orchestra.run.smithi123.stdout: "sessions_open": 1, 2024-09-11T23:34:52.604 INFO:teuthology.orchestra.run.smithi123.stdout: "sessions_stale": 0, 2024-09-11T23:34:52.604 INFO:teuthology.orchestra.run.smithi123.stdout: "total_load": 1, 2024-09-11T23:34:52.604 INFO:teuthology.orchestra.run.smithi123.stdout: "average_load": 1, 2024-09-11T23:34:52.604 INFO:teuthology.orchestra.run.smithi123.stdout: "avg_session_uptime": 951, 2024-09-11T23:34:52.604 INFO:teuthology.orchestra.run.smithi123.stdout: "mdthresh_evicted": 0 2024-09-11T23:34:52.604 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:52.604 INFO:teuthology.orchestra.run.smithi123.stdout: "mempool": { 2024-09-11T23:34:52.605 INFO:teuthology.orchestra.run.smithi123.stdout: "bloom_filter_bytes": 0, 2024-09-11T23:34:52.605 INFO:teuthology.orchestra.run.smithi123.stdout: "bloom_filter_items": 0, 2024-09-11T23:34:52.605 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_alloc_bytes": 0, 2024-09-11T23:34:52.605 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_alloc_items": 0, 2024-09-11T23:34:52.605 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_data_bytes": 0, 2024-09-11T23:34:52.605 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_data_items": 0, 2024-09-11T23:34:52.605 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-11T23:34:52.605 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_onode_items": 0, 2024-09-11T23:34:52.605 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-11T23:34:52.605 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_meta_items": 0, 2024-09-11T23:34:52.605 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_other_bytes": 0, 2024-09-11T23:34:52.605 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_other_items": 0, 2024-09-11T23:34:52.608 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-11T23:34:52.608 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_buffer_items": 0, 2024-09-11T23:34:52.608 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_extent_bytes": 0, 2024-09-11T23:34:52.608 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_extent_items": 0, 2024-09-11T23:34:52.608 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_blob_bytes": 0, 2024-09-11T23:34:52.608 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_blob_items": 0, 2024-09-11T23:34:52.608 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-11T23:34:52.608 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_shared_blob_items": 0, 2024-09-11T23:34:52.608 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-11T23:34:52.609 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_inline_bl_items": 0, 2024-09-11T23:34:52.609 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_fsck_bytes": 0, 2024-09-11T23:34:52.609 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_fsck_items": 0, 2024-09-11T23:34:52.609 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_txc_bytes": 0, 2024-09-11T23:34:52.609 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_txc_items": 0, 2024-09-11T23:34:52.609 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-11T23:34:52.609 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_writing_deferred_items": 0, 2024-09-11T23:34:52.609 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_writing_bytes": 0, 2024-09-11T23:34:52.609 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_writing_items": 0, 2024-09-11T23:34:52.609 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_bytes": 0, 2024-09-11T23:34:52.609 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_items": 0, 2024-09-11T23:34:52.609 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_file_reader_bytes": 0, 2024-09-11T23:34:52.609 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_file_reader_items": 0, 2024-09-11T23:34:52.610 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_file_writer_bytes": 0, 2024-09-11T23:34:52.610 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_file_writer_items": 0, 2024-09-11T23:34:52.610 INFO:teuthology.orchestra.run.smithi123.stdout: "buffer_anon_bytes": 239173, 2024-09-11T23:34:52.610 INFO:teuthology.orchestra.run.smithi123.stdout: "buffer_anon_items": 74, 2024-09-11T23:34:52.610 INFO:teuthology.orchestra.run.smithi123.stdout: "buffer_meta_bytes": 0, 2024-09-11T23:34:52.610 INFO:teuthology.orchestra.run.smithi123.stdout: "buffer_meta_items": 0, 2024-09-11T23:34:52.610 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_bytes": 0, 2024-09-11T23:34:52.610 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_items": 0, 2024-09-11T23:34:52.610 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_mapbl_bytes": 0, 2024-09-11T23:34:52.610 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_mapbl_items": 0, 2024-09-11T23:34:52.610 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_pglog_bytes": 0, 2024-09-11T23:34:52.610 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_pglog_items": 0, 2024-09-11T23:34:52.610 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_bytes": 9336, 2024-09-11T23:34:52.611 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_items": 176, 2024-09-11T23:34:52.611 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_mapping_bytes": 0, 2024-09-11T23:34:52.611 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_mapping_items": 0, 2024-09-11T23:34:52.611 INFO:teuthology.orchestra.run.smithi123.stdout: "pgmap_bytes": 0, 2024-09-11T23:34:52.611 INFO:teuthology.orchestra.run.smithi123.stdout: "pgmap_items": 0, 2024-09-11T23:34:52.611 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_co_bytes": 68037, 2024-09-11T23:34:52.611 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_co_items": 288, 2024-09-11T23:34:52.611 INFO:teuthology.orchestra.run.smithi123.stdout: "unittest_1_bytes": 0, 2024-09-11T23:34:52.611 INFO:teuthology.orchestra.run.smithi123.stdout: "unittest_1_items": 0, 2024-09-11T23:34:52.611 INFO:teuthology.orchestra.run.smithi123.stdout: "unittest_2_bytes": 0, 2024-09-11T23:34:52.611 INFO:teuthology.orchestra.run.smithi123.stdout: "unittest_2_items": 0 2024-09-11T23:34:52.611 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:52.611 INFO:teuthology.orchestra.run.smithi123.stdout: "objecter": { 2024-09-11T23:34:52.612 INFO:teuthology.orchestra.run.smithi123.stdout: "op_active": 0, 2024-09-11T23:34:52.612 INFO:teuthology.orchestra.run.smithi123.stdout: "op_laggy": 0, 2024-09-11T23:34:52.612 INFO:teuthology.orchestra.run.smithi123.stdout: "op_send": 42, 2024-09-11T23:34:52.612 INFO:teuthology.orchestra.run.smithi123.stdout: "op_send_bytes": 12140, 2024-09-11T23:34:52.612 INFO:teuthology.orchestra.run.smithi123.stdout: "op_resend": 29, 2024-09-11T23:34:52.612 INFO:teuthology.orchestra.run.smithi123.stdout: "op_reply": 42, 2024-09-11T23:34:52.612 INFO:teuthology.orchestra.run.smithi123.stdout: "op_latency": { 2024-09-11T23:34:52.612 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 42, 2024-09-11T23:34:52.612 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.228994882, 2024-09-11T23:34:52.612 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.005452259 2024-09-11T23:34:52.612 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:52.612 INFO:teuthology.orchestra.run.smithi123.stdout: "op_inflight": 0, 2024-09-11T23:34:52.612 INFO:teuthology.orchestra.run.smithi123.stdout: "oplen_avg": { 2024-09-11T23:34:52.612 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 42, 2024-09-11T23:34:52.612 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 66 2024-09-11T23:34:52.613 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:52.613 INFO:teuthology.orchestra.run.smithi123.stdout: "op": 42, 2024-09-11T23:34:52.613 INFO:teuthology.orchestra.run.smithi123.stdout: "op_r": 0, 2024-09-11T23:34:52.613 INFO:teuthology.orchestra.run.smithi123.stdout: "op_w": 42, 2024-09-11T23:34:52.613 INFO:teuthology.orchestra.run.smithi123.stdout: "op_rmw": 0, 2024-09-11T23:34:52.613 INFO:teuthology.orchestra.run.smithi123.stdout: "op_pg": 0, 2024-09-11T23:34:52.613 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_stat": 0, 2024-09-11T23:34:52.613 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_create": 10, 2024-09-11T23:34:52.613 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_read": 0, 2024-09-11T23:34:52.613 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_write": 4, 2024-09-11T23:34:52.613 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_writefull": 7, 2024-09-11T23:34:52.613 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_writesame": 0, 2024-09-11T23:34:52.613 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_append": 0, 2024-09-11T23:34:52.614 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_zero": 0, 2024-09-11T23:34:52.614 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_truncate": 0, 2024-09-11T23:34:52.614 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_delete": 6, 2024-09-11T23:34:52.614 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_mapext": 0, 2024-09-11T23:34:52.614 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_sparse_read": 0, 2024-09-11T23:34:52.614 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_clonerange": 0, 2024-09-11T23:34:52.614 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_getxattr": 0, 2024-09-11T23:34:52.614 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_setxattr": 20, 2024-09-11T23:34:52.614 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_cmpxattr": 0, 2024-09-11T23:34:52.614 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_rmxattr": 0, 2024-09-11T23:34:52.614 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_resetxattrs": 0, 2024-09-11T23:34:52.614 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_call": 0, 2024-09-11T23:34:52.614 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_watch": 0, 2024-09-11T23:34:52.615 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_notify": 0, 2024-09-11T23:34:52.615 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_src_cmpxattr": 0, 2024-09-11T23:34:52.615 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_pgls": 0, 2024-09-11T23:34:52.615 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_pgls_filter": 0, 2024-09-11T23:34:52.615 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_other": 0, 2024-09-11T23:34:52.615 INFO:teuthology.orchestra.run.smithi123.stdout: "linger_active": 0, 2024-09-11T23:34:52.615 INFO:teuthology.orchestra.run.smithi123.stdout: "linger_send": 0, 2024-09-11T23:34:52.615 INFO:teuthology.orchestra.run.smithi123.stdout: "linger_resend": 0, 2024-09-11T23:34:52.615 INFO:teuthology.orchestra.run.smithi123.stdout: "linger_ping": 0, 2024-09-11T23:34:52.615 INFO:teuthology.orchestra.run.smithi123.stdout: "poolop_active": 0, 2024-09-11T23:34:52.615 INFO:teuthology.orchestra.run.smithi123.stdout: "poolop_send": 0, 2024-09-11T23:34:52.615 INFO:teuthology.orchestra.run.smithi123.stdout: "poolop_resend": 0, 2024-09-11T23:34:52.616 INFO:teuthology.orchestra.run.smithi123.stdout: "poolstat_active": 0, 2024-09-11T23:34:52.616 INFO:teuthology.orchestra.run.smithi123.stdout: "poolstat_send": 0, 2024-09-11T23:34:52.616 INFO:teuthology.orchestra.run.smithi123.stdout: "poolstat_resend": 0, 2024-09-11T23:34:52.616 INFO:teuthology.orchestra.run.smithi123.stdout: "statfs_active": 0, 2024-09-11T23:34:52.616 INFO:teuthology.orchestra.run.smithi123.stdout: "statfs_send": 0, 2024-09-11T23:34:52.616 INFO:teuthology.orchestra.run.smithi123.stdout: "statfs_resend": 0, 2024-09-11T23:34:52.616 INFO:teuthology.orchestra.run.smithi123.stdout: "command_active": 0, 2024-09-11T23:34:52.616 INFO:teuthology.orchestra.run.smithi123.stdout: "command_send": 0, 2024-09-11T23:34:52.616 INFO:teuthology.orchestra.run.smithi123.stdout: "command_resend": 0, 2024-09-11T23:34:52.616 INFO:teuthology.orchestra.run.smithi123.stdout: "map_epoch": 95, 2024-09-11T23:34:52.616 INFO:teuthology.orchestra.run.smithi123.stdout: "map_full": 0, 2024-09-11T23:34:52.616 INFO:teuthology.orchestra.run.smithi123.stdout: "map_inc": 2, 2024-09-11T23:34:52.616 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_sessions": 8, 2024-09-11T23:34:52.616 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_session_open": 14, 2024-09-11T23:34:52.617 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_session_close": 6, 2024-09-11T23:34:52.617 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_laggy": 0, 2024-09-11T23:34:52.617 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_wr": 18, 2024-09-11T23:34:52.617 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_rd": 0, 2024-09-11T23:34:52.617 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_del": 1 2024-09-11T23:34:52.617 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:52.617 INFO:teuthology.orchestra.run.smithi123.stdout: "oft": { 2024-09-11T23:34:52.617 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_total_objs": 1, 2024-09-11T23:34:52.617 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_total_kv_pairs": 0, 2024-09-11T23:34:52.617 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_total_updates": 0, 2024-09-11T23:34:52.617 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_total_removes": 0 2024-09-11T23:34:52.617 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:52.617 INFO:teuthology.orchestra.run.smithi123.stdout: "osd-slow-ops": { 2024-09-11T23:34:52.618 INFO:teuthology.orchestra.run.smithi123.stdout: "slow_ops_count": 0 2024-09-11T23:34:52.618 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:52.618 INFO:teuthology.orchestra.run.smithi123.stdout: "purge_queue": { 2024-09-11T23:34:52.618 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_executing_ops": 0, 2024-09-11T23:34:52.618 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_executing_ops_high_water": 0, 2024-09-11T23:34:52.618 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_executing": 0, 2024-09-11T23:34:52.618 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_executing_high_water": 0, 2024-09-11T23:34:52.618 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_executed_ops": 0, 2024-09-11T23:34:52.618 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_executed": 0, 2024-09-11T23:34:52.618 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_item_in_journal": 0 2024-09-11T23:34:52.618 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:52.618 INFO:teuthology.orchestra.run.smithi123.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-11T23:34:52.619 INFO:teuthology.orchestra.run.smithi123.stdout: "val": 0, 2024-09-11T23:34:52.619 INFO:teuthology.orchestra.run.smithi123.stdout: "max": 104857600, 2024-09-11T23:34:52.619 INFO:teuthology.orchestra.run.smithi123.stdout: "get_started": 0, 2024-09-11T23:34:52.619 INFO:teuthology.orchestra.run.smithi123.stdout: "get": 1114, 2024-09-11T23:34:52.619 INFO:teuthology.orchestra.run.smithi123.stdout: "get_sum": 892354, 2024-09-11T23:34:52.619 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_fail": 0, 2024-09-11T23:34:52.619 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_success": 1114, 2024-09-11T23:34:52.619 INFO:teuthology.orchestra.run.smithi123.stdout: "take": 0, 2024-09-11T23:34:52.619 INFO:teuthology.orchestra.run.smithi123.stdout: "take_sum": 0, 2024-09-11T23:34:52.619 INFO:teuthology.orchestra.run.smithi123.stdout: "put": 1114, 2024-09-11T23:34:52.619 INFO:teuthology.orchestra.run.smithi123.stdout: "put_sum": 892354, 2024-09-11T23:34:52.619 INFO:teuthology.orchestra.run.smithi123.stdout: "wait": { 2024-09-11T23:34:52.619 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:52.620 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:52.620 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:52.620 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-11T23:34:52.620 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:52.620 INFO:teuthology.orchestra.run.smithi123.stdout: "throttle-objecter_bytes": { 2024-09-11T23:34:52.620 INFO:teuthology.orchestra.run.smithi123.stdout: "val": 0, 2024-09-11T23:34:52.620 INFO:teuthology.orchestra.run.smithi123.stdout: "max": 104857600, 2024-09-11T23:34:52.620 INFO:teuthology.orchestra.run.smithi123.stdout: "get_started": 0, 2024-09-11T23:34:52.620 INFO:teuthology.orchestra.run.smithi123.stdout: "get": 0, 2024-09-11T23:34:52.620 INFO:teuthology.orchestra.run.smithi123.stdout: "get_sum": 0, 2024-09-11T23:34:52.620 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_fail": 0, 2024-09-11T23:34:52.620 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_success": 0, 2024-09-11T23:34:52.620 INFO:teuthology.orchestra.run.smithi123.stdout: "take": 42, 2024-09-11T23:34:52.620 INFO:teuthology.orchestra.run.smithi123.stdout: "take_sum": 12140, 2024-09-11T23:34:52.621 INFO:teuthology.orchestra.run.smithi123.stdout: "put": 42, 2024-09-11T23:34:52.621 INFO:teuthology.orchestra.run.smithi123.stdout: "put_sum": 12140, 2024-09-11T23:34:52.621 INFO:teuthology.orchestra.run.smithi123.stdout: "wait": { 2024-09-11T23:34:52.621 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:52.621 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:52.621 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:52.621 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-11T23:34:52.621 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:52.621 INFO:teuthology.orchestra.run.smithi123.stdout: "throttle-objecter_ops": { 2024-09-11T23:34:52.621 INFO:teuthology.orchestra.run.smithi123.stdout: "val": 0, 2024-09-11T23:34:52.621 INFO:teuthology.orchestra.run.smithi123.stdout: "max": 1024, 2024-09-11T23:34:52.621 INFO:teuthology.orchestra.run.smithi123.stdout: "get_started": 0, 2024-09-11T23:34:52.622 INFO:teuthology.orchestra.run.smithi123.stdout: "get": 0, 2024-09-11T23:34:52.622 INFO:teuthology.orchestra.run.smithi123.stdout: "get_sum": 0, 2024-09-11T23:34:52.622 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_fail": 0, 2024-09-11T23:34:52.622 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_success": 0, 2024-09-11T23:34:52.622 INFO:teuthology.orchestra.run.smithi123.stdout: "take": 42, 2024-09-11T23:34:52.622 INFO:teuthology.orchestra.run.smithi123.stdout: "take_sum": 42, 2024-09-11T23:34:52.622 INFO:teuthology.orchestra.run.smithi123.stdout: "put": 42, 2024-09-11T23:34:52.622 INFO:teuthology.orchestra.run.smithi123.stdout: "put_sum": 42, 2024-09-11T23:34:52.622 INFO:teuthology.orchestra.run.smithi123.stdout: "wait": { 2024-09-11T23:34:52.622 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:52.622 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:52.622 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:52.622 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-11T23:34:52.622 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:52.623 INFO:teuthology.orchestra.run.smithi123.stdout: "throttle-write_buf_throttle": { 2024-09-11T23:34:52.623 INFO:teuthology.orchestra.run.smithi123.stdout: "val": 0, 2024-09-11T23:34:52.623 INFO:teuthology.orchestra.run.smithi123.stdout: "max": 3758096384, 2024-09-11T23:34:52.623 INFO:teuthology.orchestra.run.smithi123.stdout: "get_started": 0, 2024-09-11T23:34:52.623 INFO:teuthology.orchestra.run.smithi123.stdout: "get": 0, 2024-09-11T23:34:52.623 INFO:teuthology.orchestra.run.smithi123.stdout: "get_sum": 0, 2024-09-11T23:34:52.623 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_fail": 0, 2024-09-11T23:34:52.623 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_success": 0, 2024-09-11T23:34:52.623 INFO:teuthology.orchestra.run.smithi123.stdout: "take": 0, 2024-09-11T23:34:52.623 INFO:teuthology.orchestra.run.smithi123.stdout: "take_sum": 0, 2024-09-11T23:34:52.623 INFO:teuthology.orchestra.run.smithi123.stdout: "put": 0, 2024-09-11T23:34:52.623 INFO:teuthology.orchestra.run.smithi123.stdout: "put_sum": 0, 2024-09-11T23:34:52.624 INFO:teuthology.orchestra.run.smithi123.stdout: "wait": { 2024-09-11T23:34:52.624 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:52.624 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:52.624 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:52.624 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-11T23:34:52.624 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:52.624 INFO:teuthology.orchestra.run.smithi123.stdout: "throttle-write_buf_throttle-0x55ab984a6960": { 2024-09-11T23:34:52.624 INFO:teuthology.orchestra.run.smithi123.stdout: "val": 0, 2024-09-11T23:34:52.624 INFO:teuthology.orchestra.run.smithi123.stdout: "max": 3758096384, 2024-09-11T23:34:52.624 INFO:teuthology.orchestra.run.smithi123.stdout: "get_started": 0, 2024-09-11T23:34:52.624 INFO:teuthology.orchestra.run.smithi123.stdout: "get": 5, 2024-09-11T23:34:52.624 INFO:teuthology.orchestra.run.smithi123.stdout: "get_sum": 1433, 2024-09-11T23:34:52.624 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_fail": 0, 2024-09-11T23:34:52.625 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_success": 5, 2024-09-11T23:34:52.625 INFO:teuthology.orchestra.run.smithi123.stdout: "take": 0, 2024-09-11T23:34:52.625 INFO:teuthology.orchestra.run.smithi123.stdout: "take_sum": 0, 2024-09-11T23:34:52.625 INFO:teuthology.orchestra.run.smithi123.stdout: "put": 4, 2024-09-11T23:34:52.625 INFO:teuthology.orchestra.run.smithi123.stdout: "put_sum": 1433, 2024-09-11T23:34:52.625 INFO:teuthology.orchestra.run.smithi123.stdout: "wait": { 2024-09-11T23:34:52.625 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:52.625 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:52.625 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:52.625 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-11T23:34:52.625 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-11T23:34:52.625 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-11T23:34:53.353 INFO:tasks.check_counter:Daemon mds.h mds.exported=0 2024-09-11T23:34:53.354 INFO:tasks.check_counter:Daemon mds.h mds.imported=0 2024-09-11T23:34:53.354 DEBUG:tasks.check_counter:Getting stats from k 2024-09-11T23:34:53.354 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph daemon mds.k perf dump 2024-09-11T23:34:53.604 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T23:34:54.000 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:34:53 smithi123 ceph-mon[35438]: pgmap v865: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.7 KiB/s wr, 13 op/s 2024-09-11T23:34:54.116 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:34:53 smithi037 ceph-mon[30630]: pgmap v865: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.7 KiB/s wr, 13 op/s 2024-09-11T23:34:54.156 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-11T23:34:54.156 INFO:teuthology.orchestra.run.smithi123.stdout: "AsyncMessenger::Worker-0": { 2024-09-11T23:34:54.156 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_messages": 329, 2024-09-11T23:34:54.156 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages": 320, 2024-09-11T23:34:54.156 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_bytes": 816130, 2024-09-11T23:34:54.156 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_bytes": 193236, 2024-09-11T23:34:54.156 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_created_connections": 6, 2024-09-11T23:34:54.156 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_active_connections": 1, 2024-09-11T23:34:54.156 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_total_time": 0.104737753, 2024-09-11T23:34:54.157 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_send_time": 0.017793276, 2024-09-11T23:34:54.157 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_recv_time": 0.094163173, 2024-09-11T23:34:54.157 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_fast_dispatch_time": 0.000018446, 2024-09-11T23:34:54.157 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T23:34:54.157 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 320, 2024-09-11T23:34:54.157 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.152045449, 2024-09-11T23:34:54.157 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000475142 2024-09-11T23:34:54.157 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:54.157 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_handle_ack_lat": { 2024-09-11T23:34:54.157 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:54.157 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:54.157 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:54.158 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:54.158 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_encrypted_bytes": 815296, 2024-09-11T23:34:54.158 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_encrypted_bytes": 192912 2024-09-11T23:34:54.158 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:54.158 INFO:teuthology.orchestra.run.smithi123.stdout: "AsyncMessenger::Worker-1": { 2024-09-11T23:34:54.158 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_messages": 981, 2024-09-11T23:34:54.158 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages": 1216, 2024-09-11T23:34:54.158 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_bytes": 241262, 2024-09-11T23:34:54.158 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_bytes": 786829, 2024-09-11T23:34:54.158 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_created_connections": 5, 2024-09-11T23:34:54.158 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_active_connections": 4, 2024-09-11T23:34:54.158 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_total_time": 0.092627527, 2024-09-11T23:34:54.158 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_send_time": 0.029209306, 2024-09-11T23:34:54.159 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_recv_time": 0.020206340, 2024-09-11T23:34:54.159 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_fast_dispatch_time": 0.033362473, 2024-09-11T23:34:54.159 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T23:34:54.159 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 1214, 2024-09-11T23:34:54.159 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.067077029, 2024-09-11T23:34:54.159 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000055252 2024-09-11T23:34:54.159 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:54.159 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_handle_ack_lat": { 2024-09-11T23:34:54.159 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:54.159 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:54.159 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:54.159 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:54.159 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-11T23:34:54.160 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_encrypted_bytes": 475184 2024-09-11T23:34:54.160 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:54.160 INFO:teuthology.orchestra.run.smithi123.stdout: "AsyncMessenger::Worker-2": { 2024-09-11T23:34:54.160 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_messages": 2122, 2024-09-11T23:34:54.160 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages": 2124, 2024-09-11T23:34:54.160 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_bytes": 636120, 2024-09-11T23:34:54.160 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_bytes": 674854, 2024-09-11T23:34:54.160 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_created_connections": 4, 2024-09-11T23:34:54.160 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_active_connections": 3, 2024-09-11T23:34:54.160 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_total_time": 0.176590768, 2024-09-11T23:34:54.160 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_send_time": 0.056943398, 2024-09-11T23:34:54.160 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_recv_time": 0.046540009, 2024-09-11T23:34:54.161 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_fast_dispatch_time": 0.058763413, 2024-09-11T23:34:54.161 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T23:34:54.161 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 2122, 2024-09-11T23:34:54.161 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.107348485, 2024-09-11T23:34:54.161 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000050588 2024-09-11T23:34:54.161 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:54.161 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_handle_ack_lat": { 2024-09-11T23:34:54.161 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:54.161 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:54.161 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:54.161 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:54.161 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-11T23:34:54.161 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_encrypted_bytes": 0 2024-09-11T23:34:54.162 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:54.162 INFO:teuthology.orchestra.run.smithi123.stdout: "cct": { 2024-09-11T23:34:54.162 INFO:teuthology.orchestra.run.smithi123.stdout: "total_workers": 1, 2024-09-11T23:34:54.162 INFO:teuthology.orchestra.run.smithi123.stdout: "unhealthy_workers": 0 2024-09-11T23:34:54.162 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:54.162 INFO:teuthology.orchestra.run.smithi123.stdout: "finisher-MDSRank": { 2024-09-11T23:34:54.162 INFO:teuthology.orchestra.run.smithi123.stdout: "queue_len": 0, 2024-09-11T23:34:54.162 INFO:teuthology.orchestra.run.smithi123.stdout: "complete_latency": { 2024-09-11T23:34:54.162 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 5202, 2024-09-11T23:34:54.162 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.128000347, 2024-09-11T23:34:54.162 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000024605 2024-09-11T23:34:54.162 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-11T23:34:54.162 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:54.162 INFO:teuthology.orchestra.run.smithi123.stdout: "finisher-PurgeQueue": { 2024-09-11T23:34:54.163 INFO:teuthology.orchestra.run.smithi123.stdout: "queue_len": 0, 2024-09-11T23:34:54.163 INFO:teuthology.orchestra.run.smithi123.stdout: "complete_latency": { 2024-09-11T23:34:54.163 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:54.163 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:54.163 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:54.163 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-11T23:34:54.163 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:54.163 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": { 2024-09-11T23:34:54.163 INFO:teuthology.orchestra.run.smithi123.stdout: "request": 0, 2024-09-11T23:34:54.163 INFO:teuthology.orchestra.run.smithi123.stdout: "reply": 0, 2024-09-11T23:34:54.163 INFO:teuthology.orchestra.run.smithi123.stdout: "reply_latency": { 2024-09-11T23:34:54.163 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:54.164 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:54.164 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:54.164 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:54.164 INFO:teuthology.orchestra.run.smithi123.stdout: "slow_reply": 0, 2024-09-11T23:34:54.164 INFO:teuthology.orchestra.run.smithi123.stdout: "forward": 0, 2024-09-11T23:34:54.164 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_fetch_complete": 0, 2024-09-11T23:34:54.164 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_fetch_keys": 0, 2024-09-11T23:34:54.164 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_commit": 0, 2024-09-11T23:34:54.164 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_split": 0, 2024-09-11T23:34:54.164 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_merge": 0, 2024-09-11T23:34:54.164 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes": 0, 2024-09-11T23:34:54.164 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes_top": 0, 2024-09-11T23:34:54.165 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes_bottom": 0, 2024-09-11T23:34:54.165 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes_pin_tail": 0, 2024-09-11T23:34:54.165 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes_pinned": 0, 2024-09-11T23:34:54.165 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes_expired": 0, 2024-09-11T23:34:54.165 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes_with_caps": 0, 2024-09-11T23:34:54.165 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": 0, 2024-09-11T23:34:54.165 INFO:teuthology.orchestra.run.smithi123.stdout: "subtrees": 1, 2024-09-11T23:34:54.165 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse": 0, 2024-09-11T23:34:54.165 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse_hit": 0, 2024-09-11T23:34:54.165 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse_forward": 0, 2024-09-11T23:34:54.165 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse_discover": 0, 2024-09-11T23:34:54.165 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse_dir_fetch": 0, 2024-09-11T23:34:54.165 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse_remote_ino": 0, 2024-09-11T23:34:54.166 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse_lock": 0, 2024-09-11T23:34:54.166 INFO:teuthology.orchestra.run.smithi123.stdout: "load_cent": 0, 2024-09-11T23:34:54.166 INFO:teuthology.orchestra.run.smithi123.stdout: "q": 0, 2024-09-11T23:34:54.166 INFO:teuthology.orchestra.run.smithi123.stdout: "exported": 0, 2024-09-11T23:34:54.166 INFO:teuthology.orchestra.run.smithi123.stdout: "exported_inodes": 0, 2024-09-11T23:34:54.166 INFO:teuthology.orchestra.run.smithi123.stdout: "imported": 0, 2024-09-11T23:34:54.166 INFO:teuthology.orchestra.run.smithi123.stdout: "imported_inodes": 0, 2024-09-11T23:34:54.166 INFO:teuthology.orchestra.run.smithi123.stdout: "openino_dir_fetch": 0, 2024-09-11T23:34:54.166 INFO:teuthology.orchestra.run.smithi123.stdout: "openino_backtrace_fetch": 0, 2024-09-11T23:34:54.166 INFO:teuthology.orchestra.run.smithi123.stdout: "openino_peer_discover": 0, 2024-09-11T23:34:54.166 INFO:teuthology.orchestra.run.smithi123.stdout: "root_rfiles": 0, 2024-09-11T23:34:54.166 INFO:teuthology.orchestra.run.smithi123.stdout: "root_rbytes": 0, 2024-09-11T23:34:54.166 INFO:teuthology.orchestra.run.smithi123.stdout: "root_rsnaps": 0, 2024-09-11T23:34:54.166 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_backtrace_fetch": 0, 2024-09-11T23:34:54.167 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_set_tag": 0, 2024-09-11T23:34:54.167 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_backtrace_repaired": 0, 2024-09-11T23:34:54.167 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_inotable_repaired": 0, 2024-09-11T23:34:54.167 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_dir_inodes": 0, 2024-09-11T23:34:54.167 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_dir_base_inodes": 0, 2024-09-11T23:34:54.167 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_dirfrag_rstats": 0, 2024-09-11T23:34:54.167 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_file_inodes": 0, 2024-09-11T23:34:54.167 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_inode_file_caps": 0, 2024-09-11T23:34:54.167 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_cap_op_revoke": 0, 2024-09-11T23:34:54.167 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_cap_op_grant": 0, 2024-09-11T23:34:54.167 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_cap_op_trunc": 0, 2024-09-11T23:34:54.167 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-11T23:34:54.168 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-11T23:34:54.168 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_client_caps": 0, 2024-09-11T23:34:54.168 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_client_caps_dirty": 0, 2024-09-11T23:34:54.168 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_client_cap_release": 0, 2024-09-11T23:34:54.168 INFO:teuthology.orchestra.run.smithi123.stdout: "process_request_cap_release": 0 2024-09-11T23:34:54.168 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:54.168 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_cache": { 2024-09-11T23:34:54.168 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_update": 0, 2024-09-11T23:34:54.168 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_update_receipt": 0, 2024-09-11T23:34:54.168 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_try_discover": 0, 2024-09-11T23:34:54.168 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_send_discover": 0, 2024-09-11T23:34:54.168 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_handle_discover": 0, 2024-09-11T23:34:54.168 INFO:teuthology.orchestra.run.smithi123.stdout: "num_strays": 0, 2024-09-11T23:34:54.169 INFO:teuthology.orchestra.run.smithi123.stdout: "num_strays_delayed": 0, 2024-09-11T23:34:54.169 INFO:teuthology.orchestra.run.smithi123.stdout: "num_strays_enqueuing": 0, 2024-09-11T23:34:54.169 INFO:teuthology.orchestra.run.smithi123.stdout: "strays_created": 0, 2024-09-11T23:34:54.169 INFO:teuthology.orchestra.run.smithi123.stdout: "strays_enqueued": 0, 2024-09-11T23:34:54.169 INFO:teuthology.orchestra.run.smithi123.stdout: "strays_reintegrated": 0, 2024-09-11T23:34:54.169 INFO:teuthology.orchestra.run.smithi123.stdout: "strays_migrated": 0, 2024-09-11T23:34:54.169 INFO:teuthology.orchestra.run.smithi123.stdout: "num_recovering_processing": 0, 2024-09-11T23:34:54.169 INFO:teuthology.orchestra.run.smithi123.stdout: "num_recovering_enqueued": 0, 2024-09-11T23:34:54.169 INFO:teuthology.orchestra.run.smithi123.stdout: "num_recovering_prioritized": 0, 2024-09-11T23:34:54.169 INFO:teuthology.orchestra.run.smithi123.stdout: "recovery_started": 0, 2024-09-11T23:34:54.169 INFO:teuthology.orchestra.run.smithi123.stdout: "recovery_completed": 0, 2024-09-11T23:34:54.169 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_quiesce_path": 0, 2024-09-11T23:34:54.169 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_quiesce_inode": 0, 2024-09-11T23:34:54.170 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_enqueue_scrub": 0, 2024-09-11T23:34:54.170 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_exportdir": 0, 2024-09-11T23:34:54.170 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_flush": 0, 2024-09-11T23:34:54.170 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_fragmentdir": 0, 2024-09-11T23:34:54.170 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_fragstats": 0, 2024-09-11T23:34:54.170 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_inodestats": 0 2024-09-11T23:34:54.170 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:54.170 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_log": { 2024-09-11T23:34:54.170 INFO:teuthology.orchestra.run.smithi123.stdout: "evlrg": 0, 2024-09-11T23:34:54.170 INFO:teuthology.orchestra.run.smithi123.stdout: "evadd": 0, 2024-09-11T23:34:54.170 INFO:teuthology.orchestra.run.smithi123.stdout: "evex": 0, 2024-09-11T23:34:54.170 INFO:teuthology.orchestra.run.smithi123.stdout: "evtrm": 0, 2024-09-11T23:34:54.170 INFO:teuthology.orchestra.run.smithi123.stdout: "ev": 7, 2024-09-11T23:34:54.171 INFO:teuthology.orchestra.run.smithi123.stdout: "evexg": 0, 2024-09-11T23:34:54.171 INFO:teuthology.orchestra.run.smithi123.stdout: "evexd": 0, 2024-09-11T23:34:54.171 INFO:teuthology.orchestra.run.smithi123.stdout: "segadd": 0, 2024-09-11T23:34:54.171 INFO:teuthology.orchestra.run.smithi123.stdout: "segex": 0, 2024-09-11T23:34:54.171 INFO:teuthology.orchestra.run.smithi123.stdout: "segtrm": 0, 2024-09-11T23:34:54.171 INFO:teuthology.orchestra.run.smithi123.stdout: "seg": 2, 2024-09-11T23:34:54.171 INFO:teuthology.orchestra.run.smithi123.stdout: "segmjr": 2, 2024-09-11T23:34:54.171 INFO:teuthology.orchestra.run.smithi123.stdout: "segexg": 0, 2024-09-11T23:34:54.171 INFO:teuthology.orchestra.run.smithi123.stdout: "segexd": 0, 2024-09-11T23:34:54.171 INFO:teuthology.orchestra.run.smithi123.stdout: "expos": 4194304, 2024-09-11T23:34:54.171 INFO:teuthology.orchestra.run.smithi123.stdout: "wrpos": 4196271, 2024-09-11T23:34:54.171 INFO:teuthology.orchestra.run.smithi123.stdout: "rdpos": 4196130, 2024-09-11T23:34:54.171 INFO:teuthology.orchestra.run.smithi123.stdout: "jlat": { 2024-09-11T23:34:54.171 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:54.172 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:54.172 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:54.172 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:54.172 INFO:teuthology.orchestra.run.smithi123.stdout: "replayed": 7 2024-09-11T23:34:54.172 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:54.172 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_mem": { 2024-09-11T23:34:54.172 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 3, 2024-09-11T23:34:54.172 INFO:teuthology.orchestra.run.smithi123.stdout: "ino+": 3, 2024-09-11T23:34:54.172 INFO:teuthology.orchestra.run.smithi123.stdout: "ino-": 0, 2024-09-11T23:34:54.172 INFO:teuthology.orchestra.run.smithi123.stdout: "dir": 1, 2024-09-11T23:34:54.172 INFO:teuthology.orchestra.run.smithi123.stdout: "dir+": 1, 2024-09-11T23:34:54.172 INFO:teuthology.orchestra.run.smithi123.stdout: "dir-": 0, 2024-09-11T23:34:54.173 INFO:teuthology.orchestra.run.smithi123.stdout: "dn": 0, 2024-09-11T23:34:54.173 INFO:teuthology.orchestra.run.smithi123.stdout: "dn+": 0, 2024-09-11T23:34:54.173 INFO:teuthology.orchestra.run.smithi123.stdout: "dn-": 0, 2024-09-11T23:34:54.173 INFO:teuthology.orchestra.run.smithi123.stdout: "cap": 0, 2024-09-11T23:34:54.173 INFO:teuthology.orchestra.run.smithi123.stdout: "cap+": 0, 2024-09-11T23:34:54.173 INFO:teuthology.orchestra.run.smithi123.stdout: "cap-": 0, 2024-09-11T23:34:54.173 INFO:teuthology.orchestra.run.smithi123.stdout: "rss": 48296, 2024-09-11T23:34:54.173 INFO:teuthology.orchestra.run.smithi123.stdout: "heap": 215328 2024-09-11T23:34:54.173 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:54.173 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_server": { 2024-09-11T23:34:54.173 INFO:teuthology.orchestra.run.smithi123.stdout: "dispatch_client_request": 0, 2024-09-11T23:34:54.174 INFO:teuthology.orchestra.run.smithi123.stdout: "dispatch_server_request": 0, 2024-09-11T23:34:54.174 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_client_request": 0, 2024-09-11T23:34:54.174 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_client_session": 0, 2024-09-11T23:34:54.174 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_peer_request": 0, 2024-09-11T23:34:54.174 INFO:teuthology.orchestra.run.smithi123.stdout: "req_create_latency": { 2024-09-11T23:34:54.174 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:54.174 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:54.174 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:54.174 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:54.174 INFO:teuthology.orchestra.run.smithi123.stdout: "req_getattr_latency": { 2024-09-11T23:34:54.175 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:54.175 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:54.175 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:54.175 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:54.175 INFO:teuthology.orchestra.run.smithi123.stdout: "req_getfilelock_latency": { 2024-09-11T23:34:54.175 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:54.175 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:54.175 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:54.175 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:54.175 INFO:teuthology.orchestra.run.smithi123.stdout: "req_link_latency": { 2024-09-11T23:34:54.175 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:54.175 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:54.176 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:54.176 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:54.176 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lookup_latency": { 2024-09-11T23:34:54.176 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:54.176 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:54.176 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:54.176 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:54.176 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lookuphash_latency": { 2024-09-11T23:34:54.176 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:54.176 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:54.177 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:54.177 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:54.177 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lookupino_latency": { 2024-09-11T23:34:54.177 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:54.177 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:54.177 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:54.177 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:54.177 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lookupname_latency": { 2024-09-11T23:34:54.177 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:54.177 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:54.177 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:54.177 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:54.178 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lookupparent_latency": { 2024-09-11T23:34:54.178 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:54.178 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:54.178 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:54.178 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:54.178 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lookupsnap_latency": { 2024-09-11T23:34:54.178 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:54.178 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:54.178 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:54.179 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:54.179 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lssnap_latency": { 2024-09-11T23:34:54.179 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:54.179 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:54.179 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:54.179 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:54.179 INFO:teuthology.orchestra.run.smithi123.stdout: "req_mkdir_latency": { 2024-09-11T23:34:54.179 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:54.180 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:54.180 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:54.180 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:54.180 INFO:teuthology.orchestra.run.smithi123.stdout: "req_mknod_latency": { 2024-09-11T23:34:54.180 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:54.180 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:54.181 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:54.181 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:54.181 INFO:teuthology.orchestra.run.smithi123.stdout: "req_mksnap_latency": { 2024-09-11T23:34:54.181 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:54.181 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:54.181 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:54.181 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:54.181 INFO:teuthology.orchestra.run.smithi123.stdout: "req_open_latency": { 2024-09-11T23:34:54.181 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:54.181 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:54.182 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:54.182 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:54.182 INFO:teuthology.orchestra.run.smithi123.stdout: "req_readdir_latency": { 2024-09-11T23:34:54.182 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:54.182 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:54.182 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:54.182 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:54.182 INFO:teuthology.orchestra.run.smithi123.stdout: "req_rename_latency": { 2024-09-11T23:34:54.182 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:54.182 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:54.183 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:54.183 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:54.183 INFO:teuthology.orchestra.run.smithi123.stdout: "req_renamesnap_latency": { 2024-09-11T23:34:54.183 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:54.183 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:54.183 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:54.183 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:54.183 INFO:teuthology.orchestra.run.smithi123.stdout: "req_snapdiff_latency": { 2024-09-11T23:34:54.183 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:54.184 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:54.184 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:54.184 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:54.184 INFO:teuthology.orchestra.run.smithi123.stdout: "req_rmdir_latency": { 2024-09-11T23:34:54.184 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:54.184 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:54.184 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:54.184 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:54.184 INFO:teuthology.orchestra.run.smithi123.stdout: "req_rmsnap_latency": { 2024-09-11T23:34:54.184 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:54.185 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:54.185 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:54.185 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:54.185 INFO:teuthology.orchestra.run.smithi123.stdout: "req_rmxattr_latency": { 2024-09-11T23:34:54.185 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:54.185 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:54.185 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:54.185 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:54.185 INFO:teuthology.orchestra.run.smithi123.stdout: "req_setattr_latency": { 2024-09-11T23:34:54.186 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:54.186 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:54.186 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:54.186 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:54.186 INFO:teuthology.orchestra.run.smithi123.stdout: "req_setdirlayout_latency": { 2024-09-11T23:34:54.186 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:54.186 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:54.186 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:54.186 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:54.186 INFO:teuthology.orchestra.run.smithi123.stdout: "req_setfilelock_latency": { 2024-09-11T23:34:54.186 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:54.186 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:54.186 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:54.187 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:54.187 INFO:teuthology.orchestra.run.smithi123.stdout: "req_setlayout_latency": { 2024-09-11T23:34:54.187 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:54.187 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:54.187 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:54.187 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:54.187 INFO:teuthology.orchestra.run.smithi123.stdout: "req_setxattr_latency": { 2024-09-11T23:34:54.187 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:54.187 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:54.187 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:54.187 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:54.187 INFO:teuthology.orchestra.run.smithi123.stdout: "req_symlink_latency": { 2024-09-11T23:34:54.187 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:54.188 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:54.188 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:54.188 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:54.188 INFO:teuthology.orchestra.run.smithi123.stdout: "req_unlink_latency": { 2024-09-11T23:34:54.188 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:54.188 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:54.188 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:54.188 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:54.188 INFO:teuthology.orchestra.run.smithi123.stdout: "cap_revoke_eviction": 0, 2024-09-11T23:34:54.189 INFO:teuthology.orchestra.run.smithi123.stdout: "cap_acquisition_throttle": 0, 2024-09-11T23:34:54.189 INFO:teuthology.orchestra.run.smithi123.stdout: "req_getvxattr_latency": { 2024-09-11T23:34:54.189 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:54.189 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:54.189 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:54.189 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-11T23:34:54.189 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:54.189 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_sessions": { 2024-09-11T23:34:54.189 INFO:teuthology.orchestra.run.smithi123.stdout: "session_count": 1, 2024-09-11T23:34:54.189 INFO:teuthology.orchestra.run.smithi123.stdout: "session_add": 3, 2024-09-11T23:34:54.189 INFO:teuthology.orchestra.run.smithi123.stdout: "session_remove": 2, 2024-09-11T23:34:54.189 INFO:teuthology.orchestra.run.smithi123.stdout: "sessions_open": 2, 2024-09-11T23:34:54.190 INFO:teuthology.orchestra.run.smithi123.stdout: "sessions_stale": 0, 2024-09-11T23:34:54.190 INFO:teuthology.orchestra.run.smithi123.stdout: "total_load": 0, 2024-09-11T23:34:54.190 INFO:teuthology.orchestra.run.smithi123.stdout: "average_load": 0, 2024-09-11T23:34:54.190 INFO:teuthology.orchestra.run.smithi123.stdout: "avg_session_uptime": 3742, 2024-09-11T23:34:54.190 INFO:teuthology.orchestra.run.smithi123.stdout: "mdthresh_evicted": 0 2024-09-11T23:34:54.190 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:54.190 INFO:teuthology.orchestra.run.smithi123.stdout: "mempool": { 2024-09-11T23:34:54.190 INFO:teuthology.orchestra.run.smithi123.stdout: "bloom_filter_bytes": 0, 2024-09-11T23:34:54.190 INFO:teuthology.orchestra.run.smithi123.stdout: "bloom_filter_items": 0, 2024-09-11T23:34:54.190 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_alloc_bytes": 0, 2024-09-11T23:34:54.190 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_alloc_items": 0, 2024-09-11T23:34:54.190 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_data_bytes": 0, 2024-09-11T23:34:54.191 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_data_items": 0, 2024-09-11T23:34:54.191 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-11T23:34:54.191 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_onode_items": 0, 2024-09-11T23:34:54.191 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-11T23:34:54.191 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_meta_items": 0, 2024-09-11T23:34:54.191 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_other_bytes": 0, 2024-09-11T23:34:54.191 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_other_items": 0, 2024-09-11T23:34:54.191 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-11T23:34:54.191 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_buffer_items": 0, 2024-09-11T23:34:54.191 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_extent_bytes": 0, 2024-09-11T23:34:54.191 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_extent_items": 0, 2024-09-11T23:34:54.191 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_blob_bytes": 0, 2024-09-11T23:34:54.191 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_blob_items": 0, 2024-09-11T23:34:54.192 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-11T23:34:54.192 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_shared_blob_items": 0, 2024-09-11T23:34:54.192 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-11T23:34:54.192 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_inline_bl_items": 0, 2024-09-11T23:34:54.192 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_fsck_bytes": 0, 2024-09-11T23:34:54.192 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_fsck_items": 0, 2024-09-11T23:34:54.192 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_txc_bytes": 0, 2024-09-11T23:34:54.192 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_txc_items": 0, 2024-09-11T23:34:54.192 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-11T23:34:54.192 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_writing_deferred_items": 0, 2024-09-11T23:34:54.192 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_writing_bytes": 0, 2024-09-11T23:34:54.192 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_writing_items": 0, 2024-09-11T23:34:54.192 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_bytes": 0, 2024-09-11T23:34:54.193 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_items": 0, 2024-09-11T23:34:54.193 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_file_reader_bytes": 0, 2024-09-11T23:34:54.193 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_file_reader_items": 0, 2024-09-11T23:34:54.193 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_file_writer_bytes": 0, 2024-09-11T23:34:54.193 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_file_writer_items": 0, 2024-09-11T23:34:54.193 INFO:teuthology.orchestra.run.smithi123.stdout: "buffer_anon_bytes": 190185, 2024-09-11T23:34:54.193 INFO:teuthology.orchestra.run.smithi123.stdout: "buffer_anon_items": 53, 2024-09-11T23:34:54.193 INFO:teuthology.orchestra.run.smithi123.stdout: "buffer_meta_bytes": 0, 2024-09-11T23:34:54.193 INFO:teuthology.orchestra.run.smithi123.stdout: "buffer_meta_items": 0, 2024-09-11T23:34:54.193 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_bytes": 0, 2024-09-11T23:34:54.193 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_items": 0, 2024-09-11T23:34:54.193 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_mapbl_bytes": 0, 2024-09-11T23:34:54.193 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_mapbl_items": 0, 2024-09-11T23:34:54.194 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_pglog_bytes": 0, 2024-09-11T23:34:54.194 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_pglog_items": 0, 2024-09-11T23:34:54.194 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_bytes": 9336, 2024-09-11T23:34:54.194 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_items": 176, 2024-09-11T23:34:54.194 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_mapping_bytes": 0, 2024-09-11T23:34:54.194 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_mapping_items": 0, 2024-09-11T23:34:54.194 INFO:teuthology.orchestra.run.smithi123.stdout: "pgmap_bytes": 0, 2024-09-11T23:34:54.194 INFO:teuthology.orchestra.run.smithi123.stdout: "pgmap_items": 0, 2024-09-11T23:34:54.194 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_co_bytes": 8512, 2024-09-11T23:34:54.195 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_co_items": 13, 2024-09-11T23:34:54.195 INFO:teuthology.orchestra.run.smithi123.stdout: "unittest_1_bytes": 0, 2024-09-11T23:34:54.195 INFO:teuthology.orchestra.run.smithi123.stdout: "unittest_1_items": 0, 2024-09-11T23:34:54.195 INFO:teuthology.orchestra.run.smithi123.stdout: "unittest_2_bytes": 0, 2024-09-11T23:34:54.195 INFO:teuthology.orchestra.run.smithi123.stdout: "unittest_2_items": 0 2024-09-11T23:34:54.195 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:54.195 INFO:teuthology.orchestra.run.smithi123.stdout: "objecter": { 2024-09-11T23:34:54.195 INFO:teuthology.orchestra.run.smithi123.stdout: "op_active": 0, 2024-09-11T23:34:54.195 INFO:teuthology.orchestra.run.smithi123.stdout: "op_laggy": 0, 2024-09-11T23:34:54.195 INFO:teuthology.orchestra.run.smithi123.stdout: "op_send": 3103, 2024-09-11T23:34:54.196 INFO:teuthology.orchestra.run.smithi123.stdout: "op_send_bytes": 21, 2024-09-11T23:34:54.196 INFO:teuthology.orchestra.run.smithi123.stdout: "op_resend": 3, 2024-09-11T23:34:54.196 INFO:teuthology.orchestra.run.smithi123.stdout: "op_reply": 3103, 2024-09-11T23:34:54.196 INFO:teuthology.orchestra.run.smithi123.stdout: "op_latency": { 2024-09-11T23:34:54.196 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 3103, 2024-09-11T23:34:54.196 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 14.271684237, 2024-09-11T23:34:54.196 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.004599318 2024-09-11T23:34:54.196 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:54.196 INFO:teuthology.orchestra.run.smithi123.stdout: "op_inflight": 0, 2024-09-11T23:34:54.196 INFO:teuthology.orchestra.run.smithi123.stdout: "oplen_avg": { 2024-09-11T23:34:54.197 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 3103, 2024-09-11T23:34:54.197 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 3104 2024-09-11T23:34:54.197 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:54.197 INFO:teuthology.orchestra.run.smithi123.stdout: "op": 3103, 2024-09-11T23:34:54.197 INFO:teuthology.orchestra.run.smithi123.stdout: "op_r": 3103, 2024-09-11T23:34:54.197 INFO:teuthology.orchestra.run.smithi123.stdout: "op_w": 0, 2024-09-11T23:34:54.197 INFO:teuthology.orchestra.run.smithi123.stdout: "op_rmw": 0, 2024-09-11T23:34:54.197 INFO:teuthology.orchestra.run.smithi123.stdout: "op_pg": 0, 2024-09-11T23:34:54.197 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_stat": 2035, 2024-09-11T23:34:54.197 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_create": 0, 2024-09-11T23:34:54.197 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_read": 1066, 2024-09-11T23:34:54.198 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_write": 0, 2024-09-11T23:34:54.198 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_writefull": 0, 2024-09-11T23:34:54.198 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_writesame": 0, 2024-09-11T23:34:54.198 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_append": 0, 2024-09-11T23:34:54.198 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_zero": 0, 2024-09-11T23:34:54.198 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_truncate": 0, 2024-09-11T23:34:54.198 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_delete": 0, 2024-09-11T23:34:54.198 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_mapext": 0, 2024-09-11T23:34:54.198 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_sparse_read": 0, 2024-09-11T23:34:54.198 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_clonerange": 0, 2024-09-11T23:34:54.198 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_getxattr": 1, 2024-09-11T23:34:54.198 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_setxattr": 0, 2024-09-11T23:34:54.198 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_cmpxattr": 0, 2024-09-11T23:34:54.199 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_rmxattr": 0, 2024-09-11T23:34:54.199 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_resetxattrs": 0, 2024-09-11T23:34:54.199 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_call": 0, 2024-09-11T23:34:54.199 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_watch": 0, 2024-09-11T23:34:54.199 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_notify": 0, 2024-09-11T23:34:54.199 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_src_cmpxattr": 0, 2024-09-11T23:34:54.199 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_pgls": 0, 2024-09-11T23:34:54.199 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_pgls_filter": 0, 2024-09-11T23:34:54.199 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_other": 0, 2024-09-11T23:34:54.199 INFO:teuthology.orchestra.run.smithi123.stdout: "linger_active": 0, 2024-09-11T23:34:54.199 INFO:teuthology.orchestra.run.smithi123.stdout: "linger_send": 0, 2024-09-11T23:34:54.199 INFO:teuthology.orchestra.run.smithi123.stdout: "linger_resend": 0, 2024-09-11T23:34:54.199 INFO:teuthology.orchestra.run.smithi123.stdout: "linger_ping": 0, 2024-09-11T23:34:54.200 INFO:teuthology.orchestra.run.smithi123.stdout: "poolop_active": 0, 2024-09-11T23:34:54.200 INFO:teuthology.orchestra.run.smithi123.stdout: "poolop_send": 0, 2024-09-11T23:34:54.200 INFO:teuthology.orchestra.run.smithi123.stdout: "poolop_resend": 0, 2024-09-11T23:34:54.200 INFO:teuthology.orchestra.run.smithi123.stdout: "poolstat_active": 0, 2024-09-11T23:34:54.200 INFO:teuthology.orchestra.run.smithi123.stdout: "poolstat_send": 0, 2024-09-11T23:34:54.200 INFO:teuthology.orchestra.run.smithi123.stdout: "poolstat_resend": 0, 2024-09-11T23:34:54.200 INFO:teuthology.orchestra.run.smithi123.stdout: "statfs_active": 0, 2024-09-11T23:34:54.200 INFO:teuthology.orchestra.run.smithi123.stdout: "statfs_send": 0, 2024-09-11T23:34:54.200 INFO:teuthology.orchestra.run.smithi123.stdout: "statfs_resend": 0, 2024-09-11T23:34:54.200 INFO:teuthology.orchestra.run.smithi123.stdout: "command_active": 0, 2024-09-11T23:34:54.200 INFO:teuthology.orchestra.run.smithi123.stdout: "command_send": 0, 2024-09-11T23:34:54.200 INFO:teuthology.orchestra.run.smithi123.stdout: "command_resend": 0, 2024-09-11T23:34:54.201 INFO:teuthology.orchestra.run.smithi123.stdout: "map_epoch": 95, 2024-09-11T23:34:54.201 INFO:teuthology.orchestra.run.smithi123.stdout: "map_full": 0, 2024-09-11T23:34:54.201 INFO:teuthology.orchestra.run.smithi123.stdout: "map_inc": 2, 2024-09-11T23:34:54.201 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_sessions": 5, 2024-09-11T23:34:54.201 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_session_open": 6, 2024-09-11T23:34:54.201 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_session_close": 1, 2024-09-11T23:34:54.201 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_laggy": 0, 2024-09-11T23:34:54.201 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_wr": 0, 2024-09-11T23:34:54.201 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_rd": 2, 2024-09-11T23:34:54.201 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_del": 0 2024-09-11T23:34:54.201 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:54.201 INFO:teuthology.orchestra.run.smithi123.stdout: "oft": { 2024-09-11T23:34:54.202 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_total_objs": 0, 2024-09-11T23:34:54.202 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_total_kv_pairs": 0, 2024-09-11T23:34:54.202 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_total_updates": 0, 2024-09-11T23:34:54.202 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_total_removes": 0 2024-09-11T23:34:54.202 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:54.202 INFO:teuthology.orchestra.run.smithi123.stdout: "osd-slow-ops": { 2024-09-11T23:34:54.202 INFO:teuthology.orchestra.run.smithi123.stdout: "slow_ops_count": 0 2024-09-11T23:34:54.202 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:54.202 INFO:teuthology.orchestra.run.smithi123.stdout: "purge_queue": { 2024-09-11T23:34:54.202 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_executing_ops": 0, 2024-09-11T23:34:54.202 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_executing_ops_high_water": 0, 2024-09-11T23:34:54.202 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_executing": 0, 2024-09-11T23:34:54.202 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_executing_high_water": 0, 2024-09-11T23:34:54.203 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_executed_ops": 0, 2024-09-11T23:34:54.203 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_executed": 0, 2024-09-11T23:34:54.203 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_item_in_journal": 0 2024-09-11T23:34:54.203 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:54.203 INFO:teuthology.orchestra.run.smithi123.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-11T23:34:54.203 INFO:teuthology.orchestra.run.smithi123.stdout: "val": 0, 2024-09-11T23:34:54.203 INFO:teuthology.orchestra.run.smithi123.stdout: "max": 104857600, 2024-09-11T23:34:54.203 INFO:teuthology.orchestra.run.smithi123.stdout: "get_started": 0, 2024-09-11T23:34:54.203 INFO:teuthology.orchestra.run.smithi123.stdout: "get": 3428, 2024-09-11T23:34:54.203 INFO:teuthology.orchestra.run.smithi123.stdout: "get_sum": 1365317, 2024-09-11T23:34:54.203 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_fail": 0, 2024-09-11T23:34:54.203 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_success": 3428, 2024-09-11T23:34:54.203 INFO:teuthology.orchestra.run.smithi123.stdout: "take": 0, 2024-09-11T23:34:54.204 INFO:teuthology.orchestra.run.smithi123.stdout: "take_sum": 0, 2024-09-11T23:34:54.204 INFO:teuthology.orchestra.run.smithi123.stdout: "put": 3428, 2024-09-11T23:34:54.204 INFO:teuthology.orchestra.run.smithi123.stdout: "put_sum": 1365317, 2024-09-11T23:34:54.204 INFO:teuthology.orchestra.run.smithi123.stdout: "wait": { 2024-09-11T23:34:54.204 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:54.204 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:54.204 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:54.204 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-11T23:34:54.204 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:54.204 INFO:teuthology.orchestra.run.smithi123.stdout: "throttle-objecter_bytes": { 2024-09-11T23:34:54.204 INFO:teuthology.orchestra.run.smithi123.stdout: "val": 0, 2024-09-11T23:34:54.204 INFO:teuthology.orchestra.run.smithi123.stdout: "max": 104857600, 2024-09-11T23:34:54.204 INFO:teuthology.orchestra.run.smithi123.stdout: "get_started": 0, 2024-09-11T23:34:54.204 INFO:teuthology.orchestra.run.smithi123.stdout: "get": 0, 2024-09-11T23:34:54.205 INFO:teuthology.orchestra.run.smithi123.stdout: "get_sum": 0, 2024-09-11T23:34:54.205 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_fail": 0, 2024-09-11T23:34:54.205 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_success": 0, 2024-09-11T23:34:54.205 INFO:teuthology.orchestra.run.smithi123.stdout: "take": 3103, 2024-09-11T23:34:54.205 INFO:teuthology.orchestra.run.smithi123.stdout: "take_sum": 1972, 2024-09-11T23:34:54.205 INFO:teuthology.orchestra.run.smithi123.stdout: "put": 3103, 2024-09-11T23:34:54.205 INFO:teuthology.orchestra.run.smithi123.stdout: "put_sum": 1972, 2024-09-11T23:34:54.205 INFO:teuthology.orchestra.run.smithi123.stdout: "wait": { 2024-09-11T23:34:54.205 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:54.205 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:54.205 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:54.205 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-11T23:34:54.206 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:54.206 INFO:teuthology.orchestra.run.smithi123.stdout: "throttle-objecter_ops": { 2024-09-11T23:34:54.206 INFO:teuthology.orchestra.run.smithi123.stdout: "val": 0, 2024-09-11T23:34:54.206 INFO:teuthology.orchestra.run.smithi123.stdout: "max": 1024, 2024-09-11T23:34:54.206 INFO:teuthology.orchestra.run.smithi123.stdout: "get_started": 0, 2024-09-11T23:34:54.206 INFO:teuthology.orchestra.run.smithi123.stdout: "get": 0, 2024-09-11T23:34:54.206 INFO:teuthology.orchestra.run.smithi123.stdout: "get_sum": 0, 2024-09-11T23:34:54.206 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_fail": 0, 2024-09-11T23:34:54.206 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_success": 0, 2024-09-11T23:34:54.206 INFO:teuthology.orchestra.run.smithi123.stdout: "take": 3103, 2024-09-11T23:34:54.206 INFO:teuthology.orchestra.run.smithi123.stdout: "take_sum": 3103, 2024-09-11T23:34:54.206 INFO:teuthology.orchestra.run.smithi123.stdout: "put": 3103, 2024-09-11T23:34:54.206 INFO:teuthology.orchestra.run.smithi123.stdout: "put_sum": 3103, 2024-09-11T23:34:54.207 INFO:teuthology.orchestra.run.smithi123.stdout: "wait": { 2024-09-11T23:34:54.207 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:54.207 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:54.207 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:54.207 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-11T23:34:54.207 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:54.207 INFO:teuthology.orchestra.run.smithi123.stdout: "throttle-write_buf_throttle": { 2024-09-11T23:34:54.207 INFO:teuthology.orchestra.run.smithi123.stdout: "val": 0, 2024-09-11T23:34:54.207 INFO:teuthology.orchestra.run.smithi123.stdout: "max": 3758096384, 2024-09-11T23:34:54.207 INFO:teuthology.orchestra.run.smithi123.stdout: "get_started": 0, 2024-09-11T23:34:54.207 INFO:teuthology.orchestra.run.smithi123.stdout: "get": 0, 2024-09-11T23:34:54.207 INFO:teuthology.orchestra.run.smithi123.stdout: "get_sum": 0, 2024-09-11T23:34:54.207 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_fail": 0, 2024-09-11T23:34:54.208 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_success": 0, 2024-09-11T23:34:54.208 INFO:teuthology.orchestra.run.smithi123.stdout: "take": 0, 2024-09-11T23:34:54.208 INFO:teuthology.orchestra.run.smithi123.stdout: "take_sum": 0, 2024-09-11T23:34:54.208 INFO:teuthology.orchestra.run.smithi123.stdout: "put": 0, 2024-09-11T23:34:54.208 INFO:teuthology.orchestra.run.smithi123.stdout: "put_sum": 0, 2024-09-11T23:34:54.208 INFO:teuthology.orchestra.run.smithi123.stdout: "wait": { 2024-09-11T23:34:54.208 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:54.208 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:54.208 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:54.208 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-11T23:34:54.208 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-11T23:34:54.208 INFO:teuthology.orchestra.run.smithi123.stdout: "throttle-write_buf_throttle-0x555577228b40": { 2024-09-11T23:34:54.208 INFO:teuthology.orchestra.run.smithi123.stdout: "val": 0, 2024-09-11T23:34:54.209 INFO:teuthology.orchestra.run.smithi123.stdout: "max": 3758096384, 2024-09-11T23:34:54.209 INFO:teuthology.orchestra.run.smithi123.stdout: "get_started": 0, 2024-09-11T23:34:54.209 INFO:teuthology.orchestra.run.smithi123.stdout: "get": 0, 2024-09-11T23:34:54.209 INFO:teuthology.orchestra.run.smithi123.stdout: "get_sum": 0, 2024-09-11T23:34:54.209 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_fail": 0, 2024-09-11T23:34:54.209 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_success": 0, 2024-09-11T23:34:54.209 INFO:teuthology.orchestra.run.smithi123.stdout: "take": 0, 2024-09-11T23:34:54.209 INFO:teuthology.orchestra.run.smithi123.stdout: "take_sum": 0, 2024-09-11T23:34:54.209 INFO:teuthology.orchestra.run.smithi123.stdout: "put": 0, 2024-09-11T23:34:54.209 INFO:teuthology.orchestra.run.smithi123.stdout: "put_sum": 0, 2024-09-11T23:34:54.209 INFO:teuthology.orchestra.run.smithi123.stdout: "wait": { 2024-09-11T23:34:54.209 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-11T23:34:54.209 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-11T23:34:54.209 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-11T23:34:54.210 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-11T23:34:54.210 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-11T23:34:54.210 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-11T23:34:54.210 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:34:53 smithi160 ceph-mon[35055]: pgmap v865: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.7 KiB/s wr, 13 op/s 2024-09-11T23:34:54.941 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:34:54 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:34:54.941 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:34:54 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:34:54.941 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:34:54 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:34:54.941 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:34:54 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:34:54.941 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:34:54 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:34:54.941 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:34:54 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:34:54.942 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:34:54 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:34:54.942 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:34:54 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:34:54.971 INFO:tasks.check_counter:Daemon mds.k mds.exported=0 2024-09-11T23:34:54.971 INFO:tasks.check_counter:Daemon mds.k mds.imported=0 2024-09-11T23:34:54.971 DEBUG:tasks.check_counter:Getting stats from c 2024-09-11T23:34:54.972 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph daemon mds.c perf dump 2024-09-11T23:34:55.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:34:54 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:34:55.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:34:54 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:34:55.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:34:54 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:34:55.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:34:54 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:34:55.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:34:54 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:34:55.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:34:54 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:34:55.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:34:54 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:34:55.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:34:54 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:34:55.252 INFO:teuthology.orchestra.run.smithi160.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T23:34:55.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:34:54 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:34:55.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:34:54 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:34:55.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:34:54 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:34:55.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:34:54 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:34:55.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:34:54 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:34:55.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:34:54 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:34:55.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:34:54 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:34:55.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:34:54 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' 2024-09-11T23:34:56.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:34:55 smithi160 ceph-mon[35055]: pgmap v866: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.6 KiB/s wr, 9 op/s 2024-09-11T23:34:56.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:34:55 smithi160 ceph-mon[35055]: Adjusting osd_memory_target on smithi037 to 177.5M 2024-09-11T23:34:56.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:34:55 smithi160 ceph-mon[35055]: Unable to set osd_memory_target on smithi037 to 186147225: error parsing value: Value '186147225' is below minimum 939524096 2024-09-11T23:34:56.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:34:55 smithi123 ceph-mon[35438]: pgmap v866: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.6 KiB/s wr, 9 op/s 2024-09-11T23:34:56.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:34:55 smithi123 ceph-mon[35438]: Adjusting osd_memory_target on smithi037 to 177.5M 2024-09-11T23:34:56.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:34:55 smithi123 ceph-mon[35438]: Unable to set osd_memory_target on smithi037 to 186147225: error parsing value: Value '186147225' is below minimum 939524096 2024-09-11T23:34:56.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:34:55 smithi037 ceph-mon[30630]: pgmap v866: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.6 KiB/s wr, 9 op/s 2024-09-11T23:34:56.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:34:55 smithi037 ceph-mon[30630]: Adjusting osd_memory_target on smithi037 to 177.5M 2024-09-11T23:34:56.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:34:55 smithi037 ceph-mon[30630]: Unable to set osd_memory_target on smithi037 to 186147225: error parsing value: Value '186147225' is below minimum 939524096 2024-09-11T23:34:56.594 INFO:teuthology.orchestra.run.smithi160.stdout:{ 2024-09-11T23:34:56.594 INFO:teuthology.orchestra.run.smithi160.stdout: "AsyncMessenger::Worker-0": { 2024-09-11T23:34:56.594 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_messages": 39, 2024-09-11T23:34:56.595 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages": 93, 2024-09-11T23:34:56.595 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_bytes": 9878, 2024-09-11T23:34:56.595 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_bytes": 218990, 2024-09-11T23:34:56.595 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_created_connections": 13, 2024-09-11T23:34:56.595 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_active_connections": 4, 2024-09-11T23:34:56.595 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_total_time": 0.012576592, 2024-09-11T23:34:56.595 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_send_time": 0.002915237, 2024-09-11T23:34:56.595 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_recv_time": 0.007041234, 2024-09-11T23:34:56.595 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_fast_dispatch_time": 0.000561442, 2024-09-11T23:34:56.595 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T23:34:56.595 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 89, 2024-09-11T23:34:56.595 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.048464101, 2024-09-11T23:34:56.596 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000544540 2024-09-11T23:34:56.596 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:56.596 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_handle_ack_lat": { 2024-09-11T23:34:56.596 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 24, 2024-09-11T23:34:56.596 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000003814, 2024-09-11T23:34:56.596 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000158 2024-09-11T23:34:56.596 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:56.596 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_encrypted_bytes": 3264, 2024-09-11T23:34:56.596 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_encrypted_bytes": 182016 2024-09-11T23:34:56.596 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:56.596 INFO:teuthology.orchestra.run.smithi160.stdout: "AsyncMessenger::Worker-1": { 2024-09-11T23:34:56.596 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_messages": 31, 2024-09-11T23:34:56.596 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages": 213, 2024-09-11T23:34:56.597 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_bytes": 8464, 2024-09-11T23:34:56.597 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_bytes": 424978, 2024-09-11T23:34:56.597 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_created_connections": 12, 2024-09-11T23:34:56.597 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_active_connections": 5, 2024-09-11T23:34:56.597 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_total_time": 0.022433498, 2024-09-11T23:34:56.597 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_send_time": 0.010029646, 2024-09-11T23:34:56.597 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_recv_time": 0.009892785, 2024-09-11T23:34:56.597 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_fast_dispatch_time": 0.000351870, 2024-09-11T23:34:56.597 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T23:34:56.597 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 211, 2024-09-11T23:34:56.597 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.019505013, 2024-09-11T23:34:56.597 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000092440 2024-09-11T23:34:56.598 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:56.598 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_handle_ack_lat": { 2024-09-11T23:34:56.598 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 16, 2024-09-11T23:34:56.598 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000012608, 2024-09-11T23:34:56.598 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000788 2024-09-11T23:34:56.598 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:56.598 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-11T23:34:56.598 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_encrypted_bytes": 386672 2024-09-11T23:34:56.598 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:56.598 INFO:teuthology.orchestra.run.smithi160.stdout: "AsyncMessenger::Worker-2": { 2024-09-11T23:34:56.598 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_messages": 768, 2024-09-11T23:34:56.598 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages": 967, 2024-09-11T23:34:56.598 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_bytes": 922345, 2024-09-11T23:34:56.599 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_bytes": 477099, 2024-09-11T23:34:56.599 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_created_connections": 7, 2024-09-11T23:34:56.599 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_active_connections": 3, 2024-09-11T23:34:56.599 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_total_time": 0.099991345, 2024-09-11T23:34:56.599 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_send_time": 0.039512677, 2024-09-11T23:34:56.599 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_recv_time": 0.059418958, 2024-09-11T23:34:56.599 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_fast_dispatch_time": 0.005595830, 2024-09-11T23:34:56.599 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T23:34:56.599 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 969, 2024-09-11T23:34:56.599 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.092128245, 2024-09-11T23:34:56.599 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000095075 2024-09-11T23:34:56.599 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:56.599 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_handle_ack_lat": { 2024-09-11T23:34:56.600 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 1010, 2024-09-11T23:34:56.600 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000260300, 2024-09-11T23:34:56.600 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000257 2024-09-11T23:34:56.600 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:56.600 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_encrypted_bytes": 838592, 2024-09-11T23:34:56.600 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_encrypted_bytes": 195792 2024-09-11T23:34:56.600 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:56.600 INFO:teuthology.orchestra.run.smithi160.stdout: "cct": { 2024-09-11T23:34:56.600 INFO:teuthology.orchestra.run.smithi160.stdout: "total_workers": 1, 2024-09-11T23:34:56.600 INFO:teuthology.orchestra.run.smithi160.stdout: "unhealthy_workers": 0 2024-09-11T23:34:56.600 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:56.600 INFO:teuthology.orchestra.run.smithi160.stdout: "finisher-MDSRank": { 2024-09-11T23:34:56.601 INFO:teuthology.orchestra.run.smithi160.stdout: "queue_len": 0, 2024-09-11T23:34:56.601 INFO:teuthology.orchestra.run.smithi160.stdout: "complete_latency": { 2024-09-11T23:34:56.601 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 58, 2024-09-11T23:34:56.601 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.001771893, 2024-09-11T23:34:56.601 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000030549 2024-09-11T23:34:56.601 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-11T23:34:56.601 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:56.601 INFO:teuthology.orchestra.run.smithi160.stdout: "finisher-PurgeQueue": { 2024-09-11T23:34:56.601 INFO:teuthology.orchestra.run.smithi160.stdout: "queue_len": 0, 2024-09-11T23:34:56.601 INFO:teuthology.orchestra.run.smithi160.stdout: "complete_latency": { 2024-09-11T23:34:56.601 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 2, 2024-09-11T23:34:56.601 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000030899, 2024-09-11T23:34:56.601 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000015449 2024-09-11T23:34:56.602 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-11T23:34:56.602 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:56.602 INFO:teuthology.orchestra.run.smithi160.stdout: "mds": { 2024-09-11T23:34:56.602 INFO:teuthology.orchestra.run.smithi160.stdout: "request": 5, 2024-09-11T23:34:56.602 INFO:teuthology.orchestra.run.smithi160.stdout: "reply": 3, 2024-09-11T23:34:56.602 INFO:teuthology.orchestra.run.smithi160.stdout: "reply_latency": { 2024-09-11T23:34:56.602 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 3, 2024-09-11T23:34:56.602 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.002558766, 2024-09-11T23:34:56.602 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000852922 2024-09-11T23:34:56.602 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:56.602 INFO:teuthology.orchestra.run.smithi160.stdout: "slow_reply": 0, 2024-09-11T23:34:56.602 INFO:teuthology.orchestra.run.smithi160.stdout: "forward": 2, 2024-09-11T23:34:56.602 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_fetch_complete": 0, 2024-09-11T23:34:56.603 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_fetch_keys": 0, 2024-09-11T23:34:56.603 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_commit": 11, 2024-09-11T23:34:56.603 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_split": 0, 2024-09-11T23:34:56.603 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_merge": 0, 2024-09-11T23:34:56.603 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes": 12, 2024-09-11T23:34:56.603 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes_top": 0, 2024-09-11T23:34:56.603 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes_bottom": 12, 2024-09-11T23:34:56.603 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes_pin_tail": 0, 2024-09-11T23:34:56.603 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes_pinned": 11, 2024-09-11T23:34:56.603 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes_expired": 0, 2024-09-11T23:34:56.603 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes_with_caps": 0, 2024-09-11T23:34:56.603 INFO:teuthology.orchestra.run.smithi160.stdout: "caps": 0, 2024-09-11T23:34:56.603 INFO:teuthology.orchestra.run.smithi160.stdout: "subtrees": 2, 2024-09-11T23:34:56.604 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse": 8, 2024-09-11T23:34:56.604 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse_hit": 6, 2024-09-11T23:34:56.604 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse_forward": 0, 2024-09-11T23:34:56.604 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse_discover": 2, 2024-09-11T23:34:56.604 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse_dir_fetch": 0, 2024-09-11T23:34:56.604 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse_remote_ino": 0, 2024-09-11T23:34:56.604 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse_lock": 0, 2024-09-11T23:34:56.604 INFO:teuthology.orchestra.run.smithi160.stdout: "load_cent": 0, 2024-09-11T23:34:56.604 INFO:teuthology.orchestra.run.smithi160.stdout: "q": 0, 2024-09-11T23:34:56.604 INFO:teuthology.orchestra.run.smithi160.stdout: "exported": 0, 2024-09-11T23:34:56.604 INFO:teuthology.orchestra.run.smithi160.stdout: "exported_inodes": 0, 2024-09-11T23:34:56.604 INFO:teuthology.orchestra.run.smithi160.stdout: "imported": 0, 2024-09-11T23:34:56.605 INFO:teuthology.orchestra.run.smithi160.stdout: "imported_inodes": 0, 2024-09-11T23:34:56.605 INFO:teuthology.orchestra.run.smithi160.stdout: "openino_dir_fetch": 0, 2024-09-11T23:34:56.605 INFO:teuthology.orchestra.run.smithi160.stdout: "openino_backtrace_fetch": 0, 2024-09-11T23:34:56.605 INFO:teuthology.orchestra.run.smithi160.stdout: "openino_peer_discover": 1, 2024-09-11T23:34:56.605 INFO:teuthology.orchestra.run.smithi160.stdout: "root_rfiles": 1022, 2024-09-11T23:34:56.605 INFO:teuthology.orchestra.run.smithi160.stdout: "root_rbytes": 1586967590, 2024-09-11T23:34:56.605 INFO:teuthology.orchestra.run.smithi160.stdout: "root_rsnaps": 0, 2024-09-11T23:34:56.605 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_backtrace_fetch": 0, 2024-09-11T23:34:56.605 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_set_tag": 0, 2024-09-11T23:34:56.605 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_backtrace_repaired": 0, 2024-09-11T23:34:56.605 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_inotable_repaired": 0, 2024-09-11T23:34:56.605 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_dir_inodes": 0, 2024-09-11T23:34:56.605 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_dir_base_inodes": 0, 2024-09-11T23:34:56.606 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_dirfrag_rstats": 0, 2024-09-11T23:34:56.606 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_file_inodes": 0, 2024-09-11T23:34:56.606 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_inode_file_caps": 0, 2024-09-11T23:34:56.606 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_cap_op_revoke": 0, 2024-09-11T23:34:56.606 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_cap_op_grant": 0, 2024-09-11T23:34:56.606 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_cap_op_trunc": 0, 2024-09-11T23:34:56.606 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-11T23:34:56.606 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-11T23:34:56.606 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_client_caps": 0, 2024-09-11T23:34:56.606 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_client_caps_dirty": 0, 2024-09-11T23:34:56.606 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_client_cap_release": 0, 2024-09-11T23:34:56.606 INFO:teuthology.orchestra.run.smithi160.stdout: "process_request_cap_release": 0 2024-09-11T23:34:56.606 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:56.607 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_cache": { 2024-09-11T23:34:56.607 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_update": 0, 2024-09-11T23:34:56.607 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_update_receipt": 0, 2024-09-11T23:34:56.607 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_try_discover": 0, 2024-09-11T23:34:56.607 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_send_discover": 3, 2024-09-11T23:34:56.607 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_handle_discover": 0, 2024-09-11T23:34:56.607 INFO:teuthology.orchestra.run.smithi160.stdout: "num_strays": 0, 2024-09-11T23:34:56.607 INFO:teuthology.orchestra.run.smithi160.stdout: "num_strays_delayed": 0, 2024-09-11T23:34:56.607 INFO:teuthology.orchestra.run.smithi160.stdout: "num_strays_enqueuing": 0, 2024-09-11T23:34:56.607 INFO:teuthology.orchestra.run.smithi160.stdout: "strays_created": 0, 2024-09-11T23:34:56.607 INFO:teuthology.orchestra.run.smithi160.stdout: "strays_enqueued": 0, 2024-09-11T23:34:56.607 INFO:teuthology.orchestra.run.smithi160.stdout: "strays_reintegrated": 0, 2024-09-11T23:34:56.608 INFO:teuthology.orchestra.run.smithi160.stdout: "strays_migrated": 0, 2024-09-11T23:34:56.608 INFO:teuthology.orchestra.run.smithi160.stdout: "num_recovering_processing": 0, 2024-09-11T23:34:56.608 INFO:teuthology.orchestra.run.smithi160.stdout: "num_recovering_enqueued": 0, 2024-09-11T23:34:56.608 INFO:teuthology.orchestra.run.smithi160.stdout: "num_recovering_prioritized": 0, 2024-09-11T23:34:56.608 INFO:teuthology.orchestra.run.smithi160.stdout: "recovery_started": 0, 2024-09-11T23:34:56.608 INFO:teuthology.orchestra.run.smithi160.stdout: "recovery_completed": 0, 2024-09-11T23:34:56.608 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_quiesce_path": 0, 2024-09-11T23:34:56.608 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_quiesce_inode": 0, 2024-09-11T23:34:56.608 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_enqueue_scrub": 0, 2024-09-11T23:34:56.608 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_exportdir": 0, 2024-09-11T23:34:56.608 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_flush": 0, 2024-09-11T23:34:56.608 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_fragmentdir": 0, 2024-09-11T23:34:56.608 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_fragstats": 0, 2024-09-11T23:34:56.609 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_inodestats": 0 2024-09-11T23:34:56.609 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:56.609 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_log": { 2024-09-11T23:34:56.609 INFO:teuthology.orchestra.run.smithi160.stdout: "evlrg": 0, 2024-09-11T23:34:56.609 INFO:teuthology.orchestra.run.smithi160.stdout: "evadd": 7, 2024-09-11T23:34:56.609 INFO:teuthology.orchestra.run.smithi160.stdout: "evex": 0, 2024-09-11T23:34:56.609 INFO:teuthology.orchestra.run.smithi160.stdout: "evtrm": 0, 2024-09-11T23:34:56.609 INFO:teuthology.orchestra.run.smithi160.stdout: "ev": 7, 2024-09-11T23:34:56.609 INFO:teuthology.orchestra.run.smithi160.stdout: "evexg": 0, 2024-09-11T23:34:56.609 INFO:teuthology.orchestra.run.smithi160.stdout: "evexd": 0, 2024-09-11T23:34:56.609 INFO:teuthology.orchestra.run.smithi160.stdout: "segadd": 2, 2024-09-11T23:34:56.609 INFO:teuthology.orchestra.run.smithi160.stdout: "segex": 0, 2024-09-11T23:34:56.609 INFO:teuthology.orchestra.run.smithi160.stdout: "segtrm": 0, 2024-09-11T23:34:56.609 INFO:teuthology.orchestra.run.smithi160.stdout: "seg": 2, 2024-09-11T23:34:56.610 INFO:teuthology.orchestra.run.smithi160.stdout: "segmjr": 2, 2024-09-11T23:34:56.610 INFO:teuthology.orchestra.run.smithi160.stdout: "segexg": 0, 2024-09-11T23:34:56.610 INFO:teuthology.orchestra.run.smithi160.stdout: "segexd": 0, 2024-09-11T23:34:56.610 INFO:teuthology.orchestra.run.smithi160.stdout: "expos": 4194304, 2024-09-11T23:34:56.610 INFO:teuthology.orchestra.run.smithi160.stdout: "wrpos": 4196271, 2024-09-11T23:34:56.610 INFO:teuthology.orchestra.run.smithi160.stdout: "rdpos": 0, 2024-09-11T23:34:56.610 INFO:teuthology.orchestra.run.smithi160.stdout: "jlat": { 2024-09-11T23:34:56.610 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 6, 2024-09-11T23:34:56.610 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.012002585, 2024-09-11T23:34:56.610 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.002000430 2024-09-11T23:34:56.610 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:56.610 INFO:teuthology.orchestra.run.smithi160.stdout: "replayed": 0 2024-09-11T23:34:56.610 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:56.611 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_mem": { 2024-09-11T23:34:56.611 INFO:teuthology.orchestra.run.smithi160.stdout: "ino": 15, 2024-09-11T23:34:56.611 INFO:teuthology.orchestra.run.smithi160.stdout: "ino+": 15, 2024-09-11T23:34:56.611 INFO:teuthology.orchestra.run.smithi160.stdout: "ino-": 0, 2024-09-11T23:34:56.611 INFO:teuthology.orchestra.run.smithi160.stdout: "dir": 13, 2024-09-11T23:34:56.611 INFO:teuthology.orchestra.run.smithi160.stdout: "dir+": 14, 2024-09-11T23:34:56.611 INFO:teuthology.orchestra.run.smithi160.stdout: "dir-": 1, 2024-09-11T23:34:56.611 INFO:teuthology.orchestra.run.smithi160.stdout: "dn": 12, 2024-09-11T23:34:56.611 INFO:teuthology.orchestra.run.smithi160.stdout: "dn+": 12, 2024-09-11T23:34:56.611 INFO:teuthology.orchestra.run.smithi160.stdout: "dn-": 0, 2024-09-11T23:34:56.611 INFO:teuthology.orchestra.run.smithi160.stdout: "cap": 0, 2024-09-11T23:34:56.611 INFO:teuthology.orchestra.run.smithi160.stdout: "cap+": 3, 2024-09-11T23:34:56.611 INFO:teuthology.orchestra.run.smithi160.stdout: "cap-": 3, 2024-09-11T23:34:56.611 INFO:teuthology.orchestra.run.smithi160.stdout: "rss": 50652, 2024-09-11T23:34:56.612 INFO:teuthology.orchestra.run.smithi160.stdout: "heap": 223520 2024-09-11T23:34:56.612 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:56.612 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_server": { 2024-09-11T23:34:56.612 INFO:teuthology.orchestra.run.smithi160.stdout: "dispatch_client_request": 10, 2024-09-11T23:34:56.612 INFO:teuthology.orchestra.run.smithi160.stdout: "dispatch_server_request": 0, 2024-09-11T23:34:56.612 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_client_request": 5, 2024-09-11T23:34:56.612 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_client_session": 21, 2024-09-11T23:34:56.612 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_peer_request": 1, 2024-09-11T23:34:56.612 INFO:teuthology.orchestra.run.smithi160.stdout: "req_create_latency": { 2024-09-11T23:34:56.612 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:34:56.612 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:34:56.612 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:34:56.612 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:56.613 INFO:teuthology.orchestra.run.smithi160.stdout: "req_getattr_latency": { 2024-09-11T23:34:56.613 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 1, 2024-09-11T23:34:56.613 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.001375235, 2024-09-11T23:34:56.613 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.001375235 2024-09-11T23:34:56.613 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:56.613 INFO:teuthology.orchestra.run.smithi160.stdout: "req_getfilelock_latency": { 2024-09-11T23:34:56.613 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:34:56.613 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:34:56.613 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:34:56.613 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:56.613 INFO:teuthology.orchestra.run.smithi160.stdout: "req_link_latency": { 2024-09-11T23:34:56.613 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:34:56.613 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:34:56.614 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:34:56.614 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:56.614 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lookup_latency": { 2024-09-11T23:34:56.614 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 2, 2024-09-11T23:34:56.614 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.001183531, 2024-09-11T23:34:56.614 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000591765 2024-09-11T23:34:56.614 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:56.614 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lookuphash_latency": { 2024-09-11T23:34:56.614 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:34:56.614 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:34:56.614 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:34:56.614 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:56.614 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lookupino_latency": { 2024-09-11T23:34:56.615 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:34:56.615 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:34:56.615 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:34:56.615 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:56.615 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lookupname_latency": { 2024-09-11T23:34:56.615 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:34:56.615 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:34:56.615 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:34:56.615 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:56.615 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lookupparent_latency": { 2024-09-11T23:34:56.615 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:34:56.615 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:34:56.615 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:34:56.615 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:56.616 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lookupsnap_latency": { 2024-09-11T23:34:56.616 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:34:56.616 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:34:56.616 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:34:56.616 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:56.616 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lssnap_latency": { 2024-09-11T23:34:56.616 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:34:56.616 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:34:56.616 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:34:56.616 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:56.616 INFO:teuthology.orchestra.run.smithi160.stdout: "req_mkdir_latency": { 2024-09-11T23:34:56.616 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:34:56.617 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:34:56.617 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:34:56.617 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:56.617 INFO:teuthology.orchestra.run.smithi160.stdout: "req_mknod_latency": { 2024-09-11T23:34:56.618 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:34:56.618 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:34:56.618 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:34:56.618 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:56.618 INFO:teuthology.orchestra.run.smithi160.stdout: "req_mksnap_latency": { 2024-09-11T23:34:56.618 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:34:56.618 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:34:56.618 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:34:56.618 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:56.618 INFO:teuthology.orchestra.run.smithi160.stdout: "req_open_latency": { 2024-09-11T23:34:56.618 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:34:56.618 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:34:56.618 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:34:56.619 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:56.619 INFO:teuthology.orchestra.run.smithi160.stdout: "req_readdir_latency": { 2024-09-11T23:34:56.619 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:34:56.619 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:34:56.619 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:34:56.619 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:56.619 INFO:teuthology.orchestra.run.smithi160.stdout: "req_rename_latency": { 2024-09-11T23:34:56.619 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:34:56.619 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:34:56.619 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:34:56.619 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:56.619 INFO:teuthology.orchestra.run.smithi160.stdout: "req_renamesnap_latency": { 2024-09-11T23:34:56.619 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:34:56.620 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:34:56.620 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:34:56.620 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:56.620 INFO:teuthology.orchestra.run.smithi160.stdout: "req_snapdiff_latency": { 2024-09-11T23:34:56.620 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:34:56.620 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:34:56.620 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:34:56.620 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:56.620 INFO:teuthology.orchestra.run.smithi160.stdout: "req_rmdir_latency": { 2024-09-11T23:34:56.620 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:34:56.620 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:34:56.620 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:34:56.620 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:56.621 INFO:teuthology.orchestra.run.smithi160.stdout: "req_rmsnap_latency": { 2024-09-11T23:34:56.621 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:34:56.621 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:34:56.621 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:34:56.621 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:56.621 INFO:teuthology.orchestra.run.smithi160.stdout: "req_rmxattr_latency": { 2024-09-11T23:34:56.621 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:34:56.621 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:34:56.621 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:34:56.621 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:56.621 INFO:teuthology.orchestra.run.smithi160.stdout: "req_setattr_latency": { 2024-09-11T23:34:56.621 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:34:56.621 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:34:56.622 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:34:56.622 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:56.622 INFO:teuthology.orchestra.run.smithi160.stdout: "req_setdirlayout_latency": { 2024-09-11T23:34:56.622 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:34:56.622 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:34:56.622 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:34:56.622 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:56.622 INFO:teuthology.orchestra.run.smithi160.stdout: "req_setfilelock_latency": { 2024-09-11T23:34:56.622 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:34:56.622 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:34:56.622 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:34:56.622 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:56.623 INFO:teuthology.orchestra.run.smithi160.stdout: "req_setlayout_latency": { 2024-09-11T23:34:56.623 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:34:56.623 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:34:56.623 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:34:56.623 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:56.623 INFO:teuthology.orchestra.run.smithi160.stdout: "req_setxattr_latency": { 2024-09-11T23:34:56.623 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:34:56.623 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:34:56.623 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:34:56.623 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:56.623 INFO:teuthology.orchestra.run.smithi160.stdout: "req_symlink_latency": { 2024-09-11T23:34:56.623 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:34:56.623 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:34:56.624 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:34:56.624 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:56.624 INFO:teuthology.orchestra.run.smithi160.stdout: "req_unlink_latency": { 2024-09-11T23:34:56.624 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:34:56.624 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:34:56.624 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:34:56.624 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:56.624 INFO:teuthology.orchestra.run.smithi160.stdout: "cap_revoke_eviction": 0, 2024-09-11T23:34:56.624 INFO:teuthology.orchestra.run.smithi160.stdout: "cap_acquisition_throttle": 0, 2024-09-11T23:34:56.624 INFO:teuthology.orchestra.run.smithi160.stdout: "req_getvxattr_latency": { 2024-09-11T23:34:56.624 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:34:56.624 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:34:56.624 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:34:56.624 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-11T23:34:56.625 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:56.625 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_sessions": { 2024-09-11T23:34:56.625 INFO:teuthology.orchestra.run.smithi160.stdout: "session_count": 1, 2024-09-11T23:34:56.625 INFO:teuthology.orchestra.run.smithi160.stdout: "session_add": 3, 2024-09-11T23:34:56.625 INFO:teuthology.orchestra.run.smithi160.stdout: "session_remove": 2, 2024-09-11T23:34:56.625 INFO:teuthology.orchestra.run.smithi160.stdout: "sessions_open": 1, 2024-09-11T23:34:56.625 INFO:teuthology.orchestra.run.smithi160.stdout: "sessions_stale": 0, 2024-09-11T23:34:56.625 INFO:teuthology.orchestra.run.smithi160.stdout: "total_load": 2, 2024-09-11T23:34:56.625 INFO:teuthology.orchestra.run.smithi160.stdout: "average_load": 2, 2024-09-11T23:34:56.625 INFO:teuthology.orchestra.run.smithi160.stdout: "avg_session_uptime": 952, 2024-09-11T23:34:56.625 INFO:teuthology.orchestra.run.smithi160.stdout: "mdthresh_evicted": 0 2024-09-11T23:34:56.625 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:56.626 INFO:teuthology.orchestra.run.smithi160.stdout: "mempool": { 2024-09-11T23:34:56.626 INFO:teuthology.orchestra.run.smithi160.stdout: "bloom_filter_bytes": 0, 2024-09-11T23:34:56.626 INFO:teuthology.orchestra.run.smithi160.stdout: "bloom_filter_items": 0, 2024-09-11T23:34:56.626 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_alloc_bytes": 0, 2024-09-11T23:34:56.626 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_alloc_items": 0, 2024-09-11T23:34:56.626 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_data_bytes": 0, 2024-09-11T23:34:56.626 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_data_items": 0, 2024-09-11T23:34:56.626 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-11T23:34:56.626 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_onode_items": 0, 2024-09-11T23:34:56.626 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-11T23:34:56.626 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_meta_items": 0, 2024-09-11T23:34:56.626 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_other_bytes": 0, 2024-09-11T23:34:56.626 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_other_items": 0, 2024-09-11T23:34:56.627 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-11T23:34:56.627 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_buffer_items": 0, 2024-09-11T23:34:56.627 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_extent_bytes": 0, 2024-09-11T23:34:56.627 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_extent_items": 0, 2024-09-11T23:34:56.627 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_blob_bytes": 0, 2024-09-11T23:34:56.627 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_blob_items": 0, 2024-09-11T23:34:56.627 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-11T23:34:56.627 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_shared_blob_items": 0, 2024-09-11T23:34:56.627 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-11T23:34:56.627 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_inline_bl_items": 0, 2024-09-11T23:34:56.627 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_fsck_bytes": 0, 2024-09-11T23:34:56.627 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_fsck_items": 0, 2024-09-11T23:34:56.628 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_txc_bytes": 0, 2024-09-11T23:34:56.628 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_txc_items": 0, 2024-09-11T23:34:56.628 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-11T23:34:56.628 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_writing_deferred_items": 0, 2024-09-11T23:34:56.628 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_writing_bytes": 0, 2024-09-11T23:34:56.628 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_writing_items": 0, 2024-09-11T23:34:56.628 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_bytes": 0, 2024-09-11T23:34:56.628 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_items": 0, 2024-09-11T23:34:56.628 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_file_reader_bytes": 0, 2024-09-11T23:34:56.628 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_file_reader_items": 0, 2024-09-11T23:34:56.628 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_file_writer_bytes": 0, 2024-09-11T23:34:56.628 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_file_writer_items": 0, 2024-09-11T23:34:56.628 INFO:teuthology.orchestra.run.smithi160.stdout: "buffer_anon_bytes": 240693, 2024-09-11T23:34:56.629 INFO:teuthology.orchestra.run.smithi160.stdout: "buffer_anon_items": 84, 2024-09-11T23:34:56.629 INFO:teuthology.orchestra.run.smithi160.stdout: "buffer_meta_bytes": 88, 2024-09-11T23:34:56.629 INFO:teuthology.orchestra.run.smithi160.stdout: "buffer_meta_items": 1, 2024-09-11T23:34:56.629 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_bytes": 0, 2024-09-11T23:34:56.629 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_items": 0, 2024-09-11T23:34:56.629 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_mapbl_bytes": 0, 2024-09-11T23:34:56.629 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_mapbl_items": 0, 2024-09-11T23:34:56.629 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_pglog_bytes": 0, 2024-09-11T23:34:56.629 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_pglog_items": 0, 2024-09-11T23:34:56.629 INFO:teuthology.orchestra.run.smithi160.stdout: "osdmap_bytes": 9336, 2024-09-11T23:34:56.629 INFO:teuthology.orchestra.run.smithi160.stdout: "osdmap_items": 176, 2024-09-11T23:34:56.629 INFO:teuthology.orchestra.run.smithi160.stdout: "osdmap_mapping_bytes": 0, 2024-09-11T23:34:56.629 INFO:teuthology.orchestra.run.smithi160.stdout: "osdmap_mapping_items": 0, 2024-09-11T23:34:56.630 INFO:teuthology.orchestra.run.smithi160.stdout: "pgmap_bytes": 0, 2024-09-11T23:34:56.630 INFO:teuthology.orchestra.run.smithi160.stdout: "pgmap_items": 0, 2024-09-11T23:34:56.630 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_co_bytes": 59360, 2024-09-11T23:34:56.630 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_co_items": 237, 2024-09-11T23:34:56.630 INFO:teuthology.orchestra.run.smithi160.stdout: "unittest_1_bytes": 0, 2024-09-11T23:34:56.630 INFO:teuthology.orchestra.run.smithi160.stdout: "unittest_1_items": 0, 2024-09-11T23:34:56.630 INFO:teuthology.orchestra.run.smithi160.stdout: "unittest_2_bytes": 0, 2024-09-11T23:34:56.630 INFO:teuthology.orchestra.run.smithi160.stdout: "unittest_2_items": 0 2024-09-11T23:34:56.630 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:56.630 INFO:teuthology.orchestra.run.smithi160.stdout: "objecter": { 2024-09-11T23:34:56.630 INFO:teuthology.orchestra.run.smithi160.stdout: "op_active": 0, 2024-09-11T23:34:56.630 INFO:teuthology.orchestra.run.smithi160.stdout: "op_laggy": 0, 2024-09-11T23:34:56.630 INFO:teuthology.orchestra.run.smithi160.stdout: "op_send": 45, 2024-09-11T23:34:56.630 INFO:teuthology.orchestra.run.smithi160.stdout: "op_send_bytes": 12584, 2024-09-11T23:34:56.631 INFO:teuthology.orchestra.run.smithi160.stdout: "op_resend": 33, 2024-09-11T23:34:56.631 INFO:teuthology.orchestra.run.smithi160.stdout: "op_reply": 45, 2024-09-11T23:34:56.631 INFO:teuthology.orchestra.run.smithi160.stdout: "op_latency": { 2024-09-11T23:34:56.631 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 45, 2024-09-11T23:34:56.631 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.240996966, 2024-09-11T23:34:56.631 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.005355488 2024-09-11T23:34:56.631 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:56.631 INFO:teuthology.orchestra.run.smithi160.stdout: "op_inflight": 0, 2024-09-11T23:34:56.631 INFO:teuthology.orchestra.run.smithi160.stdout: "oplen_avg": { 2024-09-11T23:34:56.631 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 45, 2024-09-11T23:34:56.631 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 69 2024-09-11T23:34:56.631 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:56.631 INFO:teuthology.orchestra.run.smithi160.stdout: "op": 45, 2024-09-11T23:34:56.632 INFO:teuthology.orchestra.run.smithi160.stdout: "op_r": 0, 2024-09-11T23:34:56.632 INFO:teuthology.orchestra.run.smithi160.stdout: "op_w": 45, 2024-09-11T23:34:56.632 INFO:teuthology.orchestra.run.smithi160.stdout: "op_rmw": 0, 2024-09-11T23:34:56.632 INFO:teuthology.orchestra.run.smithi160.stdout: "op_pg": 0, 2024-09-11T23:34:56.632 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_stat": 0, 2024-09-11T23:34:56.632 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_create": 10, 2024-09-11T23:34:56.632 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_read": 0, 2024-09-11T23:34:56.632 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_write": 6, 2024-09-11T23:34:56.632 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_writefull": 8, 2024-09-11T23:34:56.632 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_writesame": 0, 2024-09-11T23:34:56.632 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_append": 0, 2024-09-11T23:34:56.632 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_zero": 0, 2024-09-11T23:34:56.632 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_truncate": 0, 2024-09-11T23:34:56.633 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_delete": 6, 2024-09-11T23:34:56.633 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_mapext": 0, 2024-09-11T23:34:56.633 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_sparse_read": 0, 2024-09-11T23:34:56.633 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_clonerange": 0, 2024-09-11T23:34:56.633 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_getxattr": 0, 2024-09-11T23:34:56.633 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_setxattr": 20, 2024-09-11T23:34:56.633 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_cmpxattr": 0, 2024-09-11T23:34:56.633 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_rmxattr": 0, 2024-09-11T23:34:56.633 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_resetxattrs": 0, 2024-09-11T23:34:56.633 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_call": 0, 2024-09-11T23:34:56.633 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_watch": 0, 2024-09-11T23:34:56.633 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_notify": 0, 2024-09-11T23:34:56.633 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_src_cmpxattr": 0, 2024-09-11T23:34:56.634 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_pgls": 0, 2024-09-11T23:34:56.634 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_pgls_filter": 0, 2024-09-11T23:34:56.634 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_other": 0, 2024-09-11T23:34:56.634 INFO:teuthology.orchestra.run.smithi160.stdout: "linger_active": 0, 2024-09-11T23:34:56.634 INFO:teuthology.orchestra.run.smithi160.stdout: "linger_send": 0, 2024-09-11T23:34:56.634 INFO:teuthology.orchestra.run.smithi160.stdout: "linger_resend": 0, 2024-09-11T23:34:56.634 INFO:teuthology.orchestra.run.smithi160.stdout: "linger_ping": 0, 2024-09-11T23:34:56.634 INFO:teuthology.orchestra.run.smithi160.stdout: "poolop_active": 0, 2024-09-11T23:34:56.634 INFO:teuthology.orchestra.run.smithi160.stdout: "poolop_send": 0, 2024-09-11T23:34:56.634 INFO:teuthology.orchestra.run.smithi160.stdout: "poolop_resend": 0, 2024-09-11T23:34:56.634 INFO:teuthology.orchestra.run.smithi160.stdout: "poolstat_active": 0, 2024-09-11T23:34:56.634 INFO:teuthology.orchestra.run.smithi160.stdout: "poolstat_send": 0, 2024-09-11T23:34:56.634 INFO:teuthology.orchestra.run.smithi160.stdout: "poolstat_resend": 0, 2024-09-11T23:34:56.634 INFO:teuthology.orchestra.run.smithi160.stdout: "statfs_active": 0, 2024-09-11T23:34:56.635 INFO:teuthology.orchestra.run.smithi160.stdout: "statfs_send": 0, 2024-09-11T23:34:56.635 INFO:teuthology.orchestra.run.smithi160.stdout: "statfs_resend": 0, 2024-09-11T23:34:56.635 INFO:teuthology.orchestra.run.smithi160.stdout: "command_active": 0, 2024-09-11T23:34:56.635 INFO:teuthology.orchestra.run.smithi160.stdout: "command_send": 0, 2024-09-11T23:34:56.635 INFO:teuthology.orchestra.run.smithi160.stdout: "command_resend": 0, 2024-09-11T23:34:56.635 INFO:teuthology.orchestra.run.smithi160.stdout: "map_epoch": 95, 2024-09-11T23:34:56.635 INFO:teuthology.orchestra.run.smithi160.stdout: "map_full": 0, 2024-09-11T23:34:56.635 INFO:teuthology.orchestra.run.smithi160.stdout: "map_inc": 2, 2024-09-11T23:34:56.635 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_sessions": 9, 2024-09-11T23:34:56.635 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_session_open": 13, 2024-09-11T23:34:56.635 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_session_close": 4, 2024-09-11T23:34:56.635 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_laggy": 0, 2024-09-11T23:34:56.635 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_wr": 17, 2024-09-11T23:34:56.635 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_rd": 0, 2024-09-11T23:34:56.636 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_del": 2 2024-09-11T23:34:56.636 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:56.636 INFO:teuthology.orchestra.run.smithi160.stdout: "oft": { 2024-09-11T23:34:56.636 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_total_objs": 1, 2024-09-11T23:34:56.636 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_total_kv_pairs": 0, 2024-09-11T23:34:56.636 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_total_updates": 0, 2024-09-11T23:34:56.636 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_total_removes": 0 2024-09-11T23:34:56.636 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:56.636 INFO:teuthology.orchestra.run.smithi160.stdout: "osd-slow-ops": { 2024-09-11T23:34:56.636 INFO:teuthology.orchestra.run.smithi160.stdout: "slow_ops_count": 0 2024-09-11T23:34:56.636 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:56.636 INFO:teuthology.orchestra.run.smithi160.stdout: "purge_queue": { 2024-09-11T23:34:56.637 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_executing_ops": 0, 2024-09-11T23:34:56.637 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_executing_ops_high_water": 0, 2024-09-11T23:34:56.637 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_executing": 0, 2024-09-11T23:34:56.637 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_executing_high_water": 0, 2024-09-11T23:34:56.637 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_executed_ops": 0, 2024-09-11T23:34:56.637 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_executed": 0, 2024-09-11T23:34:56.637 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_item_in_journal": 0 2024-09-11T23:34:56.637 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:56.637 INFO:teuthology.orchestra.run.smithi160.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-11T23:34:56.637 INFO:teuthology.orchestra.run.smithi160.stdout: "val": 0, 2024-09-11T23:34:56.637 INFO:teuthology.orchestra.run.smithi160.stdout: "max": 104857600, 2024-09-11T23:34:56.637 INFO:teuthology.orchestra.run.smithi160.stdout: "get_started": 0, 2024-09-11T23:34:56.637 INFO:teuthology.orchestra.run.smithi160.stdout: "get": 834, 2024-09-11T23:34:56.637 INFO:teuthology.orchestra.run.smithi160.stdout: "get_sum": 844110, 2024-09-11T23:34:56.638 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_fail": 0, 2024-09-11T23:34:56.638 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_success": 834, 2024-09-11T23:34:56.638 INFO:teuthology.orchestra.run.smithi160.stdout: "take": 0, 2024-09-11T23:34:56.638 INFO:teuthology.orchestra.run.smithi160.stdout: "take_sum": 0, 2024-09-11T23:34:56.638 INFO:teuthology.orchestra.run.smithi160.stdout: "put": 834, 2024-09-11T23:34:56.638 INFO:teuthology.orchestra.run.smithi160.stdout: "put_sum": 844110, 2024-09-11T23:34:56.638 INFO:teuthology.orchestra.run.smithi160.stdout: "wait": { 2024-09-11T23:34:56.638 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:34:56.638 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:34:56.638 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:34:56.638 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-11T23:34:56.639 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:56.639 INFO:teuthology.orchestra.run.smithi160.stdout: "throttle-objecter_bytes": { 2024-09-11T23:34:56.639 INFO:teuthology.orchestra.run.smithi160.stdout: "val": 0, 2024-09-11T23:34:56.639 INFO:teuthology.orchestra.run.smithi160.stdout: "max": 104857600, 2024-09-11T23:34:56.639 INFO:teuthology.orchestra.run.smithi160.stdout: "get_started": 0, 2024-09-11T23:34:56.639 INFO:teuthology.orchestra.run.smithi160.stdout: "get": 0, 2024-09-11T23:34:56.639 INFO:teuthology.orchestra.run.smithi160.stdout: "get_sum": 0, 2024-09-11T23:34:56.639 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_fail": 0, 2024-09-11T23:34:56.639 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_success": 0, 2024-09-11T23:34:56.639 INFO:teuthology.orchestra.run.smithi160.stdout: "take": 45, 2024-09-11T23:34:56.639 INFO:teuthology.orchestra.run.smithi160.stdout: "take_sum": 12584, 2024-09-11T23:34:56.639 INFO:teuthology.orchestra.run.smithi160.stdout: "put": 45, 2024-09-11T23:34:56.639 INFO:teuthology.orchestra.run.smithi160.stdout: "put_sum": 12584, 2024-09-11T23:34:56.640 INFO:teuthology.orchestra.run.smithi160.stdout: "wait": { 2024-09-11T23:34:56.640 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:34:56.640 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:34:56.640 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:34:56.640 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-11T23:34:56.640 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:56.640 INFO:teuthology.orchestra.run.smithi160.stdout: "throttle-objecter_ops": { 2024-09-11T23:34:56.640 INFO:teuthology.orchestra.run.smithi160.stdout: "val": 0, 2024-09-11T23:34:56.640 INFO:teuthology.orchestra.run.smithi160.stdout: "max": 1024, 2024-09-11T23:34:56.640 INFO:teuthology.orchestra.run.smithi160.stdout: "get_started": 0, 2024-09-11T23:34:56.640 INFO:teuthology.orchestra.run.smithi160.stdout: "get": 0, 2024-09-11T23:34:56.640 INFO:teuthology.orchestra.run.smithi160.stdout: "get_sum": 0, 2024-09-11T23:34:56.641 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_fail": 0, 2024-09-11T23:34:56.641 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_success": 0, 2024-09-11T23:34:56.641 INFO:teuthology.orchestra.run.smithi160.stdout: "take": 45, 2024-09-11T23:34:56.641 INFO:teuthology.orchestra.run.smithi160.stdout: "take_sum": 45, 2024-09-11T23:34:56.641 INFO:teuthology.orchestra.run.smithi160.stdout: "put": 45, 2024-09-11T23:34:56.641 INFO:teuthology.orchestra.run.smithi160.stdout: "put_sum": 45, 2024-09-11T23:34:56.641 INFO:teuthology.orchestra.run.smithi160.stdout: "wait": { 2024-09-11T23:34:56.641 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:34:56.641 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:34:56.641 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:34:56.641 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-11T23:34:56.641 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:56.641 INFO:teuthology.orchestra.run.smithi160.stdout: "throttle-write_buf_throttle": { 2024-09-11T23:34:56.641 INFO:teuthology.orchestra.run.smithi160.stdout: "val": 0, 2024-09-11T23:34:56.642 INFO:teuthology.orchestra.run.smithi160.stdout: "max": 3758096384, 2024-09-11T23:34:56.642 INFO:teuthology.orchestra.run.smithi160.stdout: "get_started": 0, 2024-09-11T23:34:56.642 INFO:teuthology.orchestra.run.smithi160.stdout: "get": 0, 2024-09-11T23:34:56.642 INFO:teuthology.orchestra.run.smithi160.stdout: "get_sum": 0, 2024-09-11T23:34:56.642 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_fail": 0, 2024-09-11T23:34:56.642 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_success": 0, 2024-09-11T23:34:56.642 INFO:teuthology.orchestra.run.smithi160.stdout: "take": 0, 2024-09-11T23:34:56.643 INFO:teuthology.orchestra.run.smithi160.stdout: "take_sum": 0, 2024-09-11T23:34:56.643 INFO:teuthology.orchestra.run.smithi160.stdout: "put": 0, 2024-09-11T23:34:56.644 INFO:teuthology.orchestra.run.smithi160.stdout: "put_sum": 0, 2024-09-11T23:34:56.644 INFO:teuthology.orchestra.run.smithi160.stdout: "wait": { 2024-09-11T23:34:56.644 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:34:56.644 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:34:56.644 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:34:56.644 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-11T23:34:56.644 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:56.644 INFO:teuthology.orchestra.run.smithi160.stdout: "throttle-write_buf_throttle-0x559b8cd3a960": { 2024-09-11T23:34:56.644 INFO:teuthology.orchestra.run.smithi160.stdout: "val": 0, 2024-09-11T23:34:56.644 INFO:teuthology.orchestra.run.smithi160.stdout: "max": 3758096384, 2024-09-11T23:34:56.644 INFO:teuthology.orchestra.run.smithi160.stdout: "get_started": 0, 2024-09-11T23:34:56.644 INFO:teuthology.orchestra.run.smithi160.stdout: "get": 7, 2024-09-11T23:34:56.644 INFO:teuthology.orchestra.run.smithi160.stdout: "get_sum": 1967, 2024-09-11T23:34:56.645 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_fail": 0, 2024-09-11T23:34:56.645 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_success": 7, 2024-09-11T23:34:56.645 INFO:teuthology.orchestra.run.smithi160.stdout: "take": 0, 2024-09-11T23:34:56.645 INFO:teuthology.orchestra.run.smithi160.stdout: "take_sum": 0, 2024-09-11T23:34:56.645 INFO:teuthology.orchestra.run.smithi160.stdout: "put": 6, 2024-09-11T23:34:56.645 INFO:teuthology.orchestra.run.smithi160.stdout: "put_sum": 1967, 2024-09-11T23:34:56.645 INFO:teuthology.orchestra.run.smithi160.stdout: "wait": { 2024-09-11T23:34:56.645 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:34:56.645 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:34:56.645 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:34:56.645 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-11T23:34:56.645 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-11T23:34:56.645 INFO:teuthology.orchestra.run.smithi160.stdout:} 2024-09-11T23:34:57.559 INFO:tasks.check_counter:Daemon mds.c mds.exported=0 2024-09-11T23:34:57.559 INFO:tasks.check_counter:Daemon mds.c mds.imported=0 2024-09-11T23:34:57.559 DEBUG:tasks.check_counter:Getting stats from f 2024-09-11T23:34:57.560 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph daemon mds.f perf dump 2024-09-11T23:34:57.808 INFO:teuthology.orchestra.run.smithi160.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T23:34:58.107 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:34:57 smithi160 ceph-mon[35055]: pgmap v867: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 2.2 KiB/s wr, 12 op/s 2024-09-11T23:34:58.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:34:57 smithi123 ceph-mon[35438]: pgmap v867: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 2.2 KiB/s wr, 12 op/s 2024-09-11T23:34:58.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:34:57 smithi037 ceph-mon[30630]: pgmap v867: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 2.2 KiB/s wr, 12 op/s 2024-09-11T23:34:58.374 INFO:teuthology.orchestra.run.smithi160.stdout:{ 2024-09-11T23:34:58.374 INFO:teuthology.orchestra.run.smithi160.stdout: "AsyncMessenger::Worker-0": { 2024-09-11T23:34:58.374 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_messages": 290, 2024-09-11T23:34:58.375 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages": 584, 2024-09-11T23:34:58.375 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_bytes": 55857, 2024-09-11T23:34:58.375 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_bytes": 102839, 2024-09-11T23:34:58.375 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_created_connections": 9, 2024-09-11T23:34:58.375 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_active_connections": 3, 2024-09-11T23:34:58.375 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_total_time": 0.047676761, 2024-09-11T23:34:58.375 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_send_time": 0.017764861, 2024-09-11T23:34:58.375 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_recv_time": 0.018646505, 2024-09-11T23:34:58.375 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_fast_dispatch_time": 0.005719807, 2024-09-11T23:34:58.375 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T23:34:58.375 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 582, 2024-09-11T23:34:58.376 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.046056311, 2024-09-11T23:34:58.376 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000079134 2024-09-11T23:34:58.376 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:58.376 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_handle_ack_lat": { 2024-09-11T23:34:58.376 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 841, 2024-09-11T23:34:58.376 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000218199, 2024-09-11T23:34:58.376 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000259 2024-09-11T23:34:58.376 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:58.376 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-11T23:34:58.376 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_encrypted_bytes": 0 2024-09-11T23:34:58.376 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:58.376 INFO:teuthology.orchestra.run.smithi160.stdout: "AsyncMessenger::Worker-1": { 2024-09-11T23:34:58.376 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_messages": 17, 2024-09-11T23:34:58.377 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages": 250, 2024-09-11T23:34:58.377 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_bytes": 4043, 2024-09-11T23:34:58.377 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_bytes": 600022, 2024-09-11T23:34:58.377 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_created_connections": 14, 2024-09-11T23:34:58.377 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_active_connections": 3, 2024-09-11T23:34:58.377 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_total_time": 0.017225783, 2024-09-11T23:34:58.377 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_send_time": 0.010056817, 2024-09-11T23:34:58.377 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_recv_time": 0.004858327, 2024-09-11T23:34:58.377 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_fast_dispatch_time": 0.000191090, 2024-09-11T23:34:58.377 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T23:34:58.377 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 248, 2024-09-11T23:34:58.377 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.029454042, 2024-09-11T23:34:58.377 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000118766 2024-09-11T23:34:58.378 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:58.378 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_handle_ack_lat": { 2024-09-11T23:34:58.378 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 9, 2024-09-11T23:34:58.378 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000001032, 2024-09-11T23:34:58.378 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000114 2024-09-11T23:34:58.378 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:58.378 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_encrypted_bytes": 1248, 2024-09-11T23:34:58.378 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_encrypted_bytes": 565536 2024-09-11T23:34:58.378 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:58.378 INFO:teuthology.orchestra.run.smithi160.stdout: "AsyncMessenger::Worker-2": { 2024-09-11T23:34:58.378 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_messages": 375, 2024-09-11T23:34:58.378 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages": 364, 2024-09-11T23:34:58.379 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_bytes": 831583, 2024-09-11T23:34:58.379 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_bytes": 228491, 2024-09-11T23:34:58.379 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_created_connections": 8, 2024-09-11T23:34:58.379 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_active_connections": 4, 2024-09-11T23:34:58.379 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_total_time": 0.046900089, 2024-09-11T23:34:58.379 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_send_time": 0.018891635, 2024-09-11T23:34:58.379 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_recv_time": 0.036369107, 2024-09-11T23:34:58.379 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_fast_dispatch_time": 0.000302670, 2024-09-11T23:34:58.379 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T23:34:58.379 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 364, 2024-09-11T23:34:58.379 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.039186114, 2024-09-11T23:34:58.379 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000107654 2024-09-11T23:34:58.380 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:58.380 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_handle_ack_lat": { 2024-09-11T23:34:58.380 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 2, 2024-09-11T23:34:58.380 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000177, 2024-09-11T23:34:58.380 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000088 2024-09-11T23:34:58.380 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:58.380 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_encrypted_bytes": 827216, 2024-09-11T23:34:58.380 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_encrypted_bytes": 196432 2024-09-11T23:34:58.380 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:58.380 INFO:teuthology.orchestra.run.smithi160.stdout: "cct": { 2024-09-11T23:34:58.380 INFO:teuthology.orchestra.run.smithi160.stdout: "total_workers": 1, 2024-09-11T23:34:58.380 INFO:teuthology.orchestra.run.smithi160.stdout: "unhealthy_workers": 0 2024-09-11T23:34:58.381 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:58.381 INFO:teuthology.orchestra.run.smithi160.stdout: "finisher-MDSRank": { 2024-09-11T23:34:58.381 INFO:teuthology.orchestra.run.smithi160.stdout: "queue_len": 0, 2024-09-11T23:34:58.381 INFO:teuthology.orchestra.run.smithi160.stdout: "complete_latency": { 2024-09-11T23:34:58.381 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 48, 2024-09-11T23:34:58.381 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.001135224, 2024-09-11T23:34:58.381 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000023650 2024-09-11T23:34:58.381 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-11T23:34:58.381 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:58.381 INFO:teuthology.orchestra.run.smithi160.stdout: "finisher-PurgeQueue": { 2024-09-11T23:34:58.381 INFO:teuthology.orchestra.run.smithi160.stdout: "queue_len": 0, 2024-09-11T23:34:58.381 INFO:teuthology.orchestra.run.smithi160.stdout: "complete_latency": { 2024-09-11T23:34:58.381 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 2, 2024-09-11T23:34:58.382 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000018700, 2024-09-11T23:34:58.382 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000009350 2024-09-11T23:34:58.382 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-11T23:34:58.382 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:58.382 INFO:teuthology.orchestra.run.smithi160.stdout: "mds": { 2024-09-11T23:34:58.382 INFO:teuthology.orchestra.run.smithi160.stdout: "request": 0, 2024-09-11T23:34:58.382 INFO:teuthology.orchestra.run.smithi160.stdout: "reply": 0, 2024-09-11T23:34:58.382 INFO:teuthology.orchestra.run.smithi160.stdout: "reply_latency": { 2024-09-11T23:34:58.382 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:34:58.382 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:34:58.382 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:34:58.382 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:58.382 INFO:teuthology.orchestra.run.smithi160.stdout: "slow_reply": 0, 2024-09-11T23:34:58.383 INFO:teuthology.orchestra.run.smithi160.stdout: "forward": 0, 2024-09-11T23:34:58.383 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_fetch_complete": 0, 2024-09-11T23:34:58.383 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_fetch_keys": 0, 2024-09-11T23:34:58.383 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_commit": 11, 2024-09-11T23:34:58.383 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_split": 0, 2024-09-11T23:34:58.383 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_merge": 0, 2024-09-11T23:34:58.383 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes": 10, 2024-09-11T23:34:58.383 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes_top": 0, 2024-09-11T23:34:58.383 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes_bottom": 10, 2024-09-11T23:34:58.383 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes_pin_tail": 0, 2024-09-11T23:34:58.383 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes_pinned": 10, 2024-09-11T23:34:58.384 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes_expired": 0, 2024-09-11T23:34:58.384 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes_with_caps": 0, 2024-09-11T23:34:58.384 INFO:teuthology.orchestra.run.smithi160.stdout: "caps": 0, 2024-09-11T23:34:58.384 INFO:teuthology.orchestra.run.smithi160.stdout: "subtrees": 1, 2024-09-11T23:34:58.384 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse": 0, 2024-09-11T23:34:58.384 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse_hit": 0, 2024-09-11T23:34:58.384 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse_forward": 0, 2024-09-11T23:34:58.384 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse_discover": 0, 2024-09-11T23:34:58.384 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse_dir_fetch": 0, 2024-09-11T23:34:58.384 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse_remote_ino": 0, 2024-09-11T23:34:58.385 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse_lock": 0, 2024-09-11T23:34:58.385 INFO:teuthology.orchestra.run.smithi160.stdout: "load_cent": 0, 2024-09-11T23:34:58.385 INFO:teuthology.orchestra.run.smithi160.stdout: "q": 0, 2024-09-11T23:34:58.385 INFO:teuthology.orchestra.run.smithi160.stdout: "exported": 0, 2024-09-11T23:34:58.385 INFO:teuthology.orchestra.run.smithi160.stdout: "exported_inodes": 0, 2024-09-11T23:34:58.385 INFO:teuthology.orchestra.run.smithi160.stdout: "imported": 0, 2024-09-11T23:34:58.385 INFO:teuthology.orchestra.run.smithi160.stdout: "imported_inodes": 0, 2024-09-11T23:34:58.385 INFO:teuthology.orchestra.run.smithi160.stdout: "openino_dir_fetch": 0, 2024-09-11T23:34:58.385 INFO:teuthology.orchestra.run.smithi160.stdout: "openino_backtrace_fetch": 0, 2024-09-11T23:34:58.386 INFO:teuthology.orchestra.run.smithi160.stdout: "openino_peer_discover": 0, 2024-09-11T23:34:58.386 INFO:teuthology.orchestra.run.smithi160.stdout: "root_rfiles": 1022, 2024-09-11T23:34:58.386 INFO:teuthology.orchestra.run.smithi160.stdout: "root_rbytes": 1586967590, 2024-09-11T23:34:58.386 INFO:teuthology.orchestra.run.smithi160.stdout: "root_rsnaps": 0, 2024-09-11T23:34:58.386 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_backtrace_fetch": 0, 2024-09-11T23:34:58.386 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_set_tag": 0, 2024-09-11T23:34:58.386 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_backtrace_repaired": 0, 2024-09-11T23:34:58.386 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_inotable_repaired": 0, 2024-09-11T23:34:58.386 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_dir_inodes": 0, 2024-09-11T23:34:58.386 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_dir_base_inodes": 0, 2024-09-11T23:34:58.386 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_dirfrag_rstats": 0, 2024-09-11T23:34:58.387 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_file_inodes": 0, 2024-09-11T23:34:58.387 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_inode_file_caps": 0, 2024-09-11T23:34:58.387 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_cap_op_revoke": 0, 2024-09-11T23:34:58.387 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_cap_op_grant": 0, 2024-09-11T23:34:58.387 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_cap_op_trunc": 0, 2024-09-11T23:34:58.387 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-11T23:34:58.387 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-11T23:34:58.387 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_client_caps": 0, 2024-09-11T23:34:58.387 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_client_caps_dirty": 0, 2024-09-11T23:34:58.387 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_client_cap_release": 0, 2024-09-11T23:34:58.387 INFO:teuthology.orchestra.run.smithi160.stdout: "process_request_cap_release": 0 2024-09-11T23:34:58.387 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:58.388 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_cache": { 2024-09-11T23:34:58.388 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_update": 0, 2024-09-11T23:34:58.388 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_update_receipt": 0, 2024-09-11T23:34:58.388 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_try_discover": 0, 2024-09-11T23:34:58.388 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_send_discover": 1, 2024-09-11T23:34:58.388 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_handle_discover": 0, 2024-09-11T23:34:58.388 INFO:teuthology.orchestra.run.smithi160.stdout: "num_strays": 0, 2024-09-11T23:34:58.388 INFO:teuthology.orchestra.run.smithi160.stdout: "num_strays_delayed": 0, 2024-09-11T23:34:58.388 INFO:teuthology.orchestra.run.smithi160.stdout: "num_strays_enqueuing": 0, 2024-09-11T23:34:58.388 INFO:teuthology.orchestra.run.smithi160.stdout: "strays_created": 0, 2024-09-11T23:34:58.388 INFO:teuthology.orchestra.run.smithi160.stdout: "strays_enqueued": 0, 2024-09-11T23:34:58.388 INFO:teuthology.orchestra.run.smithi160.stdout: "strays_reintegrated": 0, 2024-09-11T23:34:58.389 INFO:teuthology.orchestra.run.smithi160.stdout: "strays_migrated": 0, 2024-09-11T23:34:58.389 INFO:teuthology.orchestra.run.smithi160.stdout: "num_recovering_processing": 0, 2024-09-11T23:34:58.389 INFO:teuthology.orchestra.run.smithi160.stdout: "num_recovering_enqueued": 0, 2024-09-11T23:34:58.389 INFO:teuthology.orchestra.run.smithi160.stdout: "num_recovering_prioritized": 0, 2024-09-11T23:34:58.389 INFO:teuthology.orchestra.run.smithi160.stdout: "recovery_started": 0, 2024-09-11T23:34:58.389 INFO:teuthology.orchestra.run.smithi160.stdout: "recovery_completed": 0, 2024-09-11T23:34:58.389 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_quiesce_path": 0, 2024-09-11T23:34:58.389 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_quiesce_inode": 0, 2024-09-11T23:34:58.389 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_enqueue_scrub": 0, 2024-09-11T23:34:58.389 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_exportdir": 0, 2024-09-11T23:34:58.389 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_flush": 0, 2024-09-11T23:34:58.389 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_fragmentdir": 0, 2024-09-11T23:34:58.389 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_fragstats": 0, 2024-09-11T23:34:58.390 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_inodestats": 0 2024-09-11T23:34:58.390 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:58.390 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_log": { 2024-09-11T23:34:58.390 INFO:teuthology.orchestra.run.smithi160.stdout: "evlrg": 0, 2024-09-11T23:34:58.390 INFO:teuthology.orchestra.run.smithi160.stdout: "evadd": 4, 2024-09-11T23:34:58.390 INFO:teuthology.orchestra.run.smithi160.stdout: "evex": 0, 2024-09-11T23:34:58.390 INFO:teuthology.orchestra.run.smithi160.stdout: "evtrm": 0, 2024-09-11T23:34:58.390 INFO:teuthology.orchestra.run.smithi160.stdout: "ev": 4, 2024-09-11T23:34:58.390 INFO:teuthology.orchestra.run.smithi160.stdout: "evexg": 0, 2024-09-11T23:34:58.390 INFO:teuthology.orchestra.run.smithi160.stdout: "evexd": 0, 2024-09-11T23:34:58.390 INFO:teuthology.orchestra.run.smithi160.stdout: "segadd": 2, 2024-09-11T23:34:58.390 INFO:teuthology.orchestra.run.smithi160.stdout: "segex": 0, 2024-09-11T23:34:58.390 INFO:teuthology.orchestra.run.smithi160.stdout: "segtrm": 0, 2024-09-11T23:34:58.391 INFO:teuthology.orchestra.run.smithi160.stdout: "seg": 2, 2024-09-11T23:34:58.391 INFO:teuthology.orchestra.run.smithi160.stdout: "segmjr": 2, 2024-09-11T23:34:58.391 INFO:teuthology.orchestra.run.smithi160.stdout: "segexg": 0, 2024-09-11T23:34:58.391 INFO:teuthology.orchestra.run.smithi160.stdout: "segexd": 0, 2024-09-11T23:34:58.391 INFO:teuthology.orchestra.run.smithi160.stdout: "expos": 4194304, 2024-09-11T23:34:58.391 INFO:teuthology.orchestra.run.smithi160.stdout: "wrpos": 4195426, 2024-09-11T23:34:58.391 INFO:teuthology.orchestra.run.smithi160.stdout: "rdpos": 0, 2024-09-11T23:34:58.391 INFO:teuthology.orchestra.run.smithi160.stdout: "jlat": { 2024-09-11T23:34:58.391 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 3, 2024-09-11T23:34:58.391 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.005674707, 2024-09-11T23:34:58.391 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.001891569 2024-09-11T23:34:58.391 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:58.391 INFO:teuthology.orchestra.run.smithi160.stdout: "replayed": 0 2024-09-11T23:34:58.391 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:58.392 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_mem": { 2024-09-11T23:34:58.392 INFO:teuthology.orchestra.run.smithi160.stdout: "ino": 13, 2024-09-11T23:34:58.392 INFO:teuthology.orchestra.run.smithi160.stdout: "ino+": 13, 2024-09-11T23:34:58.392 INFO:teuthology.orchestra.run.smithi160.stdout: "ino-": 0, 2024-09-11T23:34:58.392 INFO:teuthology.orchestra.run.smithi160.stdout: "dir": 11, 2024-09-11T23:34:58.392 INFO:teuthology.orchestra.run.smithi160.stdout: "dir+": 12, 2024-09-11T23:34:58.392 INFO:teuthology.orchestra.run.smithi160.stdout: "dir-": 1, 2024-09-11T23:34:58.392 INFO:teuthology.orchestra.run.smithi160.stdout: "dn": 10, 2024-09-11T23:34:58.392 INFO:teuthology.orchestra.run.smithi160.stdout: "dn+": 10, 2024-09-11T23:34:58.392 INFO:teuthology.orchestra.run.smithi160.stdout: "dn-": 0, 2024-09-11T23:34:58.392 INFO:teuthology.orchestra.run.smithi160.stdout: "cap": 0, 2024-09-11T23:34:58.392 INFO:teuthology.orchestra.run.smithi160.stdout: "cap+": 0, 2024-09-11T23:34:58.392 INFO:teuthology.orchestra.run.smithi160.stdout: "cap-": 0, 2024-09-11T23:34:58.393 INFO:teuthology.orchestra.run.smithi160.stdout: "rss": 49084, 2024-09-11T23:34:58.393 INFO:teuthology.orchestra.run.smithi160.stdout: "heap": 223520 2024-09-11T23:34:58.393 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:58.393 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_server": { 2024-09-11T23:34:58.393 INFO:teuthology.orchestra.run.smithi160.stdout: "dispatch_client_request": 0, 2024-09-11T23:34:58.393 INFO:teuthology.orchestra.run.smithi160.stdout: "dispatch_server_request": 0, 2024-09-11T23:34:58.393 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_client_request": 0, 2024-09-11T23:34:58.393 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_client_session": 4, 2024-09-11T23:34:58.393 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_peer_request": 0, 2024-09-11T23:34:58.393 INFO:teuthology.orchestra.run.smithi160.stdout: "req_create_latency": { 2024-09-11T23:34:58.394 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:34:58.394 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:34:58.394 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:34:58.394 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:58.394 INFO:teuthology.orchestra.run.smithi160.stdout: "req_getattr_latency": { 2024-09-11T23:34:58.394 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:34:58.394 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:34:58.394 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:34:58.394 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:58.394 INFO:teuthology.orchestra.run.smithi160.stdout: "req_getfilelock_latency": { 2024-09-11T23:34:58.394 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:34:58.394 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:34:58.394 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:34:58.394 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:58.395 INFO:teuthology.orchestra.run.smithi160.stdout: "req_link_latency": { 2024-09-11T23:34:58.395 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:34:58.395 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:34:58.395 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:34:58.395 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:58.395 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lookup_latency": { 2024-09-11T23:34:58.395 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:34:58.395 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:34:58.395 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:34:58.396 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:58.396 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lookuphash_latency": { 2024-09-11T23:34:58.396 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:34:58.396 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:34:58.396 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:34:58.396 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:58.396 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lookupino_latency": { 2024-09-11T23:34:58.396 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:34:58.396 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:34:58.396 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:34:58.396 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:58.396 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lookupname_latency": { 2024-09-11T23:34:58.396 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:34:58.397 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:34:58.397 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:34:58.397 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:58.397 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lookupparent_latency": { 2024-09-11T23:34:58.397 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:34:58.397 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:34:58.397 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:34:58.397 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:58.397 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lookupsnap_latency": { 2024-09-11T23:34:58.397 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:34:58.397 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:34:58.397 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:34:58.398 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:58.398 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lssnap_latency": { 2024-09-11T23:34:58.398 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:34:58.398 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:34:58.398 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:34:58.398 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:58.398 INFO:teuthology.orchestra.run.smithi160.stdout: "req_mkdir_latency": { 2024-09-11T23:34:58.398 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:34:58.398 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:34:58.398 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:34:58.398 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:58.398 INFO:teuthology.orchestra.run.smithi160.stdout: "req_mknod_latency": { 2024-09-11T23:34:58.399 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:34:58.399 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:34:58.399 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:34:58.399 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:58.399 INFO:teuthology.orchestra.run.smithi160.stdout: "req_mksnap_latency": { 2024-09-11T23:34:58.399 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:34:58.399 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:34:58.399 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:34:58.399 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:58.399 INFO:teuthology.orchestra.run.smithi160.stdout: "req_open_latency": { 2024-09-11T23:34:58.399 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:34:58.399 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:34:58.399 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:34:58.400 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:58.400 INFO:teuthology.orchestra.run.smithi160.stdout: "req_readdir_latency": { 2024-09-11T23:34:58.400 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:34:58.400 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:34:58.400 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:34:58.400 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:58.400 INFO:teuthology.orchestra.run.smithi160.stdout: "req_rename_latency": { 2024-09-11T23:34:58.400 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:34:58.400 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:34:58.400 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:34:58.400 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:58.400 INFO:teuthology.orchestra.run.smithi160.stdout: "req_renamesnap_latency": { 2024-09-11T23:34:58.400 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:34:58.401 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:34:58.401 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:34:58.401 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:58.401 INFO:teuthology.orchestra.run.smithi160.stdout: "req_snapdiff_latency": { 2024-09-11T23:34:58.401 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:34:58.401 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:34:58.401 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:34:58.401 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:58.401 INFO:teuthology.orchestra.run.smithi160.stdout: "req_rmdir_latency": { 2024-09-11T23:34:58.401 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:34:58.401 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:34:58.401 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:34:58.401 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:58.402 INFO:teuthology.orchestra.run.smithi160.stdout: "req_rmsnap_latency": { 2024-09-11T23:34:58.402 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:34:58.402 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:34:58.402 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:34:58.402 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:58.402 INFO:teuthology.orchestra.run.smithi160.stdout: "req_rmxattr_latency": { 2024-09-11T23:34:58.402 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:34:58.402 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:34:58.402 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:34:58.402 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:58.402 INFO:teuthology.orchestra.run.smithi160.stdout: "req_setattr_latency": { 2024-09-11T23:34:58.402 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:34:58.402 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:34:58.402 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:34:58.403 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:58.403 INFO:teuthology.orchestra.run.smithi160.stdout: "req_setdirlayout_latency": { 2024-09-11T23:34:58.403 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:34:58.403 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:34:58.403 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:34:58.403 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:58.403 INFO:teuthology.orchestra.run.smithi160.stdout: "req_setfilelock_latency": { 2024-09-11T23:34:58.403 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:34:58.403 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:34:58.403 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:34:58.403 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:58.403 INFO:teuthology.orchestra.run.smithi160.stdout: "req_setlayout_latency": { 2024-09-11T23:34:58.403 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:34:58.404 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:34:58.404 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:34:58.404 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:58.404 INFO:teuthology.orchestra.run.smithi160.stdout: "req_setxattr_latency": { 2024-09-11T23:34:58.404 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:34:58.404 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:34:58.404 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:34:58.404 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:58.404 INFO:teuthology.orchestra.run.smithi160.stdout: "req_symlink_latency": { 2024-09-11T23:34:58.404 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:34:58.404 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:34:58.404 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:34:58.405 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:58.405 INFO:teuthology.orchestra.run.smithi160.stdout: "req_unlink_latency": { 2024-09-11T23:34:58.405 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:34:58.405 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:34:58.405 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:34:58.405 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:58.405 INFO:teuthology.orchestra.run.smithi160.stdout: "cap_revoke_eviction": 0, 2024-09-11T23:34:58.405 INFO:teuthology.orchestra.run.smithi160.stdout: "cap_acquisition_throttle": 0, 2024-09-11T23:34:58.405 INFO:teuthology.orchestra.run.smithi160.stdout: "req_getvxattr_latency": { 2024-09-11T23:34:58.405 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:34:58.405 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:34:58.405 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:34:58.405 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-11T23:34:58.406 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:58.406 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_sessions": { 2024-09-11T23:34:58.406 INFO:teuthology.orchestra.run.smithi160.stdout: "session_count": 0, 2024-09-11T23:34:58.406 INFO:teuthology.orchestra.run.smithi160.stdout: "session_add": 1, 2024-09-11T23:34:58.406 INFO:teuthology.orchestra.run.smithi160.stdout: "session_remove": 1, 2024-09-11T23:34:58.406 INFO:teuthology.orchestra.run.smithi160.stdout: "sessions_open": 0, 2024-09-11T23:34:58.406 INFO:teuthology.orchestra.run.smithi160.stdout: "sessions_stale": 0, 2024-09-11T23:34:58.406 INFO:teuthology.orchestra.run.smithi160.stdout: "total_load": 0, 2024-09-11T23:34:58.406 INFO:teuthology.orchestra.run.smithi160.stdout: "average_load": 0, 2024-09-11T23:34:58.407 INFO:teuthology.orchestra.run.smithi160.stdout: "avg_session_uptime": 74, 2024-09-11T23:34:58.407 INFO:teuthology.orchestra.run.smithi160.stdout: "mdthresh_evicted": 0 2024-09-11T23:34:58.407 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:58.407 INFO:teuthology.orchestra.run.smithi160.stdout: "mempool": { 2024-09-11T23:34:58.407 INFO:teuthology.orchestra.run.smithi160.stdout: "bloom_filter_bytes": 0, 2024-09-11T23:34:58.407 INFO:teuthology.orchestra.run.smithi160.stdout: "bloom_filter_items": 0, 2024-09-11T23:34:58.407 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_alloc_bytes": 0, 2024-09-11T23:34:58.407 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_alloc_items": 0, 2024-09-11T23:34:58.407 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_data_bytes": 0, 2024-09-11T23:34:58.407 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_data_items": 0, 2024-09-11T23:34:58.407 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-11T23:34:58.407 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_onode_items": 0, 2024-09-11T23:34:58.407 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-11T23:34:58.407 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_meta_items": 0, 2024-09-11T23:34:58.408 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_other_bytes": 0, 2024-09-11T23:34:58.408 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_other_items": 0, 2024-09-11T23:34:58.408 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-11T23:34:58.408 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_buffer_items": 0, 2024-09-11T23:34:58.408 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_extent_bytes": 0, 2024-09-11T23:34:58.408 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_extent_items": 0, 2024-09-11T23:34:58.408 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_blob_bytes": 0, 2024-09-11T23:34:58.408 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_blob_items": 0, 2024-09-11T23:34:58.408 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-11T23:34:58.408 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_shared_blob_items": 0, 2024-09-11T23:34:58.408 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-11T23:34:58.408 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_inline_bl_items": 0, 2024-09-11T23:34:58.408 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_fsck_bytes": 0, 2024-09-11T23:34:58.409 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_fsck_items": 0, 2024-09-11T23:34:58.409 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_txc_bytes": 0, 2024-09-11T23:34:58.409 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_txc_items": 0, 2024-09-11T23:34:58.409 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-11T23:34:58.409 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_writing_deferred_items": 0, 2024-09-11T23:34:58.409 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_writing_bytes": 0, 2024-09-11T23:34:58.409 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_writing_items": 0, 2024-09-11T23:34:58.409 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_bytes": 0, 2024-09-11T23:34:58.409 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_items": 0, 2024-09-11T23:34:58.409 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_file_reader_bytes": 0, 2024-09-11T23:34:58.409 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_file_reader_items": 0, 2024-09-11T23:34:58.409 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_file_writer_bytes": 0, 2024-09-11T23:34:58.409 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_file_writer_items": 0, 2024-09-11T23:34:58.410 INFO:teuthology.orchestra.run.smithi160.stdout: "buffer_anon_bytes": 238535, 2024-09-11T23:34:58.410 INFO:teuthology.orchestra.run.smithi160.stdout: "buffer_anon_items": 73, 2024-09-11T23:34:58.410 INFO:teuthology.orchestra.run.smithi160.stdout: "buffer_meta_bytes": 0, 2024-09-11T23:34:58.410 INFO:teuthology.orchestra.run.smithi160.stdout: "buffer_meta_items": 0, 2024-09-11T23:34:58.410 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_bytes": 0, 2024-09-11T23:34:58.410 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_items": 0, 2024-09-11T23:34:58.410 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_mapbl_bytes": 0, 2024-09-11T23:34:58.410 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_mapbl_items": 0, 2024-09-11T23:34:58.410 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_pglog_bytes": 0, 2024-09-11T23:34:58.410 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_pglog_items": 0, 2024-09-11T23:34:58.410 INFO:teuthology.orchestra.run.smithi160.stdout: "osdmap_bytes": 9336, 2024-09-11T23:34:58.410 INFO:teuthology.orchestra.run.smithi160.stdout: "osdmap_items": 176, 2024-09-11T23:34:58.410 INFO:teuthology.orchestra.run.smithi160.stdout: "osdmap_mapping_bytes": 0, 2024-09-11T23:34:58.410 INFO:teuthology.orchestra.run.smithi160.stdout: "osdmap_mapping_items": 0, 2024-09-11T23:34:58.411 INFO:teuthology.orchestra.run.smithi160.stdout: "pgmap_bytes": 0, 2024-09-11T23:34:58.411 INFO:teuthology.orchestra.run.smithi160.stdout: "pgmap_items": 0, 2024-09-11T23:34:58.411 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_co_bytes": 50872, 2024-09-11T23:34:58.411 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_co_items": 198, 2024-09-11T23:34:58.411 INFO:teuthology.orchestra.run.smithi160.stdout: "unittest_1_bytes": 0, 2024-09-11T23:34:58.411 INFO:teuthology.orchestra.run.smithi160.stdout: "unittest_1_items": 0, 2024-09-11T23:34:58.411 INFO:teuthology.orchestra.run.smithi160.stdout: "unittest_2_bytes": 0, 2024-09-11T23:34:58.411 INFO:teuthology.orchestra.run.smithi160.stdout: "unittest_2_items": 0 2024-09-11T23:34:58.411 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:58.411 INFO:teuthology.orchestra.run.smithi160.stdout: "objecter": { 2024-09-11T23:34:58.411 INFO:teuthology.orchestra.run.smithi160.stdout: "op_active": 0, 2024-09-11T23:34:58.411 INFO:teuthology.orchestra.run.smithi160.stdout: "op_laggy": 0, 2024-09-11T23:34:58.411 INFO:teuthology.orchestra.run.smithi160.stdout: "op_send": 38, 2024-09-11T23:34:58.411 INFO:teuthology.orchestra.run.smithi160.stdout: "op_send_bytes": 11334, 2024-09-11T23:34:58.412 INFO:teuthology.orchestra.run.smithi160.stdout: "op_resend": 33, 2024-09-11T23:34:58.412 INFO:teuthology.orchestra.run.smithi160.stdout: "op_reply": 38, 2024-09-11T23:34:58.412 INFO:teuthology.orchestra.run.smithi160.stdout: "op_latency": { 2024-09-11T23:34:58.412 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 38, 2024-09-11T23:34:58.412 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.216997280, 2024-09-11T23:34:58.412 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.005710454 2024-09-11T23:34:58.412 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:58.412 INFO:teuthology.orchestra.run.smithi160.stdout: "op_inflight": 0, 2024-09-11T23:34:58.412 INFO:teuthology.orchestra.run.smithi160.stdout: "oplen_avg": { 2024-09-11T23:34:58.412 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 38, 2024-09-11T23:34:58.412 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 60 2024-09-11T23:34:58.412 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:58.412 INFO:teuthology.orchestra.run.smithi160.stdout: "op": 38, 2024-09-11T23:34:58.413 INFO:teuthology.orchestra.run.smithi160.stdout: "op_r": 0, 2024-09-11T23:34:58.413 INFO:teuthology.orchestra.run.smithi160.stdout: "op_w": 38, 2024-09-11T23:34:58.413 INFO:teuthology.orchestra.run.smithi160.stdout: "op_rmw": 0, 2024-09-11T23:34:58.413 INFO:teuthology.orchestra.run.smithi160.stdout: "op_pg": 0, 2024-09-11T23:34:58.413 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_stat": 0, 2024-09-11T23:34:58.413 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_create": 10, 2024-09-11T23:34:58.413 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_read": 0, 2024-09-11T23:34:58.413 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_write": 3, 2024-09-11T23:34:58.413 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_writefull": 6, 2024-09-11T23:34:58.413 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_writesame": 0, 2024-09-11T23:34:58.413 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_append": 0, 2024-09-11T23:34:58.413 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_zero": 0, 2024-09-11T23:34:58.413 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_truncate": 0, 2024-09-11T23:34:58.414 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_delete": 6, 2024-09-11T23:34:58.414 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_mapext": 0, 2024-09-11T23:34:58.414 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_sparse_read": 0, 2024-09-11T23:34:58.414 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_clonerange": 0, 2024-09-11T23:34:58.414 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_getxattr": 0, 2024-09-11T23:34:58.414 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_setxattr": 20, 2024-09-11T23:34:58.414 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_cmpxattr": 0, 2024-09-11T23:34:58.414 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_rmxattr": 0, 2024-09-11T23:34:58.414 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_resetxattrs": 0, 2024-09-11T23:34:58.414 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_call": 0, 2024-09-11T23:34:58.414 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_watch": 0, 2024-09-11T23:34:58.415 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_notify": 0, 2024-09-11T23:34:58.415 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_src_cmpxattr": 0, 2024-09-11T23:34:58.415 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_pgls": 0, 2024-09-11T23:34:58.415 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_pgls_filter": 0, 2024-09-11T23:34:58.415 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_other": 0, 2024-09-11T23:34:58.415 INFO:teuthology.orchestra.run.smithi160.stdout: "linger_active": 0, 2024-09-11T23:34:58.415 INFO:teuthology.orchestra.run.smithi160.stdout: "linger_send": 0, 2024-09-11T23:34:58.415 INFO:teuthology.orchestra.run.smithi160.stdout: "linger_resend": 0, 2024-09-11T23:34:58.415 INFO:teuthology.orchestra.run.smithi160.stdout: "linger_ping": 0, 2024-09-11T23:34:58.415 INFO:teuthology.orchestra.run.smithi160.stdout: "poolop_active": 0, 2024-09-11T23:34:58.415 INFO:teuthology.orchestra.run.smithi160.stdout: "poolop_send": 0, 2024-09-11T23:34:58.415 INFO:teuthology.orchestra.run.smithi160.stdout: "poolop_resend": 0, 2024-09-11T23:34:58.415 INFO:teuthology.orchestra.run.smithi160.stdout: "poolstat_active": 0, 2024-09-11T23:34:58.416 INFO:teuthology.orchestra.run.smithi160.stdout: "poolstat_send": 0, 2024-09-11T23:34:58.416 INFO:teuthology.orchestra.run.smithi160.stdout: "poolstat_resend": 0, 2024-09-11T23:34:58.416 INFO:teuthology.orchestra.run.smithi160.stdout: "statfs_active": 0, 2024-09-11T23:34:58.416 INFO:teuthology.orchestra.run.smithi160.stdout: "statfs_send": 0, 2024-09-11T23:34:58.416 INFO:teuthology.orchestra.run.smithi160.stdout: "statfs_resend": 0, 2024-09-11T23:34:58.416 INFO:teuthology.orchestra.run.smithi160.stdout: "command_active": 0, 2024-09-11T23:34:58.416 INFO:teuthology.orchestra.run.smithi160.stdout: "command_send": 0, 2024-09-11T23:34:58.416 INFO:teuthology.orchestra.run.smithi160.stdout: "command_resend": 0, 2024-09-11T23:34:58.416 INFO:teuthology.orchestra.run.smithi160.stdout: "map_epoch": 95, 2024-09-11T23:34:58.416 INFO:teuthology.orchestra.run.smithi160.stdout: "map_full": 0, 2024-09-11T23:34:58.416 INFO:teuthology.orchestra.run.smithi160.stdout: "map_inc": 2, 2024-09-11T23:34:58.416 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_sessions": 9, 2024-09-11T23:34:58.416 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_session_open": 14, 2024-09-11T23:34:58.417 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_session_close": 5, 2024-09-11T23:34:58.417 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_laggy": 0, 2024-09-11T23:34:58.417 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_wr": 14, 2024-09-11T23:34:58.417 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_rd": 0, 2024-09-11T23:34:58.417 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_del": 1 2024-09-11T23:34:58.417 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:58.417 INFO:teuthology.orchestra.run.smithi160.stdout: "oft": { 2024-09-11T23:34:58.417 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_total_objs": 1, 2024-09-11T23:34:58.417 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_total_kv_pairs": 0, 2024-09-11T23:34:58.417 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_total_updates": 0, 2024-09-11T23:34:58.417 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_total_removes": 0 2024-09-11T23:34:58.417 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:58.418 INFO:teuthology.orchestra.run.smithi160.stdout: "osd-slow-ops": { 2024-09-11T23:34:58.418 INFO:teuthology.orchestra.run.smithi160.stdout: "slow_ops_count": 0 2024-09-11T23:34:58.418 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:58.418 INFO:teuthology.orchestra.run.smithi160.stdout: "purge_queue": { 2024-09-11T23:34:58.418 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_executing_ops": 0, 2024-09-11T23:34:58.418 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_executing_ops_high_water": 0, 2024-09-11T23:34:58.418 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_executing": 0, 2024-09-11T23:34:58.418 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_executing_high_water": 0, 2024-09-11T23:34:58.418 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_executed_ops": 0, 2024-09-11T23:34:58.418 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_executed": 0, 2024-09-11T23:34:58.418 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_item_in_journal": 0 2024-09-11T23:34:58.418 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:58.418 INFO:teuthology.orchestra.run.smithi160.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-11T23:34:58.419 INFO:teuthology.orchestra.run.smithi160.stdout: "val": 0, 2024-09-11T23:34:58.419 INFO:teuthology.orchestra.run.smithi160.stdout: "max": 104857600, 2024-09-11T23:34:58.419 INFO:teuthology.orchestra.run.smithi160.stdout: "get_started": 0, 2024-09-11T23:34:58.419 INFO:teuthology.orchestra.run.smithi160.stdout: "get": 678, 2024-09-11T23:34:58.419 INFO:teuthology.orchestra.run.smithi160.stdout: "get_sum": 809207, 2024-09-11T23:34:58.419 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_fail": 0, 2024-09-11T23:34:58.419 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_success": 678, 2024-09-11T23:34:58.419 INFO:teuthology.orchestra.run.smithi160.stdout: "take": 0, 2024-09-11T23:34:58.419 INFO:teuthology.orchestra.run.smithi160.stdout: "take_sum": 0, 2024-09-11T23:34:58.419 INFO:teuthology.orchestra.run.smithi160.stdout: "put": 678, 2024-09-11T23:34:58.419 INFO:teuthology.orchestra.run.smithi160.stdout: "put_sum": 809207, 2024-09-11T23:34:58.419 INFO:teuthology.orchestra.run.smithi160.stdout: "wait": { 2024-09-11T23:34:58.420 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:34:58.420 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:34:58.420 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:34:58.420 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-11T23:34:58.420 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:58.420 INFO:teuthology.orchestra.run.smithi160.stdout: "throttle-objecter_bytes": { 2024-09-11T23:34:58.420 INFO:teuthology.orchestra.run.smithi160.stdout: "val": 0, 2024-09-11T23:34:58.420 INFO:teuthology.orchestra.run.smithi160.stdout: "max": 104857600, 2024-09-11T23:34:58.420 INFO:teuthology.orchestra.run.smithi160.stdout: "get_started": 0, 2024-09-11T23:34:58.420 INFO:teuthology.orchestra.run.smithi160.stdout: "get": 0, 2024-09-11T23:34:58.420 INFO:teuthology.orchestra.run.smithi160.stdout: "get_sum": 0, 2024-09-11T23:34:58.420 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_fail": 0, 2024-09-11T23:34:58.420 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_success": 0, 2024-09-11T23:34:58.421 INFO:teuthology.orchestra.run.smithi160.stdout: "take": 38, 2024-09-11T23:34:58.421 INFO:teuthology.orchestra.run.smithi160.stdout: "take_sum": 11334, 2024-09-11T23:34:58.421 INFO:teuthology.orchestra.run.smithi160.stdout: "put": 38, 2024-09-11T23:34:58.421 INFO:teuthology.orchestra.run.smithi160.stdout: "put_sum": 11334, 2024-09-11T23:34:58.421 INFO:teuthology.orchestra.run.smithi160.stdout: "wait": { 2024-09-11T23:34:58.421 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:34:58.422 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:34:58.422 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:34:58.422 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-11T23:34:58.422 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:58.422 INFO:teuthology.orchestra.run.smithi160.stdout: "throttle-objecter_ops": { 2024-09-11T23:34:58.422 INFO:teuthology.orchestra.run.smithi160.stdout: "val": 0, 2024-09-11T23:34:58.422 INFO:teuthology.orchestra.run.smithi160.stdout: "max": 1024, 2024-09-11T23:34:58.422 INFO:teuthology.orchestra.run.smithi160.stdout: "get_started": 0, 2024-09-11T23:34:58.422 INFO:teuthology.orchestra.run.smithi160.stdout: "get": 0, 2024-09-11T23:34:58.422 INFO:teuthology.orchestra.run.smithi160.stdout: "get_sum": 0, 2024-09-11T23:34:58.422 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_fail": 0, 2024-09-11T23:34:58.422 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_success": 0, 2024-09-11T23:34:58.423 INFO:teuthology.orchestra.run.smithi160.stdout: "take": 38, 2024-09-11T23:34:58.423 INFO:teuthology.orchestra.run.smithi160.stdout: "take_sum": 38, 2024-09-11T23:34:58.423 INFO:teuthology.orchestra.run.smithi160.stdout: "put": 38, 2024-09-11T23:34:58.423 INFO:teuthology.orchestra.run.smithi160.stdout: "put_sum": 38, 2024-09-11T23:34:58.423 INFO:teuthology.orchestra.run.smithi160.stdout: "wait": { 2024-09-11T23:34:58.423 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:34:58.423 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:34:58.423 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:34:58.423 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-11T23:34:58.423 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:58.423 INFO:teuthology.orchestra.run.smithi160.stdout: "throttle-write_buf_throttle": { 2024-09-11T23:34:58.423 INFO:teuthology.orchestra.run.smithi160.stdout: "val": 0, 2024-09-11T23:34:58.423 INFO:teuthology.orchestra.run.smithi160.stdout: "max": 3758096384, 2024-09-11T23:34:58.424 INFO:teuthology.orchestra.run.smithi160.stdout: "get_started": 0, 2024-09-11T23:34:58.424 INFO:teuthology.orchestra.run.smithi160.stdout: "get": 0, 2024-09-11T23:34:58.424 INFO:teuthology.orchestra.run.smithi160.stdout: "get_sum": 0, 2024-09-11T23:34:58.424 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_fail": 0, 2024-09-11T23:34:58.424 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_success": 0, 2024-09-11T23:34:58.424 INFO:teuthology.orchestra.run.smithi160.stdout: "take": 0, 2024-09-11T23:34:58.424 INFO:teuthology.orchestra.run.smithi160.stdout: "take_sum": 0, 2024-09-11T23:34:58.424 INFO:teuthology.orchestra.run.smithi160.stdout: "put": 0, 2024-09-11T23:34:58.424 INFO:teuthology.orchestra.run.smithi160.stdout: "put_sum": 0, 2024-09-11T23:34:58.424 INFO:teuthology.orchestra.run.smithi160.stdout: "wait": { 2024-09-11T23:34:58.424 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:34:58.425 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:34:58.425 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:34:58.425 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-11T23:34:58.425 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:34:58.425 INFO:teuthology.orchestra.run.smithi160.stdout: "throttle-write_buf_throttle-0x55a08b250960": { 2024-09-11T23:34:58.425 INFO:teuthology.orchestra.run.smithi160.stdout: "val": 0, 2024-09-11T23:34:58.425 INFO:teuthology.orchestra.run.smithi160.stdout: "max": 3758096384, 2024-09-11T23:34:58.425 INFO:teuthology.orchestra.run.smithi160.stdout: "get_started": 0, 2024-09-11T23:34:58.425 INFO:teuthology.orchestra.run.smithi160.stdout: "get": 4, 2024-09-11T23:34:58.425 INFO:teuthology.orchestra.run.smithi160.stdout: "get_sum": 1122, 2024-09-11T23:34:58.425 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_fail": 0, 2024-09-11T23:34:58.426 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_success": 4, 2024-09-11T23:34:58.426 INFO:teuthology.orchestra.run.smithi160.stdout: "take": 0, 2024-09-11T23:34:58.426 INFO:teuthology.orchestra.run.smithi160.stdout: "take_sum": 0, 2024-09-11T23:34:58.426 INFO:teuthology.orchestra.run.smithi160.stdout: "put": 3, 2024-09-11T23:34:58.426 INFO:teuthology.orchestra.run.smithi160.stdout: "put_sum": 1122, 2024-09-11T23:34:58.426 INFO:teuthology.orchestra.run.smithi160.stdout: "wait": { 2024-09-11T23:34:58.426 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:34:58.426 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:34:58.426 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:34:58.426 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-11T23:34:58.426 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-11T23:34:58.426 INFO:teuthology.orchestra.run.smithi160.stdout:} 2024-09-11T23:34:59.283 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-09-11T23:34:59.283 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2024-09-11T23:34:59.283 DEBUG:tasks.check_counter:Getting stats from i 2024-09-11T23:34:59.283 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph daemon mds.i perf dump 2024-09-11T23:34:59.535 INFO:teuthology.orchestra.run.smithi160.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T23:34:59.933 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:34:59 smithi160 ceph-mon[35055]: pgmap v868: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 853 B/s wr, 9 op/s 2024-09-11T23:35:00.218 INFO:teuthology.orchestra.run.smithi160.stdout:{ 2024-09-11T23:35:00.218 INFO:teuthology.orchestra.run.smithi160.stdout: "AsyncMessenger::Worker-0": { 2024-09-11T23:35:00.218 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_messages": 687, 2024-09-11T23:35:00.218 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages": 948, 2024-09-11T23:35:00.219 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_bytes": 919462, 2024-09-11T23:35:00.219 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_bytes": 311410, 2024-09-11T23:35:00.219 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_created_connections": 7, 2024-09-11T23:35:00.219 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_active_connections": 3, 2024-09-11T23:35:00.219 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_total_time": 0.097907258, 2024-09-11T23:35:00.219 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_send_time": 0.038143526, 2024-09-11T23:35:00.219 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_recv_time": 0.055763694, 2024-09-11T23:35:00.219 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_fast_dispatch_time": 0.006351862, 2024-09-11T23:35:00.219 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T23:35:00.219 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 948, 2024-09-11T23:35:00.219 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.074996372, 2024-09-11T23:35:00.219 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000079110 2024-09-11T23:35:00.219 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:00.220 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_handle_ack_lat": { 2024-09-11T23:35:00.220 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 890, 2024-09-11T23:35:00.220 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000241840, 2024-09-11T23:35:00.220 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000271 2024-09-11T23:35:00.220 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:00.220 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_encrypted_bytes": 842576, 2024-09-11T23:35:00.220 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_encrypted_bytes": 195792 2024-09-11T23:35:00.220 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:00.220 INFO:teuthology.orchestra.run.smithi160.stdout: "AsyncMessenger::Worker-1": { 2024-09-11T23:35:00.220 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_messages": 17, 2024-09-11T23:35:00.220 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages": 253, 2024-09-11T23:35:00.220 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_bytes": 3994, 2024-09-11T23:35:00.220 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_bytes": 622525, 2024-09-11T23:35:00.221 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_created_connections": 14, 2024-09-11T23:35:00.221 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_active_connections": 6, 2024-09-11T23:35:00.221 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_total_time": 0.017125258, 2024-09-11T23:35:00.221 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_send_time": 0.009949789, 2024-09-11T23:35:00.221 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_recv_time": 0.004633382, 2024-09-11T23:35:00.221 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_fast_dispatch_time": 0.000257091, 2024-09-11T23:35:00.221 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T23:35:00.221 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 251, 2024-09-11T23:35:00.221 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.047183624, 2024-09-11T23:35:00.221 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000187982 2024-09-11T23:35:00.221 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:00.224 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_handle_ack_lat": { 2024-09-11T23:35:00.224 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 5, 2024-09-11T23:35:00.224 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000001583, 2024-09-11T23:35:00.224 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000316 2024-09-11T23:35:00.224 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:00.224 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-11T23:35:00.224 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_encrypted_bytes": 566240 2024-09-11T23:35:00.224 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:00.224 INFO:teuthology.orchestra.run.smithi160.stdout: "AsyncMessenger::Worker-2": { 2024-09-11T23:35:00.224 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_messages": 15, 2024-09-11T23:35:00.225 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages": 17, 2024-09-11T23:35:00.225 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_bytes": 4163, 2024-09-11T23:35:00.225 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_bytes": 13150, 2024-09-11T23:35:00.225 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_created_connections": 8, 2024-09-11T23:35:00.225 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_active_connections": 4, 2024-09-11T23:35:00.225 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_total_time": 0.002956134, 2024-09-11T23:35:00.225 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_send_time": 0.000286467, 2024-09-11T23:35:00.225 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_recv_time": 0.002050053, 2024-09-11T23:35:00.225 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_fast_dispatch_time": 0.000359855, 2024-09-11T23:35:00.225 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T23:35:00.225 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 15, 2024-09-11T23:35:00.225 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.014829450, 2024-09-11T23:35:00.225 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000988630 2024-09-11T23:35:00.226 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:00.226 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_handle_ack_lat": { 2024-09-11T23:35:00.226 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:35:00.226 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:35:00.226 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:35:00.226 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:00.226 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-11T23:35:00.226 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_encrypted_bytes": 0 2024-09-11T23:35:00.226 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:00.226 INFO:teuthology.orchestra.run.smithi160.stdout: "cct": { 2024-09-11T23:35:00.226 INFO:teuthology.orchestra.run.smithi160.stdout: "total_workers": 1, 2024-09-11T23:35:00.226 INFO:teuthology.orchestra.run.smithi160.stdout: "unhealthy_workers": 0 2024-09-11T23:35:00.226 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:00.227 INFO:teuthology.orchestra.run.smithi160.stdout: "finisher-MDSRank": { 2024-09-11T23:35:00.227 INFO:teuthology.orchestra.run.smithi160.stdout: "queue_len": 0, 2024-09-11T23:35:00.227 INFO:teuthology.orchestra.run.smithi160.stdout: "complete_latency": { 2024-09-11T23:35:00.227 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 52, 2024-09-11T23:35:00.227 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.001719317, 2024-09-11T23:35:00.227 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000033063 2024-09-11T23:35:00.227 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-11T23:35:00.227 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:00.227 INFO:teuthology.orchestra.run.smithi160.stdout: "finisher-PurgeQueue": { 2024-09-11T23:35:00.227 INFO:teuthology.orchestra.run.smithi160.stdout: "queue_len": 0, 2024-09-11T23:35:00.227 INFO:teuthology.orchestra.run.smithi160.stdout: "complete_latency": { 2024-09-11T23:35:00.227 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 2, 2024-09-11T23:35:00.227 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000014055, 2024-09-11T23:35:00.228 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000007027 2024-09-11T23:35:00.228 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-11T23:35:00.228 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:00.228 INFO:teuthology.orchestra.run.smithi160.stdout: "mds": { 2024-09-11T23:35:00.228 INFO:teuthology.orchestra.run.smithi160.stdout: "request": 0, 2024-09-11T23:35:00.228 INFO:teuthology.orchestra.run.smithi160.stdout: "reply": 0, 2024-09-11T23:35:00.228 INFO:teuthology.orchestra.run.smithi160.stdout: "reply_latency": { 2024-09-11T23:35:00.228 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:35:00.228 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:35:00.228 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:35:00.228 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:00.228 INFO:teuthology.orchestra.run.smithi160.stdout: "slow_reply": 0, 2024-09-11T23:35:00.228 INFO:teuthology.orchestra.run.smithi160.stdout: "forward": 0, 2024-09-11T23:35:00.229 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_fetch_complete": 0, 2024-09-11T23:35:00.229 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_fetch_keys": 0, 2024-09-11T23:35:00.229 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_commit": 11, 2024-09-11T23:35:00.229 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_split": 0, 2024-09-11T23:35:00.229 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_merge": 0, 2024-09-11T23:35:00.229 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes": 23, 2024-09-11T23:35:00.229 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes_top": 0, 2024-09-11T23:35:00.229 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes_bottom": 23, 2024-09-11T23:35:00.229 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes_pin_tail": 0, 2024-09-11T23:35:00.229 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes_pinned": 23, 2024-09-11T23:35:00.229 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes_expired": 0, 2024-09-11T23:35:00.229 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes_with_caps": 3, 2024-09-11T23:35:00.229 INFO:teuthology.orchestra.run.smithi160.stdout: "caps": 3, 2024-09-11T23:35:00.230 INFO:teuthology.orchestra.run.smithi160.stdout: "subtrees": 3, 2024-09-11T23:35:00.230 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse": 1, 2024-09-11T23:35:00.230 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse_hit": 0, 2024-09-11T23:35:00.230 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse_forward": 0, 2024-09-11T23:35:00.230 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse_discover": 1, 2024-09-11T23:35:00.230 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse_dir_fetch": 0, 2024-09-11T23:35:00.230 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse_remote_ino": 0, 2024-09-11T23:35:00.230 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse_lock": 0, 2024-09-11T23:35:00.230 INFO:teuthology.orchestra.run.smithi160.stdout: "load_cent": 0, 2024-09-11T23:35:00.230 INFO:teuthology.orchestra.run.smithi160.stdout: "q": 0, 2024-09-11T23:35:00.230 INFO:teuthology.orchestra.run.smithi160.stdout: "exported": 0, 2024-09-11T23:35:00.230 INFO:teuthology.orchestra.run.smithi160.stdout: "exported_inodes": 0, 2024-09-11T23:35:00.230 INFO:teuthology.orchestra.run.smithi160.stdout: "imported": 1, 2024-09-11T23:35:00.230 INFO:teuthology.orchestra.run.smithi160.stdout: "imported_inodes": 6, 2024-09-11T23:35:00.231 INFO:teuthology.orchestra.run.smithi160.stdout: "openino_dir_fetch": 0, 2024-09-11T23:35:00.231 INFO:teuthology.orchestra.run.smithi160.stdout: "openino_backtrace_fetch": 0, 2024-09-11T23:35:00.231 INFO:teuthology.orchestra.run.smithi160.stdout: "openino_peer_discover": 0, 2024-09-11T23:35:00.231 INFO:teuthology.orchestra.run.smithi160.stdout: "root_rfiles": 1022, 2024-09-11T23:35:00.231 INFO:teuthology.orchestra.run.smithi160.stdout: "root_rbytes": 1586967590, 2024-09-11T23:35:00.231 INFO:teuthology.orchestra.run.smithi160.stdout: "root_rsnaps": 0, 2024-09-11T23:35:00.231 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_backtrace_fetch": 0, 2024-09-11T23:35:00.231 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_set_tag": 0, 2024-09-11T23:35:00.231 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_backtrace_repaired": 0, 2024-09-11T23:35:00.232 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_inotable_repaired": 0, 2024-09-11T23:35:00.232 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_dir_inodes": 0, 2024-09-11T23:35:00.232 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_dir_base_inodes": 0, 2024-09-11T23:35:00.232 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_dirfrag_rstats": 0, 2024-09-11T23:35:00.232 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_file_inodes": 0, 2024-09-11T23:35:00.232 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_inode_file_caps": 0, 2024-09-11T23:35:00.232 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_cap_op_revoke": 0, 2024-09-11T23:35:00.232 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_cap_op_grant": 0, 2024-09-11T23:35:00.232 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_cap_op_trunc": 0, 2024-09-11T23:35:00.232 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-11T23:35:00.232 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-11T23:35:00.232 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_client_caps": 0, 2024-09-11T23:35:00.232 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_client_caps_dirty": 0, 2024-09-11T23:35:00.233 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_client_cap_release": 0, 2024-09-11T23:35:00.233 INFO:teuthology.orchestra.run.smithi160.stdout: "process_request_cap_release": 0 2024-09-11T23:35:00.233 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:00.233 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_cache": { 2024-09-11T23:35:00.233 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_update": 0, 2024-09-11T23:35:00.233 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_update_receipt": 0, 2024-09-11T23:35:00.233 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_try_discover": 0, 2024-09-11T23:35:00.233 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_send_discover": 2, 2024-09-11T23:35:00.233 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_handle_discover": 0, 2024-09-11T23:35:00.233 INFO:teuthology.orchestra.run.smithi160.stdout: "num_strays": 0, 2024-09-11T23:35:00.233 INFO:teuthology.orchestra.run.smithi160.stdout: "num_strays_delayed": 0, 2024-09-11T23:35:00.233 INFO:teuthology.orchestra.run.smithi160.stdout: "num_strays_enqueuing": 0, 2024-09-11T23:35:00.233 INFO:teuthology.orchestra.run.smithi160.stdout: "strays_created": 0, 2024-09-11T23:35:00.234 INFO:teuthology.orchestra.run.smithi160.stdout: "strays_enqueued": 0, 2024-09-11T23:35:00.234 INFO:teuthology.orchestra.run.smithi160.stdout: "strays_reintegrated": 0, 2024-09-11T23:35:00.234 INFO:teuthology.orchestra.run.smithi160.stdout: "strays_migrated": 0, 2024-09-11T23:35:00.234 INFO:teuthology.orchestra.run.smithi160.stdout: "num_recovering_processing": 0, 2024-09-11T23:35:00.234 INFO:teuthology.orchestra.run.smithi160.stdout: "num_recovering_enqueued": 0, 2024-09-11T23:35:00.234 INFO:teuthology.orchestra.run.smithi160.stdout: "num_recovering_prioritized": 0, 2024-09-11T23:35:00.234 INFO:teuthology.orchestra.run.smithi160.stdout: "recovery_started": 0, 2024-09-11T23:35:00.234 INFO:teuthology.orchestra.run.smithi160.stdout: "recovery_completed": 0, 2024-09-11T23:35:00.234 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_quiesce_path": 0, 2024-09-11T23:35:00.235 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_quiesce_inode": 0, 2024-09-11T23:35:00.235 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_enqueue_scrub": 0, 2024-09-11T23:35:00.235 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_exportdir": 0, 2024-09-11T23:35:00.235 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_flush": 0, 2024-09-11T23:35:00.235 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_fragmentdir": 0, 2024-09-11T23:35:00.235 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_fragstats": 0, 2024-09-11T23:35:00.236 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_inodestats": 0 2024-09-11T23:35:00.236 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:00.236 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_log": { 2024-09-11T23:35:00.236 INFO:teuthology.orchestra.run.smithi160.stdout: "evlrg": 0, 2024-09-11T23:35:00.236 INFO:teuthology.orchestra.run.smithi160.stdout: "evadd": 5, 2024-09-11T23:35:00.236 INFO:teuthology.orchestra.run.smithi160.stdout: "evex": 0, 2024-09-11T23:35:00.236 INFO:teuthology.orchestra.run.smithi160.stdout: "evtrm": 0, 2024-09-11T23:35:00.237 INFO:teuthology.orchestra.run.smithi160.stdout: "ev": 5, 2024-09-11T23:35:00.237 INFO:teuthology.orchestra.run.smithi160.stdout: "evexg": 0, 2024-09-11T23:35:00.237 INFO:teuthology.orchestra.run.smithi160.stdout: "evexd": 0, 2024-09-11T23:35:00.237 INFO:teuthology.orchestra.run.smithi160.stdout: "segadd": 2, 2024-09-11T23:35:00.237 INFO:teuthology.orchestra.run.smithi160.stdout: "segex": 0, 2024-09-11T23:35:00.237 INFO:teuthology.orchestra.run.smithi160.stdout: "segtrm": 0, 2024-09-11T23:35:00.237 INFO:teuthology.orchestra.run.smithi160.stdout: "seg": 2, 2024-09-11T23:35:00.237 INFO:teuthology.orchestra.run.smithi160.stdout: "segmjr": 2, 2024-09-11T23:35:00.237 INFO:teuthology.orchestra.run.smithi160.stdout: "segexg": 0, 2024-09-11T23:35:00.237 INFO:teuthology.orchestra.run.smithi160.stdout: "segexd": 0, 2024-09-11T23:35:00.238 INFO:teuthology.orchestra.run.smithi160.stdout: "expos": 4194304, 2024-09-11T23:35:00.238 INFO:teuthology.orchestra.run.smithi160.stdout: "wrpos": 4206412, 2024-09-11T23:35:00.238 INFO:teuthology.orchestra.run.smithi160.stdout: "rdpos": 0, 2024-09-11T23:35:00.238 INFO:teuthology.orchestra.run.smithi160.stdout: "jlat": { 2024-09-11T23:35:00.238 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 4, 2024-09-11T23:35:00.238 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.006744830, 2024-09-11T23:35:00.238 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.001686207 2024-09-11T23:35:00.238 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:00.238 INFO:teuthology.orchestra.run.smithi160.stdout: "replayed": 0 2024-09-11T23:35:00.238 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:00.238 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_mem": { 2024-09-11T23:35:00.238 INFO:teuthology.orchestra.run.smithi160.stdout: "ino": 23, 2024-09-11T23:35:00.238 INFO:teuthology.orchestra.run.smithi160.stdout: "ino+": 23, 2024-09-11T23:35:00.239 INFO:teuthology.orchestra.run.smithi160.stdout: "ino-": 0, 2024-09-11T23:35:00.239 INFO:teuthology.orchestra.run.smithi160.stdout: "dir": 19, 2024-09-11T23:35:00.239 INFO:teuthology.orchestra.run.smithi160.stdout: "dir+": 20, 2024-09-11T23:35:00.239 INFO:teuthology.orchestra.run.smithi160.stdout: "dir-": 1, 2024-09-11T23:35:00.239 INFO:teuthology.orchestra.run.smithi160.stdout: "dn": 23, 2024-09-11T23:35:00.239 INFO:teuthology.orchestra.run.smithi160.stdout: "dn+": 23, 2024-09-11T23:35:00.239 INFO:teuthology.orchestra.run.smithi160.stdout: "dn-": 0, 2024-09-11T23:35:00.239 INFO:teuthology.orchestra.run.smithi160.stdout: "cap": 3, 2024-09-11T23:35:00.239 INFO:teuthology.orchestra.run.smithi160.stdout: "cap+": 3, 2024-09-11T23:35:00.239 INFO:teuthology.orchestra.run.smithi160.stdout: "cap-": 0, 2024-09-11T23:35:00.239 INFO:teuthology.orchestra.run.smithi160.stdout: "rss": 50188, 2024-09-11T23:35:00.239 INFO:teuthology.orchestra.run.smithi160.stdout: "heap": 223520 2024-09-11T23:35:00.239 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:00.239 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_server": { 2024-09-11T23:35:00.239 INFO:teuthology.orchestra.run.smithi160.stdout: "dispatch_client_request": 0, 2024-09-11T23:35:00.240 INFO:teuthology.orchestra.run.smithi160.stdout: "dispatch_server_request": 0, 2024-09-11T23:35:00.240 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_client_request": 0, 2024-09-11T23:35:00.240 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_client_session": 1, 2024-09-11T23:35:00.240 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_peer_request": 0, 2024-09-11T23:35:00.240 INFO:teuthology.orchestra.run.smithi160.stdout: "req_create_latency": { 2024-09-11T23:35:00.240 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:35:00.240 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:35:00.240 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:35:00.240 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:00.240 INFO:teuthology.orchestra.run.smithi160.stdout: "req_getattr_latency": { 2024-09-11T23:35:00.240 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:35:00.240 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:35:00.240 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:35:00.241 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:00.241 INFO:teuthology.orchestra.run.smithi160.stdout: "req_getfilelock_latency": { 2024-09-11T23:35:00.241 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:35:00.241 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:35:00.241 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:35:00.241 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:00.241 INFO:teuthology.orchestra.run.smithi160.stdout: "req_link_latency": { 2024-09-11T23:35:00.241 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:35:00.241 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:35:00.241 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:35:00.241 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:00.241 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lookup_latency": { 2024-09-11T23:35:00.241 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:35:00.241 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:35:00.242 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:35:00.242 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:00.242 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lookuphash_latency": { 2024-09-11T23:35:00.242 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:35:00.242 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:35:00.242 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:35:00.242 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:00.242 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lookupino_latency": { 2024-09-11T23:35:00.242 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:35:00.242 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:35:00.242 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:35:00.242 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:00.242 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lookupname_latency": { 2024-09-11T23:35:00.243 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:35:00.243 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:35:00.243 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:35:00.243 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:00.243 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lookupparent_latency": { 2024-09-11T23:35:00.243 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:35:00.243 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:35:00.243 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:35:00.243 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:00.243 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lookupsnap_latency": { 2024-09-11T23:35:00.243 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:35:00.243 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:35:00.243 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:35:00.243 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:00.244 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lssnap_latency": { 2024-09-11T23:35:00.244 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:35:00.244 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:35:00.244 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:35:00.244 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:00.244 INFO:teuthology.orchestra.run.smithi160.stdout: "req_mkdir_latency": { 2024-09-11T23:35:00.244 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:35:00.244 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:35:00.244 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:35:00.244 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:00.244 INFO:teuthology.orchestra.run.smithi160.stdout: "req_mknod_latency": { 2024-09-11T23:35:00.244 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:35:00.244 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:35:00.245 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:35:00.245 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:00.245 INFO:teuthology.orchestra.run.smithi160.stdout: "req_mksnap_latency": { 2024-09-11T23:35:00.245 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:35:00.245 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:35:00.245 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:35:00.245 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:00.245 INFO:teuthology.orchestra.run.smithi160.stdout: "req_open_latency": { 2024-09-11T23:35:00.245 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:35:00.245 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:35:00.245 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:35:00.245 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:00.245 INFO:teuthology.orchestra.run.smithi160.stdout: "req_readdir_latency": { 2024-09-11T23:35:00.246 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:35:00.246 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:35:00.246 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:35:00.246 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:00.246 INFO:teuthology.orchestra.run.smithi160.stdout: "req_rename_latency": { 2024-09-11T23:35:00.246 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:35:00.246 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:35:00.246 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:35:00.246 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:00.246 INFO:teuthology.orchestra.run.smithi160.stdout: "req_renamesnap_latency": { 2024-09-11T23:35:00.246 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:35:00.246 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:35:00.246 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:35:00.247 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:00.247 INFO:teuthology.orchestra.run.smithi160.stdout: "req_snapdiff_latency": { 2024-09-11T23:35:00.247 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:35:00.247 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:35:00.247 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:35:00.247 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:00.247 INFO:teuthology.orchestra.run.smithi160.stdout: "req_rmdir_latency": { 2024-09-11T23:35:00.247 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:35:00.247 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:35:00.247 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:35:00.247 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:00.247 INFO:teuthology.orchestra.run.smithi160.stdout: "req_rmsnap_latency": { 2024-09-11T23:35:00.247 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:35:00.248 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:35:00.248 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:35:00.248 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:00.248 INFO:teuthology.orchestra.run.smithi160.stdout: "req_rmxattr_latency": { 2024-09-11T23:35:00.248 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:35:00.248 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:35:00.248 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:35:00.248 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:00.248 INFO:teuthology.orchestra.run.smithi160.stdout: "req_setattr_latency": { 2024-09-11T23:35:00.248 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:35:00.248 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:35:00.248 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:35:00.249 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:00.249 INFO:teuthology.orchestra.run.smithi160.stdout: "req_setdirlayout_latency": { 2024-09-11T23:35:00.249 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:35:00.249 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:35:00.249 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:35:00.249 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:00.249 INFO:teuthology.orchestra.run.smithi160.stdout: "req_setfilelock_latency": { 2024-09-11T23:35:00.249 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:35:00.249 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:35:00.249 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:35:00.249 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:00.249 INFO:teuthology.orchestra.run.smithi160.stdout: "req_setlayout_latency": { 2024-09-11T23:35:00.249 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:35:00.250 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:35:00.250 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:35:00.250 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:00.250 INFO:teuthology.orchestra.run.smithi160.stdout: "req_setxattr_latency": { 2024-09-11T23:35:00.250 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:35:00.250 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:35:00.250 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:35:00.250 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:00.250 INFO:teuthology.orchestra.run.smithi160.stdout: "req_symlink_latency": { 2024-09-11T23:35:00.250 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:35:00.250 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:35:00.250 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:35:00.250 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:00.251 INFO:teuthology.orchestra.run.smithi160.stdout: "req_unlink_latency": { 2024-09-11T23:35:00.251 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:35:00.251 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:35:00.251 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:35:00.251 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:00.251 INFO:teuthology.orchestra.run.smithi160.stdout: "cap_revoke_eviction": 0, 2024-09-11T23:35:00.251 INFO:teuthology.orchestra.run.smithi160.stdout: "cap_acquisition_throttle": 0, 2024-09-11T23:35:00.251 INFO:teuthology.orchestra.run.smithi160.stdout: "req_getvxattr_latency": { 2024-09-11T23:35:00.251 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:35:00.251 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:35:00.251 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:35:00.251 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-11T23:35:00.251 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:00.252 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_sessions": { 2024-09-11T23:35:00.252 INFO:teuthology.orchestra.run.smithi160.stdout: "session_count": 1, 2024-09-11T23:35:00.252 INFO:teuthology.orchestra.run.smithi160.stdout: "session_add": 1, 2024-09-11T23:35:00.252 INFO:teuthology.orchestra.run.smithi160.stdout: "session_remove": 0, 2024-09-11T23:35:00.252 INFO:teuthology.orchestra.run.smithi160.stdout: "sessions_open": 1, 2024-09-11T23:35:00.252 INFO:teuthology.orchestra.run.smithi160.stdout: "sessions_stale": 0, 2024-09-11T23:35:00.252 INFO:teuthology.orchestra.run.smithi160.stdout: "total_load": 0, 2024-09-11T23:35:00.252 INFO:teuthology.orchestra.run.smithi160.stdout: "average_load": 0, 2024-09-11T23:35:00.252 INFO:teuthology.orchestra.run.smithi160.stdout: "avg_session_uptime": 2349, 2024-09-11T23:35:00.252 INFO:teuthology.orchestra.run.smithi160.stdout: "mdthresh_evicted": 0 2024-09-11T23:35:00.252 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:00.252 INFO:teuthology.orchestra.run.smithi160.stdout: "mempool": { 2024-09-11T23:35:00.252 INFO:teuthology.orchestra.run.smithi160.stdout: "bloom_filter_bytes": 0, 2024-09-11T23:35:00.252 INFO:teuthology.orchestra.run.smithi160.stdout: "bloom_filter_items": 0, 2024-09-11T23:35:00.253 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_alloc_bytes": 0, 2024-09-11T23:35:00.253 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_alloc_items": 0, 2024-09-11T23:35:00.253 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_data_bytes": 0, 2024-09-11T23:35:00.253 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_data_items": 0, 2024-09-11T23:35:00.253 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-11T23:35:00.253 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_onode_items": 0, 2024-09-11T23:35:00.253 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-11T23:35:00.253 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_meta_items": 0, 2024-09-11T23:35:00.253 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_other_bytes": 0, 2024-09-11T23:35:00.253 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_other_items": 0, 2024-09-11T23:35:00.253 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-11T23:35:00.253 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_buffer_items": 0, 2024-09-11T23:35:00.253 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_extent_bytes": 0, 2024-09-11T23:35:00.254 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_extent_items": 0, 2024-09-11T23:35:00.254 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_blob_bytes": 0, 2024-09-11T23:35:00.254 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_blob_items": 0, 2024-09-11T23:35:00.254 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-11T23:35:00.254 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_shared_blob_items": 0, 2024-09-11T23:35:00.254 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-11T23:35:00.254 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_inline_bl_items": 0, 2024-09-11T23:35:00.254 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_fsck_bytes": 0, 2024-09-11T23:35:00.254 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_fsck_items": 0, 2024-09-11T23:35:00.254 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_txc_bytes": 0, 2024-09-11T23:35:00.254 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_txc_items": 0, 2024-09-11T23:35:00.254 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-11T23:35:00.254 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_writing_deferred_items": 0, 2024-09-11T23:35:00.255 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_writing_bytes": 0, 2024-09-11T23:35:00.255 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_writing_items": 0, 2024-09-11T23:35:00.255 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_bytes": 0, 2024-09-11T23:35:00.255 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_items": 0, 2024-09-11T23:35:00.255 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_file_reader_bytes": 0, 2024-09-11T23:35:00.255 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_file_reader_items": 0, 2024-09-11T23:35:00.255 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_file_writer_bytes": 0, 2024-09-11T23:35:00.255 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_file_writer_items": 0, 2024-09-11T23:35:00.255 INFO:teuthology.orchestra.run.smithi160.stdout: "buffer_anon_bytes": 255235, 2024-09-11T23:35:00.255 INFO:teuthology.orchestra.run.smithi160.stdout: "buffer_anon_items": 88, 2024-09-11T23:35:00.255 INFO:teuthology.orchestra.run.smithi160.stdout: "buffer_meta_bytes": 0, 2024-09-11T23:35:00.255 INFO:teuthology.orchestra.run.smithi160.stdout: "buffer_meta_items": 0, 2024-09-11T23:35:00.255 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_bytes": 0, 2024-09-11T23:35:00.255 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_items": 0, 2024-09-11T23:35:00.256 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_mapbl_bytes": 0, 2024-09-11T23:35:00.256 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_mapbl_items": 0, 2024-09-11T23:35:00.256 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_pglog_bytes": 0, 2024-09-11T23:35:00.256 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_pglog_items": 0, 2024-09-11T23:35:00.256 INFO:teuthology.orchestra.run.smithi160.stdout: "osdmap_bytes": 9336, 2024-09-11T23:35:00.256 INFO:teuthology.orchestra.run.smithi160.stdout: "osdmap_items": 176, 2024-09-11T23:35:00.256 INFO:teuthology.orchestra.run.smithi160.stdout: "osdmap_mapping_bytes": 0, 2024-09-11T23:35:00.256 INFO:teuthology.orchestra.run.smithi160.stdout: "osdmap_mapping_items": 0, 2024-09-11T23:35:00.256 INFO:teuthology.orchestra.run.smithi160.stdout: "pgmap_bytes": 0, 2024-09-11T23:35:00.257 INFO:teuthology.orchestra.run.smithi160.stdout: "pgmap_items": 0, 2024-09-11T23:35:00.257 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_co_bytes": 94923, 2024-09-11T23:35:00.257 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_co_items": 507, 2024-09-11T23:35:00.257 INFO:teuthology.orchestra.run.smithi160.stdout: "unittest_1_bytes": 0, 2024-09-11T23:35:00.257 INFO:teuthology.orchestra.run.smithi160.stdout: "unittest_1_items": 0, 2024-09-11T23:35:00.257 INFO:teuthology.orchestra.run.smithi160.stdout: "unittest_2_bytes": 0, 2024-09-11T23:35:00.257 INFO:teuthology.orchestra.run.smithi160.stdout: "unittest_2_items": 0 2024-09-11T23:35:00.257 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:00.257 INFO:teuthology.orchestra.run.smithi160.stdout: "objecter": { 2024-09-11T23:35:00.257 INFO:teuthology.orchestra.run.smithi160.stdout: "op_active": 0, 2024-09-11T23:35:00.257 INFO:teuthology.orchestra.run.smithi160.stdout: "op_laggy": 0, 2024-09-11T23:35:00.257 INFO:teuthology.orchestra.run.smithi160.stdout: "op_send": 40, 2024-09-11T23:35:00.257 INFO:teuthology.orchestra.run.smithi160.stdout: "op_send_bytes": 23055, 2024-09-11T23:35:00.257 INFO:teuthology.orchestra.run.smithi160.stdout: "op_resend": 33, 2024-09-11T23:35:00.258 INFO:teuthology.orchestra.run.smithi160.stdout: "op_reply": 40, 2024-09-11T23:35:00.258 INFO:teuthology.orchestra.run.smithi160.stdout: "op_latency": { 2024-09-11T23:35:00.258 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 40, 2024-09-11T23:35:00.258 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.232997095, 2024-09-11T23:35:00.258 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.005824927 2024-09-11T23:35:00.258 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:00.258 INFO:teuthology.orchestra.run.smithi160.stdout: "op_inflight": 0, 2024-09-11T23:35:00.258 INFO:teuthology.orchestra.run.smithi160.stdout: "oplen_avg": { 2024-09-11T23:35:00.258 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 40, 2024-09-11T23:35:00.258 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 63 2024-09-11T23:35:00.258 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:00.258 INFO:teuthology.orchestra.run.smithi160.stdout: "op": 40, 2024-09-11T23:35:00.258 INFO:teuthology.orchestra.run.smithi160.stdout: "op_r": 0, 2024-09-11T23:35:00.259 INFO:teuthology.orchestra.run.smithi160.stdout: "op_w": 40, 2024-09-11T23:35:00.259 INFO:teuthology.orchestra.run.smithi160.stdout: "op_rmw": 0, 2024-09-11T23:35:00.259 INFO:teuthology.orchestra.run.smithi160.stdout: "op_pg": 0, 2024-09-11T23:35:00.259 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_stat": 0, 2024-09-11T23:35:00.259 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_create": 10, 2024-09-11T23:35:00.259 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_read": 0, 2024-09-11T23:35:00.259 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_write": 4, 2024-09-11T23:35:00.259 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_writefull": 6, 2024-09-11T23:35:00.259 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_writesame": 0, 2024-09-11T23:35:00.259 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_append": 0, 2024-09-11T23:35:00.259 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_zero": 0, 2024-09-11T23:35:00.259 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_truncate": 0, 2024-09-11T23:35:00.259 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_delete": 6, 2024-09-11T23:35:00.259 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_mapext": 0, 2024-09-11T23:35:00.259 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_sparse_read": 0, 2024-09-11T23:35:00.260 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_clonerange": 0, 2024-09-11T23:35:00.260 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_getxattr": 0, 2024-09-11T23:35:00.260 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_setxattr": 20, 2024-09-11T23:35:00.260 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_cmpxattr": 0, 2024-09-11T23:35:00.260 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_rmxattr": 0, 2024-09-11T23:35:00.260 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_resetxattrs": 0, 2024-09-11T23:35:00.260 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_call": 0, 2024-09-11T23:35:00.260 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_watch": 0, 2024-09-11T23:35:00.260 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_notify": 0, 2024-09-11T23:35:00.260 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_src_cmpxattr": 0, 2024-09-11T23:35:00.260 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_pgls": 0, 2024-09-11T23:35:00.260 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_pgls_filter": 0, 2024-09-11T23:35:00.260 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_other": 0, 2024-09-11T23:35:00.260 INFO:teuthology.orchestra.run.smithi160.stdout: "linger_active": 0, 2024-09-11T23:35:00.261 INFO:teuthology.orchestra.run.smithi160.stdout: "linger_send": 0, 2024-09-11T23:35:00.261 INFO:teuthology.orchestra.run.smithi160.stdout: "linger_resend": 0, 2024-09-11T23:35:00.261 INFO:teuthology.orchestra.run.smithi160.stdout: "linger_ping": 0, 2024-09-11T23:35:00.261 INFO:teuthology.orchestra.run.smithi160.stdout: "poolop_active": 0, 2024-09-11T23:35:00.261 INFO:teuthology.orchestra.run.smithi160.stdout: "poolop_send": 0, 2024-09-11T23:35:00.261 INFO:teuthology.orchestra.run.smithi160.stdout: "poolop_resend": 0, 2024-09-11T23:35:00.261 INFO:teuthology.orchestra.run.smithi160.stdout: "poolstat_active": 0, 2024-09-11T23:35:00.261 INFO:teuthology.orchestra.run.smithi160.stdout: "poolstat_send": 0, 2024-09-11T23:35:00.261 INFO:teuthology.orchestra.run.smithi160.stdout: "poolstat_resend": 0, 2024-09-11T23:35:00.261 INFO:teuthology.orchestra.run.smithi160.stdout: "statfs_active": 0, 2024-09-11T23:35:00.261 INFO:teuthology.orchestra.run.smithi160.stdout: "statfs_send": 0, 2024-09-11T23:35:00.261 INFO:teuthology.orchestra.run.smithi160.stdout: "statfs_resend": 0, 2024-09-11T23:35:00.261 INFO:teuthology.orchestra.run.smithi160.stdout: "command_active": 0, 2024-09-11T23:35:00.262 INFO:teuthology.orchestra.run.smithi160.stdout: "command_send": 0, 2024-09-11T23:35:00.262 INFO:teuthology.orchestra.run.smithi160.stdout: "command_resend": 0, 2024-09-11T23:35:00.262 INFO:teuthology.orchestra.run.smithi160.stdout: "map_epoch": 95, 2024-09-11T23:35:00.262 INFO:teuthology.orchestra.run.smithi160.stdout: "map_full": 0, 2024-09-11T23:35:00.262 INFO:teuthology.orchestra.run.smithi160.stdout: "map_inc": 2, 2024-09-11T23:35:00.262 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_sessions": 9, 2024-09-11T23:35:00.262 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_session_open": 13, 2024-09-11T23:35:00.262 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_session_close": 4, 2024-09-11T23:35:00.262 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_laggy": 0, 2024-09-11T23:35:00.262 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_wr": 16, 2024-09-11T23:35:00.262 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_rd": 0, 2024-09-11T23:35:00.262 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_del": 1 2024-09-11T23:35:00.262 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:00.262 INFO:teuthology.orchestra.run.smithi160.stdout: "oft": { 2024-09-11T23:35:00.263 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_total_objs": 1, 2024-09-11T23:35:00.263 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_total_kv_pairs": 0, 2024-09-11T23:35:00.263 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_total_updates": 0, 2024-09-11T23:35:00.263 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_total_removes": 0 2024-09-11T23:35:00.263 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:00.263 INFO:teuthology.orchestra.run.smithi160.stdout: "osd-slow-ops": { 2024-09-11T23:35:00.263 INFO:teuthology.orchestra.run.smithi160.stdout: "slow_ops_count": 0 2024-09-11T23:35:00.263 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:00.263 INFO:teuthology.orchestra.run.smithi160.stdout: "purge_queue": { 2024-09-11T23:35:00.263 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_executing_ops": 0, 2024-09-11T23:35:00.263 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_executing_ops_high_water": 0, 2024-09-11T23:35:00.263 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_executing": 0, 2024-09-11T23:35:00.263 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_executing_high_water": 0, 2024-09-11T23:35:00.263 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_executed_ops": 0, 2024-09-11T23:35:00.263 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_executed": 0, 2024-09-11T23:35:00.264 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_item_in_journal": 0 2024-09-11T23:35:00.264 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:00.264 INFO:teuthology.orchestra.run.smithi160.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-11T23:35:00.264 INFO:teuthology.orchestra.run.smithi160.stdout: "val": 0, 2024-09-11T23:35:00.264 INFO:teuthology.orchestra.run.smithi160.stdout: "max": 104857600, 2024-09-11T23:35:00.264 INFO:teuthology.orchestra.run.smithi160.stdout: "get_started": 0, 2024-09-11T23:35:00.264 INFO:teuthology.orchestra.run.smithi160.stdout: "get": 715, 2024-09-11T23:35:00.264 INFO:teuthology.orchestra.run.smithi160.stdout: "get_sum": 841979, 2024-09-11T23:35:00.264 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_fail": 0, 2024-09-11T23:35:00.264 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_success": 715, 2024-09-11T23:35:00.264 INFO:teuthology.orchestra.run.smithi160.stdout: "take": 0, 2024-09-11T23:35:00.264 INFO:teuthology.orchestra.run.smithi160.stdout: "take_sum": 0, 2024-09-11T23:35:00.264 INFO:teuthology.orchestra.run.smithi160.stdout: "put": 715, 2024-09-11T23:35:00.265 INFO:teuthology.orchestra.run.smithi160.stdout: "put_sum": 841979, 2024-09-11T23:35:00.265 INFO:teuthology.orchestra.run.smithi160.stdout: "wait": { 2024-09-11T23:35:00.265 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:35:00.265 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:35:00.265 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:35:00.265 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-11T23:35:00.265 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:00.265 INFO:teuthology.orchestra.run.smithi160.stdout: "throttle-objecter_bytes": { 2024-09-11T23:35:00.265 INFO:teuthology.orchestra.run.smithi160.stdout: "val": 0, 2024-09-11T23:35:00.265 INFO:teuthology.orchestra.run.smithi160.stdout: "max": 104857600, 2024-09-11T23:35:00.265 INFO:teuthology.orchestra.run.smithi160.stdout: "get_started": 0, 2024-09-11T23:35:00.265 INFO:teuthology.orchestra.run.smithi160.stdout: "get": 0, 2024-09-11T23:35:00.265 INFO:teuthology.orchestra.run.smithi160.stdout: "get_sum": 0, 2024-09-11T23:35:00.265 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_fail": 0, 2024-09-11T23:35:00.266 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_success": 0, 2024-09-11T23:35:00.266 INFO:teuthology.orchestra.run.smithi160.stdout: "take": 40, 2024-09-11T23:35:00.266 INFO:teuthology.orchestra.run.smithi160.stdout: "take_sum": 23055, 2024-09-11T23:35:00.266 INFO:teuthology.orchestra.run.smithi160.stdout: "put": 40, 2024-09-11T23:35:00.266 INFO:teuthology.orchestra.run.smithi160.stdout: "put_sum": 23055, 2024-09-11T23:35:00.266 INFO:teuthology.orchestra.run.smithi160.stdout: "wait": { 2024-09-11T23:35:00.266 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:35:00.266 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:35:00.266 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:35:00.266 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-11T23:35:00.266 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:00.266 INFO:teuthology.orchestra.run.smithi160.stdout: "throttle-objecter_ops": { 2024-09-11T23:35:00.266 INFO:teuthology.orchestra.run.smithi160.stdout: "val": 0, 2024-09-11T23:35:00.266 INFO:teuthology.orchestra.run.smithi160.stdout: "max": 1024, 2024-09-11T23:35:00.267 INFO:teuthology.orchestra.run.smithi160.stdout: "get_started": 0, 2024-09-11T23:35:00.267 INFO:teuthology.orchestra.run.smithi160.stdout: "get": 0, 2024-09-11T23:35:00.267 INFO:teuthology.orchestra.run.smithi160.stdout: "get_sum": 0, 2024-09-11T23:35:00.267 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_fail": 0, 2024-09-11T23:35:00.267 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_success": 0, 2024-09-11T23:35:00.267 INFO:teuthology.orchestra.run.smithi160.stdout: "take": 40, 2024-09-11T23:35:00.267 INFO:teuthology.orchestra.run.smithi160.stdout: "take_sum": 40, 2024-09-11T23:35:00.267 INFO:teuthology.orchestra.run.smithi160.stdout: "put": 40, 2024-09-11T23:35:00.267 INFO:teuthology.orchestra.run.smithi160.stdout: "put_sum": 40, 2024-09-11T23:35:00.267 INFO:teuthology.orchestra.run.smithi160.stdout: "wait": { 2024-09-11T23:35:00.267 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:35:00.267 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:35:00.267 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:35:00.267 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-11T23:35:00.267 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:00.268 INFO:teuthology.orchestra.run.smithi160.stdout: "throttle-write_buf_throttle": { 2024-09-11T23:35:00.268 INFO:teuthology.orchestra.run.smithi160.stdout: "val": 0, 2024-09-11T23:35:00.268 INFO:teuthology.orchestra.run.smithi160.stdout: "max": 3758096384, 2024-09-11T23:35:00.268 INFO:teuthology.orchestra.run.smithi160.stdout: "get_started": 0, 2024-09-11T23:35:00.268 INFO:teuthology.orchestra.run.smithi160.stdout: "get": 0, 2024-09-11T23:35:00.268 INFO:teuthology.orchestra.run.smithi160.stdout: "get_sum": 0, 2024-09-11T23:35:00.268 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_fail": 0, 2024-09-11T23:35:00.268 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_success": 0, 2024-09-11T23:35:00.268 INFO:teuthology.orchestra.run.smithi160.stdout: "take": 0, 2024-09-11T23:35:00.268 INFO:teuthology.orchestra.run.smithi160.stdout: "take_sum": 0, 2024-09-11T23:35:00.268 INFO:teuthology.orchestra.run.smithi160.stdout: "put": 0, 2024-09-11T23:35:00.268 INFO:teuthology.orchestra.run.smithi160.stdout: "put_sum": 0, 2024-09-11T23:35:00.268 INFO:teuthology.orchestra.run.smithi160.stdout: "wait": { 2024-09-11T23:35:00.268 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:35:00.269 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:35:00.269 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:35:00.269 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-11T23:35:00.269 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:00.269 INFO:teuthology.orchestra.run.smithi160.stdout: "throttle-write_buf_throttle-0x56340fdd0960": { 2024-09-11T23:35:00.269 INFO:teuthology.orchestra.run.smithi160.stdout: "val": 0, 2024-09-11T23:35:00.269 INFO:teuthology.orchestra.run.smithi160.stdout: "max": 3758096384, 2024-09-11T23:35:00.269 INFO:teuthology.orchestra.run.smithi160.stdout: "get_started": 0, 2024-09-11T23:35:00.269 INFO:teuthology.orchestra.run.smithi160.stdout: "get": 5, 2024-09-11T23:35:00.269 INFO:teuthology.orchestra.run.smithi160.stdout: "get_sum": 12108, 2024-09-11T23:35:00.269 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_fail": 0, 2024-09-11T23:35:00.269 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_success": 5, 2024-09-11T23:35:00.269 INFO:teuthology.orchestra.run.smithi160.stdout: "take": 0, 2024-09-11T23:35:00.269 INFO:teuthology.orchestra.run.smithi160.stdout: "take_sum": 0, 2024-09-11T23:35:00.270 INFO:teuthology.orchestra.run.smithi160.stdout: "put": 4, 2024-09-11T23:35:00.270 INFO:teuthology.orchestra.run.smithi160.stdout: "put_sum": 12108, 2024-09-11T23:35:00.270 INFO:teuthology.orchestra.run.smithi160.stdout: "wait": { 2024-09-11T23:35:00.270 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:35:00.270 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:35:00.270 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:35:00.270 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-11T23:35:00.270 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-11T23:35:00.270 INFO:teuthology.orchestra.run.smithi160.stdout:} 2024-09-11T23:35:00.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:34:59 smithi123 ceph-mon[35438]: pgmap v868: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 853 B/s wr, 9 op/s 2024-09-11T23:35:00.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:34:59 smithi037 ceph-mon[30630]: pgmap v868: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 853 B/s wr, 9 op/s 2024-09-11T23:35:01.180 INFO:tasks.check_counter:Daemon mds.i mds.exported=0 2024-09-11T23:35:01.180 INFO:tasks.check_counter:Daemon mds.i mds.imported=1 2024-09-11T23:35:01.180 DEBUG:tasks.check_counter:Getting stats from l 2024-09-11T23:35:01.180 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph daemon mds.l perf dump 2024-09-11T23:35:01.431 INFO:teuthology.orchestra.run.smithi160.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T23:35:02.028 INFO:teuthology.orchestra.run.smithi160.stdout:{ 2024-09-11T23:35:02.028 INFO:teuthology.orchestra.run.smithi160.stdout: "AsyncMessenger::Worker-0": { 2024-09-11T23:35:02.028 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_messages": 1392, 2024-09-11T23:35:02.028 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages": 1385, 2024-09-11T23:35:02.028 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_bytes": 1170928, 2024-09-11T23:35:02.029 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_bytes": 533054, 2024-09-11T23:35:02.029 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_created_connections": 5, 2024-09-11T23:35:02.029 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_active_connections": 1, 2024-09-11T23:35:02.029 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_total_time": 0.150113814, 2024-09-11T23:35:02.029 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_send_time": 0.051136422, 2024-09-11T23:35:02.029 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_recv_time": 0.060720860, 2024-09-11T23:35:02.029 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_fast_dispatch_time": 0.035796796, 2024-09-11T23:35:02.029 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T23:35:02.029 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 1384, 2024-09-11T23:35:02.029 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.086939511, 2024-09-11T23:35:02.029 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000062817 2024-09-11T23:35:02.030 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:02.030 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_handle_ack_lat": { 2024-09-11T23:35:02.030 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:35:02.030 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:35:02.030 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:35:02.030 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:02.030 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_encrypted_bytes": 813088, 2024-09-11T23:35:02.030 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_encrypted_bytes": 194384 2024-09-11T23:35:02.030 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:02.030 INFO:teuthology.orchestra.run.smithi160.stdout: "AsyncMessenger::Worker-1": { 2024-09-11T23:35:02.030 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_messages": 4, 2024-09-11T23:35:02.030 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages": 241, 2024-09-11T23:35:02.031 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_bytes": 876, 2024-09-11T23:35:02.031 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_bytes": 566202, 2024-09-11T23:35:02.031 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_created_connections": 5, 2024-09-11T23:35:02.031 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_active_connections": 3, 2024-09-11T23:35:02.031 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_total_time": 0.012424691, 2024-09-11T23:35:02.031 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_send_time": 0.009201596, 2024-09-11T23:35:02.031 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_recv_time": 0.001230291, 2024-09-11T23:35:02.031 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_fast_dispatch_time": 0.000063443, 2024-09-11T23:35:02.031 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T23:35:02.031 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 239, 2024-09-11T23:35:02.031 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.019688916, 2024-09-11T23:35:02.031 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000082380 2024-09-11T23:35:02.031 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:02.032 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_handle_ack_lat": { 2024-09-11T23:35:02.032 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:35:02.032 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:35:02.032 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:35:02.032 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:02.032 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-11T23:35:02.032 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_encrypted_bytes": 565504 2024-09-11T23:35:02.032 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:02.032 INFO:teuthology.orchestra.run.smithi160.stdout: "AsyncMessenger::Worker-2": { 2024-09-11T23:35:02.032 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_messages": 1099, 2024-09-11T23:35:02.032 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages": 1099, 2024-09-11T23:35:02.032 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_bytes": 302187, 2024-09-11T23:35:02.032 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_bytes": 348665, 2024-09-11T23:35:02.033 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_created_connections": 5, 2024-09-11T23:35:02.033 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_active_connections": 3, 2024-09-11T23:35:02.033 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_total_time": 0.094099860, 2024-09-11T23:35:02.033 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_send_time": 0.030160956, 2024-09-11T23:35:02.033 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_recv_time": 0.026493714, 2024-09-11T23:35:02.033 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_fast_dispatch_time": 0.028696764, 2024-09-11T23:35:02.033 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T23:35:02.033 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 1098, 2024-09-11T23:35:02.033 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.071553638, 2024-09-11T23:35:02.033 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000065167 2024-09-11T23:35:02.033 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:02.033 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_handle_ack_lat": { 2024-09-11T23:35:02.033 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:35:02.034 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:35:02.034 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:35:02.034 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:02.034 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_encrypted_bytes": 3024, 2024-09-11T23:35:02.034 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_encrypted_bytes": 448 2024-09-11T23:35:02.034 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:02.034 INFO:teuthology.orchestra.run.smithi160.stdout: "cct": { 2024-09-11T23:35:02.034 INFO:teuthology.orchestra.run.smithi160.stdout: "total_workers": 1, 2024-09-11T23:35:02.034 INFO:teuthology.orchestra.run.smithi160.stdout: "unhealthy_workers": 0 2024-09-11T23:35:02.034 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:02.034 INFO:teuthology.orchestra.run.smithi160.stdout: "finisher-MDSRank": { 2024-09-11T23:35:02.034 INFO:teuthology.orchestra.run.smithi160.stdout: "queue_len": 0, 2024-09-11T23:35:02.034 INFO:teuthology.orchestra.run.smithi160.stdout: "complete_latency": { 2024-09-11T23:35:02.034 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 4293, 2024-09-11T23:35:02.035 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.120447593, 2024-09-11T23:35:02.035 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000028056 2024-09-11T23:35:02.035 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-11T23:35:02.035 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:02.035 INFO:teuthology.orchestra.run.smithi160.stdout: "finisher-PurgeQueue": { 2024-09-11T23:35:02.035 INFO:teuthology.orchestra.run.smithi160.stdout: "queue_len": 0, 2024-09-11T23:35:02.035 INFO:teuthology.orchestra.run.smithi160.stdout: "complete_latency": { 2024-09-11T23:35:02.035 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:35:02.035 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:35:02.035 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:35:02.035 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-11T23:35:02.035 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:02.035 INFO:teuthology.orchestra.run.smithi160.stdout: "mds": { 2024-09-11T23:35:02.036 INFO:teuthology.orchestra.run.smithi160.stdout: "request": 0, 2024-09-11T23:35:02.036 INFO:teuthology.orchestra.run.smithi160.stdout: "reply": 0, 2024-09-11T23:35:02.036 INFO:teuthology.orchestra.run.smithi160.stdout: "reply_latency": { 2024-09-11T23:35:02.036 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:35:02.036 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:35:02.036 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:35:02.036 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:02.036 INFO:teuthology.orchestra.run.smithi160.stdout: "slow_reply": 0, 2024-09-11T23:35:02.036 INFO:teuthology.orchestra.run.smithi160.stdout: "forward": 0, 2024-09-11T23:35:02.036 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_fetch_complete": 0, 2024-09-11T23:35:02.036 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_fetch_keys": 0, 2024-09-11T23:35:02.036 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_commit": 0, 2024-09-11T23:35:02.036 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_split": 0, 2024-09-11T23:35:02.037 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_merge": 0, 2024-09-11T23:35:02.037 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes": 13, 2024-09-11T23:35:02.037 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes_top": 0, 2024-09-11T23:35:02.037 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes_bottom": 13, 2024-09-11T23:35:02.037 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes_pin_tail": 0, 2024-09-11T23:35:02.037 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes_pinned": 13, 2024-09-11T23:35:02.037 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes_expired": 0, 2024-09-11T23:35:02.037 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes_with_caps": 0, 2024-09-11T23:35:02.037 INFO:teuthology.orchestra.run.smithi160.stdout: "caps": 0, 2024-09-11T23:35:02.038 INFO:teuthology.orchestra.run.smithi160.stdout: "subtrees": 3, 2024-09-11T23:35:02.038 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse": 0, 2024-09-11T23:35:02.038 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse_hit": 0, 2024-09-11T23:35:02.038 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse_forward": 0, 2024-09-11T23:35:02.038 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse_discover": 0, 2024-09-11T23:35:02.038 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse_dir_fetch": 0, 2024-09-11T23:35:02.038 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse_remote_ino": 0, 2024-09-11T23:35:02.038 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse_lock": 0, 2024-09-11T23:35:02.038 INFO:teuthology.orchestra.run.smithi160.stdout: "load_cent": 0, 2024-09-11T23:35:02.038 INFO:teuthology.orchestra.run.smithi160.stdout: "q": 0, 2024-09-11T23:35:02.038 INFO:teuthology.orchestra.run.smithi160.stdout: "exported": 0, 2024-09-11T23:35:02.038 INFO:teuthology.orchestra.run.smithi160.stdout: "exported_inodes": 0, 2024-09-11T23:35:02.039 INFO:teuthology.orchestra.run.smithi160.stdout: "imported": 0, 2024-09-11T23:35:02.039 INFO:teuthology.orchestra.run.smithi160.stdout: "imported_inodes": 0, 2024-09-11T23:35:02.039 INFO:teuthology.orchestra.run.smithi160.stdout: "openino_dir_fetch": 0, 2024-09-11T23:35:02.039 INFO:teuthology.orchestra.run.smithi160.stdout: "openino_backtrace_fetch": 0, 2024-09-11T23:35:02.039 INFO:teuthology.orchestra.run.smithi160.stdout: "openino_peer_discover": 0, 2024-09-11T23:35:02.039 INFO:teuthology.orchestra.run.smithi160.stdout: "root_rfiles": 0, 2024-09-11T23:35:02.039 INFO:teuthology.orchestra.run.smithi160.stdout: "root_rbytes": 0, 2024-09-11T23:35:02.039 INFO:teuthology.orchestra.run.smithi160.stdout: "root_rsnaps": 0, 2024-09-11T23:35:02.039 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_backtrace_fetch": 0, 2024-09-11T23:35:02.039 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_set_tag": 0, 2024-09-11T23:35:02.039 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_backtrace_repaired": 0, 2024-09-11T23:35:02.039 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_inotable_repaired": 0, 2024-09-11T23:35:02.039 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_dir_inodes": 0, 2024-09-11T23:35:02.039 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_dir_base_inodes": 0, 2024-09-11T23:35:02.040 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_dirfrag_rstats": 0, 2024-09-11T23:35:02.040 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_file_inodes": 0, 2024-09-11T23:35:02.040 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_inode_file_caps": 0, 2024-09-11T23:35:02.040 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_cap_op_revoke": 0, 2024-09-11T23:35:02.040 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_cap_op_grant": 0, 2024-09-11T23:35:02.040 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_cap_op_trunc": 0, 2024-09-11T23:35:02.040 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-11T23:35:02.040 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-11T23:35:02.040 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_client_caps": 0, 2024-09-11T23:35:02.040 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_client_caps_dirty": 0, 2024-09-11T23:35:02.040 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_client_cap_release": 0, 2024-09-11T23:35:02.040 INFO:teuthology.orchestra.run.smithi160.stdout: "process_request_cap_release": 0 2024-09-11T23:35:02.040 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:02.041 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_cache": { 2024-09-11T23:35:02.041 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_update": 0, 2024-09-11T23:35:02.041 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_update_receipt": 0, 2024-09-11T23:35:02.041 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_try_discover": 0, 2024-09-11T23:35:02.041 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_send_discover": 0, 2024-09-11T23:35:02.041 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_handle_discover": 0, 2024-09-11T23:35:02.041 INFO:teuthology.orchestra.run.smithi160.stdout: "num_strays": 0, 2024-09-11T23:35:02.041 INFO:teuthology.orchestra.run.smithi160.stdout: "num_strays_delayed": 0, 2024-09-11T23:35:02.041 INFO:teuthology.orchestra.run.smithi160.stdout: "num_strays_enqueuing": 0, 2024-09-11T23:35:02.041 INFO:teuthology.orchestra.run.smithi160.stdout: "strays_created": 0, 2024-09-11T23:35:02.041 INFO:teuthology.orchestra.run.smithi160.stdout: "strays_enqueued": 0, 2024-09-11T23:35:02.041 INFO:teuthology.orchestra.run.smithi160.stdout: "strays_reintegrated": 0, 2024-09-11T23:35:02.041 INFO:teuthology.orchestra.run.smithi160.stdout: "strays_migrated": 0, 2024-09-11T23:35:02.042 INFO:teuthology.orchestra.run.smithi160.stdout: "num_recovering_processing": 0, 2024-09-11T23:35:02.042 INFO:teuthology.orchestra.run.smithi160.stdout: "num_recovering_enqueued": 0, 2024-09-11T23:35:02.042 INFO:teuthology.orchestra.run.smithi160.stdout: "num_recovering_prioritized": 0, 2024-09-11T23:35:02.042 INFO:teuthology.orchestra.run.smithi160.stdout: "recovery_started": 0, 2024-09-11T23:35:02.042 INFO:teuthology.orchestra.run.smithi160.stdout: "recovery_completed": 0, 2024-09-11T23:35:02.042 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_quiesce_path": 0, 2024-09-11T23:35:02.042 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_quiesce_inode": 0, 2024-09-11T23:35:02.042 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_enqueue_scrub": 0, 2024-09-11T23:35:02.042 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_exportdir": 0, 2024-09-11T23:35:02.042 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_flush": 0, 2024-09-11T23:35:02.043 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_fragmentdir": 0, 2024-09-11T23:35:02.043 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_fragstats": 0, 2024-09-11T23:35:02.043 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_inodestats": 0 2024-09-11T23:35:02.043 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:02.043 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_log": { 2024-09-11T23:35:02.043 INFO:teuthology.orchestra.run.smithi160.stdout: "evlrg": 0, 2024-09-11T23:35:02.043 INFO:teuthology.orchestra.run.smithi160.stdout: "evadd": 0, 2024-09-11T23:35:02.043 INFO:teuthology.orchestra.run.smithi160.stdout: "evex": 0, 2024-09-11T23:35:02.043 INFO:teuthology.orchestra.run.smithi160.stdout: "evtrm": 0, 2024-09-11T23:35:02.043 INFO:teuthology.orchestra.run.smithi160.stdout: "ev": 5, 2024-09-11T23:35:02.043 INFO:teuthology.orchestra.run.smithi160.stdout: "evexg": 0, 2024-09-11T23:35:02.043 INFO:teuthology.orchestra.run.smithi160.stdout: "evexd": 0, 2024-09-11T23:35:02.043 INFO:teuthology.orchestra.run.smithi160.stdout: "segadd": 0, 2024-09-11T23:35:02.044 INFO:teuthology.orchestra.run.smithi160.stdout: "segex": 0, 2024-09-11T23:35:02.044 INFO:teuthology.orchestra.run.smithi160.stdout: "segtrm": 0, 2024-09-11T23:35:02.044 INFO:teuthology.orchestra.run.smithi160.stdout: "seg": 2, 2024-09-11T23:35:02.044 INFO:teuthology.orchestra.run.smithi160.stdout: "segmjr": 2, 2024-09-11T23:35:02.044 INFO:teuthology.orchestra.run.smithi160.stdout: "segexg": 0, 2024-09-11T23:35:02.044 INFO:teuthology.orchestra.run.smithi160.stdout: "segexd": 0, 2024-09-11T23:35:02.044 INFO:teuthology.orchestra.run.smithi160.stdout: "expos": 4194304, 2024-09-11T23:35:02.044 INFO:teuthology.orchestra.run.smithi160.stdout: "wrpos": 4206412, 2024-09-11T23:35:02.044 INFO:teuthology.orchestra.run.smithi160.stdout: "rdpos": 4203975, 2024-09-11T23:35:02.045 INFO:teuthology.orchestra.run.smithi160.stdout: "jlat": { 2024-09-11T23:35:02.045 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:35:02.045 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:35:02.045 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:35:02.045 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:02.045 INFO:teuthology.orchestra.run.smithi160.stdout: "replayed": 5 2024-09-11T23:35:02.045 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:02.045 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_mem": { 2024-09-11T23:35:02.045 INFO:teuthology.orchestra.run.smithi160.stdout: "ino": 13, 2024-09-11T23:35:02.045 INFO:teuthology.orchestra.run.smithi160.stdout: "ino+": 13, 2024-09-11T23:35:02.045 INFO:teuthology.orchestra.run.smithi160.stdout: "ino-": 0, 2024-09-11T23:35:02.045 INFO:teuthology.orchestra.run.smithi160.stdout: "dir": 9, 2024-09-11T23:35:02.045 INFO:teuthology.orchestra.run.smithi160.stdout: "dir+": 9, 2024-09-11T23:35:02.046 INFO:teuthology.orchestra.run.smithi160.stdout: "dir-": 0, 2024-09-11T23:35:02.046 INFO:teuthology.orchestra.run.smithi160.stdout: "dn": 13, 2024-09-11T23:35:02.046 INFO:teuthology.orchestra.run.smithi160.stdout: "dn+": 13, 2024-09-11T23:35:02.046 INFO:teuthology.orchestra.run.smithi160.stdout: "dn-": 0, 2024-09-11T23:35:02.046 INFO:teuthology.orchestra.run.smithi160.stdout: "cap": 0, 2024-09-11T23:35:02.046 INFO:teuthology.orchestra.run.smithi160.stdout: "cap+": 0, 2024-09-11T23:35:02.046 INFO:teuthology.orchestra.run.smithi160.stdout: "cap-": 0, 2024-09-11T23:35:02.046 INFO:teuthology.orchestra.run.smithi160.stdout: "rss": 48668, 2024-09-11T23:35:02.046 INFO:teuthology.orchestra.run.smithi160.stdout: "heap": 215328 2024-09-11T23:35:02.046 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:02.046 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_server": { 2024-09-11T23:35:02.046 INFO:teuthology.orchestra.run.smithi160.stdout: "dispatch_client_request": 0, 2024-09-11T23:35:02.046 INFO:teuthology.orchestra.run.smithi160.stdout: "dispatch_server_request": 0, 2024-09-11T23:35:02.046 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_client_request": 0, 2024-09-11T23:35:02.047 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_client_session": 0, 2024-09-11T23:35:02.047 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_peer_request": 0, 2024-09-11T23:35:02.047 INFO:teuthology.orchestra.run.smithi160.stdout: "req_create_latency": { 2024-09-11T23:35:02.047 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:35:02.047 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:35:02.047 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:35:02.047 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:02.047 INFO:teuthology.orchestra.run.smithi160.stdout: "req_getattr_latency": { 2024-09-11T23:35:02.047 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:35:02.047 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:35:02.047 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:35:02.047 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:02.047 INFO:teuthology.orchestra.run.smithi160.stdout: "req_getfilelock_latency": { 2024-09-11T23:35:02.047 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:35:02.048 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:35:02.048 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:35:02.048 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:02.048 INFO:teuthology.orchestra.run.smithi160.stdout: "req_link_latency": { 2024-09-11T23:35:02.048 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:35:02.048 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:35:02.048 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:35:02.048 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:02.048 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lookup_latency": { 2024-09-11T23:35:02.048 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:35:02.048 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:35:02.048 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:35:02.048 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:02.049 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lookuphash_latency": { 2024-09-11T23:35:02.049 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:35:02.049 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:35:02.049 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:35:02.049 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:02.049 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lookupino_latency": { 2024-09-11T23:35:02.049 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:35:02.049 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:35:02.049 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:35:02.049 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:02.049 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lookupname_latency": { 2024-09-11T23:35:02.049 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:35:02.049 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:35:02.049 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:35:02.050 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:02.050 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lookupparent_latency": { 2024-09-11T23:35:02.050 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:35:02.050 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:35:02.050 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:35:02.050 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:02.050 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lookupsnap_latency": { 2024-09-11T23:35:02.050 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:35:02.050 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:35:02.050 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:35:02.050 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:02.050 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lssnap_latency": { 2024-09-11T23:35:02.050 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:35:02.050 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:35:02.051 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:35:02.051 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:02.051 INFO:teuthology.orchestra.run.smithi160.stdout: "req_mkdir_latency": { 2024-09-11T23:35:02.051 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:35:02.051 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:35:02.051 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:35:02.051 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:02.051 INFO:teuthology.orchestra.run.smithi160.stdout: "req_mknod_latency": { 2024-09-11T23:35:02.051 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:35:02.051 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:35:02.051 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:35:02.051 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:02.052 INFO:teuthology.orchestra.run.smithi160.stdout: "req_mksnap_latency": { 2024-09-11T23:35:02.052 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:35:02.052 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:35:02.052 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:35:02.052 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:02.052 INFO:teuthology.orchestra.run.smithi160.stdout: "req_open_latency": { 2024-09-11T23:35:02.053 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:35:02.053 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:35:02.053 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:35:02.053 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:02.053 INFO:teuthology.orchestra.run.smithi160.stdout: "req_readdir_latency": { 2024-09-11T23:35:02.053 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:35:02.053 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:35:02.053 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:35:02.053 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:02.054 INFO:teuthology.orchestra.run.smithi160.stdout: "req_rename_latency": { 2024-09-11T23:35:02.054 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:35:02.054 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:35:02.054 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:35:02.054 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:02.054 INFO:teuthology.orchestra.run.smithi160.stdout: "req_renamesnap_latency": { 2024-09-11T23:35:02.054 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:35:02.054 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:35:02.054 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:35:02.054 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:02.054 INFO:teuthology.orchestra.run.smithi160.stdout: "req_snapdiff_latency": { 2024-09-11T23:35:02.054 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:35:02.055 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:35:02.055 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:35:02.055 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:02.055 INFO:teuthology.orchestra.run.smithi160.stdout: "req_rmdir_latency": { 2024-09-11T23:35:02.055 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:35:02.055 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:35:02.055 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:35:02.055 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:02.055 INFO:teuthology.orchestra.run.smithi160.stdout: "req_rmsnap_latency": { 2024-09-11T23:35:02.055 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:35:02.055 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:35:02.055 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:35:02.055 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:02.055 INFO:teuthology.orchestra.run.smithi160.stdout: "req_rmxattr_latency": { 2024-09-11T23:35:02.056 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:35:02.056 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:35:02.056 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:35:02.056 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:02.056 INFO:teuthology.orchestra.run.smithi160.stdout: "req_setattr_latency": { 2024-09-11T23:35:02.056 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:35:02.056 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:35:02.056 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:35:02.056 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:02.056 INFO:teuthology.orchestra.run.smithi160.stdout: "req_setdirlayout_latency": { 2024-09-11T23:35:02.057 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:35:02.057 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:35:02.057 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:35:02.057 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:02.057 INFO:teuthology.orchestra.run.smithi160.stdout: "req_setfilelock_latency": { 2024-09-11T23:35:02.057 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:35:02.057 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:35:02.057 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:35:02.057 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:02.057 INFO:teuthology.orchestra.run.smithi160.stdout: "req_setlayout_latency": { 2024-09-11T23:35:02.057 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:35:02.057 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:35:02.058 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:35:02.058 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:02.058 INFO:teuthology.orchestra.run.smithi160.stdout: "req_setxattr_latency": { 2024-09-11T23:35:02.058 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:35:02.058 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:35:02.058 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:35:02.058 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:02.058 INFO:teuthology.orchestra.run.smithi160.stdout: "req_symlink_latency": { 2024-09-11T23:35:02.058 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:35:02.058 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:35:02.058 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:35:02.058 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:02.058 INFO:teuthology.orchestra.run.smithi160.stdout: "req_unlink_latency": { 2024-09-11T23:35:02.058 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:35:02.059 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:35:02.059 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:35:02.059 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:02.059 INFO:teuthology.orchestra.run.smithi160.stdout: "cap_revoke_eviction": 0, 2024-09-11T23:35:02.059 INFO:teuthology.orchestra.run.smithi160.stdout: "cap_acquisition_throttle": 0, 2024-09-11T23:35:02.059 INFO:teuthology.orchestra.run.smithi160.stdout: "req_getvxattr_latency": { 2024-09-11T23:35:02.059 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:35:02.059 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:35:02.059 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:35:02.059 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-11T23:35:02.059 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:02.059 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_sessions": { 2024-09-11T23:35:02.059 INFO:teuthology.orchestra.run.smithi160.stdout: "session_count": 1, 2024-09-11T23:35:02.059 INFO:teuthology.orchestra.run.smithi160.stdout: "session_add": 1, 2024-09-11T23:35:02.060 INFO:teuthology.orchestra.run.smithi160.stdout: "session_remove": 0, 2024-09-11T23:35:02.060 INFO:teuthology.orchestra.run.smithi160.stdout: "sessions_open": 1, 2024-09-11T23:35:02.060 INFO:teuthology.orchestra.run.smithi160.stdout: "sessions_stale": 0, 2024-09-11T23:35:02.060 INFO:teuthology.orchestra.run.smithi160.stdout: "total_load": 0, 2024-09-11T23:35:02.060 INFO:teuthology.orchestra.run.smithi160.stdout: "average_load": 0, 2024-09-11T23:35:02.060 INFO:teuthology.orchestra.run.smithi160.stdout: "avg_session_uptime": 2350, 2024-09-11T23:35:02.060 INFO:teuthology.orchestra.run.smithi160.stdout: "mdthresh_evicted": 0 2024-09-11T23:35:02.060 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:02.060 INFO:teuthology.orchestra.run.smithi160.stdout: "mempool": { 2024-09-11T23:35:02.060 INFO:teuthology.orchestra.run.smithi160.stdout: "bloom_filter_bytes": 0, 2024-09-11T23:35:02.060 INFO:teuthology.orchestra.run.smithi160.stdout: "bloom_filter_items": 0, 2024-09-11T23:35:02.060 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_alloc_bytes": 0, 2024-09-11T23:35:02.060 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_alloc_items": 0, 2024-09-11T23:35:02.061 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_data_bytes": 0, 2024-09-11T23:35:02.061 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_data_items": 0, 2024-09-11T23:35:02.061 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-11T23:35:02.061 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_onode_items": 0, 2024-09-11T23:35:02.061 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-11T23:35:02.061 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_meta_items": 0, 2024-09-11T23:35:02.061 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_other_bytes": 0, 2024-09-11T23:35:02.061 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_other_items": 0, 2024-09-11T23:35:02.061 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-11T23:35:02.061 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_buffer_items": 0, 2024-09-11T23:35:02.061 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_extent_bytes": 0, 2024-09-11T23:35:02.061 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_extent_items": 0, 2024-09-11T23:35:02.061 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_blob_bytes": 0, 2024-09-11T23:35:02.061 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_blob_items": 0, 2024-09-11T23:35:02.062 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-11T23:35:02.062 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_shared_blob_items": 0, 2024-09-11T23:35:02.062 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-11T23:35:02.062 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_inline_bl_items": 0, 2024-09-11T23:35:02.062 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_fsck_bytes": 0, 2024-09-11T23:35:02.062 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_fsck_items": 0, 2024-09-11T23:35:02.062 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_txc_bytes": 0, 2024-09-11T23:35:02.062 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_txc_items": 0, 2024-09-11T23:35:02.062 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-11T23:35:02.062 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_writing_deferred_items": 0, 2024-09-11T23:35:02.062 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_writing_bytes": 0, 2024-09-11T23:35:02.062 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_writing_items": 0, 2024-09-11T23:35:02.062 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_bytes": 0, 2024-09-11T23:35:02.063 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_items": 0, 2024-09-11T23:35:02.063 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_file_reader_bytes": 0, 2024-09-11T23:35:02.063 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_file_reader_items": 0, 2024-09-11T23:35:02.063 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_file_writer_bytes": 0, 2024-09-11T23:35:02.063 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_file_writer_items": 0, 2024-09-11T23:35:02.063 INFO:teuthology.orchestra.run.smithi160.stdout: "buffer_anon_bytes": 183095, 2024-09-11T23:35:02.063 INFO:teuthology.orchestra.run.smithi160.stdout: "buffer_anon_items": 56, 2024-09-11T23:35:02.063 INFO:teuthology.orchestra.run.smithi160.stdout: "buffer_meta_bytes": 0, 2024-09-11T23:35:02.063 INFO:teuthology.orchestra.run.smithi160.stdout: "buffer_meta_items": 0, 2024-09-11T23:35:02.063 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_bytes": 0, 2024-09-11T23:35:02.063 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_items": 0, 2024-09-11T23:35:02.063 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_mapbl_bytes": 0, 2024-09-11T23:35:02.063 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_mapbl_items": 0, 2024-09-11T23:35:02.064 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_pglog_bytes": 0, 2024-09-11T23:35:02.064 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_pglog_items": 0, 2024-09-11T23:35:02.064 INFO:teuthology.orchestra.run.smithi160.stdout: "osdmap_bytes": 9336, 2024-09-11T23:35:02.064 INFO:teuthology.orchestra.run.smithi160.stdout: "osdmap_items": 176, 2024-09-11T23:35:02.064 INFO:teuthology.orchestra.run.smithi160.stdout: "osdmap_mapping_bytes": 0, 2024-09-11T23:35:02.064 INFO:teuthology.orchestra.run.smithi160.stdout: "osdmap_mapping_items": 0, 2024-09-11T23:35:02.064 INFO:teuthology.orchestra.run.smithi160.stdout: "pgmap_bytes": 0, 2024-09-11T23:35:02.064 INFO:teuthology.orchestra.run.smithi160.stdout: "pgmap_items": 0, 2024-09-11T23:35:02.064 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_co_bytes": 51147, 2024-09-11T23:35:02.064 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_co_items": 281, 2024-09-11T23:35:02.064 INFO:teuthology.orchestra.run.smithi160.stdout: "unittest_1_bytes": 0, 2024-09-11T23:35:02.064 INFO:teuthology.orchestra.run.smithi160.stdout: "unittest_1_items": 0, 2024-09-11T23:35:02.064 INFO:teuthology.orchestra.run.smithi160.stdout: "unittest_2_bytes": 0, 2024-09-11T23:35:02.064 INFO:teuthology.orchestra.run.smithi160.stdout: "unittest_2_items": 0 2024-09-11T23:35:02.065 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:02.065 INFO:teuthology.orchestra.run.smithi160.stdout: "objecter": { 2024-09-11T23:35:02.065 INFO:teuthology.orchestra.run.smithi160.stdout: "op_active": 0, 2024-09-11T23:35:02.065 INFO:teuthology.orchestra.run.smithi160.stdout: "op_laggy": 0, 2024-09-11T23:35:02.065 INFO:teuthology.orchestra.run.smithi160.stdout: "op_send": 2162, 2024-09-11T23:35:02.065 INFO:teuthology.orchestra.run.smithi160.stdout: "op_send_bytes": 21, 2024-09-11T23:35:02.065 INFO:teuthology.orchestra.run.smithi160.stdout: "op_resend": 3, 2024-09-11T23:35:02.065 INFO:teuthology.orchestra.run.smithi160.stdout: "op_reply": 2162, 2024-09-11T23:35:02.065 INFO:teuthology.orchestra.run.smithi160.stdout: "op_latency": { 2024-09-11T23:35:02.065 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 2162, 2024-09-11T23:35:02.065 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 13.200836872, 2024-09-11T23:35:02.065 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.006105844 2024-09-11T23:35:02.065 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:02.066 INFO:teuthology.orchestra.run.smithi160.stdout: "op_inflight": 0, 2024-09-11T23:35:02.066 INFO:teuthology.orchestra.run.smithi160.stdout: "oplen_avg": { 2024-09-11T23:35:02.066 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 2162, 2024-09-11T23:35:02.066 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 2163 2024-09-11T23:35:02.066 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:02.066 INFO:teuthology.orchestra.run.smithi160.stdout: "op": 2162, 2024-09-11T23:35:02.066 INFO:teuthology.orchestra.run.smithi160.stdout: "op_r": 2162, 2024-09-11T23:35:02.066 INFO:teuthology.orchestra.run.smithi160.stdout: "op_w": 0, 2024-09-11T23:35:02.066 INFO:teuthology.orchestra.run.smithi160.stdout: "op_rmw": 0, 2024-09-11T23:35:02.066 INFO:teuthology.orchestra.run.smithi160.stdout: "op_pg": 0, 2024-09-11T23:35:02.066 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_stat": 1089, 2024-09-11T23:35:02.066 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_create": 0, 2024-09-11T23:35:02.067 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_read": 1071, 2024-09-11T23:35:02.067 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_write": 0, 2024-09-11T23:35:02.067 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_writefull": 0, 2024-09-11T23:35:02.067 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_writesame": 0, 2024-09-11T23:35:02.067 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_append": 0, 2024-09-11T23:35:02.067 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_zero": 0, 2024-09-11T23:35:02.067 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_truncate": 0, 2024-09-11T23:35:02.067 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_delete": 0, 2024-09-11T23:35:02.067 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_mapext": 0, 2024-09-11T23:35:02.067 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_sparse_read": 0, 2024-09-11T23:35:02.067 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_clonerange": 0, 2024-09-11T23:35:02.067 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_getxattr": 1, 2024-09-11T23:35:02.067 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_setxattr": 0, 2024-09-11T23:35:02.068 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_cmpxattr": 0, 2024-09-11T23:35:02.068 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_rmxattr": 0, 2024-09-11T23:35:02.068 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_resetxattrs": 0, 2024-09-11T23:35:02.068 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_call": 0, 2024-09-11T23:35:02.068 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_watch": 0, 2024-09-11T23:35:02.068 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_notify": 0, 2024-09-11T23:35:02.068 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_src_cmpxattr": 0, 2024-09-11T23:35:02.068 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_pgls": 0, 2024-09-11T23:35:02.068 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_pgls_filter": 0, 2024-09-11T23:35:02.068 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_other": 0, 2024-09-11T23:35:02.069 INFO:teuthology.orchestra.run.smithi160.stdout: "linger_active": 0, 2024-09-11T23:35:02.069 INFO:teuthology.orchestra.run.smithi160.stdout: "linger_send": 0, 2024-09-11T23:35:02.069 INFO:teuthology.orchestra.run.smithi160.stdout: "linger_resend": 0, 2024-09-11T23:35:02.069 INFO:teuthology.orchestra.run.smithi160.stdout: "linger_ping": 0, 2024-09-11T23:35:02.069 INFO:teuthology.orchestra.run.smithi160.stdout: "poolop_active": 0, 2024-09-11T23:35:02.069 INFO:teuthology.orchestra.run.smithi160.stdout: "poolop_send": 0, 2024-09-11T23:35:02.069 INFO:teuthology.orchestra.run.smithi160.stdout: "poolop_resend": 0, 2024-09-11T23:35:02.069 INFO:teuthology.orchestra.run.smithi160.stdout: "poolstat_active": 0, 2024-09-11T23:35:02.069 INFO:teuthology.orchestra.run.smithi160.stdout: "poolstat_send": 0, 2024-09-11T23:35:02.069 INFO:teuthology.orchestra.run.smithi160.stdout: "poolstat_resend": 0, 2024-09-11T23:35:02.070 INFO:teuthology.orchestra.run.smithi160.stdout: "statfs_active": 0, 2024-09-11T23:35:02.070 INFO:teuthology.orchestra.run.smithi160.stdout: "statfs_send": 0, 2024-09-11T23:35:02.070 INFO:teuthology.orchestra.run.smithi160.stdout: "statfs_resend": 0, 2024-09-11T23:35:02.070 INFO:teuthology.orchestra.run.smithi160.stdout: "command_active": 0, 2024-09-11T23:35:02.070 INFO:teuthology.orchestra.run.smithi160.stdout: "command_send": 0, 2024-09-11T23:35:02.072 INFO:teuthology.orchestra.run.smithi160.stdout: "command_resend": 0, 2024-09-11T23:35:02.072 INFO:teuthology.orchestra.run.smithi160.stdout: "map_epoch": 95, 2024-09-11T23:35:02.072 INFO:teuthology.orchestra.run.smithi160.stdout: "map_full": 0, 2024-09-11T23:35:02.072 INFO:teuthology.orchestra.run.smithi160.stdout: "map_inc": 2, 2024-09-11T23:35:02.072 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_sessions": 4, 2024-09-11T23:35:02.072 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_session_open": 5, 2024-09-11T23:35:02.072 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_session_close": 1, 2024-09-11T23:35:02.073 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_laggy": 0, 2024-09-11T23:35:02.073 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_wr": 0, 2024-09-11T23:35:02.073 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_rd": 2, 2024-09-11T23:35:02.073 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_del": 0 2024-09-11T23:35:02.073 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:02.073 INFO:teuthology.orchestra.run.smithi160.stdout: "oft": { 2024-09-11T23:35:02.073 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_total_objs": 0, 2024-09-11T23:35:02.073 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_total_kv_pairs": 0, 2024-09-11T23:35:02.073 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_total_updates": 0, 2024-09-11T23:35:02.073 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_total_removes": 0 2024-09-11T23:35:02.073 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:02.073 INFO:teuthology.orchestra.run.smithi160.stdout: "osd-slow-ops": { 2024-09-11T23:35:02.073 INFO:teuthology.orchestra.run.smithi160.stdout: "slow_ops_count": 0 2024-09-11T23:35:02.074 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:02.074 INFO:teuthology.orchestra.run.smithi160.stdout: "purge_queue": { 2024-09-11T23:35:02.074 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_executing_ops": 0, 2024-09-11T23:35:02.074 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_executing_ops_high_water": 0, 2024-09-11T23:35:02.074 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_executing": 0, 2024-09-11T23:35:02.074 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_executing_high_water": 0, 2024-09-11T23:35:02.074 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_executed_ops": 0, 2024-09-11T23:35:02.074 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_executed": 0, 2024-09-11T23:35:02.074 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_item_in_journal": 0 2024-09-11T23:35:02.074 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:02.074 INFO:teuthology.orchestra.run.smithi160.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-11T23:35:02.074 INFO:teuthology.orchestra.run.smithi160.stdout: "val": 0, 2024-09-11T23:35:02.074 INFO:teuthology.orchestra.run.smithi160.stdout: "max": 104857600, 2024-09-11T23:35:02.074 INFO:teuthology.orchestra.run.smithi160.stdout: "get_started": 0, 2024-09-11T23:35:02.075 INFO:teuthology.orchestra.run.smithi160.stdout: "get": 2491, 2024-09-11T23:35:02.075 INFO:teuthology.orchestra.run.smithi160.stdout: "get_sum": 1229927, 2024-09-11T23:35:02.075 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_fail": 0, 2024-09-11T23:35:02.075 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_success": 2491, 2024-09-11T23:35:02.075 INFO:teuthology.orchestra.run.smithi160.stdout: "take": 0, 2024-09-11T23:35:02.075 INFO:teuthology.orchestra.run.smithi160.stdout: "take_sum": 0, 2024-09-11T23:35:02.075 INFO:teuthology.orchestra.run.smithi160.stdout: "put": 2491, 2024-09-11T23:35:02.075 INFO:teuthology.orchestra.run.smithi160.stdout: "put_sum": 1229927, 2024-09-11T23:35:02.075 INFO:teuthology.orchestra.run.smithi160.stdout: "wait": { 2024-09-11T23:35:02.075 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:35:02.075 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:35:02.075 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:35:02.075 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-11T23:35:02.075 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:02.076 INFO:teuthology.orchestra.run.smithi160.stdout: "throttle-objecter_bytes": { 2024-09-11T23:35:02.076 INFO:teuthology.orchestra.run.smithi160.stdout: "val": 0, 2024-09-11T23:35:02.076 INFO:teuthology.orchestra.run.smithi160.stdout: "max": 104857600, 2024-09-11T23:35:02.076 INFO:teuthology.orchestra.run.smithi160.stdout: "get_started": 0, 2024-09-11T23:35:02.076 INFO:teuthology.orchestra.run.smithi160.stdout: "get": 0, 2024-09-11T23:35:02.076 INFO:teuthology.orchestra.run.smithi160.stdout: "get_sum": 0, 2024-09-11T23:35:02.076 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_fail": 0, 2024-09-11T23:35:02.076 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_success": 0, 2024-09-11T23:35:02.076 INFO:teuthology.orchestra.run.smithi160.stdout: "take": 2162, 2024-09-11T23:35:02.076 INFO:teuthology.orchestra.run.smithi160.stdout: "take_sum": 12113, 2024-09-11T23:35:02.076 INFO:teuthology.orchestra.run.smithi160.stdout: "put": 2162, 2024-09-11T23:35:02.076 INFO:teuthology.orchestra.run.smithi160.stdout: "put_sum": 12113, 2024-09-11T23:35:02.076 INFO:teuthology.orchestra.run.smithi160.stdout: "wait": { 2024-09-11T23:35:02.077 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:35:02.077 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:35:02.077 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:35:02.077 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-11T23:35:02.077 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:02.077 INFO:teuthology.orchestra.run.smithi160.stdout: "throttle-objecter_ops": { 2024-09-11T23:35:02.077 INFO:teuthology.orchestra.run.smithi160.stdout: "val": 0, 2024-09-11T23:35:02.077 INFO:teuthology.orchestra.run.smithi160.stdout: "max": 1024, 2024-09-11T23:35:02.077 INFO:teuthology.orchestra.run.smithi160.stdout: "get_started": 0, 2024-09-11T23:35:02.077 INFO:teuthology.orchestra.run.smithi160.stdout: "get": 0, 2024-09-11T23:35:02.077 INFO:teuthology.orchestra.run.smithi160.stdout: "get_sum": 0, 2024-09-11T23:35:02.077 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_fail": 0, 2024-09-11T23:35:02.077 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_success": 0, 2024-09-11T23:35:02.078 INFO:teuthology.orchestra.run.smithi160.stdout: "take": 2162, 2024-09-11T23:35:02.078 INFO:teuthology.orchestra.run.smithi160.stdout: "take_sum": 2162, 2024-09-11T23:35:02.078 INFO:teuthology.orchestra.run.smithi160.stdout: "put": 2162, 2024-09-11T23:35:02.078 INFO:teuthology.orchestra.run.smithi160.stdout: "put_sum": 2162, 2024-09-11T23:35:02.078 INFO:teuthology.orchestra.run.smithi160.stdout: "wait": { 2024-09-11T23:35:02.078 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:35:02.078 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:35:02.078 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:35:02.078 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-11T23:35:02.078 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:02.078 INFO:teuthology.orchestra.run.smithi160.stdout: "throttle-write_buf_throttle": { 2024-09-11T23:35:02.078 INFO:teuthology.orchestra.run.smithi160.stdout: "val": 0, 2024-09-11T23:35:02.078 INFO:teuthology.orchestra.run.smithi160.stdout: "max": 3758096384, 2024-09-11T23:35:02.078 INFO:teuthology.orchestra.run.smithi160.stdout: "get_started": 0, 2024-09-11T23:35:02.079 INFO:teuthology.orchestra.run.smithi160.stdout: "get": 0, 2024-09-11T23:35:02.079 INFO:teuthology.orchestra.run.smithi160.stdout: "get_sum": 0, 2024-09-11T23:35:02.079 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_fail": 0, 2024-09-11T23:35:02.079 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_success": 0, 2024-09-11T23:35:02.079 INFO:teuthology.orchestra.run.smithi160.stdout: "take": 0, 2024-09-11T23:35:02.079 INFO:teuthology.orchestra.run.smithi160.stdout: "take_sum": 0, 2024-09-11T23:35:02.079 INFO:teuthology.orchestra.run.smithi160.stdout: "put": 0, 2024-09-11T23:35:02.079 INFO:teuthology.orchestra.run.smithi160.stdout: "put_sum": 0, 2024-09-11T23:35:02.079 INFO:teuthology.orchestra.run.smithi160.stdout: "wait": { 2024-09-11T23:35:02.079 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:35:02.079 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:35:02.079 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:35:02.079 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-11T23:35:02.080 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-11T23:35:02.080 INFO:teuthology.orchestra.run.smithi160.stdout: "throttle-write_buf_throttle-0x55d979818b40": { 2024-09-11T23:35:02.080 INFO:teuthology.orchestra.run.smithi160.stdout: "val": 0, 2024-09-11T23:35:02.080 INFO:teuthology.orchestra.run.smithi160.stdout: "max": 3758096384, 2024-09-11T23:35:02.080 INFO:teuthology.orchestra.run.smithi160.stdout: "get_started": 0, 2024-09-11T23:35:02.080 INFO:teuthology.orchestra.run.smithi160.stdout: "get": 0, 2024-09-11T23:35:02.080 INFO:teuthology.orchestra.run.smithi160.stdout: "get_sum": 0, 2024-09-11T23:35:02.080 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_fail": 0, 2024-09-11T23:35:02.080 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_success": 0, 2024-09-11T23:35:02.080 INFO:teuthology.orchestra.run.smithi160.stdout: "take": 0, 2024-09-11T23:35:02.080 INFO:teuthology.orchestra.run.smithi160.stdout: "take_sum": 0, 2024-09-11T23:35:02.080 INFO:teuthology.orchestra.run.smithi160.stdout: "put": 0, 2024-09-11T23:35:02.080 INFO:teuthology.orchestra.run.smithi160.stdout: "put_sum": 0, 2024-09-11T23:35:02.080 INFO:teuthology.orchestra.run.smithi160.stdout: "wait": { 2024-09-11T23:35:02.081 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-11T23:35:02.081 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-11T23:35:02.081 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-11T23:35:02.081 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-11T23:35:02.081 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-11T23:35:02.081 INFO:teuthology.orchestra.run.smithi160.stdout:} 2024-09-11T23:35:02.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:35:01 smithi160 ceph-mon[35055]: pgmap v869: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 853 B/s wr, 9 op/s 2024-09-11T23:35:02.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:35:01 smithi123 ceph-mon[35438]: pgmap v869: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 853 B/s wr, 9 op/s 2024-09-11T23:35:02.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:35:01 smithi037 ceph-mon[30630]: pgmap v869: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 853 B/s wr, 9 op/s 2024-09-11T23:35:02.752 INFO:tasks.check_counter:Daemon mds.l mds.exported=0 2024-09-11T23:35:02.752 INFO:tasks.check_counter:Daemon mds.l mds.imported=0 2024-09-11T23:35:02.752 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-11T23:35:02.763 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-11T23:35:02.763 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-11T23:35:02.763 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:35:02.814 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-11T23:35:02.814 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:35:02.895 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph osd blocklist ls 2024-09-11T23:35:03.326 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:35:03.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:03.919+0000 7fe349e00640 1 -- 172.21.15.37:0/3367468411 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe344103e30 msgr2=0x7fe344104210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:35:03.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:03.919+0000 7fe349e00640 1 --2- 172.21.15.37:0/3367468411 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe344103e30 0x7fe344104210 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe338009860 tx=0x7fe33802a340 comp rx=0 tx=0).stop 2024-09-11T23:35:03.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:03.919+0000 7fe349e00640 1 -- 172.21.15.37:0/3367468411 shutdown_connections 2024-09-11T23:35:03.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:03.919+0000 7fe349e00640 1 --2- 172.21.15.37:0/3367468411 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe344108f60 0x7fe344110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:35:03.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:03.919+0000 7fe349e00640 1 --2- 172.21.15.37:0/3367468411 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3441047e0 0x7fe344108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:35:03.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:03.919+0000 7fe349e00640 1 --2- 172.21.15.37:0/3367468411 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe344103e30 0x7fe344104210 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:35:03.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:03.919+0000 7fe349e00640 1 -- 172.21.15.37:0/3367468411 >> 172.21.15.37:0/3367468411 conn(0x7fe3440ff8d0 msgr2=0x7fe344101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:35:03.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:03.919+0000 7fe349e00640 1 -- 172.21.15.37:0/3367468411 shutdown_connections 2024-09-11T23:35:03.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:03.919+0000 7fe349e00640 1 -- 172.21.15.37:0/3367468411 wait complete. 2024-09-11T23:35:03.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:03.920+0000 7fe349e00640 1 Processor -- start 2024-09-11T23:35:03.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:03.920+0000 7fe349e00640 1 -- start start 2024-09-11T23:35:03.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:03.921+0000 7fe349e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe344103e30 0x7fe34419a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:35:03.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:03.921+0000 7fe349e00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe3441047e0 0x7fe34419a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:35:03.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:03.921+0000 7fe349e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe344108f60 0x7fe34419ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:35:03.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:03.921+0000 7fe349e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe344113f80 con 0x7fe344108f60 2024-09-11T23:35:03.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:03.921+0000 7fe349e00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe344113e00 con 0x7fe344103e30 2024-09-11T23:35:03.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:03.921+0000 7fe349e00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fe344114100 con 0x7fe3441047e0 2024-09-11T23:35:03.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:03.921+0000 7fe343e00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe3441047e0 0x7fe34419a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:35:03.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:03.921+0000 7fe343e00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe3441047e0 0x7fe34419a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.37:34340/0 (socket says 172.21.15.37:34340) 2024-09-11T23:35:03.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:03.921+0000 7fe343e00640 1 -- 172.21.15.37:0/255976520 learned_addr learned my addr 172.21.15.37:0/255976520 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:35:03.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:03.921+0000 7fe349400640 1 --2- 172.21.15.37:0/255976520 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe344108f60 0x7fe34419ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:35:03.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:03.921+0000 7fe348a00640 1 --2- 172.21.15.37:0/255976520 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe344103e30 0x7fe34419a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:35:03.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:03.921+0000 7fe343e00640 1 -- 172.21.15.37:0/255976520 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe344103e30 msgr2=0x7fe34419a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:35:03.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:03.921+0000 7fe343e00640 1 --2- 172.21.15.37:0/255976520 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe344103e30 0x7fe34419a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:35:03.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:03.921+0000 7fe343e00640 1 -- 172.21.15.37:0/255976520 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe344108f60 msgr2=0x7fe34419ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:35:03.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:03.921+0000 7fe343e00640 1 --2- 172.21.15.37:0/255976520 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe344108f60 0x7fe34419ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:35:03.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:03.921+0000 7fe343e00640 1 -- 172.21.15.37:0/255976520 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe34419f430 con 0x7fe3441047e0 2024-09-11T23:35:03.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:03.922+0000 7fe343e00640 1 --2- 172.21.15.37:0/255976520 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe3441047e0 0x7fe34419a9c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe33000e9c0 tx=0x7fe33000ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:35:03.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:03.922+0000 7fe341600640 1 -- 172.21.15.37:0/255976520 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe33000cde0 con 0x7fe3441047e0 2024-09-11T23:35:03.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:03.922+0000 7fe341600640 1 -- 172.21.15.37:0/255976520 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe3300035f0 con 0x7fe3441047e0 2024-09-11T23:35:03.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:03.922+0000 7fe349e00640 1 -- 172.21.15.37:0/255976520 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe34419f720 con 0x7fe3441047e0 2024-09-11T23:35:03.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:03.922+0000 7fe341600640 1 -- 172.21.15.37:0/255976520 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe330010650 con 0x7fe3441047e0 2024-09-11T23:35:03.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:03.922+0000 7fe349e00640 1 -- 172.21.15.37:0/255976520 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3441a7000 con 0x7fe3441047e0 2024-09-11T23:35:03.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:03.923+0000 7fe349e00640 1 -- 172.21.15.37:0/255976520 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe344104210 con 0x7fe3441047e0 2024-09-11T23:35:03.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:03.925+0000 7fe341600640 1 -- 172.21.15.37:0/255976520 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 20) ==== 137833+0+0 (secure 0 0 0) 0x7fe3300037a0 con 0x7fe3441047e0 2024-09-11T23:35:03.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:03.927+0000 7fe341600640 1 --2- 172.21.15.37:0/255976520 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fe32c0a2c00 0x7fe32c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:35:03.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:03.927+0000 7fe341600640 1 -- 172.21.15.37:0/255976520 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9295+0+0 (secure 0 0 0) 0x7fe3300cf760 con 0x7fe3441047e0 2024-09-11T23:35:03.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:03.927+0000 7fe348a00640 1 --2- 172.21.15.37:0/255976520 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fe32c0a2c00 0x7fe32c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:35:03.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:03.928+0000 7fe348a00640 1 --2- 172.21.15.37:0/255976520 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fe32c0a2c00 0x7fe32c0a50c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fe33802a930 tx=0x7fe3380056d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:35:03.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:03.930+0000 7fe341600640 1 -- 172.21.15.37:0/255976520 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe33009c240 con 0x7fe3441047e0 2024-09-11T23:35:04.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:35:03 smithi037 ceph-mon[30630]: pgmap v870: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 3.0 KiB/s wr, 12 op/s 2024-09-11T23:35:04.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:04.129+0000 7fe349e00640 1 -- 172.21.15.37:0/255976520 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fe34402d7c0 con 0x7fe3441047e0 2024-09-11T23:35:04.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:04.130+0000 7fe341600640 1 -- 172.21.15.37:0/255976520 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v95) ==== 81+0+591 (secure 0 0 0) 0x7fe33009bb40 con 0x7fe3441047e0 2024-09-11T23:35:04.131 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:6801/2886800769 2024-09-12T23:08:51.934167+0000 2024-09-11T23:35:04.131 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/1811301224 2024-09-12T23:08:51.934167+0000 2024-09-11T23:35:04.131 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/513883980 2024-09-12T23:08:51.934167+0000 2024-09-11T23:35:04.131 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/3698260188 2024-09-12T23:08:23.793913+0000 2024-09-11T23:35:04.131 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:6800/2886800769 2024-09-12T23:08:51.934167+0000 2024-09-11T23:35:04.131 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/4134736061 2024-09-12T23:08:23.793913+0000 2024-09-11T23:35:04.131 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/3426758476 2024-09-12T23:08:51.934167+0000 2024-09-11T23:35:04.131 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/2545840561 2024-09-12T23:08:23.793913+0000 2024-09-11T23:35:04.131 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:6801/3447426643 2024-09-12T23:08:23.793913+0000 2024-09-11T23:35:04.131 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:6800/3447426643 2024-09-12T23:08:23.793913+0000 2024-09-11T23:35:04.132 INFO:teuthology.orchestra.run.smithi037.stderr:listed 10 entries 2024-09-11T23:35:04.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:04.132+0000 7fe349e00640 1 -- 172.21.15.37:0/255976520 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fe32c0a2c00 msgr2=0x7fe32c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:35:04.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:04.132+0000 7fe349e00640 1 --2- 172.21.15.37:0/255976520 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fe32c0a2c00 0x7fe32c0a50c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fe33802a930 tx=0x7fe3380056d0 comp rx=0 tx=0).stop 2024-09-11T23:35:04.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:04.132+0000 7fe349e00640 1 -- 172.21.15.37:0/255976520 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe3441047e0 msgr2=0x7fe34419a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:35:04.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:04.132+0000 7fe349e00640 1 --2- 172.21.15.37:0/255976520 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe3441047e0 0x7fe34419a9c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe33000e9c0 tx=0x7fe33000ee80 comp rx=0 tx=0).stop 2024-09-11T23:35:04.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:04.132+0000 7fe349e00640 1 -- 172.21.15.37:0/255976520 shutdown_connections 2024-09-11T23:35:04.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:04.132+0000 7fe349e00640 1 --2- 172.21.15.37:0/255976520 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fe32c0a2c00 0x7fe32c0a50c0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:35:04.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:04.132+0000 7fe349e00640 1 --2- 172.21.15.37:0/255976520 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe344108f60 0x7fe34419ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:35:04.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:04.132+0000 7fe349e00640 1 --2- 172.21.15.37:0/255976520 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe3441047e0 0x7fe34419a9c0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:35:04.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:04.132+0000 7fe349e00640 1 --2- 172.21.15.37:0/255976520 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe344103e30 0x7fe34419a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:35:04.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:04.132+0000 7fe349e00640 1 -- 172.21.15.37:0/255976520 >> 172.21.15.37:0/255976520 conn(0x7fe3440ff8d0 msgr2=0x7fe344100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:35:04.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:04.132+0000 7fe349e00640 1 -- 172.21.15.37:0/255976520 shutdown_connections 2024-09-11T23:35:04.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:04.132+0000 7fe349e00640 1 -- 172.21.15.37:0/255976520 wait complete. 2024-09-11T23:35:04.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:35:03 smithi160 ceph-mon[35055]: pgmap v870: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 3.0 KiB/s wr, 12 op/s 2024-09-11T23:35:04.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:35:03 smithi123 ceph-mon[35438]: pgmap v870: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 3.0 KiB/s wr, 12 op/s 2024-09-11T23:35:04.853 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-11T23:35:04.854 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:35:04.854 DEBUG:teuthology.orchestra.run.smithi037:> sudo umount /tmp/cephfs 2024-09-11T23:35:05.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:35:04 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/255976520' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-11T23:35:05.143 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi037.front.sepia.ceph.com 2024-09-11T23:35:05.143 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:35:05.143 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec rmdir -- /tmp/cephfs) 2024-09-11T23:35:05.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:35:04 smithi160 ceph-mon[35055]: from='client.? 172.21.15.37:0/255976520' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-11T23:35:05.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:35:05.186 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2024-09-11T23:35:05.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:35:04 smithi123 ceph-mon[35438]: from='client.? 172.21.15.37:0/255976520' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-11T23:35:05.301 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--tmp-cephfs (id: 0) 2024-09-11T23:35:05.302 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:35:05.302 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns delete ceph-ns--tmp-cephfs 2024-09-11T23:35:05.361 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:35:05.361 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link delete ceph-brx 2024-09-11T23:35:05.723 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-11T23:35:05.734 INFO:tasks.cephadm:Teardown begin 2024-09-11T23:35:05.734 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-11T23:35:05.734 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T23:35:06.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:35:05 smithi037 ceph-mon[30630]: pgmap v871: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.7 KiB/s wr, 9 op/s 2024-09-11T23:35:06.117 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:35:06.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:35:05 smithi160 ceph-mon[35055]: pgmap v871: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.7 KiB/s wr, 9 op/s 2024-09-11T23:35:06.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:35:05 smithi123 ceph-mon[35438]: pgmap v871: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.7 KiB/s wr, 9 op/s 2024-09-11T23:35:06.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:06.708+0000 7f1d79200640 1 -- 172.21.15.37:0/611323926 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d741079c0 msgr2=0x7f1d74107da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:35:06.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:06.708+0000 7f1d79200640 1 --2- 172.21.15.37:0/611323926 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d741079c0 0x7f1d74107da0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f1d64009930 tx=0x7f1d6402a420 comp rx=0 tx=0).stop 2024-09-11T23:35:06.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:06.708+0000 7f1d79200640 1 -- 172.21.15.37:0/611323926 shutdown_connections 2024-09-11T23:35:06.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:06.708+0000 7f1d79200640 1 --2- 172.21.15.37:0/611323926 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d74102360 0x7f1d7410e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:35:06.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:06.708+0000 7f1d79200640 1 --2- 172.21.15.37:0/611323926 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1d741019c0 0x7f1d74101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:35:06.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:06.708+0000 7f1d79200640 1 --2- 172.21.15.37:0/611323926 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d741079c0 0x7f1d74107da0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:35:06.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:06.708+0000 7f1d79200640 1 -- 172.21.15.37:0/611323926 >> 172.21.15.37:0/611323926 conn(0x7f1d740fd740 msgr2=0x7f1d740ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:35:06.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:06.708+0000 7f1d79200640 1 -- 172.21.15.37:0/611323926 shutdown_connections 2024-09-11T23:35:06.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:06.708+0000 7f1d79200640 1 -- 172.21.15.37:0/611323926 wait complete. 2024-09-11T23:35:06.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:06.710+0000 7f1d79200640 1 Processor -- start 2024-09-11T23:35:06.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:06.710+0000 7f1d79200640 1 -- start start 2024-09-11T23:35:06.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:06.710+0000 7f1d79200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d741019c0 0x7f1d7419a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:35:06.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:06.710+0000 7f1d79200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d74102360 0x7f1d7419a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:35:06.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:06.710+0000 7f1d79200640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1d741079c0 0x7f1d7419ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:35:06.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:06.710+0000 7f1d79200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1d74111e10 con 0x7f1d741019c0 2024-09-11T23:35:06.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:06.710+0000 7f1d79200640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f1d74111c90 con 0x7f1d74102360 2024-09-11T23:35:06.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:06.710+0000 7f1d79200640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f1d74111f90 con 0x7f1d741079c0 2024-09-11T23:35:06.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:06.710+0000 7f1d73400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d741019c0 0x7f1d7419a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:35:06.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:06.711+0000 7f1d73400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d741019c0 0x7f1d7419a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39432/0 (socket says 172.21.15.37:39432) 2024-09-11T23:35:06.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:06.711+0000 7f1d73400640 1 -- 172.21.15.37:0/580496511 learned_addr learned my addr 172.21.15.37:0/580496511 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:35:06.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:06.711+0000 7f1d72a00640 1 --2- 172.21.15.37:0/580496511 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d74102360 0x7f1d7419a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:35:06.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:06.711+0000 7f1d73e00640 1 --2- 172.21.15.37:0/580496511 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1d741079c0 0x7f1d7419ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:35:06.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:06.711+0000 7f1d73400640 1 -- 172.21.15.37:0/580496511 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1d741079c0 msgr2=0x7f1d7419ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:35:06.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:06.711+0000 7f1d73400640 1 --2- 172.21.15.37:0/580496511 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1d741079c0 0x7f1d7419ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:35:06.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:06.711+0000 7f1d73400640 1 -- 172.21.15.37:0/580496511 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d74102360 msgr2=0x7f1d7419a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:35:06.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:06.711+0000 7f1d73400640 1 --2- 172.21.15.37:0/580496511 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d74102360 0x7f1d7419a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:35:06.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:06.711+0000 7f1d73400640 1 -- 172.21.15.37:0/580496511 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d7419f460 con 0x7f1d741019c0 2024-09-11T23:35:06.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:06.711+0000 7f1d72a00640 1 --2- 172.21.15.37:0/580496511 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d74102360 0x7f1d7419a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:35:06.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:06.712+0000 7f1d73400640 1 --2- 172.21.15.37:0/580496511 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d741019c0 0x7f1d7419a4b0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f1d6402a940 tx=0x7f1d64003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:35:06.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:06.712+0000 7f1d6be00640 1 -- 172.21.15.37:0/580496511 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d6403f070 con 0x7f1d741019c0 2024-09-11T23:35:06.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:06.712+0000 7f1d79200640 1 -- 172.21.15.37:0/580496511 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d7419f6f0 con 0x7f1d741019c0 2024-09-11T23:35:06.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:06.712+0000 7f1d6be00640 1 -- 172.21.15.37:0/580496511 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1d64031c90 con 0x7f1d741019c0 2024-09-11T23:35:06.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:06.712+0000 7f1d6be00640 1 -- 172.21.15.37:0/580496511 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d64035030 con 0x7f1d741019c0 2024-09-11T23:35:06.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:06.712+0000 7f1d79200640 1 -- 172.21.15.37:0/580496511 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d741a7030 con 0x7f1d741019c0 2024-09-11T23:35:06.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:06.714+0000 7f1d79200640 1 -- 172.21.15.37:0/580496511 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d74101e20 con 0x7f1d741019c0 2024-09-11T23:35:06.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:06.715+0000 7f1d6be00640 1 -- 172.21.15.37:0/580496511 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 20) ==== 137833+0+0 (secure 0 0 0) 0x7f1d64042070 con 0x7f1d741019c0 2024-09-11T23:35:06.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:06.717+0000 7f1d6be00640 1 --2- 172.21.15.37:0/580496511 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f1d580a2c00 0x7f1d580a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:35:06.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:06.717+0000 7f1d6be00640 1 -- 172.21.15.37:0/580496511 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9295+0+0 (secure 0 0 0) 0x7f1d640ef6f0 con 0x7f1d741019c0 2024-09-11T23:35:06.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:06.717+0000 7f1d72a00640 1 --2- 172.21.15.37:0/580496511 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f1d580a2c00 0x7f1d580a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:35:06.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:06.718+0000 7f1d72a00640 1 --2- 172.21.15.37:0/580496511 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f1d580a2c00 0x7f1d580a50c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f1d7410e5b0 tx=0x7f1d6000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:35:06.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:06.721+0000 7f1d6be00640 1 -- 172.21.15.37:0/580496511 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1d640bbbe0 con 0x7f1d741019c0 2024-09-11T23:35:06.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:06.945+0000 7f1d79200640 1 -- 172.21.15.37:0/580496511 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1d741a7200 con 0x7f1d741019c0 2024-09-11T23:35:06.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:06.946+0000 7f1d6be00640 1 -- 172.21.15.37:0/580496511 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11987 (secure 0 0 0) 0x7f1d640bfee0 con 0x7f1d741019c0 2024-09-11T23:35:06.947 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:35:06.947 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":30,"btime":"2024-09-11T23:34:37:807585+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14448,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/285120996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":285120996},{"type":"v1","addr":"172.21.15.37:6835","nonce":285120996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14460,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/3095283029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":3095283029},{"type":"v1","addr":"172.21.15.37:6837","nonce":3095283029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T23:16:16.642956+0000","modified":"2024-09-11T23:34:37.420103+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24533,"mds_1":24520,"mds_2":24499,"mds_3":24497,"mds_4":24493},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14499":{"gid":14499,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6839/1072030582","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":1072030582},{"type":"v1","addr":"172.21.15.37:6839","nonce":1072030582}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14511":{"gid":14511,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6841/209927476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":209927476},{"type":"v1","addr":"172.21.15.37:6841","nonce":209927476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24440":{"gid":24440,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.123:6833/3380294842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":3380294842},{"type":"v1","addr":"172.21.15.123:6833","nonce":3380294842}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6833/1918127245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":1918127245},{"type":"v1","addr":"172.21.15.160:6833","nonce":1918127245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.123:6835/3928690501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":3928690501},{"type":"v1","addr":"172.21.15.123:6835","nonce":3928690501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":21,"addr":"172.21.15.160:6835/2316897035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":2316897035},{"type":"v1","addr":"172.21.15.160:6835","nonce":2316897035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"h","rank":3,"incarnation":24,"state":"up:active","state_seq":19,"addr":"172.21.15.123:6837/2168535476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":2168535476},{"type":"v1","addr":"172.21.15.123:6837","nonce":2168535476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":20,"addr":"172.21.15.160:6837/2906597021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":2906597021},{"type":"v1","addr":"172.21.15.160:6837","nonce":2906597021}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24520":{"gid":24520,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":18,"addr":"172.21.15.160:6839/2041625862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":2041625862},{"type":"v1","addr":"172.21.15.160:6839","nonce":2041625862}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24533":{"gid":24533,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.123:6839/3077076065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6838","nonce":3077076065},{"type":"v1","addr":"172.21.15.123:6839","nonce":3077076065}]},"join_fscid":-1,"export_targets":[1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24533,"qdb_cluster":[24533,24520,24499,24497,24493]},"id":1}]} 2024-09-11T23:35:06.947 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 30 2024-09-11T23:35:06.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:06.948+0000 7f1d79200640 1 -- 172.21.15.37:0/580496511 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f1d580a2c00 msgr2=0x7f1d580a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:35:06.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:06.948+0000 7f1d79200640 1 --2- 172.21.15.37:0/580496511 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f1d580a2c00 0x7f1d580a50c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f1d7410e5b0 tx=0x7f1d6000b410 comp rx=0 tx=0).stop 2024-09-11T23:35:06.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:06.948+0000 7f1d79200640 1 -- 172.21.15.37:0/580496511 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d741019c0 msgr2=0x7f1d7419a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:35:06.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:06.948+0000 7f1d79200640 1 --2- 172.21.15.37:0/580496511 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d741019c0 0x7f1d7419a4b0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f1d6402a940 tx=0x7f1d64003b90 comp rx=0 tx=0).stop 2024-09-11T23:35:06.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:06.949+0000 7f1d79200640 1 -- 172.21.15.37:0/580496511 shutdown_connections 2024-09-11T23:35:06.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:06.949+0000 7f1d79200640 1 --2- 172.21.15.37:0/580496511 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f1d580a2c00 0x7f1d580a50c0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:35:06.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:06.949+0000 7f1d79200640 1 --2- 172.21.15.37:0/580496511 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d74102360 0x7f1d7419a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:35:06.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:06.949+0000 7f1d79200640 1 --2- 172.21.15.37:0/580496511 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1d741079c0 0x7f1d7419ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:35:06.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:06.949+0000 7f1d79200640 1 --2- 172.21.15.37:0/580496511 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d741019c0 0x7f1d7419a4b0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:35:06.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:06.949+0000 7f1d79200640 1 -- 172.21.15.37:0/580496511 >> 172.21.15.37:0/580496511 conn(0x7f1d740fd740 msgr2=0x7f1d740fedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:35:06.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:06.949+0000 7f1d79200640 1 -- 172.21.15.37:0/580496511 shutdown_connections 2024-09-11T23:35:06.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:06.949+0000 7f1d79200640 1 -- 172.21.15.37:0/580496511 wait complete. 2024-09-11T23:35:07.754 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T23:35:08.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:35:07 smithi037 ceph-mon[30630]: pgmap v872: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 13 op/s 2024-09-11T23:35:08.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:35:07 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/580496511' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:35:08.136 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:35:08.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:35:07 smithi160 ceph-mon[35055]: pgmap v872: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 13 op/s 2024-09-11T23:35:08.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:35:07 smithi160 ceph-mon[35055]: from='client.? 172.21.15.37:0/580496511' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:35:08.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:35:07 smithi123 ceph-mon[35438]: pgmap v872: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 13 op/s 2024-09-11T23:35:08.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:35:07 smithi123 ceph-mon[35438]: from='client.? 172.21.15.37:0/580496511' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:35:08.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:08.716+0000 7fb198a00640 1 -- 172.21.15.37:0/1446903741 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb194074eb0 msgr2=0x7fb194112650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:35:08.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:08.716+0000 7fb198a00640 1 --2- 172.21.15.37:0/1446903741 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb194074eb0 0x7fb194112650 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fb17c009900 tx=0x7fb17c02a480 comp rx=0 tx=0).stop 2024-09-11T23:35:08.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:08.716+0000 7fb198a00640 1 -- 172.21.15.37:0/1446903741 shutdown_connections 2024-09-11T23:35:08.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:08.716+0000 7fb198a00640 1 --2- 172.21.15.37:0/1446903741 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb194112b90 0x7fb194114f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:35:08.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:08.716+0000 7fb198a00640 1 --2- 172.21.15.37:0/1446903741 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb194074eb0 0x7fb194112650 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:35:08.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:08.716+0000 7fb198a00640 1 --2- 172.21.15.37:0/1446903741 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb194074590 0x7fb194074970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:35:08.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:08.716+0000 7fb198a00640 1 -- 172.21.15.37:0/1446903741 >> 172.21.15.37:0/1446903741 conn(0x7fb1940fd8c0 msgr2=0x7fb1940ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:35:08.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:08.716+0000 7fb198a00640 1 -- 172.21.15.37:0/1446903741 shutdown_connections 2024-09-11T23:35:08.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:08.716+0000 7fb198a00640 1 -- 172.21.15.37:0/1446903741 wait complete. 2024-09-11T23:35:08.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:08.717+0000 7fb198a00640 1 Processor -- start 2024-09-11T23:35:08.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:08.717+0000 7fb198a00640 1 -- start start 2024-09-11T23:35:08.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:08.718+0000 7fb198a00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb194074590 0x7fb1941a4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:35:08.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:08.718+0000 7fb198a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb194074eb0 0x7fb1941a4c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:35:08.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:08.718+0000 7fb198a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb194112b90 0x7fb19419e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:35:08.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:08.718+0000 7fb198a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb194118590 con 0x7fb194074eb0 2024-09-11T23:35:08.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:08.718+0000 7fb198a00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fb194118410 con 0x7fb194112b90 2024-09-11T23:35:08.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:08.718+0000 7fb198a00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fb194118710 con 0x7fb194074590 2024-09-11T23:35:08.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:08.718+0000 7fb18be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb194074eb0 0x7fb1941a4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:35:08.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:08.718+0000 7fb191e00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb194074590 0x7fb1941a4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:35:08.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:08.718+0000 7fb191e00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb194074590 0x7fb1941a4710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.37:34368/0 (socket says 172.21.15.37:34368) 2024-09-11T23:35:08.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:08.718+0000 7fb191e00640 1 -- 172.21.15.37:0/1771737153 learned_addr learned my addr 172.21.15.37:0/1771737153 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:35:08.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:08.718+0000 7fb192800640 1 --2- 172.21.15.37:0/1771737153 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb194112b90 0x7fb19419e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:35:08.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:08.719+0000 7fb191e00640 1 -- 172.21.15.37:0/1771737153 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb194112b90 msgr2=0x7fb19419e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:35:08.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:08.719+0000 7fb191e00640 1 --2- 172.21.15.37:0/1771737153 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb194112b90 0x7fb19419e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:35:08.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:08.719+0000 7fb191e00640 1 -- 172.21.15.37:0/1771737153 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb194074eb0 msgr2=0x7fb1941a4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:35:08.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:08.719+0000 7fb191e00640 1 --2- 172.21.15.37:0/1771737153 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb194074eb0 0x7fb1941a4c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:35:08.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:08.719+0000 7fb191e00640 1 -- 172.21.15.37:0/1771737153 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb19419f000 con 0x7fb194074590 2024-09-11T23:35:08.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:08.719+0000 7fb191e00640 1 --2- 172.21.15.37:0/1771737153 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb194074590 0x7fb1941a4710 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb18400d950 tx=0x7fb18400de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:35:08.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:08.719+0000 7fb18aa00640 1 -- 172.21.15.37:0/1771737153 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb184017070 con 0x7fb194074590 2024-09-11T23:35:08.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:08.719+0000 7fb198a00640 1 -- 172.21.15.37:0/1771737153 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb19419f2f0 con 0x7fb194074590 2024-09-11T23:35:08.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:08.719+0000 7fb18aa00640 1 -- 172.21.15.37:0/1771737153 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb184009c30 con 0x7fb194074590 2024-09-11T23:35:08.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:08.719+0000 7fb18aa00640 1 -- 172.21.15.37:0/1771737153 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb18400f6b0 con 0x7fb194074590 2024-09-11T23:35:08.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:08.719+0000 7fb198a00640 1 -- 172.21.15.37:0/1771737153 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1941ab5e0 con 0x7fb194074590 2024-09-11T23:35:08.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:08.720+0000 7fb198a00640 1 -- 172.21.15.37:0/1771737153 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb194074970 con 0x7fb194074590 2024-09-11T23:35:08.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:08.723+0000 7fb18aa00640 1 -- 172.21.15.37:0/1771737153 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 20) ==== 137833+0+0 (secure 0 0 0) 0x7fb1840109d0 con 0x7fb194074590 2024-09-11T23:35:08.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:08.724+0000 7fb18aa00640 1 --2- 172.21.15.37:0/1771737153 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fb1780a2b80 0x7fb1780a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:35:08.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:08.724+0000 7fb18aa00640 1 -- 172.21.15.37:0/1771737153 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9295+0+0 (secure 0 0 0) 0x7fb1840ceff0 con 0x7fb194074590 2024-09-11T23:35:08.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:08.724+0000 7fb18be00640 1 --2- 172.21.15.37:0/1771737153 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fb1780a2b80 0x7fb1780a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:35:08.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:08.725+0000 7fb18be00640 1 --2- 172.21.15.37:0/1771737153 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fb1780a2b80 0x7fb1780a5040 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fb17c000c00 tx=0x7fb17c005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:35:08.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:08.726+0000 7fb18aa00640 1 -- 172.21.15.37:0/1771737153 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb184009de0 con 0x7fb194074590 2024-09-11T23:35:08.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:08.955+0000 7fb198a00640 1 -- 172.21.15.37:0/1771737153 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb19419fe00 con 0x7fb194074590 2024-09-11T23:35:08.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:08.956+0000 7fb18aa00640 1 -- 172.21.15.37:0/1771737153 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11987 (secure 0 0 0) 0x7fb18409b4c0 con 0x7fb194074590 2024-09-11T23:35:08.957 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:35:08.957 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":30,"btime":"2024-09-11T23:34:37:807585+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14448,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/285120996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":285120996},{"type":"v1","addr":"172.21.15.37:6835","nonce":285120996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14460,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/3095283029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":3095283029},{"type":"v1","addr":"172.21.15.37:6837","nonce":3095283029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T23:16:16.642956+0000","modified":"2024-09-11T23:34:37.420103+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24533,"mds_1":24520,"mds_2":24499,"mds_3":24497,"mds_4":24493},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14499":{"gid":14499,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6839/1072030582","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":1072030582},{"type":"v1","addr":"172.21.15.37:6839","nonce":1072030582}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14511":{"gid":14511,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6841/209927476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":209927476},{"type":"v1","addr":"172.21.15.37:6841","nonce":209927476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24440":{"gid":24440,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.123:6833/3380294842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":3380294842},{"type":"v1","addr":"172.21.15.123:6833","nonce":3380294842}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6833/1918127245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":1918127245},{"type":"v1","addr":"172.21.15.160:6833","nonce":1918127245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.123:6835/3928690501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":3928690501},{"type":"v1","addr":"172.21.15.123:6835","nonce":3928690501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":21,"addr":"172.21.15.160:6835/2316897035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":2316897035},{"type":"v1","addr":"172.21.15.160:6835","nonce":2316897035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"h","rank":3,"incarnation":24,"state":"up:active","state_seq":19,"addr":"172.21.15.123:6837/2168535476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":2168535476},{"type":"v1","addr":"172.21.15.123:6837","nonce":2168535476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":20,"addr":"172.21.15.160:6837/2906597021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":2906597021},{"type":"v1","addr":"172.21.15.160:6837","nonce":2906597021}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24520":{"gid":24520,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":18,"addr":"172.21.15.160:6839/2041625862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":2041625862},{"type":"v1","addr":"172.21.15.160:6839","nonce":2041625862}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24533":{"gid":24533,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.123:6839/3077076065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6838","nonce":3077076065},{"type":"v1","addr":"172.21.15.123:6839","nonce":3077076065}]},"join_fscid":-1,"export_targets":[1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24533,"qdb_cluster":[24533,24520,24499,24497,24493]},"id":1}]} 2024-09-11T23:35:08.958 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 30 2024-09-11T23:35:08.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:08.958+0000 7fb198a00640 1 -- 172.21.15.37:0/1771737153 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fb1780a2b80 msgr2=0x7fb1780a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:35:08.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:08.958+0000 7fb198a00640 1 --2- 172.21.15.37:0/1771737153 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fb1780a2b80 0x7fb1780a5040 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fb17c000c00 tx=0x7fb17c005b50 comp rx=0 tx=0).stop 2024-09-11T23:35:08.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:08.958+0000 7fb198a00640 1 -- 172.21.15.37:0/1771737153 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb194074590 msgr2=0x7fb1941a4710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:35:08.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:08.958+0000 7fb198a00640 1 --2- 172.21.15.37:0/1771737153 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb194074590 0x7fb1941a4710 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb18400d950 tx=0x7fb18400de10 comp rx=0 tx=0).stop 2024-09-11T23:35:08.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:08.959+0000 7fb198a00640 1 -- 172.21.15.37:0/1771737153 shutdown_connections 2024-09-11T23:35:08.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:08.959+0000 7fb198a00640 1 --2- 172.21.15.37:0/1771737153 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7fb1780a2b80 0x7fb1780a5040 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:35:08.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:08.959+0000 7fb198a00640 1 --2- 172.21.15.37:0/1771737153 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb194112b90 0x7fb19419e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:35:08.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:08.959+0000 7fb198a00640 1 --2- 172.21.15.37:0/1771737153 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb194074eb0 0x7fb1941a4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:35:08.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:08.959+0000 7fb198a00640 1 --2- 172.21.15.37:0/1771737153 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb194074590 0x7fb1941a4710 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:35:08.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:08.959+0000 7fb198a00640 1 -- 172.21.15.37:0/1771737153 >> 172.21.15.37:0/1771737153 conn(0x7fb1940fd8c0 msgr2=0x7fb1940ff050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:35:08.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:08.959+0000 7fb198a00640 1 -- 172.21.15.37:0/1771737153 shutdown_connections 2024-09-11T23:35:08.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:08.959+0000 7fb198a00640 1 -- 172.21.15.37:0/1771737153 wait complete. 2024-09-11T23:35:09.730 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T23:35:10.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:35:09 smithi037 ceph-mon[30630]: pgmap v873: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 24 KiB/s wr, 11 op/s 2024-09-11T23:35:10.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:35:09 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/1771737153' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:35:10.113 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:35:10.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:35:09 smithi160 ceph-mon[35055]: pgmap v873: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 24 KiB/s wr, 11 op/s 2024-09-11T23:35:10.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:35:09 smithi160 ceph-mon[35055]: from='client.? 172.21.15.37:0/1771737153' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:35:10.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:35:09 smithi123 ceph-mon[35438]: pgmap v873: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 24 KiB/s wr, 11 op/s 2024-09-11T23:35:10.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:35:09 smithi123 ceph-mon[35438]: from='client.? 172.21.15.37:0/1771737153' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:35:10.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:10.658+0000 7f1849200640 1 -- 172.21.15.37:0/3832718236 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1844109120 msgr2=0x7f1844110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:35:10.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:10.658+0000 7f1849200640 1 --2- 172.21.15.37:0/3832718236 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1844109120 0x7f1844110ca0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f183c009ca0 tx=0x7f183c02a8c0 comp rx=0 tx=0).stop 2024-09-11T23:35:10.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:10.658+0000 7f1849200640 1 -- 172.21.15.37:0/3832718236 shutdown_connections 2024-09-11T23:35:10.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:10.658+0000 7f1849200640 1 --2- 172.21.15.37:0/3832718236 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1844109120 0x7f1844110ca0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:35:10.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:10.658+0000 7f1849200640 1 --2- 172.21.15.37:0/3832718236 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f18441049a0 0x7f18441089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:35:10.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:10.658+0000 7f1849200640 1 --2- 172.21.15.37:0/3832718236 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1844103ff0 0x7f18441043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:35:10.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:10.658+0000 7f1849200640 1 -- 172.21.15.37:0/3832718236 >> 172.21.15.37:0/3832718236 conn(0x7f18440ffa90 msgr2=0x7f1844101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:35:10.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:10.658+0000 7f1849200640 1 -- 172.21.15.37:0/3832718236 shutdown_connections 2024-09-11T23:35:10.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:10.658+0000 7f1849200640 1 -- 172.21.15.37:0/3832718236 wait complete. 2024-09-11T23:35:10.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:10.659+0000 7f1849200640 1 Processor -- start 2024-09-11T23:35:10.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:10.659+0000 7f1849200640 1 -- start start 2024-09-11T23:35:10.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:10.659+0000 7f1849200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1844103ff0 0x7f184419a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:35:10.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:10.659+0000 7f1849200640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f18441049a0 0x7f184419ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:35:10.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:10.659+0000 7f1849200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1844109120 0x7f184419eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:35:10.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:10.659+0000 7f1849200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f18441141a0 con 0x7f1844103ff0 2024-09-11T23:35:10.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:10.659+0000 7f1849200640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f1844114020 con 0x7f1844109120 2024-09-11T23:35:10.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:10.659+0000 7f1849200640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f1844114320 con 0x7f18441049a0 2024-09-11T23:35:10.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:10.660+0000 7f1841e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1844103ff0 0x7f184419a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:35:10.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:10.660+0000 7f1841e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1844103ff0 0x7f184419a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52718/0 (socket says 172.21.15.37:52718) 2024-09-11T23:35:10.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:10.660+0000 7f1841e00640 1 -- 172.21.15.37:0/561523093 learned_addr learned my addr 172.21.15.37:0/561523093 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:35:10.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:10.660+0000 7f1842800640 1 --2- 172.21.15.37:0/561523093 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1844109120 0x7f184419eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:35:10.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:10.660+0000 7f183be00640 1 --2- 172.21.15.37:0/561523093 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f18441049a0 0x7f184419ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:35:10.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:10.660+0000 7f1841e00640 1 -- 172.21.15.37:0/561523093 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f18441049a0 msgr2=0x7f184419ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:35:10.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:10.660+0000 7f1841e00640 1 --2- 172.21.15.37:0/561523093 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f18441049a0 0x7f184419ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:35:10.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:10.660+0000 7f1841e00640 1 -- 172.21.15.37:0/561523093 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1844109120 msgr2=0x7f184419eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:35:10.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:10.660+0000 7f1841e00640 1 --2- 172.21.15.37:0/561523093 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1844109120 0x7f184419eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:35:10.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:10.660+0000 7f1841e00640 1 -- 172.21.15.37:0/561523093 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f184419f590 con 0x7f1844103ff0 2024-09-11T23:35:10.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:10.660+0000 7f1841e00640 1 --2- 172.21.15.37:0/561523093 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1844103ff0 0x7f184419a5e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f183400d950 tx=0x7f183400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:35:10.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:10.661+0000 7f183aa00640 1 -- 172.21.15.37:0/561523093 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1834017030 con 0x7f1844103ff0 2024-09-11T23:35:10.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:10.661+0000 7f183aa00640 1 -- 172.21.15.37:0/561523093 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1834004020 con 0x7f1844103ff0 2024-09-11T23:35:10.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:10.661+0000 7f183aa00640 1 -- 172.21.15.37:0/561523093 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18340047a0 con 0x7f1844103ff0 2024-09-11T23:35:10.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:10.661+0000 7f1849200640 1 -- 172.21.15.37:0/561523093 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f184419f880 con 0x7f1844103ff0 2024-09-11T23:35:10.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:10.661+0000 7f1849200640 1 -- 172.21.15.37:0/561523093 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18441a7160 con 0x7f1844103ff0 2024-09-11T23:35:10.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:10.662+0000 7f1849200640 1 -- 172.21.15.37:0/561523093 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18441043d0 con 0x7f1844103ff0 2024-09-11T23:35:10.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:10.664+0000 7f183aa00640 1 -- 172.21.15.37:0/561523093 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 20) ==== 137833+0+0 (secure 0 0 0) 0x7f18340041d0 con 0x7f1844103ff0 2024-09-11T23:35:10.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:10.665+0000 7f183aa00640 1 --2- 172.21.15.37:0/561523093 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f18280a2c00 0x7f18280a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:35:10.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:10.665+0000 7f183aa00640 1 -- 172.21.15.37:0/561523093 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9295+0+0 (secure 0 0 0) 0x7f18340ced80 con 0x7f1844103ff0 2024-09-11T23:35:10.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:10.665+0000 7f183be00640 1 --2- 172.21.15.37:0/561523093 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f18280a2c00 0x7f18280a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:35:10.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:10.666+0000 7f183be00640 1 --2- 172.21.15.37:0/561523093 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f18280a2c00 0x7f18280a50c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f184410ab00 tx=0x7f182c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:35:10.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:10.669+0000 7f183aa00640 1 -- 172.21.15.37:0/561523093 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f183409b860 con 0x7f1844103ff0 2024-09-11T23:35:10.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:10.856+0000 7f1849200640 1 -- 172.21.15.37:0/561523093 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f184419b940 con 0x7f1844103ff0 2024-09-11T23:35:10.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:10.858+0000 7f183aa00640 1 -- 172.21.15.37:0/561523093 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) ==== 74+0+25054 (secure 0 0 0) 0x7f183409b160 con 0x7f1844103ff0 2024-09-11T23:35:10.859 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-11T23:35:10.859 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":95,"fsid":"8b03efce-7092-11ef-bcea-c7b262605968","created":"2024-09-11T23:07:59.386838+0000","modified":"2024-09-11T23:17:53.878617+0000","last_up_change":"2024-09-11T23:15:16.985748+0000","last_in_change":"2024-09-11T23:14:54.154116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:11:16.547642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:16:11.075859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T23:16:14.019910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-11T23:16:22.041463+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f76ccb11-fe3b-4df1-9a71-e6ca50de80e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1678472768},{"type":"v1","addr":"172.21.15.37:6803","nonce":1678472768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1678472768},{"type":"v1","addr":"172.21.15.37:6805","nonce":1678472768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1678472768},{"type":"v1","addr":"172.21.15.37:6809","nonce":1678472768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1678472768},{"type":"v1","addr":"172.21.15.37:6807","nonce":1678472768}]},"public_addr":"172.21.15.37:6803/1678472768","cluster_addr":"172.21.15.37:6805/1678472768","heartbeat_back_addr":"172.21.15.37:6809/1678472768","heartbeat_front_addr":"172.21.15.37:6807/1678472768","state":["exists","up"]},{"osd":1,"uuid":"13d26eed-1160-4b15-b66b-66c89066c66f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":141504725},{"type":"v1","addr":"172.21.15.123:6801","nonce":141504725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":141504725},{"type":"v1","addr":"172.21.15.123:6803","nonce":141504725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":141504725},{"type":"v1","addr":"172.21.15.123:6807","nonce":141504725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":141504725},{"type":"v1","addr":"172.21.15.123:6805","nonce":141504725}]},"public_addr":"172.21.15.123:6801/141504725","cluster_addr":"172.21.15.123:6803/141504725","heartbeat_back_addr":"172.21.15.123:6807/141504725","heartbeat_front_addr":"172.21.15.123:6805/141504725","state":["exists","up"]},{"osd":2,"uuid":"53daf4d5-2a43-4a89-bae9-f32b89b517f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":1866489133},{"type":"v1","addr":"172.21.15.160:6801","nonce":1866489133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":1866489133},{"type":"v1","addr":"172.21.15.160:6803","nonce":1866489133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":1866489133},{"type":"v1","addr":"172.21.15.160:6807","nonce":1866489133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":1866489133},{"type":"v1","addr":"172.21.15.160:6805","nonce":1866489133}]},"public_addr":"172.21.15.160:6801/1866489133","cluster_addr":"172.21.15.160:6803/1866489133","heartbeat_back_addr":"172.21.15.160:6807/1866489133","heartbeat_front_addr":"172.21.15.160:6805/1866489133","state":["exists","up"]},{"osd":3,"uuid":"7c819225-964b-44f2-93e5-1d7585eb0b36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":412656036},{"type":"v1","addr":"172.21.15.37:6811","nonce":412656036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":412656036},{"type":"v1","addr":"172.21.15.37:6813","nonce":412656036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":412656036},{"type":"v1","addr":"172.21.15.37:6817","nonce":412656036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":412656036},{"type":"v1","addr":"172.21.15.37:6815","nonce":412656036}]},"public_addr":"172.21.15.37:6811/412656036","cluster_addr":"172.21.15.37:6813/412656036","heartbeat_back_addr":"172.21.15.37:6817/412656036","heartbeat_front_addr":"172.21.15.37:6815/412656036","state":["exists","up"]},{"osd":4,"uuid":"e5ab5638-8c7e-4433-8dd0-ba57e28f39b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":3228822066},{"type":"v1","addr":"172.21.15.123:6809","nonce":3228822066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":3228822066},{"type":"v1","addr":"172.21.15.123:6811","nonce":3228822066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":3228822066},{"type":"v1","addr":"172.21.15.123:6815","nonce":3228822066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":3228822066},{"type":"v1","addr":"172.21.15.123:6813","nonce":3228822066}]},"public_addr":"172.21.15.123:6809/3228822066","cluster_addr":"172.21.15.123:6811/3228822066","heartbeat_back_addr":"172.21.15.123:6815/3228822066","heartbeat_front_addr":"172.21.15.123:6813/3228822066","state":["exists","up"]},{"osd":5,"uuid":"7f080d49-eec8-4cd9-b410-b2e84139292e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":1618319675},{"type":"v1","addr":"172.21.15.160:6809","nonce":1618319675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":1618319675},{"type":"v1","addr":"172.21.15.160:6811","nonce":1618319675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":1618319675},{"type":"v1","addr":"172.21.15.160:6815","nonce":1618319675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":1618319675},{"type":"v1","addr":"172.21.15.160:6813","nonce":1618319675}]},"public_addr":"172.21.15.160:6809/1618319675","cluster_addr":"172.21.15.160:6811/1618319675","heartbeat_back_addr":"172.21.15.160:6815/1618319675","heartbeat_front_addr":"172.21.15.160:6813/1618319675","state":["exists","up"]},{"osd":6,"uuid":"d0881c4e-bd8d-4575-8c81-94d21825c227","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3541251299},{"type":"v1","addr":"172.21.15.37:6819","nonce":3541251299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3541251299},{"type":"v1","addr":"172.21.15.37:6821","nonce":3541251299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":3541251299},{"type":"v1","addr":"172.21.15.37:6825","nonce":3541251299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3541251299},{"type":"v1","addr":"172.21.15.37:6823","nonce":3541251299}]},"public_addr":"172.21.15.37:6819/3541251299","cluster_addr":"172.21.15.37:6821/3541251299","heartbeat_back_addr":"172.21.15.37:6825/3541251299","heartbeat_front_addr":"172.21.15.37:6823/3541251299","state":["exists","up"]},{"osd":7,"uuid":"04fbec2e-91b5-4a89-a4a3-472398c45288","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":4279933341},{"type":"v1","addr":"172.21.15.123:6817","nonce":4279933341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":4279933341},{"type":"v1","addr":"172.21.15.123:6819","nonce":4279933341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":4279933341},{"type":"v1","addr":"172.21.15.123:6823","nonce":4279933341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":4279933341},{"type":"v1","addr":"172.21.15.123:6821","nonce":4279933341}]},"public_addr":"172.21.15.123:6817/4279933341","cluster_addr":"172.21.15.123:6819/4279933341","heartbeat_back_addr":"172.21.15.123:6823/4279933341","heartbeat_front_addr":"172.21.15.123:6821/4279933341","state":["exists","up"]},{"osd":8,"uuid":"c77090a7-308e-4c6d-a56e-ce6f8e050ae5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":740968584},{"type":"v1","addr":"172.21.15.160:6817","nonce":740968584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":740968584},{"type":"v1","addr":"172.21.15.160:6819","nonce":740968584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":740968584},{"type":"v1","addr":"172.21.15.160:6823","nonce":740968584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":740968584},{"type":"v1","addr":"172.21.15.160:6821","nonce":740968584}]},"public_addr":"172.21.15.160:6817/740968584","cluster_addr":"172.21.15.160:6819/740968584","heartbeat_back_addr":"172.21.15.160:6823/740968584","heartbeat_front_addr":"172.21.15.160:6821/740968584","state":["exists","up"]},{"osd":9,"uuid":"bcd19bd4-88bc-46f7-b48c-af9e3d17aa96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":692114850},{"type":"v1","addr":"172.21.15.37:6827","nonce":692114850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":692114850},{"type":"v1","addr":"172.21.15.37:6829","nonce":692114850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":692114850},{"type":"v1","addr":"172.21.15.37:6833","nonce":692114850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":692114850},{"type":"v1","addr":"172.21.15.37:6831","nonce":692114850}]},"public_addr":"172.21.15.37:6827/692114850","cluster_addr":"172.21.15.37:6829/692114850","heartbeat_back_addr":"172.21.15.37:6833/692114850","heartbeat_front_addr":"172.21.15.37:6831/692114850","state":["exists","up"]},{"osd":10,"uuid":"9e956e6c-c28a-4a4c-b385-c458788858ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":471058996},{"type":"v1","addr":"172.21.15.123:6825","nonce":471058996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":471058996},{"type":"v1","addr":"172.21.15.123:6827","nonce":471058996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":471058996},{"type":"v1","addr":"172.21.15.123:6831","nonce":471058996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":471058996},{"type":"v1","addr":"172.21.15.123:6829","nonce":471058996}]},"public_addr":"172.21.15.123:6825/471058996","cluster_addr":"172.21.15.123:6827/471058996","heartbeat_back_addr":"172.21.15.123:6831/471058996","heartbeat_front_addr":"172.21.15.123:6829/471058996","state":["exists","up"]},{"osd":11,"uuid":"0b5b3364-9a40-4cab-90d4-b7b1cba57bc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":3982315018},{"type":"v1","addr":"172.21.15.160:6825","nonce":3982315018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3982315018},{"type":"v1","addr":"172.21.15.160:6827","nonce":3982315018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3982315018},{"type":"v1","addr":"172.21.15.160:6831","nonce":3982315018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3982315018},{"type":"v1","addr":"172.21.15.160:6829","nonce":3982315018}]},"public_addr":"172.21.15.160:6825/3982315018","cluster_addr":"172.21.15.160:6827/3982315018","heartbeat_back_addr":"172.21.15.160:6831/3982315018","heartbeat_front_addr":"172.21.15.160:6829/3982315018","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:10:21.139833+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:10:47.004960+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:11:11.460263+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:11:40.849286+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:12:06.497448+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:12:32.043206+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:13:01.402019+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:13:27.993489+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:13:52.291643+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:23.840299+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:14:49.448254+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:15:15.310947+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":1}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":7}]},{"pgid":"3.17","mappings":[{"from":4,"to":7}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.30","mappings":[{"from":1,"to":9}]},{"pgid":"3.38","mappings":[{"from":5,"to":8}]},{"pgid":"4.5","mappings":[{"from":9,"to":10}]},{"pgid":"4.b","mappings":[{"from":9,"to":8}]},{"pgid":"4.11","mappings":[{"from":5,"to":8}]},{"pgid":"4.16","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:6801/2886800769":"2024-09-12T23:08:51.934167+0000","172.21.15.37:0/1811301224":"2024-09-12T23:08:51.934167+0000","172.21.15.37:0/513883980":"2024-09-12T23:08:51.934167+0000","172.21.15.37:0/3698260188":"2024-09-12T23:08:23.793913+0000","172.21.15.37:6800/2886800769":"2024-09-12T23:08:51.934167+0000","172.21.15.37:0/4134736061":"2024-09-12T23:08:23.793913+0000","172.21.15.37:0/3426758476":"2024-09-12T23:08:51.934167+0000","172.21.15.37:0/2545840561":"2024-09-12T23:08:23.793913+0000","172.21.15.37:6801/3447426643":"2024-09-12T23:08:23.793913+0000","172.21.15.37:6800/3447426643":"2024-09-12T23:08:23.793913+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:35:10.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:10.860+0000 7f1849200640 1 -- 172.21.15.37:0/561523093 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f18280a2c00 msgr2=0x7f18280a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:35:10.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:10.860+0000 7f1849200640 1 --2- 172.21.15.37:0/561523093 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f18280a2c00 0x7f18280a50c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f184410ab00 tx=0x7f182c005f90 comp rx=0 tx=0).stop 2024-09-11T23:35:10.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:10.860+0000 7f1849200640 1 -- 172.21.15.37:0/561523093 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1844103ff0 msgr2=0x7f184419a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:35:10.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:10.860+0000 7f1849200640 1 --2- 172.21.15.37:0/561523093 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1844103ff0 0x7f184419a5e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f183400d950 tx=0x7f183400de10 comp rx=0 tx=0).stop 2024-09-11T23:35:10.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:10.860+0000 7f1849200640 1 -- 172.21.15.37:0/561523093 shutdown_connections 2024-09-11T23:35:10.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:10.860+0000 7f1849200640 1 --2- 172.21.15.37:0/561523093 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f18280a2c00 0x7f18280a50c0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:35:10.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:10.860+0000 7f1849200640 1 --2- 172.21.15.37:0/561523093 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1844109120 0x7f184419eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:35:10.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:10.860+0000 7f1849200640 1 --2- 172.21.15.37:0/561523093 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f18441049a0 0x7f184419ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:35:10.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:10.860+0000 7f1849200640 1 --2- 172.21.15.37:0/561523093 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1844103ff0 0x7f184419a5e0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:35:10.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:10.860+0000 7f1849200640 1 -- 172.21.15.37:0/561523093 >> 172.21.15.37:0/561523093 conn(0x7f18440ffa90 msgr2=0x7f18441005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:35:10.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:10.861+0000 7f1849200640 1 -- 172.21.15.37:0/561523093 shutdown_connections 2024-09-11T23:35:10.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:10.861+0000 7f1849200640 1 -- 172.21.15.37:0/561523093 wait complete. 2024-09-11T23:35:11.186 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:35:10 smithi160 ceph-mon[35055]: from='client.? 172.21.15.37:0/561523093' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:35:11.221 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:35:10 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/561523093' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:35:11.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:35:10 smithi123 ceph-mon[35438]: from='client.? 172.21.15.37:0/561523093' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:35:11.610 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph fs fail cephfs 2024-09-11T23:35:11.994 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:35:12.151 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:35:11 smithi037 ceph-mon[30630]: pgmap v874: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 24 KiB/s wr, 12 op/s 2024-09-11T23:35:12.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:35:11 smithi160 ceph-mon[35055]: pgmap v874: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 24 KiB/s wr, 12 op/s 2024-09-11T23:35:12.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:35:11 smithi123 ceph-mon[35438]: pgmap v874: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 24 KiB/s wr, 12 op/s 2024-09-11T23:35:12.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:12.669+0000 7f48b3400640 1 -- 172.21.15.37:0/4040722988 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f48ac1049c0 msgr2=0x7f48ac108a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:35:12.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:12.669+0000 7f48b3400640 1 --2- 172.21.15.37:0/4040722988 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f48ac1049c0 0x7f48ac108a10 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f4898009900 tx=0x7f489802a3f0 comp rx=0 tx=0).stop 2024-09-11T23:35:12.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:12.669+0000 7f48b3400640 1 -- 172.21.15.37:0/4040722988 shutdown_connections 2024-09-11T23:35:12.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:12.669+0000 7f48b3400640 1 --2- 172.21.15.37:0/4040722988 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f48ac1049c0 0x7f48ac108a10 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:35:12.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:12.669+0000 7f48b3400640 1 --2- 172.21.15.37:0/4040722988 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f48ac109140 0x7f48ac110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:35:12.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:12.669+0000 7f48b3400640 1 --2- 172.21.15.37:0/4040722988 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f48ac104010 0x7f48ac1043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:35:12.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:12.669+0000 7f48b3400640 1 -- 172.21.15.37:0/4040722988 >> 172.21.15.37:0/4040722988 conn(0x7f48ac0ffa50 msgr2=0x7f48ac101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:35:12.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:12.669+0000 7f48b3400640 1 -- 172.21.15.37:0/4040722988 shutdown_connections 2024-09-11T23:35:12.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:12.669+0000 7f48b3400640 1 -- 172.21.15.37:0/4040722988 wait complete. 2024-09-11T23:35:12.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:12.670+0000 7f48b3400640 1 Processor -- start 2024-09-11T23:35:12.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:12.670+0000 7f48b3400640 1 -- start start 2024-09-11T23:35:12.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:12.671+0000 7f48b3400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f48ac104010 0x7f48ac19a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:35:12.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:12.671+0000 7f48b3400640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f48ac1049c0 0x7f48ac19ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:35:12.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:12.671+0000 7f48b3400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f48ac109140 0x7f48ac19efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:35:12.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:12.671+0000 7f48b3400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f48ac114140 con 0x7f48ac104010 2024-09-11T23:35:12.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:12.671+0000 7f48b3400640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f48ac113fc0 con 0x7f48ac109140 2024-09-11T23:35:12.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:12.671+0000 7f48b3400640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f48ac1142c0 con 0x7f48ac1049c0 2024-09-11T23:35:12.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:12.671+0000 7f48b0a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f48ac104010 0x7f48ac19a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:35:12.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:12.671+0000 7f48b0a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f48ac104010 0x7f48ac19a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52736/0 (socket says 172.21.15.37:52736) 2024-09-11T23:35:12.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:12.671+0000 7f48b0a00640 1 -- 172.21.15.37:0/1297437026 learned_addr learned my addr 172.21.15.37:0/1297437026 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:35:12.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:12.671+0000 7f48abe00640 1 --2- 172.21.15.37:0/1297437026 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f48ac1049c0 0x7f48ac19ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:35:12.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:12.671+0000 7f48b1400640 1 --2- 172.21.15.37:0/1297437026 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f48ac109140 0x7f48ac19efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:35:12.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:12.672+0000 7f48b0a00640 1 -- 172.21.15.37:0/1297437026 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f48ac1049c0 msgr2=0x7f48ac19ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:35:12.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:12.672+0000 7f48b0a00640 1 --2- 172.21.15.37:0/1297437026 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f48ac1049c0 0x7f48ac19ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:35:12.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:12.672+0000 7f48b0a00640 1 -- 172.21.15.37:0/1297437026 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f48ac109140 msgr2=0x7f48ac19efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:35:12.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:12.672+0000 7f48b0a00640 1 --2- 172.21.15.37:0/1297437026 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f48ac109140 0x7f48ac19efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:35:12.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:12.672+0000 7f48b0a00640 1 -- 172.21.15.37:0/1297437026 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48ac19f690 con 0x7f48ac104010 2024-09-11T23:35:12.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:12.672+0000 7f48b1400640 1 --2- 172.21.15.37:0/1297437026 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f48ac109140 0x7f48ac19efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:35:12.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:12.672+0000 7f48b0a00640 1 --2- 172.21.15.37:0/1297437026 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f48ac104010 0x7f48ac19a6e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f48a000e9f0 tx=0x7f48a000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:35:12.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:12.672+0000 7f48a9600640 1 -- 172.21.15.37:0/1297437026 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48a000cd80 con 0x7f48ac104010 2024-09-11T23:35:12.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:12.673+0000 7f48a9600640 1 -- 172.21.15.37:0/1297437026 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f48a0010910 con 0x7f48ac104010 2024-09-11T23:35:12.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:12.673+0000 7f48b3400640 1 -- 172.21.15.37:0/1297437026 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48ac19f980 con 0x7f48ac104010 2024-09-11T23:35:12.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:12.673+0000 7f48a9600640 1 -- 172.21.15.37:0/1297437026 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48a0018990 con 0x7f48ac104010 2024-09-11T23:35:12.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:12.673+0000 7f48b3400640 1 -- 172.21.15.37:0/1297437026 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48ac1a7260 con 0x7f48ac104010 2024-09-11T23:35:12.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:12.674+0000 7f48b3400640 1 -- 172.21.15.37:0/1297437026 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48ac1043f0 con 0x7f48ac104010 2024-09-11T23:35:12.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:12.676+0000 7f48a9600640 1 -- 172.21.15.37:0/1297437026 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 20) ==== 137833+0+0 (secure 0 0 0) 0x7f48a0010ac0 con 0x7f48ac104010 2024-09-11T23:35:12.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:12.677+0000 7f48a9600640 1 --2- 172.21.15.37:0/1297437026 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f48940a2b80 0x7f48940a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:35:12.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:12.677+0000 7f48a9600640 1 -- 172.21.15.37:0/1297437026 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9295+0+0 (secure 0 0 0) 0x7f48a00cf7d0 con 0x7f48ac104010 2024-09-11T23:35:12.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:12.677+0000 7f48abe00640 1 --2- 172.21.15.37:0/1297437026 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f48940a2b80 0x7f48940a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:35:12.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:12.678+0000 7f48abe00640 1 --2- 172.21.15.37:0/1297437026 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f48940a2b80 0x7f48940a5040 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f4898009230 tx=0x7f48980058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:35:12.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:12.681+0000 7f48a9600640 1 -- 172.21.15.37:0/1297437026 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f48a009bc60 con 0x7f48ac104010 2024-09-11T23:35:12.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:12.909+0000 7f48b3400640 1 -- 172.21.15.37:0/1297437026 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f48ac19ba40 con 0x7f48ac104010 2024-09-11T23:35:12.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:12.911+0000 7f48a9600640 1 -- 172.21.15.37:0/1297437026 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v31) ==== 161+0+0 (secure 0 0 0) 0x7f48a009ff60 con 0x7f48ac104010 2024-09-11T23:35:12.912 INFO:teuthology.orchestra.run.smithi037.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-11T23:35:12.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:12.915+0000 7f48b3400640 1 -- 172.21.15.37:0/1297437026 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f48940a2b80 msgr2=0x7f48940a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:35:12.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:12.915+0000 7f48b3400640 1 --2- 172.21.15.37:0/1297437026 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f48940a2b80 0x7f48940a5040 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f4898009230 tx=0x7f48980058d0 comp rx=0 tx=0).stop 2024-09-11T23:35:12.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:12.915+0000 7f48b3400640 1 -- 172.21.15.37:0/1297437026 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f48ac104010 msgr2=0x7f48ac19a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:35:12.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:12.915+0000 7f48b3400640 1 --2- 172.21.15.37:0/1297437026 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f48ac104010 0x7f48ac19a6e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f48a000e9f0 tx=0x7f48a000eeb0 comp rx=0 tx=0).stop 2024-09-11T23:35:12.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:12.916+0000 7f48b3400640 1 -- 172.21.15.37:0/1297437026 shutdown_connections 2024-09-11T23:35:12.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:12.916+0000 7f48b3400640 1 --2- 172.21.15.37:0/1297437026 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f48940a2b80 0x7f48940a5040 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:35:12.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:12.916+0000 7f48b3400640 1 --2- 172.21.15.37:0/1297437026 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f48ac109140 0x7f48ac19efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:35:12.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:12.916+0000 7f48b3400640 1 --2- 172.21.15.37:0/1297437026 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f48ac1049c0 0x7f48ac19ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:35:12.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:12.916+0000 7f48b3400640 1 --2- 172.21.15.37:0/1297437026 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f48ac104010 0x7f48ac19a6e0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:35:12.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:12.916+0000 7f48b3400640 1 -- 172.21.15.37:0/1297437026 >> 172.21.15.37:0/1297437026 conn(0x7f48ac0ffa50 msgr2=0x7f48ac100e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:35:12.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:12.916+0000 7f48b3400640 1 -- 172.21.15.37:0/1297437026 shutdown_connections 2024-09-11T23:35:12.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:12.916+0000 7f48b3400640 1 -- 172.21.15.37:0/1297437026 wait complete. 2024-09-11T23:35:12.931 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:35:12 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mon-a[30626]: 2024-09-11T23:35:12.909+0000 7f8e1c400640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-11T23:35:13.250 INFO:journalctl@ceph.mds.e.smithi123.stdout:Sep 11 23:35:12 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-e[64974]: ignoring --setuser ceph since I am not root 2024-09-11T23:35:13.251 INFO:journalctl@ceph.mds.e.smithi123.stdout:Sep 11 23:35:12 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-e[64974]: ignoring --setgroup ceph since I am not root 2024-09-11T23:35:13.251 INFO:journalctl@ceph.mds.e.smithi123.stdout:Sep 11 23:35:12 smithi123 ceph-mds[64978]: -- 172.21.15.123:0/2167341545 <== mon.2 v2:172.21.15.123:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5617f079d860 con 0x5617f077b000 2024-09-11T23:35:13.251 INFO:journalctl@ceph.mds.e.smithi123.stdout:Sep 11 23:35:12 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-e[64974]: starting mds.e at 2024-09-11T23:35:13.251 INFO:journalctl@ceph.mds.h.smithi123.stdout:Sep 11 23:35:12 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-h[65279]: ignoring --setuser ceph since I am not root 2024-09-11T23:35:13.252 INFO:journalctl@ceph.mds.h.smithi123.stdout:Sep 11 23:35:12 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-h[65279]: ignoring --setgroup ceph since I am not root 2024-09-11T23:35:13.252 INFO:journalctl@ceph.mds.h.smithi123.stdout:Sep 11 23:35:12 smithi123 ceph-mds[65283]: -- 172.21.15.123:0/762756357 <== mon.2 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x562fe7460680 con 0x562fe7435000 2024-09-11T23:35:13.252 INFO:journalctl@ceph.mds.h.smithi123.stdout:Sep 11 23:35:12 smithi123 ceph-mds[65283]: -- 172.21.15.123:0/762756357 <== mon.2 v2:172.21.15.123:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562fe7457860 con 0x562fe7435000 2024-09-11T23:35:13.252 INFO:journalctl@ceph.mds.h.smithi123.stdout:Sep 11 23:35:12 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-h[65279]: starting mds.h at 2024-09-11T23:35:13.252 INFO:journalctl@ceph.mds.b.smithi123.stdout:Sep 11 23:35:12 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-b[65584]: ignoring --setuser ceph since I am not root 2024-09-11T23:35:13.253 INFO:journalctl@ceph.mds.b.smithi123.stdout:Sep 11 23:35:12 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-b[65584]: ignoring --setgroup ceph since I am not root 2024-09-11T23:35:13.253 INFO:journalctl@ceph.mds.b.smithi123.stdout:Sep 11 23:35:12 smithi123 ceph-mds[65588]: -- 172.21.15.123:0/3059916866 <== mon.1 v2:172.21.15.160:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5581a218dc20 con 0x5581a216a800 2024-09-11T23:35:13.253 INFO:journalctl@ceph.mds.b.smithi123.stdout:Sep 11 23:35:12 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-b[65584]: starting mds.b at 2024-09-11T23:35:13.253 INFO:journalctl@ceph.mds.k.smithi123.stdout:Sep 11 23:35:12 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-k[64663]: ignoring --setuser ceph since I am not root 2024-09-11T23:35:13.253 INFO:journalctl@ceph.mds.k.smithi123.stdout:Sep 11 23:35:12 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-k[64663]: ignoring --setgroup ceph since I am not root 2024-09-11T23:35:13.253 INFO:journalctl@ceph.mds.k.smithi123.stdout:Sep 11 23:35:12 smithi123 ceph-mds[64667]: -- 172.21.15.123:0/2900101573 <== mon.2 v2:172.21.15.123:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55945fb5dc20 con 0x55945fb3b400 2024-09-11T23:35:13.254 INFO:journalctl@ceph.mds.k.smithi123.stdout:Sep 11 23:35:12 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-k[64663]: starting mds.k at 2024-09-11T23:35:13.306 INFO:journalctl@ceph.mds.g.smithi037.stdout:Sep 11 23:35:13 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-g[71187]: ignoring --setuser ceph since I am not root 2024-09-11T23:35:13.307 INFO:journalctl@ceph.mds.g.smithi037.stdout:Sep 11 23:35:13 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-g[71187]: ignoring --setgroup ceph since I am not root 2024-09-11T23:35:13.307 INFO:journalctl@ceph.mds.g.smithi037.stdout:Sep 11 23:35:13 smithi037 ceph-mds[71196]: -- 172.21.15.37:0/943079476 <== mon.0 v2:172.21.15.37:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55fa604e3860 con 0x55fa604c0800 2024-09-11T23:35:13.307 INFO:journalctl@ceph.mds.g.smithi037.stdout:Sep 11 23:35:13 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-g[71187]: starting mds.g at 2024-09-11T23:35:13.307 INFO:journalctl@ceph.mds.a.smithi037.stdout:Sep 11 23:35:13 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-a[71559]: ignoring --setuser ceph since I am not root 2024-09-11T23:35:13.307 INFO:journalctl@ceph.mds.a.smithi037.stdout:Sep 11 23:35:13 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-a[71559]: ignoring --setgroup ceph since I am not root 2024-09-11T23:35:13.307 INFO:journalctl@ceph.mds.a.smithi037.stdout:Sep 11 23:35:13 smithi037 ceph-mds[71563]: -- 172.21.15.37:0/3762432462 <== mon.1 v2:172.21.15.160:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x558563baf860 con 0x558563b8c800 2024-09-11T23:35:13.307 INFO:journalctl@ceph.mds.a.smithi037.stdout:Sep 11 23:35:13 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-a[71559]: starting mds.a at 2024-09-11T23:35:13.307 INFO:journalctl@ceph.mds.a.smithi037.stdout:Sep 11 23:35:13 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-a[71559]: 2024-09-11T23:35:13.044+0000 7f20c8a00640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6838/0: (98) Address already in use 2024-09-11T23:35:13.433 INFO:journalctl@ceph.mds.l.smithi160.stdout:Sep 11 23:35:12 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-l[64231]: ignoring --setuser ceph since I am not root 2024-09-11T23:35:13.434 INFO:journalctl@ceph.mds.l.smithi160.stdout:Sep 11 23:35:12 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-l[64231]: ignoring --setgroup ceph since I am not root 2024-09-11T23:35:13.434 INFO:journalctl@ceph.mds.l.smithi160.stdout:Sep 11 23:35:12 smithi160 ceph-mds[64235]: -- 172.21.15.160:0/379042506 <== mon.1 v2:172.21.15.160:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556a86d07860 con 0x556a86ce5000 2024-09-11T23:35:13.434 INFO:journalctl@ceph.mds.l.smithi160.stdout:Sep 11 23:35:12 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-l[64231]: starting mds.l at 2024-09-11T23:35:13.434 INFO:journalctl@ceph.mds.c.smithi160.stdout:Sep 11 23:35:12 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-c[64849]: ignoring --setuser ceph since I am not root 2024-09-11T23:35:13.434 INFO:journalctl@ceph.mds.c.smithi160.stdout:Sep 11 23:35:12 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-c[64849]: ignoring --setgroup ceph since I am not root 2024-09-11T23:35:13.434 INFO:journalctl@ceph.mds.c.smithi160.stdout:Sep 11 23:35:12 smithi160 ceph-mds[64853]: -- 172.21.15.160:0/4086902015 <== mon.2 v2:172.21.15.123:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556ce33a7860 con 0x556ce3384800 2024-09-11T23:35:13.434 INFO:journalctl@ceph.mds.c.smithi160.stdout:Sep 11 23:35:12 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-c[64849]: starting mds.c at 2024-09-11T23:35:13.435 INFO:journalctl@ceph.mds.f.smithi160.stdout:Sep 11 23:35:12 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-f[64549]: ignoring --setuser ceph since I am not root 2024-09-11T23:35:13.435 INFO:journalctl@ceph.mds.f.smithi160.stdout:Sep 11 23:35:12 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-f[64549]: ignoring --setgroup ceph since I am not root 2024-09-11T23:35:13.435 INFO:journalctl@ceph.mds.f.smithi160.stdout:Sep 11 23:35:12 smithi160 ceph-mds[64553]: -- 172.21.15.160:0/984542768 <== mon.1 v2:172.21.15.160:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d4b2905860 con 0x55d4b28e3400 2024-09-11T23:35:13.435 INFO:journalctl@ceph.mds.f.smithi160.stdout:Sep 11 23:35:12 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-f[64549]: starting mds.f at 2024-09-11T23:35:13.435 INFO:journalctl@ceph.mds.i.smithi160.stdout:Sep 11 23:35:12 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-i[65149]: ignoring --setuser ceph since I am not root 2024-09-11T23:35:13.435 INFO:journalctl@ceph.mds.i.smithi160.stdout:Sep 11 23:35:12 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-i[65149]: ignoring --setgroup ceph since I am not root 2024-09-11T23:35:13.435 INFO:journalctl@ceph.mds.i.smithi160.stdout:Sep 11 23:35:12 smithi160 ceph-mds[65153]: -- 172.21.15.160:0/3244722559 <== mon.1 v2:172.21.15.160:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ada5d53860 con 0x55ada5d31400 2024-09-11T23:35:13.435 INFO:journalctl@ceph.mds.i.smithi160.stdout:Sep 11 23:35:12 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-i[65149]: starting mds.i at 2024-09-11T23:35:13.683 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-09-11T23:35:14.067 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:35:14.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:35:13 smithi160 ceph-mon[35055]: pgmap v875: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 15 op/s 2024-09-11T23:35:14.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:35:13 smithi160 ceph-mon[35055]: from='client.? 172.21.15.37:0/1297437026' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-11T23:35:14.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:35:13 smithi160 ceph-mon[35055]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-11T23:35:14.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:35:13 smithi160 ceph-mon[35055]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-11T23:35:14.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:35:13 smithi160 ceph-mon[35055]: from='client.? 172.21.15.37:0/1297437026' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-11T23:35:14.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:35:13 smithi160 ceph-mon[35055]: osdmap e96: 12 total, 12 up, 12 in 2024-09-11T23:35:14.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:35:13 smithi160 ceph-mon[35055]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-11T23:35:14.206 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:35:13 smithi037 ceph-mon[30630]: pgmap v875: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 15 op/s 2024-09-11T23:35:14.207 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:35:13 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/1297437026' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-11T23:35:14.207 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:35:13 smithi037 ceph-mon[30630]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-11T23:35:14.207 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:35:13 smithi037 ceph-mon[30630]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-11T23:35:14.207 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:35:13 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/1297437026' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-11T23:35:14.207 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:35:13 smithi037 ceph-mon[30630]: osdmap e96: 12 total, 12 up, 12 in 2024-09-11T23:35:14.207 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:35:13 smithi037 ceph-mon[30630]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-11T23:35:14.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:35:13 smithi123 ceph-mon[35438]: pgmap v875: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 15 op/s 2024-09-11T23:35:14.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:35:13 smithi123 ceph-mon[35438]: from='client.? 172.21.15.37:0/1297437026' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-11T23:35:14.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:35:13 smithi123 ceph-mon[35438]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-11T23:35:14.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:35:13 smithi123 ceph-mon[35438]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-11T23:35:14.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:35:13 smithi123 ceph-mon[35438]: from='client.? 172.21.15.37:0/1297437026' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-11T23:35:14.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:35:13 smithi123 ceph-mon[35438]: osdmap e96: 12 total, 12 up, 12 in 2024-09-11T23:35:14.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:35:13 smithi123 ceph-mon[35438]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-11T23:35:14.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:14.720+0000 7f9bca200640 1 -- 172.21.15.37:0/979479189 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9bc41049a0 msgr2=0x7f9bc41089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:35:14.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:14.720+0000 7f9bca200640 1 --2- 172.21.15.37:0/979479189 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9bc41049a0 0x7f9bc41089f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f9bb0009900 tx=0x7f9bb002a410 comp rx=0 tx=0).stop 2024-09-11T23:35:14.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:14.720+0000 7f9bca200640 1 -- 172.21.15.37:0/979479189 shutdown_connections 2024-09-11T23:35:14.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:14.720+0000 7f9bca200640 1 --2- 172.21.15.37:0/979479189 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9bc4109120 0x7f9bc4110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:35:14.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:14.720+0000 7f9bca200640 1 --2- 172.21.15.37:0/979479189 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9bc41049a0 0x7f9bc41089f0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:35:14.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:14.720+0000 7f9bca200640 1 --2- 172.21.15.37:0/979479189 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9bc4103ff0 0x7f9bc41043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:35:14.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:14.720+0000 7f9bca200640 1 -- 172.21.15.37:0/979479189 >> 172.21.15.37:0/979479189 conn(0x7f9bc40ffa90 msgr2=0x7f9bc4101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:35:14.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:14.720+0000 7f9bca200640 1 -- 172.21.15.37:0/979479189 shutdown_connections 2024-09-11T23:35:14.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:14.720+0000 7f9bca200640 1 -- 172.21.15.37:0/979479189 wait complete. 2024-09-11T23:35:14.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:14.721+0000 7f9bca200640 1 Processor -- start 2024-09-11T23:35:14.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:14.721+0000 7f9bca200640 1 -- start start 2024-09-11T23:35:14.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:14.721+0000 7f9bca200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9bc4103ff0 0x7f9bc419a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:35:14.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:14.721+0000 7f9bca200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9bc41049a0 0x7f9bc419ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:35:14.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:14.721+0000 7f9bca200640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9bc4109120 0x7f9bc419ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:35:14.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:14.721+0000 7f9bca200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9bc4114190 con 0x7f9bc4103ff0 2024-09-11T23:35:14.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:14.721+0000 7f9bca200640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f9bc4114010 con 0x7f9bc41049a0 2024-09-11T23:35:14.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:14.721+0000 7f9bca200640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f9bc4114310 con 0x7f9bc4109120 2024-09-11T23:35:14.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:14.722+0000 7f9bc3400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9bc4103ff0 0x7f9bc419a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:35:14.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:14.722+0000 7f9bc3400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9bc4103ff0 0x7f9bc419a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52798/0 (socket says 172.21.15.37:52798) 2024-09-11T23:35:14.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:14.722+0000 7f9bc3400640 1 -- 172.21.15.37:0/1308247770 learned_addr learned my addr 172.21.15.37:0/1308247770 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:35:14.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:14.722+0000 7f9bc2a00640 1 --2- 172.21.15.37:0/1308247770 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9bc41049a0 0x7f9bc419ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:35:14.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:14.722+0000 7f9bc3e00640 1 --2- 172.21.15.37:0/1308247770 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9bc4109120 0x7f9bc419ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:35:14.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:14.722+0000 7f9bc3400640 1 -- 172.21.15.37:0/1308247770 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9bc4109120 msgr2=0x7f9bc419ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:35:14.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:14.722+0000 7f9bc3400640 1 --2- 172.21.15.37:0/1308247770 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9bc4109120 0x7f9bc419ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:35:14.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:14.722+0000 7f9bc3400640 1 -- 172.21.15.37:0/1308247770 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9bc41049a0 msgr2=0x7f9bc419ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:35:14.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:14.722+0000 7f9bc3400640 1 --2- 172.21.15.37:0/1308247770 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9bc41049a0 0x7f9bc419ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:35:14.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:14.722+0000 7f9bc3400640 1 -- 172.21.15.37:0/1308247770 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bc419f5e0 con 0x7f9bc4103ff0 2024-09-11T23:35:14.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:14.722+0000 7f9bc3e00640 1 --2- 172.21.15.37:0/1308247770 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9bc4109120 0x7f9bc419ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:35:14.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:14.722+0000 7f9bc2a00640 1 --2- 172.21.15.37:0/1308247770 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9bc41049a0 0x7f9bc419ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:35:14.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:14.722+0000 7f9bc3400640 1 --2- 172.21.15.37:0/1308247770 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9bc4103ff0 0x7f9bc419a630 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f9bb400e9f0 tx=0x7f9bb400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:35:14.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:14.723+0000 7f9bbbe00640 1 -- 172.21.15.37:0/1308247770 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bb400cd80 con 0x7f9bc4103ff0 2024-09-11T23:35:14.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:14.723+0000 7f9bca200640 1 -- 172.21.15.37:0/1308247770 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bc419f8d0 con 0x7f9bc4103ff0 2024-09-11T23:35:14.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:14.723+0000 7f9bbbe00640 1 -- 172.21.15.37:0/1308247770 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9bb4005500 con 0x7f9bc4103ff0 2024-09-11T23:35:14.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:14.723+0000 7f9bbbe00640 1 -- 172.21.15.37:0/1308247770 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bb4010690 con 0x7f9bc4103ff0 2024-09-11T23:35:14.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:14.723+0000 7f9bca200640 1 -- 172.21.15.37:0/1308247770 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bc41a71b0 con 0x7f9bc4103ff0 2024-09-11T23:35:14.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:14.724+0000 7f9bca200640 1 -- 172.21.15.37:0/1308247770 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9bc41043d0 con 0x7f9bc4103ff0 2024-09-11T23:35:14.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:14.726+0000 7f9bbbe00640 1 -- 172.21.15.37:0/1308247770 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 20) ==== 137833+0+0 (secure 0 0 0) 0x7f9bb40046c0 con 0x7f9bc4103ff0 2024-09-11T23:35:14.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:14.727+0000 7f9bbbe00640 1 --2- 172.21.15.37:0/1308247770 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f9ba80a2c00 0x7f9ba80a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:35:14.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:14.727+0000 7f9bbbe00640 1 -- 172.21.15.37:0/1308247770 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9725+0+0 (secure 0 0 0) 0x7f9bb40cfb40 con 0x7f9bc4103ff0 2024-09-11T23:35:14.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:14.727+0000 7f9bc2a00640 1 --2- 172.21.15.37:0/1308247770 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f9ba80a2c00 0x7f9ba80a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:35:14.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:14.728+0000 7f9bc2a00640 1 --2- 172.21.15.37:0/1308247770 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f9ba80a2c00 0x7f9ba80a50c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f9bb0000c00 tx=0x7f9bb0005a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:35:14.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:14.731+0000 7f9bbbe00640 1 -- 172.21.15.37:0/1308247770 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9bb409c470 con 0x7f9bc4103ff0 2024-09-11T23:35:14.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:14.953+0000 7f9bca200640 1 -- 172.21.15.37:0/1308247770 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f9bc402d7c0 con 0x7f9bc4103ff0 2024-09-11T23:35:15.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:35:14 smithi037 ceph-mon[30630]: mds.? [v2:172.21.15.123:6832/1742513513,v1:172.21.15.123:6834/1742513513] up:boot 2024-09-11T23:35:15.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:35:14 smithi037 ceph-mon[30630]: mds.? [v2:172.21.15.123:6833/224943683,v1:172.21.15.123:6835/224943683] up:boot 2024-09-11T23:35:15.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:35:14 smithi037 ceph-mon[30630]: mds.? [v2:172.21.15.160:6832/676519996,v1:172.21.15.160:6833/676519996] up:boot 2024-09-11T23:35:15.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:35:14 smithi037 ceph-mon[30630]: mds.? [v2:172.21.15.123:6836/759485206,v1:172.21.15.123:6837/759485206] up:boot 2024-09-11T23:35:15.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:35:14 smithi037 ceph-mon[30630]: mds.? [v2:172.21.15.123:6838/902254731,v1:172.21.15.123:6839/902254731] up:boot 2024-09-11T23:35:15.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:35:14 smithi037 ceph-mon[30630]: mds.? [v2:172.21.15.160:6834/1147547110,v1:172.21.15.160:6835/1147547110] up:boot 2024-09-11T23:35:15.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:35:14 smithi037 ceph-mon[30630]: mds.? [v2:172.21.15.160:6836/1260148030,v1:172.21.15.160:6837/1260148030] up:boot 2024-09-11T23:35:15.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:35:14 smithi037 ceph-mon[30630]: mds.? [v2:172.21.15.160:6838/2400395602,v1:172.21.15.160:6839/2400395602] up:boot 2024-09-11T23:35:15.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:35:14 smithi037 ceph-mon[30630]: mds.? [v2:172.21.15.37:6838/3308148095,v1:172.21.15.37:6840/3308148095] up:boot 2024-09-11T23:35:15.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:35:14 smithi037 ceph-mon[30630]: mds.? [v2:172.21.15.37:6839/853248635,v1:172.21.15.37:6841/853248635] up:boot 2024-09-11T23:35:15.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:35:14 smithi037 ceph-mon[30630]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-11T23:35:15.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:35:14 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-11T23:35:15.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:35:14 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-11T23:35:15.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:35:14 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-11T23:35:15.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:35:14 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-11T23:35:15.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:35:14 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-11T23:35:15.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:35:14 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-11T23:35:15.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:35:14 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-11T23:35:15.066 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:35:14 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-11T23:35:15.066 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:35:14 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-11T23:35:15.066 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:35:14 smithi037 ceph-mon[30630]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-11T23:35:15.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:35:14 smithi160 ceph-mon[35055]: mds.? [v2:172.21.15.123:6832/1742513513,v1:172.21.15.123:6834/1742513513] up:boot 2024-09-11T23:35:15.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:35:14 smithi160 ceph-mon[35055]: mds.? [v2:172.21.15.123:6833/224943683,v1:172.21.15.123:6835/224943683] up:boot 2024-09-11T23:35:15.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:35:14 smithi160 ceph-mon[35055]: mds.? [v2:172.21.15.160:6832/676519996,v1:172.21.15.160:6833/676519996] up:boot 2024-09-11T23:35:15.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:35:14 smithi160 ceph-mon[35055]: mds.? [v2:172.21.15.123:6836/759485206,v1:172.21.15.123:6837/759485206] up:boot 2024-09-11T23:35:15.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:35:14 smithi160 ceph-mon[35055]: mds.? [v2:172.21.15.123:6838/902254731,v1:172.21.15.123:6839/902254731] up:boot 2024-09-11T23:35:15.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:35:14 smithi160 ceph-mon[35055]: mds.? [v2:172.21.15.160:6834/1147547110,v1:172.21.15.160:6835/1147547110] up:boot 2024-09-11T23:35:15.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:35:14 smithi160 ceph-mon[35055]: mds.? [v2:172.21.15.160:6836/1260148030,v1:172.21.15.160:6837/1260148030] up:boot 2024-09-11T23:35:15.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:35:14 smithi160 ceph-mon[35055]: mds.? [v2:172.21.15.160:6838/2400395602,v1:172.21.15.160:6839/2400395602] up:boot 2024-09-11T23:35:15.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:35:14 smithi160 ceph-mon[35055]: mds.? [v2:172.21.15.37:6838/3308148095,v1:172.21.15.37:6840/3308148095] up:boot 2024-09-11T23:35:15.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:35:14 smithi160 ceph-mon[35055]: mds.? [v2:172.21.15.37:6839/853248635,v1:172.21.15.37:6841/853248635] up:boot 2024-09-11T23:35:15.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:35:14 smithi160 ceph-mon[35055]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-11T23:35:15.186 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:35:14 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-11T23:35:15.186 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:35:14 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-11T23:35:15.186 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:35:14 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-11T23:35:15.186 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:35:14 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-11T23:35:15.186 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:35:14 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-11T23:35:15.186 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:35:14 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-11T23:35:15.186 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:35:14 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-11T23:35:15.186 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:35:14 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-11T23:35:15.186 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:35:14 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-11T23:35:15.186 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:35:14 smithi160 ceph-mon[35055]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-11T23:35:15.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:35:14 smithi123 ceph-mon[35438]: mds.? [v2:172.21.15.123:6832/1742513513,v1:172.21.15.123:6834/1742513513] up:boot 2024-09-11T23:35:15.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:35:14 smithi123 ceph-mon[35438]: mds.? [v2:172.21.15.123:6833/224943683,v1:172.21.15.123:6835/224943683] up:boot 2024-09-11T23:35:15.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:35:14 smithi123 ceph-mon[35438]: mds.? [v2:172.21.15.160:6832/676519996,v1:172.21.15.160:6833/676519996] up:boot 2024-09-11T23:35:15.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:35:14 smithi123 ceph-mon[35438]: mds.? [v2:172.21.15.123:6836/759485206,v1:172.21.15.123:6837/759485206] up:boot 2024-09-11T23:35:15.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:35:14 smithi123 ceph-mon[35438]: mds.? [v2:172.21.15.123:6838/902254731,v1:172.21.15.123:6839/902254731] up:boot 2024-09-11T23:35:15.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:35:14 smithi123 ceph-mon[35438]: mds.? [v2:172.21.15.160:6834/1147547110,v1:172.21.15.160:6835/1147547110] up:boot 2024-09-11T23:35:15.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:35:14 smithi123 ceph-mon[35438]: mds.? [v2:172.21.15.160:6836/1260148030,v1:172.21.15.160:6837/1260148030] up:boot 2024-09-11T23:35:15.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:35:14 smithi123 ceph-mon[35438]: mds.? [v2:172.21.15.160:6838/2400395602,v1:172.21.15.160:6839/2400395602] up:boot 2024-09-11T23:35:15.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:35:14 smithi123 ceph-mon[35438]: mds.? [v2:172.21.15.37:6838/3308148095,v1:172.21.15.37:6840/3308148095] up:boot 2024-09-11T23:35:15.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:35:14 smithi123 ceph-mon[35438]: mds.? [v2:172.21.15.37:6839/853248635,v1:172.21.15.37:6841/853248635] up:boot 2024-09-11T23:35:15.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:35:14 smithi123 ceph-mon[35438]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-11T23:35:15.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:35:14 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-11T23:35:15.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:35:14 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-11T23:35:15.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:35:14 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-11T23:35:15.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:35:14 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-11T23:35:15.252 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:35:14 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-11T23:35:15.252 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:35:14 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-11T23:35:15.252 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:35:14 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-11T23:35:15.252 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:35:14 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-11T23:35:15.252 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:35:14 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-11T23:35:15.252 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:35:14 smithi123 ceph-mon[35438]: from='mgr.14150 172.21.15.37:0/1526198990' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-11T23:35:15.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:15.929+0000 7f9bbbe00640 1 -- 172.21.15.37:0/1308247770 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v33) ==== 104+0+0 (secure 0 0 0) 0x7f9bb409bd70 con 0x7f9bc4103ff0 2024-09-11T23:35:15.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:15.932+0000 7f9bca200640 1 -- 172.21.15.37:0/1308247770 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f9ba80a2c00 msgr2=0x7f9ba80a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:35:15.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:15.932+0000 7f9bca200640 1 --2- 172.21.15.37:0/1308247770 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f9ba80a2c00 0x7f9ba80a50c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f9bb0000c00 tx=0x7f9bb0005a40 comp rx=0 tx=0).stop 2024-09-11T23:35:15.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:15.932+0000 7f9bca200640 1 -- 172.21.15.37:0/1308247770 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9bc4103ff0 msgr2=0x7f9bc419a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:35:15.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:15.932+0000 7f9bca200640 1 --2- 172.21.15.37:0/1308247770 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9bc4103ff0 0x7f9bc419a630 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f9bb400e9f0 tx=0x7f9bb400edf0 comp rx=0 tx=0).stop 2024-09-11T23:35:15.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:15.932+0000 7f9bca200640 1 -- 172.21.15.37:0/1308247770 shutdown_connections 2024-09-11T23:35:15.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:15.932+0000 7f9bca200640 1 --2- 172.21.15.37:0/1308247770 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f9ba80a2c00 0x7f9ba80a50c0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:35:15.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:15.932+0000 7f9bca200640 1 --2- 172.21.15.37:0/1308247770 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9bc41049a0 0x7f9bc419ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:35:15.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:15.932+0000 7f9bca200640 1 --2- 172.21.15.37:0/1308247770 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9bc4109120 0x7f9bc419ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:35:15.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:15.932+0000 7f9bca200640 1 --2- 172.21.15.37:0/1308247770 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9bc4103ff0 0x7f9bc419a630 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:35:15.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:15.932+0000 7f9bca200640 1 -- 172.21.15.37:0/1308247770 >> 172.21.15.37:0/1308247770 conn(0x7f9bc40ffa90 msgr2=0x7f9bc4100dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:35:15.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:15.932+0000 7f9bca200640 1 -- 172.21.15.37:0/1308247770 shutdown_connections 2024-09-11T23:35:15.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:15.932+0000 7f9bca200640 1 -- 172.21.15.37:0/1308247770 wait complete. 2024-09-11T23:35:16.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:35:15 smithi160 ceph-mon[35055]: pgmap v877: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 27 KiB/s wr, 13 op/s 2024-09-11T23:35:16.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:35:15 smithi160 ceph-mon[35055]: from='client.? 172.21.15.37:0/1308247770' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-11T23:35:16.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:35:15 smithi123 ceph-mon[35438]: pgmap v877: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 27 KiB/s wr, 13 op/s 2024-09-11T23:35:16.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:35:15 smithi123 ceph-mon[35438]: from='client.? 172.21.15.37:0/1308247770' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-11T23:35:16.311 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:35:15 smithi037 ceph-mon[30630]: pgmap v877: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 27 KiB/s wr, 13 op/s 2024-09-11T23:35:16.311 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:35:15 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/1308247770' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-11T23:35:16.701 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-11T23:35:17.085 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:35:17.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:35:16 smithi160 ceph-mon[35055]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-11T23:35:17.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:35:16 smithi160 ceph-mon[35055]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-11T23:35:17.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:35:16 smithi160 ceph-mon[35055]: Cluster is now healthy 2024-09-11T23:35:17.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:35:16 smithi160 ceph-mon[35055]: from='client.? 172.21.15.37:0/1308247770' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-11T23:35:17.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:35:16 smithi160 ceph-mon[35055]: fsmap 12 up:standby 2024-09-11T23:35:17.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:35:16 smithi037 ceph-mon[30630]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-11T23:35:17.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:35:16 smithi037 ceph-mon[30630]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-11T23:35:17.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:35:16 smithi037 ceph-mon[30630]: Cluster is now healthy 2024-09-11T23:35:17.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:35:16 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/1308247770' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-11T23:35:17.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:35:16 smithi037 ceph-mon[30630]: fsmap 12 up:standby 2024-09-11T23:35:17.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:35:16 smithi123 ceph-mon[35438]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-11T23:35:17.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:35:16 smithi123 ceph-mon[35438]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-11T23:35:17.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:35:16 smithi123 ceph-mon[35438]: Cluster is now healthy 2024-09-11T23:35:17.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:35:16 smithi123 ceph-mon[35438]: from='client.? 172.21.15.37:0/1308247770' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-11T23:35:17.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:35:16 smithi123 ceph-mon[35438]: fsmap 12 up:standby 2024-09-11T23:35:17.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:17.672+0000 7f0cd8a00640 1 -- 172.21.15.37:0/2580607802 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0cd4103ff0 msgr2=0x7f0cd41043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:35:17.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:17.672+0000 7f0cd8a00640 1 --2- 172.21.15.37:0/2580607802 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0cd4103ff0 0x7f0cd41043d0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f0cc4009ca0 tx=0x7f0cc402a8c0 comp rx=0 tx=0).stop 2024-09-11T23:35:17.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:17.672+0000 7f0cd8a00640 1 -- 172.21.15.37:0/2580607802 shutdown_connections 2024-09-11T23:35:17.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:17.672+0000 7f0cd8a00640 1 --2- 172.21.15.37:0/2580607802 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0cd4109120 0x7f0cd4110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:35:17.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:17.672+0000 7f0cd8a00640 1 --2- 172.21.15.37:0/2580607802 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0cd41049a0 0x7f0cd41089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:35:17.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:17.672+0000 7f0cd8a00640 1 --2- 172.21.15.37:0/2580607802 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0cd4103ff0 0x7f0cd41043d0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:35:17.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:17.672+0000 7f0cd8a00640 1 -- 172.21.15.37:0/2580607802 >> 172.21.15.37:0/2580607802 conn(0x7f0cd40ffa90 msgr2=0x7f0cd4101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:35:17.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:17.672+0000 7f0cd8a00640 1 -- 172.21.15.37:0/2580607802 shutdown_connections 2024-09-11T23:35:17.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:17.672+0000 7f0cd8a00640 1 -- 172.21.15.37:0/2580607802 wait complete. 2024-09-11T23:35:17.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:17.673+0000 7f0cd8a00640 1 Processor -- start 2024-09-11T23:35:17.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:17.673+0000 7f0cd8a00640 1 -- start start 2024-09-11T23:35:17.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:17.673+0000 7f0cd8a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0cd4103ff0 0x7f0cd419a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:35:17.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:17.673+0000 7f0cd8a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0cd41049a0 0x7f0cd419ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:35:17.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:17.673+0000 7f0cd8a00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0cd4109120 0x7f0cd419eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:35:17.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:17.673+0000 7f0cd8a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd4114140 con 0x7f0cd41049a0 2024-09-11T23:35:17.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:17.673+0000 7f0cd8a00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd4113fc0 con 0x7f0cd4103ff0 2024-09-11T23:35:17.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:17.673+0000 7f0cd8a00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd41142c0 con 0x7f0cd4109120 2024-09-11T23:35:17.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:17.673+0000 7f0cc9400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0cd41049a0 0x7f0cd419ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:35:17.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:17.674+0000 7f0cc9400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0cd41049a0 0x7f0cd419ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52808/0 (socket says 172.21.15.37:52808) 2024-09-11T23:35:17.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:17.674+0000 7f0cc9400640 1 -- 172.21.15.37:0/2910155342 learned_addr learned my addr 172.21.15.37:0/2910155342 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:35:17.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:17.674+0000 7f0cd2800640 1 --2- 172.21.15.37:0/2910155342 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0cd4109120 0x7f0cd419eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:35:17.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:17.674+0000 7f0cd1e00640 1 --2- 172.21.15.37:0/2910155342 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0cd4103ff0 0x7f0cd419a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:35:17.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:17.674+0000 7f0cc9400640 1 -- 172.21.15.37:0/2910155342 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0cd4109120 msgr2=0x7f0cd419eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:35:17.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:17.674+0000 7f0cc9400640 1 --2- 172.21.15.37:0/2910155342 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0cd4109120 0x7f0cd419eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:35:17.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:17.674+0000 7f0cc9400640 1 -- 172.21.15.37:0/2910155342 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0cd4103ff0 msgr2=0x7f0cd419a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:35:17.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:17.674+0000 7f0cc9400640 1 --2- 172.21.15.37:0/2910155342 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0cd4103ff0 0x7f0cd419a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:35:17.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:17.674+0000 7f0cc9400640 1 -- 172.21.15.37:0/2910155342 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cd419f5b0 con 0x7f0cd41049a0 2024-09-11T23:35:17.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:17.674+0000 7f0cc9400640 1 --2- 172.21.15.37:0/2910155342 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0cd41049a0 0x7f0cd419ab40 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc00e9f0 tx=0x7f0cbc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:35:17.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:17.675+0000 7f0ccb400640 1 -- 172.21.15.37:0/2910155342 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cbc00cd80 con 0x7f0cd41049a0 2024-09-11T23:35:17.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:17.675+0000 7f0ccb400640 1 -- 172.21.15.37:0/2910155342 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0cbc005500 con 0x7f0cd41049a0 2024-09-11T23:35:17.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:17.675+0000 7f0ccb400640 1 -- 172.21.15.37:0/2910155342 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cbc010690 con 0x7f0cd41049a0 2024-09-11T23:35:17.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:17.675+0000 7f0cd8a00640 1 -- 172.21.15.37:0/2910155342 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cd419f8a0 con 0x7f0cd41049a0 2024-09-11T23:35:17.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:17.675+0000 7f0cd8a00640 1 -- 172.21.15.37:0/2910155342 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cd41a7180 con 0x7f0cd41049a0 2024-09-11T23:35:17.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:17.676+0000 7f0cd8a00640 1 -- 172.21.15.37:0/2910155342 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0cd41043d0 con 0x7f0cd41049a0 2024-09-11T23:35:17.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:17.678+0000 7f0ccb400640 1 -- 172.21.15.37:0/2910155342 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 20) ==== 137833+0+0 (secure 0 0 0) 0x7f0cbc0046c0 con 0x7f0cd41049a0 2024-09-11T23:35:17.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:17.679+0000 7f0ccb400640 1 --2- 172.21.15.37:0/2910155342 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f0cb80a2b80 0x7f0cb80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:35:17.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:17.679+0000 7f0ccb400640 1 -- 172.21.15.37:0/2910155342 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9725+0+0 (secure 0 0 0) 0x7f0cbc0cfa50 con 0x7f0cd41049a0 2024-09-11T23:35:17.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:17.679+0000 7f0cd1e00640 1 --2- 172.21.15.37:0/2910155342 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f0cb80a2b80 0x7f0cb80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:35:17.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:17.680+0000 7f0cd1e00640 1 --2- 172.21.15.37:0/2910155342 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f0cb80a2b80 0x7f0cb80a5040 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f0cc4006010 tx=0x7f0cc4009360 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:35:17.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:17.684+0000 7f0ccb400640 1 -- 172.21.15.37:0/2910155342 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0cbc09c380 con 0x7f0cd41049a0 2024-09-11T23:35:17.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:17.872+0000 7f0cd8a00640 1 -- 172.21.15.37:0/2910155342 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f0cd402d7c0 con 0x7f0cd41049a0 2024-09-11T23:35:17.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:17.931+0000 7f0ccb400640 1 -- 172.21.15.37:0/2910155342 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v97) ==== 181+0+0 (secure 0 0 0) 0x7f0cbc09bc80 con 0x7f0cd41049a0 2024-09-11T23:35:17.932 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' removed 2024-09-11T23:35:17.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:17.934+0000 7f0cd8a00640 1 -- 172.21.15.37:0/2910155342 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f0cb80a2b80 msgr2=0x7f0cb80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:35:17.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:17.934+0000 7f0cd8a00640 1 --2- 172.21.15.37:0/2910155342 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f0cb80a2b80 0x7f0cb80a5040 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f0cc4006010 tx=0x7f0cc4009360 comp rx=0 tx=0).stop 2024-09-11T23:35:17.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:17.934+0000 7f0cd8a00640 1 -- 172.21.15.37:0/2910155342 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0cd41049a0 msgr2=0x7f0cd419ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:35:17.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:17.934+0000 7f0cd8a00640 1 --2- 172.21.15.37:0/2910155342 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0cd41049a0 0x7f0cd419ab40 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc00e9f0 tx=0x7f0cbc00edf0 comp rx=0 tx=0).stop 2024-09-11T23:35:17.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:17.934+0000 7f0cd8a00640 1 -- 172.21.15.37:0/2910155342 shutdown_connections 2024-09-11T23:35:17.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:17.934+0000 7f0cd8a00640 1 --2- 172.21.15.37:0/2910155342 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f0cb80a2b80 0x7f0cb80a5040 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:35:17.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:17.934+0000 7f0cd8a00640 1 --2- 172.21.15.37:0/2910155342 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0cd4109120 0x7f0cd419eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:35:17.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:17.934+0000 7f0cd8a00640 1 --2- 172.21.15.37:0/2910155342 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0cd41049a0 0x7f0cd419ab40 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:35:17.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:17.934+0000 7f0cd8a00640 1 --2- 172.21.15.37:0/2910155342 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0cd4103ff0 0x7f0cd419a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:35:17.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:17.934+0000 7f0cd8a00640 1 -- 172.21.15.37:0/2910155342 >> 172.21.15.37:0/2910155342 conn(0x7f0cd40ffa90 msgr2=0x7f0cd4100db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:35:17.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:17.934+0000 7f0cd8a00640 1 -- 172.21.15.37:0/2910155342 shutdown_connections 2024-09-11T23:35:17.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:17.934+0000 7f0cd8a00640 1 -- 172.21.15.37:0/2910155342 wait complete. 2024-09-11T23:35:18.253 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:35:17 smithi123 ceph-mon[35438]: pgmap v878: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 2.2 KiB/s wr, 10 op/s 2024-09-11T23:35:18.253 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:35:17 smithi123 ceph-mon[35438]: from='client.? 172.21.15.37:0/2910155342' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-11T23:35:18.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:35:17 smithi037 ceph-mon[30630]: pgmap v878: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 2.2 KiB/s wr, 10 op/s 2024-09-11T23:35:18.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:35:17 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/2910155342' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-11T23:35:18.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:35:17 smithi160 ceph-mon[35055]: pgmap v878: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 2.2 KiB/s wr, 10 op/s 2024-09-11T23:35:18.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:35:17 smithi160 ceph-mon[35055]: from='client.? 172.21.15.37:0/2910155342' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-11T23:35:18.797 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-11T23:35:19.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:35:18 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/2910155342' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-11T23:35:19.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:35:18 smithi037 ceph-mon[30630]: osdmap e97: 12 total, 12 up, 12 in 2024-09-11T23:35:19.177 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:35:19.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:35:18 smithi123 ceph-mon[35438]: from='client.? 172.21.15.37:0/2910155342' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-11T23:35:19.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:35:18 smithi123 ceph-mon[35438]: osdmap e97: 12 total, 12 up, 12 in 2024-09-11T23:35:19.335 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:35:18 smithi160 ceph-mon[35055]: from='client.? 172.21.15.37:0/2910155342' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-11T23:35:19.335 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:35:18 smithi160 ceph-mon[35055]: osdmap e97: 12 total, 12 up, 12 in 2024-09-11T23:35:19.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:19.715+0000 7f7abc200640 1 -- 172.21.15.37:0/3974037892 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ab4074e30 msgr2=0x7f7ab410df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:35:19.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:19.715+0000 7f7abc200640 1 --2- 172.21.15.37:0/3974037892 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ab4074e30 0x7f7ab410df10 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7aa0009860 tx=0x7f7aa002a3d0 comp rx=0 tx=0).stop 2024-09-11T23:35:19.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:19.715+0000 7f7abc200640 1 -- 172.21.15.37:0/3974037892 shutdown_connections 2024-09-11T23:35:19.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:19.715+0000 7f7abc200640 1 --2- 172.21.15.37:0/3974037892 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ab4074e30 0x7f7ab410df10 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:35:19.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:19.715+0000 7f7abc200640 1 --2- 172.21.15.37:0/3974037892 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7ab410e450 0x7f7ab4110840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:35:19.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:19.715+0000 7f7abc200640 1 --2- 172.21.15.37:0/3974037892 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ab4074510 0x7f7ab40748f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:35:19.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:19.715+0000 7f7abc200640 1 -- 172.21.15.37:0/3974037892 >> 172.21.15.37:0/3974037892 conn(0x7f7ab40fd8b0 msgr2=0x7f7ab40ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:35:19.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:19.715+0000 7f7abc200640 1 -- 172.21.15.37:0/3974037892 shutdown_connections 2024-09-11T23:35:19.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:19.716+0000 7f7abc200640 1 -- 172.21.15.37:0/3974037892 wait complete. 2024-09-11T23:35:19.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:19.716+0000 7f7abc200640 1 Processor -- start 2024-09-11T23:35:19.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:19.717+0000 7f7abc200640 1 -- start start 2024-09-11T23:35:19.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:19.717+0000 7f7abc200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ab4074510 0x7f7ab419a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:35:19.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:19.717+0000 7f7abc200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ab4074e30 0x7f7ab419abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:35:19.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:19.717+0000 7f7abc200640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7ab410e450 0x7f7ab419ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:35:19.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:19.717+0000 7f7abc200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7ab41141c0 con 0x7f7ab4074e30 2024-09-11T23:35:19.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:19.717+0000 7f7abc200640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f7ab4114040 con 0x7f7ab4074510 2024-09-11T23:35:19.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:19.717+0000 7f7abc200640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f7ab4114340 con 0x7f7ab410e450 2024-09-11T23:35:19.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:19.717+0000 7f7ab9800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ab4074510 0x7f7ab419a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:35:19.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:19.717+0000 7f7ab8e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ab4074e30 0x7f7ab419abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:35:19.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:19.717+0000 7f7ab9800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ab4074510 0x7f7ab419a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.37:53512/0 (socket says 172.21.15.37:53512) 2024-09-11T23:35:19.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:19.717+0000 7f7ab9800640 1 -- 172.21.15.37:0/1621539314 learned_addr learned my addr 172.21.15.37:0/1621539314 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:35:19.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:19.717+0000 7f7aba200640 1 --2- 172.21.15.37:0/1621539314 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7ab410e450 0x7f7ab419ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:35:19.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:19.718+0000 7f7ab9800640 1 -- 172.21.15.37:0/1621539314 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7ab410e450 msgr2=0x7f7ab419ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:35:19.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:19.718+0000 7f7ab9800640 1 --2- 172.21.15.37:0/1621539314 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7ab410e450 0x7f7ab419ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:35:19.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:19.718+0000 7f7ab9800640 1 -- 172.21.15.37:0/1621539314 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ab4074e30 msgr2=0x7f7ab419abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:35:19.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:19.718+0000 7f7ab9800640 1 --2- 172.21.15.37:0/1621539314 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ab4074e30 0x7f7ab419abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:35:19.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:19.718+0000 7f7ab9800640 1 -- 172.21.15.37:0/1621539314 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ab419f640 con 0x7f7ab4074510 2024-09-11T23:35:19.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:19.718+0000 7f7ab9800640 1 --2- 172.21.15.37:0/1621539314 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ab4074510 0x7f7ab419a690 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7aa800e9c0 tx=0x7f7aa800ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:35:19.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:19.718+0000 7f7ab2000640 1 -- 172.21.15.37:0/1621539314 <== mon.2 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aa800ccc0 con 0x7f7ab4074510 2024-09-11T23:35:19.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:19.718+0000 7f7ab2000640 1 -- 172.21.15.37:0/1621539314 <== mon.2 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7aa8005500 con 0x7f7ab4074510 2024-09-11T23:35:19.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:19.718+0000 7f7abc200640 1 -- 172.21.15.37:0/1621539314 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ab419f930 con 0x7f7ab4074510 2024-09-11T23:35:19.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:19.718+0000 7f7ab2000640 1 -- 172.21.15.37:0/1621539314 <== mon.2 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aa8010430 con 0x7f7ab4074510 2024-09-11T23:35:19.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:19.718+0000 7f7abc200640 1 -- 172.21.15.37:0/1621539314 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ab41a7210 con 0x7f7ab4074510 2024-09-11T23:35:19.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:19.719+0000 7f7abc200640 1 -- 172.21.15.37:0/1621539314 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ab40748f0 con 0x7f7ab4074510 2024-09-11T23:35:19.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:19.721+0000 7f7ab2000640 1 -- 172.21.15.37:0/1621539314 <== mon.2 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 20) ==== 137833+0+0 (secure 0 0 0) 0x7f7aa80046c0 con 0x7f7ab4074510 2024-09-11T23:35:19.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:19.723+0000 7f7ab2000640 1 --2- 172.21.15.37:0/1621539314 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f7a9c0a2b80 0x7f7a9c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:35:19.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:19.723+0000 7f7ab2000640 1 -- 172.21.15.37:0/1621539314 <== mon.2 v2:172.21.15.123:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9171+0+0 (secure 0 0 0) 0x7f7aa80cf6f0 con 0x7f7ab4074510 2024-09-11T23:35:19.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:19.723+0000 7f7ab8e00640 1 --2- 172.21.15.37:0/1621539314 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f7a9c0a2b80 0x7f7a9c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:35:19.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:19.724+0000 7f7ab8e00640 1 --2- 172.21.15.37:0/1621539314 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f7a9c0a2b80 0x7f7a9c0a5040 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f7ab410f7e0 tx=0x7f7aa0005c90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:35:19.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:19.725+0000 7f7ab2000640 1 -- 172.21.15.37:0/1621539314 <== mon.2 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7aa809c240 con 0x7f7ab4074510 2024-09-11T23:35:19.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:19.914+0000 7f7abc200640 1 -- 172.21.15.37:0/1621539314 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f7ab402d7c0 con 0x7f7ab4074510 2024-09-11T23:35:19.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:19.947+0000 7f7ab2000640 1 -- 172.21.15.37:0/1621539314 <== mon.2 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v98) ==== 169+0+0 (secure 0 0 0) 0x7f7aa809bb40 con 0x7f7ab4074510 2024-09-11T23:35:19.948 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' removed 2024-09-11T23:35:19.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:19.950+0000 7f7abc200640 1 -- 172.21.15.37:0/1621539314 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f7a9c0a2b80 msgr2=0x7f7a9c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:35:19.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:19.950+0000 7f7abc200640 1 --2- 172.21.15.37:0/1621539314 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f7a9c0a2b80 0x7f7a9c0a5040 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f7ab410f7e0 tx=0x7f7aa0005c90 comp rx=0 tx=0).stop 2024-09-11T23:35:19.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:19.950+0000 7f7abc200640 1 -- 172.21.15.37:0/1621539314 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ab4074510 msgr2=0x7f7ab419a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:35:19.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:19.950+0000 7f7abc200640 1 --2- 172.21.15.37:0/1621539314 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ab4074510 0x7f7ab419a690 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7aa800e9c0 tx=0x7f7aa800ee80 comp rx=0 tx=0).stop 2024-09-11T23:35:19.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:19.950+0000 7f7abc200640 1 -- 172.21.15.37:0/1621539314 shutdown_connections 2024-09-11T23:35:19.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:19.950+0000 7f7abc200640 1 --2- 172.21.15.37:0/1621539314 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f7a9c0a2b80 0x7f7a9c0a5040 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:35:19.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:19.950+0000 7f7abc200640 1 --2- 172.21.15.37:0/1621539314 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7ab410e450 0x7f7ab419ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:35:19.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:19.950+0000 7f7abc200640 1 --2- 172.21.15.37:0/1621539314 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ab4074e30 0x7f7ab419abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:35:19.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:19.950+0000 7f7abc200640 1 --2- 172.21.15.37:0/1621539314 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ab4074510 0x7f7ab419a690 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:35:19.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:19.950+0000 7f7abc200640 1 -- 172.21.15.37:0/1621539314 >> 172.21.15.37:0/1621539314 conn(0x7f7ab40fd8b0 msgr2=0x7f7ab40fe550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:35:19.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:19.950+0000 7f7abc200640 1 -- 172.21.15.37:0/1621539314 shutdown_connections 2024-09-11T23:35:19.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:19.950+0000 7f7abc200640 1 -- 172.21.15.37:0/1621539314 wait complete. 2024-09-11T23:35:20.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:35:19 smithi160 ceph-mon[35055]: pgmap v880: 97 pgs: 97 active+clean; 1.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:35:20.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:35:19 smithi160 ceph-mon[35055]: from='client.? 172.21.15.37:0/1621539314' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-11T23:35:20.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:35:19 smithi160 ceph-mon[35055]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-11T23:35:20.204 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:35:19 smithi123 ceph-mon[35438]: pgmap v880: 97 pgs: 97 active+clean; 1.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:35:20.205 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:35:19 smithi123 ceph-mon[35438]: from='client.? 172.21.15.37:0/1621539314' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-11T23:35:20.205 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:35:19 smithi123 ceph-mon[35438]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-11T23:35:20.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:35:19 smithi037 ceph-mon[30630]: pgmap v880: 97 pgs: 97 active+clean; 1.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:35:20.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:35:19 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/1621539314' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-11T23:35:20.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:35:19 smithi037 ceph-mon[30630]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-11T23:35:20.669 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 8b03efce-7092-11ef-bcea-c7b262605968 -- ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-09-11T23:35:21.062 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:35:21.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:35:20 smithi160 ceph-mon[35055]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-11T23:35:21.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:35:20 smithi160 ceph-mon[35055]: osdmap e98: 12 total, 12 up, 12 in 2024-09-11T23:35:21.223 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:35:20 smithi037 ceph-mon[30630]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-11T23:35:21.223 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:35:20 smithi037 ceph-mon[30630]: osdmap e98: 12 total, 12 up, 12 in 2024-09-11T23:35:21.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:35:20 smithi123 ceph-mon[35438]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-11T23:35:21.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:35:20 smithi123 ceph-mon[35438]: osdmap e98: 12 total, 12 up, 12 in 2024-09-11T23:35:21.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:21.625+0000 7f7608600640 1 -- 172.21.15.37:0/3225746563 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76001049c0 msgr2=0x7f7600108a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:35:21.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:21.625+0000 7f7608600640 1 --2- 172.21.15.37:0/3225746563 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76001049c0 0x7f7600108a10 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f75ec009900 tx=0x7f75ec02a410 comp rx=0 tx=0).stop 2024-09-11T23:35:21.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:21.625+0000 7f7608600640 1 -- 172.21.15.37:0/3225746563 shutdown_connections 2024-09-11T23:35:21.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:21.625+0000 7f7608600640 1 --2- 172.21.15.37:0/3225746563 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7600109140 0x7f7600110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:35:21.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:21.625+0000 7f7608600640 1 --2- 172.21.15.37:0/3225746563 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76001049c0 0x7f7600108a10 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:35:21.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:21.625+0000 7f7608600640 1 --2- 172.21.15.37:0/3225746563 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7600104010 0x7f76001043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:35:21.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:21.625+0000 7f7608600640 1 -- 172.21.15.37:0/3225746563 >> 172.21.15.37:0/3225746563 conn(0x7f76000ffa50 msgr2=0x7f7600101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:35:21.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:21.625+0000 7f7608600640 1 -- 172.21.15.37:0/3225746563 shutdown_connections 2024-09-11T23:35:21.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:21.625+0000 7f7608600640 1 -- 172.21.15.37:0/3225746563 wait complete. 2024-09-11T23:35:21.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:21.626+0000 7f7608600640 1 Processor -- start 2024-09-11T23:35:21.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:21.626+0000 7f7608600640 1 -- start start 2024-09-11T23:35:21.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:21.627+0000 7f7608600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7600104010 0x7f76001a0400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:35:21.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:21.627+0000 7f7608600640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f76001049c0 0x7f76001a0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:35:21.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:21.627+0000 7f7608600640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7600109140 0x7f760019a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:35:21.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:21.627+0000 7f7608600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f76001141b0 con 0x7f7600104010 2024-09-11T23:35:21.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:21.627+0000 7f7608600640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f7600114030 con 0x7f7600109140 2024-09-11T23:35:21.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:21.627+0000 7f7608600640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f7600114330 con 0x7f76001049c0 2024-09-11T23:35:21.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:21.627+0000 7f7605c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7600104010 0x7f76001a0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:35:21.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:21.627+0000 7f7605c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7600104010 0x7f76001a0400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37294/0 (socket says 172.21.15.37:37294) 2024-09-11T23:35:21.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:21.627+0000 7f7605c00640 1 -- 172.21.15.37:0/3840388147 learned_addr learned my addr 172.21.15.37:0/3840388147 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-11T23:35:21.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:21.627+0000 7f7606600640 1 --2- 172.21.15.37:0/3840388147 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7600109140 0x7f760019a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:35:21.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:21.627+0000 7f7605c00640 1 -- 172.21.15.37:0/3840388147 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f76001049c0 msgr2=0x7f76001a0940 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-11T23:35:21.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:21.627+0000 7f7605c00640 1 --2- 172.21.15.37:0/3840388147 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f76001049c0 0x7f76001a0940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:35:21.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:21.627+0000 7f7605c00640 1 -- 172.21.15.37:0/3840388147 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7600109140 msgr2=0x7f760019a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:35:21.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:21.627+0000 7f7605c00640 1 --2- 172.21.15.37:0/3840388147 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7600109140 0x7f760019a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:35:21.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:21.627+0000 7f7605c00640 1 -- 172.21.15.37:0/3840388147 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f760019acf0 con 0x7f7600104010 2024-09-11T23:35:21.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:21.627+0000 7f7606600640 1 --2- 172.21.15.37:0/3840388147 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7600109140 0x7f760019a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:35:21.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:21.628+0000 7f7605c00640 1 --2- 172.21.15.37:0/3840388147 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7600104010 0x7f76001a0400 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f75f400e9f0 tx=0x7f75f400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:35:21.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:21.628+0000 7f75fe000640 1 -- 172.21.15.37:0/3840388147 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75f400cd80 con 0x7f7600104010 2024-09-11T23:35:21.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:21.628+0000 7f75fe000640 1 -- 172.21.15.37:0/3840388147 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f75f4010910 con 0x7f7600104010 2024-09-11T23:35:21.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:21.628+0000 7f7608600640 1 -- 172.21.15.37:0/3840388147 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f760019afe0 con 0x7f7600104010 2024-09-11T23:35:21.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:21.628+0000 7f75fe000640 1 -- 172.21.15.37:0/3840388147 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75f4018990 con 0x7f7600104010 2024-09-11T23:35:21.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:21.628+0000 7f7608600640 1 -- 172.21.15.37:0/3840388147 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76001a72d0 con 0x7f7600104010 2024-09-11T23:35:21.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:21.629+0000 7f7608600640 1 -- 172.21.15.37:0/3840388147 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76001043f0 con 0x7f7600104010 2024-09-11T23:35:21.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:21.631+0000 7f75fe000640 1 -- 172.21.15.37:0/3840388147 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 20) ==== 137833+0+0 (secure 0 0 0) 0x7f75f4010ac0 con 0x7f7600104010 2024-09-11T23:35:21.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:21.633+0000 7f75fe000640 1 --2- 172.21.15.37:0/3840388147 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f75e80a2b80 0x7f75e80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:35:21.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:21.633+0000 7f75fe000640 1 -- 172.21.15.37:0/3840388147 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 8496+0+0 (secure 0 0 0) 0x7f75f40cf5f0 con 0x7f7600104010 2024-09-11T23:35:21.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:21.633+0000 7f7605200640 1 --2- 172.21.15.37:0/3840388147 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f75e80a2b80 0x7f75e80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:35:21.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:21.634+0000 7f7605200640 1 --2- 172.21.15.37:0/3840388147 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f75e80a2b80 0x7f75e80a5040 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f75ec02a930 tx=0x7f75ec005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:35:21.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:21.637+0000 7f75fe000640 1 -- 172.21.15.37:0/3840388147 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f75f409c410 con 0x7f7600104010 2024-09-11T23:35:21.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:21.825+0000 7f7608600640 1 -- 172.21.15.37:0/3840388147 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7f760019baf0 con 0x7f7600104010 2024-09-11T23:35:21.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:21.955+0000 7f75fe000640 1 -- 172.21.15.37:0/3840388147 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v99) ==== 178+0+0 (secure 0 0 0) 0x7f75f409bd10 con 0x7f7600104010 2024-09-11T23:35:21.955 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data_ec' removed 2024-09-11T23:35:21.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:21.957+0000 7f7608600640 1 -- 172.21.15.37:0/3840388147 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f75e80a2b80 msgr2=0x7f75e80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:35:21.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:21.957+0000 7f7608600640 1 --2- 172.21.15.37:0/3840388147 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f75e80a2b80 0x7f75e80a5040 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f75ec02a930 tx=0x7f75ec005fd0 comp rx=0 tx=0).stop 2024-09-11T23:35:21.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:21.957+0000 7f7608600640 1 -- 172.21.15.37:0/3840388147 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7600104010 msgr2=0x7f76001a0400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:35:21.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:21.957+0000 7f7608600640 1 --2- 172.21.15.37:0/3840388147 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7600104010 0x7f76001a0400 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f75f400e9f0 tx=0x7f75f400eeb0 comp rx=0 tx=0).stop 2024-09-11T23:35:21.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:21.957+0000 7f7608600640 1 -- 172.21.15.37:0/3840388147 shutdown_connections 2024-09-11T23:35:21.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:21.957+0000 7f7608600640 1 --2- 172.21.15.37:0/3840388147 >> [v2:172.21.15.37:6800/31543269,v1:172.21.15.37:6801/31543269] conn(0x7f75e80a2b80 0x7f75e80a5040 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:35:21.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:21.957+0000 7f7608600640 1 --2- 172.21.15.37:0/3840388147 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7600109140 0x7f760019a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:35:21.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:21.957+0000 7f7608600640 1 --2- 172.21.15.37:0/3840388147 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f76001049c0 0x7f76001a0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:35:21.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:21.957+0000 7f7608600640 1 --2- 172.21.15.37:0/3840388147 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7600104010 0x7f76001a0400 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:35:21.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:21.957+0000 7f7608600640 1 -- 172.21.15.37:0/3840388147 >> 172.21.15.37:0/3840388147 conn(0x7f76000ffa50 msgr2=0x7f7600100de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:35:21.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:21.958+0000 7f7608600640 1 -- 172.21.15.37:0/3840388147 shutdown_connections 2024-09-11T23:35:21.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-11T23:35:21.958+0000 7f7608600640 1 -- 172.21.15.37:0/3840388147 wait complete. 2024-09-11T23:35:22.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:35:21 smithi123 ceph-mon[35438]: pgmap v882: 33 pgs: 33 active+clean; 1.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:35:22.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:35:21 smithi123 ceph-mon[35438]: from='client.? 172.21.15.37:0/3840388147' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-11T23:35:22.311 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:35:21 smithi037 ceph-mon[30630]: pgmap v882: 33 pgs: 33 active+clean; 1.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:35:22.311 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:35:21 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/3840388147' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-11T23:35:22.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:35:21 smithi160 ceph-mon[35055]: pgmap v882: 33 pgs: 33 active+clean; 1.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:35:22.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:35:21 smithi160 ceph-mon[35055]: from='client.? 172.21.15.37:0/3840388147' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-11T23:35:22.731 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-11T23:35:22.845 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-11T23:35:22.949 DEBUG:teuthology.orchestra.run.smithi160:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-11T23:35:22.979 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-11T23:35:22.979 DEBUG:teuthology.orchestra.run.smithi037:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-11T23:35:23.054 DEBUG:teuthology.orchestra.run.smithi123:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-11T23:35:23.177 DEBUG:teuthology.orchestra.run.smithi160:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-11T23:35:23.193 INFO:tasks.cephadm:Stopping all daemons... 2024-09-11T23:35:23.193 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-11T23:35:23.193 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ceph-8b03efce-7092-11ef-bcea-c7b262605968@mon.a 2024-09-11T23:35:23.246 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:35:22 smithi037 ceph-mon[30630]: from='client.? 172.21.15.37:0/3840388147' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-09-11T23:35:23.246 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:35:22 smithi037 ceph-mon[30630]: osdmap e99: 12 total, 12 up, 12 in 2024-09-11T23:35:23.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:35:22 smithi123 ceph-mon[35438]: from='client.? 172.21.15.37:0/3840388147' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-09-11T23:35:23.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:35:22 smithi123 ceph-mon[35438]: osdmap e99: 12 total, 12 up, 12 in 2024-09-11T23:35:23.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:35:22 smithi160 ceph-mon[35055]: from='client.? 172.21.15.37:0/3840388147' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-09-11T23:35:23.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:35:22 smithi160 ceph-mon[35055]: osdmap e99: 12 total, 12 up, 12 in 2024-09-11T23:35:23.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:35:23 smithi037 systemd[1]: Stopping Ceph mon.a for 8b03efce-7092-11ef-bcea-c7b262605968... 2024-09-11T23:35:24.004 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:35:23 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mon-a[30626]: 2024-09-11T23:35:23.749+0000 7f8e23200640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T23:35:24.004 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:35:23 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mon-a[30626]: 2024-09-11T23:35:23.749+0000 7f8e23200640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-11T23:35:24.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:35:24 smithi037 podman[89943]: 2024-09-11 23:35:24.005349897 +0000 UTC m=+0.500582142 container died c2d2d08e1b75c98bcc194d52eaa4ad5e491a2913ce1e4e900814b8a081690385 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-mon-a, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-11T23:35:24.686 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:35:24 smithi037 podman[89943]: 2024-09-11 23:35:24.478365108 +0000 UTC m=+0.973597355 container cleanup c2d2d08e1b75c98bcc194d52eaa4ad5e491a2913ce1e4e900814b8a081690385 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-mon-a, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-11T23:35:24.686 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:35:24 smithi037 bash[89943]: ceph-8b03efce-7092-11ef-bcea-c7b262605968-mon-a 2024-09-11T23:35:25.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 11 23:35:24 smithi037 podman[89954]: 2024-09-11 23:35:24.721618345 +0000 UTC m=+0.702369256 container remove c2d2d08e1b75c98bcc194d52eaa4ad5e491a2913ce1e4e900814b8a081690385 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-mon-a, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3) 2024-09-11T23:35:25.246 DEBUG:teuthology.orchestra.run.smithi037:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8b03efce-7092-11ef-bcea-c7b262605968@mon.a.service' 2024-09-11T23:35:25.347 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T23:35:25.348 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-11T23:35:25.348 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-09-11T23:35:25.348 DEBUG:teuthology.orchestra.run.smithi123:> sudo systemctl stop ceph-8b03efce-7092-11ef-bcea-c7b262605968@mon.b 2024-09-11T23:35:25.720 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:35:25 smithi123 systemd[1]: Stopping Ceph mon.b for 8b03efce-7092-11ef-bcea-c7b262605968... 2024-09-11T23:35:26.000 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:35:25 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mon-b[35434]: 2024-09-11T23:35:25.720+0000 7f67c89bb640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T23:35:26.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:35:25 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mon-b[35434]: 2024-09-11T23:35:25.720+0000 7f67c89bb640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-11T23:35:26.001 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:35:25 smithi123 podman[70866]: 2024-09-11 23:35:25.883726957 +0000 UTC m=+0.297878914 container died 4d3bb55dfca208def2ac8b3bfa1933161fe974db2c14bdb95bd0f8ff0989c03b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-mon-b, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-11T23:35:26.500 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:35:26 smithi123 podman[70866]: 2024-09-11 23:35:26.287089953 +0000 UTC m=+0.701241907 container cleanup 4d3bb55dfca208def2ac8b3bfa1933161fe974db2c14bdb95bd0f8ff0989c03b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-mon-b, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-11T23:35:26.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 11 23:35:26 smithi123 bash[70866]: ceph-8b03efce-7092-11ef-bcea-c7b262605968-mon-b 2024-09-11T23:35:26.697 DEBUG:teuthology.orchestra.run.smithi123:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8b03efce-7092-11ef-bcea-c7b262605968@mon.b.service' 2024-09-11T23:35:26.744 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T23:35:26.745 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-09-11T23:35:26.745 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-09-11T23:35:26.745 DEBUG:teuthology.orchestra.run.smithi160:> sudo systemctl stop ceph-8b03efce-7092-11ef-bcea-c7b262605968@mon.c 2024-09-11T23:35:27.120 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:35:26 smithi160 systemd[1]: Stopping Ceph mon.c for 8b03efce-7092-11ef-bcea-c7b262605968... 2024-09-11T23:35:27.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:35:27 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mon-c[35051]: 2024-09-11T23:35:27.120+0000 7f8ebeade640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T23:35:27.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:35:27 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mon-c[35051]: 2024-09-11T23:35:27.120+0000 7f8ebeade640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-11T23:35:27.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:35:27 smithi160 podman[70196]: 2024-09-11 23:35:27.141097732 +0000 UTC m=+0.148740635 container died 4bff42e76a97bdd4362a4cd67d84cf01dfcaf503cbbc5c4c3b715750cb9f4b7c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-mon-c, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-11T23:35:27.804 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:35:27 smithi160 podman[70196]: 2024-09-11 23:35:27.537118917 +0000 UTC m=+0.544761820 container cleanup 4bff42e76a97bdd4362a4cd67d84cf01dfcaf503cbbc5c4c3b715750cb9f4b7c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-mon-c, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-b53b6d3) 2024-09-11T23:35:27.805 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 11 23:35:27 smithi160 bash[70196]: ceph-8b03efce-7092-11ef-bcea-c7b262605968-mon-c 2024-09-11T23:35:27.968 DEBUG:teuthology.orchestra.run.smithi160:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8b03efce-7092-11ef-bcea-c7b262605968@mon.c.service' 2024-09-11T23:35:28.010 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T23:35:28.010 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-09-11T23:35:28.010 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-11T23:35:28.010 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ceph-8b03efce-7092-11ef-bcea-c7b262605968@mgr.x 2024-09-11T23:35:28.445 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:35:28 smithi037 systemd[1]: Stopping Ceph mgr.x for 8b03efce-7092-11ef-bcea-c7b262605968... 2024-09-11T23:35:28.814 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:35:28 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: 2024-09-11T23:35:28.444+0000 7f56d2600640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T23:35:28.814 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:35:28 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x[30852]: 2024-09-11T23:35:28.444+0000 7f56d2600640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-09-11T23:35:28.814 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:35:28 smithi037 podman[90069]: 2024-09-11 23:35:28.527106939 +0000 UTC m=+0.223524838 container died a37b4620cc88c47b2c546ce6ac224a718710048cff345d7039896967d9cd1857 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True) 2024-09-11T23:35:29.314 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:35:29 smithi037 podman[90069]: 2024-09-11 23:35:29.001064257 +0000 UTC m=+0.697482153 container cleanup a37b4620cc88c47b2c546ce6ac224a718710048cff345d7039896967d9cd1857 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3) 2024-09-11T23:35:29.314 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:35:29 smithi037 bash[90069]: ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x 2024-09-11T23:35:29.680 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 11 23:35:29 smithi037 podman[90081]: 2024-09-11 23:35:29.419925142 +0000 UTC m=+0.880329353 container remove a37b4620cc88c47b2c546ce6ac224a718710048cff345d7039896967d9cd1857 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-x, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-11T23:35:29.709 DEBUG:teuthology.orchestra.run.smithi037:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8b03efce-7092-11ef-bcea-c7b262605968@mgr.x.service' 2024-09-11T23:35:29.784 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T23:35:29.785 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-11T23:35:29.785 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-11T23:35:29.785 DEBUG:teuthology.orchestra.run.smithi123:> sudo systemctl stop ceph-8b03efce-7092-11ef-bcea-c7b262605968@mgr.y 2024-09-11T23:35:30.000 INFO:journalctl@ceph.mgr.y.smithi123.stdout:Sep 11 23:35:29 smithi123 systemd[1]: Stopping Ceph mgr.y for 8b03efce-7092-11ef-bcea-c7b262605968... 2024-09-11T23:35:30.500 INFO:journalctl@ceph.mgr.y.smithi123.stdout:Sep 11 23:35:30 smithi123 podman[70989]: 2024-09-11 23:35:30.113176162 +0000 UTC m=+0.139640826 container died fd87b2de8d1182542042d507b92adc250105ea27209df2bc41de9d52ec0519d8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-y, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3) 2024-09-11T23:35:30.985 INFO:journalctl@ceph.mgr.y.smithi123.stdout:Sep 11 23:35:30 smithi123 podman[70989]: 2024-09-11 23:35:30.676187068 +0000 UTC m=+0.702651731 container cleanup fd87b2de8d1182542042d507b92adc250105ea27209df2bc41de9d52ec0519d8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-y, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-11T23:35:30.985 INFO:journalctl@ceph.mgr.y.smithi123.stdout:Sep 11 23:35:30 smithi123 bash[70989]: ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-y 2024-09-11T23:35:31.145 DEBUG:teuthology.orchestra.run.smithi123:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8b03efce-7092-11ef-bcea-c7b262605968@mgr.y.service' 2024-09-11T23:35:31.181 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T23:35:31.181 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-11T23:35:31.181 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-09-11T23:35:31.182 DEBUG:teuthology.orchestra.run.smithi160:> sudo systemctl stop ceph-8b03efce-7092-11ef-bcea-c7b262605968@mgr.z 2024-09-11T23:35:31.520 INFO:journalctl@ceph.mgr.z.smithi160.stdout:Sep 11 23:35:31 smithi160 systemd[1]: Stopping Ceph mgr.z for 8b03efce-7092-11ef-bcea-c7b262605968... 2024-09-11T23:35:31.809 INFO:journalctl@ceph.mgr.z.smithi160.stdout:Sep 11 23:35:31 smithi160 podman[70322]: 2024-09-11 23:35:31.521224884 +0000 UTC m=+0.144217997 container died 16f8fc961ace97ea3195c2bd3d15ca25d183d4b8b05659df36f266a23ad6e1f8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-z, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-11T23:35:32.183 INFO:journalctl@ceph.mgr.z.smithi160.stdout:Sep 11 23:35:31 smithi160 podman[70322]: 2024-09-11 23:35:31.909524156 +0000 UTC m=+0.532517271 container cleanup 16f8fc961ace97ea3195c2bd3d15ca25d183d4b8b05659df36f266a23ad6e1f8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-z, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T23:35:32.183 INFO:journalctl@ceph.mgr.z.smithi160.stdout:Sep 11 23:35:31 smithi160 bash[70322]: ceph-8b03efce-7092-11ef-bcea-c7b262605968-mgr-z 2024-09-11T23:35:32.379 DEBUG:teuthology.orchestra.run.smithi160:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8b03efce-7092-11ef-bcea-c7b262605968@mgr.z.service' 2024-09-11T23:35:32.414 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T23:35:32.415 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-09-11T23:35:32.415 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-11T23:35:32.415 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ceph-8b03efce-7092-11ef-bcea-c7b262605968@osd.0 2024-09-11T23:35:32.814 INFO:journalctl@ceph.osd.0.smithi037.stdout:Sep 11 23:35:32 smithi037 systemd[1]: Stopping Ceph osd.0 for 8b03efce-7092-11ef-bcea-c7b262605968... 2024-09-11T23:35:33.564 INFO:journalctl@ceph.osd.0.smithi037.stdout:Sep 11 23:35:33 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-0[44334]: 2024-09-11T23:35:33.169+0000 7fe386a00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T23:35:33.564 INFO:journalctl@ceph.osd.0.smithi037.stdout:Sep 11 23:35:33 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-0[44334]: 2024-09-11T23:35:33.169+0000 7fe386a00640 -1 osd.0 99 *** Got signal Terminated *** 2024-09-11T23:35:33.564 INFO:journalctl@ceph.osd.0.smithi037.stdout:Sep 11 23:35:33 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-0[44334]: 2024-09-11T23:35:33.169+0000 7fe386a00640 -1 osd.0 99 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T23:35:39.314 INFO:journalctl@ceph.osd.0.smithi037.stdout:Sep 11 23:35:39 smithi037 podman[90188]: 2024-09-11 23:35:39.010904207 +0000 UTC m=+6.298275421 container died dd609e5825943c68b8198497750e239449331606c6149c304134198a5cb5fc21 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-11T23:35:39.674 INFO:journalctl@ceph.osd.0.smithi037.stdout:Sep 11 23:35:39 smithi037 podman[90188]: 2024-09-11 23:35:39.456865788 +0000 UTC m=+6.744237006 container cleanup dd609e5825943c68b8198497750e239449331606c6149c304134198a5cb5fc21 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T23:35:39.674 INFO:journalctl@ceph.osd.0.smithi037.stdout:Sep 11 23:35:39 smithi037 bash[90188]: ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-0 2024-09-11T23:35:40.064 INFO:journalctl@ceph.osd.0.smithi037.stdout:Sep 11 23:35:39 smithi037 podman[90206]: 2024-09-11 23:35:39.675283642 +0000 UTC m=+0.655343464 container remove dd609e5825943c68b8198497750e239449331606c6149c304134198a5cb5fc21 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=) 2024-09-11T23:35:40.561 INFO:journalctl@ceph.osd.0.smithi037.stdout:Sep 11 23:35:40 smithi037 podman[90291]: 2024-09-11 23:35:40.126004209 +0000 UTC m=+0.027395194 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T23:35:40.561 INFO:journalctl@ceph.osd.0.smithi037.stdout:Sep 11 23:35:40 smithi037 podman[90291]: 2024-09-11 23:35:40.242960185 +0000 UTC m=+0.144351167 container create aa2c40fcca71fba573e1d90c6686cdc4897863e30325dd4ff228e505a47c8d1b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-0-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS) 2024-09-11T23:35:40.561 INFO:journalctl@ceph.osd.0.smithi037.stdout:Sep 11 23:35:40 smithi037 podman[90291]: 2024-09-11 23:35:40.459346896 +0000 UTC m=+0.360737889 container init aa2c40fcca71fba573e1d90c6686cdc4897863e30325dd4ff228e505a47c8d1b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-0-deactivate, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-11T23:35:40.561 INFO:journalctl@ceph.osd.0.smithi037.stdout:Sep 11 23:35:40 smithi037 podman[90291]: 2024-09-11 23:35:40.466597131 +0000 UTC m=+0.367988119 container start aa2c40fcca71fba573e1d90c6686cdc4897863e30325dd4ff228e505a47c8d1b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-0-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-11T23:35:40.561 INFO:journalctl@ceph.osd.0.smithi037.stdout:Sep 11 23:35:40 smithi037 podman[90291]: 2024-09-11 23:35:40.562081141 +0000 UTC m=+0.463472138 container attach aa2c40fcca71fba573e1d90c6686cdc4897863e30325dd4ff228e505a47c8d1b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-0-deactivate, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-11T23:35:41.189 INFO:journalctl@ceph.osd.0.smithi037.stdout:Sep 11 23:35:40 smithi037 podman[90314]: 2024-09-11 23:35:40.861848498 +0000 UTC m=+0.027121481 container died aa2c40fcca71fba573e1d90c6686cdc4897863e30325dd4ff228e505a47c8d1b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-0-deactivate, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T23:35:41.517 DEBUG:teuthology.orchestra.run.smithi037:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8b03efce-7092-11ef-bcea-c7b262605968@osd.0.service' 2024-09-11T23:35:41.597 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T23:35:41.597 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-11T23:35:41.597 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-11T23:35:41.597 DEBUG:teuthology.orchestra.run.smithi123:> sudo systemctl stop ceph-8b03efce-7092-11ef-bcea-c7b262605968@osd.1 2024-09-11T23:35:41.922 INFO:journalctl@ceph.osd.1.smithi123.stdout:Sep 11 23:35:41 smithi123 systemd[1]: Stopping Ceph osd.1 for 8b03efce-7092-11ef-bcea-c7b262605968... 2024-09-11T23:35:42.250 INFO:journalctl@ceph.osd.1.smithi123.stdout:Sep 11 23:35:41 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-1[39896]: 2024-09-11T23:35:41.921+0000 7f2bcbc59640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T23:35:42.250 INFO:journalctl@ceph.osd.1.smithi123.stdout:Sep 11 23:35:41 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-1[39896]: 2024-09-11T23:35:41.921+0000 7f2bcbc59640 -1 osd.1 99 *** Got signal Terminated *** 2024-09-11T23:35:42.250 INFO:journalctl@ceph.osd.1.smithi123.stdout:Sep 11 23:35:41 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-1[39896]: 2024-09-11T23:35:41.921+0000 7f2bcbc59640 -1 osd.1 99 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T23:35:47.913 INFO:journalctl@ceph.osd.1.smithi123.stdout:Sep 11 23:35:47 smithi123 podman[71115]: 2024-09-11 23:35:47.60659917 +0000 UTC m=+5.809557399 container died 431e33f0dc4e68cf728c0cdfd230295a94c9432785627d25ac35c511fcb835d9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-1, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-11T23:35:48.250 INFO:journalctl@ceph.osd.1.smithi123.stdout:Sep 11 23:35:48 smithi123 podman[71115]: 2024-09-11 23:35:48.030393965 +0000 UTC m=+6.233352182 container cleanup 431e33f0dc4e68cf728c0cdfd230295a94c9432785627d25ac35c511fcb835d9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-1, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True) 2024-09-11T23:35:48.250 INFO:journalctl@ceph.osd.1.smithi123.stdout:Sep 11 23:35:48 smithi123 bash[71115]: ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-1 2024-09-11T23:35:48.694 INFO:journalctl@ceph.osd.1.smithi123.stdout:Sep 11 23:35:48 smithi123 podman[71131]: 2024-09-11 23:35:48.298666635 +0000 UTC m=+0.685797516 container remove 431e33f0dc4e68cf728c0cdfd230295a94c9432785627d25ac35c511fcb835d9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-1, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T23:35:49.000 INFO:journalctl@ceph.osd.1.smithi123.stdout:Sep 11 23:35:48 smithi123 podman[71220]: 2024-09-11 23:35:48.597789911 +0000 UTC m=+0.015690155 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T23:35:49.000 INFO:journalctl@ceph.osd.1.smithi123.stdout:Sep 11 23:35:48 smithi123 podman[71220]: 2024-09-11 23:35:48.729709694 +0000 UTC m=+0.147609932 container create 38ade8c33b52fb34796f1ba4bd27278337c2f42abf58ec60e5406445e4f81eb5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-1-deactivate, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T23:35:49.368 INFO:journalctl@ceph.osd.1.smithi123.stdout:Sep 11 23:35:49 smithi123 podman[71220]: 2024-09-11 23:35:49.244333701 +0000 UTC m=+0.662233940 container init 38ade8c33b52fb34796f1ba4bd27278337c2f42abf58ec60e5406445e4f81eb5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-1-deactivate, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-11T23:35:49.369 INFO:journalctl@ceph.osd.1.smithi123.stdout:Sep 11 23:35:49 smithi123 podman[71220]: 2024-09-11 23:35:49.247782414 +0000 UTC m=+0.665682659 container start 38ade8c33b52fb34796f1ba4bd27278337c2f42abf58ec60e5406445e4f81eb5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-1-deactivate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=squid-b53b6d3, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-11T23:35:49.369 INFO:journalctl@ceph.osd.1.smithi123.stdout:Sep 11 23:35:49 smithi123 podman[71220]: 2024-09-11 23:35:49.369343787 +0000 UTC m=+0.787244030 container attach 38ade8c33b52fb34796f1ba4bd27278337c2f42abf58ec60e5406445e4f81eb5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-1-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD) 2024-09-11T23:35:49.740 INFO:journalctl@ceph.osd.1.smithi123.stdout:Sep 11 23:35:49 smithi123 podman[71244]: 2024-09-11 23:35:49.501061277 +0000 UTC m=+0.017262031 container died 38ade8c33b52fb34796f1ba4bd27278337c2f42abf58ec60e5406445e4f81eb5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T23:35:50.102 DEBUG:teuthology.orchestra.run.smithi123:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8b03efce-7092-11ef-bcea-c7b262605968@osd.1.service' 2024-09-11T23:35:51.236 INFO:journalctl@ceph.osd.1.smithi123.stdout:Sep 11 23:35:50 smithi123 podman[71244]: 2024-09-11 23:35:50.082117501 +0000 UTC m=+0.598318237 container remove 38ade8c33b52fb34796f1ba4bd27278337c2f42abf58ec60e5406445e4f81eb5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-1-deactivate, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=squid-b53b6d3, ceph=True) 2024-09-11T23:35:51.236 INFO:journalctl@ceph.osd.1.smithi123.stdout:Sep 11 23:35:50 smithi123 systemd[1]: ceph-8b03efce-7092-11ef-bcea-c7b262605968@osd.1.service: Deactivated successfully. 2024-09-11T23:35:51.236 INFO:journalctl@ceph.osd.1.smithi123.stdout:Sep 11 23:35:50 smithi123 systemd[1]: Stopped Ceph osd.1 for 8b03efce-7092-11ef-bcea-c7b262605968. 2024-09-11T23:35:51.236 INFO:journalctl@ceph.osd.1.smithi123.stdout:Sep 11 23:35:50 smithi123 systemd[1]: ceph-8b03efce-7092-11ef-bcea-c7b262605968@osd.1.service: Consumed 10min 27.788s CPU time. 2024-09-11T23:35:51.277 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T23:35:51.278 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-11T23:35:51.278 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-11T23:35:51.278 DEBUG:teuthology.orchestra.run.smithi160:> sudo systemctl stop ceph-8b03efce-7092-11ef-bcea-c7b262605968@osd.2 2024-09-11T23:35:51.587 INFO:journalctl@ceph.osd.2.smithi160.stdout:Sep 11 23:35:51 smithi160 systemd[1]: Stopping Ceph osd.2 for 8b03efce-7092-11ef-bcea-c7b262605968... 2024-09-11T23:35:51.847 INFO:journalctl@ceph.osd.2.smithi160.stdout:Sep 11 23:35:51 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-2[40045]: 2024-09-11T23:35:51.588+0000 7f7737a72640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T23:35:51.847 INFO:journalctl@ceph.osd.2.smithi160.stdout:Sep 11 23:35:51 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-2[40045]: 2024-09-11T23:35:51.588+0000 7f7737a72640 -1 osd.2 99 *** Got signal Terminated *** 2024-09-11T23:35:51.847 INFO:journalctl@ceph.osd.2.smithi160.stdout:Sep 11 23:35:51 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-2[40045]: 2024-09-11T23:35:51.588+0000 7f7737a72640 -1 osd.2 99 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T23:35:57.306 INFO:journalctl@ceph.osd.2.smithi160.stdout:Sep 11 23:35:57 smithi160 podman[70450]: 2024-09-11 23:35:57.01610494 +0000 UTC m=+5.546334298 container died b49b97d77fa711d610d9eaee7567d1a2fcefbc4216d948f53e811f8f86f2f6db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux ) 2024-09-11T23:35:57.683 INFO:journalctl@ceph.osd.2.smithi160.stdout:Sep 11 23:35:57 smithi160 podman[70450]: 2024-09-11 23:35:57.405254592 +0000 UTC m=+5.935483949 container cleanup b49b97d77fa711d610d9eaee7567d1a2fcefbc4216d948f53e811f8f86f2f6db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-11T23:35:57.683 INFO:journalctl@ceph.osd.2.smithi160.stdout:Sep 11 23:35:57 smithi160 bash[70450]: ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-2 2024-09-11T23:35:58.014 INFO:journalctl@ceph.osd.2.smithi160.stdout:Sep 11 23:35:57 smithi160 podman[70476]: 2024-09-11 23:35:57.69015445 +0000 UTC m=+0.670103033 container remove b49b97d77fa711d610d9eaee7567d1a2fcefbc4216d948f53e811f8f86f2f6db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0) 2024-09-11T23:35:58.338 INFO:journalctl@ceph.osd.2.smithi160.stdout:Sep 11 23:35:58 smithi160 podman[70564]: 2024-09-11 23:35:57.917611689 +0000 UTC m=+0.016210023 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T23:35:58.338 INFO:journalctl@ceph.osd.2.smithi160.stdout:Sep 11 23:35:58 smithi160 podman[70564]: 2024-09-11 23:35:58.049578952 +0000 UTC m=+0.148177323 container create 01a7798ee94a7468298fc711c723d59cbd84858ce5e7764a33b32a7371df0dab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-11T23:35:58.590 INFO:journalctl@ceph.osd.2.smithi160.stdout:Sep 11 23:35:58 smithi160 podman[70564]: 2024-09-11 23:35:58.339156197 +0000 UTC m=+0.437754532 container init 01a7798ee94a7468298fc711c723d59cbd84858ce5e7764a33b32a7371df0dab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-2-deactivate, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3) 2024-09-11T23:35:58.590 INFO:journalctl@ceph.osd.2.smithi160.stdout:Sep 11 23:35:58 smithi160 podman[70564]: 2024-09-11 23:35:58.342740245 +0000 UTC m=+0.441338573 container start 01a7798ee94a7468298fc711c723d59cbd84858ce5e7764a33b32a7371df0dab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-2-deactivate, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=) 2024-09-11T23:35:58.591 INFO:journalctl@ceph.osd.2.smithi160.stdout:Sep 11 23:35:58 smithi160 podman[70564]: 2024-09-11 23:35:58.452177209 +0000 UTC m=+0.550775544 container attach 01a7798ee94a7468298fc711c723d59cbd84858ce5e7764a33b32a7371df0dab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-2-deactivate, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-11T23:35:58.933 INFO:journalctl@ceph.osd.2.smithi160.stdout:Sep 11 23:35:58 smithi160 podman[70564]: 2024-09-11 23:35:58.591651407 +0000 UTC m=+0.690249741 container died 01a7798ee94a7468298fc711c723d59cbd84858ce5e7764a33b32a7371df0dab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-2-deactivate, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-11T23:35:59.255 DEBUG:teuthology.orchestra.run.smithi160:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8b03efce-7092-11ef-bcea-c7b262605968@osd.2.service' 2024-09-11T23:35:59.295 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T23:35:59.295 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-11T23:35:59.296 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-11T23:35:59.296 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ceph-8b03efce-7092-11ef-bcea-c7b262605968@osd.3 2024-09-11T23:35:59.722 INFO:journalctl@ceph.osd.3.smithi037.stdout:Sep 11 23:35:59 smithi037 systemd[1]: Stopping Ceph osd.3 for 8b03efce-7092-11ef-bcea-c7b262605968... 2024-09-11T23:36:00.063 INFO:journalctl@ceph.osd.3.smithi037.stdout:Sep 11 23:35:59 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-3[50928]: 2024-09-11T23:35:59.722+0000 7f4fe1400640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T23:36:00.063 INFO:journalctl@ceph.osd.3.smithi037.stdout:Sep 11 23:35:59 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-3[50928]: 2024-09-11T23:35:59.722+0000 7f4fe1400640 -1 osd.3 99 *** Got signal Terminated *** 2024-09-11T23:36:00.063 INFO:journalctl@ceph.osd.3.smithi037.stdout:Sep 11 23:35:59 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-3[50928]: 2024-09-11T23:35:59.722+0000 7f4fe1400640 -1 osd.3 99 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T23:36:00.183 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 11 23:35:59 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-5[46502]: 2024-09-11T23:35:59.727+0000 7faa72ce1640 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:37.583174+0000 front 2024-09-11T23:35:37.583193+0000 (oldest deadline 2024-09-11T23:35:59.283292+0000) 2024-09-11T23:36:00.314 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:00 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:00.293+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:33.392902+0000 front 2024-09-11T23:35:33.393259+0000 (oldest deadline 2024-09-11T23:35:59.793635+0000) 2024-09-11T23:36:01.183 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 11 23:36:00 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-5[46502]: 2024-09-11T23:36:00.726+0000 7faa72ce1640 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:37.583174+0000 front 2024-09-11T23:35:37.583193+0000 (oldest deadline 2024-09-11T23:35:59.283292+0000) 2024-09-11T23:36:01.564 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:01 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:01.254+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:33.392902+0000 front 2024-09-11T23:35:33.393259+0000 (oldest deadline 2024-09-11T23:35:59.793635+0000) 2024-09-11T23:36:01.757 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:01 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:01.490+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:37.277803+0000 front 2024-09-11T23:35:37.277821+0000 (oldest deadline 2024-09-11T23:36:00.777764+0000) 2024-09-11T23:36:02.000 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:01 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:01.747+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:35.287175+0000 front 2024-09-11T23:35:35.287164+0000 (oldest deadline 2024-09-11T23:36:01.186976+0000) 2024-09-11T23:36:02.183 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 11 23:36:01 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-5[46502]: 2024-09-11T23:36:01.758+0000 7faa72ce1640 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:37.583174+0000 front 2024-09-11T23:35:37.583193+0000 (oldest deadline 2024-09-11T23:35:59.283292+0000) 2024-09-11T23:36:02.564 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:02 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:02.266+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:33.392902+0000 front 2024-09-11T23:35:33.393259+0000 (oldest deadline 2024-09-11T23:35:59.793635+0000) 2024-09-11T23:36:02.735 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:02 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:02.479+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:37.277803+0000 front 2024-09-11T23:35:37.277821+0000 (oldest deadline 2024-09-11T23:36:00.777764+0000) 2024-09-11T23:36:03.183 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 11 23:36:02 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-5[46502]: 2024-09-11T23:36:02.736+0000 7faa72ce1640 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:37.583174+0000 front 2024-09-11T23:35:37.583193+0000 (oldest deadline 2024-09-11T23:35:59.283292+0000) 2024-09-11T23:36:03.250 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:02 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:02.795+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:35.287175+0000 front 2024-09-11T23:35:35.287164+0000 (oldest deadline 2024-09-11T23:36:01.186976+0000) 2024-09-11T23:36:03.564 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:03 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:03.258+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:33.392902+0000 front 2024-09-11T23:35:33.393259+0000 (oldest deadline 2024-09-11T23:35:59.793635+0000) 2024-09-11T23:36:03.763 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:03 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:03.490+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:37.277803+0000 front 2024-09-11T23:35:37.277821+0000 (oldest deadline 2024-09-11T23:36:00.777764+0000) 2024-09-11T23:36:04.183 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 11 23:36:03 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-5[46502]: 2024-09-11T23:36:03.763+0000 7faa72ce1640 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:37.583174+0000 front 2024-09-11T23:35:37.583193+0000 (oldest deadline 2024-09-11T23:35:59.283292+0000) 2024-09-11T23:36:04.250 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:03 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:03.844+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:35.287175+0000 front 2024-09-11T23:35:35.287164+0000 (oldest deadline 2024-09-11T23:36:01.186976+0000) 2024-09-11T23:36:04.495 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:04 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:04.242+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:34.129174+0000 front 2024-09-11T23:35:34.128995+0000 (oldest deadline 2024-09-11T23:36:04.129586+0000) 2024-09-11T23:36:04.564 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:04 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:04.299+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:33.392902+0000 front 2024-09-11T23:35:33.393259+0000 (oldest deadline 2024-09-11T23:35:59.793635+0000) 2024-09-11T23:36:04.933 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 11 23:36:04 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-5[46502]: 2024-09-11T23:36:04.713+0000 7faa72ce1640 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:37.583174+0000 front 2024-09-11T23:35:37.583193+0000 (oldest deadline 2024-09-11T23:35:59.283292+0000) 2024-09-11T23:36:04.934 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:04 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:04.494+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:37.277803+0000 front 2024-09-11T23:35:37.277821+0000 (oldest deadline 2024-09-11T23:36:00.777764+0000) 2024-09-11T23:36:05.250 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:04 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:04.886+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:35.287175+0000 front 2024-09-11T23:35:35.287164+0000 (oldest deadline 2024-09-11T23:36:01.186976+0000) 2024-09-11T23:36:05.494 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:05 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:05.211+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:34.129174+0000 front 2024-09-11T23:35:34.128995+0000 (oldest deadline 2024-09-11T23:36:04.129586+0000) 2024-09-11T23:36:05.539 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:05 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:05.261+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:33.392902+0000 front 2024-09-11T23:35:33.393259+0000 (oldest deadline 2024-09-11T23:35:59.793635+0000) 2024-09-11T23:36:05.815 INFO:journalctl@ceph.osd.3.smithi037.stdout:Sep 11 23:36:05 smithi037 podman[90405]: 2024-09-11 23:36:05.540328892 +0000 UTC m=+5.944322160 container died 1527a4b0cf86bf7a9e19574ea9900ec72db923327eadf40e0591868925316e0c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-3, ceph=True, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-11T23:36:05.933 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 11 23:36:05 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-5[46502]: 2024-09-11T23:36:05.679+0000 7faa72ce1640 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:37.583174+0000 front 2024-09-11T23:35:37.583193+0000 (oldest deadline 2024-09-11T23:35:59.283292+0000) 2024-09-11T23:36:05.933 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:05 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:05.493+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:37.277803+0000 front 2024-09-11T23:35:37.277821+0000 (oldest deadline 2024-09-11T23:36:00.777764+0000) 2024-09-11T23:36:06.203 INFO:journalctl@ceph.osd.3.smithi037.stdout:Sep 11 23:36:06 smithi037 podman[90405]: 2024-09-11 23:36:06.011081025 +0000 UTC m=+6.415074293 container cleanup 1527a4b0cf86bf7a9e19574ea9900ec72db923327eadf40e0591868925316e0c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-3, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-11T23:36:06.204 INFO:journalctl@ceph.osd.3.smithi037.stdout:Sep 11 23:36:06 smithi037 bash[90405]: ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-3 2024-09-11T23:36:06.250 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:05 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:05.898+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:35.287175+0000 front 2024-09-11T23:35:35.287164+0000 (oldest deadline 2024-09-11T23:36:01.186976+0000) 2024-09-11T23:36:06.433 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:06 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:06.168+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:34.129174+0000 front 2024-09-11T23:35:34.128995+0000 (oldest deadline 2024-09-11T23:36:04.129586+0000) 2024-09-11T23:36:06.564 INFO:journalctl@ceph.osd.3.smithi037.stdout:Sep 11 23:36:06 smithi037 podman[90434]: 2024-09-11 23:36:06.204139275 +0000 UTC m=+0.658875099 container remove 1527a4b0cf86bf7a9e19574ea9900ec72db923327eadf40e0591868925316e0c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-3, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=squid-b53b6d3) 2024-09-11T23:36:06.564 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:06 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:06.304+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:33.392902+0000 front 2024-09-11T23:35:33.393259+0000 (oldest deadline 2024-09-11T23:35:59.793635+0000) 2024-09-11T23:36:06.933 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 11 23:36:06 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-5[46502]: 2024-09-11T23:36:06.665+0000 7faa72ce1640 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:37.583174+0000 front 2024-09-11T23:35:37.583193+0000 (oldest deadline 2024-09-11T23:35:59.283292+0000) 2024-09-11T23:36:06.933 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:06 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:06.540+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:37.277803+0000 front 2024-09-11T23:35:37.277821+0000 (oldest deadline 2024-09-11T23:36:00.777764+0000) 2024-09-11T23:36:07.064 INFO:journalctl@ceph.osd.3.smithi037.stdout:Sep 11 23:36:06 smithi037 podman[90522]: 2024-09-11 23:36:06.683170277 +0000 UTC m=+0.027354718 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T23:36:07.064 INFO:journalctl@ceph.osd.3.smithi037.stdout:Sep 11 23:36:06 smithi037 podman[90522]: 2024-09-11 23:36:06.813619592 +0000 UTC m=+0.157804010 container create 801f1106e4dfe1abea5c8416a8a119336c7e2798016f3e57297ad44cb94e56de (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-3-deactivate, GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-11T23:36:07.250 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:06 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:06.903+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:35.287175+0000 front 2024-09-11T23:35:35.287164+0000 (oldest deadline 2024-09-11T23:36:01.186976+0000) 2024-09-11T23:36:07.343 INFO:journalctl@ceph.osd.3.smithi037.stdout:Sep 11 23:36:07 smithi037 podman[90522]: 2024-09-11 23:36:07.074742599 +0000 UTC m=+0.418927031 container init 801f1106e4dfe1abea5c8416a8a119336c7e2798016f3e57297ad44cb94e56de (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-3-deactivate, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-11T23:36:07.343 INFO:journalctl@ceph.osd.3.smithi037.stdout:Sep 11 23:36:07 smithi037 podman[90522]: 2024-09-11 23:36:07.081484988 +0000 UTC m=+0.425669407 container start 801f1106e4dfe1abea5c8416a8a119336c7e2798016f3e57297ad44cb94e56de (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-3-deactivate, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-11T23:36:07.343 INFO:journalctl@ceph.osd.3.smithi037.stdout:Sep 11 23:36:07 smithi037 podman[90522]: 2024-09-11 23:36:07.16602738 +0000 UTC m=+0.510211805 container attach 801f1106e4dfe1abea5c8416a8a119336c7e2798016f3e57297ad44cb94e56de (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-3-deactivate, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True) 2024-09-11T23:36:07.343 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:07 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:07.276+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:33.392902+0000 front 2024-09-11T23:35:33.393259+0000 (oldest deadline 2024-09-11T23:35:59.793635+0000) 2024-09-11T23:36:07.497 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:07 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:07.214+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:34.129174+0000 front 2024-09-11T23:35:34.128995+0000 (oldest deadline 2024-09-11T23:36:04.129586+0000) 2024-09-11T23:36:07.694 INFO:journalctl@ceph.osd.3.smithi037.stdout:Sep 11 23:36:07 smithi037 podman[90522]: 2024-09-11 23:36:07.343936356 +0000 UTC m=+0.688120783 container died 801f1106e4dfe1abea5c8416a8a119336c7e2798016f3e57297ad44cb94e56de (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-3-deactivate, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-11T23:36:07.933 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 11 23:36:07 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-5[46502]: 2024-09-11T23:36:07.621+0000 7faa72ce1640 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:37.583174+0000 front 2024-09-11T23:35:37.583193+0000 (oldest deadline 2024-09-11T23:35:59.283292+0000) 2024-09-11T23:36:07.933 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:07 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:07.496+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:37.277803+0000 front 2024-09-11T23:35:37.277821+0000 (oldest deadline 2024-09-11T23:36:00.777764+0000) 2024-09-11T23:36:08.075 DEBUG:teuthology.orchestra.run.smithi037:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8b03efce-7092-11ef-bcea-c7b262605968@osd.3.service' 2024-09-11T23:36:08.153 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T23:36:08.153 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-11T23:36:08.153 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-11T23:36:08.153 DEBUG:teuthology.orchestra.run.smithi123:> sudo systemctl stop ceph-8b03efce-7092-11ef-bcea-c7b262605968@osd.4 2024-09-11T23:36:08.180 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:07 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:07.886+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:35.287175+0000 front 2024-09-11T23:35:35.287164+0000 (oldest deadline 2024-09-11T23:36:01.186976+0000) 2024-09-11T23:36:08.314 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:08 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:08.286+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:33.392902+0000 front 2024-09-11T23:35:33.393259+0000 (oldest deadline 2024-09-11T23:35:59.793635+0000) 2024-09-11T23:36:08.492 INFO:journalctl@ceph.osd.4.smithi123.stdout:Sep 11 23:36:08 smithi123 systemd[1]: Stopping Ceph osd.4 for 8b03efce-7092-11ef-bcea-c7b262605968... 2024-09-11T23:36:08.503 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:08 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:08.222+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:34.129174+0000 front 2024-09-11T23:35:34.128995+0000 (oldest deadline 2024-09-11T23:36:04.129586+0000) 2024-09-11T23:36:08.745 INFO:journalctl@ceph.osd.4.smithi123.stdout:Sep 11 23:36:08 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-4[46656]: 2024-09-11T23:36:08.492+0000 7faa35a50640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T23:36:08.745 INFO:journalctl@ceph.osd.4.smithi123.stdout:Sep 11 23:36:08 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-4[46656]: 2024-09-11T23:36:08.492+0000 7faa35a50640 -1 osd.4 99 *** Got signal Terminated *** 2024-09-11T23:36:08.745 INFO:journalctl@ceph.osd.4.smithi123.stdout:Sep 11 23:36:08 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-4[46656]: 2024-09-11T23:36:08.492+0000 7faa35a50640 -1 osd.4 99 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T23:36:08.745 INFO:journalctl@ceph.osd.4.smithi123.stdout:Sep 11 23:36:08 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-4[46656]: 2024-09-11T23:36:08.745+0000 7faa2e05e640 -1 osd.4 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:44.766485+0000 front 2024-09-11T23:35:44.766520+0000 (oldest deadline 2024-09-11T23:36:08.266687+0000) 2024-09-11T23:36:08.933 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 11 23:36:08 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-5[46502]: 2024-09-11T23:36:08.584+0000 7faa72ce1640 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:37.583174+0000 front 2024-09-11T23:35:37.583193+0000 (oldest deadline 2024-09-11T23:35:59.283292+0000) 2024-09-11T23:36:08.934 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:08 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:08.503+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:37.277803+0000 front 2024-09-11T23:35:37.277821+0000 (oldest deadline 2024-09-11T23:36:00.777764+0000) 2024-09-11T23:36:08.934 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:08 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:08.503+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.478993+0000 front 2024-09-11T23:35:45.478970+0000 (oldest deadline 2024-09-11T23:36:08.379023+0000) 2024-09-11T23:36:09.000 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:08 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:08.928+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:35.287175+0000 front 2024-09-11T23:35:35.287164+0000 (oldest deadline 2024-09-11T23:36:01.186976+0000) 2024-09-11T23:36:09.564 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:09 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:09.305+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:33.392902+0000 front 2024-09-11T23:35:33.393259+0000 (oldest deadline 2024-09-11T23:35:59.793635+0000) 2024-09-11T23:36:09.584 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:09 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:09.267+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:34.129174+0000 front 2024-09-11T23:35:34.128995+0000 (oldest deadline 2024-09-11T23:36:04.129586+0000) 2024-09-11T23:36:09.585 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:09 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:09.484+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:37.277803+0000 front 2024-09-11T23:35:37.277821+0000 (oldest deadline 2024-09-11T23:36:00.777764+0000) 2024-09-11T23:36:09.585 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:09 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:09.484+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.478993+0000 front 2024-09-11T23:35:45.478970+0000 (oldest deadline 2024-09-11T23:36:08.379023+0000) 2024-09-11T23:36:09.933 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 11 23:36:09 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-5[46502]: 2024-09-11T23:36:09.584+0000 7faa72ce1640 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:37.583174+0000 front 2024-09-11T23:35:37.583193+0000 (oldest deadline 2024-09-11T23:35:59.283292+0000) 2024-09-11T23:36:09.933 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 11 23:36:09 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-5[46502]: 2024-09-11T23:36:09.584+0000 7faa72ce1640 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:46.086340+0000 front 2024-09-11T23:35:46.086374+0000 (oldest deadline 2024-09-11T23:36:08.986337+0000) 2024-09-11T23:36:10.250 INFO:journalctl@ceph.osd.4.smithi123.stdout:Sep 11 23:36:09 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-4[46656]: 2024-09-11T23:36:09.784+0000 7faa2e05e640 -1 osd.4 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:44.766485+0000 front 2024-09-11T23:35:44.766520+0000 (oldest deadline 2024-09-11T23:36:08.266687+0000) 2024-09-11T23:36:10.251 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:09 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:09.891+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:35.287175+0000 front 2024-09-11T23:35:35.287164+0000 (oldest deadline 2024-09-11T23:36:01.186976+0000) 2024-09-11T23:36:10.251 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 11 23:36:09 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-7[53549]: 2024-09-11T23:36:09.811+0000 7f58e9644640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:44.344227+0000 front 2024-09-11T23:35:44.344251+0000 (oldest deadline 2024-09-11T23:36:09.044354+0000) 2024-09-11T23:36:10.556 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:10 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:10.303+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:34.129174+0000 front 2024-09-11T23:35:34.128995+0000 (oldest deadline 2024-09-11T23:36:04.129586+0000) 2024-09-11T23:36:10.557 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:10 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:10.513+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:37.277803+0000 front 2024-09-11T23:35:37.277821+0000 (oldest deadline 2024-09-11T23:36:00.777764+0000) 2024-09-11T23:36:10.557 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:10 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:10.513+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.478993+0000 front 2024-09-11T23:35:45.478970+0000 (oldest deadline 2024-09-11T23:36:08.379023+0000) 2024-09-11T23:36:10.564 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:10 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:10.296+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:33.392902+0000 front 2024-09-11T23:35:33.393259+0000 (oldest deadline 2024-09-11T23:35:59.793635+0000) 2024-09-11T23:36:10.933 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 11 23:36:10 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-5[46502]: 2024-09-11T23:36:10.556+0000 7faa72ce1640 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:37.583174+0000 front 2024-09-11T23:35:37.583193+0000 (oldest deadline 2024-09-11T23:35:59.283292+0000) 2024-09-11T23:36:10.933 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 11 23:36:10 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-5[46502]: 2024-09-11T23:36:10.556+0000 7faa72ce1640 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:46.086340+0000 front 2024-09-11T23:35:46.086374+0000 (oldest deadline 2024-09-11T23:36:08.986337+0000) 2024-09-11T23:36:11.250 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 11 23:36:10 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-7[53549]: 2024-09-11T23:36:10.840+0000 7f58e9644640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:44.344227+0000 front 2024-09-11T23:35:44.344251+0000 (oldest deadline 2024-09-11T23:36:09.044354+0000) 2024-09-11T23:36:11.251 INFO:journalctl@ceph.osd.4.smithi123.stdout:Sep 11 23:36:10 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-4[46656]: 2024-09-11T23:36:10.793+0000 7faa2e05e640 -1 osd.4 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:44.766485+0000 front 2024-09-11T23:35:44.766520+0000 (oldest deadline 2024-09-11T23:36:08.266687+0000) 2024-09-11T23:36:11.251 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:10 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:10.859+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:35.287175+0000 front 2024-09-11T23:35:35.287164+0000 (oldest deadline 2024-09-11T23:36:01.186976+0000) 2024-09-11T23:36:11.251 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:10 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:10.859+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.288233+0000 front 2024-09-11T23:35:45.288257+0000 (oldest deadline 2024-09-11T23:36:09.988379+0000) 2024-09-11T23:36:11.564 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:11 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:11.258+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:33.392902+0000 front 2024-09-11T23:35:33.393259+0000 (oldest deadline 2024-09-11T23:35:59.793635+0000) 2024-09-11T23:36:11.597 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:11 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:11.299+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:34.129174+0000 front 2024-09-11T23:35:34.128995+0000 (oldest deadline 2024-09-11T23:36:04.129586+0000) 2024-09-11T23:36:11.597 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:11 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:11.520+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:37.277803+0000 front 2024-09-11T23:35:37.277821+0000 (oldest deadline 2024-09-11T23:36:00.777764+0000) 2024-09-11T23:36:11.597 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:11 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:11.520+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.478993+0000 front 2024-09-11T23:35:45.478970+0000 (oldest deadline 2024-09-11T23:36:08.379023+0000) 2024-09-11T23:36:11.933 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 11 23:36:11 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-5[46502]: 2024-09-11T23:36:11.596+0000 7faa72ce1640 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:37.583174+0000 front 2024-09-11T23:35:37.583193+0000 (oldest deadline 2024-09-11T23:35:59.283292+0000) 2024-09-11T23:36:11.933 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 11 23:36:11 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-5[46502]: 2024-09-11T23:36:11.596+0000 7faa72ce1640 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:46.086340+0000 front 2024-09-11T23:35:46.086374+0000 (oldest deadline 2024-09-11T23:36:08.986337+0000) 2024-09-11T23:36:12.238 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 11 23:36:11 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-6[57869]: 2024-09-11T23:36:11.850+0000 7f4498e00640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.519792+0000 front 2024-09-11T23:35:45.519899+0000 (oldest deadline 2024-09-11T23:36:11.420000+0000) 2024-09-11T23:36:12.250 INFO:journalctl@ceph.osd.4.smithi123.stdout:Sep 11 23:36:11 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-4[46656]: 2024-09-11T23:36:11.793+0000 7faa2e05e640 -1 osd.4 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:44.766485+0000 front 2024-09-11T23:35:44.766520+0000 (oldest deadline 2024-09-11T23:36:08.266687+0000) 2024-09-11T23:36:12.250 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 11 23:36:11 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-7[53549]: 2024-09-11T23:36:11.821+0000 7f58e9644640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:44.344227+0000 front 2024-09-11T23:35:44.344251+0000 (oldest deadline 2024-09-11T23:36:09.044354+0000) 2024-09-11T23:36:12.250 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:11 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:11.830+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:35.287175+0000 front 2024-09-11T23:35:35.287164+0000 (oldest deadline 2024-09-11T23:36:01.186976+0000) 2024-09-11T23:36:12.251 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:11 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:11.830+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.288233+0000 front 2024-09-11T23:35:45.288257+0000 (oldest deadline 2024-09-11T23:36:09.988379+0000) 2024-09-11T23:36:12.564 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:12 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:12.238+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:33.392902+0000 front 2024-09-11T23:35:33.393259+0000 (oldest deadline 2024-09-11T23:35:59.793635+0000) 2024-09-11T23:36:12.618 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:12 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:12.277+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:34.129174+0000 front 2024-09-11T23:35:34.128995+0000 (oldest deadline 2024-09-11T23:36:04.129586+0000) 2024-09-11T23:36:12.619 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:12 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:12.491+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:37.277803+0000 front 2024-09-11T23:35:37.277821+0000 (oldest deadline 2024-09-11T23:36:00.777764+0000) 2024-09-11T23:36:12.619 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:12 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:12.491+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.478993+0000 front 2024-09-11T23:35:45.478970+0000 (oldest deadline 2024-09-11T23:36:08.379023+0000) 2024-09-11T23:36:12.933 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 11 23:36:12 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-5[46502]: 2024-09-11T23:36:12.618+0000 7faa72ce1640 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:37.583174+0000 front 2024-09-11T23:35:37.583193+0000 (oldest deadline 2024-09-11T23:35:59.283292+0000) 2024-09-11T23:36:12.933 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 11 23:36:12 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-5[46502]: 2024-09-11T23:36:12.618+0000 7faa72ce1640 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:46.086340+0000 front 2024-09-11T23:35:46.086374+0000 (oldest deadline 2024-09-11T23:36:08.986337+0000) 2024-09-11T23:36:13.250 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 11 23:36:12 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-7[53549]: 2024-09-11T23:36:12.780+0000 7f58e9644640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:44.344227+0000 front 2024-09-11T23:35:44.344251+0000 (oldest deadline 2024-09-11T23:36:09.044354+0000) 2024-09-11T23:36:13.251 INFO:journalctl@ceph.osd.4.smithi123.stdout:Sep 11 23:36:12 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-4[46656]: 2024-09-11T23:36:12.791+0000 7faa2e05e640 -1 osd.4 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:44.766485+0000 front 2024-09-11T23:35:44.766520+0000 (oldest deadline 2024-09-11T23:36:08.266687+0000) 2024-09-11T23:36:13.251 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:12 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:12.788+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:35.287175+0000 front 2024-09-11T23:35:35.287164+0000 (oldest deadline 2024-09-11T23:36:01.186976+0000) 2024-09-11T23:36:13.251 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:12 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:12.788+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.288233+0000 front 2024-09-11T23:35:45.288257+0000 (oldest deadline 2024-09-11T23:36:09.988379+0000) 2024-09-11T23:36:13.252 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 11 23:36:12 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-6[57869]: 2024-09-11T23:36:12.885+0000 7f4498e00640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.519792+0000 front 2024-09-11T23:35:45.519899+0000 (oldest deadline 2024-09-11T23:36:11.420000+0000) 2024-09-11T23:36:13.564 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:13 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:13.253+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:33.392902+0000 front 2024-09-11T23:35:33.393259+0000 (oldest deadline 2024-09-11T23:35:59.793635+0000) 2024-09-11T23:36:13.564 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:13 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:13.253+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:46.696487+0000 front 2024-09-11T23:35:46.696550+0000 (oldest deadline 2024-09-11T23:36:12.596707+0000) 2024-09-11T23:36:13.624 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:13 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:13.302+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:34.129174+0000 front 2024-09-11T23:35:34.128995+0000 (oldest deadline 2024-09-11T23:36:04.129586+0000) 2024-09-11T23:36:13.624 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:13 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:13.513+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:37.277803+0000 front 2024-09-11T23:35:37.277821+0000 (oldest deadline 2024-09-11T23:36:00.777764+0000) 2024-09-11T23:36:13.624 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:13 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:13.513+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.478993+0000 front 2024-09-11T23:35:45.478970+0000 (oldest deadline 2024-09-11T23:36:08.379023+0000) 2024-09-11T23:36:13.933 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 11 23:36:13 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-5[46502]: 2024-09-11T23:36:13.624+0000 7faa72ce1640 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:37.583174+0000 front 2024-09-11T23:35:37.583193+0000 (oldest deadline 2024-09-11T23:35:59.283292+0000) 2024-09-11T23:36:13.933 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 11 23:36:13 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-5[46502]: 2024-09-11T23:36:13.624+0000 7faa72ce1640 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:46.086340+0000 front 2024-09-11T23:35:46.086374+0000 (oldest deadline 2024-09-11T23:36:08.986337+0000) 2024-09-11T23:36:14.075 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 11 23:36:13 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-7[53549]: 2024-09-11T23:36:13.762+0000 7f58e9644640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:44.344227+0000 front 2024-09-11T23:35:44.344251+0000 (oldest deadline 2024-09-11T23:36:09.044354+0000) 2024-09-11T23:36:14.076 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:13 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:13.754+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:35.287175+0000 front 2024-09-11T23:35:35.287164+0000 (oldest deadline 2024-09-11T23:36:01.186976+0000) 2024-09-11T23:36:14.076 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:13 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:13.754+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.288233+0000 front 2024-09-11T23:35:45.288257+0000 (oldest deadline 2024-09-11T23:36:09.988379+0000) 2024-09-11T23:36:14.279 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 11 23:36:13 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-6[57869]: 2024-09-11T23:36:13.872+0000 7f4498e00640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.519792+0000 front 2024-09-11T23:35:45.519899+0000 (oldest deadline 2024-09-11T23:36:11.420000+0000) 2024-09-11T23:36:14.375 INFO:journalctl@ceph.osd.4.smithi123.stdout:Sep 11 23:36:14 smithi123 podman[71336]: 2024-09-11 23:36:14.076934466 +0000 UTC m=+5.729484455 container died ecf7680b27e36249dfd27d236c47f114c491b5da77963c437428c8f08617506e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-4, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-11T23:36:14.564 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:14 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:14.279+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:33.392902+0000 front 2024-09-11T23:35:33.393259+0000 (oldest deadline 2024-09-11T23:35:59.793635+0000) 2024-09-11T23:36:14.564 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:14 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:14.279+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:46.696487+0000 front 2024-09-11T23:35:46.696550+0000 (oldest deadline 2024-09-11T23:36:12.596707+0000) 2024-09-11T23:36:14.629 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:14 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:14.466+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:37.277803+0000 front 2024-09-11T23:35:37.277821+0000 (oldest deadline 2024-09-11T23:36:00.777764+0000) 2024-09-11T23:36:14.629 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:14 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:14.466+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.478993+0000 front 2024-09-11T23:35:45.478970+0000 (oldest deadline 2024-09-11T23:36:08.379023+0000) 2024-09-11T23:36:14.630 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:14 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:14.279+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:34.129174+0000 front 2024-09-11T23:35:34.128995+0000 (oldest deadline 2024-09-11T23:36:04.129586+0000) 2024-09-11T23:36:14.630 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:14 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:14.279+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.830933+0000 front 2024-09-11T23:35:45.830844+0000 (oldest deadline 2024-09-11T23:36:13.431439+0000) 2024-09-11T23:36:14.735 INFO:journalctl@ceph.osd.4.smithi123.stdout:Sep 11 23:36:14 smithi123 podman[71336]: 2024-09-11 23:36:14.467489968 +0000 UTC m=+6.120039956 container cleanup ecf7680b27e36249dfd27d236c47f114c491b5da77963c437428c8f08617506e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-4, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T23:36:14.735 INFO:journalctl@ceph.osd.4.smithi123.stdout:Sep 11 23:36:14 smithi123 bash[71336]: ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-4 2024-09-11T23:36:14.933 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 11 23:36:14 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-5[46502]: 2024-09-11T23:36:14.629+0000 7faa72ce1640 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:37.583174+0000 front 2024-09-11T23:35:37.583193+0000 (oldest deadline 2024-09-11T23:35:59.283292+0000) 2024-09-11T23:36:14.933 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 11 23:36:14 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-5[46502]: 2024-09-11T23:36:14.629+0000 7faa72ce1640 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:46.086340+0000 front 2024-09-11T23:35:46.086374+0000 (oldest deadline 2024-09-11T23:36:08.986337+0000) 2024-09-11T23:36:15.000 INFO:journalctl@ceph.osd.4.smithi123.stdout:Sep 11 23:36:14 smithi123 podman[71351]: 2024-09-11 23:36:14.735905389 +0000 UTC m=+0.659636024 container remove ecf7680b27e36249dfd27d236c47f114c491b5da77963c437428c8f08617506e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-4, ceph=True, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T23:36:15.001 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 11 23:36:14 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-7[53549]: 2024-09-11T23:36:14.812+0000 7f58e9644640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:44.344227+0000 front 2024-09-11T23:35:44.344251+0000 (oldest deadline 2024-09-11T23:36:09.044354+0000) 2024-09-11T23:36:15.001 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:14 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:14.747+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:35.287175+0000 front 2024-09-11T23:35:35.287164+0000 (oldest deadline 2024-09-11T23:36:01.186976+0000) 2024-09-11T23:36:15.001 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:14 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:14.747+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.288233+0000 front 2024-09-11T23:35:45.288257+0000 (oldest deadline 2024-09-11T23:36:09.988379+0000) 2024-09-11T23:36:15.287 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 11 23:36:14 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-6[57869]: 2024-09-11T23:36:14.831+0000 7f4498e00640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.519792+0000 front 2024-09-11T23:35:45.519899+0000 (oldest deadline 2024-09-11T23:36:11.420000+0000) 2024-09-11T23:36:15.355 INFO:journalctl@ceph.osd.4.smithi123.stdout:Sep 11 23:36:15 smithi123 podman[71439]: 2024-09-11 23:36:14.974982515 +0000 UTC m=+0.015602364 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T23:36:15.355 INFO:journalctl@ceph.osd.4.smithi123.stdout:Sep 11 23:36:15 smithi123 podman[71439]: 2024-09-11 23:36:15.095039125 +0000 UTC m=+0.135658959 container create 22cdc7556ebd2d3e3d1d55f93161558080713720583e9f4f6a8c17ba9341d69e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-4-deactivate, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T23:36:15.564 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:15 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:15.287+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:33.392902+0000 front 2024-09-11T23:35:33.393259+0000 (oldest deadline 2024-09-11T23:35:59.793635+0000) 2024-09-11T23:36:15.564 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:15 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:15.287+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:46.696487+0000 front 2024-09-11T23:35:46.696550+0000 (oldest deadline 2024-09-11T23:36:12.596707+0000) 2024-09-11T23:36:15.620 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:15 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:15.324+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:34.129174+0000 front 2024-09-11T23:35:34.128995+0000 (oldest deadline 2024-09-11T23:36:04.129586+0000) 2024-09-11T23:36:15.620 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:15 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:15.324+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.830933+0000 front 2024-09-11T23:35:45.830844+0000 (oldest deadline 2024-09-11T23:36:13.431439+0000) 2024-09-11T23:36:15.621 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:15 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:15.481+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:37.277803+0000 front 2024-09-11T23:35:37.277821+0000 (oldest deadline 2024-09-11T23:36:00.777764+0000) 2024-09-11T23:36:15.621 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:15 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:15.481+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.478993+0000 front 2024-09-11T23:35:45.478970+0000 (oldest deadline 2024-09-11T23:36:08.379023+0000) 2024-09-11T23:36:15.750 INFO:journalctl@ceph.osd.4.smithi123.stdout:Sep 11 23:36:15 smithi123 podman[71439]: 2024-09-11 23:36:15.356031842 +0000 UTC m=+0.396651676 container init 22cdc7556ebd2d3e3d1d55f93161558080713720583e9f4f6a8c17ba9341d69e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-4-deactivate, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, ceph=True) 2024-09-11T23:36:15.750 INFO:journalctl@ceph.osd.4.smithi123.stdout:Sep 11 23:36:15 smithi123 podman[71439]: 2024-09-11 23:36:15.359330715 +0000 UTC m=+0.399950566 container start 22cdc7556ebd2d3e3d1d55f93161558080713720583e9f4f6a8c17ba9341d69e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-4-deactivate, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-11T23:36:15.751 INFO:journalctl@ceph.osd.4.smithi123.stdout:Sep 11 23:36:15 smithi123 podman[71439]: 2024-09-11 23:36:15.464360723 +0000 UTC m=+0.504980579 container attach 22cdc7556ebd2d3e3d1d55f93161558080713720583e9f4f6a8c17ba9341d69e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-4-deactivate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-11T23:36:15.751 INFO:journalctl@ceph.osd.4.smithi123.stdout:Sep 11 23:36:15 smithi123 podman[71439]: 2024-09-11 23:36:15.549762741 +0000 UTC m=+0.590382591 container died 22cdc7556ebd2d3e3d1d55f93161558080713720583e9f4f6a8c17ba9341d69e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-4-deactivate, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-11T23:36:15.933 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 11 23:36:15 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-5[46502]: 2024-09-11T23:36:15.620+0000 7faa72ce1640 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:37.583174+0000 front 2024-09-11T23:35:37.583193+0000 (oldest deadline 2024-09-11T23:35:59.283292+0000) 2024-09-11T23:36:15.933 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 11 23:36:15 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-5[46502]: 2024-09-11T23:36:15.620+0000 7faa72ce1640 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:46.086340+0000 front 2024-09-11T23:35:46.086374+0000 (oldest deadline 2024-09-11T23:36:08.986337+0000) 2024-09-11T23:36:16.158 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 11 23:36:15 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-7[53549]: 2024-09-11T23:36:15.830+0000 7f58e9644640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:44.344227+0000 front 2024-09-11T23:35:44.344251+0000 (oldest deadline 2024-09-11T23:36:09.044354+0000) 2024-09-11T23:36:16.159 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:15 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:15.775+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:35.287175+0000 front 2024-09-11T23:35:35.287164+0000 (oldest deadline 2024-09-11T23:36:01.186976+0000) 2024-09-11T23:36:16.159 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:15 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:15.775+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.288233+0000 front 2024-09-11T23:35:45.288257+0000 (oldest deadline 2024-09-11T23:36:09.988379+0000) 2024-09-11T23:36:16.178 DEBUG:teuthology.orchestra.run.smithi123:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8b03efce-7092-11ef-bcea-c7b262605968@osd.4.service' 2024-09-11T23:36:16.263 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T23:36:16.263 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-11T23:36:16.264 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-11T23:36:16.264 DEBUG:teuthology.orchestra.run.smithi160:> sudo systemctl stop ceph-8b03efce-7092-11ef-bcea-c7b262605968@osd.5 2024-09-11T23:36:16.314 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 11 23:36:15 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-6[57869]: 2024-09-11T23:36:15.838+0000 7f4498e00640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.519792+0000 front 2024-09-11T23:35:45.519899+0000 (oldest deadline 2024-09-11T23:36:11.420000+0000) 2024-09-11T23:36:16.592 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 11 23:36:16 smithi160 systemd[1]: Stopping Ceph osd.5 for 8b03efce-7092-11ef-bcea-c7b262605968... 2024-09-11T23:36:16.592 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:16 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:16.341+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:34.129174+0000 front 2024-09-11T23:35:34.128995+0000 (oldest deadline 2024-09-11T23:36:04.129586+0000) 2024-09-11T23:36:16.592 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:16 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:16.341+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.830933+0000 front 2024-09-11T23:35:45.830844+0000 (oldest deadline 2024-09-11T23:36:13.431439+0000) 2024-09-11T23:36:16.593 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:16 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:16.507+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:37.277803+0000 front 2024-09-11T23:35:37.277821+0000 (oldest deadline 2024-09-11T23:36:00.777764+0000) 2024-09-11T23:36:16.593 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:16 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:16.507+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.478993+0000 front 2024-09-11T23:35:45.478970+0000 (oldest deadline 2024-09-11T23:36:08.379023+0000) 2024-09-11T23:36:16.808 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:16 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:16.331+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:33.392902+0000 front 2024-09-11T23:35:33.393259+0000 (oldest deadline 2024-09-11T23:35:59.793635+0000) 2024-09-11T23:36:16.809 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:16 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:16.331+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:46.696487+0000 front 2024-09-11T23:35:46.696550+0000 (oldest deadline 2024-09-11T23:36:12.596707+0000) 2024-09-11T23:36:16.933 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 11 23:36:16 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-5[46502]: 2024-09-11T23:36:16.591+0000 7faa766cb640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T23:36:16.933 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 11 23:36:16 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-5[46502]: 2024-09-11T23:36:16.591+0000 7faa766cb640 -1 osd.5 99 *** Got signal Terminated *** 2024-09-11T23:36:16.934 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 11 23:36:16 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-5[46502]: 2024-09-11T23:36:16.591+0000 7faa766cb640 -1 osd.5 99 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T23:36:16.934 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 11 23:36:16 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-5[46502]: 2024-09-11T23:36:16.653+0000 7faa72ce1640 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:37.583174+0000 front 2024-09-11T23:35:37.583193+0000 (oldest deadline 2024-09-11T23:35:59.283292+0000) 2024-09-11T23:36:16.934 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 11 23:36:16 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-5[46502]: 2024-09-11T23:36:16.653+0000 7faa72ce1640 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:46.086340+0000 front 2024-09-11T23:35:46.086374+0000 (oldest deadline 2024-09-11T23:36:08.986337+0000) 2024-09-11T23:36:17.064 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 11 23:36:16 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-6[57869]: 2024-09-11T23:36:16.809+0000 7f4498e00640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.519792+0000 front 2024-09-11T23:35:45.519899+0000 (oldest deadline 2024-09-11T23:36:11.420000+0000) 2024-09-11T23:36:17.250 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 11 23:36:16 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-7[53549]: 2024-09-11T23:36:16.838+0000 7f58e9644640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:44.344227+0000 front 2024-09-11T23:35:44.344251+0000 (oldest deadline 2024-09-11T23:36:09.044354+0000) 2024-09-11T23:36:17.251 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:16 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:16.783+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:35.287175+0000 front 2024-09-11T23:35:35.287164+0000 (oldest deadline 2024-09-11T23:36:01.186976+0000) 2024-09-11T23:36:17.251 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:16 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:16.783+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.288233+0000 front 2024-09-11T23:35:45.288257+0000 (oldest deadline 2024-09-11T23:36:09.988379+0000) 2024-09-11T23:36:17.564 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:17 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:17.291+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:33.392902+0000 front 2024-09-11T23:35:33.393259+0000 (oldest deadline 2024-09-11T23:35:59.793635+0000) 2024-09-11T23:36:17.564 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:17 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:17.291+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:46.696487+0000 front 2024-09-11T23:35:46.696550+0000 (oldest deadline 2024-09-11T23:36:12.596707+0000) 2024-09-11T23:36:17.683 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:17 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:17.312+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:34.129174+0000 front 2024-09-11T23:35:34.128995+0000 (oldest deadline 2024-09-11T23:36:04.129586+0000) 2024-09-11T23:36:17.683 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:17 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:17.312+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.830933+0000 front 2024-09-11T23:35:45.830844+0000 (oldest deadline 2024-09-11T23:36:13.431439+0000) 2024-09-11T23:36:17.684 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:17 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:17.556+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:37.277803+0000 front 2024-09-11T23:35:37.277821+0000 (oldest deadline 2024-09-11T23:36:00.777764+0000) 2024-09-11T23:36:17.684 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:17 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:17.556+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.478993+0000 front 2024-09-11T23:35:45.478970+0000 (oldest deadline 2024-09-11T23:36:08.379023+0000) 2024-09-11T23:36:18.064 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 11 23:36:17 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-6[57869]: 2024-09-11T23:36:17.799+0000 7f4498e00640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.519792+0000 front 2024-09-11T23:35:45.519899+0000 (oldest deadline 2024-09-11T23:36:11.420000+0000) 2024-09-11T23:36:18.152 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:17 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:17.825+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:35.287175+0000 front 2024-09-11T23:35:35.287164+0000 (oldest deadline 2024-09-11T23:36:01.186976+0000) 2024-09-11T23:36:18.152 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:17 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:17.825+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.288233+0000 front 2024-09-11T23:35:45.288257+0000 (oldest deadline 2024-09-11T23:36:09.988379+0000) 2024-09-11T23:36:18.152 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 11 23:36:17 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-7[53549]: 2024-09-11T23:36:17.814+0000 7f58e9644640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:44.344227+0000 front 2024-09-11T23:35:44.344251+0000 (oldest deadline 2024-09-11T23:36:09.044354+0000) 2024-09-11T23:36:18.183 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 11 23:36:17 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-5[46502]: 2024-09-11T23:36:17.701+0000 7faa72ce1640 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:37.583174+0000 front 2024-09-11T23:35:37.583193+0000 (oldest deadline 2024-09-11T23:35:59.283292+0000) 2024-09-11T23:36:18.183 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 11 23:36:17 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-5[46502]: 2024-09-11T23:36:17.701+0000 7faa72ce1640 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:46.086340+0000 front 2024-09-11T23:35:46.086374+0000 (oldest deadline 2024-09-11T23:36:08.986337+0000) 2024-09-11T23:36:18.183 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 11 23:36:17 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-5[46502]: 2024-09-11T23:36:17.701+0000 7faa72ce1640 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:55.888184+0000 front 2024-09-11T23:35:55.888112+0000 (oldest deadline 2024-09-11T23:36:17.588288+0000) 2024-09-11T23:36:18.549 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:18 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:18.263+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:34.129174+0000 front 2024-09-11T23:35:34.128995+0000 (oldest deadline 2024-09-11T23:36:04.129586+0000) 2024-09-11T23:36:18.550 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:18 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:18.263+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.830933+0000 front 2024-09-11T23:35:45.830844+0000 (oldest deadline 2024-09-11T23:36:13.431439+0000) 2024-09-11T23:36:18.550 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:18 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:18.263+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:53.932228+0000 front 2024-09-11T23:35:53.932202+0000 (oldest deadline 2024-09-11T23:36:18.032372+0000) 2024-09-11T23:36:18.563 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:18 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:18.261+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:33.392902+0000 front 2024-09-11T23:35:33.393259+0000 (oldest deadline 2024-09-11T23:35:59.793635+0000) 2024-09-11T23:36:18.564 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:18 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:18.261+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:46.696487+0000 front 2024-09-11T23:35:46.696550+0000 (oldest deadline 2024-09-11T23:36:12.596707+0000) 2024-09-11T23:36:18.933 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:18 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:18.549+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:37.277803+0000 front 2024-09-11T23:35:37.277821+0000 (oldest deadline 2024-09-11T23:36:00.777764+0000) 2024-09-11T23:36:18.933 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:18 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:18.549+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.478993+0000 front 2024-09-11T23:35:45.478970+0000 (oldest deadline 2024-09-11T23:36:08.379023+0000) 2024-09-11T23:36:18.934 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 11 23:36:18 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-5[46502]: 2024-09-11T23:36:18.714+0000 7faa72ce1640 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:37.583174+0000 front 2024-09-11T23:35:37.583193+0000 (oldest deadline 2024-09-11T23:35:59.283292+0000) 2024-09-11T23:36:18.934 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 11 23:36:18 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-5[46502]: 2024-09-11T23:36:18.714+0000 7faa72ce1640 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:46.086340+0000 front 2024-09-11T23:35:46.086374+0000 (oldest deadline 2024-09-11T23:36:08.986337+0000) 2024-09-11T23:36:18.934 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 11 23:36:18 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-5[46502]: 2024-09-11T23:36:18.714+0000 7faa72ce1640 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:55.888184+0000 front 2024-09-11T23:35:55.888112+0000 (oldest deadline 2024-09-11T23:36:17.588288+0000) 2024-09-11T23:36:19.064 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 11 23:36:18 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-6[57869]: 2024-09-11T23:36:18.772+0000 7f4498e00640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.519792+0000 front 2024-09-11T23:35:45.519899+0000 (oldest deadline 2024-09-11T23:36:11.420000+0000) 2024-09-11T23:36:19.064 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 11 23:36:18 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-6[57869]: 2024-09-11T23:36:18.772+0000 7f4498e00640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:51.921756+0000 front 2024-09-11T23:35:51.921842+0000 (oldest deadline 2024-09-11T23:36:18.322897+0000) 2024-09-11T23:36:19.250 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 11 23:36:18 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-7[53549]: 2024-09-11T23:36:18.820+0000 7f58e9644640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:44.344227+0000 front 2024-09-11T23:35:44.344251+0000 (oldest deadline 2024-09-11T23:36:09.044354+0000) 2024-09-11T23:36:19.250 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:18 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:18.795+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:35.287175+0000 front 2024-09-11T23:35:35.287164+0000 (oldest deadline 2024-09-11T23:36:01.186976+0000) 2024-09-11T23:36:19.251 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:18 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:18.795+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.288233+0000 front 2024-09-11T23:35:45.288257+0000 (oldest deadline 2024-09-11T23:36:09.988379+0000) 2024-09-11T23:36:19.251 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:18 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:18.795+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:54.590336+0000 front 2024-09-11T23:35:54.590569+0000 (oldest deadline 2024-09-11T23:36:18.690277+0000) 2024-09-11T23:36:19.564 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:19 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:19.256+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:33.392902+0000 front 2024-09-11T23:35:33.393259+0000 (oldest deadline 2024-09-11T23:35:59.793635+0000) 2024-09-11T23:36:19.564 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:19 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:19.256+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:46.696487+0000 front 2024-09-11T23:35:46.696550+0000 (oldest deadline 2024-09-11T23:36:12.596707+0000) 2024-09-11T23:36:19.564 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:19 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:19.256+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:52.597139+0000 front 2024-09-11T23:35:52.597169+0000 (oldest deadline 2024-09-11T23:36:18.497326+0000) 2024-09-11T23:36:19.588 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:19 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:19.276+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:34.129174+0000 front 2024-09-11T23:35:34.128995+0000 (oldest deadline 2024-09-11T23:36:04.129586+0000) 2024-09-11T23:36:19.588 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:19 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:19.276+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.830933+0000 front 2024-09-11T23:35:45.830844+0000 (oldest deadline 2024-09-11T23:36:13.431439+0000) 2024-09-11T23:36:19.589 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:19 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:19.276+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:53.932228+0000 front 2024-09-11T23:35:53.932202+0000 (oldest deadline 2024-09-11T23:36:18.032372+0000) 2024-09-11T23:36:19.933 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 11 23:36:19 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-5[46502]: 2024-09-11T23:36:19.677+0000 7faa72ce1640 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:37.583174+0000 front 2024-09-11T23:35:37.583193+0000 (oldest deadline 2024-09-11T23:35:59.283292+0000) 2024-09-11T23:36:19.933 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 11 23:36:19 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-5[46502]: 2024-09-11T23:36:19.677+0000 7faa72ce1640 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:46.086340+0000 front 2024-09-11T23:35:46.086374+0000 (oldest deadline 2024-09-11T23:36:08.986337+0000) 2024-09-11T23:36:19.933 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 11 23:36:19 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-5[46502]: 2024-09-11T23:36:19.677+0000 7faa72ce1640 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:55.888184+0000 front 2024-09-11T23:35:55.888112+0000 (oldest deadline 2024-09-11T23:36:17.588288+0000) 2024-09-11T23:36:19.934 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:19 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:19.587+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:37.277803+0000 front 2024-09-11T23:35:37.277821+0000 (oldest deadline 2024-09-11T23:36:00.777764+0000) 2024-09-11T23:36:19.934 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:19 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:19.588+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.478993+0000 front 2024-09-11T23:35:45.478970+0000 (oldest deadline 2024-09-11T23:36:08.379023+0000) 2024-09-11T23:36:19.934 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:19 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:19.588+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:55.980636+0000 front 2024-09-11T23:35:55.980669+0000 (oldest deadline 2024-09-11T23:36:18.880843+0000) 2024-09-11T23:36:20.064 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 11 23:36:19 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-6[57869]: 2024-09-11T23:36:19.788+0000 7f4498e00640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.519792+0000 front 2024-09-11T23:35:45.519899+0000 (oldest deadline 2024-09-11T23:36:11.420000+0000) 2024-09-11T23:36:20.064 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 11 23:36:19 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-6[57869]: 2024-09-11T23:36:19.788+0000 7f4498e00640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:51.921756+0000 front 2024-09-11T23:35:51.921842+0000 (oldest deadline 2024-09-11T23:36:18.322897+0000) 2024-09-11T23:36:20.251 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 11 23:36:19 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-7[53549]: 2024-09-11T23:36:19.859+0000 7f58e9644640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:44.344227+0000 front 2024-09-11T23:35:44.344251+0000 (oldest deadline 2024-09-11T23:36:09.044354+0000) 2024-09-11T23:36:20.251 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:19 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:19.764+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:35.287175+0000 front 2024-09-11T23:35:35.287164+0000 (oldest deadline 2024-09-11T23:36:01.186976+0000) 2024-09-11T23:36:20.251 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:19 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:19.764+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.288233+0000 front 2024-09-11T23:35:45.288257+0000 (oldest deadline 2024-09-11T23:36:09.988379+0000) 2024-09-11T23:36:20.251 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:19 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:19.764+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:54.590336+0000 front 2024-09-11T23:35:54.590569+0000 (oldest deadline 2024-09-11T23:36:18.690277+0000) 2024-09-11T23:36:20.564 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:20 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:20.263+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:33.392902+0000 front 2024-09-11T23:35:33.393259+0000 (oldest deadline 2024-09-11T23:35:59.793635+0000) 2024-09-11T23:36:20.564 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:20 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:20.263+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:46.696487+0000 front 2024-09-11T23:35:46.696550+0000 (oldest deadline 2024-09-11T23:36:12.596707+0000) 2024-09-11T23:36:20.564 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:20 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:20.263+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:52.597139+0000 front 2024-09-11T23:35:52.597169+0000 (oldest deadline 2024-09-11T23:36:18.497326+0000) 2024-09-11T23:36:20.632 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:20 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:20.291+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:34.129174+0000 front 2024-09-11T23:35:34.128995+0000 (oldest deadline 2024-09-11T23:36:04.129586+0000) 2024-09-11T23:36:20.632 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:20 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:20.291+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.830933+0000 front 2024-09-11T23:35:45.830844+0000 (oldest deadline 2024-09-11T23:36:13.431439+0000) 2024-09-11T23:36:20.632 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:20 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:20.291+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:53.932228+0000 front 2024-09-11T23:35:53.932202+0000 (oldest deadline 2024-09-11T23:36:18.032372+0000) 2024-09-11T23:36:20.933 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:20 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:20.631+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:37.277803+0000 front 2024-09-11T23:35:37.277821+0000 (oldest deadline 2024-09-11T23:36:00.777764+0000) 2024-09-11T23:36:20.933 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:20 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:20.631+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.478993+0000 front 2024-09-11T23:35:45.478970+0000 (oldest deadline 2024-09-11T23:36:08.379023+0000) 2024-09-11T23:36:20.933 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:20 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:20.631+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:55.980636+0000 front 2024-09-11T23:35:55.980669+0000 (oldest deadline 2024-09-11T23:36:18.880843+0000) 2024-09-11T23:36:20.934 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 11 23:36:20 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-5[46502]: 2024-09-11T23:36:20.675+0000 7faa72ce1640 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:37.583174+0000 front 2024-09-11T23:35:37.583193+0000 (oldest deadline 2024-09-11T23:35:59.283292+0000) 2024-09-11T23:36:20.934 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 11 23:36:20 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-5[46502]: 2024-09-11T23:36:20.675+0000 7faa72ce1640 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:46.086340+0000 front 2024-09-11T23:35:46.086374+0000 (oldest deadline 2024-09-11T23:36:08.986337+0000) 2024-09-11T23:36:20.934 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 11 23:36:20 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-5[46502]: 2024-09-11T23:36:20.675+0000 7faa72ce1640 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:55.888184+0000 front 2024-09-11T23:35:55.888112+0000 (oldest deadline 2024-09-11T23:36:17.588288+0000) 2024-09-11T23:36:21.064 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 11 23:36:20 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-6[57869]: 2024-09-11T23:36:20.780+0000 7f4498e00640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.519792+0000 front 2024-09-11T23:35:45.519899+0000 (oldest deadline 2024-09-11T23:36:11.420000+0000) 2024-09-11T23:36:21.064 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 11 23:36:20 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-6[57869]: 2024-09-11T23:36:20.780+0000 7f4498e00640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:51.921756+0000 front 2024-09-11T23:35:51.921842+0000 (oldest deadline 2024-09-11T23:36:18.322897+0000) 2024-09-11T23:36:21.250 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 11 23:36:20 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-7[53549]: 2024-09-11T23:36:20.844+0000 7f58e9644640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:44.344227+0000 front 2024-09-11T23:35:44.344251+0000 (oldest deadline 2024-09-11T23:36:09.044354+0000) 2024-09-11T23:36:21.250 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 11 23:36:20 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-7[53549]: 2024-09-11T23:36:20.844+0000 7f58e9644640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:54.945348+0000 front 2024-09-11T23:35:54.945308+0000 (oldest deadline 2024-09-11T23:36:20.245466+0000) 2024-09-11T23:36:21.251 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:20 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:20.781+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:35.287175+0000 front 2024-09-11T23:35:35.287164+0000 (oldest deadline 2024-09-11T23:36:01.186976+0000) 2024-09-11T23:36:21.251 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:20 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:20.781+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.288233+0000 front 2024-09-11T23:35:45.288257+0000 (oldest deadline 2024-09-11T23:36:09.988379+0000) 2024-09-11T23:36:21.251 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:20 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:20.781+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:54.590336+0000 front 2024-09-11T23:35:54.590569+0000 (oldest deadline 2024-09-11T23:36:18.690277+0000) 2024-09-11T23:36:21.564 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:21 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:21.240+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:33.392902+0000 front 2024-09-11T23:35:33.393259+0000 (oldest deadline 2024-09-11T23:35:59.793635+0000) 2024-09-11T23:36:21.564 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:21 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:21.240+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:46.696487+0000 front 2024-09-11T23:35:46.696550+0000 (oldest deadline 2024-09-11T23:36:12.596707+0000) 2024-09-11T23:36:21.564 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:21 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:21.240+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:52.597139+0000 front 2024-09-11T23:35:52.597169+0000 (oldest deadline 2024-09-11T23:36:18.497326+0000) 2024-09-11T23:36:21.626 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:21 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:21.254+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:34.129174+0000 front 2024-09-11T23:35:34.128995+0000 (oldest deadline 2024-09-11T23:36:04.129586+0000) 2024-09-11T23:36:21.626 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:21 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:21.254+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.830933+0000 front 2024-09-11T23:35:45.830844+0000 (oldest deadline 2024-09-11T23:36:13.431439+0000) 2024-09-11T23:36:21.626 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:21 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:21.254+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:53.932228+0000 front 2024-09-11T23:35:53.932202+0000 (oldest deadline 2024-09-11T23:36:18.032372+0000) 2024-09-11T23:36:21.906 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:21 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:21.625+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:37.277803+0000 front 2024-09-11T23:35:37.277821+0000 (oldest deadline 2024-09-11T23:36:00.777764+0000) 2024-09-11T23:36:21.906 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:21 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:21.625+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.478993+0000 front 2024-09-11T23:35:45.478970+0000 (oldest deadline 2024-09-11T23:36:08.379023+0000) 2024-09-11T23:36:21.906 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:21 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:21.625+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:55.980636+0000 front 2024-09-11T23:35:55.980669+0000 (oldest deadline 2024-09-11T23:36:18.880843+0000) 2024-09-11T23:36:22.064 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 11 23:36:21 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-6[57869]: 2024-09-11T23:36:21.768+0000 7f4498e00640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.519792+0000 front 2024-09-11T23:35:45.519899+0000 (oldest deadline 2024-09-11T23:36:11.420000+0000) 2024-09-11T23:36:22.064 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 11 23:36:21 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-6[57869]: 2024-09-11T23:36:21.768+0000 7f4498e00640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:51.921756+0000 front 2024-09-11T23:35:51.921842+0000 (oldest deadline 2024-09-11T23:36:18.322897+0000) 2024-09-11T23:36:22.250 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 11 23:36:21 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-7[53549]: 2024-09-11T23:36:21.838+0000 7f58e9644640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:44.344227+0000 front 2024-09-11T23:35:44.344251+0000 (oldest deadline 2024-09-11T23:36:09.044354+0000) 2024-09-11T23:36:22.250 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 11 23:36:21 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-7[53549]: 2024-09-11T23:36:21.838+0000 7f58e9644640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:54.945348+0000 front 2024-09-11T23:35:54.945308+0000 (oldest deadline 2024-09-11T23:36:20.245466+0000) 2024-09-11T23:36:22.250 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:21 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:21.790+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:35.287175+0000 front 2024-09-11T23:35:35.287164+0000 (oldest deadline 2024-09-11T23:36:01.186976+0000) 2024-09-11T23:36:22.251 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:21 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:21.790+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.288233+0000 front 2024-09-11T23:35:45.288257+0000 (oldest deadline 2024-09-11T23:36:09.988379+0000) 2024-09-11T23:36:22.251 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:21 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:21.790+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:54.590336+0000 front 2024-09-11T23:35:54.590569+0000 (oldest deadline 2024-09-11T23:36:18.690277+0000) 2024-09-11T23:36:22.564 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:22 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:22.227+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:33.392902+0000 front 2024-09-11T23:35:33.393259+0000 (oldest deadline 2024-09-11T23:35:59.793635+0000) 2024-09-11T23:36:22.564 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:22 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:22.227+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:46.696487+0000 front 2024-09-11T23:35:46.696550+0000 (oldest deadline 2024-09-11T23:36:12.596707+0000) 2024-09-11T23:36:22.564 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:22 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:22.227+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:52.597139+0000 front 2024-09-11T23:35:52.597169+0000 (oldest deadline 2024-09-11T23:36:18.497326+0000) 2024-09-11T23:36:22.576 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 11 23:36:22 smithi160 podman[70668]: 2024-09-11 23:36:22.275905918 +0000 UTC m=+5.806990849 container died 4780d0b7d74b2c71504fe1ff4db43d2fd33da98b404843c75b93d2dd470a3695 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-5, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-11T23:36:22.576 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:22 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:22.287+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:34.129174+0000 front 2024-09-11T23:35:34.128995+0000 (oldest deadline 2024-09-11T23:36:04.129586+0000) 2024-09-11T23:36:22.576 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:22 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:22.287+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.830933+0000 front 2024-09-11T23:35:45.830844+0000 (oldest deadline 2024-09-11T23:36:13.431439+0000) 2024-09-11T23:36:22.576 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:22 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:22.287+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:53.932228+0000 front 2024-09-11T23:35:53.932202+0000 (oldest deadline 2024-09-11T23:36:18.032372+0000) 2024-09-11T23:36:22.902 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 11 23:36:22 smithi160 podman[70668]: 2024-09-11 23:36:22.667006756 +0000 UTC m=+6.198091676 container cleanup 4780d0b7d74b2c71504fe1ff4db43d2fd33da98b404843c75b93d2dd470a3695 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-5, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-11T23:36:22.902 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 11 23:36:22 smithi160 bash[70668]: ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-5 2024-09-11T23:36:22.903 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:22 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:22.633+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:37.277803+0000 front 2024-09-11T23:35:37.277821+0000 (oldest deadline 2024-09-11T23:36:00.777764+0000) 2024-09-11T23:36:22.903 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:22 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:22.633+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.478993+0000 front 2024-09-11T23:35:45.478970+0000 (oldest deadline 2024-09-11T23:36:08.379023+0000) 2024-09-11T23:36:22.903 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:22 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:22.633+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:55.980636+0000 front 2024-09-11T23:35:55.980669+0000 (oldest deadline 2024-09-11T23:36:18.880843+0000) 2024-09-11T23:36:23.064 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 11 23:36:22 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-6[57869]: 2024-09-11T23:36:22.720+0000 7f4498e00640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.519792+0000 front 2024-09-11T23:35:45.519899+0000 (oldest deadline 2024-09-11T23:36:11.420000+0000) 2024-09-11T23:36:23.064 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 11 23:36:22 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-6[57869]: 2024-09-11T23:36:22.720+0000 7f4498e00640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:51.921756+0000 front 2024-09-11T23:35:51.921842+0000 (oldest deadline 2024-09-11T23:36:18.322897+0000) 2024-09-11T23:36:23.183 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 11 23:36:22 smithi160 podman[70694]: 2024-09-11 23:36:22.960778515 +0000 UTC m=+0.679202709 container remove 4780d0b7d74b2c71504fe1ff4db43d2fd33da98b404843c75b93d2dd470a3695 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-11T23:36:23.250 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 11 23:36:22 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-7[53549]: 2024-09-11T23:36:22.810+0000 7f58e9644640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:44.344227+0000 front 2024-09-11T23:35:44.344251+0000 (oldest deadline 2024-09-11T23:36:09.044354+0000) 2024-09-11T23:36:23.250 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 11 23:36:22 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-7[53549]: 2024-09-11T23:36:22.810+0000 7f58e9644640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:54.945348+0000 front 2024-09-11T23:35:54.945308+0000 (oldest deadline 2024-09-11T23:36:20.245466+0000) 2024-09-11T23:36:23.251 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:22 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:22.774+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:35.287175+0000 front 2024-09-11T23:35:35.287164+0000 (oldest deadline 2024-09-11T23:36:01.186976+0000) 2024-09-11T23:36:23.251 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:22 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:22.774+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.288233+0000 front 2024-09-11T23:35:45.288257+0000 (oldest deadline 2024-09-11T23:36:09.988379+0000) 2024-09-11T23:36:23.251 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:22 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:22.774+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:54.590336+0000 front 2024-09-11T23:35:54.590569+0000 (oldest deadline 2024-09-11T23:36:18.690277+0000) 2024-09-11T23:36:23.564 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:23 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:23.228+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:33.392902+0000 front 2024-09-11T23:35:33.393259+0000 (oldest deadline 2024-09-11T23:35:59.793635+0000) 2024-09-11T23:36:23.564 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:23 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:23.228+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:46.696487+0000 front 2024-09-11T23:35:46.696550+0000 (oldest deadline 2024-09-11T23:36:12.596707+0000) 2024-09-11T23:36:23.564 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:23 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:23.228+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:52.597139+0000 front 2024-09-11T23:35:52.597169+0000 (oldest deadline 2024-09-11T23:36:18.497326+0000) 2024-09-11T23:36:23.571 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 11 23:36:23 smithi160 podman[70783]: 2024-09-11 23:36:23.185791328 +0000 UTC m=+0.016133760 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T23:36:23.571 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 11 23:36:23 smithi160 podman[70783]: 2024-09-11 23:36:23.303241822 +0000 UTC m=+0.133584297 container create 1946bad4a9aebea842cdd9740ae5b5d670a8bdf3d5a007dee10e88537f3b8467 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-5-deactivate, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD) 2024-09-11T23:36:23.572 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:23 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:23.332+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:34.129174+0000 front 2024-09-11T23:35:34.128995+0000 (oldest deadline 2024-09-11T23:36:04.129586+0000) 2024-09-11T23:36:23.572 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:23 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:23.332+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.830933+0000 front 2024-09-11T23:35:45.830844+0000 (oldest deadline 2024-09-11T23:36:13.431439+0000) 2024-09-11T23:36:23.572 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:23 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:23.332+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:53.932228+0000 front 2024-09-11T23:35:53.932202+0000 (oldest deadline 2024-09-11T23:36:18.032372+0000) 2024-09-11T23:36:23.933 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:23 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:23.586+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:37.277803+0000 front 2024-09-11T23:35:37.277821+0000 (oldest deadline 2024-09-11T23:36:00.777764+0000) 2024-09-11T23:36:23.933 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:23 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:23.586+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.478993+0000 front 2024-09-11T23:35:45.478970+0000 (oldest deadline 2024-09-11T23:36:08.379023+0000) 2024-09-11T23:36:23.933 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:23 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:23.586+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:55.980636+0000 front 2024-09-11T23:35:55.980669+0000 (oldest deadline 2024-09-11T23:36:18.880843+0000) 2024-09-11T23:36:23.934 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 11 23:36:23 smithi160 podman[70783]: 2024-09-11 23:36:23.572717047 +0000 UTC m=+0.403059477 container init 1946bad4a9aebea842cdd9740ae5b5d670a8bdf3d5a007dee10e88537f3b8467 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-5-deactivate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-11T23:36:23.934 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 11 23:36:23 smithi160 podman[70783]: 2024-09-11 23:36:23.576122947 +0000 UTC m=+0.406465377 container start 1946bad4a9aebea842cdd9740ae5b5d670a8bdf3d5a007dee10e88537f3b8467 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-5-deactivate, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-11T23:36:23.934 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 11 23:36:23 smithi160 podman[70783]: 2024-09-11 23:36:23.672731077 +0000 UTC m=+0.503073518 container attach 1946bad4a9aebea842cdd9740ae5b5d670a8bdf3d5a007dee10e88537f3b8467 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-5-deactivate, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS) 2024-09-11T23:36:23.934 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 11 23:36:23 smithi160 podman[70783]: 2024-09-11 23:36:23.761333544 +0000 UTC m=+0.591675983 container died 1946bad4a9aebea842cdd9740ae5b5d670a8bdf3d5a007dee10e88537f3b8467 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-5-deactivate, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-11T23:36:24.064 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 11 23:36:23 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-6[57869]: 2024-09-11T23:36:23.717+0000 7f4498e00640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.519792+0000 front 2024-09-11T23:35:45.519899+0000 (oldest deadline 2024-09-11T23:36:11.420000+0000) 2024-09-11T23:36:24.064 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 11 23:36:23 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-6[57869]: 2024-09-11T23:36:23.717+0000 7f4498e00640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:51.921756+0000 front 2024-09-11T23:35:51.921842+0000 (oldest deadline 2024-09-11T23:36:18.322897+0000) 2024-09-11T23:36:24.250 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 11 23:36:23 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-7[53549]: 2024-09-11T23:36:23.800+0000 7f58e9644640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:44.344227+0000 front 2024-09-11T23:35:44.344251+0000 (oldest deadline 2024-09-11T23:36:09.044354+0000) 2024-09-11T23:36:24.250 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 11 23:36:23 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-7[53549]: 2024-09-11T23:36:23.800+0000 7f58e9644640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:54.945348+0000 front 2024-09-11T23:35:54.945308+0000 (oldest deadline 2024-09-11T23:36:20.245466+0000) 2024-09-11T23:36:24.251 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:23 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:23.770+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:35.287175+0000 front 2024-09-11T23:35:35.287164+0000 (oldest deadline 2024-09-11T23:36:01.186976+0000) 2024-09-11T23:36:24.251 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:23 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:23.770+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.288233+0000 front 2024-09-11T23:35:45.288257+0000 (oldest deadline 2024-09-11T23:36:09.988379+0000) 2024-09-11T23:36:24.251 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:23 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:23.770+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:54.590336+0000 front 2024-09-11T23:35:54.590569+0000 (oldest deadline 2024-09-11T23:36:18.690277+0000) 2024-09-11T23:36:24.384 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:24 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:24.316+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:34.129174+0000 front 2024-09-11T23:35:34.128995+0000 (oldest deadline 2024-09-11T23:36:04.129586+0000) 2024-09-11T23:36:24.385 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:24 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:24.316+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.830933+0000 front 2024-09-11T23:35:45.830844+0000 (oldest deadline 2024-09-11T23:36:13.431439+0000) 2024-09-11T23:36:24.385 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:24 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:24.316+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:53.932228+0000 front 2024-09-11T23:35:53.932202+0000 (oldest deadline 2024-09-11T23:36:18.032372+0000) 2024-09-11T23:36:24.418 DEBUG:teuthology.orchestra.run.smithi160:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8b03efce-7092-11ef-bcea-c7b262605968@osd.5.service' 2024-09-11T23:36:24.459 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T23:36:24.460 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-11T23:36:24.460 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-11T23:36:24.460 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ceph-8b03efce-7092-11ef-bcea-c7b262605968@osd.6 2024-09-11T23:36:24.514 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:24 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:24.198+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:33.392902+0000 front 2024-09-11T23:35:33.393259+0000 (oldest deadline 2024-09-11T23:35:59.793635+0000) 2024-09-11T23:36:24.515 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:24 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:24.198+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:46.696487+0000 front 2024-09-11T23:35:46.696550+0000 (oldest deadline 2024-09-11T23:36:12.596707+0000) 2024-09-11T23:36:24.515 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:24 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:24.198+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:52.597139+0000 front 2024-09-11T23:35:52.597169+0000 (oldest deadline 2024-09-11T23:36:18.497326+0000) 2024-09-11T23:36:24.683 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:24 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:24.607+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:37.277803+0000 front 2024-09-11T23:35:37.277821+0000 (oldest deadline 2024-09-11T23:36:00.777764+0000) 2024-09-11T23:36:24.683 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:24 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:24.607+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.478993+0000 front 2024-09-11T23:35:45.478970+0000 (oldest deadline 2024-09-11T23:36:08.379023+0000) 2024-09-11T23:36:24.683 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:24 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:24.607+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:55.980636+0000 front 2024-09-11T23:35:55.980669+0000 (oldest deadline 2024-09-11T23:36:18.880843+0000) 2024-09-11T23:36:24.814 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 11 23:36:24 smithi037 systemd[1]: Stopping Ceph osd.6 for 8b03efce-7092-11ef-bcea-c7b262605968... 2024-09-11T23:36:24.814 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 11 23:36:24 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-6[57869]: 2024-09-11T23:36:24.717+0000 7f4498e00640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.519792+0000 front 2024-09-11T23:35:45.519899+0000 (oldest deadline 2024-09-11T23:36:11.420000+0000) 2024-09-11T23:36:24.814 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 11 23:36:24 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-6[57869]: 2024-09-11T23:36:24.717+0000 7f4498e00640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:51.921756+0000 front 2024-09-11T23:35:51.921842+0000 (oldest deadline 2024-09-11T23:36:18.322897+0000) 2024-09-11T23:36:25.242 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 11 23:36:24 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-6[57869]: 2024-09-11T23:36:24.925+0000 7f44a2400640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T23:36:25.242 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 11 23:36:24 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-6[57869]: 2024-09-11T23:36:24.925+0000 7f44a2400640 -1 osd.6 99 *** Got signal Terminated *** 2024-09-11T23:36:25.242 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 11 23:36:24 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-6[57869]: 2024-09-11T23:36:24.925+0000 7f44a2400640 -1 osd.6 99 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T23:36:25.250 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 11 23:36:24 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-7[53549]: 2024-09-11T23:36:24.768+0000 7f58e9644640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:44.344227+0000 front 2024-09-11T23:35:44.344251+0000 (oldest deadline 2024-09-11T23:36:09.044354+0000) 2024-09-11T23:36:25.250 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 11 23:36:24 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-7[53549]: 2024-09-11T23:36:24.768+0000 7f58e9644640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:54.945348+0000 front 2024-09-11T23:35:54.945308+0000 (oldest deadline 2024-09-11T23:36:20.245466+0000) 2024-09-11T23:36:25.250 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:24 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:24.761+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:35.287175+0000 front 2024-09-11T23:35:35.287164+0000 (oldest deadline 2024-09-11T23:36:01.186976+0000) 2024-09-11T23:36:25.251 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:24 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:24.761+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.288233+0000 front 2024-09-11T23:35:45.288257+0000 (oldest deadline 2024-09-11T23:36:09.988379+0000) 2024-09-11T23:36:25.251 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:24 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:24.761+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:54.590336+0000 front 2024-09-11T23:35:54.590569+0000 (oldest deadline 2024-09-11T23:36:18.690277+0000) 2024-09-11T23:36:25.564 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:25 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:25.241+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:33.392902+0000 front 2024-09-11T23:35:33.393259+0000 (oldest deadline 2024-09-11T23:35:59.793635+0000) 2024-09-11T23:36:25.564 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:25 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:25.241+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:46.696487+0000 front 2024-09-11T23:35:46.696550+0000 (oldest deadline 2024-09-11T23:36:12.596707+0000) 2024-09-11T23:36:25.564 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:25 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:25.241+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:52.597139+0000 front 2024-09-11T23:35:52.597169+0000 (oldest deadline 2024-09-11T23:36:18.497326+0000) 2024-09-11T23:36:25.564 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:25 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:25.284+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:34.129174+0000 front 2024-09-11T23:35:34.128995+0000 (oldest deadline 2024-09-11T23:36:04.129586+0000) 2024-09-11T23:36:25.564 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:25 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:25.284+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.830933+0000 front 2024-09-11T23:35:45.830844+0000 (oldest deadline 2024-09-11T23:36:13.431439+0000) 2024-09-11T23:36:25.565 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:25 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:25.284+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:53.932228+0000 front 2024-09-11T23:35:53.932202+0000 (oldest deadline 2024-09-11T23:36:18.032372+0000) 2024-09-11T23:36:25.933 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:25 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:25.565+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:37.277803+0000 front 2024-09-11T23:35:37.277821+0000 (oldest deadline 2024-09-11T23:36:00.777764+0000) 2024-09-11T23:36:25.933 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:25 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:25.565+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.478993+0000 front 2024-09-11T23:35:45.478970+0000 (oldest deadline 2024-09-11T23:36:08.379023+0000) 2024-09-11T23:36:25.934 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:25 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:25.565+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:55.980636+0000 front 2024-09-11T23:35:55.980669+0000 (oldest deadline 2024-09-11T23:36:18.880843+0000) 2024-09-11T23:36:26.000 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 11 23:36:25 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-7[53549]: 2024-09-11T23:36:25.719+0000 7f58e9644640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:44.344227+0000 front 2024-09-11T23:35:44.344251+0000 (oldest deadline 2024-09-11T23:36:09.044354+0000) 2024-09-11T23:36:26.001 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 11 23:36:25 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-7[53549]: 2024-09-11T23:36:25.719+0000 7f58e9644640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:54.945348+0000 front 2024-09-11T23:35:54.945308+0000 (oldest deadline 2024-09-11T23:36:20.245466+0000) 2024-09-11T23:36:26.001 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:25 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:25.723+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:35.287175+0000 front 2024-09-11T23:35:35.287164+0000 (oldest deadline 2024-09-11T23:36:01.186976+0000) 2024-09-11T23:36:26.001 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:25 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:25.723+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.288233+0000 front 2024-09-11T23:35:45.288257+0000 (oldest deadline 2024-09-11T23:36:09.988379+0000) 2024-09-11T23:36:26.001 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:25 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:25.723+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:54.590336+0000 front 2024-09-11T23:35:54.590569+0000 (oldest deadline 2024-09-11T23:36:18.690277+0000) 2024-09-11T23:36:26.064 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 11 23:36:25 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-6[57869]: 2024-09-11T23:36:25.681+0000 7f4498e00640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.519792+0000 front 2024-09-11T23:35:45.519899+0000 (oldest deadline 2024-09-11T23:36:11.420000+0000) 2024-09-11T23:36:26.065 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 11 23:36:25 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-6[57869]: 2024-09-11T23:36:25.681+0000 7f4498e00640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:51.921756+0000 front 2024-09-11T23:35:51.921842+0000 (oldest deadline 2024-09-11T23:36:18.322897+0000) 2024-09-11T23:36:26.564 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:26 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:26.254+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:33.392902+0000 front 2024-09-11T23:35:33.393259+0000 (oldest deadline 2024-09-11T23:35:59.793635+0000) 2024-09-11T23:36:26.564 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:26 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:26.254+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:46.696487+0000 front 2024-09-11T23:35:46.696550+0000 (oldest deadline 2024-09-11T23:36:12.596707+0000) 2024-09-11T23:36:26.564 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:26 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:26.254+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:52.597139+0000 front 2024-09-11T23:35:52.597169+0000 (oldest deadline 2024-09-11T23:36:18.497326+0000) 2024-09-11T23:36:26.685 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:26 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:26.522+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:37.277803+0000 front 2024-09-11T23:35:37.277821+0000 (oldest deadline 2024-09-11T23:36:00.777764+0000) 2024-09-11T23:36:26.685 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:26 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:26.522+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.478993+0000 front 2024-09-11T23:35:45.478970+0000 (oldest deadline 2024-09-11T23:36:08.379023+0000) 2024-09-11T23:36:26.685 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:26 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:26.522+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:55.980636+0000 front 2024-09-11T23:35:55.980669+0000 (oldest deadline 2024-09-11T23:36:18.880843+0000) 2024-09-11T23:36:26.685 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:26 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:26.298+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:34.129174+0000 front 2024-09-11T23:35:34.128995+0000 (oldest deadline 2024-09-11T23:36:04.129586+0000) 2024-09-11T23:36:26.686 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:26 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:26.298+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.830933+0000 front 2024-09-11T23:35:45.830844+0000 (oldest deadline 2024-09-11T23:36:13.431439+0000) 2024-09-11T23:36:26.686 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:26 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:26.298+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:53.932228+0000 front 2024-09-11T23:35:53.932202+0000 (oldest deadline 2024-09-11T23:36:18.032372+0000) 2024-09-11T23:36:26.686 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:26 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:26.298+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-11T23:36:03.333416+0000 front 2024-09-11T23:36:03.333467+0000 (oldest deadline 2024-09-11T23:36:26.233354+0000) 2024-09-11T23:36:27.002 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 11 23:36:26 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-7[53549]: 2024-09-11T23:36:26.716+0000 7f58e9644640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:44.344227+0000 front 2024-09-11T23:35:44.344251+0000 (oldest deadline 2024-09-11T23:36:09.044354+0000) 2024-09-11T23:36:27.002 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 11 23:36:26 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-7[53549]: 2024-09-11T23:36:26.716+0000 7f58e9644640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:54.945348+0000 front 2024-09-11T23:35:54.945308+0000 (oldest deadline 2024-09-11T23:36:20.245466+0000) 2024-09-11T23:36:27.002 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:26 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:26.708+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:35.287175+0000 front 2024-09-11T23:35:35.287164+0000 (oldest deadline 2024-09-11T23:36:01.186976+0000) 2024-09-11T23:36:27.002 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:26 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:26.708+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.288233+0000 front 2024-09-11T23:35:45.288257+0000 (oldest deadline 2024-09-11T23:36:09.988379+0000) 2024-09-11T23:36:27.003 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:26 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:26.708+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:54.590336+0000 front 2024-09-11T23:35:54.590569+0000 (oldest deadline 2024-09-11T23:36:18.690277+0000) 2024-09-11T23:36:27.064 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 11 23:36:26 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-6[57869]: 2024-09-11T23:36:26.647+0000 7f4498e00640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.519792+0000 front 2024-09-11T23:35:45.519899+0000 (oldest deadline 2024-09-11T23:36:11.420000+0000) 2024-09-11T23:36:27.064 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 11 23:36:26 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-6[57869]: 2024-09-11T23:36:26.647+0000 7f4498e00640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:51.921756+0000 front 2024-09-11T23:35:51.921842+0000 (oldest deadline 2024-09-11T23:36:18.322897+0000) 2024-09-11T23:36:27.564 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:27 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:27.277+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:33.392902+0000 front 2024-09-11T23:35:33.393259+0000 (oldest deadline 2024-09-11T23:35:59.793635+0000) 2024-09-11T23:36:27.564 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:27 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:27.277+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:46.696487+0000 front 2024-09-11T23:35:46.696550+0000 (oldest deadline 2024-09-11T23:36:12.596707+0000) 2024-09-11T23:36:27.564 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:27 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:27.277+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:52.597139+0000 front 2024-09-11T23:35:52.597169+0000 (oldest deadline 2024-09-11T23:36:18.497326+0000) 2024-09-11T23:36:27.564 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:27 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:27.277+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-11T23:36:03.198553+0000 front 2024-09-11T23:36:03.198476+0000 (oldest deadline 2024-09-11T23:36:27.199197+0000) 2024-09-11T23:36:27.683 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:27 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:27.563+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:37.277803+0000 front 2024-09-11T23:35:37.277821+0000 (oldest deadline 2024-09-11T23:36:00.777764+0000) 2024-09-11T23:36:27.684 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:27 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:27.563+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.478993+0000 front 2024-09-11T23:35:45.478970+0000 (oldest deadline 2024-09-11T23:36:08.379023+0000) 2024-09-11T23:36:27.684 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:27 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:27.563+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:55.980636+0000 front 2024-09-11T23:35:55.980669+0000 (oldest deadline 2024-09-11T23:36:18.880843+0000) 2024-09-11T23:36:27.684 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:27 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:27.329+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:34.129174+0000 front 2024-09-11T23:35:34.128995+0000 (oldest deadline 2024-09-11T23:36:04.129586+0000) 2024-09-11T23:36:27.684 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:27 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:27.329+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.830933+0000 front 2024-09-11T23:35:45.830844+0000 (oldest deadline 2024-09-11T23:36:13.431439+0000) 2024-09-11T23:36:27.685 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:27 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:27.329+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:53.932228+0000 front 2024-09-11T23:35:53.932202+0000 (oldest deadline 2024-09-11T23:36:18.032372+0000) 2024-09-11T23:36:27.685 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:27 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:27.329+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-11T23:36:03.333416+0000 front 2024-09-11T23:36:03.333467+0000 (oldest deadline 2024-09-11T23:36:26.233354+0000) 2024-09-11T23:36:28.000 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 11 23:36:27 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-7[53549]: 2024-09-11T23:36:27.736+0000 7f58e9644640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:44.344227+0000 front 2024-09-11T23:35:44.344251+0000 (oldest deadline 2024-09-11T23:36:09.044354+0000) 2024-09-11T23:36:28.001 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 11 23:36:27 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-7[53549]: 2024-09-11T23:36:27.736+0000 7f58e9644640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:54.945348+0000 front 2024-09-11T23:35:54.945308+0000 (oldest deadline 2024-09-11T23:36:20.245466+0000) 2024-09-11T23:36:28.001 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:27 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:27.716+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:35.287175+0000 front 2024-09-11T23:35:35.287164+0000 (oldest deadline 2024-09-11T23:36:01.186976+0000) 2024-09-11T23:36:28.001 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:27 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:27.716+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.288233+0000 front 2024-09-11T23:35:45.288257+0000 (oldest deadline 2024-09-11T23:36:09.988379+0000) 2024-09-11T23:36:28.001 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:27 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:27.716+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:54.590336+0000 front 2024-09-11T23:35:54.590569+0000 (oldest deadline 2024-09-11T23:36:18.690277+0000) 2024-09-11T23:36:28.001 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:27 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:27.716+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-11T23:36:04.591561+0000 front 2024-09-11T23:36:04.591535+0000 (oldest deadline 2024-09-11T23:36:26.891405+0000) 2024-09-11T23:36:28.064 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 11 23:36:27 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-6[57869]: 2024-09-11T23:36:27.677+0000 7f4498e00640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.519792+0000 front 2024-09-11T23:35:45.519899+0000 (oldest deadline 2024-09-11T23:36:11.420000+0000) 2024-09-11T23:36:28.064 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 11 23:36:27 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-6[57869]: 2024-09-11T23:36:27.677+0000 7f4498e00640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:51.921756+0000 front 2024-09-11T23:35:51.921842+0000 (oldest deadline 2024-09-11T23:36:18.322897+0000) 2024-09-11T23:36:28.564 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:28 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:28.291+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:33.392902+0000 front 2024-09-11T23:35:33.393259+0000 (oldest deadline 2024-09-11T23:35:59.793635+0000) 2024-09-11T23:36:28.564 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:28 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:28.291+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:46.696487+0000 front 2024-09-11T23:35:46.696550+0000 (oldest deadline 2024-09-11T23:36:12.596707+0000) 2024-09-11T23:36:28.564 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:28 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:28.291+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:52.597139+0000 front 2024-09-11T23:35:52.597169+0000 (oldest deadline 2024-09-11T23:36:18.497326+0000) 2024-09-11T23:36:28.564 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:28 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:28.291+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-11T23:36:03.198553+0000 front 2024-09-11T23:36:03.198476+0000 (oldest deadline 2024-09-11T23:36:27.199197+0000) 2024-09-11T23:36:28.683 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:28 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:28.526+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:37.277803+0000 front 2024-09-11T23:35:37.277821+0000 (oldest deadline 2024-09-11T23:36:00.777764+0000) 2024-09-11T23:36:28.683 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:28 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:28.526+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.478993+0000 front 2024-09-11T23:35:45.478970+0000 (oldest deadline 2024-09-11T23:36:08.379023+0000) 2024-09-11T23:36:28.683 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:28 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:28.526+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:55.980636+0000 front 2024-09-11T23:35:55.980669+0000 (oldest deadline 2024-09-11T23:36:18.880843+0000) 2024-09-11T23:36:28.684 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:28 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:28.308+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:34.129174+0000 front 2024-09-11T23:35:34.128995+0000 (oldest deadline 2024-09-11T23:36:04.129586+0000) 2024-09-11T23:36:28.684 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:28 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:28.308+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.830933+0000 front 2024-09-11T23:35:45.830844+0000 (oldest deadline 2024-09-11T23:36:13.431439+0000) 2024-09-11T23:36:28.684 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:28 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:28.308+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:53.932228+0000 front 2024-09-11T23:35:53.932202+0000 (oldest deadline 2024-09-11T23:36:18.032372+0000) 2024-09-11T23:36:28.684 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:28 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:28.308+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-11T23:36:03.333416+0000 front 2024-09-11T23:36:03.333467+0000 (oldest deadline 2024-09-11T23:36:26.233354+0000) 2024-09-11T23:36:29.000 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 11 23:36:28 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-7[53549]: 2024-09-11T23:36:28.732+0000 7f58e9644640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:44.344227+0000 front 2024-09-11T23:35:44.344251+0000 (oldest deadline 2024-09-11T23:36:09.044354+0000) 2024-09-11T23:36:29.000 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 11 23:36:28 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-7[53549]: 2024-09-11T23:36:28.732+0000 7f58e9644640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:54.945348+0000 front 2024-09-11T23:35:54.945308+0000 (oldest deadline 2024-09-11T23:36:20.245466+0000) 2024-09-11T23:36:29.001 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 11 23:36:28 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-7[53549]: 2024-09-11T23:36:28.732+0000 7f58e9644640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-11T23:36:03.746532+0000 front 2024-09-11T23:36:03.746421+0000 (oldest deadline 2024-09-11T23:36:27.846542+0000) 2024-09-11T23:36:29.001 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:28 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:28.723+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:35.287175+0000 front 2024-09-11T23:35:35.287164+0000 (oldest deadline 2024-09-11T23:36:01.186976+0000) 2024-09-11T23:36:29.001 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:28 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:28.723+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.288233+0000 front 2024-09-11T23:35:45.288257+0000 (oldest deadline 2024-09-11T23:36:09.988379+0000) 2024-09-11T23:36:29.001 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:28 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:28.723+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:54.590336+0000 front 2024-09-11T23:35:54.590569+0000 (oldest deadline 2024-09-11T23:36:18.690277+0000) 2024-09-11T23:36:29.001 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:28 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:28.723+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-11T23:36:04.591561+0000 front 2024-09-11T23:36:04.591535+0000 (oldest deadline 2024-09-11T23:36:26.891405+0000) 2024-09-11T23:36:29.064 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 11 23:36:28 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-6[57869]: 2024-09-11T23:36:28.688+0000 7f4498e00640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.519792+0000 front 2024-09-11T23:35:45.519899+0000 (oldest deadline 2024-09-11T23:36:11.420000+0000) 2024-09-11T23:36:29.064 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 11 23:36:28 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-6[57869]: 2024-09-11T23:36:28.688+0000 7f4498e00640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:51.921756+0000 front 2024-09-11T23:35:51.921842+0000 (oldest deadline 2024-09-11T23:36:18.322897+0000) 2024-09-11T23:36:29.564 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:29 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:29.268+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:33.392902+0000 front 2024-09-11T23:35:33.393259+0000 (oldest deadline 2024-09-11T23:35:59.793635+0000) 2024-09-11T23:36:29.564 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:29 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:29.268+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:46.696487+0000 front 2024-09-11T23:35:46.696550+0000 (oldest deadline 2024-09-11T23:36:12.596707+0000) 2024-09-11T23:36:29.564 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:29 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:29.268+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:52.597139+0000 front 2024-09-11T23:35:52.597169+0000 (oldest deadline 2024-09-11T23:36:18.497326+0000) 2024-09-11T23:36:29.564 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:29 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:29.268+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-11T23:36:03.198553+0000 front 2024-09-11T23:36:03.198476+0000 (oldest deadline 2024-09-11T23:36:27.199197+0000) 2024-09-11T23:36:29.567 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:29 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:29.314+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:34.129174+0000 front 2024-09-11T23:35:34.128995+0000 (oldest deadline 2024-09-11T23:36:04.129586+0000) 2024-09-11T23:36:29.567 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:29 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:29.314+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.830933+0000 front 2024-09-11T23:35:45.830844+0000 (oldest deadline 2024-09-11T23:36:13.431439+0000) 2024-09-11T23:36:29.567 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:29 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:29.314+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:53.932228+0000 front 2024-09-11T23:35:53.932202+0000 (oldest deadline 2024-09-11T23:36:18.032372+0000) 2024-09-11T23:36:29.568 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:29 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:29.314+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-11T23:36:03.333416+0000 front 2024-09-11T23:36:03.333467+0000 (oldest deadline 2024-09-11T23:36:26.233354+0000) 2024-09-11T23:36:29.933 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:29 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:29.567+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:37.277803+0000 front 2024-09-11T23:35:37.277821+0000 (oldest deadline 2024-09-11T23:36:00.777764+0000) 2024-09-11T23:36:29.933 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:29 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:29.567+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.478993+0000 front 2024-09-11T23:35:45.478970+0000 (oldest deadline 2024-09-11T23:36:08.379023+0000) 2024-09-11T23:36:29.933 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:29 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:29.567+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:55.980636+0000 front 2024-09-11T23:35:55.980669+0000 (oldest deadline 2024-09-11T23:36:18.880843+0000) 2024-09-11T23:36:30.000 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 11 23:36:29 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-7[53549]: 2024-09-11T23:36:29.731+0000 7f58e9644640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:44.344227+0000 front 2024-09-11T23:35:44.344251+0000 (oldest deadline 2024-09-11T23:36:09.044354+0000) 2024-09-11T23:36:30.001 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 11 23:36:29 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-7[53549]: 2024-09-11T23:36:29.731+0000 7f58e9644640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:54.945348+0000 front 2024-09-11T23:35:54.945308+0000 (oldest deadline 2024-09-11T23:36:20.245466+0000) 2024-09-11T23:36:30.001 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 11 23:36:29 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-7[53549]: 2024-09-11T23:36:29.731+0000 7f58e9644640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-11T23:36:03.746532+0000 front 2024-09-11T23:36:03.746421+0000 (oldest deadline 2024-09-11T23:36:27.846542+0000) 2024-09-11T23:36:30.001 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:29 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:29.756+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:35.287175+0000 front 2024-09-11T23:35:35.287164+0000 (oldest deadline 2024-09-11T23:36:01.186976+0000) 2024-09-11T23:36:30.001 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:29 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:29.756+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.288233+0000 front 2024-09-11T23:35:45.288257+0000 (oldest deadline 2024-09-11T23:36:09.988379+0000) 2024-09-11T23:36:30.001 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:29 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:29.756+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:54.590336+0000 front 2024-09-11T23:35:54.590569+0000 (oldest deadline 2024-09-11T23:36:18.690277+0000) 2024-09-11T23:36:30.001 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:29 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:29.756+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-11T23:36:04.591561+0000 front 2024-09-11T23:36:04.591535+0000 (oldest deadline 2024-09-11T23:36:26.891405+0000) 2024-09-11T23:36:30.064 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 11 23:36:29 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-6[57869]: 2024-09-11T23:36:29.718+0000 7f4498e00640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.519792+0000 front 2024-09-11T23:35:45.519899+0000 (oldest deadline 2024-09-11T23:36:11.420000+0000) 2024-09-11T23:36:30.064 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 11 23:36:29 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-6[57869]: 2024-09-11T23:36:29.718+0000 7f4498e00640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:51.921756+0000 front 2024-09-11T23:35:51.921842+0000 (oldest deadline 2024-09-11T23:36:18.322897+0000) 2024-09-11T23:36:30.064 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 11 23:36:29 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-6[57869]: 2024-09-11T23:36:29.718+0000 7f4498e00640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-11T23:36:03.525477+0000 front 2024-09-11T23:36:03.525510+0000 (oldest deadline 2024-09-11T23:36:28.726806+0000) 2024-09-11T23:36:30.404 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:30 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:30.223+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:33.392902+0000 front 2024-09-11T23:35:33.393259+0000 (oldest deadline 2024-09-11T23:35:59.793635+0000) 2024-09-11T23:36:30.405 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:30 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:30.223+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:46.696487+0000 front 2024-09-11T23:35:46.696550+0000 (oldest deadline 2024-09-11T23:36:12.596707+0000) 2024-09-11T23:36:30.405 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:30 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:30.223+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:52.597139+0000 front 2024-09-11T23:35:52.597169+0000 (oldest deadline 2024-09-11T23:36:18.497326+0000) 2024-09-11T23:36:30.405 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:30 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:30.223+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-11T23:36:03.198553+0000 front 2024-09-11T23:36:03.198476+0000 (oldest deadline 2024-09-11T23:36:27.199197+0000) 2024-09-11T23:36:30.683 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:30 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:30.323+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:34.129174+0000 front 2024-09-11T23:35:34.128995+0000 (oldest deadline 2024-09-11T23:36:04.129586+0000) 2024-09-11T23:36:30.684 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:30 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:30.323+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.830933+0000 front 2024-09-11T23:35:45.830844+0000 (oldest deadline 2024-09-11T23:36:13.431439+0000) 2024-09-11T23:36:30.684 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:30 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:30.323+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:53.932228+0000 front 2024-09-11T23:35:53.932202+0000 (oldest deadline 2024-09-11T23:36:18.032372+0000) 2024-09-11T23:36:30.684 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:30 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:30.323+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-11T23:36:03.333416+0000 front 2024-09-11T23:36:03.333467+0000 (oldest deadline 2024-09-11T23:36:26.233354+0000) 2024-09-11T23:36:30.684 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:30 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:30.534+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:37.277803+0000 front 2024-09-11T23:35:37.277821+0000 (oldest deadline 2024-09-11T23:36:00.777764+0000) 2024-09-11T23:36:30.684 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:30 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:30.534+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.478993+0000 front 2024-09-11T23:35:45.478970+0000 (oldest deadline 2024-09-11T23:36:08.379023+0000) 2024-09-11T23:36:30.684 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:30 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:30.534+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:55.980636+0000 front 2024-09-11T23:35:55.980669+0000 (oldest deadline 2024-09-11T23:36:18.880843+0000) 2024-09-11T23:36:30.740 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 11 23:36:30 smithi037 podman[90624]: 2024-09-11 23:36:30.624168395 +0000 UTC m=+5.868870239 container stop e1a6ed77222aa8d152812fc485d0ec6d18342458143f771c5b96a0b686274646 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-6, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T23:36:30.740 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 11 23:36:30 smithi037 podman[90624]: 2024-09-11 23:36:30.652828047 +0000 UTC m=+5.897529914 container died e1a6ed77222aa8d152812fc485d0ec6d18342458143f771c5b96a0b686274646 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-6, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD) 2024-09-11T23:36:31.000 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 11 23:36:30 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-7[53549]: 2024-09-11T23:36:30.713+0000 7f58e9644640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:44.344227+0000 front 2024-09-11T23:35:44.344251+0000 (oldest deadline 2024-09-11T23:36:09.044354+0000) 2024-09-11T23:36:31.001 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 11 23:36:30 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-7[53549]: 2024-09-11T23:36:30.713+0000 7f58e9644640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:54.945348+0000 front 2024-09-11T23:35:54.945308+0000 (oldest deadline 2024-09-11T23:36:20.245466+0000) 2024-09-11T23:36:31.001 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 11 23:36:30 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-7[53549]: 2024-09-11T23:36:30.713+0000 7f58e9644640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-11T23:36:03.746532+0000 front 2024-09-11T23:36:03.746421+0000 (oldest deadline 2024-09-11T23:36:27.846542+0000) 2024-09-11T23:36:31.001 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:30 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:30.741+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:35.287175+0000 front 2024-09-11T23:35:35.287164+0000 (oldest deadline 2024-09-11T23:36:01.186976+0000) 2024-09-11T23:36:31.001 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:30 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:30.741+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.288233+0000 front 2024-09-11T23:35:45.288257+0000 (oldest deadline 2024-09-11T23:36:09.988379+0000) 2024-09-11T23:36:31.001 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:30 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:30.741+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:54.590336+0000 front 2024-09-11T23:35:54.590569+0000 (oldest deadline 2024-09-11T23:36:18.690277+0000) 2024-09-11T23:36:31.001 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:30 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:30.741+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-11T23:36:04.591561+0000 front 2024-09-11T23:36:04.591535+0000 (oldest deadline 2024-09-11T23:36:26.891405+0000) 2024-09-11T23:36:31.314 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 11 23:36:31 smithi037 podman[90624]: 2024-09-11 23:36:31.039141053 +0000 UTC m=+6.283842910 container cleanup e1a6ed77222aa8d152812fc485d0ec6d18342458143f771c5b96a0b686274646 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-6, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-11T23:36:31.314 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 11 23:36:31 smithi037 bash[90624]: ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-6 2024-09-11T23:36:31.314 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:31 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:31.236+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:33.392902+0000 front 2024-09-11T23:35:33.393259+0000 (oldest deadline 2024-09-11T23:35:59.793635+0000) 2024-09-11T23:36:31.314 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:31 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:31.236+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:46.696487+0000 front 2024-09-11T23:35:46.696550+0000 (oldest deadline 2024-09-11T23:36:12.596707+0000) 2024-09-11T23:36:31.314 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:31 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:31.236+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:52.597139+0000 front 2024-09-11T23:35:52.597169+0000 (oldest deadline 2024-09-11T23:36:18.497326+0000) 2024-09-11T23:36:31.314 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:31 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:31.236+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-11T23:36:03.198553+0000 front 2024-09-11T23:36:03.198476+0000 (oldest deadline 2024-09-11T23:36:27.199197+0000) 2024-09-11T23:36:31.624 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 11 23:36:31 smithi037 podman[90644]: 2024-09-11 23:36:31.323792172 +0000 UTC m=+0.685334952 container remove e1a6ed77222aa8d152812fc485d0ec6d18342458143f771c5b96a0b686274646 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-6, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T23:36:31.683 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:31 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:31.339+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:34.129174+0000 front 2024-09-11T23:35:34.128995+0000 (oldest deadline 2024-09-11T23:36:04.129586+0000) 2024-09-11T23:36:31.683 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:31 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:31.339+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.830933+0000 front 2024-09-11T23:35:45.830844+0000 (oldest deadline 2024-09-11T23:36:13.431439+0000) 2024-09-11T23:36:31.683 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:31 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:31.339+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:53.932228+0000 front 2024-09-11T23:35:53.932202+0000 (oldest deadline 2024-09-11T23:36:18.032372+0000) 2024-09-11T23:36:31.684 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:31 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:31.339+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-11T23:36:03.333416+0000 front 2024-09-11T23:36:03.333467+0000 (oldest deadline 2024-09-11T23:36:26.233354+0000) 2024-09-11T23:36:31.684 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:31 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:31.579+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:37.277803+0000 front 2024-09-11T23:35:37.277821+0000 (oldest deadline 2024-09-11T23:36:00.777764+0000) 2024-09-11T23:36:31.684 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:31 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:31.579+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.478993+0000 front 2024-09-11T23:35:45.478970+0000 (oldest deadline 2024-09-11T23:36:08.379023+0000) 2024-09-11T23:36:31.684 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:31 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:31.579+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:55.980636+0000 front 2024-09-11T23:35:55.980669+0000 (oldest deadline 2024-09-11T23:36:18.880843+0000) 2024-09-11T23:36:31.939 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 11 23:36:31 smithi037 podman[90736]: 2024-09-11 23:36:31.673161574 +0000 UTC m=+0.026991011 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T23:36:31.939 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 11 23:36:31 smithi037 podman[90736]: 2024-09-11 23:36:31.825011224 +0000 UTC m=+0.178840660 container create ef16663d138717da9e6f167f2a74400cd6148cfc903a94e511d8c910fff6501f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-6-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731) 2024-09-11T23:36:32.247 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 11 23:36:32 smithi037 podman[90736]: 2024-09-11 23:36:32.044020565 +0000 UTC m=+0.397850003 container init ef16663d138717da9e6f167f2a74400cd6148cfc903a94e511d8c910fff6501f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-6-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3) 2024-09-11T23:36:32.247 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 11 23:36:32 smithi037 podman[90736]: 2024-09-11 23:36:32.050903658 +0000 UTC m=+0.404733100 container start ef16663d138717da9e6f167f2a74400cd6148cfc903a94e511d8c910fff6501f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-6-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS) 2024-09-11T23:36:32.247 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 11 23:36:32 smithi037 podman[90736]: 2024-09-11 23:36:32.143882639 +0000 UTC m=+0.497712099 container attach ef16663d138717da9e6f167f2a74400cd6148cfc903a94e511d8c910fff6501f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-6-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-11T23:36:32.250 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 11 23:36:31 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-7[53549]: 2024-09-11T23:36:31.761+0000 7f58e9644640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:44.344227+0000 front 2024-09-11T23:35:44.344251+0000 (oldest deadline 2024-09-11T23:36:09.044354+0000) 2024-09-11T23:36:32.250 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 11 23:36:31 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-7[53549]: 2024-09-11T23:36:31.761+0000 7f58e9644640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:54.945348+0000 front 2024-09-11T23:35:54.945308+0000 (oldest deadline 2024-09-11T23:36:20.245466+0000) 2024-09-11T23:36:32.250 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 11 23:36:31 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-7[53549]: 2024-09-11T23:36:31.761+0000 7f58e9644640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-11T23:36:03.746532+0000 front 2024-09-11T23:36:03.746421+0000 (oldest deadline 2024-09-11T23:36:27.846542+0000) 2024-09-11T23:36:32.251 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:31 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:31.775+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:35.287175+0000 front 2024-09-11T23:35:35.287164+0000 (oldest deadline 2024-09-11T23:36:01.186976+0000) 2024-09-11T23:36:32.251 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:31 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:31.775+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.288233+0000 front 2024-09-11T23:35:45.288257+0000 (oldest deadline 2024-09-11T23:36:09.988379+0000) 2024-09-11T23:36:32.251 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:31 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:31.775+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:54.590336+0000 front 2024-09-11T23:35:54.590569+0000 (oldest deadline 2024-09-11T23:36:18.690277+0000) 2024-09-11T23:36:32.251 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:31 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:31.775+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-11T23:36:04.591561+0000 front 2024-09-11T23:36:04.591535+0000 (oldest deadline 2024-09-11T23:36:26.891405+0000) 2024-09-11T23:36:32.564 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 11 23:36:32 smithi037 podman[90736]: 2024-09-11 23:36:32.330850352 +0000 UTC m=+0.684679790 container died ef16663d138717da9e6f167f2a74400cd6148cfc903a94e511d8c910fff6501f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-6-deactivate, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T23:36:32.564 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:32 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:32.246+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:33.392902+0000 front 2024-09-11T23:35:33.393259+0000 (oldest deadline 2024-09-11T23:35:59.793635+0000) 2024-09-11T23:36:32.564 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:32 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:32.246+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:46.696487+0000 front 2024-09-11T23:35:46.696550+0000 (oldest deadline 2024-09-11T23:36:12.596707+0000) 2024-09-11T23:36:32.564 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:32 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:32.246+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:52.597139+0000 front 2024-09-11T23:35:52.597169+0000 (oldest deadline 2024-09-11T23:36:18.497326+0000) 2024-09-11T23:36:32.564 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:32 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:32.246+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-11T23:36:03.198553+0000 front 2024-09-11T23:36:03.198476+0000 (oldest deadline 2024-09-11T23:36:27.199197+0000) 2024-09-11T23:36:32.683 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:32 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:32.343+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:34.129174+0000 front 2024-09-11T23:35:34.128995+0000 (oldest deadline 2024-09-11T23:36:04.129586+0000) 2024-09-11T23:36:32.683 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:32 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:32.343+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.830933+0000 front 2024-09-11T23:35:45.830844+0000 (oldest deadline 2024-09-11T23:36:13.431439+0000) 2024-09-11T23:36:32.684 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:32 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:32.343+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:53.932228+0000 front 2024-09-11T23:35:53.932202+0000 (oldest deadline 2024-09-11T23:36:18.032372+0000) 2024-09-11T23:36:32.684 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:32 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:32.343+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-11T23:36:03.333416+0000 front 2024-09-11T23:36:03.333467+0000 (oldest deadline 2024-09-11T23:36:26.233354+0000) 2024-09-11T23:36:32.684 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:32 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:32.545+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:37.277803+0000 front 2024-09-11T23:35:37.277821+0000 (oldest deadline 2024-09-11T23:36:00.777764+0000) 2024-09-11T23:36:32.684 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:32 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:32.545+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.478993+0000 front 2024-09-11T23:35:45.478970+0000 (oldest deadline 2024-09-11T23:36:08.379023+0000) 2024-09-11T23:36:32.684 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:32 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:32.545+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:55.980636+0000 front 2024-09-11T23:35:55.980669+0000 (oldest deadline 2024-09-11T23:36:18.880843+0000) 2024-09-11T23:36:33.000 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 11 23:36:32 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-7[53549]: 2024-09-11T23:36:32.750+0000 7f58e9644640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:44.344227+0000 front 2024-09-11T23:35:44.344251+0000 (oldest deadline 2024-09-11T23:36:09.044354+0000) 2024-09-11T23:36:33.001 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 11 23:36:32 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-7[53549]: 2024-09-11T23:36:32.750+0000 7f58e9644640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:54.945348+0000 front 2024-09-11T23:35:54.945308+0000 (oldest deadline 2024-09-11T23:36:20.245466+0000) 2024-09-11T23:36:33.001 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 11 23:36:32 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-7[53549]: 2024-09-11T23:36:32.750+0000 7f58e9644640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-11T23:36:03.746532+0000 front 2024-09-11T23:36:03.746421+0000 (oldest deadline 2024-09-11T23:36:27.846542+0000) 2024-09-11T23:36:33.001 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:32 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:32.816+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:35.287175+0000 front 2024-09-11T23:35:35.287164+0000 (oldest deadline 2024-09-11T23:36:01.186976+0000) 2024-09-11T23:36:33.001 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:32 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:32.816+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.288233+0000 front 2024-09-11T23:35:45.288257+0000 (oldest deadline 2024-09-11T23:36:09.988379+0000) 2024-09-11T23:36:33.001 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:32 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:32.816+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:54.590336+0000 front 2024-09-11T23:35:54.590569+0000 (oldest deadline 2024-09-11T23:36:18.690277+0000) 2024-09-11T23:36:33.001 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:32 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:32.816+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-11T23:36:04.591561+0000 front 2024-09-11T23:36:04.591535+0000 (oldest deadline 2024-09-11T23:36:26.891405+0000) 2024-09-11T23:36:33.082 DEBUG:teuthology.orchestra.run.smithi037:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8b03efce-7092-11ef-bcea-c7b262605968@osd.6.service' 2024-09-11T23:36:33.159 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T23:36:33.160 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-11T23:36:33.160 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-11T23:36:33.160 DEBUG:teuthology.orchestra.run.smithi123:> sudo systemctl stop ceph-8b03efce-7092-11ef-bcea-c7b262605968@osd.7 2024-09-11T23:36:33.314 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:33 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:33.273+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:33.392902+0000 front 2024-09-11T23:35:33.393259+0000 (oldest deadline 2024-09-11T23:35:59.793635+0000) 2024-09-11T23:36:33.314 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:33 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:33.273+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:46.696487+0000 front 2024-09-11T23:35:46.696550+0000 (oldest deadline 2024-09-11T23:36:12.596707+0000) 2024-09-11T23:36:33.314 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:33 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:33.273+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:52.597139+0000 front 2024-09-11T23:35:52.597169+0000 (oldest deadline 2024-09-11T23:36:18.497326+0000) 2024-09-11T23:36:33.314 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:33 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:33.273+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-11T23:36:03.198553+0000 front 2024-09-11T23:36:03.198476+0000 (oldest deadline 2024-09-11T23:36:27.199197+0000) 2024-09-11T23:36:33.478 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 11 23:36:33 smithi123 systemd[1]: Stopping Ceph osd.7 for 8b03efce-7092-11ef-bcea-c7b262605968... 2024-09-11T23:36:33.592 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:33 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:33.302+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:34.129174+0000 front 2024-09-11T23:35:34.128995+0000 (oldest deadline 2024-09-11T23:36:04.129586+0000) 2024-09-11T23:36:33.593 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:33 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:33.302+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.830933+0000 front 2024-09-11T23:35:45.830844+0000 (oldest deadline 2024-09-11T23:36:13.431439+0000) 2024-09-11T23:36:33.593 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:33 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:33.302+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:53.932228+0000 front 2024-09-11T23:35:53.932202+0000 (oldest deadline 2024-09-11T23:36:18.032372+0000) 2024-09-11T23:36:33.593 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:33 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:33.302+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-11T23:36:03.333416+0000 front 2024-09-11T23:36:03.333467+0000 (oldest deadline 2024-09-11T23:36:26.233354+0000) 2024-09-11T23:36:33.729 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 11 23:36:33 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-7[53549]: 2024-09-11T23:36:33.478+0000 7f58f1036640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T23:36:33.729 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 11 23:36:33 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-7[53549]: 2024-09-11T23:36:33.478+0000 7f58f1036640 -1 osd.7 99 *** Got signal Terminated *** 2024-09-11T23:36:33.730 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 11 23:36:33 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-7[53549]: 2024-09-11T23:36:33.478+0000 7f58f1036640 -1 osd.7 99 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T23:36:33.730 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 11 23:36:33 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-7[53549]: 2024-09-11T23:36:33.730+0000 7f58e9644640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:44.344227+0000 front 2024-09-11T23:35:44.344251+0000 (oldest deadline 2024-09-11T23:36:09.044354+0000) 2024-09-11T23:36:33.730 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 11 23:36:33 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-7[53549]: 2024-09-11T23:36:33.730+0000 7f58e9644640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:54.945348+0000 front 2024-09-11T23:35:54.945308+0000 (oldest deadline 2024-09-11T23:36:20.245466+0000) 2024-09-11T23:36:33.730 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 11 23:36:33 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-7[53549]: 2024-09-11T23:36:33.730+0000 7f58e9644640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-11T23:36:03.746532+0000 front 2024-09-11T23:36:03.746421+0000 (oldest deadline 2024-09-11T23:36:27.846542+0000) 2024-09-11T23:36:33.933 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:33 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:33.593+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:37.277803+0000 front 2024-09-11T23:35:37.277821+0000 (oldest deadline 2024-09-11T23:36:00.777764+0000) 2024-09-11T23:36:33.933 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:33 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:33.593+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.478993+0000 front 2024-09-11T23:35:45.478970+0000 (oldest deadline 2024-09-11T23:36:08.379023+0000) 2024-09-11T23:36:33.933 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:33 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:33.593+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:55.980636+0000 front 2024-09-11T23:35:55.980669+0000 (oldest deadline 2024-09-11T23:36:18.880843+0000) 2024-09-11T23:36:34.000 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:33 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:33.828+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:35.287175+0000 front 2024-09-11T23:35:35.287164+0000 (oldest deadline 2024-09-11T23:36:01.186976+0000) 2024-09-11T23:36:34.000 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:33 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:33.828+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.288233+0000 front 2024-09-11T23:35:45.288257+0000 (oldest deadline 2024-09-11T23:36:09.988379+0000) 2024-09-11T23:36:34.001 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:33 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:33.828+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:54.590336+0000 front 2024-09-11T23:35:54.590569+0000 (oldest deadline 2024-09-11T23:36:18.690277+0000) 2024-09-11T23:36:34.001 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:33 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:33.828+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-11T23:36:04.591561+0000 front 2024-09-11T23:36:04.591535+0000 (oldest deadline 2024-09-11T23:36:26.891405+0000) 2024-09-11T23:36:34.564 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:34 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:34.303+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:33.392902+0000 front 2024-09-11T23:35:33.393259+0000 (oldest deadline 2024-09-11T23:35:59.793635+0000) 2024-09-11T23:36:34.564 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:34 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:34.303+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:46.696487+0000 front 2024-09-11T23:35:46.696550+0000 (oldest deadline 2024-09-11T23:36:12.596707+0000) 2024-09-11T23:36:34.564 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:34 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:34.303+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:52.597139+0000 front 2024-09-11T23:35:52.597169+0000 (oldest deadline 2024-09-11T23:36:18.497326+0000) 2024-09-11T23:36:34.564 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:34 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:34.303+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-11T23:36:03.198553+0000 front 2024-09-11T23:36:03.198476+0000 (oldest deadline 2024-09-11T23:36:27.199197+0000) 2024-09-11T23:36:34.564 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:34 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:34.303+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-11T23:36:11.300666+0000 front 2024-09-11T23:36:11.300802+0000 (oldest deadline 2024-09-11T23:36:34.200458+0000) 2024-09-11T23:36:34.683 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:34 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:34.549+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:37.277803+0000 front 2024-09-11T23:35:37.277821+0000 (oldest deadline 2024-09-11T23:36:00.777764+0000) 2024-09-11T23:36:34.683 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:34 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:34.549+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.478993+0000 front 2024-09-11T23:35:45.478970+0000 (oldest deadline 2024-09-11T23:36:08.379023+0000) 2024-09-11T23:36:34.683 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:34 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:34.549+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:55.980636+0000 front 2024-09-11T23:35:55.980669+0000 (oldest deadline 2024-09-11T23:36:18.880843+0000) 2024-09-11T23:36:34.683 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:34 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:34.549+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-11T23:36:12.486674+0000 front 2024-09-11T23:36:12.486576+0000 (oldest deadline 2024-09-11T23:36:34.186664+0000) 2024-09-11T23:36:34.684 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:34 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:34.333+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:34.129174+0000 front 2024-09-11T23:35:34.128995+0000 (oldest deadline 2024-09-11T23:36:04.129586+0000) 2024-09-11T23:36:34.684 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:34 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:34.333+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.830933+0000 front 2024-09-11T23:35:45.830844+0000 (oldest deadline 2024-09-11T23:36:13.431439+0000) 2024-09-11T23:36:34.684 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:34 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:34.333+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:53.932228+0000 front 2024-09-11T23:35:53.932202+0000 (oldest deadline 2024-09-11T23:36:18.032372+0000) 2024-09-11T23:36:34.684 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:34 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:34.333+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-11T23:36:03.333416+0000 front 2024-09-11T23:36:03.333467+0000 (oldest deadline 2024-09-11T23:36:26.233354+0000) 2024-09-11T23:36:35.000 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 11 23:36:34 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-7[53549]: 2024-09-11T23:36:34.734+0000 7f58e9644640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:44.344227+0000 front 2024-09-11T23:35:44.344251+0000 (oldest deadline 2024-09-11T23:36:09.044354+0000) 2024-09-11T23:36:35.001 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 11 23:36:34 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-7[53549]: 2024-09-11T23:36:34.734+0000 7f58e9644640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:54.945348+0000 front 2024-09-11T23:35:54.945308+0000 (oldest deadline 2024-09-11T23:36:20.245466+0000) 2024-09-11T23:36:35.001 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 11 23:36:34 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-7[53549]: 2024-09-11T23:36:34.734+0000 7f58e9644640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-11T23:36:03.746532+0000 front 2024-09-11T23:36:03.746421+0000 (oldest deadline 2024-09-11T23:36:27.846542+0000) 2024-09-11T23:36:35.001 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:34 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:34.795+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:35.287175+0000 front 2024-09-11T23:35:35.287164+0000 (oldest deadline 2024-09-11T23:36:01.186976+0000) 2024-09-11T23:36:35.001 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:34 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:34.795+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.288233+0000 front 2024-09-11T23:35:45.288257+0000 (oldest deadline 2024-09-11T23:36:09.988379+0000) 2024-09-11T23:36:35.001 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:34 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:34.795+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:54.590336+0000 front 2024-09-11T23:35:54.590569+0000 (oldest deadline 2024-09-11T23:36:18.690277+0000) 2024-09-11T23:36:35.001 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:34 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:34.795+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-11T23:36:04.591561+0000 front 2024-09-11T23:36:04.591535+0000 (oldest deadline 2024-09-11T23:36:26.891405+0000) 2024-09-11T23:36:35.585 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:35 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:35.297+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:34.129174+0000 front 2024-09-11T23:35:34.128995+0000 (oldest deadline 2024-09-11T23:36:04.129586+0000) 2024-09-11T23:36:35.586 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:35 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:35.297+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.830933+0000 front 2024-09-11T23:35:45.830844+0000 (oldest deadline 2024-09-11T23:36:13.431439+0000) 2024-09-11T23:36:35.586 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:35 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:35.297+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:53.932228+0000 front 2024-09-11T23:35:53.932202+0000 (oldest deadline 2024-09-11T23:36:18.032372+0000) 2024-09-11T23:36:35.586 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:35 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:35.297+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-11T23:36:03.333416+0000 front 2024-09-11T23:36:03.333467+0000 (oldest deadline 2024-09-11T23:36:26.233354+0000) 2024-09-11T23:36:35.814 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:35 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:35.315+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:33.392902+0000 front 2024-09-11T23:35:33.393259+0000 (oldest deadline 2024-09-11T23:35:59.793635+0000) 2024-09-11T23:36:35.814 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:35 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:35.315+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:46.696487+0000 front 2024-09-11T23:35:46.696550+0000 (oldest deadline 2024-09-11T23:36:12.596707+0000) 2024-09-11T23:36:35.814 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:35 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:35.315+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:52.597139+0000 front 2024-09-11T23:35:52.597169+0000 (oldest deadline 2024-09-11T23:36:18.497326+0000) 2024-09-11T23:36:35.814 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:35 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:35.315+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-11T23:36:03.198553+0000 front 2024-09-11T23:36:03.198476+0000 (oldest deadline 2024-09-11T23:36:27.199197+0000) 2024-09-11T23:36:35.814 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:35 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:35.315+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-11T23:36:11.300666+0000 front 2024-09-11T23:36:11.300802+0000 (oldest deadline 2024-09-11T23:36:34.200458+0000) 2024-09-11T23:36:35.933 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:35 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:35.586+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:37.277803+0000 front 2024-09-11T23:35:37.277821+0000 (oldest deadline 2024-09-11T23:36:00.777764+0000) 2024-09-11T23:36:35.933 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:35 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:35.586+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.478993+0000 front 2024-09-11T23:35:45.478970+0000 (oldest deadline 2024-09-11T23:36:08.379023+0000) 2024-09-11T23:36:35.933 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:35 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:35.586+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:55.980636+0000 front 2024-09-11T23:35:55.980669+0000 (oldest deadline 2024-09-11T23:36:18.880843+0000) 2024-09-11T23:36:35.933 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:35 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:35.586+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-11T23:36:12.486674+0000 front 2024-09-11T23:36:12.486576+0000 (oldest deadline 2024-09-11T23:36:34.186664+0000) 2024-09-11T23:36:36.250 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 11 23:36:35 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-7[53549]: 2024-09-11T23:36:35.755+0000 7f58e9644640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:44.344227+0000 front 2024-09-11T23:35:44.344251+0000 (oldest deadline 2024-09-11T23:36:09.044354+0000) 2024-09-11T23:36:36.251 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 11 23:36:35 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-7[53549]: 2024-09-11T23:36:35.755+0000 7f58e9644640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:54.945348+0000 front 2024-09-11T23:35:54.945308+0000 (oldest deadline 2024-09-11T23:36:20.245466+0000) 2024-09-11T23:36:36.251 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 11 23:36:35 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-7[53549]: 2024-09-11T23:36:35.755+0000 7f58e9644640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-11T23:36:03.746532+0000 front 2024-09-11T23:36:03.746421+0000 (oldest deadline 2024-09-11T23:36:27.846542+0000) 2024-09-11T23:36:36.251 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 11 23:36:35 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-7[53549]: 2024-09-11T23:36:35.755+0000 7f58e9644640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-11T23:36:12.547546+0000 front 2024-09-11T23:36:12.547574+0000 (oldest deadline 2024-09-11T23:36:34.847661+0000) 2024-09-11T23:36:36.251 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:35 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:35.758+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:35.287175+0000 front 2024-09-11T23:35:35.287164+0000 (oldest deadline 2024-09-11T23:36:01.186976+0000) 2024-09-11T23:36:36.251 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:35 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:35.758+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.288233+0000 front 2024-09-11T23:35:45.288257+0000 (oldest deadline 2024-09-11T23:36:09.988379+0000) 2024-09-11T23:36:36.251 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:35 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:35.758+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:54.590336+0000 front 2024-09-11T23:35:54.590569+0000 (oldest deadline 2024-09-11T23:36:18.690277+0000) 2024-09-11T23:36:36.251 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:35 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:35.759+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-11T23:36:04.591561+0000 front 2024-09-11T23:36:04.591535+0000 (oldest deadline 2024-09-11T23:36:26.891405+0000) 2024-09-11T23:36:36.612 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:36 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:36.313+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:34.129174+0000 front 2024-09-11T23:35:34.128995+0000 (oldest deadline 2024-09-11T23:36:04.129586+0000) 2024-09-11T23:36:36.612 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:36 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:36.313+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.830933+0000 front 2024-09-11T23:35:45.830844+0000 (oldest deadline 2024-09-11T23:36:13.431439+0000) 2024-09-11T23:36:36.612 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:36 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:36.313+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:53.932228+0000 front 2024-09-11T23:35:53.932202+0000 (oldest deadline 2024-09-11T23:36:18.032372+0000) 2024-09-11T23:36:36.612 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:36 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:36.313+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-11T23:36:03.333416+0000 front 2024-09-11T23:36:03.333467+0000 (oldest deadline 2024-09-11T23:36:26.233354+0000) 2024-09-11T23:36:36.814 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:36 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:36.332+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:33.392902+0000 front 2024-09-11T23:35:33.393259+0000 (oldest deadline 2024-09-11T23:35:59.793635+0000) 2024-09-11T23:36:36.814 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:36 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:36.332+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:46.696487+0000 front 2024-09-11T23:35:46.696550+0000 (oldest deadline 2024-09-11T23:36:12.596707+0000) 2024-09-11T23:36:36.814 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:36 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:36.332+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:52.597139+0000 front 2024-09-11T23:35:52.597169+0000 (oldest deadline 2024-09-11T23:36:18.497326+0000) 2024-09-11T23:36:36.814 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:36 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:36.332+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-11T23:36:03.198553+0000 front 2024-09-11T23:36:03.198476+0000 (oldest deadline 2024-09-11T23:36:27.199197+0000) 2024-09-11T23:36:36.814 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:36 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:36.332+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-11T23:36:11.300666+0000 front 2024-09-11T23:36:11.300802+0000 (oldest deadline 2024-09-11T23:36:34.200458+0000) 2024-09-11T23:36:36.933 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:36 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:36.612+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:37.277803+0000 front 2024-09-11T23:35:37.277821+0000 (oldest deadline 2024-09-11T23:36:00.777764+0000) 2024-09-11T23:36:36.933 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:36 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:36.612+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.478993+0000 front 2024-09-11T23:35:45.478970+0000 (oldest deadline 2024-09-11T23:36:08.379023+0000) 2024-09-11T23:36:36.934 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:36 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:36.612+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:55.980636+0000 front 2024-09-11T23:35:55.980669+0000 (oldest deadline 2024-09-11T23:36:18.880843+0000) 2024-09-11T23:36:36.934 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:36 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:36.612+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-11T23:36:12.486674+0000 front 2024-09-11T23:36:12.486576+0000 (oldest deadline 2024-09-11T23:36:34.186664+0000) 2024-09-11T23:36:37.001 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 11 23:36:36 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-7[53549]: 2024-09-11T23:36:36.715+0000 7f58e9644640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:44.344227+0000 front 2024-09-11T23:35:44.344251+0000 (oldest deadline 2024-09-11T23:36:09.044354+0000) 2024-09-11T23:36:37.001 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 11 23:36:36 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-7[53549]: 2024-09-11T23:36:36.715+0000 7f58e9644640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:54.945348+0000 front 2024-09-11T23:35:54.945308+0000 (oldest deadline 2024-09-11T23:36:20.245466+0000) 2024-09-11T23:36:37.001 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 11 23:36:36 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-7[53549]: 2024-09-11T23:36:36.715+0000 7f58e9644640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-11T23:36:03.746532+0000 front 2024-09-11T23:36:03.746421+0000 (oldest deadline 2024-09-11T23:36:27.846542+0000) 2024-09-11T23:36:37.001 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 11 23:36:36 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-7[53549]: 2024-09-11T23:36:36.715+0000 7f58e9644640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-11T23:36:12.547546+0000 front 2024-09-11T23:36:12.547574+0000 (oldest deadline 2024-09-11T23:36:34.847661+0000) 2024-09-11T23:36:37.001 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:36 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:36.728+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:35.287175+0000 front 2024-09-11T23:35:35.287164+0000 (oldest deadline 2024-09-11T23:36:01.186976+0000) 2024-09-11T23:36:37.001 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:36 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:36.728+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.288233+0000 front 2024-09-11T23:35:45.288257+0000 (oldest deadline 2024-09-11T23:36:09.988379+0000) 2024-09-11T23:36:37.002 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:36 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:36.728+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:54.590336+0000 front 2024-09-11T23:35:54.590569+0000 (oldest deadline 2024-09-11T23:36:18.690277+0000) 2024-09-11T23:36:37.002 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:36 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:36.728+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-11T23:36:04.591561+0000 front 2024-09-11T23:36:04.591535+0000 (oldest deadline 2024-09-11T23:36:26.891405+0000) 2024-09-11T23:36:37.641 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:37 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:37.351+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:34.129174+0000 front 2024-09-11T23:35:34.128995+0000 (oldest deadline 2024-09-11T23:36:04.129586+0000) 2024-09-11T23:36:37.641 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:37 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:37.351+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.830933+0000 front 2024-09-11T23:35:45.830844+0000 (oldest deadline 2024-09-11T23:36:13.431439+0000) 2024-09-11T23:36:37.641 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:37 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:37.351+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:53.932228+0000 front 2024-09-11T23:35:53.932202+0000 (oldest deadline 2024-09-11T23:36:18.032372+0000) 2024-09-11T23:36:37.641 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:37 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:37.351+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-11T23:36:03.333416+0000 front 2024-09-11T23:36:03.333467+0000 (oldest deadline 2024-09-11T23:36:26.233354+0000) 2024-09-11T23:36:37.814 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:37 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:37.347+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:33.392902+0000 front 2024-09-11T23:35:33.393259+0000 (oldest deadline 2024-09-11T23:35:59.793635+0000) 2024-09-11T23:36:37.814 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:37 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:37.347+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:46.696487+0000 front 2024-09-11T23:35:46.696550+0000 (oldest deadline 2024-09-11T23:36:12.596707+0000) 2024-09-11T23:36:37.814 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:37 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:37.347+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:52.597139+0000 front 2024-09-11T23:35:52.597169+0000 (oldest deadline 2024-09-11T23:36:18.497326+0000) 2024-09-11T23:36:37.814 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:37 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:37.347+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-11T23:36:03.198553+0000 front 2024-09-11T23:36:03.198476+0000 (oldest deadline 2024-09-11T23:36:27.199197+0000) 2024-09-11T23:36:37.814 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:37 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:37.347+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-11T23:36:11.300666+0000 front 2024-09-11T23:36:11.300802+0000 (oldest deadline 2024-09-11T23:36:34.200458+0000) 2024-09-11T23:36:37.933 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:37 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:37.641+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:37.277803+0000 front 2024-09-11T23:35:37.277821+0000 (oldest deadline 2024-09-11T23:36:00.777764+0000) 2024-09-11T23:36:37.933 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:37 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:37.641+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.478993+0000 front 2024-09-11T23:35:45.478970+0000 (oldest deadline 2024-09-11T23:36:08.379023+0000) 2024-09-11T23:36:37.933 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:37 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:37.641+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:55.980636+0000 front 2024-09-11T23:35:55.980669+0000 (oldest deadline 2024-09-11T23:36:18.880843+0000) 2024-09-11T23:36:37.933 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:37 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:37.641+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-11T23:36:12.486674+0000 front 2024-09-11T23:36:12.486576+0000 (oldest deadline 2024-09-11T23:36:34.186664+0000) 2024-09-11T23:36:38.000 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 11 23:36:37 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-7[53549]: 2024-09-11T23:36:37.693+0000 7f58e9644640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:44.344227+0000 front 2024-09-11T23:35:44.344251+0000 (oldest deadline 2024-09-11T23:36:09.044354+0000) 2024-09-11T23:36:38.001 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 11 23:36:37 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-7[53549]: 2024-09-11T23:36:37.693+0000 7f58e9644640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:54.945348+0000 front 2024-09-11T23:35:54.945308+0000 (oldest deadline 2024-09-11T23:36:20.245466+0000) 2024-09-11T23:36:38.001 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 11 23:36:37 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-7[53549]: 2024-09-11T23:36:37.693+0000 7f58e9644640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-11T23:36:03.746532+0000 front 2024-09-11T23:36:03.746421+0000 (oldest deadline 2024-09-11T23:36:27.846542+0000) 2024-09-11T23:36:38.001 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 11 23:36:37 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-7[53549]: 2024-09-11T23:36:37.693+0000 7f58e9644640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-11T23:36:12.547546+0000 front 2024-09-11T23:36:12.547574+0000 (oldest deadline 2024-09-11T23:36:34.847661+0000) 2024-09-11T23:36:38.001 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:37 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:37.771+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:35.287175+0000 front 2024-09-11T23:35:35.287164+0000 (oldest deadline 2024-09-11T23:36:01.186976+0000) 2024-09-11T23:36:38.001 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:37 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:37.771+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.288233+0000 front 2024-09-11T23:35:45.288257+0000 (oldest deadline 2024-09-11T23:36:09.988379+0000) 2024-09-11T23:36:38.001 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:37 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:37.771+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:54.590336+0000 front 2024-09-11T23:35:54.590569+0000 (oldest deadline 2024-09-11T23:36:18.690277+0000) 2024-09-11T23:36:38.001 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:37 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:37.771+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-11T23:36:04.591561+0000 front 2024-09-11T23:36:04.591535+0000 (oldest deadline 2024-09-11T23:36:26.891405+0000) 2024-09-11T23:36:38.683 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:38 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:38.627+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:37.277803+0000 front 2024-09-11T23:35:37.277821+0000 (oldest deadline 2024-09-11T23:36:00.777764+0000) 2024-09-11T23:36:38.683 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:38 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:38.627+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.478993+0000 front 2024-09-11T23:35:45.478970+0000 (oldest deadline 2024-09-11T23:36:08.379023+0000) 2024-09-11T23:36:38.684 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:38 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:38.627+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:55.980636+0000 front 2024-09-11T23:35:55.980669+0000 (oldest deadline 2024-09-11T23:36:18.880843+0000) 2024-09-11T23:36:38.684 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:38 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:38.627+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-11T23:36:12.486674+0000 front 2024-09-11T23:36:12.486576+0000 (oldest deadline 2024-09-11T23:36:34.186664+0000) 2024-09-11T23:36:38.684 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:38 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:38.395+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:34.129174+0000 front 2024-09-11T23:35:34.128995+0000 (oldest deadline 2024-09-11T23:36:04.129586+0000) 2024-09-11T23:36:38.684 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:38 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:38.395+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.830933+0000 front 2024-09-11T23:35:45.830844+0000 (oldest deadline 2024-09-11T23:36:13.431439+0000) 2024-09-11T23:36:38.684 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:38 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:38.395+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:53.932228+0000 front 2024-09-11T23:35:53.932202+0000 (oldest deadline 2024-09-11T23:36:18.032372+0000) 2024-09-11T23:36:38.684 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:38 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:38.395+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-11T23:36:03.333416+0000 front 2024-09-11T23:36:03.333467+0000 (oldest deadline 2024-09-11T23:36:26.233354+0000) 2024-09-11T23:36:38.814 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:38 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:38.354+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:33.392902+0000 front 2024-09-11T23:35:33.393259+0000 (oldest deadline 2024-09-11T23:35:59.793635+0000) 2024-09-11T23:36:38.814 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:38 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:38.354+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:46.696487+0000 front 2024-09-11T23:35:46.696550+0000 (oldest deadline 2024-09-11T23:36:12.596707+0000) 2024-09-11T23:36:38.814 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:38 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:38.354+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:52.597139+0000 front 2024-09-11T23:35:52.597169+0000 (oldest deadline 2024-09-11T23:36:18.497326+0000) 2024-09-11T23:36:38.814 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:38 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:38.354+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-11T23:36:03.198553+0000 front 2024-09-11T23:36:03.198476+0000 (oldest deadline 2024-09-11T23:36:27.199197+0000) 2024-09-11T23:36:38.814 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:38 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:38.354+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-11T23:36:11.300666+0000 front 2024-09-11T23:36:11.300802+0000 (oldest deadline 2024-09-11T23:36:34.200458+0000) 2024-09-11T23:36:39.250 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 11 23:36:38 smithi123 podman[71554]: 2024-09-11 23:36:38.961714511 +0000 UTC m=+5.606435738 container died 3e7e055d93ab40345ff413d277a2a89cdb0bf77a897bf1c262b143f8db2d0755 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-7, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-11T23:36:39.251 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:38 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:38.797+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:35.287175+0000 front 2024-09-11T23:35:35.287164+0000 (oldest deadline 2024-09-11T23:36:01.186976+0000) 2024-09-11T23:36:39.251 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:38 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:38.797+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.288233+0000 front 2024-09-11T23:35:45.288257+0000 (oldest deadline 2024-09-11T23:36:09.988379+0000) 2024-09-11T23:36:39.251 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:38 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:38.797+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:54.590336+0000 front 2024-09-11T23:35:54.590569+0000 (oldest deadline 2024-09-11T23:36:18.690277+0000) 2024-09-11T23:36:39.251 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:38 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:38.797+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-11T23:36:04.591561+0000 front 2024-09-11T23:36:04.591535+0000 (oldest deadline 2024-09-11T23:36:26.891405+0000) 2024-09-11T23:36:39.594 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 11 23:36:39 smithi123 podman[71554]: 2024-09-11 23:36:39.344601767 +0000 UTC m=+5.989322986 container cleanup 3e7e055d93ab40345ff413d277a2a89cdb0bf77a897bf1c262b143f8db2d0755 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-7, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3) 2024-09-11T23:36:39.595 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 11 23:36:39 smithi123 bash[71554]: ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-7 2024-09-11T23:36:39.814 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:39 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:39.342+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:33.392902+0000 front 2024-09-11T23:35:33.393259+0000 (oldest deadline 2024-09-11T23:35:59.793635+0000) 2024-09-11T23:36:39.814 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:39 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:39.342+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:46.696487+0000 front 2024-09-11T23:35:46.696550+0000 (oldest deadline 2024-09-11T23:36:12.596707+0000) 2024-09-11T23:36:39.814 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:39 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:39.342+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:52.597139+0000 front 2024-09-11T23:35:52.597169+0000 (oldest deadline 2024-09-11T23:36:18.497326+0000) 2024-09-11T23:36:39.814 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:39 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:39.342+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-11T23:36:03.198553+0000 front 2024-09-11T23:36:03.198476+0000 (oldest deadline 2024-09-11T23:36:27.199197+0000) 2024-09-11T23:36:39.814 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:39 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:39.342+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-11T23:36:11.300666+0000 front 2024-09-11T23:36:11.300802+0000 (oldest deadline 2024-09-11T23:36:34.200458+0000) 2024-09-11T23:36:39.901 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 11 23:36:39 smithi123 podman[71573]: 2024-09-11 23:36:39.595827668 +0000 UTC m=+0.627724884 container remove 3e7e055d93ab40345ff413d277a2a89cdb0bf77a897bf1c262b143f8db2d0755 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-7, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=) 2024-09-11T23:36:39.901 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:39 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:39.776+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:35.287175+0000 front 2024-09-11T23:35:35.287164+0000 (oldest deadline 2024-09-11T23:36:01.186976+0000) 2024-09-11T23:36:39.901 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:39 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:39.776+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.288233+0000 front 2024-09-11T23:35:45.288257+0000 (oldest deadline 2024-09-11T23:36:09.988379+0000) 2024-09-11T23:36:39.901 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:39 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:39.776+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:54.590336+0000 front 2024-09-11T23:35:54.590569+0000 (oldest deadline 2024-09-11T23:36:18.690277+0000) 2024-09-11T23:36:39.902 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:39 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:39.776+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-11T23:36:04.591561+0000 front 2024-09-11T23:36:04.591535+0000 (oldest deadline 2024-09-11T23:36:26.891405+0000) 2024-09-11T23:36:39.902 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:39 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:39.776+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-11T23:36:13.193445+0000 front 2024-09-11T23:36:13.193489+0000 (oldest deadline 2024-09-11T23:36:39.093541+0000) 2024-09-11T23:36:39.933 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:39 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:39.658+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:37.277803+0000 front 2024-09-11T23:35:37.277821+0000 (oldest deadline 2024-09-11T23:36:00.777764+0000) 2024-09-11T23:36:39.933 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:39 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:39.658+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.478993+0000 front 2024-09-11T23:35:45.478970+0000 (oldest deadline 2024-09-11T23:36:08.379023+0000) 2024-09-11T23:36:39.933 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:39 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:39.658+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:55.980636+0000 front 2024-09-11T23:35:55.980669+0000 (oldest deadline 2024-09-11T23:36:18.880843+0000) 2024-09-11T23:36:39.933 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:39 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:39.658+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-11T23:36:12.486674+0000 front 2024-09-11T23:36:12.486576+0000 (oldest deadline 2024-09-11T23:36:34.186664+0000) 2024-09-11T23:36:39.934 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:39 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:39.434+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:34.129174+0000 front 2024-09-11T23:35:34.128995+0000 (oldest deadline 2024-09-11T23:36:04.129586+0000) 2024-09-11T23:36:39.934 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:39 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:39.434+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.830933+0000 front 2024-09-11T23:35:45.830844+0000 (oldest deadline 2024-09-11T23:36:13.431439+0000) 2024-09-11T23:36:39.934 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:39 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:39.434+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:53.932228+0000 front 2024-09-11T23:35:53.932202+0000 (oldest deadline 2024-09-11T23:36:18.032372+0000) 2024-09-11T23:36:39.934 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:39 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:39.434+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-11T23:36:03.333416+0000 front 2024-09-11T23:36:03.333467+0000 (oldest deadline 2024-09-11T23:36:26.233354+0000) 2024-09-11T23:36:40.190 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 11 23:36:39 smithi123 podman[71662]: 2024-09-11 23:36:39.804339206 +0000 UTC m=+0.015802622 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T23:36:40.190 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 11 23:36:39 smithi123 podman[71662]: 2024-09-11 23:36:39.913277999 +0000 UTC m=+0.124741447 container create ebb07deb47f25ad3823aa812583c3c34c927cfc563106e0620e75ff2fc471d5b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-7-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-11T23:36:40.501 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 11 23:36:40 smithi123 podman[71662]: 2024-09-11 23:36:40.191128344 +0000 UTC m=+0.402591752 container init ebb07deb47f25ad3823aa812583c3c34c927cfc563106e0620e75ff2fc471d5b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-7-deactivate, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True) 2024-09-11T23:36:40.501 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 11 23:36:40 smithi123 podman[71662]: 2024-09-11 23:36:40.194630293 +0000 UTC m=+0.406093699 container start ebb07deb47f25ad3823aa812583c3c34c927cfc563106e0620e75ff2fc471d5b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-7-deactivate, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-11T23:36:40.501 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 11 23:36:40 smithi123 podman[71662]: 2024-09-11 23:36:40.290928076 +0000 UTC m=+0.502391482 container attach ebb07deb47f25ad3823aa812583c3c34c927cfc563106e0620e75ff2fc471d5b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-7-deactivate, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True) 2024-09-11T23:36:40.501 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 11 23:36:40 smithi123 podman[71662]: 2024-09-11 23:36:40.38672741 +0000 UTC m=+0.598190828 container died ebb07deb47f25ad3823aa812583c3c34c927cfc563106e0620e75ff2fc471d5b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-7-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-11T23:36:40.683 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:40 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:40.644+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:37.277803+0000 front 2024-09-11T23:35:37.277821+0000 (oldest deadline 2024-09-11T23:36:00.777764+0000) 2024-09-11T23:36:40.683 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:40 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:40.644+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.478993+0000 front 2024-09-11T23:35:45.478970+0000 (oldest deadline 2024-09-11T23:36:08.379023+0000) 2024-09-11T23:36:40.683 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:40 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:40.644+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:55.980636+0000 front 2024-09-11T23:35:55.980669+0000 (oldest deadline 2024-09-11T23:36:18.880843+0000) 2024-09-11T23:36:40.683 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:40 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:40.644+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-11T23:36:12.486674+0000 front 2024-09-11T23:36:12.486576+0000 (oldest deadline 2024-09-11T23:36:34.186664+0000) 2024-09-11T23:36:40.684 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:40 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:40.424+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:34.129174+0000 front 2024-09-11T23:35:34.128995+0000 (oldest deadline 2024-09-11T23:36:04.129586+0000) 2024-09-11T23:36:40.684 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:40 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:40.424+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.830933+0000 front 2024-09-11T23:35:45.830844+0000 (oldest deadline 2024-09-11T23:36:13.431439+0000) 2024-09-11T23:36:40.684 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:40 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:40.424+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:53.932228+0000 front 2024-09-11T23:35:53.932202+0000 (oldest deadline 2024-09-11T23:36:18.032372+0000) 2024-09-11T23:36:40.684 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:40 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:40.424+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-11T23:36:03.333416+0000 front 2024-09-11T23:36:03.333467+0000 (oldest deadline 2024-09-11T23:36:26.233354+0000) 2024-09-11T23:36:40.814 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:40 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:40.334+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:33.392902+0000 front 2024-09-11T23:35:33.393259+0000 (oldest deadline 2024-09-11T23:35:59.793635+0000) 2024-09-11T23:36:40.814 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:40 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:40.334+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:46.696487+0000 front 2024-09-11T23:35:46.696550+0000 (oldest deadline 2024-09-11T23:36:12.596707+0000) 2024-09-11T23:36:40.814 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:40 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:40.334+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:52.597139+0000 front 2024-09-11T23:35:52.597169+0000 (oldest deadline 2024-09-11T23:36:18.497326+0000) 2024-09-11T23:36:40.814 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:40 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:40.334+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-11T23:36:03.198553+0000 front 2024-09-11T23:36:03.198476+0000 (oldest deadline 2024-09-11T23:36:27.199197+0000) 2024-09-11T23:36:40.814 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:40 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:40.334+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-11T23:36:11.300666+0000 front 2024-09-11T23:36:11.300802+0000 (oldest deadline 2024-09-11T23:36:34.200458+0000) 2024-09-11T23:36:41.000 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:40 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:40.774+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:35.287175+0000 front 2024-09-11T23:35:35.287164+0000 (oldest deadline 2024-09-11T23:36:01.186976+0000) 2024-09-11T23:36:41.000 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:40 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:40.774+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.288233+0000 front 2024-09-11T23:35:45.288257+0000 (oldest deadline 2024-09-11T23:36:09.988379+0000) 2024-09-11T23:36:41.000 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:40 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:40.774+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:54.590336+0000 front 2024-09-11T23:35:54.590569+0000 (oldest deadline 2024-09-11T23:36:18.690277+0000) 2024-09-11T23:36:41.001 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:40 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:40.774+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-11T23:36:04.591561+0000 front 2024-09-11T23:36:04.591535+0000 (oldest deadline 2024-09-11T23:36:26.891405+0000) 2024-09-11T23:36:41.001 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:40 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:40.774+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-11T23:36:13.193445+0000 front 2024-09-11T23:36:13.193489+0000 (oldest deadline 2024-09-11T23:36:39.093541+0000) 2024-09-11T23:36:41.073 DEBUG:teuthology.orchestra.run.smithi123:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8b03efce-7092-11ef-bcea-c7b262605968@osd.7.service' 2024-09-11T23:36:41.113 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T23:36:41.113 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-11T23:36:41.113 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-09-11T23:36:41.114 DEBUG:teuthology.orchestra.run.smithi160:> sudo systemctl stop ceph-8b03efce-7092-11ef-bcea-c7b262605968@osd.8 2024-09-11T23:36:41.420 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:41 smithi160 systemd[1]: Stopping Ceph osd.8 for 8b03efce-7092-11ef-bcea-c7b262605968... 2024-09-11T23:36:41.420 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:41 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:41.386+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:34.129174+0000 front 2024-09-11T23:35:34.128995+0000 (oldest deadline 2024-09-11T23:36:04.129586+0000) 2024-09-11T23:36:41.421 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:41 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:41.386+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.830933+0000 front 2024-09-11T23:35:45.830844+0000 (oldest deadline 2024-09-11T23:36:13.431439+0000) 2024-09-11T23:36:41.421 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:41 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:41.386+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:53.932228+0000 front 2024-09-11T23:35:53.932202+0000 (oldest deadline 2024-09-11T23:36:18.032372+0000) 2024-09-11T23:36:41.421 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:41 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:41.386+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-11T23:36:03.333416+0000 front 2024-09-11T23:36:03.333467+0000 (oldest deadline 2024-09-11T23:36:26.233354+0000) 2024-09-11T23:36:41.421 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:41 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:41.420+0000 7f670ae20640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T23:36:41.421 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:41 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:41.420+0000 7f670ae20640 -1 osd.8 99 *** Got signal Terminated *** 2024-09-11T23:36:41.421 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:41 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:41.420+0000 7f670ae20640 -1 osd.8 99 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T23:36:41.683 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:41 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:41.603+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:37.277803+0000 front 2024-09-11T23:35:37.277821+0000 (oldest deadline 2024-09-11T23:36:00.777764+0000) 2024-09-11T23:36:41.683 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:41 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:41.603+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.478993+0000 front 2024-09-11T23:35:45.478970+0000 (oldest deadline 2024-09-11T23:36:08.379023+0000) 2024-09-11T23:36:41.683 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:41 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:41.603+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:55.980636+0000 front 2024-09-11T23:35:55.980669+0000 (oldest deadline 2024-09-11T23:36:18.880843+0000) 2024-09-11T23:36:41.683 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:41 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:41.603+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-11T23:36:12.486674+0000 front 2024-09-11T23:36:12.486576+0000 (oldest deadline 2024-09-11T23:36:34.186664+0000) 2024-09-11T23:36:41.814 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:41 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:41.343+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:33.392902+0000 front 2024-09-11T23:35:33.393259+0000 (oldest deadline 2024-09-11T23:35:59.793635+0000) 2024-09-11T23:36:41.814 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:41 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:41.343+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:46.696487+0000 front 2024-09-11T23:35:46.696550+0000 (oldest deadline 2024-09-11T23:36:12.596707+0000) 2024-09-11T23:36:41.814 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:41 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:41.343+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:52.597139+0000 front 2024-09-11T23:35:52.597169+0000 (oldest deadline 2024-09-11T23:36:18.497326+0000) 2024-09-11T23:36:41.814 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:41 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:41.343+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-11T23:36:03.198553+0000 front 2024-09-11T23:36:03.198476+0000 (oldest deadline 2024-09-11T23:36:27.199197+0000) 2024-09-11T23:36:41.814 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:41 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:41.343+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-11T23:36:11.300666+0000 front 2024-09-11T23:36:11.300802+0000 (oldest deadline 2024-09-11T23:36:34.200458+0000) 2024-09-11T23:36:42.250 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:41 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:41.805+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:35.287175+0000 front 2024-09-11T23:35:35.287164+0000 (oldest deadline 2024-09-11T23:36:01.186976+0000) 2024-09-11T23:36:42.250 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:41 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:41.805+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.288233+0000 front 2024-09-11T23:35:45.288257+0000 (oldest deadline 2024-09-11T23:36:09.988379+0000) 2024-09-11T23:36:42.250 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:41 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:41.805+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:54.590336+0000 front 2024-09-11T23:35:54.590569+0000 (oldest deadline 2024-09-11T23:36:18.690277+0000) 2024-09-11T23:36:42.251 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:41 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:41.805+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-11T23:36:04.591561+0000 front 2024-09-11T23:36:04.591535+0000 (oldest deadline 2024-09-11T23:36:26.891405+0000) 2024-09-11T23:36:42.251 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:41 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:41.805+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-11T23:36:13.193445+0000 front 2024-09-11T23:36:13.193489+0000 (oldest deadline 2024-09-11T23:36:39.093541+0000) 2024-09-11T23:36:42.683 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:42 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:42.616+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:37.277803+0000 front 2024-09-11T23:35:37.277821+0000 (oldest deadline 2024-09-11T23:36:00.777764+0000) 2024-09-11T23:36:42.683 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:42 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:42.616+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.478993+0000 front 2024-09-11T23:35:45.478970+0000 (oldest deadline 2024-09-11T23:36:08.379023+0000) 2024-09-11T23:36:42.684 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:42 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:42.616+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:55.980636+0000 front 2024-09-11T23:35:55.980669+0000 (oldest deadline 2024-09-11T23:36:18.880843+0000) 2024-09-11T23:36:42.684 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:42 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:42.616+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-11T23:36:12.486674+0000 front 2024-09-11T23:36:12.486576+0000 (oldest deadline 2024-09-11T23:36:34.186664+0000) 2024-09-11T23:36:42.684 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:42 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:42.372+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:34.129174+0000 front 2024-09-11T23:35:34.128995+0000 (oldest deadline 2024-09-11T23:36:04.129586+0000) 2024-09-11T23:36:42.684 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:42 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:42.372+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.830933+0000 front 2024-09-11T23:35:45.830844+0000 (oldest deadline 2024-09-11T23:36:13.431439+0000) 2024-09-11T23:36:42.684 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:42 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:42.372+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:53.932228+0000 front 2024-09-11T23:35:53.932202+0000 (oldest deadline 2024-09-11T23:36:18.032372+0000) 2024-09-11T23:36:42.684 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:42 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:42.372+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-11T23:36:03.333416+0000 front 2024-09-11T23:36:03.333467+0000 (oldest deadline 2024-09-11T23:36:26.233354+0000) 2024-09-11T23:36:42.814 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:42 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:42.316+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:33.392902+0000 front 2024-09-11T23:35:33.393259+0000 (oldest deadline 2024-09-11T23:35:59.793635+0000) 2024-09-11T23:36:42.814 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:42 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:42.316+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:46.696487+0000 front 2024-09-11T23:35:46.696550+0000 (oldest deadline 2024-09-11T23:36:12.596707+0000) 2024-09-11T23:36:42.814 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:42 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:42.316+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:52.597139+0000 front 2024-09-11T23:35:52.597169+0000 (oldest deadline 2024-09-11T23:36:18.497326+0000) 2024-09-11T23:36:42.814 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:42 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:42.316+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-11T23:36:03.198553+0000 front 2024-09-11T23:36:03.198476+0000 (oldest deadline 2024-09-11T23:36:27.199197+0000) 2024-09-11T23:36:42.814 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:42 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:42.316+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-11T23:36:11.300666+0000 front 2024-09-11T23:36:11.300802+0000 (oldest deadline 2024-09-11T23:36:34.200458+0000) 2024-09-11T23:36:43.250 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:42 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:42.853+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:35.287175+0000 front 2024-09-11T23:35:35.287164+0000 (oldest deadline 2024-09-11T23:36:01.186976+0000) 2024-09-11T23:36:43.250 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:42 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:42.853+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.288233+0000 front 2024-09-11T23:35:45.288257+0000 (oldest deadline 2024-09-11T23:36:09.988379+0000) 2024-09-11T23:36:43.251 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:42 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:42.853+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:54.590336+0000 front 2024-09-11T23:35:54.590569+0000 (oldest deadline 2024-09-11T23:36:18.690277+0000) 2024-09-11T23:36:43.251 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:42 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:42.853+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-11T23:36:04.591561+0000 front 2024-09-11T23:36:04.591535+0000 (oldest deadline 2024-09-11T23:36:26.891405+0000) 2024-09-11T23:36:43.251 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:42 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:42.853+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-11T23:36:13.193445+0000 front 2024-09-11T23:36:13.193489+0000 (oldest deadline 2024-09-11T23:36:39.093541+0000) 2024-09-11T23:36:43.564 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:43 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:43.287+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:33.392902+0000 front 2024-09-11T23:35:33.393259+0000 (oldest deadline 2024-09-11T23:35:59.793635+0000) 2024-09-11T23:36:43.564 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:43 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:43.287+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:46.696487+0000 front 2024-09-11T23:35:46.696550+0000 (oldest deadline 2024-09-11T23:36:12.596707+0000) 2024-09-11T23:36:43.564 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:43 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:43.287+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:52.597139+0000 front 2024-09-11T23:35:52.597169+0000 (oldest deadline 2024-09-11T23:36:18.497326+0000) 2024-09-11T23:36:43.564 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:43 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:43.287+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-11T23:36:03.198553+0000 front 2024-09-11T23:36:03.198476+0000 (oldest deadline 2024-09-11T23:36:27.199197+0000) 2024-09-11T23:36:43.564 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:43 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:43.287+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-11T23:36:11.300666+0000 front 2024-09-11T23:36:11.300802+0000 (oldest deadline 2024-09-11T23:36:34.200458+0000) 2024-09-11T23:36:43.564 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:43 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:43.287+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-09-11T23:36:17.601881+0000 front 2024-09-11T23:36:17.601954+0000 (oldest deadline 2024-09-11T23:36:42.902005+0000) 2024-09-11T23:36:43.641 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:43 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:43.390+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:34.129174+0000 front 2024-09-11T23:35:34.128995+0000 (oldest deadline 2024-09-11T23:36:04.129586+0000) 2024-09-11T23:36:43.641 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:43 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:43.390+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.830933+0000 front 2024-09-11T23:35:45.830844+0000 (oldest deadline 2024-09-11T23:36:13.431439+0000) 2024-09-11T23:36:43.642 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:43 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:43.390+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:53.932228+0000 front 2024-09-11T23:35:53.932202+0000 (oldest deadline 2024-09-11T23:36:18.032372+0000) 2024-09-11T23:36:43.642 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:43 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:43.390+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-11T23:36:03.333416+0000 front 2024-09-11T23:36:03.333467+0000 (oldest deadline 2024-09-11T23:36:26.233354+0000) 2024-09-11T23:36:43.933 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:43 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:43.642+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:37.277803+0000 front 2024-09-11T23:35:37.277821+0000 (oldest deadline 2024-09-11T23:36:00.777764+0000) 2024-09-11T23:36:43.933 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:43 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:43.642+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.478993+0000 front 2024-09-11T23:35:45.478970+0000 (oldest deadline 2024-09-11T23:36:08.379023+0000) 2024-09-11T23:36:43.933 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:43 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:43.642+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:55.980636+0000 front 2024-09-11T23:35:55.980669+0000 (oldest deadline 2024-09-11T23:36:18.880843+0000) 2024-09-11T23:36:43.933 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:43 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:43.642+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-11T23:36:12.486674+0000 front 2024-09-11T23:36:12.486576+0000 (oldest deadline 2024-09-11T23:36:34.186664+0000) 2024-09-11T23:36:43.933 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:43 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:43.642+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-09-11T23:36:20.289712+0000 front 2024-09-11T23:36:20.289628+0000 (oldest deadline 2024-09-11T23:36:43.189713+0000) 2024-09-11T23:36:44.250 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:43 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:43.817+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:35.287175+0000 front 2024-09-11T23:35:35.287164+0000 (oldest deadline 2024-09-11T23:36:01.186976+0000) 2024-09-11T23:36:44.250 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:43 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:43.817+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.288233+0000 front 2024-09-11T23:35:45.288257+0000 (oldest deadline 2024-09-11T23:36:09.988379+0000) 2024-09-11T23:36:44.250 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:43 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:43.817+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:54.590336+0000 front 2024-09-11T23:35:54.590569+0000 (oldest deadline 2024-09-11T23:36:18.690277+0000) 2024-09-11T23:36:44.251 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:43 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:43.817+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-11T23:36:04.591561+0000 front 2024-09-11T23:36:04.591535+0000 (oldest deadline 2024-09-11T23:36:26.891405+0000) 2024-09-11T23:36:44.251 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:43 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:43.817+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-11T23:36:13.193445+0000 front 2024-09-11T23:36:13.193489+0000 (oldest deadline 2024-09-11T23:36:39.093541+0000) 2024-09-11T23:36:44.564 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:44 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:44.273+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:33.392902+0000 front 2024-09-11T23:35:33.393259+0000 (oldest deadline 2024-09-11T23:35:59.793635+0000) 2024-09-11T23:36:44.564 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:44 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:44.273+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:46.696487+0000 front 2024-09-11T23:35:46.696550+0000 (oldest deadline 2024-09-11T23:36:12.596707+0000) 2024-09-11T23:36:44.564 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:44 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:44.273+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:52.597139+0000 front 2024-09-11T23:35:52.597169+0000 (oldest deadline 2024-09-11T23:36:18.497326+0000) 2024-09-11T23:36:44.564 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:44 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:44.273+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-11T23:36:03.198553+0000 front 2024-09-11T23:36:03.198476+0000 (oldest deadline 2024-09-11T23:36:27.199197+0000) 2024-09-11T23:36:44.564 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:44 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:44.273+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-11T23:36:11.300666+0000 front 2024-09-11T23:36:11.300802+0000 (oldest deadline 2024-09-11T23:36:34.200458+0000) 2024-09-11T23:36:44.564 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:44 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:44.273+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-09-11T23:36:17.601881+0000 front 2024-09-11T23:36:17.601954+0000 (oldest deadline 2024-09-11T23:36:42.902005+0000) 2024-09-11T23:36:44.683 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:44 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:44.421+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:34.129174+0000 front 2024-09-11T23:35:34.128995+0000 (oldest deadline 2024-09-11T23:36:04.129586+0000) 2024-09-11T23:36:44.684 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:44 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:44.421+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.830933+0000 front 2024-09-11T23:35:45.830844+0000 (oldest deadline 2024-09-11T23:36:13.431439+0000) 2024-09-11T23:36:44.684 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:44 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:44.421+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:53.932228+0000 front 2024-09-11T23:35:53.932202+0000 (oldest deadline 2024-09-11T23:36:18.032372+0000) 2024-09-11T23:36:44.684 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:44 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:44.421+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-11T23:36:03.333416+0000 front 2024-09-11T23:36:03.333467+0000 (oldest deadline 2024-09-11T23:36:26.233354+0000) 2024-09-11T23:36:44.684 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:44 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:44.421+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-09-11T23:36:20.835994+0000 front 2024-09-11T23:36:20.836019+0000 (oldest deadline 2024-09-11T23:36:43.736148+0000) 2024-09-11T23:36:44.684 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:44 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:44.602+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:37.277803+0000 front 2024-09-11T23:35:37.277821+0000 (oldest deadline 2024-09-11T23:36:00.777764+0000) 2024-09-11T23:36:44.684 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:44 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:44.602+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.478993+0000 front 2024-09-11T23:35:45.478970+0000 (oldest deadline 2024-09-11T23:36:08.379023+0000) 2024-09-11T23:36:44.684 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:44 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:44.602+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:55.980636+0000 front 2024-09-11T23:35:55.980669+0000 (oldest deadline 2024-09-11T23:36:18.880843+0000) 2024-09-11T23:36:44.684 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:44 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:44.602+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-11T23:36:12.486674+0000 front 2024-09-11T23:36:12.486576+0000 (oldest deadline 2024-09-11T23:36:34.186664+0000) 2024-09-11T23:36:44.685 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:44 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:44.602+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-09-11T23:36:20.289712+0000 front 2024-09-11T23:36:20.289628+0000 (oldest deadline 2024-09-11T23:36:43.189713+0000) 2024-09-11T23:36:45.250 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:44 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:44.848+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:35.287175+0000 front 2024-09-11T23:35:35.287164+0000 (oldest deadline 2024-09-11T23:36:01.186976+0000) 2024-09-11T23:36:45.250 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:44 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:44.848+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.288233+0000 front 2024-09-11T23:35:45.288257+0000 (oldest deadline 2024-09-11T23:36:09.988379+0000) 2024-09-11T23:36:45.250 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:44 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:44.848+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:54.590336+0000 front 2024-09-11T23:35:54.590569+0000 (oldest deadline 2024-09-11T23:36:18.690277+0000) 2024-09-11T23:36:45.251 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:44 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:44.848+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-11T23:36:04.591561+0000 front 2024-09-11T23:36:04.591535+0000 (oldest deadline 2024-09-11T23:36:26.891405+0000) 2024-09-11T23:36:45.251 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:44 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:44.848+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-11T23:36:13.193445+0000 front 2024-09-11T23:36:13.193489+0000 (oldest deadline 2024-09-11T23:36:39.093541+0000) 2024-09-11T23:36:45.251 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:44 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:44.848+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-09-11T23:36:19.094094+0000 front 2024-09-11T23:36:19.094012+0000 (oldest deadline 2024-09-11T23:36:44.393951+0000) 2024-09-11T23:36:45.814 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:45 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:45.316+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:33.392902+0000 front 2024-09-11T23:35:33.393259+0000 (oldest deadline 2024-09-11T23:35:59.793635+0000) 2024-09-11T23:36:45.814 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:45 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:45.316+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:46.696487+0000 front 2024-09-11T23:35:46.696550+0000 (oldest deadline 2024-09-11T23:36:12.596707+0000) 2024-09-11T23:36:45.814 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:45 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:45.316+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:52.597139+0000 front 2024-09-11T23:35:52.597169+0000 (oldest deadline 2024-09-11T23:36:18.497326+0000) 2024-09-11T23:36:45.814 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:45 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:45.316+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-11T23:36:03.198553+0000 front 2024-09-11T23:36:03.198476+0000 (oldest deadline 2024-09-11T23:36:27.199197+0000) 2024-09-11T23:36:45.814 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:45 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:45.316+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-11T23:36:11.300666+0000 front 2024-09-11T23:36:11.300802+0000 (oldest deadline 2024-09-11T23:36:34.200458+0000) 2024-09-11T23:36:45.814 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:45 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:45.316+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-09-11T23:36:17.601881+0000 front 2024-09-11T23:36:17.601954+0000 (oldest deadline 2024-09-11T23:36:42.902005+0000) 2024-09-11T23:36:45.933 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:45 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:45.457+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:34.129174+0000 front 2024-09-11T23:35:34.128995+0000 (oldest deadline 2024-09-11T23:36:04.129586+0000) 2024-09-11T23:36:45.934 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:45 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:45.457+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.830933+0000 front 2024-09-11T23:35:45.830844+0000 (oldest deadline 2024-09-11T23:36:13.431439+0000) 2024-09-11T23:36:45.934 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:45 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:45.457+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:53.932228+0000 front 2024-09-11T23:35:53.932202+0000 (oldest deadline 2024-09-11T23:36:18.032372+0000) 2024-09-11T23:36:45.934 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:45 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:45.457+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-11T23:36:03.333416+0000 front 2024-09-11T23:36:03.333467+0000 (oldest deadline 2024-09-11T23:36:26.233354+0000) 2024-09-11T23:36:45.934 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:45 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8[53009]: 2024-09-11T23:36:45.457+0000 7f670342e640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-09-11T23:36:20.835994+0000 front 2024-09-11T23:36:20.836019+0000 (oldest deadline 2024-09-11T23:36:43.736148+0000) 2024-09-11T23:36:45.934 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:45 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:45.558+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:37.277803+0000 front 2024-09-11T23:35:37.277821+0000 (oldest deadline 2024-09-11T23:36:00.777764+0000) 2024-09-11T23:36:45.934 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:45 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:45.558+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.478993+0000 front 2024-09-11T23:35:45.478970+0000 (oldest deadline 2024-09-11T23:36:08.379023+0000) 2024-09-11T23:36:45.934 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:45 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:45.558+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:55.980636+0000 front 2024-09-11T23:35:55.980669+0000 (oldest deadline 2024-09-11T23:36:18.880843+0000) 2024-09-11T23:36:45.934 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:45 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:45.558+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-11T23:36:12.486674+0000 front 2024-09-11T23:36:12.486576+0000 (oldest deadline 2024-09-11T23:36:34.186664+0000) 2024-09-11T23:36:45.934 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:45 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:45.558+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-09-11T23:36:20.289712+0000 front 2024-09-11T23:36:20.289628+0000 (oldest deadline 2024-09-11T23:36:43.189713+0000) 2024-09-11T23:36:46.250 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:45 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:45.860+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:35.287175+0000 front 2024-09-11T23:35:35.287164+0000 (oldest deadline 2024-09-11T23:36:01.186976+0000) 2024-09-11T23:36:46.250 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:45 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:45.860+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.288233+0000 front 2024-09-11T23:35:45.288257+0000 (oldest deadline 2024-09-11T23:36:09.988379+0000) 2024-09-11T23:36:46.251 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:45 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:45.860+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:54.590336+0000 front 2024-09-11T23:35:54.590569+0000 (oldest deadline 2024-09-11T23:36:18.690277+0000) 2024-09-11T23:36:46.251 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:45 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:45.860+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-11T23:36:04.591561+0000 front 2024-09-11T23:36:04.591535+0000 (oldest deadline 2024-09-11T23:36:26.891405+0000) 2024-09-11T23:36:46.251 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:45 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:45.860+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-11T23:36:13.193445+0000 front 2024-09-11T23:36:13.193489+0000 (oldest deadline 2024-09-11T23:36:39.093541+0000) 2024-09-11T23:36:46.251 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:45 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:45.860+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-09-11T23:36:19.094094+0000 front 2024-09-11T23:36:19.094012+0000 (oldest deadline 2024-09-11T23:36:44.393951+0000) 2024-09-11T23:36:46.814 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:46 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:46.343+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:33.392902+0000 front 2024-09-11T23:35:33.393259+0000 (oldest deadline 2024-09-11T23:35:59.793635+0000) 2024-09-11T23:36:46.814 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:46 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:46.343+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:46.696487+0000 front 2024-09-11T23:35:46.696550+0000 (oldest deadline 2024-09-11T23:36:12.596707+0000) 2024-09-11T23:36:46.814 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:46 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:46.343+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:52.597139+0000 front 2024-09-11T23:35:52.597169+0000 (oldest deadline 2024-09-11T23:36:18.497326+0000) 2024-09-11T23:36:46.814 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:46 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:46.343+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-11T23:36:03.198553+0000 front 2024-09-11T23:36:03.198476+0000 (oldest deadline 2024-09-11T23:36:27.199197+0000) 2024-09-11T23:36:46.814 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:46 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:46.343+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-11T23:36:11.300666+0000 front 2024-09-11T23:36:11.300802+0000 (oldest deadline 2024-09-11T23:36:34.200458+0000) 2024-09-11T23:36:46.814 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:46 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:46.343+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-09-11T23:36:17.601881+0000 front 2024-09-11T23:36:17.601954+0000 (oldest deadline 2024-09-11T23:36:42.902005+0000) 2024-09-11T23:36:46.933 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:46 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:46.563+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:37.277803+0000 front 2024-09-11T23:35:37.277821+0000 (oldest deadline 2024-09-11T23:36:00.777764+0000) 2024-09-11T23:36:46.934 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:46 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:46.563+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.478993+0000 front 2024-09-11T23:35:45.478970+0000 (oldest deadline 2024-09-11T23:36:08.379023+0000) 2024-09-11T23:36:46.934 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:46 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:46.563+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:55.980636+0000 front 2024-09-11T23:35:55.980669+0000 (oldest deadline 2024-09-11T23:36:18.880843+0000) 2024-09-11T23:36:46.934 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:46 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:46.563+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-11T23:36:12.486674+0000 front 2024-09-11T23:36:12.486576+0000 (oldest deadline 2024-09-11T23:36:34.186664+0000) 2024-09-11T23:36:46.934 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:46 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:46.563+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-09-11T23:36:20.289712+0000 front 2024-09-11T23:36:20.289628+0000 (oldest deadline 2024-09-11T23:36:43.189713+0000) 2024-09-11T23:36:47.250 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:46 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:46.816+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:35.287175+0000 front 2024-09-11T23:35:35.287164+0000 (oldest deadline 2024-09-11T23:36:01.186976+0000) 2024-09-11T23:36:47.250 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:46 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:46.816+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.288233+0000 front 2024-09-11T23:35:45.288257+0000 (oldest deadline 2024-09-11T23:36:09.988379+0000) 2024-09-11T23:36:47.250 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:46 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:46.816+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:54.590336+0000 front 2024-09-11T23:35:54.590569+0000 (oldest deadline 2024-09-11T23:36:18.690277+0000) 2024-09-11T23:36:47.250 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:46 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:46.816+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-11T23:36:04.591561+0000 front 2024-09-11T23:36:04.591535+0000 (oldest deadline 2024-09-11T23:36:26.891405+0000) 2024-09-11T23:36:47.251 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:46 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:46.816+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-11T23:36:13.193445+0000 front 2024-09-11T23:36:13.193489+0000 (oldest deadline 2024-09-11T23:36:39.093541+0000) 2024-09-11T23:36:47.251 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:46 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:46.816+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-09-11T23:36:19.094094+0000 front 2024-09-11T23:36:19.094012+0000 (oldest deadline 2024-09-11T23:36:44.393951+0000) 2024-09-11T23:36:47.412 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:47 smithi160 podman[70885]: 2024-09-11 23:36:47.138489503 +0000 UTC m=+5.829398920 container died 9d9bfb862389a4cf90ffd49f90df0edad80eba1c54d2399f544342de4f7f8a29 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, RELEASE=squid-b53b6d3) 2024-09-11T23:36:47.683 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:47 smithi160 podman[70885]: 2024-09-11 23:36:47.528500503 +0000 UTC m=+6.219409919 container cleanup 9d9bfb862389a4cf90ffd49f90df0edad80eba1c54d2399f544342de4f7f8a29 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T23:36:47.683 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:47 smithi160 bash[70885]: ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8 2024-09-11T23:36:47.683 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:47 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:47.545+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:37.277803+0000 front 2024-09-11T23:35:37.277821+0000 (oldest deadline 2024-09-11T23:36:00.777764+0000) 2024-09-11T23:36:47.684 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:47 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:47.545+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.478993+0000 front 2024-09-11T23:35:45.478970+0000 (oldest deadline 2024-09-11T23:36:08.379023+0000) 2024-09-11T23:36:47.684 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:47 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:47.545+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:55.980636+0000 front 2024-09-11T23:35:55.980669+0000 (oldest deadline 2024-09-11T23:36:18.880843+0000) 2024-09-11T23:36:47.684 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:47 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:47.545+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-11T23:36:12.486674+0000 front 2024-09-11T23:36:12.486576+0000 (oldest deadline 2024-09-11T23:36:34.186664+0000) 2024-09-11T23:36:47.684 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:47 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:47.545+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-09-11T23:36:20.289712+0000 front 2024-09-11T23:36:20.289628+0000 (oldest deadline 2024-09-11T23:36:43.189713+0000) 2024-09-11T23:36:47.814 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:47 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:47.370+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:33.392902+0000 front 2024-09-11T23:35:33.393259+0000 (oldest deadline 2024-09-11T23:35:59.793635+0000) 2024-09-11T23:36:47.814 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:47 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:47.370+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:46.696487+0000 front 2024-09-11T23:35:46.696550+0000 (oldest deadline 2024-09-11T23:36:12.596707+0000) 2024-09-11T23:36:47.814 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:47 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:47.370+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:52.597139+0000 front 2024-09-11T23:35:52.597169+0000 (oldest deadline 2024-09-11T23:36:18.497326+0000) 2024-09-11T23:36:47.814 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:47 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:47.370+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-11T23:36:03.198553+0000 front 2024-09-11T23:36:03.198476+0000 (oldest deadline 2024-09-11T23:36:27.199197+0000) 2024-09-11T23:36:47.814 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:47 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:47.370+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-11T23:36:11.300666+0000 front 2024-09-11T23:36:11.300802+0000 (oldest deadline 2024-09-11T23:36:34.200458+0000) 2024-09-11T23:36:47.814 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:47 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:47.370+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-09-11T23:36:17.601881+0000 front 2024-09-11T23:36:17.601954+0000 (oldest deadline 2024-09-11T23:36:42.902005+0000) 2024-09-11T23:36:48.098 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:47 smithi160 podman[70901]: 2024-09-11 23:36:47.788314962 +0000 UTC m=+0.653058169 container remove 9d9bfb862389a4cf90ffd49f90df0edad80eba1c54d2399f544342de4f7f8a29 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T23:36:48.152 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:47 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:47.842+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:35.287175+0000 front 2024-09-11T23:35:35.287164+0000 (oldest deadline 2024-09-11T23:36:01.186976+0000) 2024-09-11T23:36:48.152 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:47 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:47.842+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.288233+0000 front 2024-09-11T23:35:45.288257+0000 (oldest deadline 2024-09-11T23:36:09.988379+0000) 2024-09-11T23:36:48.153 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:47 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:47.842+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:54.590336+0000 front 2024-09-11T23:35:54.590569+0000 (oldest deadline 2024-09-11T23:36:18.690277+0000) 2024-09-11T23:36:48.153 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:47 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:47.842+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-11T23:36:04.591561+0000 front 2024-09-11T23:36:04.591535+0000 (oldest deadline 2024-09-11T23:36:26.891405+0000) 2024-09-11T23:36:48.153 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:47 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:47.842+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-11T23:36:13.193445+0000 front 2024-09-11T23:36:13.193489+0000 (oldest deadline 2024-09-11T23:36:39.093541+0000) 2024-09-11T23:36:48.153 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:47 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:47.842+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-09-11T23:36:19.094094+0000 front 2024-09-11T23:36:19.094012+0000 (oldest deadline 2024-09-11T23:36:44.393951+0000) 2024-09-11T23:36:48.384 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:48 smithi160 podman[70986]: 2024-09-11 23:36:48.000826939 +0000 UTC m=+0.016063314 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T23:36:48.385 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:48 smithi160 podman[70986]: 2024-09-11 23:36:48.105666858 +0000 UTC m=+0.120903278 container create bc063f83632a99948a7bd2a91167ea6a9884ba9cb1f78880562388e4ce7437a5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8-deactivate, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3) 2024-09-11T23:36:48.385 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:48 smithi160 podman[70986]: 2024-09-11 23:36:48.385228699 +0000 UTC m=+0.400465087 container init bc063f83632a99948a7bd2a91167ea6a9884ba9cb1f78880562388e4ce7437a5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8-deactivate, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T23:36:48.683 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:48 smithi160 podman[70986]: 2024-09-11 23:36:48.38862316 +0000 UTC m=+0.403859538 container start bc063f83632a99948a7bd2a91167ea6a9884ba9cb1f78880562388e4ce7437a5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8-deactivate, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T23:36:48.683 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:48 smithi160 podman[70986]: 2024-09-11 23:36:48.476822918 +0000 UTC m=+0.492059303 container attach bc063f83632a99948a7bd2a91167ea6a9884ba9cb1f78880562388e4ce7437a5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-11T23:36:48.684 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 11 23:36:48 smithi160 podman[70986]: 2024-09-11 23:36:48.570237482 +0000 UTC m=+0.585473867 container died bc063f83632a99948a7bd2a91167ea6a9884ba9cb1f78880562388e4ce7437a5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-8-deactivate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-11T23:36:48.684 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:48 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:48.569+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:37.277803+0000 front 2024-09-11T23:35:37.277821+0000 (oldest deadline 2024-09-11T23:36:00.777764+0000) 2024-09-11T23:36:48.684 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:48 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:48.569+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.478993+0000 front 2024-09-11T23:35:45.478970+0000 (oldest deadline 2024-09-11T23:36:08.379023+0000) 2024-09-11T23:36:48.684 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:48 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:48.569+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:55.980636+0000 front 2024-09-11T23:35:55.980669+0000 (oldest deadline 2024-09-11T23:36:18.880843+0000) 2024-09-11T23:36:48.684 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:48 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:48.569+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-11T23:36:12.486674+0000 front 2024-09-11T23:36:12.486576+0000 (oldest deadline 2024-09-11T23:36:34.186664+0000) 2024-09-11T23:36:48.684 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:48 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:48.569+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-09-11T23:36:20.289712+0000 front 2024-09-11T23:36:20.289628+0000 (oldest deadline 2024-09-11T23:36:43.189713+0000) 2024-09-11T23:36:48.814 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:48 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:48.360+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:33.392902+0000 front 2024-09-11T23:35:33.393259+0000 (oldest deadline 2024-09-11T23:35:59.793635+0000) 2024-09-11T23:36:48.814 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:48 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:48.360+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:46.696487+0000 front 2024-09-11T23:35:46.696550+0000 (oldest deadline 2024-09-11T23:36:12.596707+0000) 2024-09-11T23:36:48.814 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:48 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:48.360+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:52.597139+0000 front 2024-09-11T23:35:52.597169+0000 (oldest deadline 2024-09-11T23:36:18.497326+0000) 2024-09-11T23:36:48.814 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:48 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:48.360+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-11T23:36:03.198553+0000 front 2024-09-11T23:36:03.198476+0000 (oldest deadline 2024-09-11T23:36:27.199197+0000) 2024-09-11T23:36:48.814 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:48 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:48.360+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-11T23:36:11.300666+0000 front 2024-09-11T23:36:11.300802+0000 (oldest deadline 2024-09-11T23:36:34.200458+0000) 2024-09-11T23:36:48.814 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:48 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:48.360+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-09-11T23:36:17.601881+0000 front 2024-09-11T23:36:17.601954+0000 (oldest deadline 2024-09-11T23:36:42.902005+0000) 2024-09-11T23:36:49.206 DEBUG:teuthology.orchestra.run.smithi160:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8b03efce-7092-11ef-bcea-c7b262605968@osd.8.service' 2024-09-11T23:36:49.248 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T23:36:49.249 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-09-11T23:36:49.249 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-09-11T23:36:49.249 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ceph-8b03efce-7092-11ef-bcea-c7b262605968@osd.9 2024-09-11T23:36:49.250 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:48 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:48.856+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:35.287175+0000 front 2024-09-11T23:35:35.287164+0000 (oldest deadline 2024-09-11T23:36:01.186976+0000) 2024-09-11T23:36:49.250 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:48 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:48.856+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.288233+0000 front 2024-09-11T23:35:45.288257+0000 (oldest deadline 2024-09-11T23:36:09.988379+0000) 2024-09-11T23:36:49.250 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:48 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:48.856+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:54.590336+0000 front 2024-09-11T23:35:54.590569+0000 (oldest deadline 2024-09-11T23:36:18.690277+0000) 2024-09-11T23:36:49.250 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:48 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:48.856+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-11T23:36:04.591561+0000 front 2024-09-11T23:36:04.591535+0000 (oldest deadline 2024-09-11T23:36:26.891405+0000) 2024-09-11T23:36:49.250 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:48 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:48.856+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-11T23:36:13.193445+0000 front 2024-09-11T23:36:13.193489+0000 (oldest deadline 2024-09-11T23:36:39.093541+0000) 2024-09-11T23:36:49.251 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:48 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:48.856+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-09-11T23:36:19.094094+0000 front 2024-09-11T23:36:19.094012+0000 (oldest deadline 2024-09-11T23:36:44.393951+0000) 2024-09-11T23:36:49.564 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:49 smithi037 systemd[1]: Stopping Ceph osd.9 for 8b03efce-7092-11ef-bcea-c7b262605968... 2024-09-11T23:36:49.564 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:49 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:49.403+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:33.392902+0000 front 2024-09-11T23:35:33.393259+0000 (oldest deadline 2024-09-11T23:35:59.793635+0000) 2024-09-11T23:36:49.564 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:49 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:49.404+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:46.696487+0000 front 2024-09-11T23:35:46.696550+0000 (oldest deadline 2024-09-11T23:36:12.596707+0000) 2024-09-11T23:36:49.564 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:49 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:49.404+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:52.597139+0000 front 2024-09-11T23:35:52.597169+0000 (oldest deadline 2024-09-11T23:36:18.497326+0000) 2024-09-11T23:36:49.564 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:49 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:49.404+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-11T23:36:03.198553+0000 front 2024-09-11T23:36:03.198476+0000 (oldest deadline 2024-09-11T23:36:27.199197+0000) 2024-09-11T23:36:49.564 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:49 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:49.404+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-11T23:36:11.300666+0000 front 2024-09-11T23:36:11.300802+0000 (oldest deadline 2024-09-11T23:36:34.200458+0000) 2024-09-11T23:36:49.564 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:49 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:49.404+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-09-11T23:36:17.601881+0000 front 2024-09-11T23:36:17.601954+0000 (oldest deadline 2024-09-11T23:36:42.902005+0000) 2024-09-11T23:36:49.933 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:49 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:49.574+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:37.277803+0000 front 2024-09-11T23:35:37.277821+0000 (oldest deadline 2024-09-11T23:36:00.777764+0000) 2024-09-11T23:36:49.933 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:49 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:49.574+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.478993+0000 front 2024-09-11T23:35:45.478970+0000 (oldest deadline 2024-09-11T23:36:08.379023+0000) 2024-09-11T23:36:49.933 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:49 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:49.574+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:55.980636+0000 front 2024-09-11T23:35:55.980669+0000 (oldest deadline 2024-09-11T23:36:18.880843+0000) 2024-09-11T23:36:49.933 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:49 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:49.574+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-11T23:36:12.486674+0000 front 2024-09-11T23:36:12.486576+0000 (oldest deadline 2024-09-11T23:36:34.186664+0000) 2024-09-11T23:36:49.934 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:49 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:49.574+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-09-11T23:36:20.289712+0000 front 2024-09-11T23:36:20.289628+0000 (oldest deadline 2024-09-11T23:36:43.189713+0000) 2024-09-11T23:36:50.064 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:49 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:49.686+0000 7f2f16800640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T23:36:50.064 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:49 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:49.686+0000 7f2f16800640 -1 osd.9 99 *** Got signal Terminated *** 2024-09-11T23:36:50.064 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:49 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:49.686+0000 7f2f16800640 -1 osd.9 99 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T23:36:50.250 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:49 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:49.900+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:35.287175+0000 front 2024-09-11T23:35:35.287164+0000 (oldest deadline 2024-09-11T23:36:01.186976+0000) 2024-09-11T23:36:50.250 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:49 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:49.900+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.288233+0000 front 2024-09-11T23:35:45.288257+0000 (oldest deadline 2024-09-11T23:36:09.988379+0000) 2024-09-11T23:36:50.251 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:49 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:49.900+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:54.590336+0000 front 2024-09-11T23:35:54.590569+0000 (oldest deadline 2024-09-11T23:36:18.690277+0000) 2024-09-11T23:36:50.251 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:49 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:49.900+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-11T23:36:04.591561+0000 front 2024-09-11T23:36:04.591535+0000 (oldest deadline 2024-09-11T23:36:26.891405+0000) 2024-09-11T23:36:50.251 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:49 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:49.900+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-11T23:36:13.193445+0000 front 2024-09-11T23:36:13.193489+0000 (oldest deadline 2024-09-11T23:36:39.093541+0000) 2024-09-11T23:36:50.251 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:49 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:49.900+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-09-11T23:36:19.094094+0000 front 2024-09-11T23:36:19.094012+0000 (oldest deadline 2024-09-11T23:36:44.393951+0000) 2024-09-11T23:36:50.683 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:50 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:50.539+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:37.277803+0000 front 2024-09-11T23:35:37.277821+0000 (oldest deadline 2024-09-11T23:36:00.777764+0000) 2024-09-11T23:36:50.683 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:50 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:50.539+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.478993+0000 front 2024-09-11T23:35:45.478970+0000 (oldest deadline 2024-09-11T23:36:08.379023+0000) 2024-09-11T23:36:50.683 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:50 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:50.539+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:55.980636+0000 front 2024-09-11T23:35:55.980669+0000 (oldest deadline 2024-09-11T23:36:18.880843+0000) 2024-09-11T23:36:50.683 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:50 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:50.539+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-11T23:36:12.486674+0000 front 2024-09-11T23:36:12.486576+0000 (oldest deadline 2024-09-11T23:36:34.186664+0000) 2024-09-11T23:36:50.684 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:50 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:50.539+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-09-11T23:36:20.289712+0000 front 2024-09-11T23:36:20.289628+0000 (oldest deadline 2024-09-11T23:36:43.189713+0000) 2024-09-11T23:36:50.814 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:50 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:50.430+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:33.392902+0000 front 2024-09-11T23:35:33.393259+0000 (oldest deadline 2024-09-11T23:35:59.793635+0000) 2024-09-11T23:36:50.814 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:50 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:50.430+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:46.696487+0000 front 2024-09-11T23:35:46.696550+0000 (oldest deadline 2024-09-11T23:36:12.596707+0000) 2024-09-11T23:36:50.814 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:50 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:50.430+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:52.597139+0000 front 2024-09-11T23:35:52.597169+0000 (oldest deadline 2024-09-11T23:36:18.497326+0000) 2024-09-11T23:36:50.814 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:50 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:50.430+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-11T23:36:03.198553+0000 front 2024-09-11T23:36:03.198476+0000 (oldest deadline 2024-09-11T23:36:27.199197+0000) 2024-09-11T23:36:50.814 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:50 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:50.430+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-11T23:36:11.300666+0000 front 2024-09-11T23:36:11.300802+0000 (oldest deadline 2024-09-11T23:36:34.200458+0000) 2024-09-11T23:36:50.814 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:50 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:50.430+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-09-11T23:36:17.601881+0000 front 2024-09-11T23:36:17.601954+0000 (oldest deadline 2024-09-11T23:36:42.902005+0000) 2024-09-11T23:36:51.250 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:50 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:50.884+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:35.287175+0000 front 2024-09-11T23:35:35.287164+0000 (oldest deadline 2024-09-11T23:36:01.186976+0000) 2024-09-11T23:36:51.250 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:50 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:50.884+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.288233+0000 front 2024-09-11T23:35:45.288257+0000 (oldest deadline 2024-09-11T23:36:09.988379+0000) 2024-09-11T23:36:51.250 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:50 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:50.884+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:54.590336+0000 front 2024-09-11T23:35:54.590569+0000 (oldest deadline 2024-09-11T23:36:18.690277+0000) 2024-09-11T23:36:51.251 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:50 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:50.884+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-11T23:36:04.591561+0000 front 2024-09-11T23:36:04.591535+0000 (oldest deadline 2024-09-11T23:36:26.891405+0000) 2024-09-11T23:36:51.251 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:50 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:50.884+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-11T23:36:13.193445+0000 front 2024-09-11T23:36:13.193489+0000 (oldest deadline 2024-09-11T23:36:39.093541+0000) 2024-09-11T23:36:51.251 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:50 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:50.884+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-09-11T23:36:19.094094+0000 front 2024-09-11T23:36:19.094012+0000 (oldest deadline 2024-09-11T23:36:44.393951+0000) 2024-09-11T23:36:51.814 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:51 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:51.445+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:33.392902+0000 front 2024-09-11T23:35:33.393259+0000 (oldest deadline 2024-09-11T23:35:59.793635+0000) 2024-09-11T23:36:51.814 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:51 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:51.445+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:46.696487+0000 front 2024-09-11T23:35:46.696550+0000 (oldest deadline 2024-09-11T23:36:12.596707+0000) 2024-09-11T23:36:51.814 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:51 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:51.445+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:52.597139+0000 front 2024-09-11T23:35:52.597169+0000 (oldest deadline 2024-09-11T23:36:18.497326+0000) 2024-09-11T23:36:51.814 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:51 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:51.445+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-11T23:36:03.198553+0000 front 2024-09-11T23:36:03.198476+0000 (oldest deadline 2024-09-11T23:36:27.199197+0000) 2024-09-11T23:36:51.814 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:51 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:51.445+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-11T23:36:11.300666+0000 front 2024-09-11T23:36:11.300802+0000 (oldest deadline 2024-09-11T23:36:34.200458+0000) 2024-09-11T23:36:51.814 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:51 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:51.445+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-09-11T23:36:17.601881+0000 front 2024-09-11T23:36:17.601954+0000 (oldest deadline 2024-09-11T23:36:42.902005+0000) 2024-09-11T23:36:51.933 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:51 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:51.575+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:37.277803+0000 front 2024-09-11T23:35:37.277821+0000 (oldest deadline 2024-09-11T23:36:00.777764+0000) 2024-09-11T23:36:51.934 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:51 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:51.575+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.478993+0000 front 2024-09-11T23:35:45.478970+0000 (oldest deadline 2024-09-11T23:36:08.379023+0000) 2024-09-11T23:36:51.934 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:51 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:51.575+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:55.980636+0000 front 2024-09-11T23:35:55.980669+0000 (oldest deadline 2024-09-11T23:36:18.880843+0000) 2024-09-11T23:36:51.934 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:51 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:51.575+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-11T23:36:12.486674+0000 front 2024-09-11T23:36:12.486576+0000 (oldest deadline 2024-09-11T23:36:34.186664+0000) 2024-09-11T23:36:51.934 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:51 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:51.575+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-09-11T23:36:20.289712+0000 front 2024-09-11T23:36:20.289628+0000 (oldest deadline 2024-09-11T23:36:43.189713+0000) 2024-09-11T23:36:52.250 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:51 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:51.907+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:35.287175+0000 front 2024-09-11T23:35:35.287164+0000 (oldest deadline 2024-09-11T23:36:01.186976+0000) 2024-09-11T23:36:52.251 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:51 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:51.907+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.288233+0000 front 2024-09-11T23:35:45.288257+0000 (oldest deadline 2024-09-11T23:36:09.988379+0000) 2024-09-11T23:36:52.251 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:51 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:51.907+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:54.590336+0000 front 2024-09-11T23:35:54.590569+0000 (oldest deadline 2024-09-11T23:36:18.690277+0000) 2024-09-11T23:36:52.251 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:51 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:51.907+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-11T23:36:04.591561+0000 front 2024-09-11T23:36:04.591535+0000 (oldest deadline 2024-09-11T23:36:26.891405+0000) 2024-09-11T23:36:52.251 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:51 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:51.907+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-11T23:36:13.193445+0000 front 2024-09-11T23:36:13.193489+0000 (oldest deadline 2024-09-11T23:36:39.093541+0000) 2024-09-11T23:36:52.251 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:51 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:51.907+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-09-11T23:36:19.094094+0000 front 2024-09-11T23:36:19.094012+0000 (oldest deadline 2024-09-11T23:36:44.393951+0000) 2024-09-11T23:36:52.814 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:52 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:52.415+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:33.392902+0000 front 2024-09-11T23:35:33.393259+0000 (oldest deadline 2024-09-11T23:35:59.793635+0000) 2024-09-11T23:36:52.814 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:52 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:52.415+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:46.696487+0000 front 2024-09-11T23:35:46.696550+0000 (oldest deadline 2024-09-11T23:36:12.596707+0000) 2024-09-11T23:36:52.814 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:52 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:52.415+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:52.597139+0000 front 2024-09-11T23:35:52.597169+0000 (oldest deadline 2024-09-11T23:36:18.497326+0000) 2024-09-11T23:36:52.814 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:52 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:52.415+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-11T23:36:03.198553+0000 front 2024-09-11T23:36:03.198476+0000 (oldest deadline 2024-09-11T23:36:27.199197+0000) 2024-09-11T23:36:52.814 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:52 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:52.415+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-11T23:36:11.300666+0000 front 2024-09-11T23:36:11.300802+0000 (oldest deadline 2024-09-11T23:36:34.200458+0000) 2024-09-11T23:36:52.814 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:52 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:52.415+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-09-11T23:36:17.601881+0000 front 2024-09-11T23:36:17.601954+0000 (oldest deadline 2024-09-11T23:36:42.902005+0000) 2024-09-11T23:36:52.933 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:52 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:52.575+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:37.277803+0000 front 2024-09-11T23:35:37.277821+0000 (oldest deadline 2024-09-11T23:36:00.777764+0000) 2024-09-11T23:36:52.933 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:52 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:52.575+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.478993+0000 front 2024-09-11T23:35:45.478970+0000 (oldest deadline 2024-09-11T23:36:08.379023+0000) 2024-09-11T23:36:52.933 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:52 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:52.575+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:55.980636+0000 front 2024-09-11T23:35:55.980669+0000 (oldest deadline 2024-09-11T23:36:18.880843+0000) 2024-09-11T23:36:52.933 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:52 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:52.575+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-11T23:36:12.486674+0000 front 2024-09-11T23:36:12.486576+0000 (oldest deadline 2024-09-11T23:36:34.186664+0000) 2024-09-11T23:36:52.934 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:52 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:52.575+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-09-11T23:36:20.289712+0000 front 2024-09-11T23:36:20.289628+0000 (oldest deadline 2024-09-11T23:36:43.189713+0000) 2024-09-11T23:36:53.250 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:52 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:52.900+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:35.287175+0000 front 2024-09-11T23:35:35.287164+0000 (oldest deadline 2024-09-11T23:36:01.186976+0000) 2024-09-11T23:36:53.250 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:52 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:52.900+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.288233+0000 front 2024-09-11T23:35:45.288257+0000 (oldest deadline 2024-09-11T23:36:09.988379+0000) 2024-09-11T23:36:53.250 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:52 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:52.900+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:54.590336+0000 front 2024-09-11T23:35:54.590569+0000 (oldest deadline 2024-09-11T23:36:18.690277+0000) 2024-09-11T23:36:53.251 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:52 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:52.900+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-11T23:36:04.591561+0000 front 2024-09-11T23:36:04.591535+0000 (oldest deadline 2024-09-11T23:36:26.891405+0000) 2024-09-11T23:36:53.251 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:52 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:52.900+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-11T23:36:13.193445+0000 front 2024-09-11T23:36:13.193489+0000 (oldest deadline 2024-09-11T23:36:39.093541+0000) 2024-09-11T23:36:53.251 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:52 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:52.900+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-09-11T23:36:19.094094+0000 front 2024-09-11T23:36:19.094012+0000 (oldest deadline 2024-09-11T23:36:44.393951+0000) 2024-09-11T23:36:53.814 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:53 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:53.377+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:33.392902+0000 front 2024-09-11T23:35:33.393259+0000 (oldest deadline 2024-09-11T23:35:59.793635+0000) 2024-09-11T23:36:53.814 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:53 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:53.377+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:46.696487+0000 front 2024-09-11T23:35:46.696550+0000 (oldest deadline 2024-09-11T23:36:12.596707+0000) 2024-09-11T23:36:53.814 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:53 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:53.377+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:52.597139+0000 front 2024-09-11T23:35:52.597169+0000 (oldest deadline 2024-09-11T23:36:18.497326+0000) 2024-09-11T23:36:53.814 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:53 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:53.377+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-11T23:36:03.198553+0000 front 2024-09-11T23:36:03.198476+0000 (oldest deadline 2024-09-11T23:36:27.199197+0000) 2024-09-11T23:36:53.814 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:53 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:53.377+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-11T23:36:11.300666+0000 front 2024-09-11T23:36:11.300802+0000 (oldest deadline 2024-09-11T23:36:34.200458+0000) 2024-09-11T23:36:53.814 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:53 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:53.377+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-09-11T23:36:17.601881+0000 front 2024-09-11T23:36:17.601954+0000 (oldest deadline 2024-09-11T23:36:42.902005+0000) 2024-09-11T23:36:53.933 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:53 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:53.555+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:37.277803+0000 front 2024-09-11T23:35:37.277821+0000 (oldest deadline 2024-09-11T23:36:00.777764+0000) 2024-09-11T23:36:53.933 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:53 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:53.555+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.478993+0000 front 2024-09-11T23:35:45.478970+0000 (oldest deadline 2024-09-11T23:36:08.379023+0000) 2024-09-11T23:36:53.933 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:53 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:53.555+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:55.980636+0000 front 2024-09-11T23:35:55.980669+0000 (oldest deadline 2024-09-11T23:36:18.880843+0000) 2024-09-11T23:36:53.933 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:53 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:53.555+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-11T23:36:12.486674+0000 front 2024-09-11T23:36:12.486576+0000 (oldest deadline 2024-09-11T23:36:34.186664+0000) 2024-09-11T23:36:53.933 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:53 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:53.555+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-09-11T23:36:20.289712+0000 front 2024-09-11T23:36:20.289628+0000 (oldest deadline 2024-09-11T23:36:43.189713+0000) 2024-09-11T23:36:54.250 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:53 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:53.941+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:35.287175+0000 front 2024-09-11T23:35:35.287164+0000 (oldest deadline 2024-09-11T23:36:01.186976+0000) 2024-09-11T23:36:54.250 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:53 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:53.941+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.288233+0000 front 2024-09-11T23:35:45.288257+0000 (oldest deadline 2024-09-11T23:36:09.988379+0000) 2024-09-11T23:36:54.251 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:53 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:53.941+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:54.590336+0000 front 2024-09-11T23:35:54.590569+0000 (oldest deadline 2024-09-11T23:36:18.690277+0000) 2024-09-11T23:36:54.251 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:53 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:53.941+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-11T23:36:04.591561+0000 front 2024-09-11T23:36:04.591535+0000 (oldest deadline 2024-09-11T23:36:26.891405+0000) 2024-09-11T23:36:54.251 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:53 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:53.941+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-11T23:36:13.193445+0000 front 2024-09-11T23:36:13.193489+0000 (oldest deadline 2024-09-11T23:36:39.093541+0000) 2024-09-11T23:36:54.251 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:53 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:53.941+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-09-11T23:36:19.094094+0000 front 2024-09-11T23:36:19.094012+0000 (oldest deadline 2024-09-11T23:36:44.393951+0000) 2024-09-11T23:36:54.251 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:53 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:53.941+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-09-11T23:36:27.295022+0000 front 2024-09-11T23:36:27.295163+0000 (oldest deadline 2024-09-11T23:36:53.194775+0000) 2024-09-11T23:36:54.814 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:54 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:54.377+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:33.392902+0000 front 2024-09-11T23:35:33.393259+0000 (oldest deadline 2024-09-11T23:35:59.793635+0000) 2024-09-11T23:36:54.814 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:54 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:54.377+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:46.696487+0000 front 2024-09-11T23:35:46.696550+0000 (oldest deadline 2024-09-11T23:36:12.596707+0000) 2024-09-11T23:36:54.814 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:54 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:54.377+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:52.597139+0000 front 2024-09-11T23:35:52.597169+0000 (oldest deadline 2024-09-11T23:36:18.497326+0000) 2024-09-11T23:36:54.814 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:54 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:54.377+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-11T23:36:03.198553+0000 front 2024-09-11T23:36:03.198476+0000 (oldest deadline 2024-09-11T23:36:27.199197+0000) 2024-09-11T23:36:54.814 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:54 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:54.377+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-11T23:36:11.300666+0000 front 2024-09-11T23:36:11.300802+0000 (oldest deadline 2024-09-11T23:36:34.200458+0000) 2024-09-11T23:36:54.814 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:54 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9[64833]: 2024-09-11T23:36:54.377+0000 7f2f12200640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-09-11T23:36:17.601881+0000 front 2024-09-11T23:36:17.601954+0000 (oldest deadline 2024-09-11T23:36:42.902005+0000) 2024-09-11T23:36:54.933 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:54 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:54.564+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:37.277803+0000 front 2024-09-11T23:35:37.277821+0000 (oldest deadline 2024-09-11T23:36:00.777764+0000) 2024-09-11T23:36:54.933 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:54 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:54.564+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.478993+0000 front 2024-09-11T23:35:45.478970+0000 (oldest deadline 2024-09-11T23:36:08.379023+0000) 2024-09-11T23:36:54.933 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:54 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:54.564+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:55.980636+0000 front 2024-09-11T23:35:55.980669+0000 (oldest deadline 2024-09-11T23:36:18.880843+0000) 2024-09-11T23:36:54.933 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:54 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:54.564+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-11T23:36:12.486674+0000 front 2024-09-11T23:36:12.486576+0000 (oldest deadline 2024-09-11T23:36:34.186664+0000) 2024-09-11T23:36:54.934 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:54 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:54.564+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-09-11T23:36:20.289712+0000 front 2024-09-11T23:36:20.289628+0000 (oldest deadline 2024-09-11T23:36:43.189713+0000) 2024-09-11T23:36:54.934 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:54 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:54.564+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-09-11T23:36:28.491009+0000 front 2024-09-11T23:36:28.490992+0000 (oldest deadline 2024-09-11T23:36:53.790884+0000) 2024-09-11T23:36:55.250 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:54 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:54.955+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:35.287175+0000 front 2024-09-11T23:35:35.287164+0000 (oldest deadline 2024-09-11T23:36:01.186976+0000) 2024-09-11T23:36:55.250 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:54 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:54.955+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.288233+0000 front 2024-09-11T23:35:45.288257+0000 (oldest deadline 2024-09-11T23:36:09.988379+0000) 2024-09-11T23:36:55.250 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:54 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:54.955+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:54.590336+0000 front 2024-09-11T23:35:54.590569+0000 (oldest deadline 2024-09-11T23:36:18.690277+0000) 2024-09-11T23:36:55.251 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:54 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:54.955+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-11T23:36:04.591561+0000 front 2024-09-11T23:36:04.591535+0000 (oldest deadline 2024-09-11T23:36:26.891405+0000) 2024-09-11T23:36:55.251 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:54 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:54.955+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-11T23:36:13.193445+0000 front 2024-09-11T23:36:13.193489+0000 (oldest deadline 2024-09-11T23:36:39.093541+0000) 2024-09-11T23:36:55.251 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:54 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:54.955+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-09-11T23:36:19.094094+0000 front 2024-09-11T23:36:19.094012+0000 (oldest deadline 2024-09-11T23:36:44.393951+0000) 2024-09-11T23:36:55.251 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:54 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:54.955+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-09-11T23:36:27.295022+0000 front 2024-09-11T23:36:27.295163+0000 (oldest deadline 2024-09-11T23:36:53.194775+0000) 2024-09-11T23:36:55.728 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:55 smithi037 podman[90838]: 2024-09-11 23:36:55.442934798 +0000 UTC m=+5.903156027 container died 1bc3ec3f10d2ef146402deded98537050465cf7c621ff2e639baaece2ca708dd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-11T23:36:55.933 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:55 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:55.524+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:37.277803+0000 front 2024-09-11T23:35:37.277821+0000 (oldest deadline 2024-09-11T23:36:00.777764+0000) 2024-09-11T23:36:55.933 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:55 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:55.524+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.478993+0000 front 2024-09-11T23:35:45.478970+0000 (oldest deadline 2024-09-11T23:36:08.379023+0000) 2024-09-11T23:36:55.934 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:55 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:55.524+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:55.980636+0000 front 2024-09-11T23:35:55.980669+0000 (oldest deadline 2024-09-11T23:36:18.880843+0000) 2024-09-11T23:36:55.934 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:55 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:55.524+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-11T23:36:12.486674+0000 front 2024-09-11T23:36:12.486576+0000 (oldest deadline 2024-09-11T23:36:34.186664+0000) 2024-09-11T23:36:55.934 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:55 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:55.524+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-09-11T23:36:20.289712+0000 front 2024-09-11T23:36:20.289628+0000 (oldest deadline 2024-09-11T23:36:43.189713+0000) 2024-09-11T23:36:55.934 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:55 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:55.524+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-09-11T23:36:28.491009+0000 front 2024-09-11T23:36:28.490992+0000 (oldest deadline 2024-09-11T23:36:53.790884+0000) 2024-09-11T23:36:56.064 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:55 smithi037 podman[90838]: 2024-09-11 23:36:55.858148968 +0000 UTC m=+6.318370197 container cleanup 1bc3ec3f10d2ef146402deded98537050465cf7c621ff2e639baaece2ca708dd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T23:36:56.064 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:55 smithi037 bash[90838]: ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9 2024-09-11T23:36:56.250 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:55 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:55.929+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:35.287175+0000 front 2024-09-11T23:35:35.287164+0000 (oldest deadline 2024-09-11T23:36:01.186976+0000) 2024-09-11T23:36:56.250 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:55 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:55.929+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.288233+0000 front 2024-09-11T23:35:45.288257+0000 (oldest deadline 2024-09-11T23:36:09.988379+0000) 2024-09-11T23:36:56.250 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:55 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:55.929+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:54.590336+0000 front 2024-09-11T23:35:54.590569+0000 (oldest deadline 2024-09-11T23:36:18.690277+0000) 2024-09-11T23:36:56.250 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:55 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:55.929+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-11T23:36:04.591561+0000 front 2024-09-11T23:36:04.591535+0000 (oldest deadline 2024-09-11T23:36:26.891405+0000) 2024-09-11T23:36:56.250 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:55 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:55.929+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-11T23:36:13.193445+0000 front 2024-09-11T23:36:13.193489+0000 (oldest deadline 2024-09-11T23:36:39.093541+0000) 2024-09-11T23:36:56.251 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:55 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:55.929+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-09-11T23:36:19.094094+0000 front 2024-09-11T23:36:19.094012+0000 (oldest deadline 2024-09-11T23:36:44.393951+0000) 2024-09-11T23:36:56.251 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:55 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:55.929+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-09-11T23:36:27.295022+0000 front 2024-09-11T23:36:27.295163+0000 (oldest deadline 2024-09-11T23:36:53.194775+0000) 2024-09-11T23:36:56.564 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:56 smithi037 podman[90856]: 2024-09-11 23:36:56.130403737 +0000 UTC m=+0.681507055 container remove 1bc3ec3f10d2ef146402deded98537050465cf7c621ff2e639baaece2ca708dd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T23:36:56.933 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:56 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:56.516+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:37.277803+0000 front 2024-09-11T23:35:37.277821+0000 (oldest deadline 2024-09-11T23:36:00.777764+0000) 2024-09-11T23:36:56.933 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:56 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:56.516+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.478993+0000 front 2024-09-11T23:35:45.478970+0000 (oldest deadline 2024-09-11T23:36:08.379023+0000) 2024-09-11T23:36:56.933 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:56 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:56.516+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:55.980636+0000 front 2024-09-11T23:35:55.980669+0000 (oldest deadline 2024-09-11T23:36:18.880843+0000) 2024-09-11T23:36:56.933 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:56 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:56.516+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-11T23:36:12.486674+0000 front 2024-09-11T23:36:12.486576+0000 (oldest deadline 2024-09-11T23:36:34.186664+0000) 2024-09-11T23:36:56.933 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:56 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:56.516+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-09-11T23:36:20.289712+0000 front 2024-09-11T23:36:20.289628+0000 (oldest deadline 2024-09-11T23:36:43.189713+0000) 2024-09-11T23:36:56.934 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:56 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:56.516+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-09-11T23:36:28.491009+0000 front 2024-09-11T23:36:28.490992+0000 (oldest deadline 2024-09-11T23:36:53.790884+0000) 2024-09-11T23:36:56.937 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:56 smithi037 podman[90945]: 2024-09-11 23:36:56.568011184 +0000 UTC m=+0.027630946 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T23:36:56.937 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:56 smithi037 podman[90945]: 2024-09-11 23:36:56.718560264 +0000 UTC m=+0.178180016 container create 29b299d3881dbebf93e3489b6765d56a4c19ad561041e3efec2d59eaaa378a21 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9-deactivate, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-11T23:36:56.937 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:56 smithi037 podman[90945]: 2024-09-11 23:36:56.937483209 +0000 UTC m=+0.397102971 container init 29b299d3881dbebf93e3489b6765d56a4c19ad561041e3efec2d59eaaa378a21 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-11T23:36:57.202 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:56 smithi037 podman[90945]: 2024-09-11 23:36:56.945279626 +0000 UTC m=+0.404899378 container start 29b299d3881dbebf93e3489b6765d56a4c19ad561041e3efec2d59eaaa378a21 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9-deactivate, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-11T23:36:57.202 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:57 smithi037 podman[90945]: 2024-09-11 23:36:57.028649301 +0000 UTC m=+0.488269054 container attach 29b299d3881dbebf93e3489b6765d56a4c19ad561041e3efec2d59eaaa378a21 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9-deactivate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-11T23:36:57.202 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 11 23:36:57 smithi037 podman[90945]: 2024-09-11 23:36:57.202890386 +0000 UTC m=+0.662510145 container died 29b299d3881dbebf93e3489b6765d56a4c19ad561041e3efec2d59eaaa378a21 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-9-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-11T23:36:57.250 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:56 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:56.940+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:35.287175+0000 front 2024-09-11T23:35:35.287164+0000 (oldest deadline 2024-09-11T23:36:01.186976+0000) 2024-09-11T23:36:57.251 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:56 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:56.940+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.288233+0000 front 2024-09-11T23:35:45.288257+0000 (oldest deadline 2024-09-11T23:36:09.988379+0000) 2024-09-11T23:36:57.251 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:56 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:56.940+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:54.590336+0000 front 2024-09-11T23:35:54.590569+0000 (oldest deadline 2024-09-11T23:36:18.690277+0000) 2024-09-11T23:36:57.251 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:56 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:56.940+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-11T23:36:04.591561+0000 front 2024-09-11T23:36:04.591535+0000 (oldest deadline 2024-09-11T23:36:26.891405+0000) 2024-09-11T23:36:57.251 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:56 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:56.940+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-11T23:36:13.193445+0000 front 2024-09-11T23:36:13.193489+0000 (oldest deadline 2024-09-11T23:36:39.093541+0000) 2024-09-11T23:36:57.251 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:56 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:56.940+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-09-11T23:36:19.094094+0000 front 2024-09-11T23:36:19.094012+0000 (oldest deadline 2024-09-11T23:36:44.393951+0000) 2024-09-11T23:36:57.251 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:56 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:56.940+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-09-11T23:36:27.295022+0000 front 2024-09-11T23:36:27.295163+0000 (oldest deadline 2024-09-11T23:36:53.194775+0000) 2024-09-11T23:36:57.834 DEBUG:teuthology.orchestra.run.smithi037:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8b03efce-7092-11ef-bcea-c7b262605968@osd.9.service' 2024-09-11T23:36:57.910 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T23:36:57.910 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-09-11T23:36:57.910 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-09-11T23:36:57.910 DEBUG:teuthology.orchestra.run.smithi123:> sudo systemctl stop ceph-8b03efce-7092-11ef-bcea-c7b262605968@osd.10 2024-09-11T23:36:57.933 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:57 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:57.527+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:37.277803+0000 front 2024-09-11T23:35:37.277821+0000 (oldest deadline 2024-09-11T23:36:00.777764+0000) 2024-09-11T23:36:57.933 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:57 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:57.527+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.478993+0000 front 2024-09-11T23:35:45.478970+0000 (oldest deadline 2024-09-11T23:36:08.379023+0000) 2024-09-11T23:36:57.933 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:57 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:57.527+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:55.980636+0000 front 2024-09-11T23:35:55.980669+0000 (oldest deadline 2024-09-11T23:36:18.880843+0000) 2024-09-11T23:36:57.933 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:57 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:57.527+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-11T23:36:12.486674+0000 front 2024-09-11T23:36:12.486576+0000 (oldest deadline 2024-09-11T23:36:34.186664+0000) 2024-09-11T23:36:57.934 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:57 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:57.527+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-09-11T23:36:20.289712+0000 front 2024-09-11T23:36:20.289628+0000 (oldest deadline 2024-09-11T23:36:43.189713+0000) 2024-09-11T23:36:57.934 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:57 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:57.527+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-09-11T23:36:28.491009+0000 front 2024-09-11T23:36:28.490992+0000 (oldest deadline 2024-09-11T23:36:53.790884+0000) 2024-09-11T23:36:58.196 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:57 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:57.954+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:35.287175+0000 front 2024-09-11T23:35:35.287164+0000 (oldest deadline 2024-09-11T23:36:01.186976+0000) 2024-09-11T23:36:58.196 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:57 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:57.954+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.288233+0000 front 2024-09-11T23:35:45.288257+0000 (oldest deadline 2024-09-11T23:36:09.988379+0000) 2024-09-11T23:36:58.196 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:57 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:57.954+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:54.590336+0000 front 2024-09-11T23:35:54.590569+0000 (oldest deadline 2024-09-11T23:36:18.690277+0000) 2024-09-11T23:36:58.196 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:57 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:57.954+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-11T23:36:04.591561+0000 front 2024-09-11T23:36:04.591535+0000 (oldest deadline 2024-09-11T23:36:26.891405+0000) 2024-09-11T23:36:58.196 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:57 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:57.954+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-11T23:36:13.193445+0000 front 2024-09-11T23:36:13.193489+0000 (oldest deadline 2024-09-11T23:36:39.093541+0000) 2024-09-11T23:36:58.196 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:57 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:57.954+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-09-11T23:36:19.094094+0000 front 2024-09-11T23:36:19.094012+0000 (oldest deadline 2024-09-11T23:36:44.393951+0000) 2024-09-11T23:36:58.196 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:57 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:57.954+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-09-11T23:36:27.295022+0000 front 2024-09-11T23:36:27.295163+0000 (oldest deadline 2024-09-11T23:36:53.194775+0000) 2024-09-11T23:36:58.196 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:57 smithi123 systemd[1]: Stopping Ceph osd.10 for 8b03efce-7092-11ef-bcea-c7b262605968... 2024-09-11T23:36:58.500 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:58 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:58.238+0000 7ff04a37c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T23:36:58.501 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:58 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:58.238+0000 7ff04a37c640 -1 osd.10 99 *** Got signal Terminated *** 2024-09-11T23:36:58.501 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:58 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:58.238+0000 7ff04a37c640 -1 osd.10 99 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T23:36:58.933 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:58 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:58.554+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:37.277803+0000 front 2024-09-11T23:35:37.277821+0000 (oldest deadline 2024-09-11T23:36:00.777764+0000) 2024-09-11T23:36:58.933 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:58 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:58.554+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.478993+0000 front 2024-09-11T23:35:45.478970+0000 (oldest deadline 2024-09-11T23:36:08.379023+0000) 2024-09-11T23:36:58.934 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:58 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:58.554+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:55.980636+0000 front 2024-09-11T23:35:55.980669+0000 (oldest deadline 2024-09-11T23:36:18.880843+0000) 2024-09-11T23:36:58.934 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:58 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:58.554+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-11T23:36:12.486674+0000 front 2024-09-11T23:36:12.486576+0000 (oldest deadline 2024-09-11T23:36:34.186664+0000) 2024-09-11T23:36:58.934 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:58 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:58.554+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-09-11T23:36:20.289712+0000 front 2024-09-11T23:36:20.289628+0000 (oldest deadline 2024-09-11T23:36:43.189713+0000) 2024-09-11T23:36:58.934 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:58 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:58.554+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-09-11T23:36:28.491009+0000 front 2024-09-11T23:36:28.490992+0000 (oldest deadline 2024-09-11T23:36:53.790884+0000) 2024-09-11T23:36:59.250 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:58 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:58.910+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:35.287175+0000 front 2024-09-11T23:35:35.287164+0000 (oldest deadline 2024-09-11T23:36:01.186976+0000) 2024-09-11T23:36:59.250 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:58 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:58.910+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.288233+0000 front 2024-09-11T23:35:45.288257+0000 (oldest deadline 2024-09-11T23:36:09.988379+0000) 2024-09-11T23:36:59.250 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:58 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:58.910+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:54.590336+0000 front 2024-09-11T23:35:54.590569+0000 (oldest deadline 2024-09-11T23:36:18.690277+0000) 2024-09-11T23:36:59.250 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:58 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:58.910+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-11T23:36:04.591561+0000 front 2024-09-11T23:36:04.591535+0000 (oldest deadline 2024-09-11T23:36:26.891405+0000) 2024-09-11T23:36:59.250 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:58 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:58.910+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-11T23:36:13.193445+0000 front 2024-09-11T23:36:13.193489+0000 (oldest deadline 2024-09-11T23:36:39.093541+0000) 2024-09-11T23:36:59.251 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:58 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:58.910+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-09-11T23:36:19.094094+0000 front 2024-09-11T23:36:19.094012+0000 (oldest deadline 2024-09-11T23:36:44.393951+0000) 2024-09-11T23:36:59.251 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:58 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:58.910+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-09-11T23:36:27.295022+0000 front 2024-09-11T23:36:27.295163+0000 (oldest deadline 2024-09-11T23:36:53.194775+0000) 2024-09-11T23:36:59.933 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:59 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:59.586+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:37.277803+0000 front 2024-09-11T23:35:37.277821+0000 (oldest deadline 2024-09-11T23:36:00.777764+0000) 2024-09-11T23:36:59.933 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:59 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:59.586+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.478993+0000 front 2024-09-11T23:35:45.478970+0000 (oldest deadline 2024-09-11T23:36:08.379023+0000) 2024-09-11T23:36:59.934 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:59 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:59.586+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:55.980636+0000 front 2024-09-11T23:35:55.980669+0000 (oldest deadline 2024-09-11T23:36:18.880843+0000) 2024-09-11T23:36:59.934 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:59 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:59.586+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-11T23:36:12.486674+0000 front 2024-09-11T23:36:12.486576+0000 (oldest deadline 2024-09-11T23:36:34.186664+0000) 2024-09-11T23:36:59.934 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:59 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:59.586+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-09-11T23:36:20.289712+0000 front 2024-09-11T23:36:20.289628+0000 (oldest deadline 2024-09-11T23:36:43.189713+0000) 2024-09-11T23:36:59.934 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:36:59 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:36:59.586+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-09-11T23:36:28.491009+0000 front 2024-09-11T23:36:28.490992+0000 (oldest deadline 2024-09-11T23:36:53.790884+0000) 2024-09-11T23:37:00.250 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:59 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:59.888+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:35.287175+0000 front 2024-09-11T23:35:35.287164+0000 (oldest deadline 2024-09-11T23:36:01.186976+0000) 2024-09-11T23:37:00.250 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:59 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:59.888+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.288233+0000 front 2024-09-11T23:35:45.288257+0000 (oldest deadline 2024-09-11T23:36:09.988379+0000) 2024-09-11T23:37:00.251 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:59 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:59.888+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:54.590336+0000 front 2024-09-11T23:35:54.590569+0000 (oldest deadline 2024-09-11T23:36:18.690277+0000) 2024-09-11T23:37:00.251 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:59 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:59.888+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-11T23:36:04.591561+0000 front 2024-09-11T23:36:04.591535+0000 (oldest deadline 2024-09-11T23:36:26.891405+0000) 2024-09-11T23:37:00.251 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:59 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:59.888+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-11T23:36:13.193445+0000 front 2024-09-11T23:36:13.193489+0000 (oldest deadline 2024-09-11T23:36:39.093541+0000) 2024-09-11T23:37:00.251 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:59 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:59.888+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-09-11T23:36:19.094094+0000 front 2024-09-11T23:36:19.094012+0000 (oldest deadline 2024-09-11T23:36:44.393951+0000) 2024-09-11T23:37:00.251 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:36:59 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:36:59.888+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-09-11T23:36:27.295022+0000 front 2024-09-11T23:36:27.295163+0000 (oldest deadline 2024-09-11T23:36:53.194775+0000) 2024-09-11T23:37:00.933 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:37:00 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:37:00.606+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:37.277803+0000 front 2024-09-11T23:35:37.277821+0000 (oldest deadline 2024-09-11T23:36:00.777764+0000) 2024-09-11T23:37:00.934 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:37:00 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:37:00.606+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.478993+0000 front 2024-09-11T23:35:45.478970+0000 (oldest deadline 2024-09-11T23:36:08.379023+0000) 2024-09-11T23:37:00.934 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:37:00 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:37:00.606+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:55.980636+0000 front 2024-09-11T23:35:55.980669+0000 (oldest deadline 2024-09-11T23:36:18.880843+0000) 2024-09-11T23:37:00.934 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:37:00 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:37:00.606+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-11T23:36:12.486674+0000 front 2024-09-11T23:36:12.486576+0000 (oldest deadline 2024-09-11T23:36:34.186664+0000) 2024-09-11T23:37:00.934 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:37:00 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:37:00.606+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-09-11T23:36:20.289712+0000 front 2024-09-11T23:36:20.289628+0000 (oldest deadline 2024-09-11T23:36:43.189713+0000) 2024-09-11T23:37:00.934 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:37:00 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:37:00.606+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-09-11T23:36:28.491009+0000 front 2024-09-11T23:36:28.490992+0000 (oldest deadline 2024-09-11T23:36:53.790884+0000) 2024-09-11T23:37:00.934 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:37:00 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:37:00.606+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.123:6820 osd.7 since back 2024-09-11T23:36:37.792615+0000 front 2024-09-11T23:36:37.792597+0000 (oldest deadline 2024-09-11T23:37:00.092512+0000) 2024-09-11T23:37:01.250 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:37:00 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:37:00.923+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:35.287175+0000 front 2024-09-11T23:35:35.287164+0000 (oldest deadline 2024-09-11T23:36:01.186976+0000) 2024-09-11T23:37:01.250 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:37:00 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:37:00.923+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.288233+0000 front 2024-09-11T23:35:45.288257+0000 (oldest deadline 2024-09-11T23:36:09.988379+0000) 2024-09-11T23:37:01.250 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:37:00 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:37:00.923+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:54.590336+0000 front 2024-09-11T23:35:54.590569+0000 (oldest deadline 2024-09-11T23:36:18.690277+0000) 2024-09-11T23:37:01.251 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:37:00 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:37:00.923+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-11T23:36:04.591561+0000 front 2024-09-11T23:36:04.591535+0000 (oldest deadline 2024-09-11T23:36:26.891405+0000) 2024-09-11T23:37:01.251 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:37:00 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:37:00.923+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-11T23:36:13.193445+0000 front 2024-09-11T23:36:13.193489+0000 (oldest deadline 2024-09-11T23:36:39.093541+0000) 2024-09-11T23:37:01.251 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:37:00 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:37:00.923+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-09-11T23:36:19.094094+0000 front 2024-09-11T23:36:19.094012+0000 (oldest deadline 2024-09-11T23:36:44.393951+0000) 2024-09-11T23:37:01.251 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:37:00 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:37:00.923+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-09-11T23:36:27.295022+0000 front 2024-09-11T23:36:27.295163+0000 (oldest deadline 2024-09-11T23:36:53.194775+0000) 2024-09-11T23:37:01.933 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:37:01 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:37:01.613+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:37.277803+0000 front 2024-09-11T23:35:37.277821+0000 (oldest deadline 2024-09-11T23:36:00.777764+0000) 2024-09-11T23:37:01.933 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:37:01 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:37:01.613+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.478993+0000 front 2024-09-11T23:35:45.478970+0000 (oldest deadline 2024-09-11T23:36:08.379023+0000) 2024-09-11T23:37:01.934 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:37:01 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:37:01.613+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:55.980636+0000 front 2024-09-11T23:35:55.980669+0000 (oldest deadline 2024-09-11T23:36:18.880843+0000) 2024-09-11T23:37:01.934 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:37:01 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:37:01.613+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-11T23:36:12.486674+0000 front 2024-09-11T23:36:12.486576+0000 (oldest deadline 2024-09-11T23:36:34.186664+0000) 2024-09-11T23:37:01.934 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:37:01 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:37:01.613+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-09-11T23:36:20.289712+0000 front 2024-09-11T23:36:20.289628+0000 (oldest deadline 2024-09-11T23:36:43.189713+0000) 2024-09-11T23:37:01.934 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:37:01 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:37:01.613+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-09-11T23:36:28.491009+0000 front 2024-09-11T23:36:28.490992+0000 (oldest deadline 2024-09-11T23:36:53.790884+0000) 2024-09-11T23:37:01.934 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:37:01 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:37:01.613+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.123:6820 osd.7 since back 2024-09-11T23:36:37.792615+0000 front 2024-09-11T23:36:37.792597+0000 (oldest deadline 2024-09-11T23:37:00.092512+0000) 2024-09-11T23:37:02.250 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:37:01 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:37:01.887+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:35.287175+0000 front 2024-09-11T23:35:35.287164+0000 (oldest deadline 2024-09-11T23:36:01.186976+0000) 2024-09-11T23:37:02.251 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:37:01 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:37:01.887+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.288233+0000 front 2024-09-11T23:35:45.288257+0000 (oldest deadline 2024-09-11T23:36:09.988379+0000) 2024-09-11T23:37:02.251 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:37:01 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:37:01.887+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:54.590336+0000 front 2024-09-11T23:35:54.590569+0000 (oldest deadline 2024-09-11T23:36:18.690277+0000) 2024-09-11T23:37:02.251 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:37:01 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:37:01.887+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-11T23:36:04.591561+0000 front 2024-09-11T23:36:04.591535+0000 (oldest deadline 2024-09-11T23:36:26.891405+0000) 2024-09-11T23:37:02.251 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:37:01 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:37:01.887+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-11T23:36:13.193445+0000 front 2024-09-11T23:36:13.193489+0000 (oldest deadline 2024-09-11T23:36:39.093541+0000) 2024-09-11T23:37:02.251 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:37:01 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:37:01.887+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-09-11T23:36:19.094094+0000 front 2024-09-11T23:36:19.094012+0000 (oldest deadline 2024-09-11T23:36:44.393951+0000) 2024-09-11T23:37:02.251 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:37:01 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:37:01.887+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-09-11T23:36:27.295022+0000 front 2024-09-11T23:36:27.295163+0000 (oldest deadline 2024-09-11T23:36:53.194775+0000) 2024-09-11T23:37:02.933 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:37:02 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:37:02.662+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:37.277803+0000 front 2024-09-11T23:35:37.277821+0000 (oldest deadline 2024-09-11T23:36:00.777764+0000) 2024-09-11T23:37:02.933 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:37:02 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:37:02.662+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.478993+0000 front 2024-09-11T23:35:45.478970+0000 (oldest deadline 2024-09-11T23:36:08.379023+0000) 2024-09-11T23:37:02.933 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:37:02 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:37:02.662+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:55.980636+0000 front 2024-09-11T23:35:55.980669+0000 (oldest deadline 2024-09-11T23:36:18.880843+0000) 2024-09-11T23:37:02.934 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:37:02 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:37:02.662+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-11T23:36:12.486674+0000 front 2024-09-11T23:36:12.486576+0000 (oldest deadline 2024-09-11T23:36:34.186664+0000) 2024-09-11T23:37:02.934 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:37:02 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:37:02.662+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-09-11T23:36:20.289712+0000 front 2024-09-11T23:36:20.289628+0000 (oldest deadline 2024-09-11T23:36:43.189713+0000) 2024-09-11T23:37:02.934 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:37:02 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:37:02.662+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-09-11T23:36:28.491009+0000 front 2024-09-11T23:36:28.490992+0000 (oldest deadline 2024-09-11T23:36:53.790884+0000) 2024-09-11T23:37:02.934 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:37:02 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:37:02.662+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.123:6820 osd.7 since back 2024-09-11T23:36:37.792615+0000 front 2024-09-11T23:36:37.792597+0000 (oldest deadline 2024-09-11T23:37:00.092512+0000) 2024-09-11T23:37:03.250 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:37:02 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:37:02.865+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:35.287175+0000 front 2024-09-11T23:35:35.287164+0000 (oldest deadline 2024-09-11T23:36:01.186976+0000) 2024-09-11T23:37:03.250 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:37:02 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:37:02.865+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.288233+0000 front 2024-09-11T23:35:45.288257+0000 (oldest deadline 2024-09-11T23:36:09.988379+0000) 2024-09-11T23:37:03.250 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:37:02 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:37:02.865+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:54.590336+0000 front 2024-09-11T23:35:54.590569+0000 (oldest deadline 2024-09-11T23:36:18.690277+0000) 2024-09-11T23:37:03.250 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:37:02 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:37:02.865+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-11T23:36:04.591561+0000 front 2024-09-11T23:36:04.591535+0000 (oldest deadline 2024-09-11T23:36:26.891405+0000) 2024-09-11T23:37:03.251 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:37:02 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:37:02.865+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-11T23:36:13.193445+0000 front 2024-09-11T23:36:13.193489+0000 (oldest deadline 2024-09-11T23:36:39.093541+0000) 2024-09-11T23:37:03.251 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:37:02 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:37:02.865+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-09-11T23:36:19.094094+0000 front 2024-09-11T23:36:19.094012+0000 (oldest deadline 2024-09-11T23:36:44.393951+0000) 2024-09-11T23:37:03.251 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:37:02 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10[60116]: 2024-09-11T23:37:02.865+0000 7ff046992640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-09-11T23:36:27.295022+0000 front 2024-09-11T23:36:27.295163+0000 (oldest deadline 2024-09-11T23:36:53.194775+0000) 2024-09-11T23:37:03.933 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:37:03 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:37:03.625+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:37.277803+0000 front 2024-09-11T23:35:37.277821+0000 (oldest deadline 2024-09-11T23:36:00.777764+0000) 2024-09-11T23:37:03.934 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:37:03 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:37:03.625+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.478993+0000 front 2024-09-11T23:35:45.478970+0000 (oldest deadline 2024-09-11T23:36:08.379023+0000) 2024-09-11T23:37:03.934 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:37:03 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:37:03.625+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:55.980636+0000 front 2024-09-11T23:35:55.980669+0000 (oldest deadline 2024-09-11T23:36:18.880843+0000) 2024-09-11T23:37:03.934 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:37:03 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:37:03.625+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-11T23:36:12.486674+0000 front 2024-09-11T23:36:12.486576+0000 (oldest deadline 2024-09-11T23:36:34.186664+0000) 2024-09-11T23:37:03.934 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:37:03 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:37:03.625+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-09-11T23:36:20.289712+0000 front 2024-09-11T23:36:20.289628+0000 (oldest deadline 2024-09-11T23:36:43.189713+0000) 2024-09-11T23:37:03.934 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:37:03 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:37:03.625+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-09-11T23:36:28.491009+0000 front 2024-09-11T23:36:28.490992+0000 (oldest deadline 2024-09-11T23:36:53.790884+0000) 2024-09-11T23:37:03.934 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:37:03 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:37:03.625+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.123:6820 osd.7 since back 2024-09-11T23:36:37.792615+0000 front 2024-09-11T23:36:37.792597+0000 (oldest deadline 2024-09-11T23:37:00.092512+0000) 2024-09-11T23:37:04.103 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:37:03 smithi123 podman[71775]: 2024-09-11 23:37:03.775256985 +0000 UTC m=+5.666531491 container died 6e09bb0b261ca8ad8fbcc5131bfd21469b643d9dcf20233bb411fe3eba07d807 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T23:37:04.501 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:37:04 smithi123 podman[71775]: 2024-09-11 23:37:04.279705013 +0000 UTC m=+6.170979518 container cleanup 6e09bb0b261ca8ad8fbcc5131bfd21469b643d9dcf20233bb411fe3eba07d807 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-11T23:37:04.502 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:37:04 smithi123 bash[71775]: ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10 2024-09-11T23:37:04.809 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:37:04 smithi123 podman[71792]: 2024-09-11 23:37:04.505921998 +0000 UTC m=+0.733676983 container remove 6e09bb0b261ca8ad8fbcc5131bfd21469b643d9dcf20233bb411fe3eba07d807 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10, ceph=True, GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-11T23:37:04.933 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:37:04 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:37:04.621+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:37.277803+0000 front 2024-09-11T23:35:37.277821+0000 (oldest deadline 2024-09-11T23:36:00.777764+0000) 2024-09-11T23:37:04.933 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:37:04 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:37:04.621+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.478993+0000 front 2024-09-11T23:35:45.478970+0000 (oldest deadline 2024-09-11T23:36:08.379023+0000) 2024-09-11T23:37:04.933 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:37:04 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:37:04.621+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:55.980636+0000 front 2024-09-11T23:35:55.980669+0000 (oldest deadline 2024-09-11T23:36:18.880843+0000) 2024-09-11T23:37:04.933 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:37:04 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:37:04.621+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-11T23:36:12.486674+0000 front 2024-09-11T23:36:12.486576+0000 (oldest deadline 2024-09-11T23:36:34.186664+0000) 2024-09-11T23:37:04.934 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:37:04 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:37:04.621+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-09-11T23:36:20.289712+0000 front 2024-09-11T23:36:20.289628+0000 (oldest deadline 2024-09-11T23:36:43.189713+0000) 2024-09-11T23:37:04.934 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:37:04 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:37:04.621+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-09-11T23:36:28.491009+0000 front 2024-09-11T23:36:28.490992+0000 (oldest deadline 2024-09-11T23:36:53.790884+0000) 2024-09-11T23:37:04.934 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:37:04 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:37:04.621+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.123:6820 osd.7 since back 2024-09-11T23:36:37.792615+0000 front 2024-09-11T23:36:37.792597+0000 (oldest deadline 2024-09-11T23:37:00.092512+0000) 2024-09-11T23:37:05.074 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:37:04 smithi123 podman[71876]: 2024-09-11 23:37:04.713055754 +0000 UTC m=+0.015906855 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T23:37:05.074 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:37:04 smithi123 podman[71876]: 2024-09-11 23:37:04.814799507 +0000 UTC m=+0.117650597 container create 0ca47394283395c7bed3ad1e2de18e1a6dab4549163100233188ea67263a3c19 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10-deactivate, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-11T23:37:05.074 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:37:05 smithi123 podman[71876]: 2024-09-11 23:37:05.075569363 +0000 UTC m=+0.378420453 container init 0ca47394283395c7bed3ad1e2de18e1a6dab4549163100233188ea67263a3c19 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10-deactivate, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T23:37:05.500 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:37:05 smithi123 podman[71876]: 2024-09-11 23:37:05.078971894 +0000 UTC m=+0.381822984 container start 0ca47394283395c7bed3ad1e2de18e1a6dab4549163100233188ea67263a3c19 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10-deactivate, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-11T23:37:05.500 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:37:05 smithi123 podman[71876]: 2024-09-11 23:37:05.158923836 +0000 UTC m=+0.461774934 container attach 0ca47394283395c7bed3ad1e2de18e1a6dab4549163100233188ea67263a3c19 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10-deactivate, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, RELEASE=squid-b53b6d3) 2024-09-11T23:37:05.500 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 11 23:37:05 smithi123 podman[71876]: 2024-09-11 23:37:05.269381605 +0000 UTC m=+0.572232704 container died 0ca47394283395c7bed3ad1e2de18e1a6dab4549163100233188ea67263a3c19 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-10-deactivate, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, ceph=True, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T23:37:05.896 DEBUG:teuthology.orchestra.run.smithi123:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8b03efce-7092-11ef-bcea-c7b262605968@osd.10.service' 2024-09-11T23:37:05.933 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:37:05 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:37:05.576+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:37.277803+0000 front 2024-09-11T23:35:37.277821+0000 (oldest deadline 2024-09-11T23:36:00.777764+0000) 2024-09-11T23:37:05.933 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:37:05 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:37:05.576+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.478993+0000 front 2024-09-11T23:35:45.478970+0000 (oldest deadline 2024-09-11T23:36:08.379023+0000) 2024-09-11T23:37:05.933 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:37:05 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:37:05.576+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:55.980636+0000 front 2024-09-11T23:35:55.980669+0000 (oldest deadline 2024-09-11T23:36:18.880843+0000) 2024-09-11T23:37:05.933 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:37:05 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:37:05.576+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-11T23:36:12.486674+0000 front 2024-09-11T23:36:12.486576+0000 (oldest deadline 2024-09-11T23:36:34.186664+0000) 2024-09-11T23:37:05.934 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:37:05 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:37:05.576+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-09-11T23:36:20.289712+0000 front 2024-09-11T23:36:20.289628+0000 (oldest deadline 2024-09-11T23:36:43.189713+0000) 2024-09-11T23:37:05.934 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:37:05 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:37:05.576+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-09-11T23:36:28.491009+0000 front 2024-09-11T23:36:28.490992+0000 (oldest deadline 2024-09-11T23:36:53.790884+0000) 2024-09-11T23:37:05.934 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:37:05 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:37:05.576+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.123:6820 osd.7 since back 2024-09-11T23:36:37.792615+0000 front 2024-09-11T23:36:37.792597+0000 (oldest deadline 2024-09-11T23:37:00.092512+0000) 2024-09-11T23:37:05.936 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T23:37:05.936 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-09-11T23:37:05.936 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-09-11T23:37:05.937 DEBUG:teuthology.orchestra.run.smithi160:> sudo systemctl stop ceph-8b03efce-7092-11ef-bcea-c7b262605968@osd.11 2024-09-11T23:37:06.233 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:37:05 smithi160 systemd[1]: Stopping Ceph osd.11 for 8b03efce-7092-11ef-bcea-c7b262605968... 2024-09-11T23:37:06.577 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:37:06 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:37:06.233+0000 7f2cecf2d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T23:37:06.577 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:37:06 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:37:06.233+0000 7f2cecf2d640 -1 osd.11 99 *** Got signal Terminated *** 2024-09-11T23:37:06.577 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:37:06 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:37:06.233+0000 7f2cecf2d640 -1 osd.11 99 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T23:37:06.577 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:37:06 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:37:06.577+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:37.277803+0000 front 2024-09-11T23:35:37.277821+0000 (oldest deadline 2024-09-11T23:36:00.777764+0000) 2024-09-11T23:37:06.577 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:37:06 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:37:06.577+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.478993+0000 front 2024-09-11T23:35:45.478970+0000 (oldest deadline 2024-09-11T23:36:08.379023+0000) 2024-09-11T23:37:06.577 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:37:06 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:37:06.577+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:55.980636+0000 front 2024-09-11T23:35:55.980669+0000 (oldest deadline 2024-09-11T23:36:18.880843+0000) 2024-09-11T23:37:06.577 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:37:06 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:37:06.577+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-11T23:36:12.486674+0000 front 2024-09-11T23:36:12.486576+0000 (oldest deadline 2024-09-11T23:36:34.186664+0000) 2024-09-11T23:37:06.578 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:37:06 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:37:06.577+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-09-11T23:36:20.289712+0000 front 2024-09-11T23:36:20.289628+0000 (oldest deadline 2024-09-11T23:36:43.189713+0000) 2024-09-11T23:37:06.578 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:37:06 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:37:06.577+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-09-11T23:36:28.491009+0000 front 2024-09-11T23:36:28.490992+0000 (oldest deadline 2024-09-11T23:36:53.790884+0000) 2024-09-11T23:37:06.578 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:37:06 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:37:06.577+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.123:6820 osd.7 since back 2024-09-11T23:36:37.792615+0000 front 2024-09-11T23:36:37.792597+0000 (oldest deadline 2024-09-11T23:37:00.092512+0000) 2024-09-11T23:37:07.933 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:37:07 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:37:07.555+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:37.277803+0000 front 2024-09-11T23:35:37.277821+0000 (oldest deadline 2024-09-11T23:36:00.777764+0000) 2024-09-11T23:37:07.933 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:37:07 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:37:07.555+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.478993+0000 front 2024-09-11T23:35:45.478970+0000 (oldest deadline 2024-09-11T23:36:08.379023+0000) 2024-09-11T23:37:07.934 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:37:07 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:37:07.555+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:55.980636+0000 front 2024-09-11T23:35:55.980669+0000 (oldest deadline 2024-09-11T23:36:18.880843+0000) 2024-09-11T23:37:07.934 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:37:07 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:37:07.555+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-11T23:36:12.486674+0000 front 2024-09-11T23:36:12.486576+0000 (oldest deadline 2024-09-11T23:36:34.186664+0000) 2024-09-11T23:37:07.934 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:37:07 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:37:07.555+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-09-11T23:36:20.289712+0000 front 2024-09-11T23:36:20.289628+0000 (oldest deadline 2024-09-11T23:36:43.189713+0000) 2024-09-11T23:37:07.934 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:37:07 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:37:07.556+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-09-11T23:36:28.491009+0000 front 2024-09-11T23:36:28.490992+0000 (oldest deadline 2024-09-11T23:36:53.790884+0000) 2024-09-11T23:37:07.934 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:37:07 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:37:07.556+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.123:6820 osd.7 since back 2024-09-11T23:36:37.792615+0000 front 2024-09-11T23:36:37.792597+0000 (oldest deadline 2024-09-11T23:37:00.092512+0000) 2024-09-11T23:37:08.939 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:37:08 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:37:08.600+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:37.277803+0000 front 2024-09-11T23:35:37.277821+0000 (oldest deadline 2024-09-11T23:36:00.777764+0000) 2024-09-11T23:37:08.939 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:37:08 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:37:08.600+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.478993+0000 front 2024-09-11T23:35:45.478970+0000 (oldest deadline 2024-09-11T23:36:08.379023+0000) 2024-09-11T23:37:08.939 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:37:08 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:37:08.600+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:55.980636+0000 front 2024-09-11T23:35:55.980669+0000 (oldest deadline 2024-09-11T23:36:18.880843+0000) 2024-09-11T23:37:08.939 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:37:08 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:37:08.600+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-11T23:36:12.486674+0000 front 2024-09-11T23:36:12.486576+0000 (oldest deadline 2024-09-11T23:36:34.186664+0000) 2024-09-11T23:37:08.939 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:37:08 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:37:08.600+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-09-11T23:36:20.289712+0000 front 2024-09-11T23:36:20.289628+0000 (oldest deadline 2024-09-11T23:36:43.189713+0000) 2024-09-11T23:37:08.939 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:37:08 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:37:08.600+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-09-11T23:36:28.491009+0000 front 2024-09-11T23:36:28.490992+0000 (oldest deadline 2024-09-11T23:36:53.790884+0000) 2024-09-11T23:37:08.939 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:37:08 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:37:08.600+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.123:6820 osd.7 since back 2024-09-11T23:36:37.792615+0000 front 2024-09-11T23:36:37.792597+0000 (oldest deadline 2024-09-11T23:37:00.092512+0000) 2024-09-11T23:37:09.933 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:37:09 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:37:09.631+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:37.277803+0000 front 2024-09-11T23:35:37.277821+0000 (oldest deadline 2024-09-11T23:36:00.777764+0000) 2024-09-11T23:37:09.933 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:37:09 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:37:09.631+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.478993+0000 front 2024-09-11T23:35:45.478970+0000 (oldest deadline 2024-09-11T23:36:08.379023+0000) 2024-09-11T23:37:09.933 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:37:09 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:37:09.631+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:55.980636+0000 front 2024-09-11T23:35:55.980669+0000 (oldest deadline 2024-09-11T23:36:18.880843+0000) 2024-09-11T23:37:09.934 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:37:09 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:37:09.631+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-11T23:36:12.486674+0000 front 2024-09-11T23:36:12.486576+0000 (oldest deadline 2024-09-11T23:36:34.186664+0000) 2024-09-11T23:37:09.934 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:37:09 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:37:09.631+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-09-11T23:36:20.289712+0000 front 2024-09-11T23:36:20.289628+0000 (oldest deadline 2024-09-11T23:36:43.189713+0000) 2024-09-11T23:37:09.934 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:37:09 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:37:09.631+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-09-11T23:36:28.491009+0000 front 2024-09-11T23:36:28.490992+0000 (oldest deadline 2024-09-11T23:36:53.790884+0000) 2024-09-11T23:37:09.934 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:37:09 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:37:09.631+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.123:6820 osd.7 since back 2024-09-11T23:36:37.792615+0000 front 2024-09-11T23:36:37.792597+0000 (oldest deadline 2024-09-11T23:37:00.092512+0000) 2024-09-11T23:37:10.933 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:37:10 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:37:10.678+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-11T23:35:37.277803+0000 front 2024-09-11T23:35:37.277821+0000 (oldest deadline 2024-09-11T23:36:00.777764+0000) 2024-09-11T23:37:10.934 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:37:10 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:37:10.678+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-11T23:35:45.478993+0000 front 2024-09-11T23:35:45.478970+0000 (oldest deadline 2024-09-11T23:36:08.379023+0000) 2024-09-11T23:37:10.934 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:37:10 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:37:10.678+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-11T23:35:55.980636+0000 front 2024-09-11T23:35:55.980669+0000 (oldest deadline 2024-09-11T23:36:18.880843+0000) 2024-09-11T23:37:10.934 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:37:10 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:37:10.678+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-11T23:36:12.486674+0000 front 2024-09-11T23:36:12.486576+0000 (oldest deadline 2024-09-11T23:36:34.186664+0000) 2024-09-11T23:37:10.934 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:37:10 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:37:10.678+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-09-11T23:36:20.289712+0000 front 2024-09-11T23:36:20.289628+0000 (oldest deadline 2024-09-11T23:36:43.189713+0000) 2024-09-11T23:37:10.934 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:37:10 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:37:10.678+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-09-11T23:36:28.491009+0000 front 2024-09-11T23:36:28.490992+0000 (oldest deadline 2024-09-11T23:36:53.790884+0000) 2024-09-11T23:37:10.934 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:37:10 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:37:10.678+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.123:6820 osd.7 since back 2024-09-11T23:36:37.792615+0000 front 2024-09-11T23:36:37.792597+0000 (oldest deadline 2024-09-11T23:37:00.092512+0000) 2024-09-11T23:37:10.934 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:37:10 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11[59708]: 2024-09-11T23:37:10.678+0000 7f2ce9543640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.160:6820 osd.8 since back 2024-09-11T23:36:45.393358+0000 front 2024-09-11T23:36:45.393378+0000 (oldest deadline 2024-09-11T23:37:10.093446+0000) 2024-09-11T23:37:12.183 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:37:11 smithi160 podman[71102]: 2024-09-11 23:37:11.89712606 +0000 UTC m=+5.760620614 container died 5cc5efb627672b4d371cb72c68309d03abbd823da3565fe490c55ae7effa13c4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-11T23:37:12.684 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:37:12 smithi160 podman[71102]: 2024-09-11 23:37:12.232507529 +0000 UTC m=+6.096002073 container cleanup 5cc5efb627672b4d371cb72c68309d03abbd823da3565fe490c55ae7effa13c4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-11T23:37:12.684 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:37:12 smithi160 bash[71102]: ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11 2024-09-11T23:37:12.684 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:37:12 smithi160 podman[71117]: 2024-09-11 23:37:12.425203213 +0000 UTC m=+0.521178144 container remove 5cc5efb627672b4d371cb72c68309d03abbd823da3565fe490c55ae7effa13c4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-11T23:37:13.085 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:37:12 smithi160 podman[71203]: 2024-09-11 23:37:12.809291938 +0000 UTC m=+0.102956758 container create 60676eabf2b23cfe46e9d07b1413d0b9565e177dd5868d08082e33bf25999786 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11-deactivate, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-11T23:37:13.086 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:37:12 smithi160 podman[71203]: 2024-09-11 23:37:12.722171582 +0000 UTC m=+0.015836397 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T23:37:13.086 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:37:13 smithi160 podman[71203]: 2024-09-11 23:37:13.011466775 +0000 UTC m=+0.305131593 container init 60676eabf2b23cfe46e9d07b1413d0b9565e177dd5868d08082e33bf25999786 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11-deactivate, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-11T23:37:13.086 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:37:13 smithi160 podman[71203]: 2024-09-11 23:37:13.014791438 +0000 UTC m=+0.308456254 container start 60676eabf2b23cfe46e9d07b1413d0b9565e177dd5868d08082e33bf25999786 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11-deactivate, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T23:37:13.086 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:37:13 smithi160 podman[71203]: 2024-09-11 23:37:13.086418418 +0000 UTC m=+0.380083243 container attach 60676eabf2b23cfe46e9d07b1413d0b9565e177dd5868d08082e33bf25999786 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11-deactivate, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-11T23:37:13.433 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 11 23:37:13 smithi160 podman[71203]: 2024-09-11 23:37:13.203130948 +0000 UTC m=+0.496795764 container died 60676eabf2b23cfe46e9d07b1413d0b9565e177dd5868d08082e33bf25999786 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-osd-11-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3) 2024-09-11T23:37:13.791 DEBUG:teuthology.orchestra.run.smithi160:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8b03efce-7092-11ef-bcea-c7b262605968@osd.11.service' 2024-09-11T23:37:13.830 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T23:37:13.830 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-09-11T23:37:13.830 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-09-11T23:37:13.831 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ceph-8b03efce-7092-11ef-bcea-c7b262605968@mds.a 2024-09-11T23:37:14.253 INFO:journalctl@ceph.mds.a.smithi037.stdout:Sep 11 23:37:13 smithi037 systemd[1]: Stopping Ceph mds.a for 8b03efce-7092-11ef-bcea-c7b262605968... 2024-09-11T23:37:14.564 INFO:journalctl@ceph.mds.a.smithi037.stdout:Sep 11 23:37:14 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-a[71559]: 2024-09-11T23:37:14.253+0000 7f20c6200640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T23:37:14.564 INFO:journalctl@ceph.mds.a.smithi037.stdout:Sep 11 23:37:14 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-a[71559]: 2024-09-11T23:37:14.253+0000 7f20c6200640 -1 mds.a *** got signal Terminated *** 2024-09-11T23:37:17.375 INFO:journalctl@ceph.mds.a.smithi037.stdout:Sep 11 23:37:17 smithi037 podman[91046]: 2024-09-11 23:37:17.081577228 +0000 UTC m=+2.953480315 container died 11b888c7cda125ec5d8b173195ea276ea8e6c3e2c9c80a984e7ca770c9ea084c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-a, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T23:37:17.777 INFO:journalctl@ceph.mds.a.smithi037.stdout:Sep 11 23:37:17 smithi037 podman[91046]: 2024-09-11 23:37:17.491359773 +0000 UTC m=+3.363262858 container cleanup 11b888c7cda125ec5d8b173195ea276ea8e6c3e2c9c80a984e7ca770c9ea084c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-a, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-11T23:37:17.778 INFO:journalctl@ceph.mds.a.smithi037.stdout:Sep 11 23:37:17 smithi037 bash[91046]: ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-a 2024-09-11T23:37:18.039 INFO:journalctl@ceph.mds.a.smithi037.stdout:Sep 11 23:37:17 smithi037 podman[91069]: 2024-09-11 23:37:17.778157265 +0000 UTC m=+0.683703438 container remove 11b888c7cda125ec5d8b173195ea276ea8e6c3e2c9c80a984e7ca770c9ea084c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-a, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-11T23:37:18.048 DEBUG:teuthology.orchestra.run.smithi037:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8b03efce-7092-11ef-bcea-c7b262605968@mds.a.service' 2024-09-11T23:37:18.122 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T23:37:18.123 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-09-11T23:37:18.123 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-09-11T23:37:18.123 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ceph-8b03efce-7092-11ef-bcea-c7b262605968@mds.d 2024-09-11T23:37:18.314 INFO:journalctl@ceph.mds.d.smithi037.stdout:Sep 11 23:37:18 smithi037 systemd[1]: Stopping Ceph mds.d for 8b03efce-7092-11ef-bcea-c7b262605968... 2024-09-11T23:37:18.814 INFO:journalctl@ceph.mds.d.smithi037.stdout:Sep 11 23:37:18 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-d[70408]: 2024-09-11T23:37:18.514+0000 7fce39c00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T23:37:18.814 INFO:journalctl@ceph.mds.d.smithi037.stdout:Sep 11 23:37:18 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-d[70408]: 2024-09-11T23:37:18.514+0000 7fce39c00640 -1 mds.d *** got signal Terminated *** 2024-09-11T23:37:19.920 INFO:journalctl@ceph.mds.d.smithi037.stdout:Sep 11 23:37:19 smithi037 podman[91181]: 2024-09-11 23:37:19.592194728 +0000 UTC m=+1.195362719 container died a5ddc41a5961d4dd605ed0b7edcd5b4d3003c01b581314fed49a00106195eaca (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-d, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0) 2024-09-11T23:37:20.245 INFO:journalctl@ceph.mds.d.smithi037.stdout:Sep 11 23:37:20 smithi037 podman[91181]: 2024-09-11 23:37:20.02828972 +0000 UTC m=+1.631457711 container cleanup a5ddc41a5961d4dd605ed0b7edcd5b4d3003c01b581314fed49a00106195eaca (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-d, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-11T23:37:20.245 INFO:journalctl@ceph.mds.d.smithi037.stdout:Sep 11 23:37:20 smithi037 bash[91181]: ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-d 2024-09-11T23:37:20.501 INFO:journalctl@ceph.mds.d.smithi037.stdout:Sep 11 23:37:20 smithi037 podman[91194]: 2024-09-11 23:37:20.246012803 +0000 UTC m=+0.647865620 container remove a5ddc41a5961d4dd605ed0b7edcd5b4d3003c01b581314fed49a00106195eaca (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-d, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-11T23:37:20.522 DEBUG:teuthology.orchestra.run.smithi037:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8b03efce-7092-11ef-bcea-c7b262605968@mds.d.service' 2024-09-11T23:37:20.592 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T23:37:20.592 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-09-11T23:37:20.592 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-09-11T23:37:20.593 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ceph-8b03efce-7092-11ef-bcea-c7b262605968@mds.g 2024-09-11T23:37:20.814 INFO:journalctl@ceph.mds.g.smithi037.stdout:Sep 11 23:37:20 smithi037 systemd[1]: Stopping Ceph mds.g for 8b03efce-7092-11ef-bcea-c7b262605968... 2024-09-11T23:37:21.313 INFO:journalctl@ceph.mds.g.smithi037.stdout:Sep 11 23:37:21 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-g[71187]: 2024-09-11T23:37:21.002+0000 7fe04b600640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T23:37:21.314 INFO:journalctl@ceph.mds.g.smithi037.stdout:Sep 11 23:37:21 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-g[71187]: 2024-09-11T23:37:21.002+0000 7fe04b600640 -1 mds.g *** got signal Terminated *** 2024-09-11T23:37:25.282 INFO:journalctl@ceph.mds.g.smithi037.stdout:Sep 11 23:37:25 smithi037 podman[91301]: 2024-09-11 23:37:25.015770404 +0000 UTC m=+4.142505025 container died 22f2d21f19d98096c9ae3454bcc07db987367b86ad84277e5fb3fba4c88e2ebf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-g, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3) 2024-09-11T23:37:25.564 INFO:journalctl@ceph.mds.g.smithi037.stdout:Sep 11 23:37:25 smithi037 podman[91301]: 2024-09-11 23:37:25.398742384 +0000 UTC m=+4.525477004 container cleanup 22f2d21f19d98096c9ae3454bcc07db987367b86ad84277e5fb3fba4c88e2ebf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-g, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-11T23:37:25.564 INFO:journalctl@ceph.mds.g.smithi037.stdout:Sep 11 23:37:25 smithi037 bash[91301]: ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-g 2024-09-11T23:37:25.851 INFO:journalctl@ceph.mds.g.smithi037.stdout:Sep 11 23:37:25 smithi037 podman[91315]: 2024-09-11 23:37:25.592978775 +0000 UTC m=+0.566714368 container remove 22f2d21f19d98096c9ae3454bcc07db987367b86ad84277e5fb3fba4c88e2ebf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-g, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True) 2024-09-11T23:37:25.861 DEBUG:teuthology.orchestra.run.smithi037:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8b03efce-7092-11ef-bcea-c7b262605968@mds.g.service' 2024-09-11T23:37:25.931 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T23:37:25.931 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-09-11T23:37:25.932 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-09-11T23:37:25.932 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ceph-8b03efce-7092-11ef-bcea-c7b262605968@mds.j 2024-09-11T23:37:26.314 INFO:journalctl@ceph.mds.j.smithi037.stdout:Sep 11 23:37:26 smithi037 systemd[1]: Stopping Ceph mds.j for 8b03efce-7092-11ef-bcea-c7b262605968... 2024-09-11T23:37:26.814 INFO:journalctl@ceph.mds.j.smithi037.stdout:Sep 11 23:37:26 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-j[70008]: 2024-09-11T23:37:26.322+0000 7fe08b400640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T23:37:26.814 INFO:journalctl@ceph.mds.j.smithi037.stdout:Sep 11 23:37:26 smithi037 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-j[70008]: 2024-09-11T23:37:26.322+0000 7fe08b400640 -1 mds.j *** got signal Terminated *** 2024-09-11T23:37:27.713 INFO:journalctl@ceph.mds.j.smithi037.stdout:Sep 11 23:37:27 smithi037 podman[91419]: 2024-09-11 23:37:27.431880785 +0000 UTC m=+1.222335259 container stop 9ead93e0f5a3f43501ddc78af177ed532602edbfdd5114b6f4ee8ab6ff1af610 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-j, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-11T23:37:27.714 INFO:journalctl@ceph.mds.j.smithi037.stdout:Sep 11 23:37:27 smithi037 podman[91419]: 2024-09-11 23:37:27.462893571 +0000 UTC m=+1.253348054 container died 9ead93e0f5a3f43501ddc78af177ed532602edbfdd5114b6f4ee8ab6ff1af610 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-j, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-11T23:37:28.064 INFO:journalctl@ceph.mds.j.smithi037.stdout:Sep 11 23:37:27 smithi037 podman[91419]: 2024-09-11 23:37:27.826922928 +0000 UTC m=+1.617377400 container cleanup 9ead93e0f5a3f43501ddc78af177ed532602edbfdd5114b6f4ee8ab6ff1af610 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-j, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-11T23:37:28.064 INFO:journalctl@ceph.mds.j.smithi037.stdout:Sep 11 23:37:27 smithi037 bash[91419]: ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-j 2024-09-11T23:37:28.268 DEBUG:teuthology.orchestra.run.smithi037:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8b03efce-7092-11ef-bcea-c7b262605968@mds.j.service' 2024-09-11T23:37:28.337 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T23:37:28.337 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-09-11T23:37:28.337 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-09-11T23:37:28.337 DEBUG:teuthology.orchestra.run.smithi123:> sudo systemctl stop ceph-8b03efce-7092-11ef-bcea-c7b262605968@mds.b 2024-09-11T23:37:28.645 INFO:journalctl@ceph.mds.b.smithi123.stdout:Sep 11 23:37:28 smithi123 systemd[1]: Stopping Ceph mds.b for 8b03efce-7092-11ef-bcea-c7b262605968... 2024-09-11T23:37:28.899 INFO:journalctl@ceph.mds.b.smithi123.stdout:Sep 11 23:37:28 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-b[65584]: 2024-09-11T23:37:28.644+0000 7f70aa234640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T23:37:28.899 INFO:journalctl@ceph.mds.b.smithi123.stdout:Sep 11 23:37:28 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-b[65584]: 2024-09-11T23:37:28.644+0000 7f70aa234640 -1 mds.b *** got signal Terminated *** 2024-09-11T23:37:32.947 INFO:journalctl@ceph.mds.b.smithi123.stdout:Sep 11 23:37:32 smithi123 podman[71980]: 2024-09-11 23:37:32.657654594 +0000 UTC m=+4.119690370 container died aded3ef33681d2efda9ceff7d053d4f0b9ff68ac256ccaed15fc4700aa8e3a63 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-b, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-11T23:37:33.250 INFO:journalctl@ceph.mds.b.smithi123.stdout:Sep 11 23:37:33 smithi123 podman[71980]: 2024-09-11 23:37:33.0454769 +0000 UTC m=+4.507512678 container cleanup aded3ef33681d2efda9ceff7d053d4f0b9ff68ac256ccaed15fc4700aa8e3a63 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-b, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, RELEASE=squid-b53b6d3, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-11T23:37:33.250 INFO:journalctl@ceph.mds.b.smithi123.stdout:Sep 11 23:37:33 smithi123 bash[71980]: ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-b 2024-09-11T23:37:33.429 DEBUG:teuthology.orchestra.run.smithi123:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8b03efce-7092-11ef-bcea-c7b262605968@mds.b.service' 2024-09-11T23:37:33.466 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T23:37:33.466 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-09-11T23:37:33.467 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-09-11T23:37:33.467 DEBUG:teuthology.orchestra.run.smithi123:> sudo systemctl stop ceph-8b03efce-7092-11ef-bcea-c7b262605968@mds.e 2024-09-11T23:37:33.752 INFO:journalctl@ceph.mds.e.smithi123.stdout:Sep 11 23:37:33 smithi123 systemd[1]: Stopping Ceph mds.e for 8b03efce-7092-11ef-bcea-c7b262605968... 2024-09-11T23:37:34.250 INFO:journalctl@ceph.mds.e.smithi123.stdout:Sep 11 23:37:33 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-e[64974]: 2024-09-11T23:37:33.799+0000 7f9771dd1640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T23:37:34.250 INFO:journalctl@ceph.mds.e.smithi123.stdout:Sep 11 23:37:33 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-e[64974]: 2024-09-11T23:37:33.799+0000 7f9771dd1640 -1 mds.e *** got signal Terminated *** 2024-09-11T23:37:37.250 INFO:journalctl@ceph.mds.e.smithi123.stdout:Sep 11 23:37:36 smithi123 podman[72116]: 2024-09-11 23:37:36.97953629 +0000 UTC m=+3.291686868 container died d4249ad555eb6ce572f388b371ab46d188fe533001fd660daf81fd8888f7eacf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-e, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-11T23:37:37.632 INFO:journalctl@ceph.mds.e.smithi123.stdout:Sep 11 23:37:37 smithi123 podman[72116]: 2024-09-11 23:37:37.374434164 +0000 UTC m=+3.686584729 container cleanup d4249ad555eb6ce572f388b371ab46d188fe533001fd660daf81fd8888f7eacf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-e, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-11T23:37:37.632 INFO:journalctl@ceph.mds.e.smithi123.stdout:Sep 11 23:37:37 smithi123 bash[72116]: ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-e 2024-09-11T23:37:37.771 DEBUG:teuthology.orchestra.run.smithi123:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8b03efce-7092-11ef-bcea-c7b262605968@mds.e.service' 2024-09-11T23:37:37.805 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T23:37:37.805 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-09-11T23:37:37.805 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-09-11T23:37:37.805 DEBUG:teuthology.orchestra.run.smithi123:> sudo systemctl stop ceph-8b03efce-7092-11ef-bcea-c7b262605968@mds.h 2024-09-11T23:37:38.250 INFO:journalctl@ceph.mds.h.smithi123.stdout:Sep 11 23:37:37 smithi123 systemd[1]: Stopping Ceph mds.h for 8b03efce-7092-11ef-bcea-c7b262605968... 2024-09-11T23:37:38.250 INFO:journalctl@ceph.mds.h.smithi123.stdout:Sep 11 23:37:38 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-h[65279]: 2024-09-11T23:37:38.127+0000 7efe5b4b9640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T23:37:38.251 INFO:journalctl@ceph.mds.h.smithi123.stdout:Sep 11 23:37:38 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-h[65279]: 2024-09-11T23:37:38.127+0000 7efe5b4b9640 -1 mds.h *** got signal Terminated *** 2024-09-11T23:37:41.500 INFO:journalctl@ceph.mds.h.smithi123.stdout:Sep 11 23:37:41 smithi123 podman[72238]: 2024-09-11 23:37:41.001533047 +0000 UTC m=+2.974871949 container died 256404eb79bd94413c5dcb8db077e70a0074ae358a760380875aaf1219b58eef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-h, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-11T23:37:41.827 INFO:journalctl@ceph.mds.h.smithi123.stdout:Sep 11 23:37:41 smithi123 podman[72238]: 2024-09-11 23:37:41.594591552 +0000 UTC m=+3.567930451 container cleanup 256404eb79bd94413c5dcb8db077e70a0074ae358a760380875aaf1219b58eef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-h, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3) 2024-09-11T23:37:41.828 INFO:journalctl@ceph.mds.h.smithi123.stdout:Sep 11 23:37:41 smithi123 bash[72238]: ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-h 2024-09-11T23:37:41.970 DEBUG:teuthology.orchestra.run.smithi123:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8b03efce-7092-11ef-bcea-c7b262605968@mds.h.service' 2024-09-11T23:37:42.003 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T23:37:42.003 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-09-11T23:37:42.003 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-09-11T23:37:42.003 DEBUG:teuthology.orchestra.run.smithi123:> sudo systemctl stop ceph-8b03efce-7092-11ef-bcea-c7b262605968@mds.k 2024-09-11T23:37:42.500 INFO:journalctl@ceph.mds.k.smithi123.stdout:Sep 11 23:37:42 smithi123 systemd[1]: Stopping Ceph mds.k for 8b03efce-7092-11ef-bcea-c7b262605968... 2024-09-11T23:37:42.501 INFO:journalctl@ceph.mds.k.smithi123.stdout:Sep 11 23:37:42 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-k[64663]: 2024-09-11T23:37:42.322+0000 7f5c49ce8640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T23:37:42.501 INFO:journalctl@ceph.mds.k.smithi123.stdout:Sep 11 23:37:42 smithi123 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-k[64663]: 2024-09-11T23:37:42.322+0000 7f5c49ce8640 -1 mds.k *** got signal Terminated *** 2024-09-11T23:37:45.422 INFO:journalctl@ceph.mds.k.smithi123.stdout:Sep 11 23:37:45 smithi123 podman[72360]: 2024-09-11 23:37:45.077760705 +0000 UTC m=+2.852230965 container died 1b47a29b3f6bac599a402d0dd4d4e56e41dfa925467ae21405ded10f048d06f8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-k, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-11T23:37:45.681 INFO:journalctl@ceph.mds.k.smithi123.stdout:Sep 11 23:37:45 smithi123 podman[72360]: 2024-09-11 23:37:45.497853867 +0000 UTC m=+3.272324129 container cleanup 1b47a29b3f6bac599a402d0dd4d4e56e41dfa925467ae21405ded10f048d06f8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-k, GIT_CLEAN=True, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-11T23:37:45.681 INFO:journalctl@ceph.mds.k.smithi123.stdout:Sep 11 23:37:45 smithi123 bash[72360]: ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-k 2024-09-11T23:37:45.926 DEBUG:teuthology.orchestra.run.smithi123:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8b03efce-7092-11ef-bcea-c7b262605968@mds.k.service' 2024-09-11T23:37:45.947 INFO:journalctl@ceph.mds.k.smithi123.stdout:Sep 11 23:37:45 smithi123 podman[72374]: 2024-09-11 23:37:45.681988664 +0000 UTC m=+0.602755755 container remove 1b47a29b3f6bac599a402d0dd4d4e56e41dfa925467ae21405ded10f048d06f8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-k, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-11T23:37:45.947 INFO:journalctl@ceph.mds.k.smithi123.stdout:Sep 11 23:37:45 smithi123 systemd[1]: ceph-8b03efce-7092-11ef-bcea-c7b262605968@mds.k.service: Deactivated successfully. 2024-09-11T23:37:45.947 INFO:journalctl@ceph.mds.k.smithi123.stdout:Sep 11 23:37:45 smithi123 systemd[1]: Stopped Ceph mds.k for 8b03efce-7092-11ef-bcea-c7b262605968. 2024-09-11T23:37:45.947 INFO:journalctl@ceph.mds.k.smithi123.stdout:Sep 11 23:37:45 smithi123 systemd[1]: ceph-8b03efce-7092-11ef-bcea-c7b262605968@mds.k.service: Consumed 2.355s CPU time. 2024-09-11T23:37:45.957 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T23:37:45.957 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-09-11T23:37:45.958 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-09-11T23:37:45.958 DEBUG:teuthology.orchestra.run.smithi160:> sudo systemctl stop ceph-8b03efce-7092-11ef-bcea-c7b262605968@mds.c 2024-09-11T23:37:46.255 INFO:journalctl@ceph.mds.c.smithi160.stdout:Sep 11 23:37:46 smithi160 systemd[1]: Stopping Ceph mds.c for 8b03efce-7092-11ef-bcea-c7b262605968... 2024-09-11T23:37:46.519 INFO:journalctl@ceph.mds.c.smithi160.stdout:Sep 11 23:37:46 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-c[64849]: 2024-09-11T23:37:46.254+0000 7f9a309d1640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T23:37:46.519 INFO:journalctl@ceph.mds.c.smithi160.stdout:Sep 11 23:37:46 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-c[64849]: 2024-09-11T23:37:46.254+0000 7f9a309d1640 -1 mds.c *** got signal Terminated *** 2024-09-11T23:37:49.256 INFO:journalctl@ceph.mds.c.smithi160.stdout:Sep 11 23:37:48 smithi160 podman[71306]: 2024-09-11 23:37:48.993030284 +0000 UTC m=+2.836494669 container died f2e7795edd730b1374972d762bdef6725af83cf0fa0261afe20b127f3a3b066f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-c, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T23:37:49.683 INFO:journalctl@ceph.mds.c.smithi160.stdout:Sep 11 23:37:49 smithi160 podman[71306]: 2024-09-11 23:37:49.347014388 +0000 UTC m=+3.190478762 container cleanup f2e7795edd730b1374972d762bdef6725af83cf0fa0261afe20b127f3a3b066f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-c, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-11T23:37:49.683 INFO:journalctl@ceph.mds.c.smithi160.stdout:Sep 11 23:37:49 smithi160 bash[71306]: ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-c 2024-09-11T23:37:49.831 DEBUG:teuthology.orchestra.run.smithi160:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8b03efce-7092-11ef-bcea-c7b262605968@mds.c.service' 2024-09-11T23:37:49.868 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T23:37:49.868 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-09-11T23:37:49.868 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-09-11T23:37:49.868 DEBUG:teuthology.orchestra.run.smithi160:> sudo systemctl stop ceph-8b03efce-7092-11ef-bcea-c7b262605968@mds.f 2024-09-11T23:37:50.433 INFO:journalctl@ceph.mds.f.smithi160.stdout:Sep 11 23:37:49 smithi160 systemd[1]: Stopping Ceph mds.f for 8b03efce-7092-11ef-bcea-c7b262605968... 2024-09-11T23:37:50.433 INFO:journalctl@ceph.mds.f.smithi160.stdout:Sep 11 23:37:50 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-f[64549]: 2024-09-11T23:37:50.192+0000 7f81b81e3640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T23:37:50.433 INFO:journalctl@ceph.mds.f.smithi160.stdout:Sep 11 23:37:50 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-f[64549]: 2024-09-11T23:37:50.192+0000 7f81b81e3640 -1 mds.f *** got signal Terminated *** 2024-09-11T23:37:53.268 INFO:journalctl@ceph.mds.f.smithi160.stdout:Sep 11 23:37:52 smithi160 podman[71439]: 2024-09-11 23:37:52.999692484 +0000 UTC m=+2.907267714 container died 85da6bde1dd5530e7eb40a199c925b04be300f0532293cda152df5a8bd367dec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-f, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-11T23:37:53.570 INFO:journalctl@ceph.mds.f.smithi160.stdout:Sep 11 23:37:53 smithi160 podman[71439]: 2024-09-11 23:37:53.342488874 +0000 UTC m=+3.250064104 container cleanup 85da6bde1dd5530e7eb40a199c925b04be300f0532293cda152df5a8bd367dec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-f, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True) 2024-09-11T23:37:53.570 INFO:journalctl@ceph.mds.f.smithi160.stdout:Sep 11 23:37:53 smithi160 bash[71439]: ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-f 2024-09-11T23:37:53.822 INFO:journalctl@ceph.mds.f.smithi160.stdout:Sep 11 23:37:53 smithi160 podman[71451]: 2024-09-11 23:37:53.571031188 +0000 UTC m=+0.567589391 container remove 85da6bde1dd5530e7eb40a199c925b04be300f0532293cda152df5a8bd367dec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-f, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux ) 2024-09-11T23:37:53.826 DEBUG:teuthology.orchestra.run.smithi160:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8b03efce-7092-11ef-bcea-c7b262605968@mds.f.service' 2024-09-11T23:37:53.860 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T23:37:53.860 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-09-11T23:37:53.860 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-09-11T23:37:53.861 DEBUG:teuthology.orchestra.run.smithi160:> sudo systemctl stop ceph-8b03efce-7092-11ef-bcea-c7b262605968@mds.i 2024-09-11T23:37:54.162 INFO:journalctl@ceph.mds.i.smithi160.stdout:Sep 11 23:37:53 smithi160 systemd[1]: Stopping Ceph mds.i for 8b03efce-7092-11ef-bcea-c7b262605968... 2024-09-11T23:37:54.433 INFO:journalctl@ceph.mds.i.smithi160.stdout:Sep 11 23:37:54 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-i[65149]: 2024-09-11T23:37:54.162+0000 7fc62df8c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T23:37:54.433 INFO:journalctl@ceph.mds.i.smithi160.stdout:Sep 11 23:37:54 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-i[65149]: 2024-09-11T23:37:54.162+0000 7fc62df8c640 -1 mds.i *** got signal Terminated *** 2024-09-11T23:37:57.245 INFO:journalctl@ceph.mds.i.smithi160.stdout:Sep 11 23:37:56 smithi160 podman[71562]: 2024-09-11 23:37:56.977209884 +0000 UTC m=+2.905233971 container died cf017f203c3f19eb21842b04ff4ee19698cd460587ce69869b767eae2389d6bd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-i, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-11T23:37:57.510 INFO:journalctl@ceph.mds.i.smithi160.stdout:Sep 11 23:37:57 smithi160 podman[71562]: 2024-09-11 23:37:57.320756807 +0000 UTC m=+3.248780882 container cleanup cf017f203c3f19eb21842b04ff4ee19698cd460587ce69869b767eae2389d6bd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-i, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T23:37:57.510 INFO:journalctl@ceph.mds.i.smithi160.stdout:Sep 11 23:37:57 smithi160 bash[71562]: ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-i 2024-09-11T23:37:57.739 DEBUG:teuthology.orchestra.run.smithi160:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8b03efce-7092-11ef-bcea-c7b262605968@mds.i.service' 2024-09-11T23:37:57.761 INFO:journalctl@ceph.mds.i.smithi160.stdout:Sep 11 23:37:57 smithi160 podman[71576]: 2024-09-11 23:37:57.511124856 +0000 UTC m=+0.525045287 container remove cf017f203c3f19eb21842b04ff4ee19698cd460587ce69869b767eae2389d6bd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-i, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2) 2024-09-11T23:37:57.761 INFO:journalctl@ceph.mds.i.smithi160.stdout:Sep 11 23:37:57 smithi160 systemd[1]: ceph-8b03efce-7092-11ef-bcea-c7b262605968@mds.i.service: Deactivated successfully. 2024-09-11T23:37:57.761 INFO:journalctl@ceph.mds.i.smithi160.stdout:Sep 11 23:37:57 smithi160 systemd[1]: Stopped Ceph mds.i for 8b03efce-7092-11ef-bcea-c7b262605968. 2024-09-11T23:37:57.761 INFO:journalctl@ceph.mds.i.smithi160.stdout:Sep 11 23:37:57 smithi160 systemd[1]: ceph-8b03efce-7092-11ef-bcea-c7b262605968@mds.i.service: Consumed 2.000s CPU time. 2024-09-11T23:37:57.772 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T23:37:57.772 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-09-11T23:37:57.772 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-09-11T23:37:57.773 DEBUG:teuthology.orchestra.run.smithi160:> sudo systemctl stop ceph-8b03efce-7092-11ef-bcea-c7b262605968@mds.l 2024-09-11T23:37:58.090 INFO:journalctl@ceph.mds.l.smithi160.stdout:Sep 11 23:37:57 smithi160 systemd[1]: Stopping Ceph mds.l for 8b03efce-7092-11ef-bcea-c7b262605968... 2024-09-11T23:37:58.433 INFO:journalctl@ceph.mds.l.smithi160.stdout:Sep 11 23:37:58 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-l[64231]: 2024-09-11T23:37:58.090+0000 7f7ec78ff640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T23:37:58.433 INFO:journalctl@ceph.mds.l.smithi160.stdout:Sep 11 23:37:58 smithi160 ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-l[64231]: 2024-09-11T23:37:58.090+0000 7f7ec78ff640 -1 mds.l *** got signal Terminated *** 2024-09-11T23:38:01.266 INFO:journalctl@ceph.mds.l.smithi160.stdout:Sep 11 23:38:00 smithi160 podman[71683]: 2024-09-11 23:38:00.98907968 +0000 UTC m=+3.001119107 container died 961c574cf3350c66b82af5239223774f36d93239ec1108033945af7d69de5bbe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-l, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T23:38:01.624 INFO:journalctl@ceph.mds.l.smithi160.stdout:Sep 11 23:38:01 smithi160 podman[71683]: 2024-09-11 23:38:01.357902103 +0000 UTC m=+3.369941530 container cleanup 961c574cf3350c66b82af5239223774f36d93239ec1108033945af7d69de5bbe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-l, GIT_BRANCH=HEAD, ceph=True, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-11T23:38:01.624 INFO:journalctl@ceph.mds.l.smithi160.stdout:Sep 11 23:38:01 smithi160 bash[71683]: ceph-8b03efce-7092-11ef-bcea-c7b262605968-mds-l 2024-09-11T23:38:01.782 DEBUG:teuthology.orchestra.run.smithi160:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8b03efce-7092-11ef-bcea-c7b262605968@mds.l.service' 2024-09-11T23:38:01.814 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T23:38:01.814 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-09-11T23:38:01.815 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 8b03efce-7092-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-11T23:38:02.101 INFO:teuthology.orchestra.run.smithi037.stdout:Deleting cluster with fsid: 8b03efce-7092-11ef-bcea-c7b262605968 2024-09-11T23:38:06.176 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 8b03efce-7092-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-11T23:38:06.374 INFO:teuthology.orchestra.run.smithi123.stdout:Deleting cluster with fsid: 8b03efce-7092-11ef-bcea-c7b262605968 2024-09-11T23:38:08.898 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 8b03efce-7092-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-11T23:38:09.100 INFO:teuthology.orchestra.run.smithi160.stdout:Deleting cluster with fsid: 8b03efce-7092-11ef-bcea-c7b262605968 2024-09-11T23:38:11.496 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-11T23:38:11.567 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-11T23:38:11.600 DEBUG:teuthology.orchestra.run.smithi160:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-11T23:38:11.627 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-11T23:38:11.629 DEBUG:teuthology.misc:Transferring archived files from smithi037:/var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901455/remote/smithi037/crash 2024-09-11T23:38:11.629 DEBUG:teuthology.orchestra.run.smithi037:> sudo tar c -f - -C /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/crash -- . 2024-09-11T23:38:11.694 INFO:teuthology.orchestra.run.smithi037.stderr:tar: /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-11T23:38:11.694 INFO:teuthology.orchestra.run.smithi037.stderr:tar: Error is not recoverable: exiting now 2024-09-11T23:38:11.698 DEBUG:teuthology.misc:Transferring archived files from smithi123:/var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901455/remote/smithi123/crash 2024-09-11T23:38:11.698 DEBUG:teuthology.orchestra.run.smithi123:> sudo tar c -f - -C /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/crash -- . 2024-09-11T23:38:11.734 INFO:teuthology.orchestra.run.smithi123.stderr:tar: /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-11T23:38:11.734 INFO:teuthology.orchestra.run.smithi123.stderr:tar: Error is not recoverable: exiting now 2024-09-11T23:38:11.736 DEBUG:teuthology.misc:Transferring archived files from smithi160:/var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901455/remote/smithi160/crash 2024-09-11T23:38:11.737 DEBUG:teuthology.orchestra.run.smithi160:> sudo tar c -f - -C /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/crash -- . 2024-09-11T23:38:11.783 INFO:teuthology.orchestra.run.smithi160.stderr:tar: /var/lib/ceph/8b03efce-7092-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-11T23:38:11.784 INFO:teuthology.orchestra.run.smithi160.stderr:tar: Error is not recoverable: exiting now 2024-09-11T23:38:11.785 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-11T23:38:11.785 DEBUG:teuthology.orchestra.run.smithi037:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-11T23:38:11.917 INFO:tasks.cephadm:Compressing logs... 2024-09-11T23:38:11.918 DEBUG:teuthology.orchestra.run.smithi037:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-11T23:38:11.921 DEBUG:teuthology.orchestra.run.smithi123:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-11T23:38:11.924 DEBUG:teuthology.orchestra.run.smithi160:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-11T23:38:11.949 INFO:teuthology.orchestra.run.smithi123.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph-osd.10.log 2024-09-11T23:38:11.949 INFO:teuthology.orchestra.run.smithi123.stderr:: No such file or directory 2024-09-11T23:38:11.950 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph-osd.1.log 2024-09-11T23:38:11.950 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph-osd.7.log 2024-09-11T23:38:11.950 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-11T23:38:11.953 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph-mds.b.log 2024-09-11T23:38:11.953 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph-mds.k.log 2024-09-11T23:38:11.953 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph-osd.4.log 2024-09-11T23:38:11.953 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-11T23:38:11.953 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-11T23:38:11.953 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph-mgr.y.log 2024-09-11T23:38:11.953 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph.log 2024-09-11T23:38:11.954 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph-mds.h.log 2024-09-11T23:38:11.954 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph-mon.b.log 2024-09-11T23:38:11.954 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph.log: /var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph-mds.e.log 2024-09-11T23:38:11.954 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-11T23:38:11.959 INFO:teuthology.orchestra.run.smithi160.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-09-11T23:38:11.960 INFO:teuthology.orchestra.run.smithi160.stderr:gzip -5 --verbose -- /var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-11T23:38:11.964 INFO:teuthology.orchestra.run.smithi160.stderr:gzip -5 --verbose -- /var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-11T23:38:11.964 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph-mds.i.log 2024-09-11T23:38:11.965 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph-mon.c.log 2024-09-11T23:38:11.965 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-11T23:38:11.965 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph-osd.11.log 2024-09-11T23:38:11.965 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph-osd.2.log 2024-09-11T23:38:11.965 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph-osd.5.log 2024-09-11T23:38:11.965 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph.log 2024-09-11T23:38:11.965 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph-mds.l.log 2024-09-11T23:38:11.965 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph-osd.8.log 2024-09-11T23:38:11.965 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph-mds.l.log: gzip -5 --verbose -- /var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph-mgr.z.log 2024-09-11T23:38:11.965 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph-mds.c.log 2024-09-11T23:38:11.965 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph-mgr.z.log: gzip -5 --verbose -- /var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph-mds.f.log 2024-09-11T23:38:11.965 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-11T23:38:11.991 INFO:teuthology.orchestra.run.smithi037.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.log 2024-09-11T23:38:11.991 INFO:teuthology.orchestra.run.smithi037.stderr:: No such file or directory 2024-09-11T23:38:11.992 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph-osd.0.log 2024-09-11T23:38:11.993 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.log: gzip -5 --verbose -- /var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph-osd.9.log 2024-09-11T23:38:11.993 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-11T23:38:11.994 INFO:teuthology.orchestra.run.smithi037.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.log.gz 2024-09-11T23:38:11.994 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-11T23:38:11.995 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph-mds.a.log 2024-09-11T23:38:11.996 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-11T23:38:11.997 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph-mon.a.log 2024-09-11T23:38:11.997 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph-mds.g.log 2024-09-11T23:38:11.998 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph-osd.6.log 2024-09-11T23:38:11.999 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph.log 2024-09-11T23:38:12.000 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph-mds.d.log 2024-09-11T23:38:12.000 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph-mgr.x.log 2024-09-11T23:38:12.001 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph-mds.j.log 2024-09-11T23:38:12.002 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph-osd.3.log 2024-09-11T23:38:12.003 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph-mds.e.log: /var/log/ceph/cephadm.log: 93.4% -- replaced with /var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph-mds.h.log.gz 2024-09-11T23:38:12.004 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph-mds.j.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-11T23:38:12.004 INFO:teuthology.orchestra.run.smithi037.stderr: 86.9% -- replaced with /var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-11T23:38:12.006 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph-osd.3.log: /var/log/ceph/cephadm.log: 94.3% -- replaced with /var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph-mds.d.log.gz 2024-09-11T23:38:12.008 INFO:teuthology.orchestra.run.smithi037.stderr: 94.3% -- replaced with /var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph-mds.j.log.gz 2024-09-11T23:38:12.020 INFO:teuthology.orchestra.run.smithi123.stderr: 82.5% -- replaced with /var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-11T23:38:12.052 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph-mds.f.log: /var/log/ceph/cephadm.log: 82.4% -- replaced with /var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-11T23:38:12.067 INFO:teuthology.orchestra.run.smithi160.stderr: 92.1% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-11T23:38:12.079 INFO:teuthology.orchestra.run.smithi037.stderr: 82.4% -- replaced with /var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-11T23:38:12.099 INFO:teuthology.orchestra.run.smithi123.stderr: 90.4% -- replaced with /var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-11T23:38:12.103 INFO:teuthology.orchestra.run.smithi160.stderr: 93.2% -- replaced with /var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph-mgr.z.log.gz 2024-09-11T23:38:12.106 INFO:teuthology.orchestra.run.smithi123.stderr: 91.8% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-11T23:38:12.115 INFO:teuthology.orchestra.run.smithi123.stderr: 86.9% -- replaced with /var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-11T23:38:12.156 INFO:teuthology.orchestra.run.smithi037.stderr: 90.3% -- replaced with /var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-11T23:38:12.156 INFO:teuthology.orchestra.run.smithi123.stderr: 93.2% -- replaced with /var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph-mgr.y.log.gz 2024-09-11T23:38:12.171 INFO:teuthology.orchestra.run.smithi037.stderr: 93.6% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-11T23:38:12.252 INFO:teuthology.orchestra.run.smithi037.stderr: 94.5% -- replaced with /var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph-mds.g.log.gz 2024-09-11T23:38:12.283 INFO:teuthology.orchestra.run.smithi037.stderr: 91.0% -- replaced with /var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-11T23:38:12.288 INFO:teuthology.orchestra.run.smithi160.stderr: 91.0% -- replaced with /var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-11T23:38:12.291 INFO:teuthology.orchestra.run.smithi160.stderr: 93.8% -- replaced with /var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph-mds.i.log.gz 2024-09-11T23:38:12.318 INFO:teuthology.orchestra.run.smithi037.stderr: 94.5% -- replaced with /var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph-mds.a.log.gz 2024-09-11T23:38:12.454 INFO:teuthology.orchestra.run.smithi160.stderr: 90.5% -- replaced with /var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-11T23:38:12.725 INFO:teuthology.orchestra.run.smithi160.stderr: 94.1% -- replaced with /var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph-mds.f.log.gz 2024-09-11T23:38:12.759 INFO:teuthology.orchestra.run.smithi160.stderr: 86.9% -- replaced with /var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-11T23:38:12.817 INFO:teuthology.orchestra.run.smithi037.stderr: 90.4% -- replaced with /var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph-mgr.x.log.gz 2024-09-11T23:38:12.883 INFO:teuthology.orchestra.run.smithi123.stderr: 94.6% -- replaced with /var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph-mds.k.log.gz 2024-09-11T23:38:13.417 INFO:teuthology.orchestra.run.smithi160.stderr: 94.5% -- replaced with /var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph-mds.l.log.gz 2024-09-11T23:38:13.441 INFO:teuthology.orchestra.run.smithi123.stderr: 91.0% -- replaced with /var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-11T23:38:13.677 INFO:teuthology.orchestra.run.smithi123.stderr: 91.9% -- replaced with /var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph-mon.b.log.gz 2024-09-11T23:38:13.704 INFO:teuthology.orchestra.run.smithi123.stderr: 94.6% -- replaced with /var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph-mds.e.log.gz 2024-09-11T23:38:14.558 INFO:teuthology.orchestra.run.smithi160.stderr: 93.7% -- replaced with /var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph-mds.c.log.gz 2024-09-11T23:38:16.829 INFO:teuthology.orchestra.run.smithi037.stderr: 90.3% -- replaced with /var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph-mon.a.log.gz 2024-09-11T23:38:17.813 INFO:teuthology.orchestra.run.smithi160.stderr: 91.8% -- replaced with /var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph-mon.c.log.gz 2024-09-11T23:38:29.414 INFO:teuthology.orchestra.run.smithi123.stderr: 93.7% -- replaced with /var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph-mds.b.log.gz 2024-09-11T23:39:37.128 INFO:teuthology.orchestra.run.smithi160.stderr: 90.4% -- replaced with /var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph-osd.8.log.gz 2024-09-11T23:41:34.436 INFO:teuthology.orchestra.run.smithi123.stderr: 90.5% -- replaced with /var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph-osd.1.log.gz 2024-09-11T23:43:27.072 INFO:teuthology.orchestra.run.smithi123.stderr: 90.5% -- replaced with /var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph-osd.10.log.gz 2024-09-11T23:44:09.305 INFO:teuthology.orchestra.run.smithi123.stderr: 90.5% -- replaced with /var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph-osd.7.log.gz 2024-09-11T23:44:26.930 INFO:teuthology.orchestra.run.smithi123.stderr: 90.8% -- replaced with /var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph-osd.4.log.gz 2024-09-11T23:44:26.932 INFO:teuthology.orchestra.run.smithi123.stderr: 2024-09-11T23:44:26.932 INFO:teuthology.orchestra.run.smithi123.stderr:real 6m14.994s 2024-09-11T23:44:26.932 INFO:teuthology.orchestra.run.smithi123.stderr:user 5m29.981s 2024-09-11T23:44:26.933 INFO:teuthology.orchestra.run.smithi123.stderr:sys 0m12.040s 2024-09-11T23:47:46.440 INFO:teuthology.orchestra.run.smithi037.stderr: 90.6% -- replaced with /var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph-osd.0.log.gz 2024-09-11T23:48:28.237 INFO:teuthology.orchestra.run.smithi037.stderr: 90.5% -- replaced with /var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph-osd.3.log.gz 2024-09-11T23:49:23.156 INFO:teuthology.orchestra.run.smithi160.stderr: 90.6% -- replaced with /var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph-osd.11.log.gz 2024-09-11T23:50:26.589 INFO:teuthology.orchestra.run.smithi037.stderr: 90.7% -- replaced with /var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph-osd.6.log.gz 2024-09-11T23:50:48.481 INFO:teuthology.orchestra.run.smithi160.stderr: 90.9% -- replaced with /var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph-osd.2.log.gz 2024-09-11T23:51:12.642 INFO:teuthology.orchestra.run.smithi160.stderr: 90.6% -- replaced with /var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph-osd.5.log.gz 2024-09-11T23:51:12.643 INFO:teuthology.orchestra.run.smithi160.stderr: 2024-09-11T23:51:12.644 INFO:teuthology.orchestra.run.smithi160.stderr:real 13m0.706s 2024-09-11T23:51:12.644 INFO:teuthology.orchestra.run.smithi160.stderr:user 6m22.742s 2024-09-11T23:51:12.644 INFO:teuthology.orchestra.run.smithi160.stderr:sys 0m16.269s 2024-09-11T23:51:21.879 INFO:teuthology.orchestra.run.smithi037.stderr: 90.7% -- replaced with /var/log/ceph/8b03efce-7092-11ef-bcea-c7b262605968/ceph-osd.9.log.gz 2024-09-11T23:51:21.882 INFO:teuthology.orchestra.run.smithi037.stderr: 2024-09-11T23:51:21.882 INFO:teuthology.orchestra.run.smithi037.stderr:real 13m9.933s 2024-09-11T23:51:21.882 INFO:teuthology.orchestra.run.smithi037.stderr:user 7m47.467s 2024-09-11T23:51:21.882 INFO:teuthology.orchestra.run.smithi037.stderr:sys 0m52.328s 2024-09-11T23:51:21.884 INFO:tasks.cephadm:Archiving logs... 2024-09-11T23:51:21.884 DEBUG:teuthology.misc:Transferring archived files from smithi037:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901455/remote/smithi037/log 2024-09-11T23:51:21.885 DEBUG:teuthology.orchestra.run.smithi037:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-11T23:52:39.774 DEBUG:teuthology.misc:Transferring archived files from smithi123:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901455/remote/smithi123/log 2024-09-11T23:52:39.775 DEBUG:teuthology.orchestra.run.smithi123:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-11T23:53:39.751 DEBUG:teuthology.misc:Transferring archived files from smithi160:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901455/remote/smithi160/log 2024-09-11T23:53:39.752 DEBUG:teuthology.orchestra.run.smithi160:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-11T23:54:50.151 INFO:tasks.cephadm:Removing cluster... 2024-09-11T23:54:50.152 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 8b03efce-7092-11ef-bcea-c7b262605968 --force 2024-09-11T23:54:50.763 INFO:teuthology.orchestra.run.smithi037.stdout:Deleting cluster with fsid: 8b03efce-7092-11ef-bcea-c7b262605968 2024-09-11T23:54:52.912 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 8b03efce-7092-11ef-bcea-c7b262605968 --force 2024-09-11T23:54:53.124 INFO:teuthology.orchestra.run.smithi123.stdout:Deleting cluster with fsid: 8b03efce-7092-11ef-bcea-c7b262605968 2024-09-11T23:54:53.809 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 8b03efce-7092-11ef-bcea-c7b262605968 --force 2024-09-11T23:54:54.274 INFO:teuthology.orchestra.run.smithi160.stdout:Deleting cluster with fsid: 8b03efce-7092-11ef-bcea-c7b262605968 2024-09-11T23:54:55.063 INFO:tasks.cephadm:Removing cephadm ... 2024-09-11T23:54:55.063 DEBUG:teuthology.orchestra.run.smithi037:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-11T23:54:55.120 DEBUG:teuthology.orchestra.run.smithi123:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-11T23:54:55.141 DEBUG:teuthology.orchestra.run.smithi160:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-11T23:54:55.157 INFO:tasks.cephadm:Teardown complete 2024-09-11T23:54:55.157 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-11T23:54:55.171 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-11T23:54:55.172 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-11T23:54:55.176 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-11T23:54:55.183 DEBUG:teuthology.orchestra.run.smithi160:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-11T23:54:55.350 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-11T23:54:55.469 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-11T23:54:55.469 DEBUG:teuthology.orchestra.run.smithi037:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T23:54:55.474 DEBUG:teuthology.orchestra.run.smithi123:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T23:54:55.476 DEBUG:teuthology.orchestra.run.smithi160:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T23:54:55.491 INFO:teuthology.orchestra.run.smithi160.stderr:bash: line 1: ntpq: command not found 2024-09-11T23:54:55.491 INFO:teuthology.orchestra.run.smithi123.stderr:bash: line 1: ntpq: command not found 2024-09-11T23:54:55.506 INFO:teuthology.orchestra.run.smithi037.stderr:bash: line 1: ntpq: command not found 2024-09-11T23:54:55.510 INFO:teuthology.orchestra.run.smithi123.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T23:54:55.510 INFO:teuthology.orchestra.run.smithi123.stdout:=============================================================================== 2024-09-11T23:54:55.510 INFO:teuthology.orchestra.run.smithi123.stdout:^* hv01.front.sepia.ceph.com 3 6 377 6 +1897us[+1905us] +/- 51ms 2024-09-11T23:54:55.510 INFO:teuthology.orchestra.run.smithi123.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 5 -1482us[-1482us] +/- 77ms 2024-09-11T23:54:55.511 INFO:teuthology.orchestra.run.smithi123.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 6 -1509us[-1501us] +/- 83ms 2024-09-11T23:54:55.511 INFO:teuthology.orchestra.run.smithi123.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T23:54:55.537 INFO:teuthology.orchestra.run.smithi160.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T23:54:55.537 INFO:teuthology.orchestra.run.smithi160.stdout:=============================================================================== 2024-09-11T23:54:55.537 INFO:teuthology.orchestra.run.smithi160.stdout:^* hv01.front.sepia.ceph.com 3 6 377 9 +1909us[+1910us] +/- 51ms 2024-09-11T23:54:55.537 INFO:teuthology.orchestra.run.smithi160.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 11 -1481us[-1479us] +/- 77ms 2024-09-11T23:54:55.537 INFO:teuthology.orchestra.run.smithi160.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 10 -1508us[-1507us] +/- 83ms 2024-09-11T23:54:55.537 INFO:teuthology.orchestra.run.smithi160.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T23:54:55.623 INFO:teuthology.orchestra.run.smithi037.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T23:54:55.623 INFO:teuthology.orchestra.run.smithi037.stdout:=============================================================================== 2024-09-11T23:54:55.623 INFO:teuthology.orchestra.run.smithi037.stdout:^* hv01.front.sepia.ceph.com 3 6 377 12 +1956us[+1942us] +/- 51ms 2024-09-11T23:54:55.623 INFO:teuthology.orchestra.run.smithi037.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 11 -1405us[-1405us] +/- 77ms 2024-09-11T23:54:55.624 INFO:teuthology.orchestra.run.smithi037.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 5 -1458us[-1458us] +/- 83ms 2024-09-11T23:54:55.624 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T23:54:55.625 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-11T23:54:55.638 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-11T23:54:55.639 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-11T23:54:55.728 DEBUG:teuthology.orchestra.run.smithi037:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-11T23:54:55.939 DEBUG:teuthology.orchestra.run.smithi123:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-11T23:54:56.067 DEBUG:teuthology.orchestra.run.smithi160:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-11T23:54:56.185 DEBUG:teuthology.orchestra.run.smithi037:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-11T23:54:56.248 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T23:54:56.249 DEBUG:teuthology.orchestra.run.smithi123:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-11T23:54:56.279 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T23:54:56.280 DEBUG:teuthology.orchestra.run.smithi160:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-11T23:54:56.311 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T23:54:56.312 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-11T23:54:56.322 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-11T23:54:56.336 INFO:teuthology.task.internal:Duration was 3276.701642 seconds 2024-09-11T23:54:56.337 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-11T23:54:56.591 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-11T23:54:56.591 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-11T23:54:56.595 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-11T23:54:56.599 DEBUG:teuthology.orchestra.run.smithi160:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-11T23:54:56.670 INFO:teuthology.orchestra.run.smithi160.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T23:54:56.673 INFO:teuthology.orchestra.run.smithi123.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T23:54:56.691 INFO:teuthology.orchestra.run.smithi037.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T23:54:57.175 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-11T23:54:57.175 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi037.front.sepia.ceph.com 2024-09-11T23:54:57.176 DEBUG:teuthology.orchestra.run.smithi037:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-11T23:54:57.234 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi123.front.sepia.ceph.com 2024-09-11T23:54:57.234 DEBUG:teuthology.orchestra.run.smithi123:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-11T23:54:57.276 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi160.front.sepia.ceph.com 2024-09-11T23:54:57.276 DEBUG:teuthology.orchestra.run.smithi160:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-11T23:54:57.317 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-11T23:54:57.317 DEBUG:teuthology.orchestra.run.smithi037:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-11T23:54:57.321 DEBUG:teuthology.orchestra.run.smithi123:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-11T23:54:57.324 DEBUG:teuthology.orchestra.run.smithi160:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-11T23:54:57.389 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-11T23:54:57.389 DEBUG:teuthology.orchestra.run.smithi037:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-11T23:54:57.393 DEBUG:teuthology.orchestra.run.smithi123:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-11T23:54:57.400 DEBUG:teuthology.orchestra.run.smithi160:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-11T23:54:58.007 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-11T23:54:58.019 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-11T23:54:58.019 DEBUG:teuthology.orchestra.run.smithi037:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-11T23:54:58.077 DEBUG:teuthology.orchestra.run.smithi123:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-11T23:54:58.119 DEBUG:teuthology.orchestra.run.smithi160:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-11T23:54:58.160 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-11T23:54:58.180 DEBUG:teuthology.orchestra.run.smithi037:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-11T23:54:58.185 DEBUG:teuthology.orchestra.run.smithi123:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-11T23:54:58.187 DEBUG:teuthology.orchestra.run.smithi160:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-11T23:54:58.231 INFO:teuthology.orchestra.run.smithi160.stdout:kernel.core_pattern = core 2024-09-11T23:54:58.263 INFO:teuthology.orchestra.run.smithi123.stdout:kernel.core_pattern = core 2024-09-11T23:54:58.272 INFO:teuthology.orchestra.run.smithi037.stdout:kernel.core_pattern = core 2024-09-11T23:54:58.310 DEBUG:teuthology.orchestra.run.smithi037:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-11T23:54:58.343 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T23:54:58.344 DEBUG:teuthology.orchestra.run.smithi123:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-11T23:54:58.358 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T23:54:58.358 DEBUG:teuthology.orchestra.run.smithi160:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-11T23:54:58.373 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T23:54:58.373 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-11T23:54:58.527 INFO:teuthology.task.internal:Transferring archived files... 2024-09-11T23:54:58.529 DEBUG:teuthology.misc:Transferring archived files from smithi037:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901455/remote/smithi037 2024-09-11T23:54:58.529 DEBUG:teuthology.orchestra.run.smithi037:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-11T23:54:58.607 DEBUG:teuthology.misc:Transferring archived files from smithi123:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901455/remote/smithi123 2024-09-11T23:54:58.608 DEBUG:teuthology.orchestra.run.smithi123:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-11T23:54:58.644 DEBUG:teuthology.misc:Transferring archived files from smithi160:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901455/remote/smithi160 2024-09-11T23:54:58.644 DEBUG:teuthology.orchestra.run.smithi160:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-11T23:54:58.683 INFO:teuthology.task.internal:Removing archive directory... 2024-09-11T23:54:58.683 DEBUG:teuthology.orchestra.run.smithi037:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-11T23:54:58.687 DEBUG:teuthology.orchestra.run.smithi123:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-11T23:54:58.690 DEBUG:teuthology.orchestra.run.smithi160:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-11T23:54:58.731 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-11T23:54:58.752 INFO:teuthology.task.internal:Not uploading archives. 2024-09-11T23:54:58.752 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-11T23:54:58.974 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-11T23:54:58.974 DEBUG:teuthology.orchestra.run.smithi037:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-11T23:54:58.979 DEBUG:teuthology.orchestra.run.smithi123:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-11T23:54:58.981 DEBUG:teuthology.orchestra.run.smithi160:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-11T23:54:58.994 INFO:teuthology.orchestra.run.smithi123.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 11 23:54 /home/ubuntu/cephtest 2024-09-11T23:54:58.996 INFO:teuthology.orchestra.run.smithi160.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 11 23:54 /home/ubuntu/cephtest 2024-09-11T23:54:59.010 INFO:teuthology.orchestra.run.smithi037.stdout: 393233 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 11 23:54 /home/ubuntu/cephtest 2024-09-11T23:54:59.012 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-11T23:54:59.229 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-11T23:54:59.769 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/no} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/no 5-quiesce/no 6-workunit/postgres}} duration: 3276.7016422748566 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-11T23:54:59.769 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-11T23:54:59.863 INFO:teuthology.run:pass